CN114173193A

CN114173193A - Multimedia stream playing method and electronic equipment

Info

Publication number: CN114173193A
Application number: CN202010949875.1A
Authority: CN
Inventors: 方荣杰; 李德永; 陈向军; 王云路; 崔云颀
Original assignee: Huawei Technologies Co Ltd
Current assignee: Huawei Technologies Co Ltd
Priority date: 2020-09-10
Filing date: 2020-09-10
Publication date: 2022-03-11
Also published as: WO2022052791A1

Abstract

The embodiment of the application discloses a multimedia stream playing method and electronic equipment, and relates to the field of electronic equipment, so that the multimedia stream can be more accurately and stably played continuously among different equipment, and the operation is easy. The specific scheme is as follows: the first electronic device detects first biometric information, the first biometric information is used for identifying a first user, and the biometric information of different users is different. The first electronic device acquires a first broadcast control record corresponding to the first user according to the first biological identification information. The first broadcast control record is acquired from the second electronic device, the first broadcast control record comprises a first time of the first multimedia stream recorded by the second electronic device, and the second electronic device is an electronic device corresponding to the first user. The first electronic device plays the first multimedia stream from a first time according to the first play control record.

Description

Multimedia stream playing method and electronic equipment

Technical Field

The embodiment of the application relates to the field of electronic equipment, in particular to a multimedia stream playing method and electronic equipment.

Background

At present, most electronic devices (such as mobile phones and televisions) can acquire multimedia files from a network and play the multimedia files. Illustratively, the multimedia files may include video stream files, and network audio streams, among others.

Take the multimedia file acquired and played by the electronic device as the video stream file (referred to as video stream for short) acquired by the electronic device through the network as an example. The mobile phone of the user can provide the service of playing the video stream for the user in the commuting process of the user. Other electronic devices of the user, such as a television at home, may also provide the user with the service of playing the video stream after the user returns to home. However, if the user goes out and goes back to the residence, and wants to continue watching the video played on the mobile phone on the television, the user needs to turn on the television and then turn on the related video again, or needs to perform multiple operations to actively associate the video playing information of the two devices, the continuous playing of the video between different devices is troublesome, and currently, there is no intelligent inter-device video switching playing scheme.

Disclosure of Invention

The embodiment of the application provides a multimedia stream playing method and electronic equipment, so that the multimedia stream can be played continuously between different equipment more accurately and stably, and the operation is easy.

In order to achieve the above purpose, the embodiment of the present application adopts the following technical solutions:

in a first aspect, a method for playing a multimedia stream is provided, where the method is applied to a first electronic device having a function of playing the multimedia stream, and the method includes: the first electronic device detects first biometric information, the first biometric information is used for identifying a first user, and the biometric information of different users is different. The first electronic device acquires a first broadcast control record corresponding to the first user according to the first biological identification information. The first broadcast control record is acquired from the second electronic device, the first broadcast control record comprises a first time of the first multimedia stream recorded by the second electronic device, and the second electronic device is an electronic device corresponding to the first user. The first electronic device plays the first multimedia stream from a first time according to the first play control record.

Based on this scheme, the first electronic device (e.g., a television) may actively acquire biometric information of a current user (e.g., a first user). For example, the television may obtain face information and/or voiceprint information of the current user. The television can also determine the broadcast control record corresponding to the biological identification information according to the acquired biological identification information. As an example, the tv may store biometric information corresponding to different users and broadcast control records corresponding to different users. The television may then use the current biometric information to compare with the stored plurality of biometric information to determine the current user (or the identity of the current user). The television may determine its corresponding broadcast control record based on the current user (or the identity of the current user). It can be understood that the current user is the user who uses the television at present, and therefore, obviously, there is a demand for using the television, the television can continue to play at the breakpoint according to the play control record corresponding to the current user, so that the current user can continue to watch the multimedia stream that has not been watched on the second electronic device (such as a mobile phone) before through the television without inputting any operation. Meanwhile, the television can be accurately matched with the corresponding broadcast control record according to the biological identification information of the current user, so that the breakpoint continuous broadcast based on the broadcast control record is accurate. In addition, the biometric information and the broadcast control record are only shared between the first electronic device and the second electronic device, and other relay devices (such as a server and the like) are not needed, so that the biometric information and the broadcast control record are more stable. It should be noted that, in some examples of the present application, when the television continues playing according to the first play control record, the television may also start playing the first multimedia stream from a time slightly earlier than the first time, so that the user can obtain a better continuous playing viewing experience.

In one possible design, the first time of the first multimedia stream recorded by the second electronic device is a time when the playing of the first multimedia stream by the second electronic device is interrupted. The interruption of the corresponding operation comprises stopping, pausing or exiting the playing of the first multimedia stream. Based on this scheme, a specific example of the first time is provided. For example, the first time may be an operation of the second electronic device (e.g., a mobile phone) receiving a user input to interrupt the playing of the first multimedia stream. The user can input the operation by touching corresponding controls, buttons and the like on the mobile phone, or the user can input the operation by voice control or other input equipment. Therefore, the first electronic equipment can accurately continue playing the first multimedia stream from the position which is watched by the user last time when the breakpoint continuous playing is required.

In one possible design, the method further includes: and under the condition that the second electronic equipment and the first electronic equipment are in the same local area network, the first electronic equipment acquires the first broadcast control record from the second electronic equipment. Based on the scheme, a sharing mechanism of the broadcast control record is provided. For example, a first broadcast control record is stored in a mobile phone, and in general, the mobile phone follows a user, so when the user returns to his/her residence, the mobile phone will be in the same local area network as the television of the residence, and at this time, a demand for performing a breakpoint resume on the television according to the first broadcast control record may occur. In this example, when the mobile phone and the television are in the same local area network, the television may send a request for obtaining the broadcast control record to the mobile phone, so that the mobile phone responds to the request and sends the corresponding broadcast control record to the television. It should be noted that in other implementations, when the mobile phone and the television are in the same local area network, the mobile phone may actively send the broadcast control record to the television without the television sending a corresponding request. In other implementations, the television may obtain the corresponding broadcast control record from the mobile phone only when it is determined that the current user is a user corresponding to the mobile phone.

In one possible design, the first electronic device detects first biometric information, including: when the first electronic equipment is awakened from the screen, the first biological identification information is triggered and detected. Or when the first electronic device detects the user through an image acquisition module and/or a sound acquisition module arranged on the first electronic device, triggering to detect the first biological identification information. Or the first electronic equipment triggers the detection of the first biological identification information when the operation of the first electronic equipment by the user is detected. Based on this solution, a mechanism is provided for a first electronic device (e.g. a television) to actively detect biometric information of a user. For example, the television may begin detecting biometric information of the current user upon waking up from the screen. As another example, the television may begin detecting biometric information of the current user upon detecting the user's voice or face. For another example, the tv may start to detect the biometric information of the current user when receiving an operation of the tv by the user, such as an instruction input to the tv by the user through a tv remote controller.

In one possible design, the obtaining, by the first electronic device, the first broadcast control record corresponding to the first user according to the first biometric information specifically includes: and the first electronic equipment matches the detected first biological identification information with the stored second biological identification information of the first user, and acquires a first broadcast control record corresponding to the first user according to a matching result. Wherein the second biometric information of the first user is obtained from the second electronic device. Based on the scheme, a specific scheme for determining the corresponding broadcast control record by the television according to the biometric information of the current user is provided. It can be understood that, by the scheme, the television can accurately acquire the broadcast control record corresponding to the current user. For example, the tv may have acquired broadcast control records of all users before acquiring the biometric information of the current user, and then after determining the matching result, the tv may acquire the corresponding broadcast control record locally. In other implementations, the television may determine the identity of the current user locally after obtaining the biometric information of the current user, and then obtain the corresponding broadcast control record from the mobile phone of the user with the identity. In other implementation manners, after acquiring the biometric information of the current user, the television may directly acquire the corresponding broadcast control record from the mobile phone of the corresponding user according to the biometric information. The specific implementation of the television for acquiring the broadcast control record is not limited.

In one possible design, the method further includes: when the second electronic device and the first electronic device are in the same local area network, the first electronic device acquires second biological identification information of the first user from the second electronic device. Based on the scheme, when the television and the mobile phone are in the same local area network, the biological identification information of the corresponding user stored in the mobile phone can be obtained and stored. So that the television can determine the current user according to the corresponding relation between the stored biological identification information and the user (or the user identification) after acquiring the identification information of the current user. It should be noted that, in some implementations, the television may obtain the biometric information of the user corresponding to the mobile phone when the television and the mobile phone are in the same local area network for the first time. And when the mobile phone is in the same local area network with the television next time, the television can not acquire the corresponding biological identification information from the mobile phone any more. Therefore, the television can not repeatedly acquire the biological identification information of the same user, and the signaling overhead between the television and the mobile phone can also be reduced.

In one possible design, the first electronic device obtains the second biometric information of the first user from the second electronic device in a case where the second electronic device obtains the authorization information of the first user. Based on the scheme, a scheme capable of improving the safety of the user biological identification information is provided. For example, the mobile phone may present the corresponding authorization interface to the user before transmitting the biometric information of the corresponding user to the television, so as to perform sharing of the biometric information under the authorization of the user.

In one possible design, the first electronic device has a secure world TE disposed therein, and the method further includes: the first electronic device stores the acquired second biometric information of the first user in the TE. Based on this scheme, another scheme for improving the security of biometric information is provided. For example, the TE and RE may be provided in a television and/or a handset. The television can store the biometric information in the TE, isolated from other information (e.g., broadcast control information) to improve information security.

In one possible design, the method further includes: the first electronic device detects third biometric information, the third biometric information identifying the second user. And the first electronic equipment acquires a second broadcast control record corresponding to the second user according to the third biological identification information. Wherein the second broadcast record is obtained from a third electronic device. The second broadcast control record includes a second time of a second multimedia stream recorded by a third electronic device, the third electronic device being an electronic device corresponding to the second user. The first electronic device plays the second multimedia stream from the second time according to the second play control record. Based on the scheme, if the current user is no longer the first user, for example, the current user is the second user, the television can also acquire the biometric information of the corresponding user and execute the corresponding breakpoint continuous playing. Thereby enabling the scheme of the present example to provide accurate, stable and easy-to-operate breakpoint continuous play for different users.

In one possible design, the first electronic device plays the first multimedia stream starting from a first time according to the first play control recording, including: and the first electronic equipment directly continues to play the first multimedia stream from the first time on the interface of the first electronic equipment according to the first play control record. Or the first electronic device displays a first prompt corresponding to the first broadcast control record on an interface of the first electronic device according to the first broadcast control record. The first electronic device receives a first operation of the first prompt, and in response to the first operation, the first electronic device continues to play the first multimedia stream on the interface from a first time. Based on the scheme, at least two possible schemes for the first electronic equipment (such as a television) to carry out breakpoint play are provided. For example, the first electronic device may directly display a breakpoint resume on its interface according to the first play control record, such as continuing to play the corresponding video stream from the first time. For another example, the first electronic device may display a prompt corresponding to the play record on its interface, and the prompt may be presented to the user in the form of a card. In the cue, related content in the first broadcast control record, such as a name of the video stream, related information of an APP playing the video stream, a key frame screenshot of the video stream, and the like, may be included. By this prompt, the user can intuitively confirm whether or not the video stream that is continuously played at the breakpoint is a video stream that the user wants to watch continuously. Therefore, the breakpoint continuous playing of the television according to the confirmation of the prompt by the user is more reliable.

In one possible design, when the first electronic device detects the first biometric information of the first user and the second biometric information of the second user at the same time, the method further includes: and the first electronic equipment plays the first multimedia stream or the second multimedia stream according to the priority according to the first broadcast control record and the second broadcast control record. Or the first electronic equipment randomly selects to play the first multimedia stream or the second multimedia stream according to the first broadcast control record and the second broadcast control record. Or according to the selection of the user, the first electronic equipment plays the first multimedia stream or the second multimedia stream. Based on the scheme, a coping strategy when the television detects two users simultaneously is provided. For example, the television can select the corresponding broadcast control record according to the low priority of the user to perform breakpoint continuous broadcasting. For another example, the television may select the corresponding broadcast control record according to the priority of the broadcast control record to perform breakpoint continuous broadcasting. For another example, the television can select one broadcast control record from the broadcast control records corresponding to a plurality of current users, and perform breakpoint continuous broadcasting according to the selected broadcast control record. For another example, the television may display a prompt corresponding to each broadcast control record on its interface, so as to perform breakpoint continuous broadcasting according to the corresponding broadcast control record according to the operation input by the user. The embodiment of the application can flexibly select the specific implementation of breakpoint continuous playing under the scene with a plurality of current users according to the requirement, and can also select and determine the breakpoint continuous playing according to the preset configuration of the users.

In a possible design, if the first electronic device detects the first user and the third user at the same time, before the first electronic device starts playing the first multimedia stream from the first time according to the first play control record, the method further includes: and the first electronic equipment displays the prompt information of the first broadcast control record, and the prompt information hides all or part of the information related to the first multimedia stream. Based on the scheme, the scheme capable of achieving the privacy and confidentiality functions of the user is provided. In this example, the television may display a prompt corresponding to each broadcast control record on its interface when multiple broadcast control records are determined according to the current user. As one possible implementation, the prompt may be a card displayed on the interface. In the card corresponding to each broadcast control record, information corresponding to the broadcast control record may be displayed. In this example, due to the existence of multiple users, the information in the card may hide part or all of the information corresponding to the broadcast control record, and only the content that the user can recognize the correspondence relationship between the card and the user is provided, so that the privacy effect on the related privacy of the history of the user watching the video stream can be played.

In one possible design, the first broadcast record further includes device information of the second electronic device. Based on the scheme, a realization mode of broadcast control recording is provided. For example, the device information of the handset that generated the broadcast record, i.e., the handset that previously played the video stream, may also be included in the broadcast record. For example, the device information may include a model of a mobile phone, software information, and the like.

In one possible design, the first electronic device adjusts the playing of the first multimedia stream according to the device information of the second electronic device. Based on the scheme, the method for ensuring the television to normally play the first multimedia stream is provided. For example, the television can know the playing environment of the video stream on the mobile phone according to the device information included in the play control record, and the normal continuous playing of the multimedia stream on the television is ensured by combining the playing capability of the multimedia stream which can be provided by the television.

In one possible design, the method further includes: when the first electronic device plays the first multimedia stream, a third play control record for playing the first multimedia stream is obtained, and the third play control record is used for indicating a third time when the first multimedia stream is played currently. And the first electronic equipment sends the third broadcast control record to the second electronic equipment so that the second electronic equipment can continue to play the first multimedia stream from the third time according to the third broadcast control record. Based on the scheme, a breakpoint playing scheme for a first electronic device (such as a television) to a second electronic device (such as a mobile phone) is provided. For example, the television may generate a corresponding broadcast control record according to a video stream being played, generate the broadcast control record according to a certain period, or generate the broadcast control record in real time, and send the broadcast control record to the mobile phone. Therefore, when the user wants to use the mobile phone to continuously watch the video stream, the mobile phone can provide the breakpoint continuous playing service for the user according to the play control record.

In a second aspect, a playing apparatus for multimedia stream is provided, which is applied to a first electronic device having a function of playing multimedia stream, and includes: the device comprises a detection unit, an acquisition unit and a playing unit. The detection unit is used for detecting first biological identification information, the first biological identification information is used for identifying a first user, and the biological identification information of different users is different. The acquisition unit is used for acquiring a first broadcast control record corresponding to a first user according to the first biological identification information. The first broadcast control record is acquired from the second electronic device, the first broadcast control record comprises a first time of the first multimedia stream recorded by the second electronic device, and the second electronic device is an electronic device corresponding to the first user. And the playing unit is used for playing the first multimedia stream from the first time according to the first play control record.

In one possible design, the first time of the first multimedia stream recorded by the second electronic device is a time when the playing of the first multimedia stream by the second electronic device is interrupted. The interruption of the corresponding operation comprises stopping, pausing or exiting the playing of the first multimedia stream.

In a possible design, the obtaining unit is further configured to, in a case where the second electronic device is in the same local area network as the first electronic device, obtain, by the first electronic device, the first broadcast control record from the second electronic device.

In one possible design, the detection unit is configured to trigger detection of the first biometric information when the screen is turned off and awakened. Or the detection unit is used for triggering and detecting the first biological identification information when the image acquisition module and/or the sound acquisition module arranged on the first electronic equipment detect the user. Or the detection unit is used for triggering the detection of the first biological identification information when the operation of the first electronic equipment by the user is detected.

In one possible design, the obtaining unit is configured to match the detected first biometric information with stored second biometric information of the first user, and obtain a first broadcast control record corresponding to the first user according to a matching result. Wherein the second biometric information of the first user is obtained from the second electronic device.

In a possible design, the obtaining unit is further configured to obtain, from the second electronic device, the second biometric information of the first user when the second electronic device is in the same local area network as the first electronic device.

In one possible design, the obtaining unit is configured to obtain the second biometric information of the first user from the second electronic device if the second electronic device obtains the authorization information of the first user.

In one possible design, a secure world (TE) is provided in the first electronic device, and the apparatus further includes: a storage unit for storing the acquired second biometric information of the first user in the TE.

In one possible embodiment, the detection unit is further configured to detect third biometric information, and the third biometric information is used to identify the second user. And the acquisition unit is used for acquiring a second broadcast control record corresponding to the second user according to the third biological identification information. Wherein the second broadcast record is obtained from a third electronic device. The second broadcast control record includes a second time of a second multimedia stream recorded by a third electronic device, the third electronic device being an electronic device corresponding to the second user. And the playing unit is used for playing the second multimedia stream from the second time according to the second play control record.

In one possible design, the playing unit is configured to continue playing the first multimedia stream directly on the interface of the first electronic device from the first time according to the first play control record. Or the playing unit is used for displaying a first prompt corresponding to the first broadcast control record on an interface of the first electronic equipment according to the first broadcast control record. The first electronic device receives a first operation of the first prompt, and in response to the first operation, the first electronic device continues to play the first multimedia stream on the interface from a first time.

In a possible design, when the first electronic device detects the first biometric information of the first user and the second biometric information of the second user at the same time, the playing unit is configured to play the first multimedia stream or the second multimedia stream according to the priority according to the first broadcast control record and the second broadcast control record. Or the playing unit is used for randomly selecting and playing the first multimedia stream or the second multimedia stream according to the first play control record and the second play control record. Or a playing unit, for playing the first multimedia stream or the second multimedia stream according to the selection of the user.

In a possible design, if the first electronic device detects the first user and the third user at the same time, the playing unit is further configured to display a prompt message of the first broadcast control record before the first electronic device starts playing the first multimedia stream from the first time according to the first broadcast control record, where the prompt message hides all or part of information related to the first multimedia stream.

In one possible design, the first broadcast record further includes device information of the second electronic device.

In a possible design, the playing unit is further configured to adjust playing of the first multimedia stream according to the device information of the second electronic device.

In a possible design, the obtaining unit is further configured to obtain, when the first multimedia stream is played, a third play control record for playing the first multimedia stream, where the third play control record is used to indicate a third time when the first multimedia stream is currently played. The device further comprises a sending unit, configured to send, by the first electronic device, the third broadcast control record to the second electronic device, so that the second electronic device continues to play the first multimedia stream from the third time according to the third broadcast control record.

In a third aspect, an electronic device is provided that includes one or more processors and one or more memories; one or more memories coupled with the one or more processors, the one or more memories storing computer instructions; the computer instructions, when executed by the one or more processors, cause the communication device to perform a method of playing a multimedia stream as described in any one of the first aspect and its possible designs.

In a fourth aspect, a chip system is provided, which can be applied in public devices (such as televisions). Illustratively, the system-on-a-chip includes an interface circuit and a processor; the interface circuit and the processor are interconnected through a line; the interface circuit is used for receiving signals from a memory of the electronic device and sending signals to the processor, wherein the signals comprise computer instructions stored in the memory; when the processor executes the computer instructions, the system-on-chip performs the method for playing a multimedia stream as described in any one of the first aspect and its possible designs.

In a fifth aspect, there is provided a computer readable storage medium comprising computer instructions which, when executed, perform a method of playing back a multimedia stream as described in any one of the first aspect and its possible designs.

A sixth aspect provides a computer program product comprising instructions which, when run on a computer, enable the computer to perform a method of playing a multimedia stream according to any one of the first aspect and its possible designs.

It should be understood that, in the technical solutions provided in the second aspect, the third aspect, the fourth aspect, the fifth aspect and the sixth aspect, technical features of the technical solutions may all correspond to the playing method of the multimedia stream provided in the first aspect and possible designs thereof, and therefore beneficial effects that can be achieved are similar and will not be described herein again.

In a seventh aspect, a method for playing a multimedia stream is provided, where the method is applied to a first electronic device having a function of playing the multimedia stream, and the method includes: the first electronic device obtains a first broadcast control record, wherein the first broadcast control record comprises a first time of a first multimedia stream recorded by the first electronic device, and the first multimedia stream is played to a first user by the first electronic device. The first electronic device sends the first broadcast control record to the second electronic device, so that the second electronic device continues to play the first multimedia stream to the first user from the first time according to the first broadcast control record.

Based on the scheme, a scheme is provided, so that a first electronic device (such as a mobile phone) can provide a broadcast control record for breakpoint continuous playing to a second electronic device (such as a television). And then only through the interaction of two devices, namely realize the breakpoint continuous play between different devices of the multimedia stream, make the breakpoint continuous play service more accurate and stable from this, and because can not need any operation of user, therefore it is easier to operate.

In one possible design, the first electronic device obtains a first broadcast record, including: the first electronic device generates a first play control record when detecting an operation of interrupting the play of the first multimedia stream, wherein the operation corresponding to the interruption includes an operation of stopping, pausing or exiting the play of the first multimedia stream. Based on the scheme, a specific scheme for generating the broadcast control record by the mobile phone is provided. For example, the mobile phone may generate and store the play control record when receiving an instruction for interrupting the play input by the user.

In one possible design, a first electronic device sends a first broadcast record to a second electronic device, including: and under the condition that the second electronic equipment and the first electronic equipment are in the same local area network, the first electronic equipment sends the first broadcast control record to the second electronic equipment. Based on the scheme, a scheme for sharing the broadcast control record among different electronic devices is provided. For example, the mobile phone may store the broadcast control record, and when the mobile phone and the second electronic device (e.g., a television) are in the same local area network, the mobile phone may actively send the broadcast control record to the television, or when receiving a request for the broadcast control record of the television, the mobile phone may send the broadcast control record to the television.

In one possible design, before the first electronic device sends the first broadcast record to the second electronic device, the method further includes: the first electronic equipment sends first biological identification information of the first user to the second electronic equipment, so that the second electronic equipment determines to continue playing the first multimedia stream according to the first broadcast control record according to the first biological identification information. Based on the scheme, a scheme for sharing biometric information is provided. For example, the mobile phone may store the biometric information of the user, and the mobile phone may actively transmit the biometric information to the television when the mobile phone is in the same local area network with the television for the first time, or transmit the biometric information at the request of the television. It should be noted that, in some implementations, the mobile phone may obtain the authorization of the user before sending the biometric information to the television, thereby improving the security of the biometric information.

In an eighth aspect, a playing apparatus for multimedia stream is provided, which is applied to a first electronic device having a function of playing multimedia stream, and includes: the device comprises an acquisition unit and a sending unit. The device comprises an acquisition unit, a storage unit and a processing unit, wherein the acquisition unit is used for acquiring a first broadcast control record, and the first broadcast control record comprises a first time of a first multimedia stream recorded by first electronic equipment, and the first multimedia stream is played to a first user by the first electronic equipment. And the sending unit is used for sending the first broadcast control record to the second electronic equipment so that the second electronic equipment can continue to play the first multimedia stream to the first user from the first time according to the first broadcast control record.

In a possible design, the obtaining unit is specifically configured to generate the first play control record when an operation of interrupting the playing of the first multimedia stream is detected, where the operation corresponding to the interruption includes an operation of stopping, pausing, or exiting the playing of the first multimedia stream.

In a possible design, the sending unit is configured to send the first broadcast control record to the second electronic device when the second electronic device and the first electronic device are in the same local area network.

In a possible design, the sending unit is further configured to send, by the second electronic device, the first biometric information of the first user to the second electronic device when the second electronic device is in the same local area network as the first electronic device, so that the second electronic device determines to continue playing the first multimedia stream according to the first broadcast control record according to the first biometric information.

In a ninth aspect, an electronic device is provided that includes one or more processors and one or more memories; one or more memories coupled with the one or more processors, the one or more memories storing computer instructions; the computer instructions, when executed by the one or more processors, cause the communication device to perform a method of playing a multimedia stream as described in any one of the first aspect and its possible designs.

In a tenth aspect, a chip system is provided, which can be applied in a public device (such as a television). Illustratively, the system-on-a-chip includes an interface circuit and a processor; the interface circuit and the processor are interconnected through a line; the interface circuit is used for receiving signals from a memory of the electronic device and sending signals to the processor, wherein the signals comprise computer instructions stored in the memory; when the processor executes the computer instructions, the system-on-chip performs the method for playing a multimedia stream as described in any one of the first aspect and its possible designs.

In an eleventh aspect, there is provided a computer-readable storage medium comprising computer instructions which, when executed, perform a method of playing back a multimedia stream as described in any one of the first aspect and its possible designs.

In a twelfth aspect, a computer program product is provided, which comprises instructions that, when run on a computer, enable the computer to perform the method for playing back a multimedia stream according to any one of the first aspect and its possible designs.

It should be understood that, in the technical solutions provided in the above-mentioned eighth aspect, ninth aspect, tenth aspect, eleventh aspect and twelfth aspect, the technical features thereof can all correspond to the playing method of the multimedia stream provided in the first aspect and possible designs thereof, and therefore, similar beneficial effects can be achieved, and details are not repeated herein.

In a thirteenth aspect, a system for playing a multimedia stream is provided. The playing system at least comprises a first electronic device and a second electronic device. Illustratively, the first electronic device may be a public device referred to in the embodiments of the present application, for example, the first electronic device may be a television. The second electronic device may be a private device referred to in the embodiments of the present application, for example, the second electronic device may be a mobile phone. In some implementations, the first electronic device may be the apparatus provided in the second aspect or the electronic device provided in the third aspect. The second electronic device may be the apparatus provided in the eighth aspect or the electronic device provided in the ninth aspect. In this example, the playing system of the multimedia stream may be configured to execute the playing method of the multimedia stream as provided in any one of the above first aspect and its possible design, and/or the user may execute the playing method of the multimedia stream as provided in any one of the above seventh aspect and its possible design.

As an example, the second electronic device may be configured to obtain a first play record including a first time of a first multimedia stream recorded by the second electronic device, wherein the first multimedia stream is played by the second electronic device to the first user. The second electronic device may also be configured to send the first broadcast control record to the first electronic device. The first electronic device may be configured to detect first biometric information identifying a first user, the biometric information of different users being different. The first electronic device can also be used for acquiring a first broadcast control record corresponding to the first user according to the first biological identification information. The first electronic device may be further configured to play the first multimedia stream starting from the first time in accordance with the first play control recording.

In other examples, the playing system of the multimedia stream may also be used to perform all or part of the steps in the playing method of other multimedia streams provided in the embodiments of the present application.

It should be understood that, technical features of the multimedia stream playing system provided in the thirteenth aspect may all correspond to the first aspect and its possible design, or the multimedia stream playing method provided in the second aspect and its possible design, and therefore, similar beneficial effects can be achieved, and details are not described herein.

Drawings

FIG. 1 is a schematic diagram of breakpoint resume;

fig. 2 is a schematic composition diagram of an electronic device according to an embodiment of the present disclosure;

fig. 3 is a scene diagram illustrating a breakpoint continuous playing of a multimedia stream according to an embodiment of the present application;

fig. 4 is a flowchart illustrating a method for breakpoint playback of a multimedia stream according to an embodiment of the present application;

fig. 5 is a schematic view of an input interface of biometric information provided in an embodiment of the present application;

fig. 5A is a schematic diagram illustrating sharing of biometric information according to an embodiment of the present application;

FIG. 6 is a schematic diagram of a user authorization interface provided by an embodiment of the present application;

fig. 7 is a schematic view of a scene of screen turn-off wake-up according to an embodiment of the present application;

fig. 8 is a schematic diagram illustrating a public device actively acquiring biometric information of a user according to an embodiment of the present application;

FIG. 9 is a diagram illustrating an embodiment of a public device actively collecting biometric information of a user;

fig. 10 is a schematic interface diagram of breakpoint resume provided in an embodiment of the present application;

fig. 11 is a schematic interface diagram of another breakpoint resume provided in the embodiment of the present application;

fig. 12 is a schematic diagram of another prompt message for breakpoint resumption according to an embodiment of the present application;

fig. 13 is a schematic interface diagram of another breakpoint resume provided in the embodiment of the present application;

fig. 14 is a flowchart illustrating a breakpoint continuous playing method for a multimedia stream according to an embodiment of the present application;

fig. 15 is a schematic composition diagram of a playing apparatus for multimedia streams according to an embodiment of the present application;

fig. 16 is a schematic composition diagram of an electronic device according to an embodiment of the present application;

fig. 17 is a schematic composition diagram of a chip system according to an embodiment of the present disclosure;

fig. 18 is a schematic composition diagram of a playing apparatus for playing a multimedia stream according to an embodiment of the present application;

fig. 19 is a schematic composition diagram of another electronic device provided in the embodiment of the present application;

FIG. 20 is a block diagram of another chip system provided in an embodiment of the present application;

fig. 21 is a group diagram illustrating a system for playing a multimedia stream according to an embodiment of the present application.

Detailed Description

Multimedia playing services provided by electronic devices have become one of their indispensable functions. The multimedia playing service provided by the electronic device may be used to play multimedia files, which may include, but are not limited to, multimedia files acquired from a network, and the like. In some examples, the multimedia file may include a continuous stream of data, such as a video stream, an audio stream, and so forth. In this example, the multimedia file may be referred to as a multimedia stream. In this case, the multimedia stream is taken as an example of a video stream, and the video stream may also be referred to as a network video, or a network video stream, or an online video stream.

Take the played multimedia stream as the video stream as an example. The electronic device capable of playing the video stream may include, but is not limited to, a device provided with a display screen and capable of performing data interaction with a network, such as a mobile phone, a tablet computer, a notebook computer, and a television. For example, the electronic device may obtain data of a video stream from a network under the control of a user, and play the video stream through a corresponding Application (APP) or a web page or a native player, thereby providing a corresponding multimedia playing service for the user.

Currently, switching playing of video streams between different electronic devices has become a common scenario. As an example, a user may watch a video stream on a commute (e.g., work or work) using their cell phone. After the user returns to his home, the video stream can continue to be viewed using the television in the home. In order to avoid the need for manual control to enable the switched electronic device (for example, called a playback device) to skip the viewed part during switching the playback device of the video stream, the switched playback device (for example, a television) may provide a service of playing the video stream at a breakpoint, so that when the video stream is switched from a mobile phone to a television for playing, the television can continue playing the video stream from the breakpoint position where the mobile phone plays the video stream, thereby providing a better viewing experience for the user. In this embodiment, the above-mentioned continuing playing the video stream from the breakpoint position may be referred to as a breakpoint continuing playing of the video stream. By way of example, fig. 1 shows a schematic diagram of breakpoint resumption. The user can watch video stream 1 through his handset. As shown in fig. 1 (a), the video stream 1 has a duration of 90 minutes, and the user currently views a position of 20 minutes and 12 seconds (i.e., 20:12 as shown in fig. 1 (a)) using the handset. When the user needs to continue watching the video stream 1 by using the tv shown in fig. 1 (b), the tv can obtain the timestamp position (e.g. 20 minutes and 12 seconds) of the current playing of the video stream 1 through direct or indirect interaction with the handset (e.g. through a web server, etc.). The television may continue playing video stream 1 from the time stamp location so that the user may be enabled to continue watching video stream 1 on the television.

In order to enable the electronic device to provide the above breakpoint resume service for the user, there are various schemes:

scheme 1: the related information of the breakpoint continuous playing is displayed to the user in the form of the two-dimensional code, so that the user can request the breakpoint continuous playing on different electronic equipment by scanning the two-dimensional code. Illustratively, the information of the breakpoint resume may include an address of the remote server. The playing information such as the type and progress of the video stream viewed by the user on the electronic device 1 may be stored in the remote server. When a user wants to perform breakpoint continuous play through the electronic device 2, the user may connect to the remote server by scanning the two-dimensional code displayed on the electronic device 2, and request the remote server to send play information to the electronic device 2 by using the two-dimensional code as an entry, so that the electronic device 2 may perform breakpoint continuous play according to the play information.

Scheme 2: breakpoint resume can also be implemented through a mechanism built in the APP. Illustratively, when a user views a video stream through the APP1 on the electronic device 1, the playing progress of the video stream, and the login account information when viewing the video stream may be stored in the corresponding application server. When the user wants to continue watching the video stream through the electronic device 2, the user can log in the APP1 on the electronic device 2 by using the login account information, so as to obtain the playing progress of the video stream from the application server, and implement breakpoint playing on the electronic device 2.

The above scheme can realize breakpoint continuous playing of video stream, but has some problems.

For example, in the above scheme 1, the user needs to scan the two-dimensional code on the electronic device 2 to request for playing information, so as to control the electronic device 2 to implement breakpoint playing. It can be seen that the scheme depends on active control of a user, and active breakpoint continuous playing on the electronic equipment side cannot be realized. Meanwhile, since active control by the user is required, an interaction problem between the user and the electronic apparatus (such as the electronic apparatus 2 described above) is liable to occur. In addition, this solution requires the participation of a remote server in addition to the electronic device 1 and the electronic device 2. Therefore, when communication between the electronic device 1 and the remote server and/or communication between the electronic device 2 and the remote server is problematic, a failure of the breakpoint resumption may be caused.

In the above scheme 2, the login account information of the fixed APP is relied on, so that the method has a great limitation. For example, when a user watches a video stream on the electronic device 1 using the APP2, but the APP2 does not directly or indirectly provide a service of breakpoint resumption, breakpoint resumption on a different electronic device cannot be realized. In addition, the scheme also has the problems that the scheme depends on active control of a user, and more electronic devices need to participate (such as application servers need to participate), and the like, so that the instability of breakpoint play is increased.

Therefore, a solution is needed to avoid the above problems while stably providing the breakpoint resume service to the user.

In order to solve the above problem, an embodiment of the present application provides a breakpoint continuous playing method for a multimedia stream. Based on the scheme, different electronic devices can share the playing information through autonomous interaction. In addition, the electronic device playing the multimedia stream can adaptively select the related information of the multimedia stream corresponding to the current user to perform breakpoint continuous playing according to the biological identification information (such as face information and voiceprint information) of the user. Therefore, the method can actively identify the user and provide the corresponding breakpoint continuous playing on the premise of not needing the user to actively control while providing a quick and stable breakpoint continuous playing function. Therefore, accurate and stable breakpoint continuous playing service is provided for the user.

The scheme provided by the embodiment of the application is described in detail below with reference to the accompanying drawings.

It should be noted that the breakpoint resume method provided in the embodiment of the present application may be applied to electronic equipment of a user. The electronic device may be a mobile phone, a tablet computer, a Personal Digital Assistant (PDA), an Augmented Reality (AR) \ Virtual Reality (VR) device, a media player, a television, an electronic device with a multimedia stream playing function such as a speaker box. The embodiment of the present application does not specifically limit the specific form of the apparatus.

As an example, please refer to fig. 2, which is a schematic composition diagram of an electronic device 100 according to an embodiment of the present disclosure. The breakpoint continuous playing method of the multimedia stream provided by the embodiment of the present application can be applied to the electronic device 100 shown in fig. 2.

As shown in fig. 2, the electronic device 100 may include a processor 101, a display screen 103, a communication module 102, and the like.

Among other things, processor 101 may include one or more processing units, such as: the processor 101 may include an Application Processor (AP), a modem processor, a Graphics Processing Unit (GPU), an Image Signal Processor (ISP), a controller, a memory, a video stream codec, a Digital Signal Processor (DSP), a baseband processor, and/or a neural-Network Processing Unit (NPU), etc. The different processing units may be separate devices or may be integrated in one or more processors 101.

The controller may be a neural center and a command center of the electronic device 100. The controller can generate an operation control signal according to the instruction operation code and the timing signal to complete the control of instruction fetching and instruction execution.

A memory may also be provided in the processor 101 for storing instructions and data. In some embodiments, the memory in the processor 101 is a cache memory. The memory may hold instructions or data that have just been used or recycled by the processor 101. If the processor 101 needs to use the instruction or data again, it can be called directly from the memory. Avoiding repeated accesses reduces the latency of the processor 101, thereby increasing the efficiency of the system.

In some embodiments, processor 101 may include one or more interfaces. The interface may include an integrated circuit (I2C) interface, an integrated circuit built-in audio (I2S) interface, a Pulse Code Modulation (PCM) interface, a universal asynchronous receiver/transmitter (UART) interface, a mobile industry processor 101 interface (mobile industry processor interface, MIPI), a general-purpose input/output (GPIO) interface, a Subscriber Identity Module (SIM) interface, and/or a Universal Serial Bus (USB) interface 111, etc.

The electronic device 100 implements display functions via the GPU, the display screen 103, and the application processor 101, etc. The GPU is a microprocessor for image processing, and is connected to the display screen 103 and an application processor. The GPU is used to perform mathematical and geometric calculations for graphics rendering. The processor 101 may include one or more GPUs that execute program instructions to generate or alter display information.

The display screen 103 is used to display images, video streams, etc. The display screen 103 includes a display panel. The display panel may adopt a Liquid Crystal Display (LCD) 103, an organic light-emitting diode (OLED), an active-matrix organic light-emitting diode (active-matrix organic light-emitting diode, AMOLED), a flexible light-emitting diode (FLED), a miniature, a Micro-oeld, a quantum dot light-emitting diode (QLED), and the like. In some embodiments, the electronic device 100 may include 1 or N display screens 103, N being a positive integer greater than 1.

The communication module 102 may include an antenna 1, an antenna 2, a mobile communication module 102A, and/or a wireless communication module 102B. Take the case that the communication module 102 includes the antenna 1, the antenna 2, the mobile communication module 102A and the wireless communication module 102B.

The wireless communication function of the electronic device 100 may be implemented by the antenna 1, the antenna 2, the mobile communication module 102A, the wireless communication module 102B, a modem processor, a baseband processor, and the like.

The antennas 1 and 2 are used for transmitting and receiving electromagnetic wave signals. Each antenna in the electronic device 100 may be used to cover a single or multiple communication bands. Different antennas can also be multiplexed to improve the utilization of the antennas. For example: the antenna 1 may be multiplexed as a diversity antenna of a wireless local area network. In other embodiments, the antenna may be used in conjunction with a tuning switch.

The mobile communication module 102A may provide a solution for wireless communication including 2G/3G/4G/5G, etc. applied to the electronic device 100. The mobile communication module 102A may include at least one filter, a switch, a power amplifier, a Low Noise Amplifier (LNA), and the like. The mobile communication module 102A may receive the electromagnetic wave from the antenna 1, and may perform filtering, amplification, and other processing on the received electromagnetic wave, and transmit the electromagnetic wave to the modem processor for demodulation. The mobile communication module 102A may also amplify the signal modulated by the modem processor, and convert the signal into electromagnetic wave through the antenna 1 to radiate the electromagnetic wave. In some embodiments, at least some of the functional modules of the mobile communication module 102A may be disposed in the processor 101. In some embodiments, at least some of the functional modules of the mobile communication module 102A may be provided in the same device as at least some of the modules of the processor 101.

The modem processor may include a modulator and a demodulator. The modulator is used for modulating a low-frequency baseband signal to be transmitted into a medium-high frequency signal. The demodulator is used for demodulating the received electromagnetic wave signal into a low-frequency baseband signal. The demodulator then passes the demodulated low frequency baseband signal to a baseband processor for processing. The low frequency baseband signal is processed by the baseband processor and then transferred to the application processor. The application processor outputs a sound signal through an audio device (not limited to the speaker 106A, the receiver 106B, etc.) or displays an image or a video stream through the display screen 103. In some embodiments, the modem processor may be a stand-alone device. In other embodiments, the modem processor may be provided in the same device as the mobile communication module 102A or other functional modules, independent of the processor 101.

The wireless communication module 102B may provide a solution for wireless communication applied to the electronic device 100, including Wireless Local Area Networks (WLANs) (e.g., wireless fidelity (Wi-Fi) networks), bluetooth (bluetooth, BT), Global Navigation Satellite System (GNSS), Frequency Modulation (FM), Near Field Communication (NFC), Infrared (IR), and the like. The wireless communication module 102B may be one or more devices that integrate at least one communication processing module. The wireless communication module 102B receives electromagnetic waves via the antenna 2, performs frequency modulation and filtering processing on electromagnetic wave signals, and transmits the processed signals to the processor 101. The wireless communication module 102B may also receive a signal to be transmitted from the processor 101, perform frequency modulation and amplification on the signal, and convert the signal into electromagnetic waves through the antenna 2 to radiate the electromagnetic waves.

In some embodiments, the antenna 1 of the electronic device 100 is coupled to the mobile communication module 102A and the antenna 2 is coupled to the wireless communication module 102B such that the electronic device 100 can communicate with networks and other devices via wireless communication techniques. The wireless communication technology may include global system for mobile communications (GSM), General Packet Radio Service (GPRS), code division multiple access (code division multiple access, CDMA), Wideband Code Division Multiple Access (WCDMA), time-division code division multiple access (time-division code division multiple access, TD-SCDMA), Long Term Evolution (LTE), LTE, BT, GNSS, WLAN, NFC, FM, and/or IR technologies, etc. The GNSS may include a Global Positioning System (GPS), a global navigation satellite system (GLONASS), a beidou navigation satellite system (BDS), a quasi-zenith satellite system (QZSS), and/or a Satellite Based Augmentation System (SBAS).

As an example, the electronic device 100 is a mobile phone. The communication module 102 in the handset may include a mobile communication module 102A and a wireless communication module 102B. When the mobile phone plays the video stream from the network, the video stream data of the video stream can be acquired from the network through the 3G/4G/5G-based communication solution of the mobile communication module 102A, and the video stream is played according to the video stream data. The mobile phone may also acquire video stream data of the video stream from the network through a communication solution based on WLAN/BT, etc. of the wireless communication module 102B, and play the video stream according to the video stream data.

In other embodiments, the electronic device 100 is taken as a television. The communication module 102 in the television may include a wireless communication module 102B. When the television plays the video stream from the network, the video stream data of the video stream may be acquired from the network through the communication solution based on WLAN/BT, etc. of the wireless communication module 102B, and the playing of the video stream may be performed according to the video stream data.

It should be noted that, in the embodiment of the present application, the communication module 102 may also be used for interaction between devices without passing through an electronic device. For example, the electronic device 1 and the electronic device 2 may share biometric information through the communication module 102 provided therein. The electronic device 1 and the electronic device 2 can also share the broadcast control record through the communication module 102 respectively arranged therein.

As shown in fig. 2, in some implementations, the electronic device 100 may further include an external memory interface 110, an internal memory 104, a Universal Serial Bus (USB) interface, a charging management module 112, a power management module 113, a battery 114, an audio module 106, a speaker 106A, a receiver 106B, a microphone 106C, a headset interface 106D, a sensor module 105, a button 109, a motor, an indicator 108, a camera 107, a Subscriber Identity Module (SIM) card interface, and the like.

The electronic device 100 may implement a shooting function through the ISP, the camera 107, the video stream codec, the GPU, the display screen 103, the application processor 101, and the like.

The ISP is used to process the data fed back by the camera 107. For example, when taking a picture, the shutter is opened, light is transmitted to the photosensitive element of the camera 107 through the lens, the optical signal is converted into an electrical signal, and the photosensitive element of the camera 107 transmits the electrical signal to the ISP for processing and converting into an image visible to the naked eye. The ISP can also carry out algorithm optimization on the noise, brightness and skin color of the image. The ISP can also optimize parameters such as exposure, color temperature and the like of a shooting scene. In some embodiments, the ISP may be provided in the camera 107.

The camera 107 is used to capture still images or video streams. The object generates an optical image through the lens and projects the optical image to the photosensitive element. The photosensitive element may be a Charge Coupled Device (CCD) or a complementary metal-oxide-semiconductor (CMOS) phototransistor. The light sensing element converts the optical signal into an electrical signal, which is then passed to the ISP where it is converted into a digital image signal. And the ISP outputs the digital image signal to the DSP for processing. The DSP converts the digital image signal into image signal in standard RGB, YUV and other formats. In some embodiments, the electronic device 100 may include 1 or N cameras 107, N being a positive integer greater than 1.

The digital signal processor is used for processing digital signals, and can process digital image signals and other digital signals. For example, when the electronic device 100 selects a frequency bin, the digital signal processor is used to perform fourier transform or the like on the frequency bin energy.

The video stream codec is used to compress or decompress a digital video stream. The electronic device 100 may support one or more video stream codecs. In this way, the electronic device 100 can play or record video streams in a variety of encoding formats, such as: moving Picture Experts Group (MPEG) 1, MPEG2, MPEG3, MPEG4, and the like.

The NPU is a neural-network (NN) computing processor that processes input information quickly by using a biological neural network structure, for example, by using a transfer mode between neurons of a human brain, and can also learn by itself continuously. Applications such as intelligent recognition of the electronic device 100 can be realized through the NPU, for example: image recognition, face recognition, speech recognition, text understanding, and the like.

The charging management module 112 is configured to receive charging input from a charger. The charger may be a wireless charger or a wired charger. In some wired charging embodiments, the charging management module 112 may receive charging input from a wired charger via the USB interface 111. In some wireless charging embodiments, the charging management module 112 may receive a wireless charging input through a wireless charging coil of the electronic device 100. The charging management module 112 may also supply power to the electronic device 100 through the power management module 113 while charging the battery 114.

The power management module 113 is used to connect the battery 114, the charging management module 112 and the processor 101. The power management module 113 receives input from the battery 114 and/or the charging management module 112, and provides power to the processor 101, the internal memory 104, the external memory, the display screen 103, the camera 107, and the wireless communication module 102B. The power management module 113 may also be used to monitor parameters such as the capacity of the battery 114, the cycle number of the battery 114, and the state of health (leakage, impedance) of the battery 114. In some other embodiments, the power management module 113 may also be disposed in the processor 101. In other embodiments, the power management module 113 and the charging management module 112 may be disposed in the same device.

The external memory interface 110 may be used to connect an external memory card, such as a Micro SD card, to extend the memory capability of the electronic device 100. The external memory card communicates with the processor 101 through the external memory interface 110 to implement a data storage function. For example, files such as music, video streams, etc. are saved in the external memory card.

The internal memory 104 may be used to store computer-executable program code, which includes instructions. The processor 101 executes various functional applications of the electronic device 100 and data processing by executing instructions stored in the internal memory 104. The internal memory 104 may include a program storage area and a data storage area. The storage program area may store an operating system, an application program (such as a sound playing function, an image playing function, etc.) required by at least one function, and the like. The storage data area may store data (such as audio data, phone book, etc.) created during use of the electronic device 100, and the like. In addition, the internal memory 104 may include a high-speed random access memory, and may further include a nonvolatile memory, such as at least one magnetic disk storage device, a flash memory device, a universal flash memory (UFS), and the like.

The electronic device 100 may implement audio functions via the audio module 106, the speaker 106A, the receiver 106B, the microphone 106C, the headphone interface 106D, the application processor 101, and the like. Such as music playing, recording, etc.

The audio module 106 is used to convert digital audio information into an analog audio signal output and also to convert an analog audio input into a digital audio signal. The audio module 106 may also be used to encode and decode audio signals. In some embodiments, the audio module 106 may be disposed in the processor 101, or some functional modules of the audio module 106 may be disposed in the processor 101.

The speaker 106A, also called a "horn", is used to convert the audio electrical signals into sound signals. The electronic apparatus 100 can listen to music through the speaker 106A or listen to a hands-free call.

The receiver 106B, also called "earpiece", is used to convert the electrical audio signal into an acoustic signal. When the electronic device 100 receives a call or voice information, it can receive the voice by placing the receiver 106B close to the ear of the person.

The microphone 106C, also known as a "microphone," is used to convert sound signals into electrical signals. When a call is placed or a voice message is sent or it is desired to trigger the electronic device 100 to perform some function by the voice assistant, the user may speak via his/her mouth near the microphone 106C and input a voice signal into the microphone 106C. The electronic device 100 may be provided with at least one microphone 106C. In other embodiments, the electronic device 100 may be provided with two microphones 106C to achieve a noise reduction function in addition to collecting sound signals. In other embodiments, the electronic device 100 may further include three, four or more microphones 106C to collect sound signals, reduce noise, identify sound sources, perform directional recording, and so on.

The headphone interface 106D is used to connect wired headphones.

The sensor module 105 in the electronic device 100 may include a touch sensor, a pressure sensor, a gyroscope sensor, an air pressure sensor, a magnetic sensor, an acceleration sensor, a distance sensor, a proximity light sensor, an ambient light sensor, a fingerprint sensor, a temperature sensor, a bone conduction sensor, and the like to implement sensing and/or acquiring functions for different signals.

The keys 109 include a power-on key, a volume key, and the like. The keys 109 may be mechanical keys 109. Or may be a touch key 109. The electronic device 100 may receive key 109 inputs, generating key signal inputs relating to user settings and function control of the electronic device 100.

The motor may generate a vibration cue. The motor can be used for incoming call vibration prompt and can also be used for touch vibration feedback. For example, touch operations applied to different applications (e.g., photographing, audio playing, etc.) may correspond to different vibration feedback effects. The motors may also respond to different vibration feedback effects for touch operations applied to different areas of the display screen 103. Different application scenes (such as time reminding, receiving information, alarm clock, game and the like) can also correspond to different vibration feedback effects. The touch vibration feedback effect may also support customization.

Indicator 108 may be an indicator light that may be used to indicate a state of charge, a change in charge, or a message, missed call, notification, etc.

The SIM card interface is used for connecting the SIM card. The SIM card can be brought into and out of contact with the electronic apparatus 100 by being inserted into and pulled out of the SIM card interface. The electronic device 100 may support 1 or N SIM card interfaces, N being a positive integer greater than 1. The SIM card interface can support a Nano SIM card, a Micro SIM card, a SIM card and the like. Multiple cards can be inserted into the same SIM card interface at the same time. The types of the plurality of cards may be the same or different. The SIM card interface may also be compatible with different types of SIM cards. The SIM card interface may also be compatible with external memory cards. The electronic device 100 interacts with the network through the SIM card to implement functions such as communication and data communication. In some embodiments, the electronic device 100 employs esims, namely: an embedded SIM card. The eSIM card can be embedded in the electronic device 100 and cannot be separated from the electronic device 100.

It is to be understood that the illustrated structure of the present embodiment does not constitute a specific limitation to the electronic apparatus 100. In other embodiments, electronic device 100 may include more or fewer components than shown, or combine certain components, or split certain components, or a different arrangement of components. The illustrated components may be implemented in hardware, software, or a combination of software and hardware.

It should be noted that, in the electronic device 100 shown in fig. 2, an operating system may be run, and different application programs (i.e., APPs) may be installed in the operating system. Electronic device 100 may run one or more APPs through its operating system to implement corresponding functions. Illustratively, a media player may be installed in the operating system, and when the media player is executed, the multimedia stream playing function of the electronic device 100 may be implemented. The operating system may also be loaded with video stream type APP, such as (beepli)^TMAPP of (A), Aiqi skill^TMAPP of (1), YouTube^TMAPP), etc., when running the video stream APP, the function of the electronic device 100 obtaining the video stream from the application server corresponding to the APP and playing the video stream can be realized.

In some implementations of the present application, a secure world (TE) and a common world (RE) may also be provided in the operating system of the electronic device 100 shown in fig. 2. As one implementation, the TE and the RE may be virtual operating systems with independent storage, processing, and communication functions provided in the electronic device 100. Among them, TE can be used to process data with high requirements for security. For example, the TE may be used to process/store operations related to biometric information. The RE may be used to process data that has less stringent security requirements. For example, the RE may be used to process/store operations related to the playback information of the multimedia stream. In some implementations, communication may be between TE and RE in the same electronic device. For example, after acquiring the biometric information of the current user and accordingly acquiring the user matching result, the TE may send the user matching result to the RE, so that the RE performs breakpoint playing accordingly. In other implementations, communication may also be made between TEs in different electronic devices, or between REs in different electronic devices. For example, the TE1 in electronic device 1 may share the biometric information of the user stored therein to the TE2 in electronic device 2. As another example, RE1 in electronic device 1 may share the broadcast recording stored therein to RE2 in electronic device 2. It should be noted that, in other implementations, the secure world may also be used to refer to a trusted execution environment (for example, the english abbreviation may be TEE), and the general world may also be used to refer to an unsecure world or a general execution environment (for example, the english abbreviation may be REE).

The breakpoint resume method provided by the embodiment of the application can be implemented by the electronic device 100 shown in fig. 2.

Illustratively, a multimedia stream is taken as a video stream. The electronic device 100 may be configured to monitor an operation of interrupting the playing of the video stream, which is input by the user while the video stream is being played. For example, the operation may include an operation of stopping the video stream playing, or pausing the video stream playing, or exiting the video stream playing, which is input by the user. The electronic device 100 may be configured to generate and store a play control record corresponding to a video stream according to an operation of interrupting playing of the video stream input by a user. The electronic device 100 may also be used to share the broadcast record with other electronic devices 100 in the same local area network. The electronic device 100 may also be used to share other information, such as a user's biometric information, with other electronic devices in the same local area network.

In the embodiment of the present application, the electronic device 100 may further be configured to determine the user and the broadcast control record corresponding to the user by actively detecting the biometric information of the current user. And then the breakpoint continuous playing is carried out according to the playing control record.

It should be understood that in a scenario where a breakpoint resume is performed, there are at least two electronic devices. One of the electronic devices may be an electronic device (e.g., referred to as electronic device a) that stores a portion of a multimedia stream that has been played for a user. The other electronic device may be an electronic device that is about to continue playing the multimedia stream (e.g., referred to as electronic device B). The breakpoint continuous playing method provided by the embodiment of the application can be applied to the above-mentioned scenario including one electronic device a and one electronic device B, and can also be applied to the scenario including a plurality of electronic devices a. Fig. 3 is a schematic view illustrating a scene of breakpoint continuous playing of a multimedia stream according to an embodiment of the present application. As shown in fig. 3, N +1 electronic devices may be included in the scene, where N is an integer greater than or equal to 1. One of the electronic devices (e.g., the tv shown in fig. 3) may correspond to the electronic device B, i.e., the electronic device that is going to continue playing the multimedia stream. Other electronic devices (e.g., mobile phones 1 to N shown in fig. 3) may correspond to the electronic device a, that is, the electronic device that stores the multimedia stream that has been played for the user. Wherein, each mobile phone can correspond to one user. Therefore, in this scenario, the television may be configured to provide a breakpoint resume service to N users corresponding to the N mobile phones, respectively.

It should be noted that, in the embodiment of the present application, an electronic device (such as a television shown in fig. 3) that may provide a playing service of a multimedia stream for multiple users at the same time may be referred to as a public device. Electronic devices (such as the mobile phone 1 to the mobile phone N shown in fig. 3) that provide a play service of multimedia streams to only one user are referred to as private devices. It should be understood that fig. 3 illustrates an example in which the public device is a television and the private device is a mobile phone, and in some other implementation scenarios, the public device and the private device may have different implementations. Illustratively, the public devices may include televisions, smart speakers, etc., and the private devices may include cell phones, smart watches, etc.

In addition, the scenario shown in fig. 3 is described as including only one public device. In other implementation scenarios of the embodiment of the present application, a plurality of public devices may also be included to provide a playing service of a multimedia stream for different users. The embodiments of the present application do not limit this.

The breakpoint continuous playing method provided in the application embodiment is described in detail below. For convenience of illustration, the following takes as an example that the scheme provided by the embodiment of the present application is applied to a scenario shown in fig. 3, that is, the scenario includes 1 public device (e.g., a television) and N private devices (e.g., a mobile phone 1 to a mobile phone N), and the multimedia stream performing breakpoint playing is a video stream acquired from a network.

Please refer to fig. 4, which is a flowchart illustrating a breakpoint continuous playing method of a multimedia stream according to an embodiment of the present application. As shown in fig. 4, the method may include S401-S408.

S401, the mobile phone sends the biological identification information to the television.

S402, the television receives the biological identification information.

S403, the television stores the corresponding relation between the biological identification information and the user.

The biometric information may be biometric information of a user corresponding to the mobile phone. Illustratively, the biometric information may include face information of the user, and/or voiceprint information of the user. It should be understood that the biometric information of different users is different, and thus, the biometric information may be used to distinguish between different users.

In general, a user's mobile phone can store biometric information of the user. Illustratively, when a user uses a mobile phone, the face information can be set and stored in the mobile phone, so that the mobile phone can confirm the identity of the user by detecting the face information of the user using the mobile phone and matching the stored face information, and the related operations of functions such as mobile phone payment and mobile phone unlocking can be conveniently realized. As an example, when a user wants to enter face information, the user may input a corresponding operation to the mobile phone, for example, an operation of entering a "face recognition" interface. In response to this operation, the mobile phone may implement an interface as shown in (a) in fig. 5. As shown in fig. 5 (a), no information is displayed in the area 501 where the face information that has been saved is displayed, so the user can confirm that the mobile phone currently does not store any face information. The user can input an operation of creating face information, such as touching or clicking the control 502. In response to the operation, the mobile phone can start to collect the face information of the user. After the acquisition of the face information is completed, the interface shown in (b) in fig. 5 may be displayed. As shown in (b) in fig. 5, the entry of the current face information has been completed. Thereafter, the mobile phone can automatically jump to the previous interface under the operation of the user (such as touch or click operation on the arrow 503). For example, the mobile phone may display an interface as shown in (c) of fig. 5. In the interface, the face information (such as face information 1 in the figure) which has been entered can be displayed in the area 501. Thereby, the input of the face information is completed. The mobile phone can store the face information so as to realize subsequent related functions.

It should be understood that the above example is described by taking biometric information as face information. In other examples, the biometric information may also be voiceprint information, and the entry process is similar and will not be described herein again.

In the embodiment of the application, the mobile phone can share the biological identification information stored in the mobile phone to the television. In some implementations, the mobile phone may perform the sharing of biometric information with the television described above when the mobile phone is in the same local area network as the television. I.e., S401 as shown in fig. 4 is performed. The television can acquire the biological identification information from the mobile phone, so that the television does not need to input the biological identification information of each user in advance, the user only needs to input the biological identification information on the mobile phone, and the biological identification information authenticated or identified by the user does not need to be input on the television, so that the user operation is simplified, and the biological identification information is derived from private equipment such as the mobile phone and the like and can be safer.

In the above example, the biometric information is shared by itself between different devices (e.g., a mobile phone and a television). In other implementations of the present application, a user may actively share biometric information to other devices. Illustratively, in conjunction with fig. 5A. After the user 1 completes the entry of the face information 1 on his mobile phone 1, a share button 504 as shown in (a) of fig. 5A may be displayed on the "face recognition" interface. When the user wants to control the mobile phone 1 to share the face information 1 with the television 1, the user may input an operation to the sharing button 504, for example, click or touch, or control through voice. In response to an operation input by the user, the cellular phone 1 can perform a sharing process of the face information 1. For example, the mobile phone 1 may search for other devices in the local area network where the mobile phone 1 is located, at this time, the mobile phone 1 may display a prompt box 505 as shown in (b) in fig. 5A on the interface, and the prompt box 505 may include a text prompt, such as "device being searched … …". In other implementations, the prompt box 505 may further include an icon, a dynamic image, or the like for presenting the current search status to the user. After searching for the corresponding device, the mobile phone 1 may display a prompt box 506 on its interface as shown in (c) of fig. 5A. A text prompt may be displayed in the prompt box 506 to present the search results to the user. For example, the text prompt in the prompt box 506 may include a searched device, such as television 1. When the user wants to share the face information 1 to the television 1, the user can input an operation on the area corresponding to the device displayed in the prompt box 506, so that the mobile phone 1 can share the face information 1 to the corresponding device. For example, the user 1 may input a touch or click operation on "tv 1" in the prompt box 506 as shown in (c) in fig. 5A, and in response to this operation, the cellular phone 1 may share the face information 1 to the tv 1.

It should be noted that, because the biometric information is important for the user and belongs to private data that needs to be kept secret, in some embodiments of the present application, the authorization of the user may be obtained before the mobile phone shares the biometric information. For example, in conjunction with fig. 5, when the user enters the face information, the mobile phone and the television are in the same local area network as each other. After the entry of the face information is completed, as shown in fig. 6, the mobile phone may display a card 601 on a "face recognition" interface, so that the mobile phone can determine whether the user is authorized according to the operation input by the user through the control included in the card 601, and perform subsequent operations. As an example, the card 601 may include authorization content therein. For example, the authorization content may be presented to the user in the form of a text prompt. Such as "new face information is detected, whether the face information is synchronized to the television". The card 601 may also include controls for capturing user input authorization or non-authorization. For example, a "yes" button 602 and a "no" button 603 may be included in the card 601. When the mobile phone receives an operation that the user clicks or touches the "yes" button, the mobile phone determines that the user agrees with the authorization. When the mobile phone receives the operation that the user clicks or touches the 'no' button, the mobile phone determines that the user does not agree with the authorization. In other implementation manners, the mobile phone may also display the card 601 to the user in the form of voice, animation, or the like, and the mobile phone may also determine whether the user authorizes the current operation (e.g., a sharing operation of face information) by receiving operations of the user, such as a voice instruction and a gesture instruction. The authorization mode of the user is not specifically limited in the embodiment of the present application. After the user is determined to be authorized, the mobile phone can transmit the biometric information of the user stored in the mobile phone to the television.

After receiving the biological identification information sent by the mobile phone, the television can store the corresponding relation between the biological identification information and the corresponding user. For example, the correspondence may be a correspondence of the face information and the identification of the user.

It should be noted that, for each of the N handsets shown in fig. 3, the above S401-S403 may be executed when conditions are met (e.g., when the handset is in the same local area network as the tv). Thus, if each mobile phone obtains the authorization of the user, the N mobile phones can respectively transmit the stored biometric information of the corresponding user to the television. Correspondingly, the television can store the corresponding relationship between the acquired N pieces of biological identification information and the corresponding users.

As a possible implementation manner, the television may store the correspondence shown in table 1 below.

TABLE 1

Biometric information	Corresponding to the user
		Face information 1	User identification 1
Face information 2	User identification 2
		……	……
Face information N	User identification N

Through the table 1, the television can determine the corresponding user according to the face information. For example, the television may determine, according to the face information 1, that the corresponding user is the user 1 corresponding to the user identifier 1. The television can determine that the corresponding user is the user 2 corresponding to the user identifier 2 according to the face information 2. Similarly, the television can determine that the corresponding user is the user N corresponding to the user identifier N according to the face information N. It should be noted that in other implementation manners of the present application, the television may further store the corresponding relationship between the face information and the user through other manners. For example, the television may label the biometric information with a corresponding user when the biometric information is received, so that different users may be distinguished and determined based on the biometric information.

S404, the mobile phone monitors the playing of the video stream and obtains a corresponding play control record.

S405, the mobile phone sends the broadcast control record to the television.

In this example, the broadcast control record may include video stream information for the corresponding video stream.

The video stream information may include a name of the video stream and information indicating a current playing position of the video stream. Illustratively, the name of the video stream may be identified by a movie ID (e.g., called vod).

It should be noted that, in some implementations, the video stream information may further include a packet name of an APP playing the video stream. For example, the packet name may be com. It can be understood that, according to the packet name, the electronic device can know the network location (e.g., the location of the corresponding application server) corresponding to the APP of the open video stream. When the video stream needs to be played, the electronic device may extract video stream data of the video stream from a corresponding network location according to the movie ID for playing. Additionally, in an example, the current playback position of the video stream can be used to indicate the progress of the playback of the video stream when the playback is interrupted. For example, the current play position may be identified by the played time length (e.g., referred to as playTime). In other implementations, the current playing schedule may be a time stamp of the video stream playing when the playing is paused or stopped or exited. As another example, the current playing schedule may be a played percentage of the video stream played when the playing is paused or stopped or exited. As another example, the current playing schedule may be an unplayed percentage of the video stream playing when the playing is paused or stopped or exited. In other implementations, the video stream information may also include other information related to the playing of the video stream, such as the volume of the playing of the video stream, the classification of the video stream, and so on.

The broadcast control record may also include device information of the handset. For example, the device information may be used to indicate related information of the mobile phone. As an example, the Device information may include a unique identifier (UDID) of the mobile phone, a Device type, Device manufacturer information, a Device model, software version information of the mobile phone, and the like. Through the equipment information of the mobile phone, when the electronic equipment (such as a television) needs to perform breakpoint continuous broadcasting according to the broadcasting control record, the environment of the video stream during broadcasting on the mobile phone can be known, and the normal broadcasting of the video stream on the television can be ensured through adjustment by combining the broadcasting environment of the television.

In this example, the mobile phone may monitor playing of the video stream on the mobile phone, and when an operation of interrupting playing of the video stream input by the user is detected, obtain a play control record corresponding to the video stream. The operation of interrupting the playing of the video stream input by the user may include an operation of pausing the playing or stopping the playing or exiting the playing. When the mobile phone detects that the user inputs the operation of interrupting the video stream playing, the playing progress information of the current video stream can be acquired.

Illustratively, take user 1 watching video stream 1 through his handset 1 as an example. The mobile phone 1 can monitor the operation of interrupting the playing of the video stream 1, which is input by the user, during the process of watching the video stream 1 by the user. Upon receiving the operation, the handset 1 may generate the broadcast control information 1 corresponding to the video stream 1 in response to the operation.

The mobile phone can share the stored broadcast control record to the television, so that the television can continue to broadcast at a breakpoint according to the broadcast control record. In some embodiments of the application, when the mobile phone and the television are in the same local area network, the broadcast control record stored in the mobile phone can be sent to the television, so that the broadcast control record can be shared between the mobile phone and the television. It can be understood that, when N mobile phones and a television are in the same local area network and the N mobile phones store corresponding broadcast control records, the television can receive and store the N broadcast control records respectively sent by the N mobile phones. It should be noted that, as described with reference to the method shown in fig. 5A, the user may actively share the broadcast control record on the mobile phone to the television. The process of sharing the broadcast control record by the user may be similar to the operation of the mobile phone 1 in sharing the face information 1 as shown in fig. 5A. For example, the user may control the mobile phone 1 to search for a device capable of sharing the broadcast control record by operating the mobile phone 1, and when the device (e.g., the television 1) is searched, the mobile phone 1 may present the search result to the user and establish a connection with the television 1 under the operation of the user, so as to share the broadcast control record to the television 1. The specific implementation process may refer to the process shown in fig. 5A, and is not described herein again. It can be understood that the user can also actively share the broadcast control record on the television to the mobile phone.

It can be seen that the above-described S401-S403 provide examples of methods of sharing biometric information between a public device and a private device. S404-S405 above provide examples of methods for sharing of a recorded broadcast between a public device and a private device. It should be noted that there is no chronological restriction between the above-mentioned sharing process of biometric information and the sharing process of broadcast control recording. For example, the private device may perform sharing of biometric information when first under the same local area network as the public device, i.e., as per S401-S403 described above. At this time, if there is no play record in the private device, S404-S405 may not be performed. For another example, the private device may execute the above S404-S405 when the private device is in the same local area network as the public device after obtaining the broadcast control record, so as to implement sharing of the broadcast control record, and at this time, if the biometric information corresponding to the private device is already stored by the public device (i.e., the biometric information stored in the private device is already shared to the public device by the above methods of S401-S403, or by other methods), the sharing process of the biometric information may not be executed. As another example, the private device may transmit the biometric information stored therein to the public device synchronously or asynchronously each time a transmission of a broadcast record is made.

S406, the television acquires the biometric information of the current user.

And S407, determining a user matching result according to the acquired biological identification information of the current user.

And S408, the television carries out breakpoint continuous playing according to the playing control record corresponding to the user matching result.

In this example, the tv may obtain the biometric information of the current user when the tv wakes up from the screen.

It should be noted that when no user uses the television (e.g., the user is out of residence, or the user is at rest, etc.), the television may be in the screen-off state. The screen state refers to a state in which a display screen of the television is closed, or a screen saver image/black image is displayed on the display screen of the television. When a user needs to use the television, the television can be switched from a screen-off state to a normal working state, and for example, a display screen of the television can be switched from a closed state to a state of displaying a home page interface. In the description of the embodiment of the present application, the process of switching from the screen saver state to the normal operating state is referred to as screen saver wake-up.

In different implementations, the screen-off wake-up of the television may have different trigger mechanisms.

For example, in some embodiments, the television wake-up on screen may be user-activated. For example, the user may send a wake-up indication to the tv by voice or by operating the tv remote control using a smart speaker, a smart gateway, or a tv remote control. The television may receive the wake-up indication and perform a screen-off wake-up in response to the wake-up indication.

In other embodiments, the television may determine to perform a screen off wakeup by autonomous detection. It should be understood that when the television is in the screen-off state, some components (such as some sensors, cameras, etc.) may be in the low-power standby state. In the sniff state, the sensor may reduce its sensitivity by active, and the camera may reduce its image resolution to reduce power consumption while continuing to maintain monitoring of the surrounding environment. That is, in the screen-saving state, the tv can still detect whether the user is present within a certain range. For example, please refer to fig. 7. When the television is in the screen-off state, the interface 701 may be as shown in fig. 7 (a). The interface 701 may be displayed with a screen saver image or in a black screen state. When the television detects that the user is present within its play range, the television may switch from the sniff state to a home page as shown in (b) of fig. 7 for display, for example, the home page may be the interface of 702 as shown in (b) of fig. 7. The playing range of the television can be preset or can be determined by the television according to the use habit of the user. For example, in a screen-saving state of a television, when an infrared sensor detects that a user appears in a playing range of the television, or when a camera in the television detects that the user appears in the playing range of the television, the television can determine that a playing requirement exists, and then perform screen-saving wakeup. In addition, in the smart home scene, the trigger mechanism for the television to determine to perform screen-off wakeup can also be automatically triggered in the smart scene preset by the user. The embodiment of the application does not limit the trigger condition for the television to perform screen-off wakeup.

In the embodiment of the application, when the television wakes up by turning off the screen, the biometric information of the current user is acquired, which may be that the television starts to acquire the biometric information of the current user when the television starts to wake up by turning off the screen, or the television starts to acquire the biometric information of the current user after the television finishes waking up by turning off the screen, for example, when the home page interface is already displayed. The embodiments of the present application do not limit this. It should be understood that the current user is the user who is present within the scope of the tv broadcast. The following is an exemplary description of an implementation of collecting biometric information of a current user.

For example, in some embodiments, the biometric information is face information of the user. The television can acquire face information of a user in a playing range of the television through components with image acquisition functions, such as a camera arranged on the television. Referring to fig. 8, the playing range of the tv is taken as AOB as an example. The camera can collect the face information of the user in the AOB range, and the collection of the face information of the user is achieved.

It should be noted that, in some implementations of the present example, the television may determine whether the user is within the playing range of the television by the clarity of the collected facial information. It can be understood that when the user is in the AOB area but far away from the tv, the clarity of the face information acquired by the tv is poor. The television may not be able to determine the corresponding user from the face information. Therefore, in this example, the television may determine whether the user is within the playing range of the television according to a size relationship between the sharpness of the acquired face information and a corresponding preset threshold (e.g., a first threshold). For example, when the definition is greater than the first threshold, it is determined that the user is within the playing range of the television, and the television may store the face information acquired at this time as effective information. On the contrary, when the definition is smaller than the first threshold, it is determined that the user is not in the playing range of the television, and the television can process the corresponding face information as invalid information, such as discarding and the like. The tv may also be used to determine whether to continue to perform S407-S408 based on determining whether the user is within the play range. For example, if the user is within the play range of the television, execution continues with S407. On the contrary, if the user is not within the playing range of the tv, S407 is not performed.

In other embodiments, the biometric information is the user's voiceprint information. The television can collect the voiceprint information of the user through a part with a sound collection function, such as a receiver arranged on the television. Referring to fig. 9, the television can collect voiceprint information of the user through a receiver thereof.

It should be noted that, in some implementations of this example, the television may determine whether the user is within the playing range of the television according to the sound level of the collected voiceprint information, and selectively retain the collected voiceprint information, thereby improving the reliability of the user identification information. In this embodiment of the application, the television may determine whether the user is within a playing range of the television according to a size relationship between the sound size of the collected voiceprint information and a corresponding preset threshold (e.g., a second threshold). For example, when the sound size is greater than the second threshold, it is determined that the user is within the playing range of the television, and the television may store the voiceprint information acquired at this time as valid information. On the contrary, when the sound size is smaller than the second threshold, it is determined that the user is not in the playing range of the television, and the television can treat the corresponding voiceprint information as invalid information, such as discarding and the like. It should be understood that the television may also determine whether the user is within the playing range of the television by other methods. For example, the television can simultaneously collect voiceprint information of the user through two or more receivers (e.g., two receivers shown in fig. 9) disposed thereon, respectively, to locate the user, thereby determining whether the user is within the playing range of the television.

In the above example, the biometric information is exemplified as the voiceprint information or the face information. In other implementation scenarios, the biometric information may also include both voiceprint information and face information, or the biometric information may also include other information that can be used to identify the user. For convenience of explanation, the biometric information is exemplified as the face information in the following.

In the above example, the biometric information of the current user is collected when the tv is turned off and awakened. In other implementations of the present application, the television may trigger detection of biometric information of the current user under control of the user. For example, the operation television that detects the user to open the video APP1 starts to detect biometric information of the current user when the video APP1 is opened. The video APP1 may be an APP with a playing multimedia stream.

Through the above description, the television can collect and store the face information of the current user. In conjunction with the descriptions of S401 to S403, the television may further store a correspondence between the face information of the user using the television and the identifier of the user (for example, the correspondence may be a correspondence shown in table 1). The television can compare stored face information acquired from the mobile phone according to the face information of the current user, so that the current user can be determined. For example, the face information acquired from the mobile phone stored in the television is taken as the corresponding relation shown in table 1 as an example. When the face information of the current user is the face information 1, the television can determine that the current user can be the user 1 corresponding to the user identifier 1. When the face information of the current user is the face information 2, the television may determine that the current user may be the user 2 corresponding to the user identifier 2. By analogy, when the face information of the current user is the face information N, the television can determine that the current user can identify the user N corresponding to the user identifier N.

In conjunction with the descriptions of S404-S405, the tv may obtain the broadcast control record corresponding to the user using the mobile phone from the mobile phone. Generally, when a user is within the playing range of a television, the mobile phone of the user and the television are in the same local area network. Therefore, the television can acquire the broadcast control record corresponding to the current user from the mobile phone of the user. In an actual use scene, the television can also acquire other broadcast control records from other mobile phones of users in the same local area network. Therefore, in this example, in order to enable the television to accurately provide accurate breakpoint continuous playing for the current user, the television may determine, according to the determined current user, a broadcast control record corresponding to the current user, and perform breakpoint continuous playing according to the broadcast control record.

In the above example, the description is given by taking an example in which the television acquires the corresponding broadcast control record from the mobile phone of the first user before detecting the biometric information of the current user.

In other implementations of the present application, the television may further obtain the corresponding broadcast control record from the mobile phone of the user after detecting the biometric information of the current user and determining the user according to the biometric information. For example, the tv detects the biometric information 1 of the current user. The tv may determine that the biometric information corresponds to the user 1 according to the correspondence between the biometric information of the user and the user identifier acquired in S401 to S403 described above. The television may initiate a transmission request for a broadcast record to the handset 1 of the user 1 and in response to this request the handset 1 may transmit its stored broadcast record 1 to the television. Therefore, the television acquires the broadcast control record corresponding to the current user.

In this example, the breakpoint resume of the television according to the broadcast control record corresponding to the current user may be implemented in various ways.

For example, in some implementations, the television may display information about the video stream to be breakpoint resumed on its home interface so that the breakpoint resume is resumed at the direction of the user. For an illustration of one implementation, please refer to fig. 10. When the television determines that the current user is user a and determines the information related to video stream a to be played at a breakpoint according to user a, a card 1001 corresponding to video stream a may be displayed on its interface (e.g., a "welcome" interface shown in fig. 10 (a)). The card may be used to ask user a to confirm whether to resume playing of video stream a shown on card 1001. As an example, the card 1001 may include text prompts, such as "breakpoint resume prompt: whether to continue watching video stream a "also includes" you have watched video stream a on handset a before to 25:50, whether to continue watching ", etc. The user a can input a corresponding operation according to the card 1001. For example, in some implementations, other controls may also be included in the card 1001. As shown in fig. 10 (b), the controls may include a "yes" button 1002, and a "no" button 1003. When the television receives the operation of clicking or touching the user A or inputting a 'yes' button through a television remote controller, the television determines to continue playing at the breakpoint according to the playing control record corresponding to the text prompt of the card. That is, the television can continue the breakpoint play of the video stream a on its display screen in accordance with the information indicated by the play record in response to the operation of the "yes" button input by the user a. In contrast, when the television receives the operation of clicking or touching the user a or inputting the no button through the television remote controller, the television determines not to continue playing at the breakpoint according to the play control record corresponding to the text prompt of the card. The television can normally display its home interface at this time so that the user a can use other functions of the television. Note that the card shown in fig. 10 (b) may not include the no button 1003. User a may use other operations to enter the home interface of the television. For example, the user a may input an operation that can be used to enter the home interface through a remote controller of the television, for example, click a "home" button on the remote controller, or click a "return" button on the remote controller, or implement control of the television to display the home interface through voice control and other manners.

In other implementation manners, when the television determines that only one user is in the current playing area, the breakpoint continuous playing can be directly performed according to the play control record corresponding to the current user, so that the television can automatically select the corresponding play control record for the user to perform the breakpoint continuous playing without any operation input by the user.

In other implementations, the television may display, on its interface, cards corresponding to multiple broadcast recordings for one user. Therefore, the television can show the selection corresponding to a plurality of different broadcast control records to the user through the interface of the television, so that the television can independently select the corresponding broadcast control record to watch. For example, the television may display the broadcast control record 1, the broadcast control record 2 and the broadcast control record 3 corresponding to the user 1 on the interface. The user can select the corresponding play control record to play according to the requirement. If the user selects the broadcast control record 2, the television can continue to play at the breakpoint according to the broadcast control record 2.

In other implementations, the user may actively select a video stream to be resumed on the television. For example, a user may say to a television: "continue playing the video a just played on the mobile phone a", after receiving the instruction, the television can search the broadcast control record matched with the instruction in the television, and continue playing the video a according to the broadcast control record. For example, the television can search for the corresponding broadcast control record through the video a, and can also search for the corresponding broadcast control record according to the video a and the mobile phone a. The broadcast control record is obtained from the mobile phone A before the user instruction is received. Optionally, the television also obtains the broadcast control record corresponding to the video a from the mobile phone a after receiving the instruction of the user, and then the television performs breakpoint continuous playing according to the obtained broadcast control record.

In the description of fig. 10, only one user in the playback range of the television is described as an example. It will be appreciated that in other scenarios, there may be two or more users within the playing range of the television. At this time, the television can also provide different breakpoint continuous playing services for the user. Take the example that there are two users (e.g., user 1 and user 2) in the playing range of the tv.

Illustratively, the television may determine broadcast record 1 corresponding to user 1 and broadcast record 2 corresponding to user 2, respectively. As shown in fig. 11, the tv may display card 1 (e.g., 1101 in fig. 11) and card 2 (e.g., 1102 in fig. 11) on its current display interface (e.g., the home interface), respectively. The card 1 includes information related to the video stream 1 corresponding to the broadcast record 1, for example, the card 1 may include a text prompt similar to (b) in fig. 10. Similarly, the card 2 includes information related to the video stream 2 corresponding to the broadcast record 2, for example, the card 2 may also include a text prompt similar to (b) in fig. 10. In this way, the user 1 and the user 2 can clearly know the situation of the video stream which can be played continuously at the breakpoint, and can select the video stream according to the situation. Illustratively, when user 1 and user 2 want to continue watching video stream 1, a command to continue playing video stream 1 may be input to the television via a television remote control, or voice control. In response to the command, the television may resume the breakpoint play of video stream 1 based on play record 1. Similarly, when user 1 and user 2 want to continue watching video stream 2, a command to continue playing video stream 2 can be input to the television via a television remote control, or voice control. In response to the command, the television may resume the breakpoint play of video stream 2 based on broadcast control record 2. It should be understood that in other implementations, card 1 and card 2 may also be two controls, or two areas, in one card. The display mode of the information corresponding to the broadcast control record 1 and the broadcast control record 2 is not limited in the embodiment of the present application.

It can be understood that, when two or more users exist in the playing range of the television, the television can only display part of the information recorded in the broadcast control record in the card, and simultaneously hide other information corresponding to the broadcast control record, thereby achieving the purpose of protecting the privacy of the users. Illustratively, referring to fig. 12, the television may display a card 1201 including information for a portion of the broadcast control recording on the current display interface. For example, text prompts such as "breakpoint resume prompt: carrying out breakpoint continuous playing of the user 1; and carrying out breakpoint continuous play of the user 2. In some implementations, the text prompts of "performing the breakpoint resumption of the user 1" and "performing the breakpoint resumption of the user 2" in the text prompts may also have functions of receiving operations corresponding to the users of the

controls

1202 and 1203 shown in fig. 12. Therefore, the user can select the corresponding control to execute the corresponding breakpoint continuous playing through the television remote controller. Illustratively, when the television receives a user click input to the control 1202, the breakpoint continuous playing is performed on the video stream 1 corresponding to the play control record 1 corresponding to the user 1. When the television receives a click input of the user on the control 1203, the corresponding video stream 2 is continuously played at a breakpoint according to the play control record 2 corresponding to the user 2. Therefore, the television does not directly display the video stream watching history information of two or more users on the interface thereof, thereby achieving the purpose of protecting the privacy of the users.

In addition, in other implementation manners of the present application, the television may determine, according to the priority of the user, which user corresponds to the broadcast control record to perform the breakpoint continuous broadcast. For example, the priority of the user may be preset in the television or may be determined by the television itself. For example, the tv may prioritize the users according to the frequency of use of different users in the history of using the tv, where the user with the highest frequency of use has the highest priority and the user with the lowest frequency of use has the lowest priority. Or, the television can also carry out breakpoint continuous playing according to the priority of the broadcast control record. For example, the television can perform priority sequencing on a plurality of broadcast control records according to the time sequence of obtaining the breakpoint continuous broadcast, and the broadcast control records with later obtaining time are most likely to be continuously broadcast, so that the television can have higher priority. Correspondingly, a broadcast record with an earlier acquisition time is less likely to be replayed, and therefore may have a lower priority. After the priority of the user/broadcast control record is determined, the television can directly enter the breakpoint continuous broadcast of the video stream according to the corresponding broadcast control record. In other implementations of the present application, the television may further execute the corresponding breakpoint resume according to an instruction input by the user. For example, take the example that the current users include user 1 and user 2. User 1 may input a voice control indication to the television, for example, user 1 may speak to the television: "continue playing video 1 played on handset 1". After receiving the instruction, the television can select the broadcast control record corresponding to the video 1 and the mobile phone 1 to perform breakpoint continuous broadcasting. It should be noted that, in some implementation manners, the television may further perform voice recognition by receiving a voice instruction of the user 1, determine a corresponding user, and select a broadcast control record corresponding to the user to perform breakpoint playback; or, after receiving the voice instruction of the user 1, the television can trigger face recognition to determine the corresponding user, and then further acquire the broadcast control record related to the user to perform breakpoint continuous broadcasting.

It should be noted that, in other embodiments of the present application, when the television plays the video stream, the playing condition of the video stream may also be synchronized to the mobile phone in the same local area network, so that the user may also play the video stream at the breakpoint based on the current playing schedule of the television through the mobile phone.

For example, the television and the mobile phone 1 are in the same local area network. In some implementations, the television can synchronize its playing progress of the video stream and the related information of the video stream (i.e., the playing control record corresponding to the video stream being played) to the mobile phone 1 in real time. The interface of the mobile phone 1 may display a corresponding card. The card can be used for showing the user the related information of the broadcast control record corresponding to the video stream currently being played by the television. For example, in some implementations, as shown in fig. 13 (a), the handset 1 may display a text prompt in the card 1301, such as "video streaming information: video stream 1 is being viewed, now playing 20:12 ". In other implementations, as shown in (b) of fig. 13, the mobile phone 1 may present the relevant video stream playing information in the form of multimedia in the card 1302. For example, the card 1302 may include the name "video stream 1" of the video stream currently being played by the tv, the card 1302 may further include the progress "20: 12" of the video stream currently being played by the tv, the card 1302 may further include a key frame image in the current progress of playing, and the like.

The user can know the playing situation of the current video stream on the television through the card. When the user wants to continue watching the video stream through the mobile phone 1, the user can input relevant operations (such as touching or clicking) to the card. The handset 1 can receive this operation. As a response to the operation, the mobile phone can perform breakpoint continuous playing on its interface based on the play control record corresponding to the card. For example, from 20:12 begin to continue playing video stream 1.

It should be noted that, when the user operates the card on the mobile phone 1 to implement breakpoint continuous playing of the video stream 1 through the mobile phone 1, the television can determine whether the user is still in the playing range of the user, and if so, the television can also continue playing the video stream 1. If the television determines that the user is no longer within its play range, the television may exit the play of video stream 1. For example, enter the screen-off state.

In the above example, the description is given by taking an example that the television sends the broadcast control record to the mobile phone 1 in real time, in other embodiments, the television may further obtain, according to a preset time period, the broadcast control record corresponding to the video stream played on the television, and send the broadcast control record to the mobile phone 1. In other embodiments, the television may further obtain a corresponding broadcast control record when monitoring an operation of interrupting the video stream playing input by the user, and send the broadcast control record to the mobile phone 1. The embodiment of the application does not limit the time when the television sends the broadcast control record to the mobile phone 1.

In addition, when a plurality of users watch the video stream played by the television at the same time in front of the television, the television can send the current broadcast control record to the corresponding collection according to different scene requirements.

For example, in some implementations, the video stream 1 currently played by the television is a breakpoint continuous play according to the broadcast control record 1 sent by the mobile phone 1. The television can send the broadcast control record corresponding to the video stream 1 to the mobile phone 1 in real time, so that the corresponding user 1 can accurately know the playing progress of the video stream 1 at the mobile phone 1. When the user 1 wants to continue watching the video stream 1 through the mobile phone 1, the mobile phone 1 can provide the corresponding breakpoint continuous playing service for the user 1 according to the playing progress.

In other implementations, the video stream currently played by the television is not the breakpoint continuous playing according to the broadcast control record of any mobile phone. The television can send the broadcast control record corresponding to the video stream to all mobile phones in the current local area network in real time, so that users watching the current video stream through the television can know the playing progress of the current video stream on the television through the respective mobile phones, and meanwhile, the mobile phones of the users can provide breakpoint continuous playing service for the corresponding users according to the broadcast control record when the users want to continuously watch the video stream on the mobile phones. Of course, in other embodiments, if the video stream currently played by the television is not a breakpoint continuous play, the television may also share its broadcast control record with any mobile phone, thereby reducing the communication pressure between the television and the local area network where the mobile phone is located.

In addition, in other implementations, if the relevant policy is preset in the tv, for example, the tv synchronizes the broadcast control record of the currently played video stream to the mobile phone 1 in the local area network. The television may perform an operation of synchronising the broadcast control record to the handset 1 in accordance with the policy. Therefore, when the television plays any video stream, the user 1 can know the playing progress of the current video stream through the mobile phone 1, and further active control of the user 1 on television playing resources is achieved, for example, parental control is achieved.

In the above example, the example is described as an example in which the television performs the breakpoint continuous play according to the playing method of the multimedia stream when the television does not play any multimedia stream. In other embodiments of the present application, the television may also provide the user with the breakpoint resume service according to the above method while playing the multimedia stream.

Illustratively, take the example that a television is playing video stream 1 for user 1. According to the method provided in fig. 4, when the tv detects the biometric information of the user 2, the corresponding broadcast control record can be obtained according to the biometric information of the user 2. At this point, the tv may consider that a need for a breakpoint resume of user 2 may arise. Then, in this example, the television may display a card 1001 as shown in (a) in fig. 10 or (b) in fig. 10 on the interface while playing the video stream 1, so that the user may instruct the television to perform breakpoint continuous playing according to the broadcast record corresponding to the user 2 by operating the television, for example, the television may switch from playing the video stream 1 to playing the corresponding video stream 2 continuously according to the broadcast record corresponding to the user 2. Of course, when the user does not need to perform the breakpoint resume on the video stream 2, the corresponding operation (such as clicking a return/exit key, or indicating that the breakpoint resume is not needed through voice, etc.) may be input, and the television may continue to play the video stream 1. It will be appreciated that if the user does not enter any action on the card 1001, the television may dismiss the display of the card 1001 on the interface after a preset time to better enable the user to play the video stream 1.

So far, the breakpoint continuous playing scheme provided by the embodiments of the present application should be clearly and clearly understood by those skilled in the art. It should be noted that, in the above example, only the multimedia stream is taken as an example of a video stream, in other implementation manners of the present application, the multimedia stream may also be an audio stream, and a specific execution manner of the multimedia stream may refer to an execution manner of the video stream in the above example, which is not described again.

It can be understood that, with reference to the above description, the breakpoint resume method provided in the embodiment of the present application can enable a public device (e.g., a television) to share broadcast control records with a private device (e.g., a mobile phone) by itself. And the biometric information of the current user can be acquired by self without any operation input by the user, and the broadcast control record matched with the current user is determined according to the biometric information. The corresponding card is displayed on the interface of the user, so that the user can execute the corresponding breakpoint continuous playing by confirming the card information, or the breakpoint continuous playing is directly carried out for the user, and therefore the convenient breakpoint continuous playing service is provided for the user. In addition, only public equipment and private equipment participate in interaction in the whole process, and information confirmation (such as acquisition of broadcast control records from an application server and the like) with other equipment is not needed, so that the stability of the breakpoint continuous broadcast service is improved.

In the above examples, data acquisition and transmission of biometric information and broadcast control records are involved. In some implementations, the public device (e.g., a television) and/or the private device (e.g., a mobile phone) may store the acquired biometric information and the broadcast control record in the corresponding storage area according to a built-in storage mechanism thereof, and call the corresponding data for transmission according to the method in the above example. For example, the tv and the mobile phone can complete all data interaction (such as processing and storing of the biometric information and broadcast control record) in the RE and all steps in the above playing method of the multimedia stream file.

In other implementations of the application, the public device and/or the private device may process data with different security requirements separately. For example, the storage and processing of biometric information may be separated from the storage and processing of broadcast control records to achieve isolation of data for different security requirements. It should be understood that, because the security requirement of the biometric information is high, the security of the biometric information can be improved by the user authorization mechanism shown in fig. 4 and 6 in the above description. In other implementations of the present application, in order to further enhance the security of the biometric information, as described in conjunction with fig. 2, TE and RE may be disposed in electronic devices (such as a private device and a public device), and the purpose of enhancing the security of the biometric information is achieved by independently processing data.

Illustratively, TE and RE in an electronic device may be isolated in a variety of ways. In some implementations, REs and TEs in an electronic device may be physically isolated. For example, the electronic device may configure its internal memory to use a fixed physical memory address segment as TE and other physical memory address segments as RE. To achieve physical isolation between TE stored data and RE stored data. In other implementations, the RE and TE may also be virtual isolation implemented by software configuration. For example, a virtual operating system corresponding to the TE and a virtual operating system corresponding to the RE may be configured in the electronic device, respectively. The virtual operating system is capable of providing processing, storage, and communication functions. The electronic device can store and process the information with higher security level through the TE, and store and process other information with lower security level, such as broadcast control record, through the RE. Therefore, the biological identification information of the user is isolated from other information, and the safety of the biological identification information can be improved.

The breakpoint resume method provided by the embodiment of the present application is exemplarily described below with an example that a public device and a private device are both provided with a virtual operating system (for example, simply referred to as TE) corresponding to the TE and a virtual operating system (for example, simply referred to as RE) corresponding to the RE, wherein the private device is provided with TE1 and RE1, and the public device is provided with TE2 and RE 2. As shown in fig. 14, the method may include S1401-S1410.

S1401, TE1 transmit biometric information to TE 2.

In conjunction with the above description, before the TE1 transmits the biometric information to the TE2, it may be determined that the authorization module (not shown in fig. 14) in the private device has obtained the authorization of the user, and then the transmission of the biometric information is performed, thereby improving the security of the biometric information.

S1402 and TE2 receive biometric information.

S1403, TE2 store the correspondence between biometric information and the user.

S1404 and RE1 monitor the playing of the multimedia stream, and obtain the play control record.

S1405, RE1 sends the play control record to RE 2.

S1406, TE2 acquires the biometric information of the current user.

S1407 and TE2 determine the user matching result according to the obtained biological identification information of the current user.

S1408, TE2 sends the user matching result to RE 2.

S1409 and RE2 determine the playing control record corresponding to the user matching result.

S1410 and RE2 perform breakpoint continuous playing according to the play control record.

The execution processes of the above-mentioned S1401-S1410 are related to the description of the aforementioned fig. 4, and the execution processes are similar, and are not described again here.

It can be seen that in the method shown in fig. 14, data related to biometric information is processed in TE (e.g. TE1 for private devices and TE2 for public devices), so that separate processing of biometric information and other information (e.g. broadcast control records) is realized, and convenient breakpoint resume service can be provided for users while ensuring security of biometric information.

Note that, in executing S1401, the TE1 can directly share biometric information with the TE2 by its communication function. In other implementations, the TE1 can also implement sharing of biometric information with the TE2 through a communication function between the RE1 and the RE 2. Illustratively, when the TE1 of the private device communicates with the TE2 of the public device, the private device can exchange a public key with the RE2 of the public device through the RE1 arranged therein, so that the TE1 which needs to transmit the biometric information encrypts the biometric information according to the public key and the private key of the TE1, and transmits the encrypted biometric information through a transmission channel between the RE1 and the RE 2. The RE2 may forward the received encrypted biometric information to the TE2, and the TE2 may decrypt the encrypted biometric information according to the public key and the private key of the TE2 to obtain the biometric information to be sent by the TE 1. Therefore, direct data communication between the TE1 and the TE2 is not needed, so that the TE1 and the TE2 do not need to provide communication functions between devices, and the requirements on hardware in the process of configuring the TE1 and the TE2 are further reduced.

The above description mainly introduces the solutions provided in the embodiments of the present application from the perspective of electronic devices (such as televisions and mobile phones). To implement the above functions, it includes hardware structures and/or software modules for performing the respective functions. Those of skill in the art would readily appreciate that the various illustrative elements and algorithm steps described in connection with the embodiments disclosed herein may be implemented as hardware or combinations of hardware and computer software. Whether a function is performed as hardware or computer software drives hardware depends upon the particular application and design constraints imposed on the solution. Skilled artisans may implement the described functionality in varying ways for each particular application, but such implementation decisions should not be interpreted as causing a departure from the scope of the present application.

In the embodiment of the present application, the functional modules of the devices involved in the method may be divided according to the above method example, for example, each functional module may be divided corresponding to each function, or two or more functions may be integrated into one processing module. The integrated module can be realized in a hardware mode, and can also be realized in a software functional module mode. It should be noted that, in the embodiment of the present application, the division of the module is schematic, and is only one logic function division, and there may be another division manner in actual implementation.

Please refer to fig. 15, which is a block diagram illustrating a multimedia stream playing apparatus 1500 according to an embodiment of the present disclosure. The playing apparatus 1500 of the multimedia stream may be a public device such as a television, or may be a chip inside the public device, and may implement the embodiments shown in fig. 4 and fig. 14 and the above-mentioned optional embodiments.

As shown in fig. 15, the apparatus 1500 for playing a multimedia stream may include: a detection module 1501, an acquisition module 1502 and a play module 1503. The detecting module 1501 is configured to detect first biometric information, where the first biometric information is used to identify a first user, and biometric information of different users is different. The obtaining module 1502 is configured to obtain a first broadcast control record corresponding to a first user according to the first biometric information. The first broadcast control record is acquired from the second electronic device, the first broadcast control record comprises a first time of the first multimedia stream recorded by the second electronic device, and the second electronic device is an electronic device corresponding to the first user. The playing module 1503 is configured to play the first multimedia stream from the first time according to the first play control record.

In a possible design, the obtaining module 1502 is further configured to, in a case where the second electronic device is in the same local area network as the first electronic device, obtain, by the first electronic device, the first broadcast control record from the second electronic device.

In one possible design, the detecting module 1501 is configured to trigger the detection of the first biometric information when the screen is turned off. Or, the detecting module 1501 is configured to trigger detection of the first biometric information when an image capturing module and/or a sound capturing module provided on the first electronic device detect the user. Or, the detecting module 1501 is configured to trigger the detection of the first biometric information when detecting the operation of the first electronic device by the user.

In one possible design, the obtaining module 1502 is configured to match the detected first biometric information with stored second biometric information of the first user, and obtain a first broadcast control record corresponding to the first user according to a matching result. Wherein the second biometric information of the first user is obtained from the second electronic device.

In a possible design, the obtaining module 1502 is further configured to obtain second biometric information of the first user from the second electronic device when the second electronic device is in a same local area network as the first electronic device.

In a possible design, the obtaining module 1502 is configured to obtain the second biometric information of the first user from the second electronic device if the second electronic device obtains the authorization information of the first user.

In one possible design, a secure world (TE) is provided in the first electronic device, and the apparatus further includes: a storage module 1504 for storing the acquired second biometric information of the first user in the TE.

In one possible design, detecting module 1501 is further configured to detect third biometric information, where the third biometric information is used to identify the second user. An obtaining module 1502 is configured to obtain a second broadcast control record corresponding to a second user according to the third biometric information. Wherein the second broadcast record is obtained from a third electronic device. The second broadcast control record includes a second time of a second multimedia stream recorded by a third electronic device, the third electronic device being an electronic device corresponding to the second user. The playing module 1503 is configured to play the second multimedia stream from the second time according to the second play control record.

In one possible design, the playing module 1503 is configured to continue playing the first multimedia stream from the first time directly on the interface of the first electronic device according to the first play control record. Or the playing module 1503 is configured to display, according to the first broadcast control record, a first prompt corresponding to the first broadcast control record on an interface of the first electronic device. The first electronic device receives a first operation of the first prompt, and in response to the first operation, the first electronic device continues to play the first multimedia stream on the interface from a first time.

In a possible design, when the first electronic device detects the first biometric information of the first user and the second biometric information of the second user at the same time, the playing module 1503 is configured to play the first multimedia stream or the second multimedia stream according to the priority according to the first broadcast control record and the second broadcast control record. Or the playing module 1503, configured to randomly select to play the first multimedia stream or the second multimedia stream according to the first broadcast control record and the second broadcast control record. Or a playing module 1503, configured to play the first multimedia stream or the second multimedia stream according to a selection of the user.

In a possible design, if the first electronic device detects the first user and the third user at the same time, the playing module 1503 is further configured to display a prompt message of the first broadcast control record before the first electronic device starts playing the first multimedia stream from the first time according to the first broadcast control record, where the prompt message hides all or part of information related to the first multimedia stream.

In a possible design, the playing module 1503 is further configured to adjust playing of the first multimedia stream according to the device information of the second electronic device.

In one possible design, the obtaining module 1502 is further configured to, when the first multimedia stream is played, obtain a third play control record for playing the first multimedia stream, where the third play control record is used to indicate a third time when the first multimedia stream is currently played. The device further comprises a sending module 1505 for the first electronic device to send the third broadcast control record to the second electronic device, so that the second electronic device continues to play the first multimedia stream from a third time according to the third broadcast control record.

It should be understood that the playing apparatus of the multimedia stream in the embodiment of the present application may be implemented by software, for example, a computer program or instructions having the above-mentioned functions, and the corresponding computer program or instructions may be stored in a memory inside the public device, and the corresponding computer program or instructions inside the memory may be read by the processor to implement the above-mentioned functions. Alternatively, the playing device of the multimedia stream in the embodiment of the present application may also be implemented by hardware. Alternatively, the playing device of the multimedia stream in the embodiment of the present application may also be implemented by a combination of a processor and a software module.

Fig. 16 shows a schematic block diagram of an electronic device 1600. The electronic device may be any of the above examples of a public device, for example, the electronic device may be a television. Illustratively, as shown in fig. 16, the playing device 1600 for the multimedia stream may include: a processor 1601, and a memory 1602. The memory 1602 is used to store computer-executable instructions. For example, in some embodiments, when the processor 1601 executes the instructions stored in the memory 1602, the electronic device 1600 may be caused to perform any function of the public device in the above embodiments, so as to implement any method for playing a multimedia stream in the above examples.

It should be noted that all relevant contents of each step related to the above method embodiment may be referred to the functional description of the corresponding functional module, and are not described herein again.

Fig. 17 shows a schematic diagram of a chip system 1700. The chip system 1700 may be provided in a public device. The chip system 1700 may be provided in a television, for example. Illustratively, the chip system 1700 may include: a processor 1701 and a communication interface 1702 for supporting a public device to implement the functions referred to in the above embodiments. In one possible design, the system-on-chip further includes a memory for storing necessary program instructions and data for the electronic device. The chip system may be constituted by a chip, or may include a chip and other discrete devices. It should be noted that, in some implementations of the present application, the communication interface 1702 may also be referred to as an interface circuit.

Please refer to fig. 18, which is a block diagram illustrating a multimedia stream playing apparatus 1800 according to an embodiment of the present application. The playing apparatus 1800 of the multimedia stream may be a private device such as a mobile phone, or may be a chip inside the private device, and may implement the optional embodiments as shown in fig. 4 and fig. 14 and described above.

As shown in fig. 18, the apparatus 1800 for playing the multimedia stream may include: an obtaining module 1801 and a sending module 1802. An obtaining module 1801 is configured to obtain a first broadcast control record, where the first broadcast control record includes a first time of a first multimedia stream recorded by a first electronic device, where the first multimedia stream is played to a first user by the first electronic device. A sending module 1802, configured to send the first broadcast control record to the second electronic device, so that the second electronic device continues to play the first multimedia stream to the first user from the first time according to the first broadcast control record.

In a possible design, the obtaining module 1801 is specifically configured to generate a first broadcast control record when an operation of interrupting the playing of the first multimedia stream is detected, where the operation corresponding to the interruption includes an operation of stopping, pausing, or exiting the playing of the first multimedia stream.

In one possible design, the sending module 1802 is configured to send the first broadcast control record to the second electronic device when the second electronic device and the first electronic device are in the same local area network.

In a possible design, the sending module 1802 is further configured to send, by the second electronic device, the first biometric information of the first user to the second electronic device when the second electronic device is in the same local area network as the first electronic device, so that the second electronic device determines to continue playing the first multimedia stream according to the first broadcast control record according to the first biometric information.

It should be understood that the playing device of the multimedia stream in the embodiment of the present application may be implemented by software, for example, a computer program or instructions having the above-mentioned functions, and the corresponding computer program or instructions may be stored in a memory inside the private apparatus, and the corresponding computer program or instructions inside the memory may be read by the processor to implement the above-mentioned functions. Alternatively, the playing device of the multimedia stream in the embodiment of the present application may also be implemented by hardware. Alternatively, the playing device of the multimedia stream in the embodiment of the present application may also be implemented by a combination of a processor and a software module.

Fig. 19 shows a schematic block diagram of an electronic device 1900. The electronic device may be any one of the private devices in the above examples, for example, the electronic device may be a cell phone. Illustratively, as shown in fig. 19, the playing device 1900 for the multimedia stream may include: a processor 1901 and a memory 1902. The memory 1902 is used to store computer-executable instructions. For example, in some embodiments, when the processor 1901 executes the instructions stored in the memory 1902, the electronic device 1900 may be caused to perform any function of the private device in the above embodiments, so as to implement the playing method of any multimedia stream in the above examples.

Fig. 20 shows a schematic diagram of a chip system 2000. The system-on-chip 2000 may be provided in a private device. The chip system 2000 may be provided in a mobile phone, for example. Illustratively, the chip system 2000 may include: a processor 2001 and a communication interface 2002 for enabling a proprietary device to implement the functions involved in the above embodiments. In one possible design, the system-on-chip further includes a memory for storing necessary program instructions and data for the electronic device. The chip system may be constituted by a chip, or may include a chip and other discrete devices. It should be noted that, in some implementations of the present application, the communication interface 2002 may also be referred to as an interface circuit.

Fig. 21 is a schematic diagram illustrating a system 2100 for playing a multimedia stream according to an embodiment of the present application. As shown in fig. 21, the system 2100 for playing a multimedia stream may include a first electronic device 2101 and a second electronic device 2102. In some implementations, the first electronic device 2101 can be a television as shown in fig. 3, and the second electronic device 2102 can be any one of the cell phones 1 through N as shown in fig. 3. The system 2100 for playing multimedia stream can be used to implement the method for playing multimedia stream according to the method shown in fig. 4 or fig. 14. Alternatively, the system 2100 for playing multimedia streams may be used to implement other methods for playing multimedia streams involved in the embodiments of the present application. It should be noted that, in some implementations of the present application, the system 2100 for playing a multimedia stream may further include another second electronic device, which is used to implement any one of the methods for playing a multimedia stream provided in the embodiments of the present application.

The functions or actions or operations or steps, etc., in the above embodiments may be implemented in whole or in part by software, hardware, firmware, or any combination thereof. When implemented using a software program, may be implemented in whole or in part in the form of a computer program product. The computer program product includes one or more computer instructions. The procedures or functions described in accordance with the embodiments of the present application are all or partially generated upon loading and execution of computer program instructions on a computer. The computer may be a general purpose computer, a special purpose computer, a network of computers, or other programmable device. The computer instructions may be stored on a computer readable storage medium or transmitted from one computer readable storage medium to another, for example, from one website, computer, server, or data center to another website, computer, server, or data center via wire (e.g., coaxial cable, fiber optic, Digital Subscriber Line (DSL)) or wireless (e.g., infrared, wireless, microwave, etc.). The computer-readable storage medium can be any available medium that can be accessed by a computer or can comprise one or more data storage devices, such as a server, a data center, etc., that can be integrated with the medium. The usable medium may be a magnetic medium (e.g., floppy disk, hard disk, magnetic tape), an optical medium (e.g., DVD), or a semiconductor medium (e.g., Solid State Disk (SSD)), among others.

Although the present application has been described in conjunction with specific features and embodiments thereof, it will be evident that various modifications and combinations can be made thereto without departing from the spirit and scope of the application. Accordingly, the specification and figures are merely exemplary of the present application as defined in the appended claims and are intended to cover any and all modifications, variations, combinations, or equivalents within the scope of the present application. It will be apparent to those skilled in the art that various changes and modifications may be made in the present application without departing from the spirit and scope of the application. Thus, if such modifications and variations of the present application fall within the scope of the claims of the present application and their equivalents, the present application is also intended to include such modifications and variations.

Claims

1. A method for playing a multimedia stream, the method being applied to a first electronic device having a function of playing the multimedia stream, the method comprising:

the first electronic equipment detects first biological identification information, wherein the first biological identification information is used for identifying a first user, and the biological identification information of different users is different;

the first electronic equipment acquires a first broadcast control record corresponding to the first user according to the first biological identification information; wherein the first broadcast control record is obtained from a second electronic device, the first broadcast control record includes a first time of a first multimedia stream recorded by the second electronic device, and the second electronic device is an electronic device corresponding to the first user;

and the first electronic equipment plays the first multimedia stream from the first time according to the first play control record.

2. The method according to claim 1, wherein the first time of the first multimedia stream recorded by the second electronic device is a time when the playing of the first multimedia stream by the second electronic device is interrupted;

the operation corresponding to the interruption comprises the operation of stopping, pausing or exiting the playing of the first multimedia stream.

3. The method according to claim 1 or 2, characterized in that the method further comprises:

and under the condition that the second electronic equipment and the first electronic equipment are in the same local area network, the first electronic equipment acquires the first broadcast control record from the second electronic equipment.

4. The method of any of claims 1-3, wherein the first electronic device detects first biometric information, comprising:

when the first electronic equipment is awakened from a screen, triggering and detecting the first biological identification information; alternatively, the first and second electrodes may be,

the first electronic equipment triggers and detects the first biological identification information when an image acquisition module and/or a sound acquisition module arranged on the first electronic equipment detect a user; alternatively, the first and second electrodes may be,

the first electronic equipment triggers and detects the first biological identification information when detecting the operation of a user on the first electronic equipment.

5. The method according to any one of claims 1 to 4, wherein the acquiring, by the first electronic device, the first play record corresponding to the first user according to the first biometric information specifically includes:

the first electronic equipment matches the detected first biological identification information with stored second biological identification information of the first user, and acquires the first broadcast control record corresponding to the first user according to a matching result; wherein the second biometric information of the first user is obtained from the second electronic device.

6. The method of claim 5, further comprising:

and when the second electronic equipment and the first electronic equipment are in the same local area network, the first electronic equipment acquires second biological identification information of the first user from the second electronic equipment.

7. The method of claim 6, wherein the first electronic device obtains second biometric information of the first user from the second electronic device if the second electronic device obtains authorization information of the first user.

8. The method according to any of claims 5-7, wherein a secure world TE is provided in the first electronic device, the method further comprising:

the first electronic device stores the acquired second biometric information of the first user in the TE.

9. The method according to any one of claims 1-8, further comprising:

the first electronic equipment detects third biological identification information, and the third biological identification information is used for identifying a second user;

the first electronic equipment acquires a second broadcast control record corresponding to the second user according to the third biological identification information; wherein the second broadcast control record is obtained from a third electronic device; the second broadcast control record comprises a second time of a second multimedia stream recorded by the third electronic device, the third electronic device being an electronic device corresponding to the second user;

and the first electronic equipment plays the second multimedia stream from the second time according to the second play control record.

10. The method of any of claims 1-9, wherein the first electronic device plays the first multimedia stream starting from the first time according to the first play record, comprising:

the first electronic equipment directly continues to play the first multimedia stream from the first time on an interface of the first electronic equipment according to the first play control record; alternatively, the first and second electrodes may be,

the first electronic equipment displays a first prompt corresponding to the first broadcast control record on an interface of the first electronic equipment according to the first broadcast control record; the first electronic device receives a first operation of the first prompt, and in response to the first operation, the first electronic device continues to play the first multimedia stream from the first time on an interface.

11. The method according to claim 9 or 10, wherein when the first electronic device simultaneously detects the first biometric information of the first user and the second biometric information of the second user, the method further comprises:

the first electronic equipment plays the first multimedia stream or the second multimedia stream according to the priority according to the first broadcast control record and the second broadcast control record; or

The first electronic equipment randomly selects to play the first multimedia stream or the second multimedia stream according to the first broadcast control record and the second broadcast control record; or

And according to the selection of the user, the first electronic equipment plays the first multimedia stream or the second multimedia stream.

12. The method of any of claims 1-11, wherein if the first electronic device detects the first user and a third user simultaneously, before the first electronic device plays the first multimedia stream from the first time according to the first play control record, the method further comprises:

and the first electronic equipment displays prompt information recorded by the first broadcast control, wherein the prompt information hides all or part of information related to the first multimedia stream.

13. The method of any of claims 1-12, wherein the first broadcast record further comprises device information of the second electronic device.

14. The method of claim 13, wherein the first electronic device adjusts the playing of the first multimedia stream according to device information of the second electronic device.

15. The method according to any one of claims 1-14, further comprising:

when the first electronic device plays the first multimedia stream, acquiring a third play control record for playing the first multimedia stream, wherein the third play control record is used for indicating a third time when the first multimedia stream is played currently;

and the first electronic equipment sends the third broadcast control record to the second electronic equipment, so that the second electronic equipment continues to play the first multimedia stream from the third time according to the third broadcast control record.

16. A method for playing a multimedia stream, the method being applied to a first electronic device having a function of playing the multimedia stream, the method comprising:

the first electronic equipment acquires a first broadcast control record, wherein the first broadcast control record comprises a first time of a first multimedia stream recorded by the first electronic equipment;

and the first electronic equipment sends the first broadcast control record to second electronic equipment, so that the second electronic equipment can continue to play the first multimedia stream to the first user from the first time according to the first broadcast control record.

17. The method of claim 16, wherein the first electronic device obtaining a first broadcast record comprises:

and the first electronic equipment generates the first play control record when detecting an operation of interrupting the play of the first multimedia stream, wherein the operation corresponding to the interruption comprises an operation of stopping, pausing or exiting the play of the first multimedia stream.

18. The method of claim 16 or 17, wherein the first electronic device sending the first broadcast record to a second electronic device comprises:

and under the condition that the second electronic equipment and the first electronic equipment are in the same local area network, the first electronic equipment sends the first broadcast control record to the second electronic equipment.

19. The method of any of claims 16-18, wherein prior to the first electronic device sending the first broadcast record to a second electronic device, the method further comprises:

and the first electronic equipment sends the first biological identification information of the first user to the second electronic equipment, so that the second electronic equipment continues to play the first multimedia stream according to the first broadcast control record according to the first biological identification information.

20. An electronic device having functionality for playing multimedia streams, the electronic device comprising one or more processors and one or more memories; the one or more memories coupled with the one or more processors, the one or more memories storing computer instructions;

the computer instructions, when executed by the one or more processors, cause the electronic device to perform a method of playing a multimedia stream as recited in any of claims 1-15.

21. An electronic device having functionality for playing multimedia streams, the electronic device comprising one or more processors and one or more memories; the one or more memories coupled with the one or more processors, the one or more memories storing computer instructions;

the computer instructions, when executed by the one or more processors, cause the electronic device to perform a method of playing a multimedia stream as recited in any of claims 16-19.

22. A chip system, wherein the chip comprises processing circuitry and an interface; the processing circuit is configured to call and run a computer program stored in a storage medium from the storage medium to execute a playing method of a multimedia stream according to any one of claims 1 to 15, or execute a playing method of a multimedia stream according to any one of claims 16 to 19.

23. A computer-readable storage medium, characterized in that it comprises computer instructions which, when executed, perform a method of playing back a multimedia stream according to any one of claims 1-15, or a method of playing back a multimedia stream according to any one of claims 16-19.

24. A playing system for multimedia streams, characterized in that the playing system comprises an electronic device according to claim 20 and an electronic device according to claim 21.