CN115804114A

CN115804114A - Multimedia interaction method, playing equipment, mobile terminal and electronic device

Info

Publication number: CN115804114A
Application number: CN202180000649.1A
Authority: CN
Inventors: 徐丽蓉; 马永达; 马明园; 温垦
Original assignee: BOE Technology Group Co Ltd
Current assignee: BOE Technology Group Co Ltd
Priority date: 2021-03-30
Filing date: 2021-03-30
Publication date: 2023-03-14
Also published as: WO2022204933A1

Abstract

A multimedia interaction method is used for a first playing device, and comprises the following steps: (S12) receiving a play stop instruction to control the first playing device to stop playing the multimedia content and determine first playing information; and (S14) uploading the first playing information to the mobile terminal so that the mobile terminal sends the first playing information to the second playing device, and the second playing device continues to play the multimedia content of the first playing device according to the first playing information. The application also discloses a playing device, a mobile terminal, an electronic device and a storage medium.

Description

Multimedia interaction method, playing equipment, mobile terminal and electronic device

Technical Field

The present application relates to the field of streaming media technologies, and in particular, to a multimedia interaction method, a playing device, a mobile terminal, and an electronic apparatus.

Background

The current multimedia display modes comprise a plurality of mobile terminals or large-scale non-mobile terminals such as televisions, mobile phones, ipads, vehicle-mounted screens and the like. However, the rhythm of life of people is very fast, so that people often cannot continuously watch or listen to complete audio-visual contents at a certain terminal. For example, before going out in the morning, many people may select to turn on a television or a mobile phone to listen to news or English and other learning contents, after going out, driving still wants to listen to news continuously, related audiovisual information needs to be called on a vehicle-mounted screen, a user needs to select corresponding apps in multiple steps according to memory, adjust to the same playing position to listen continuously, time is consumed, and audiovisual contents cannot be played directly and continuously.

Disclosure of Invention

In view of the above, the present invention is directed to solving, at least to some extent, one of the problems in the related art. Therefore, the present application aims to provide a multimedia interaction method, a playing device, a mobile terminal and an electronic device.

The multimedia interaction method of the embodiment of the application is used for a first playing device, and comprises the following steps: receiving a playing stopping instruction to control the first playing device to stop playing the multimedia content and determine first playing information; and uploading the first playing information to a mobile terminal so that the mobile terminal sends the first playing information to a second playing device, and the second playing device continues to play the multimedia content of the first playing device according to the first playing information.

In certain embodiments, the method comprises: receiving second playing information sent by the mobile terminal, wherein the second playing information is determined playing information for stopping playing the multimedia content after the second playing equipment receives the playing stopping instruction; and continuing to play the multimedia content of the second playing device according to the second playing information.

In some embodiments, the first playback information includes: at least one of the playing content, the playing position and the playing application when the first playing device stops playing; the second playing information comprises: and at least one of the playing content, the playing position and the playing application when the second playing device stops playing.

In certain embodiments, the method comprises: receiving the playing stopping instruction actively input by a user through input equipment and sending the playing stopping instruction to the first playing equipment; or detecting the user state in a preset range to automatically generate the playing stopping instruction.

In some embodiments, the first playback device and the mobile terminal are in a first communication network, and the second playback device and the mobile terminal are in a second communication network.

In some embodiments, the receiving a stop playing instruction to control the first playing device to stop playing the multimedia content and determining the first playing information includes: receiving a play stopping instruction sent by the mobile terminal through NFC to control the first playing device to stop playing the multimedia content and determine the first playing information; the uploading the first playing information to the mobile terminal so that the mobile terminal sends the first playing information to the second playing device, and the enabling the second playing device to continue playing the multimedia content of the first playing device according to the first playing information includes: uploading the first playing information to the mobile terminal through NFC so that the mobile terminal sends the first playing information to the second playing device, and the second playing device continues to play the multimedia content of the first playing device according to the first playing information.

The multimedia interaction method of the embodiment of the application is used for a mobile terminal, and the method comprises the following steps: receiving first playing information uploaded by first playing equipment, wherein the first playing information is determined playing information for stopping playing multimedia contents after the first playing equipment receives a playing stopping instruction; and sending the first playing information to corresponding second playing equipment, so that the corresponding second playing equipment continues to play the multimedia content of the first playing equipment.

In certain embodiments, the method comprises: receiving second playing information uploaded by the second playing device, wherein the second playing information is determined playing information for stopping playing the multimedia content after the second playing device receives the playing stopping instruction; and sending the second playing information to corresponding first playing equipment, so that the corresponding first playing equipment continues to play the multimedia content of the second playing equipment.

In some embodiments, the first playback device and the mobile terminal are in a first communication network, and the second playback device and the mobile terminal are in a second communication network

In some embodiments, before sending the first playing information to the corresponding second playing device, so that the corresponding second playing device continues to play the multimedia content of the first playing device, the method further includes: detecting motion information of the mobile terminal; and when the motion information of the mobile terminal meets a first preset condition, sending first selection information to enable a user to select a second playing device for continuously playing the multimedia content according to the first selection information.

In some embodiments, the motion information includes a moving speed and a moving direction, and the moving speed and the moving direction of the mobile terminal are determined by the mobile terminal through the attitude sensor and the GPS module.

In some embodiments, the sending out first selection information to enable a user to select a second playing device for continuing to play multimedia content according to the first selection information when the motion information of the mobile terminal meets a first preset condition includes: determining the motion trend of the mobile terminal according to the moving speed and the moving direction of the mobile terminal; and sending the first selection information when the motion trend is away from the preset range of the first playing device.

In some embodiments, after issuing the first selection information to enable the user to select the second playing device for continuing to play the multimedia content according to the first selection information when the motion information of the mobile terminal meets the first preset condition, the method further includes: responding to the operation of selecting the second playing device by the user, and detecting the position information of the mobile terminal and the position information of the second playing device; and when the position information of the mobile terminal and the position information of the second playing device meet a second preset condition, sending second selection information to enable a user to select whether to connect the second playing device or not according to the second selection information and send the first playing information to the second playing device.

In some embodiments, when the location information of the mobile terminal and the location information of the second playback device satisfy a second preset condition, sending second selection information to enable a user to select whether to connect the second playback device according to the second selection information and send the first playback information to the second playback device includes: and sending the second selection information when the distance between the mobile terminal and the second playing device is determined to be smaller than a distance threshold and the direction is within an angle threshold range.

In some embodiments, the sending the first playing information to the corresponding second playing device so that the corresponding second playing device continues to play the multimedia content of the first playing device further includes: responding to the operation that a user selects to connect the second playing device and sends the first playing information to the second playing device, sending the first playing information to the second playing device, and enabling the second playing device to continue playing the multimedia content of the first playing device.

In some embodiments, the sending the first playing information to the corresponding second playing device so that the corresponding second playing device continues to play the multimedia content of the first playing device further includes: and the mobile terminal sends the first playing information to the corresponding second playing equipment through NFC, so that the second playing equipment continues to play the multimedia content of the first playing equipment.

The playing device of the embodiment of the application comprises a first playing device and a second playing device. The first playing device comprises a first receiving module and a first transmitting module. The first receiving module is used for receiving a playing stopping instruction to control the first playing device to stop playing the multimedia content and determine first playing information; the first transmission module is used for uploading the first playing information to a mobile terminal so that the mobile terminal sends the first playing information to a second playing device, and the second playing device continues to play the multimedia content of the first playing device according to the first playing information.

The mobile terminal of the embodiment of the application comprises a second receiving module and a second transmitting module. The second receiving module is used for receiving first playing information uploaded by first playing equipment, wherein the first playing information is playing information which is determined after the first playing equipment stops playing the multimedia content after receiving the playing stopping instruction; the second transmission module is used for transmitting the first playing information to corresponding second playing equipment, so that the corresponding second playing equipment continues to play the multimedia content of the first playing equipment.

The electronic device comprises a processor and a memory, wherein the memory stores a computer program, and the computer program is used for receiving a playing stopping instruction to control a first playing device to stop playing multimedia content and determine first playing information when being executed by the processor; uploading the first playing information to a mobile terminal so that the mobile terminal sends the first playing information to a second playing device, so that the second playing device continues to play the multimedia content of the first playing device according to the first playing information, or receiving the first playing information uploaded by the first playing device, wherein the first playing information is the playing information determined by the first playing device after the first playing device receives a playing stopping instruction; and sending the first playing information to corresponding second playing equipment, so that the corresponding second playing equipment continues to play the multimedia content of the first playing equipment.

One or more non-transitory computer-readable storage media containing a computer program are provided, storing a computer program that, when executed by one or more processors, causes the processors to perform the steps of the multimedia interaction method described above.

Additional aspects and advantages of the present application will be set forth in part in the description which follows and, in part, will be obvious from the description, or may be learned by practice of the present application.

Drawings

The foregoing and/or additional aspects and advantages of the present application will become apparent and readily appreciated from the following description of the embodiments, taken in conjunction with the accompanying drawings of which:

FIG. 1 is a schematic flow chart diagram of a multimedia interaction method according to some embodiments of the present application;

FIG. 2 is a schematic diagram of a playback device according to some embodiments of the present application;

FIG. 3 is a schematic flow chart diagram of a multimedia interaction method according to some embodiments of the present application;

FIG. 4 is a schematic diagram of a first playback device according to some embodiments of the present application;

FIG. 5 is a schematic view of a multimedia interaction method according to some embodiments of the present application;

FIG. 6 is a flow chart illustrating a multimedia interaction method according to some embodiments of the present application;

FIG. 7 is a block diagram of a mobile terminal according to some embodiments of the present application;

FIG. 8 is a flow chart illustrating a multimedia interaction method according to some embodiments of the present application;

FIG. 9 is a flow chart illustrating a method of multimedia interaction in some embodiments of the present application;

FIG. 10 is a block diagram of a mobile terminal according to some embodiments of the present application;

FIG. 11 is a schematic view of a multimedia interaction method according to some embodiments of the present application;

FIG. 12 is a schematic diagram of a multimedia interaction method according to some embodiments of the present application;

FIG. 13 is a schematic flow chart diagram of a method of multimedia interaction in some embodiments of the present application;

FIG. 14 is a schematic structural diagram of an electronic device according to some embodiments of the present application;

FIG. 15 is a schematic diagram of a computer-readable storage medium according to some embodiments of the present application.

Detailed Description

Reference will now be made in detail to embodiments of the present application, examples of which are illustrated in the accompanying drawings, wherein like reference numerals refer to the same or similar elements or elements having the same or similar functions throughout. The embodiments described below with reference to the accompanying drawings are illustrative and are only for the purpose of explaining the present application and are not to be construed as limiting the present application.

In the description of the present application, it is to be understood that the terms "first", "second" are used for descriptive purposes only and are not to be construed as indicating or implying relative importance or implying any number of technical features indicated. Thus, features defined as "first", "second", may explicitly or implicitly include one or more of the described features. In the description of the present application, "a plurality" means two or more unless explicitly defined otherwise.

In the description of the present application, it should be noted that, unless otherwise explicitly stated or limited, the terms "mounted," "connected," and "connected" are to be construed broadly, and may be, for example, a fixed connection, a detachable connection, or an integral connection; may be mechanically connected, may be electrically connected or may be in communication with each other; either directly or indirectly through intervening media, either internally or in any other relationship. The specific meaning of the above terms in the present application can be understood by those of ordinary skill in the art as appropriate.

The following disclosure provides many different embodiments or examples for implementing different features of the application. To simplify the disclosure of the present application, specific example components and arrangements are described below. Of course, they are merely examples and are not intended to limit the present application. Further, the present application may repeat reference numerals and/or reference letters in the various examples for simplicity and clarity and does not in itself dictate a relationship between the various embodiments and/or arrangements discussed.

Reference will now be made in detail to embodiments of the present application, examples of which are illustrated in the accompanying drawings, wherein like or similar reference numerals refer to the same or similar elements or elements having the same or similar function throughout. The embodiments described below with reference to the accompanying drawings are illustrative and are only for the purpose of explaining the present application and are not to be construed as limiting the present application.

The current multimedia display modes comprise a plurality of mobile terminals or large-scale non-mobile terminals such as a television, a mobile phone, an ipad, a vehicle-mounted screen and the like, and the rhythm of life of people is very fast, so that people can not continuously watch or listen to complete audio-visual contents at a certain terminal. For example, before going out in the morning, many people can select to turn on a television or a mobile phone to listen to news or learning contents such as english, and when driving and continuing to listen to news after going out, related audiovisual information needs to be called on a vehicle-mounted screen, and a user needs to select corresponding apps in multiple steps according to memory, adjust to the same playing position to continue listening, so that time is consumed, and audiovisual contents cannot be continuously played. For another example, when a user needs to go out while watching a television program, the user cannot continue to watch the same television program while sitting in a car; or, when the user watches the audio-visual content of the mobile terminal such as the mobile phone before returning home, and needs to continue to enjoy the audio-visual content by using a large screen or a sound box with the viewing experience or audio experience at home after returning home, the user needs to reset the screen or the sound box, which consumes time, and the user cannot directly continue to continuously play the audio-visual content watched before returning home.

In view of this, the embodiment of the present application first describes a multimedia interaction method of the present application from a playback device side.

Referring to fig. 1, an embodiment of the present application provides a multimedia interaction method for a first playback device, the method including:

s12: receiving a playing stopping instruction to control a first playing device to stop playing the multimedia content and determine first playing information;

s14: and uploading the first playing information to the mobile terminal so that the mobile terminal sends the first playing information to the second playing device, and the second playing device continues to play the multimedia content of the first playing device according to the first playing information.

Referring to fig. 2, the present application further provides a playing device 100, where the playing device 100 includes a first playing device 10 and a second playing device 20, and the first playing device 10 includes: a first receiving module 12 and a first transmitting module 14.

Step S12 may be implemented by the first receiving module 12 and step S14 may be implemented by the first transmitting module 14. That is, the first receiving module 12 is configured to receive a play stop instruction to control the first playing device 10 to stop playing the multimedia content and determine the first playing information; the first transmitting module 14 is configured to upload the first playing information to the mobile terminal, so that the mobile terminal sends the first playing information to the second playing device 20, and the second playing device 20 continues to play the multimedia content of the first playing device 10 according to the first playing information.

Specifically, the first playing device 10 includes a large-screen playing device such as a television and an intelligent mirror, the first playing device 10 may further include a screen playing device of a fitness equipment, and other smart homes with screens such as ipads, and the second playing device 20 of the present application may be the same as the first playing device 10 in terms of location, for example, model, size, and type, except that the location is different from that of the first playing device, that is, the multimedia interaction method of the present application is also applicable to the second playing device 20, and the first playing device 10 and the second playing device 20 may be interchanged. The mobile terminal in the application is an Access Point (AP) of a plurality of remote playing devices, and the mobile terminal includes mobile electronic devices such as a mobile phone and a tablet computer.

The first playing device 10 may passively receive an input of a stop playing instruction from a user, such as an input of a remote controller or an input of a touch screen. In addition, the first playing device 10 may also actively input a playing stop instruction, for example, the first playing device 10 detects whether the user is in front of the screen by detecting an infrared image of the user through infrared, and the first playing device 10 actively inputs the playing stop instruction if the user is not in front of the screen; or the first playing device 10 analyzes the sight of the user by acquiring the user image, and if the analysis result shows that the sight of the user is separated from the screen of the first playing device 10, the first playing device 10 may actively input a playing stopping instruction; or acquiring the visual field range of the screen to determine whether the user is in the visual field range of the first playing device 10, and if the determination result is that the user is not in the visual field range of the first playing device 10, the first playing device 10 may actively input a playing stop instruction. Or the first playing device 10 may also actively input a playing stop instruction when detecting that the distance between the user and the screen of the first playing device 10 exceeds a preset distance threshold by detecting the distance between the user and the screen of the first playing device 10.

The first playing information includes multimedia content information such as news, learned video or audio lessons, etc. played by the first playing device 10. The first playing information may be multimedia content after the first playing device 10 determines to stop playing the node (including the stop playing node) after receiving the stop playing instruction, so that other playing devices (for example, the second playing device 20) directly start to continue playing the multimedia content from the stop playing node of the first playing device 10 after receiving the first playing information, thereby achieving the purpose that the user continuously watches the multimedia content in different places.

In addition, the first playing information may also be all playing contents of the playing program determined by the first playing device 10 after receiving the instruction to stop playing (that is, the playing contents may be played from the beginning), and then the user selects a node to start playing in the second playing device 20, so as to increase the flexibility of playing.

Optionally, the first playing device 10 may receive an input that the user stops playing through Near Field Communication (NFC), and send the playing information to a mobile terminal such as a mobile phone through NFC. The NFC technology is a short-range high-frequency wireless communication technology. It will be appreciated that devices using NFC technology (e.g. mobile phones) may exchange data in close proximity to each other. The NFC technology is integrated and evolved from a non-contact Radio Frequency Identification (RFID) and an interconnection technology, and has a function of integrating an inductive card reader, an inductive card, and a point-to-point communication on a single chip.

The second playing device 20 is a playing device located at a different location from the first playing device 10, and may specifically include any one of a car-mounted player, another television or an ipad that is different from the first playing device 10 and has a screen. That is, the second playing device 20 only needs to be in a different location from the first playing device 10, and the types, models, and sizes of the two playing devices may be the same or different, which is not limited herein.

According to the multimedia interaction method, the mobile terminal uploads the first playing information after the playing of the first playing device 10 is stopped to the second playing device 20, the second playing device 20 continues to play the multimedia content of the first playing device 10 according to the first playing information, the effect of continuously playing the multimedia content in different places can be achieved, and the user experience is improved.

Referring to fig. 3, in some embodiments, the multimedia interaction method further includes:

s16: receiving second playing information sent by the mobile terminal, wherein the second playing information is determined playing information for stopping playing the multimedia content after the second playing equipment receives the playing stopping instruction;

s18: and continuing to play the multimedia content of the second playing device according to the second playing information.

Referring to fig. 4, the first playing device 10 further includes a first playing module 18.

Step S16 may be implemented by the first receiving module 12, and step S18 may be implemented by the first playing module 18. That is to say, the first receiving module 12 is configured to receive second playing information sent by the mobile terminal, where the second playing information is playing information that the second playing device stops playing the multimedia content after receiving the playing stop instruction and is determined; the first playing module 18 is configured to continue playing the multimedia content of the second playing device according to the second playing information.

It should be understood that, referring to fig. 5, the methods of step S16 and step S18 are the reverse of step S12 and step S14, that is, the second playing device 20 may also continue to present the multimedia content that has stopped playing in the first playing device 10 through the mobile terminal. Specifically, the second playing information is the playing information of the multimedia content that is stopped playing after the second playing device 20 receives the instruction to stop playing, the mobile terminal may receive the second playing information sent to the mobile terminal by the second playing device 20, the mobile terminal sends the second playing information to the first playing device 10, and the first playing device 10 may receive the second playing information sent by the mobile terminal and continue playing the multimedia content played by the second playing device 20 according to the second playing information.

It should be noted that, the first playback device 10 and the second playback device 20 of the present application may determine the playback content of the node to be stopped after receiving the instruction to stop playing, that is, the first playback device 10 determines the first playback information, and the second playback device 20 determines the second playback information in the same manner, where the second playback information is the same as the first playback information in nature. Therefore, the second playing information is similar to the first playing information, and the second playing information may be multimedia content after the playing device determines to stop the playing node (including the stop playing node) after receiving the stop playing instruction, or may be all playing content of the playing program determined after receiving the stop playing instruction (that is, the playing content may be played from the beginning in the second playing device 20).

More specifically, the first play information may include: the first playback device 10 stops at least one of the playback content, the playback position, and the playback application at the time of playback.

In one embodiment, when the first playing information only includes the playing content when the first playing device 10 stops playing, the playing content may refer to the playing content after the first playing device 10 stops playing the node (including stopping playing the node), so that the multimedia content is played continuously, conveniently and quickly. In addition, the first playing information may also refer to all playing contents of the multimedia content when the first playing device 10 stops playing (the playing contents may be played from the beginning in the second playing device 20), and the user may select a node to start playing in the second playing device 20 by himself, so that the playing is flexible.

In another embodiment, when the first playing information only includes the playing position, then the playing position may refer to a playing position where the first playing device 10 stops playing the node, the second playing device 20 may intelligently search for the multimedia content according to the playing position of the stop playing node and determine the playing position, and then the second playing device 20 may continue playing the multimedia content from the playing position.

In another embodiment, when the first playing information only includes the playing application, the playing application refers to the playing application when the first playing device 10 stops playing, and the second playing device 20 may directly select to play the corresponding multimedia content according to the playing application. The playing application may be, for example, an early education app for children, a news playing app, a video education app, or the like.

The first playing information includes a plurality of playing contents, playing positions and playing applications when the first playing device 10 stops playing, that is, the first playing information is obtained by combining two or three of the above three embodiments. For example, when the first playing information includes a playing content and a playing position, and the first playing information is a playing content after the current playing position (including the current playing position), the second playing device 20 may explicitly determine the playing position and the playing content for continuing playing, so that the user may realize to continue watching the multimedia content in a different place. When the first playing information includes the playing content and the playing application, the second playing device 20 may accurately determine the multimedia content to be played according to the playing application and the playing content, and may also enable the user to continue to watch the multimedia content in a different place. When the first playing information includes the playing content, the playing position, and the playing application, the second playing device 20 may accurately determine the playing position, the playing application, and the playing content to be played continuously according to the playing application, the playing position, and the playing content, and may also achieve the purpose that the user continues to watch the multimedia content in a different place. That is to say, the more information content the first playing information contains, the more accurate the playing content determined by the second playing device 20 is, the faster the playing is, and the experience of the user playing the multimedia content in different places is enhanced.

Similarly, the second playing information may also include: the second playing device 20 stops at least one of the playing content, the playing position and the playing application when playing is stopped, the second playing information is basically the same as the first playing information, and the second playing information and the first playing information are only different from each other as the playing devices to which the second playing information belongs, and are not described herein again.

In some embodiments, the first playback device 10 is in a first communication network with the mobile terminal, the first communication network comprising: one or more wireless communication protocols of DLNA, miracast, zigbee, airply and MQTT. That is to say, the first playing device 10 may perform communication connection with the mobile terminal through one or more wireless communication protocols of DLNA, miracast, zigbee, airlay, and MQTT. It can be understood that, in a home environment, a general mobile terminal (for example, a mobile phone) and the first playback device 10 are connected to the same WiFi, so that the mobile terminal (mobile phone) and the first playback device 10 can be in communication connection, and the communication protocol may be a wireless communication protocol such as DLNA, miracast, zigbee, airlay, MQTT, and the like.

The second playing device 20 and the mobile terminal are in a second communication network, and the second communication network includes a wireless communication mode and a wired connection mode. In one embodiment, the second playback device 20 may be communicatively coupled to the mobile terminal via long-range wireless communication. It is understood that the mobile terminal may send the first playing information to the second playing device 20 through long-distance wireless communication after receiving the first playing information, that is, the second playing device 20 also has a wireless long-distance communication module, for example, a 2G, 3G, 4G or 5G communication module, or other longer-distance wireless communication modules, for example, communication modules such as Lora and WiFi. It is understood that the second playing device 20 may be a remote playing device that is located a distance greater than a predetermined threshold from the mobile terminal, for example, the mobile terminal and the first playing device 10 are both at home, the second playing device 20 may be a vehicle-mounted playing device in an automobile that the user stops outside the home, and the second playing device 20 may also be a computer in an office that is located a distance away from the home or other playing devices located at a distance from the first playing device 10.

In another embodiment, the connection mode of the second playback device 20 and the mobile terminal is not limited to the wireless connection mode, and the second playback device 20 and the mobile terminal may be connected through a wired connection network, for example, the mobile terminal may interact with the second playback device 20 through HDMI and USB. In addition, the mobile terminal may interact with the second playing device 20 in an NFC manner, and after the user connects the mobile terminal with the second playing device 20 in an NFC manner, the second playing device 20 may receive the first playing information and continue to play the corresponding audiovisual content of the first playing device 10. In short, the second playing device 20 may be connected with the mobile terminal through a mobile communication service provider or other connection methods such as USB or other connection methods, which are not limited herein.

It should be noted that the second playing device 20 can be set and selected in the mobile terminal according to the needs of the user, and is not limited herein.

In some embodiments, the multimedia interaction method further comprises: receiving a playing stopping instruction actively input by a user through input equipment and sending the instruction to first playing equipment 10; or, detecting the user state within a preset range to automatically generate a play stop instruction. The first playing device 10 may receive an input that the user stops playing in an NFC manner, and meanwhile, the first playing device 10 may also send the first playing information to the mobile terminal such as the mobile phone in the NFC manner.

Specifically, the input device may refer to a touch screen in the first playing device or a remote controller for remotely controlling the first playing device, that is, the input through the input device may refer to input through the touch screen or input through the remote controller, the user actively inputting the stop instruction through the input device may refer to the user pressing a pause playing key through the remote controller or the touch screen to input a stop playing instruction, or may refer to the user pressing a standby key through the remote controller to input a stop playing instruction, or may refer to the user directly shutting down the first playing device 10 to obtain the stop playing instruction.

The multimedia interaction method detects a user state within a preset range through the first playing device 10 to automatically generate a play stop instruction, where the preset range may refer to a predetermined distance range from a screen of the first playing device 10, and may be, for example, a range equidistant from the screen of the first playing device 10 by 1m, 1.2m, 2m, 2.5m, 3m, 3.8m, 4m, 4.8m, 5m, and 6 m.

In one embodiment, the user status may refer to detecting whether the user is within a predetermined distance range of the first playback device 10, including whether the user is within the predetermined distance range of the first playback device 10 and whether the user is not within the predetermined distance range of the first playback device 10. When the user does not look at the first playback device 10 or the user is not within a predetermined range of the first playback device 10, the first playback device 10 may automatically generate a stop playback instruction. The detection mode here may be to detect whether the user is within a predetermined distance range in front of the screen of the first playback device 10 by detecting the infrared image of the user through infrared, or may be to set another detection mode such as a distance sensor, which is not limited herein. According to the multimedia interaction method, whether the user is in the preset range of the first playing device 10 or not is detected in real time, when the user is not in the first playing device 10, the first playing device 10 can directly, intelligently and automatically generate the playing stopping instruction, the technological sense is strong, and the user experience sense is favorably improved.

In another embodiment, the user status may refer to detecting whether the user is looking at the first playback device 10 through a camera, that is, collecting an image of the user through the camera to analyze the user's gaze, that is, the user status includes that the user is looking at the first playback device 10 or the user is not looking at the first playback device 10. According to the multimedia interaction method, the state of the user can be intelligently judged by detecting whether the sight of the user is watching the first playing device 10 or not in real time, so that the playing stopping instruction can be intelligently, quickly and automatically generated by the first playing device 10, and the user experience can be improved.

In detail, taking the preset range as the distance from the first playing device 5m as an example, when the first playing device 10 detects that the user state within the range of 5m is that the user is not within the range of 5m, the first playing device 10 automatically generates a playing stop instruction, or when the first playing device 10 detects that the user state within the range of 5m is that the user does not watch the first playing device 10, the first playing device 10 automatically generates a playing stop instruction.

In some embodiments, a multimedia interaction method comprises: receiving a playing stopping instruction sent by the mobile terminal through NFC to control the first playing device to stop playing the multimedia content and determine first playing information; the first playing information is uploaded to the mobile terminal through NFC, so that the mobile terminal sends the first playing information to the second playing device, and the second playing device continues to play the multimedia content of the first playing device according to the first playing information.

Specifically, according to the multimedia interaction method, the playing stopping instruction is directly sent to the first playing device 10 through the mobile terminal in an NFC manner, so that the short-distance, fast and efficient communication connection between the mobile terminal and the first playing device 10 can be realized.

In addition, according to the multimedia interaction method, the mobile terminal is directly used for sending the playing stop instruction to the first playing device 10 through the NFC, the first playing device 10 directly uploads the first playing information to the mobile terminal 30 through the NFC, other remote control devices or a user approaching the first playing device 10 does not need to be used for inputting the playing stop instruction through a touch screen, the method is fast in aspect, and the user experience feeling is improved.

The multimedia interaction method of the present application is described below from the mobile terminal side.

Referring to fig. 6, the present embodiment further provides a multimedia interaction method for a mobile terminal 30. The multimedia interaction method comprises the following steps:

s32: receiving first playing information uploaded by the first playing device 10, wherein the first playing information is determined playing information for stopping playing the multimedia content after the first playing device 20 receives the instruction for stopping playing;

s34: and sending the first playing information to the corresponding second playing device 20, so that the corresponding second playing device 20 continues to play the multimedia content of the first playing device 10.

Referring to fig. 7, the present application further provides a mobile terminal 30, where the mobile terminal 30 includes: a second receiving module 32 and a second transmitting module 34.

Step S32 may be implemented by the second receiving module 32, and step S34 may be implemented by the second transmitting module 34. That is to say, the second receiving module 32 is configured to receive first playing information uploaded by the first playing device 10, where the first playing information is playing information that is determined after the first playing device 10 receives the playing stop instruction and stops playing the multimedia content; the second transmitting module 34 is configured to send the first playing information to the corresponding second playing device 20, so that the corresponding second playing device 20 continues to play the multimedia content of the first playing device.

Specifically, the mobile terminal 30 is an Access Point (AP) of a plurality of placeshifting devices, and the mobile terminal 30 may include a mobile electronic device such as a mobile phone and a tablet computer. The first playback device 10 and the second playback device 20 and the first playback information have already been described in detail on the playback device side, and are not described here again.

According to the multimedia interaction method, the first playing information is uploaded to the second playing device 20 through the mobile terminal 30 by the first playing device 10, the second playing device 20 continues to play the multimedia content of the first playing device 10 according to the first playing information, the effect of continuously playing the multimedia content in different places can be achieved, and the user experience is increased.

Referring to fig. 8, in some embodiments, the multimedia interaction method includes:

s36: receiving second playing information uploaded by the second playing device 20, where the second playing information is determined playing information obtained by the second playing device 20 stopping playing the multimedia content after receiving the instruction to stop playing;

s38: and sending the second playing information to the corresponding first playing device 10, so that the corresponding first playing device 10 continues to play the multimedia content of the second playing device 20.

Referring to fig. 7, step S36 may be implemented by the second receiving module 32, and step S38 may be implemented by the second transmitting module 34. That is to say, the second receiving module 32 is configured to receive second playing information uploaded by the second playing device 20, where the second playing information is determined playing information obtained by the second playing device 20 stopping playing the multimedia content after receiving the instruction to stop playing; the second transmitting module 34 is configured to send the second playing information to the corresponding first playing device 10, so that the corresponding first playing device 10 continues to play the multimedia content of the second playing device 20.

In some embodiments, the first playback device 10 and the mobile terminal 30 are in a first communication network, and the second playback device 20 and the mobile terminal 30 are in a second communication network. Specifically, the first communication network includes one or more wireless communication protocols of DLNA, miracast, zigbee, airlay, MQTT. That is, the first playing device 10 is in communication connection with the mobile terminal 30 through one or more wireless communication protocols of DLNA, miracast, zigbee, airlay, and MQTT. The second communication network includes a wireless communication mode and a wired connection mode, that is, the second playing device 20 can be connected to the mobile terminal 30 through a long-distance wireless communication mode or a wired connection mode. For example, the mobile terminal may interact with the second playback device 20 in an NFC manner, and after the user connects the mobile terminal with the second playback device 20 in an NFC manner, the second playback device 20 may receive the first playback information and continue to play the corresponding audiovisual content of the first playback device 10. In addition, the second playing device 20 may be connected with the mobile terminal through a mobile communication service provider or other connection methods such as USB or other connection methods, which are not limited herein.

Referring to fig. 9, in some embodiments, before sending the first playing information to the corresponding second playing device 20, so that the corresponding second playing device 20 continues to play the multimedia content of the first playing device 20, the method further includes:

s31: detecting motion information of the mobile terminal 30;

s33: when the motion information of the mobile terminal 30 satisfies a first preset condition, first selection information is issued to enable the user to select a second playing device 20 for continuing to play the multimedia content according to the first selection information.

Referring to fig. 10, the first playing device 30 includes a first detecting module 31 and a first selecting module 33.

Step S31 may be implemented by the first detecting module 31, and step S33 may be implemented by the first selecting module 33. That is, the first detecting module 31 is configured to detect motion information of the mobile terminal; the first selection module 33 is configured to send out first selection information when the motion information of the mobile terminal 30 meets a first preset condition, so that the user selects the second playing device 20 for continuing to play the multimedia content according to the first selection information.

It should be noted that the arrows in fig. 9 do not indicate the order of execution of steps S31 and 33 and step 32, the order of steps S31 and 33 and step 32 is not limited herein, and step S31 and step 33 may be executed first and then step 32 is executed, step 32 may be executed first and then steps S31 and 33 are executed, or steps 32, S31 and 33 are executed at the same time.

Specifically, the motion information may include a moving speed and a moving direction, and the mobile terminal 30 may determine the moving speed and the moving direction of the mobile terminal 30 through the attitude sensor and the GPS module. That is, the first detection module 31 may include an attitude sensor and a GPS module.

The first preset condition may refer to that the moving direction of the mobile terminal 30 is toward the second playing device 20, and the moving speed of the mobile terminal 30 is a constant speed or a variable speed motion, at this time, if the mobile terminal 30 meets the first preset condition, the first selection module 33 of the mobile terminal 30 may send out the first selection information so that the user selects the second playing device 20 for continuing to play the multimedia content according to the first selection information. The first selection information may refer to that when a plurality of second playing devices which can be selected by the user to play are provided in the mobile terminal 30 according to the motion information of the mobile terminal 30, the user may select one or more playing devices from the plurality of second playing devices 20 to continue playing the multimedia content, so that the user may select one or more second playing devices 20 nearby to continue playing the multimedia content, which is more intelligent, or may flexibly select one or more second playing devices 20 to continue playing the multimedia content, and the flexibility selectable by the user is enhanced.

In detail, in a case that the first preset condition is that the mobile terminal 30 performs a uniform or variable speed motion in a direction toward the second playback device 20, for example, please refer to fig. 11, the first detection module 31 detects that the moving direction of the mobile terminal 30 is a direction a and the moving speed is 1m/s of uniform motion, and if one or more second playback devices 20 exist in the direction a (for example, the

second playback devices

201, 202, and 203 are included in fig. 11), it is determined that the mobile terminal 30 satisfies the first preset condition. Then, the first selection module 33 of the mobile terminal 30 may send out first selection information, the first selection information may be visual information presented on a display page of the mobile terminal 30 as shown in fig. 12, or the first selection information may also prompt the user to select through voice information, and the selection mode is convenient, fast and more intelligent. The user may select one or more second playing devices from the plurality of second playing devices 20 to continue playing the multimedia content, as shown in fig. 12, the user may only select the second playing device 201 to continue playing the multimedia content, or the user may simultaneously select the second playing device 201 and the second playing device 202 to continue playing the multimedia content, that is, the user may flexibly select the second playing device 20 to continue playing completely according to the user requirement, so as to improve the user experience.

In some embodiments, issuing the first selection information to enable the user to select the second playing device 20 for continuing to play the multimedia content according to the first selection information when the motion information of the mobile terminal 30 satisfies the first preset condition comprises: determining a movement trend of the mobile terminal 30 according to the moving speed and the moving direction of the mobile terminal 30; and when the movement trend is away from the preset range of the first playing device, sending out first selection information.

It can be understood that, after the mobile terminal 30 receives the first playing information, if the user holding the mobile terminal 30 does not take the emergency exit, the mobile terminal 30 may detect the motion trend of the mobile terminal in real time according to the moving speed and the moving direction of the user, for example, when the motion trend of the mobile terminal 30 is to leave the door of the home and enter the elevator, that is, the motion trend of the mobile terminal 30 is to move away from the preset range of the first playing device 10 (for example, the first playing device 10 is a television in the home), the mobile terminal 30 may start to detect the position information of the mobile terminal 30 and the second playing device 20 at this time, and send the first selection information. The user can flexibly select one or more second playing devices 20 to continue playing the multimedia content according to the first selection information.

Referring to fig. 13, in some embodiments, after issuing the first selection information to enable the user to select the second playing device 20 for continuing to play the multimedia content according to the first selection information when the motion information of the mobile terminal 30 satisfies the first preset condition, the method further includes:

s331: detecting position information of the mobile terminal 30 and position information of the second playback device 20 in response to an operation of the user selecting the second playback device 20;

s332: when the position information of the mobile terminal 30 and the position information of the second playing device 20 satisfy a second preset condition, second selection information is sent out so that the user can select whether to connect the second playing device 20 according to the second selection information and send the first playing information to the second playing device 20.

Referring to fig. 10, step S331 may be implemented by the first detecting module 331, and step S332 may be implemented by the first selecting module 33. That is, the first detecting module 331 may be further configured to detect the position information of the mobile terminal and the position information of the second playback device in response to an operation of selecting the second playback device by the user; the first selection module 33 may be further configured to send second selection information when the location information of the mobile terminal and the location information of the second playing device meet a second preset condition, so that the user selects whether to connect the second playing device according to the second selection information and sends the first playing information to the second playing device.

Specifically, when the user selects the second playback device 20, the first detection module 331 may detect the position information of the mobile terminal 30 and the second playback device 20 in real time, so as to determine whether the mobile terminal 30 (user) is in the vicinity of the second playback device in real time. The first selection module 33 of the mobile terminal 30 may present the second selection information to the user when the position information of the mobile terminal and the position information of the second playing device satisfy the second preset condition, and the user selects to connect the mobile terminal 30 and the second playing device 20 in a communication manner according to the second selection information, so as to send the first playing information to the second playing device 20.

Wherein the second preset condition may include: the distance between the mobile terminal 30 and the second playing device 20 is less than the distance threshold and the orientation is within the preset angle threshold range. That is to say, in the multimedia interaction method of the present application, when it is determined that the distance between the mobile terminal 30 and the second playing device 20 is smaller than the distance threshold and the position of the mobile terminal is within the preset angle threshold range of the second playing device 20, the mobile terminal 30 may be controlled to send the second selection information, so that it is ensured that a user holding the mobile terminal 30 can establish a connection between the determined second playing device 20 and the mobile terminal 30 before reaching the second playing device 20, the continuity of continuous playing from the first playing device 10 to the second playing device 20 can be enhanced, and the user experience is improved.

In some embodiments, sending the first playing information to the corresponding second playing device 20, so that the corresponding second playing device 20 continues to play the multimedia content of the first playing device 10 further includes: the mobile terminal 30 transmits the first play information to the second play device 20 in response to the user selecting the operations of connecting the second play device 20 and transmitting the first play information to the second play device 20, so that the second play device 20 continues to play the multimedia content of the first play device 10.

In some embodiments, sending the first playing information to the corresponding second playing device 20, so that the corresponding second playing device 20 continues to play the multimedia content of the first playing device 10 further includes: the mobile terminal 30 sends the first playing information to the corresponding second playing device 20 through NFC, so that the second playing device continues to play the multimedia content of the first playing device 10.

It should be noted that the roles of the first playback device 10 and the second playback device 20 can also be interchanged, so that the multimedia content being played by the second playback device 20 can also be sent to the first playback device 10 via the mobile terminal 30 for continuous playback.

It should be noted that the multimedia interaction method described with a focus on the playing device is also applicable to the mobile terminal in the embodiment of the present application, and the implementation principle is similar, and is not described herein again.

Referring to fig. 14, an electronic device 200 according to an embodiment of the present disclosure includes a processor 210, a memory 220 and a computer program 222 stored in the memory 220, wherein the program 222 is executed by the processor 210 to perform the steps of the multimedia interaction method.

In some embodiments, the electronic apparatus 200 may be a mobile phone, a tablet computer, a smart wearable device (smart watch, smart glasses, etc.), a virtual reality device or head display device, a television, or the like. In the present embodiment, the electronic device 200 is a mobile phone as an example. When the electronic apparatus 200 is used to execute the multimedia interaction method corresponding to the playback device, the electronic apparatus 200 may be the first playback device 10 or a part of the first playback device 10, or the electronic apparatus 200 may be a device connected to the first playback device 10, the electronic apparatus 200 may also be the second playback device 20 or a part of the second playback device 20, and the electronic apparatus 200 may also be a device connected to the second playback device 20. When the electronic apparatus 200 is used to execute the multimedia interaction method corresponding to the mobile terminal 30, the electronic apparatus 200 may be the mobile terminal 30 or a part of the mobile terminal 30, and the electronic apparatus 200 may also be a device connected to the mobile terminal 30.

Referring to fig. 15, the present application provides a non-transitory computer-readable storage medium 40 containing a computer program, which when executed by one or more processors 50, causes the processors 50 to perform the steps of the multimedia interaction method described above.

In some embodiments, the computer-readable storage medium 40 may be a storage medium built in the electronic device 200, such as a memory, or a storage medium that can be plugged into the electronic device 200 in a pluggable manner, such as an SD card.

According to the multimedia interaction method, the electronic device 200 and the storage medium 40, the first playing information is uploaded to the second playing device through the mobile terminal through the first playing device, and the second playing device continues to play the multimedia content of the first playing device according to the first playing information, so that the effect of continuously playing the multimedia content at different places can be achieved, and the user experience is increased.

The above examples only express several embodiments of the present application, and the description thereof is more specific and detailed, but not construed as limiting the scope of the present application. It should be noted that, for a person skilled in the art, several variations and modifications can be made without departing from the concept of the present application, which falls within the scope of protection of the present application. Therefore, the protection scope of the present patent shall be subject to the appended claims.

Claims

A multimedia interaction method for a first playback device, the method comprising:

receiving a playing stopping instruction to control the first playing device to stop playing the multimedia content and determine first playing information;

and uploading the first playing information to a mobile terminal so that the mobile terminal sends the first playing information to a second playing device, and the second playing device continues to play the multimedia content of the first playing device according to the first playing information.
The method of claim 1, further comprising:

receiving second playing information sent by the mobile terminal, wherein the second playing information is determined playing information for stopping playing the multimedia content after the second playing equipment receives the playing stopping instruction;

and continuing to play the multimedia content of the second playing device according to the second playing information.
The multimedia interaction method of claim 2, wherein the first playing information comprises: at least one of the playing content, the playing position and the playing application when the first playing device stops playing; the second playing information comprises: and at least one of the playing content, the playing position and the playing application when the second playing device stops playing.
A multimedia interaction method according to any of claims 1 to 3, characterized in that it comprises:

receiving the playing stopping instruction actively input by a user through input equipment and sending the playing stopping instruction to the first playing equipment; or the like, or, alternatively,

and detecting the user state within a preset range to automatically generate the playing stopping instruction.
The multimedia interaction method according to any one of claims 1 to 4, wherein the first playback device and the mobile terminal are in a first communication network, and the second playback device and the mobile terminal are in a second communication network.
The method of any one of claims 1 to 4, wherein the receiving a stop playing command to stop playing the multimedia content and determining the first playing information comprises:

receiving a play stopping instruction sent by the mobile terminal through NFC to control the first playing device to stop playing the multimedia content and determine the first playing information;

the uploading the first playing information to a mobile terminal so that the mobile terminal sends the first playing information to the second playing device, and the enabling the second playing device to continue playing the multimedia content of the first playing device according to the first playing information includes:

uploading the first playing information to the mobile terminal through NFC so that the mobile terminal sends the first playing information to the second playing device, and the second playing device continues to play the multimedia content of the first playing device according to the first playing information.
A multimedia interaction method for a mobile terminal, the method comprising:

receiving first playing information uploaded by first playing equipment, wherein the first playing information is playing information which is determined by the first playing equipment after the first playing equipment receives a playing stopping instruction and stops playing multimedia content;

and sending the first playing information to corresponding second playing equipment, so that the corresponding second playing equipment continues to play the multimedia content of the first playing equipment.
The method of claim 7, wherein the method comprises:

receiving second playing information uploaded by the second playing device, wherein the second playing information is determined playing information for stopping playing the multimedia content after the second playing device receives the playing stopping instruction;

and sending the second playing information to corresponding first playing equipment, so that the corresponding first playing equipment continues to play the multimedia content of the second playing equipment.
The multimedia interaction method according to claim 8, wherein the first playback device and the mobile terminal are in a first communication network, and the second playback device and the mobile terminal are in a second communication network.
The multimedia interaction method according to claim 7, wherein before the first playing information is sent to the corresponding second playing device, so that the corresponding second playing device continues to play the multimedia content of the first playing device, the method further comprises:

detecting motion information of the mobile terminal;

and when the motion information of the mobile terminal meets a first preset condition, sending first selection information to enable a user to select a second playing device for continuously playing the multimedia content according to the first selection information.
The multimedia interaction method as claimed in claim 10, wherein the motion information includes a moving speed and a moving direction, and the moving terminal determines the moving speed and the moving direction of the mobile terminal through an attitude sensor and a GPS module.
The multimedia interaction method of claim 11, wherein the issuing first selection information to enable the user to select a second playing device for continuing playing the multimedia content according to the first selection information when the motion information of the mobile terminal meets a first preset condition comprises:

determining the motion trend of the mobile terminal according to the moving speed and the moving direction of the mobile terminal;

and sending the first selection information when the motion trend is away from the preset range of the first playing device.
The multimedia interaction method according to claim 10, wherein after issuing the first selection information to enable the user to select the second playing device for continuing to play the multimedia content according to the first selection information when the motion information of the mobile terminal satisfies the first preset condition, the method further comprises:

responding to the operation of selecting the second playing device by the user, and detecting the position information of the mobile terminal and the position information of the second playing device;

and when the position information of the mobile terminal and the position information of the second playing device meet a second preset condition, sending second selection information to enable a user to select whether to connect the second playing device or not according to the second selection information and send the first playing information to the second playing device.
The multimedia interaction method according to claim 13, wherein when the location information of the mobile terminal and the location information of the second playback device satisfy a second preset condition, sending second selection information to enable a user to select whether to connect the second playback device according to the second selection information and send the first playback information to the second playback device comprises:

and sending the second selection information when the distance between the mobile terminal and the second playing device is determined to be smaller than a distance threshold and the direction is within an angle threshold range.
The multimedia interaction method according to claim 14, wherein the sending the first playing information to a corresponding second playing device so that the corresponding second playing device continues to play the multimedia content of the first playing device further comprises:

responding to the operation that a user selects to connect the second playing device and sends the first playing information to the second playing device, sending the first playing information to the second playing device, and enabling the second playing device to continue playing the multimedia content of the first playing device.
The multimedia interaction method according to claim 7, wherein the sending the first playing information to a corresponding second playing device so that the corresponding second playing device continues to play the multimedia content of the first playing device further comprises:

and the mobile terminal sends the first playing information to the corresponding second playing equipment through NFC, so that the second playing equipment continues to play the multimedia content of the first playing equipment.
A playback apparatus including a first playback apparatus and a second playback apparatus, characterized in that the first playback apparatus includes:

the first receiving module is used for receiving a playing stopping instruction to control the first playing equipment to stop playing the multimedia content and determine first playing information;

the first transmission module is used for transmitting the first playing information to a mobile terminal so that the mobile terminal can transmit the first playing information to a second playing device, and the second playing device can continue to play the multimedia content of the first playing device according to the first playing information.
A mobile terminal, comprising

The second receiving module is used for receiving first playing information uploaded by first playing equipment, and the first playing information is determined playing information for stopping playing the multimedia content after the first playing equipment receives a playing stopping instruction;

and the second transmission module is used for transmitting the first playing information to corresponding second playing equipment, so that the corresponding second playing equipment continues to play the multimedia content of the first playing equipment.
An electronic apparatus, characterized in that it comprises a processor and a memory, said memory storing a computer program which, when executed by said processor, implements the method of any of claims 1-6 or claims 7-16.
A non-transitory computer-readable storage medium containing a computer program, wherein the computer program is stored, which when executed by one or more processors causes the processors to perform the method of any one of claims 1-6 or claims 7-16.