Detailed Description
In the embodiment of the invention, when the user terminal, such as a mobile phone, shoots an image or a video, the image or the video is transmitted to the remote projection equipment for display through the internet of things platform, so that the image or the video can be shared by the remote user for watching, and the image or the video shot by the user terminal can be transmitted to each projection equipment in real time for display, so that the picture of the image or the video shot by the remote user can be synchronous with the picture of the image or the video watched by the user. When the user terminal transmits the image or the video, as long as the image or the video picture is shot locally, the user terminal is actively connected with the Internet of things platform to transmit the image or the video to the Internet of things platform in real time, and when the user terminal controls the Internet of things platform to receive the image or the video data, the user terminal is actively connected with the projection equipment to transmit the image or the video data to the projection equipment matched with the user terminal for projection display.
The present invention will be described in further detail with reference to the following detailed description and accompanying drawings.
The first embodiment is as follows:
in this embodiment, the user terminal is responsible for recording multimedia data, such as shooting images and videos, and transmitting the multimedia data to a preset broadcasting device for playing, wherein the user terminal is bound with the playing device in advance.
Referring to fig. 1, a method for synchronously playing recorded multimedia in different places may include the following steps:
101. the user terminal starts a real-time transmission mode for recording the multimedia.
It can be understood that, in the real-time transmission mode, when it is detected that new multimedia data is locally available at the user terminal, the new multimedia data is immediately transmitted to the playing device for playing.
102. The user terminal monitors whether new multimedia data is recorded or not.
The multimedia data may be video data and/or audio data.
103. And if the recording is monitored to obtain new multimedia data, transmitting the recorded new multimedia data to preset playing equipment in real time through a wireless network so that the playing equipment can play the multimedia data in real time after receiving the multimedia data.
The playing device includes but is not limited to: projection devices, televisions, tablet computers, and the like.
The new multimedia data of the embodiment is transmitted to the remote playing device through the wireless network for playing, so that the function of playing the multimedia data recorded by the user device in real time can still be realized when the user terminal is not in the same place with the playing device, and the function of remote real-time sharing is realized.
As shown in fig. 2, the step 102-103 may be implemented in the following manner:
s1: and checking whether a new photo is shot in a time period with the latest preset time length according to a preset time interval. If yes, go to step S2.
The preset time interval may be set manually, for example, every 5 seconds. For example, after the user terminal starts the multimedia recording real-time transmission mode, every 5 seconds, it is checked whether there is a new picture recently taken.
S2: and transmitting the shot new photo to the playing equipment through a wireless network in real time.
The last preset time period may also be manually set in advance, for example, within the last 1 second. If the photos shot within 1 second exist, for example, the photos are defaulted to be new photos, and the new photos are immediately transmitted to the playing device, so that the playing device plays the new photos in real time after obtaining the new photos.
As shown in fig. 3, the step 102-103 may be implemented in the following manner:
and S10, the user terminal monitors whether the audio and video recording function is started, and if so, the step S20 is executed.
The multimedia data of the present embodiment is audio data and/or video data.
And S20, establishing a streaming media data transmission channel with the playing device.
The multimedia data of the embodiment is transmitted through the streaming media channel.
And S30, editing the recorded audio and video data into audio and video data blocks in a streaming media format in real time, and transmitting the formed new audio and video data blocks to the playing equipment through a streaming media transmission channel in real time.
In one embodiment, the user terminal may monitor whether the audio recording function is turned on and whether the video function is turned on. When any one of the audio recording function and the video recording function is monitored to be started, a streaming media data transmission channel is established with the playing equipment, the recorded audio data and the recorded video data are respectively edited into an audio data block and a video data block in a streaming media format in real time, and the formed new audio data block and the formed new video data block are transmitted to the playing equipment through the streaming media transmission channel in real time.
It can be understood that if the audio recording function is not turned on or the video recording function is not turned on, the editing and transmission of the audio data block or the video data block are not performed accordingly. It should be further noted that, on the basis of the embodiment, omitting the monitoring whether the audio recording function is turned on or not or whether the video recording function is turned on, and accordingly omitting the editing or transmission of the audio data block or the video data block, both belong to the protection scope of the present invention.
In one embodiment, as shown in fig. 4, the method further comprises the following steps: 104. and the user terminal logs in the Internet of things platform by using the user account authenticated by the Internet of things platform.
In step 103, the step of transmitting the recorded new multimedia data to a preset playing device in real time includes: and transmitting the recorded new multimedia data to the playing equipment through the Internet of things platform in real time.
The embodiment can transmit the recorded new multimedia data to the playing equipment in real time through the Internet of things platform. Before transmission, a user account needs to be registered on an internet of things platform firstly by a user terminal, an equipment account needs to be registered on the internet of things platform by a playing device, the user account and the equipment account of the playing device are bound on the internet of things platform, when information needs to be sent and received in real time, the user terminal logs in the internet of things platform through the user account authenticated by the internet of things platform in advance, and the internet of things platform can forward multimedia data to the playing device corresponding to the user terminal according to the binding relationship between the user terminal and the playing device.
In one embodiment, after the user terminal is bound to the playback device, a control entry of the playback device is shown on a user interface of the user terminal, and the user interface of the playback device is accessed through the entry, where the control interface has a control for the user to start a long-lived photo/video real-time transmission mode. Referring to fig. 4, the method for synchronously playing the recorded multimedia in different places further includes the following steps:
105. and the user terminal displays a control interface of the playing equipment.
In which, as shown in fig. 5, an example of presenting a control interface of a playback device at a user terminal is illustrated. The control interface comprises a first object for starting the recording multimedia real-time transmission mode, and the first object has two states corresponding to the recording multimedia real-time transmission mode starting 1051 and the recording multimedia real-time transmission mode closing 1052.
When a user operation a for starting the recorded multimedia real-time transmission mode occurs, a step of the user terminal starting the recorded multimedia real-time transmission mode, that is, step 101, is performed.
The user operation converts the first object from a state corresponding to the recorded multimedia real time transmission mode off 1052 to a state corresponding to the recorded multimedia real time transmission mode on 1051.
Preferably, in this embodiment, after the user terminal logs in the internet of things platform by using the user account, the user interface has a control entry of the playing device, and when the control entry of the playing device is clicked, the control interface of the playing device can be displayed.
In one embodiment, the first object is used to turn on and off a permanent recorded multimedia real-time transmission mode. The on and off of the permanent recorded multimedia real-time transmission mode can be triggered by user operation.
After the permanent recorded multimedia real-time transmission mode is started, the user terminal starts a first process, and executes the steps 102-103 according to a preset time interval in a circulating manner, the user terminal monitors whether new multimedia data are recorded, and transmits the new recorded multimedia data to preset playing equipment in real time when the new recorded multimedia data are monitored, and the first process is closed until the permanent recorded multimedia real-time transmission mode is closed. Therefore, the multimedia data recorded by the user terminal can be continuously transmitted in real time before the permanent recorded multimedia real-time transmission mode is closed.
In one embodiment, as shown in fig. 6, the method further comprises the following steps:
105' the user terminal displays a multimedia recording interface, wherein the multimedia recording interface comprises a second object for starting a real-time transmission mode of recording multimedia. As shown in fig. 7, the second object has two states corresponding to a recorded multimedia real time transfer mode on 1051 'and a recorded multimedia real time transfer mode off 1052'.
When a user operation B for starting the recorded multimedia real-time transmission mode occurs, a step of the user terminal starting the recorded multimedia real-time transmission mode, i.e. step 101, is performed. The user operation converts the second object from a state corresponding to the recorded multimedia real time transmission mode off 1052 'to a state corresponding to the recorded multimedia real time transmission mode on 1051'.
In one embodiment, the second object is used to initiate a temporary recorded multimedia real-time transmission mode. The temporary starting of the real-time transmission mode of the recorded multimedia can be triggered by user operation. After the temporary recorded multimedia real-time transmission mode is started, the user terminal starts a second process, the steps 102 to 103 are executed according to the preset time interval in a circulating mode, the user terminal monitors whether new multimedia data are recorded, if the new multimedia data are recorded, the new multimedia data are transmitted to preset playing equipment in real time, and if the new multimedia data are not recorded, the second process is automatically closed. Therefore, after the transmission of the recently shot picture or the currently shot video and audio is finished, the multimedia data recorded next time is not transmitted any more. And the user terminal starts the temporary recording multimedia real-time transmission mode again until the user operates again.
For the temporary photo/video real-time transmission mode, the method can be started by the following steps: the user interface has a control that can be used to initiate a temporary photo/video real-time transfer mode. After the temporary photo/video real-time transmission mode is started, the currently shot photo/video is transmitted to the playing equipment in real time. The currently taken picture may refer to the most recently taken picture, e.g., a picture taken within 1 second. It should be further noted that the currently captured video refers to a video currently being captured. Preferably, if the temporary photo/video real-time transmission mode is started only when the video starts to be shot, the video after the temporary photo/video real-time transmission mode is started can be transmitted in real time, and the video frames which are shot before the current time are not transmitted.
Example two:
referring to fig. 8, a method for synchronously playing recorded multimedia in different places includes:
201. the playing device starts a multimedia real-time playing receiving mode.
After the playing device starts a multimedia real-time playing mode, the playing device receives multimedia data transmitted by the user terminal in real time and immediately plays the multimedia data after receiving the multimedia data.
202. The playing device monitors whether multimedia data recorded by the user terminal and transmitted by a preset user terminal is newly received, if so, step 203 is executed.
203. And the playing equipment plays multimedia in real time according to the newly received multimedia data.
In one embodiment, as shown in fig. 9, the playing device of this embodiment plays in real time when receiving the transmitted photo. The step 202-203 specifically comprises:
s100, the playing device monitors whether a photo transmitted by the playing device is newly received, and if so, the step S200 is executed.
And S200, playing the newly received photo.
In an embodiment, as shown in fig. 10, the multimedia data of this embodiment is transmitted through a streaming media channel, and the step 202 and the step 203 specifically include:
s100 ', the playing device monitors whether a request for establishing a streaming media data transmission channel sent by the user terminal is received, if so, step S200' is executed.
S200', a streaming media transmission channel is established with the user terminal.
And S300', receiving newly transmitted audio and video data blocks in real time through a streaming media transmission channel.
S400', multimedia playing is carried out in real time according to the newly received audio and video data blocks.
In one embodiment, as shown in fig. 11, the method may further include the steps of:
204. the playing device logs in the Internet of things platform through a device account number registered in the Internet of things platform in advance.
The multimedia data recorded by the user terminal is transferred to the playing device through the Internet of things platform.
The user account of the user terminal and the device account of the playing device have a binding relationship in the internet of things platform, so that the internet of things platform can forward messages between the playing device and the user terminal. The user account of the user terminal is used for logging in the Internet of things platform and is authenticated by the Internet of things platform.
Example three:
as shown in fig. 12, the present embodiment provides a user terminal including a memory 30, a processor 31, and a recording device 32, wherein:
the memory 30 is used to store application programs.
The processor 31 executes an application for: and starting a real-time multimedia recording transmission mode, monitoring whether the recording device 32 records new multimedia data, and if so, transmitting the recorded new multimedia data to preset playing equipment through a wireless network in real time so that the playing equipment plays the multimedia data in real time after receiving the new multimedia data.
In one embodiment, the processor 31 executes an application program specifically for: and starting a recording multimedia real-time transmission mode, checking whether a new photo is shot in a time period with the latest preset time length according to a preset time interval, and if the new photo is shot in the time period with the latest preset time length, transmitting the shot new photo to the playing equipment in real time through a wireless network.
In one embodiment, the processor 31 executes an application program specifically for: monitoring whether the audio and video recording function is started, when the audio and video recording function is started, establishing a streaming media data transmission channel with the playing equipment, editing the recorded audio and video data into audio and video data blocks in a streaming media format in real time, and transmitting the formed new audio and video data blocks to the playing equipment through the streaming media transmission channel in real time.
In one embodiment, the processor 31 executing the application program is further configured to: logging in the Internet of things platform by using a user account authenticated by the Internet of things platform; and transmitting the recorded new multimedia data to the playing equipment through the Internet of things platform in real time.
The user account and the equipment account of the playing equipment have a binding relationship in the internet of things platform, so that the internet of things platform can forward messages between the playing equipment and the user terminal. The device account of the playing device is an account which is registered in the internet of things platform in advance by the playing device and used for logging in the internet of things platform.
In one embodiment, the processor 31 executing the application program is further configured to: a control interface of the playing device is shown,
the control interface comprises a first object for starting a recording multimedia real-time transmission mode, and the first object has two states corresponding to the starting of the recording multimedia real-time transmission mode and the closing of the recording multimedia real-time transmission mode.
And when user operation for starting the recording multimedia real-time transmission mode occurs, executing the step of starting the recording multimedia real-time transmission mode.
And the user operation converts the first object from a state corresponding to the closing of the recorded multimedia real-time transmission mode to a state corresponding to the opening of the recorded multimedia real-time transmission mode.
In one embodiment, the processor 31 executing the application program is further configured to: and displaying the multimedia recording interface. The multimedia recording interface comprises a second object for starting a recording multimedia real-time transmission mode, and the second object has two states of starting the recording multimedia real-time transmission mode and closing the recording multimedia real-time transmission mode.
And when user operation for starting the recording multimedia real-time transmission mode occurs, executing the step of starting the recording multimedia real-time transmission mode.
And the user operation converts the state of the second object corresponding to the closing of the real-time transmission mode of the recorded multimedia into the state corresponding to the opening of the real-time transmission mode of the recorded multimedia.
Example four:
as shown in fig. 13, the present embodiment provides a playback apparatus including a memory 40, a processor 41, and a playback device 42.
The memory 40 is used to store application programs.
Processor 41 executes an application for: and starting a multimedia receiving real-time playing mode. And monitoring whether multimedia data recorded by the user terminal and transmitted by the preset user terminal through the wireless network is newly received. If the newly received multimedia data is detected, the playing device 42 is controlled to play the multimedia according to the newly received multimedia data.
In one embodiment, processor 41 is specifically configured to: whether a preset photo transmitted by the user terminal through the wireless network is newly received or not is monitored, and if yes, the playing device 42 is controlled to play the newly received photo.
In one embodiment, processor 41 is specifically configured to: monitoring whether a request for establishing a streaming media data transmission channel sent by a user terminal is received, if so, establishing the streaming media transmission channel with the user terminal, receiving a newly transmitted audio and video data block in real time through the streaming media transmission channel, and controlling a playing device 42 to play multimedia according to the newly received audio and video data block in real time.
In one embodiment, processor 41 is further configured to: and logging in the Internet of things platform by using the equipment account number registered in the Internet of things platform in advance.
The multimedia data recorded by the user terminal is transferred to the playing device through the Internet of things platform. The user account of the user terminal and the device account of the playing device have a binding relationship in the internet of things platform, so that the internet of things platform can forward messages between the playing device and the user terminal. And the user account of the user terminal is used for logging in the Internet of things platform and authenticating the Internet of things platform.
Example five:
as shown in fig. 14, the present embodiment provides an apparatus for synchronously playing recorded multimedia in different places, which includes:
a transmission mode starting module 50, configured to start a real-time transmission mode for recording multimedia.
And a recording monitoring module 51, configured to monitor whether new multimedia data is recorded.
The transmission module 52 is configured to, when the recording monitoring module 51 monitors that new multimedia data is obtained by recording, transmit the new recorded multimedia data to a preset playing device through a wireless network in real time, so that the playing device performs real-time playing after receiving the multimedia data.
In one embodiment, the recording monitoring module 51 is specifically configured to: and checking whether a new photo is shot in a time period with the latest preset time length according to a preset time interval.
The transmission module 52 is specifically configured to: and when the fact that a new photo is shot in the time period with the latest preset time length is detected, the shot new photo is transmitted to the playing equipment in real time through a wireless network.
In one embodiment, the recording monitoring module 51 is specifically configured to: and monitoring whether the audio and video recording function is started or not.
The transmission module 52 is specifically configured to: when the audio and video recording function is checked to be started, a streaming media data transmission channel is established with the playing device, the recorded audio and video data is edited into audio and video data blocks in a streaming media format in real time, and the formed new audio and video data blocks are transmitted to the playing device through the streaming media transmission channel in real time.
In one embodiment, as shown in fig. 15, the apparatus for recording multimedia placeshifting synchronization further includes: and the login module 53 is configured to log in the internet of things platform through the user account authenticated by the internet of things platform.
The transmission module 52 is specifically configured to: and transmitting the recorded new multimedia data to the playing equipment through the Internet of things platform in real time.
The user account and the equipment account of the playing equipment have a binding relationship in the internet of things platform, so that the internet of things platform can forward messages between the playing equipment and the user terminal.
The device account of the playing device is an account which is registered in the internet of things platform in advance by the playing device and used for logging in the internet of things platform.
Referring to fig. 15, in an embodiment, the apparatus for synchronously playing the recorded multimedia at different places further includes:
and a control interface display module 54, configured to display a control interface of the playing device, where the control interface includes a first object for starting the recorded multimedia real-time transmission mode, and the first object has two states, namely starting the recorded multimedia real-time transmission mode and closing the recorded multimedia real-time transmission mode.
It is understood that the step of the user terminal turning on the recorded multimedia real-time transmission mode is performed when a user operation for turning on the recorded multimedia real-time transmission mode occurs, the user operation switching the first object from a state corresponding to the recorded multimedia real-time transmission mode being turned off to a state corresponding to the recorded multimedia real-time transmission mode being turned on.
In an embodiment, referring to fig. 16, the apparatus for recording multimedia and playing multimedia synchronously in different places further includes:
the recording interface display module 55 is configured to display a multimedia recording interface, where the multimedia recording interface includes a second object for starting a recording multimedia real-time transmission mode, and the second object has two states corresponding to starting the recording multimedia real-time transmission mode and stopping the recording multimedia real-time transmission mode;
it is understood that, when a user operation for turning on the recorded multimedia real-time transmission mode occurs, the step of turning on the recorded multimedia real-time transmission mode by the user terminal is performed, and the user operation converts the state of the second object corresponding to the turning off of the recorded multimedia real-time transmission mode into the state corresponding to the turning on of the recorded multimedia real-time transmission mode.
Example six:
as shown in fig. 17, the present embodiment provides an apparatus for synchronously playing recorded multimedia in different places, which includes:
a playing mode starting module 60, configured to start a multimedia real-time playing mode.
And the transmission monitoring module 61 is configured to monitor whether multimedia data recorded by a user terminal, which is transmitted by a preset user terminal through a wireless network, is newly received.
And the playing module 62 is configured to play the multimedia according to the newly received multimedia data in real time when the transmission monitoring module 61 monitors that the multimedia data is newly received.
In an embodiment, the transmission monitoring module 61 is specifically configured to monitor whether a preset photo sent by the user terminal through the wireless network is newly received. The playing module 62 is specifically configured to: and when the transmission monitoring module 61 monitors that the photo transmitted by the preset user terminal is newly received, playing the newly received photo.
In an embodiment, the transmission monitoring module 61 is specifically configured to monitor whether a request for establishing a streaming media data transmission channel sent by a user terminal is received. The playing module 62 is specifically configured to: when the transmission monitoring module 61 monitors a request for establishing a streaming media data transmission channel sent by a user terminal, it establishes the streaming media transmission channel with the user terminal, receives a newly transmitted audio/video data block in real time through the streaming media transmission channel, and plays multimedia according to the newly received audio/video data block in real time.
In one embodiment, as shown in fig. 18, the apparatus for recording multimedia placeshifting synchronization further includes: and a login module 63, configured to log in the internet of things platform with an equipment account registered in the internet of things platform in advance.
The multimedia data recorded by the user terminal is transferred to the playing device through the Internet of things platform. The user account of the user terminal and the device account of the playing device have a binding relationship in the internet of things platform, so that the internet of things platform can forward messages between the playing device and the user terminal. The user account of the user terminal is used for logging in the Internet of things platform and is authenticated by the Internet of things platform.
Those skilled in the art will appreciate that all or part of the steps of the various methods in the above embodiments may be implemented by instructions associated with hardware via a program, which may be stored in a computer-readable storage medium, and the storage medium may include: read-only memory, random access memory, magnetic or optical disk, and the like.
The present invention has been described in terms of specific examples, which are provided to aid understanding of the invention and are not intended to be limiting. For a person skilled in the art to which the invention pertains, several simple deductions, modifications or substitutions may be made according to the idea of the invention.