WO2016197859A1 - Procédé et dispositif de diffusion synchrone de données multimédia - Google Patents

Procédé et dispositif de diffusion synchrone de données multimédia Download PDF

Info

Publication number
WO2016197859A1
WO2016197859A1 PCT/CN2016/084596 CN2016084596W WO2016197859A1 WO 2016197859 A1 WO2016197859 A1 WO 2016197859A1 CN 2016084596 W CN2016084596 W CN 2016084596W WO 2016197859 A1 WO2016197859 A1 WO 2016197859A1
Authority
WO
WIPO (PCT)
Prior art keywords
play
multimedia data
terminal
receiver
session
Prior art date
Application number
PCT/CN2016/084596
Other languages
English (en)
Chinese (zh)
Inventor
於聪
陶媛
严飞军
裘钰钢
金琼瑶
黄种堃
Original Assignee
阿里巴巴集团控股有限公司
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 阿里巴巴集团控股有限公司 filed Critical 阿里巴巴集团控股有限公司
Publication of WO2016197859A1 publication Critical patent/WO2016197859A1/fr

Links

Images

Classifications

    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
    • H04N21/4302—Content synchronisation processes, e.g. decoder synchronisation
    • H04N21/4307—Synchronising the rendering of multiple content streams or additional data on devices, e.g. synchronisation of audio on a mobile phone with the video output on the TV screen
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L65/00—Network arrangements, protocols or services for supporting real-time applications in data packet communication
    • H04L65/40—Support for services or applications
    • H04L65/401—Support for services or applications wherein the services involve a main real-time session and one or more additional parallel real-time or time sensitive sessions, e.g. white board sharing or spawning of a subconference
    • H04L65/4015—Support for services or applications wherein the services involve a main real-time session and one or more additional parallel real-time or time sensitive sessions, e.g. white board sharing or spawning of a subconference where at least one of the additional parallel sessions is real time or time sensitive, e.g. white board sharing, collaboration or spawning of a subconference
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L65/00—Network arrangements, protocols or services for supporting real-time applications in data packet communication
    • H04L65/40—Support for services or applications
    • H04L65/403—Arrangements for multi-party communication, e.g. for conferences

Definitions

  • the present application relates to the field of computer technologies, and in particular, to a method and an apparatus for synchronously playing multimedia data.
  • the user uses the mobile terminal, in addition to the short message communication and the telephone communication through the telecommunication carrier network, the user can also use the communication application (Application, APP) installed in the mobile terminal to communicate through the Internet, thereby Communication is more and more convenient.
  • APP Application, APP
  • a user can use a communication application to establish a separate session with other users (the separate session consists of instant messaging messages exchanged between two users), a group session (described A group session consists of instant messaging messages exchanged between multiple users in a user group.
  • the separate session consists of instant messaging messages exchanged between two users
  • a group session consists of instant messaging messages exchanged between multiple users in a user group.
  • the user shares the multimedia data (such as video data and audio data) by using the above communication method
  • other users participating in the session can only browse the content of the multimedia data in the terminal used by the user, because the user browses each time.
  • the time is not uniform. If some users want to discuss and exchange a certain piece of content of the multimedia data, they can only wait for other users to browse the content, or let other users browse the content through progress adjustment. Obviously, when sharing multimedia data in such a way, the convenience of interaction is poor.
  • the embodiment of the present invention provides a method and an apparatus for synchronously playing multimedia data, which are used to solve the problem that the communication method in the prior art is inconvenient in interaction when performing multimedia data sharing.
  • the initiator terminal acquires a resource identifier of the multimedia data
  • the initiator terminal After acquiring the multimedia data according to the resource identifier, the initiator terminal sends a synchronization play notification to the receiver terminals, so that all terminals participating in the session play the multimedia data synchronously.
  • the receiver terminal receives the resource identifier of the multimedia data sent by the initiator terminal;
  • the multimedia data is played according to the synchronous play notification.
  • a method for synchronously playing multimedia data including:
  • the server receives the resource identifier sent by the initiator terminal;
  • An embodiment of the present application provides an apparatus for synchronously playing multimedia data, including:
  • An obtaining module configured to acquire a resource identifier of the multimedia data
  • a sending module configured to send the resource identifier to all receiver terminals in the same session
  • the synchronization notification module is configured to send a synchronization play notification to each of the receiver terminals after the multimedia data is acquired according to the resource identifier, so that all the terminals participating in the session play the multimedia data synchronously.
  • An embodiment of the present application further provides an apparatus for synchronously playing multimedia data, including:
  • a receiving module configured to receive, by the receiving terminal, a resource identifier of the multimedia data sent by the initiator terminal;
  • An acquiring module configured to acquire, according to the resource identifier, the multimedia data to be played
  • a notification receiving module configured to receive a synchronization play notification sent by the initiator terminal
  • a synchronous play module configured to play the multimedia data according to the synchronous play notification.
  • the embodiment of the present application further provides an apparatus for synchronously playing multimedia data, including:
  • a receiving module configured to receive, by a server, a resource identifier sent by the initiator terminal
  • a distribution module configured to distribute the resource identifier to all receiver terminals in the same session
  • the synchronization notification module is configured to receive the synchronization play notification sent by the initiator terminal, and distribute the notification to all the receiver terminals, so that all the terminals participating in the session play the multimedia data synchronously.
  • An embodiment of the present invention provides a method and an apparatus for synchronously playing multimedia data.
  • an initiator terminal in the same session sends the resource identifier corresponding to the acquired multimedia data to other terminals in the session.
  • the initiator terminal further sends a synchronization play notification to each receiver terminal to notify all terminals to play the multimedia data at the same time. Therefore, all the terminals in the session realize synchronous play for the multimedia data, which changes the defect that the terminals participating in the session can only play the multimedia data by itself, which not only effectively improves the multimedia data.
  • the synchronism of playback also enhances the interactivity when sharing multimedia data, making the interaction when sharing multimedia data more convenient.
  • FIG. 1 is a flowchart of synchronously playing multimedia data according to an embodiment of the present application
  • FIG. 2 is a schematic diagram of an interface in a terminal in an actual application scenario according to an embodiment of the present disclosure
  • FIG. 3 is a schematic diagram of a play control after entering a full screen mode in an actual application scenario according to an embodiment of the present disclosure
  • FIG. 5 is a flowchart of synchronously playing multimedia data in a server according to an embodiment of the present application
  • FIG. 6 is a schematic structural diagram of an apparatus for synchronously playing multimedia data in an initiator terminal according to an embodiment of the present disclosure
  • FIG. 7 is a schematic structural diagram of an apparatus for synchronously playing multimedia data in a receiver terminal according to an embodiment of the present disclosure
  • FIG. 8 is a schematic structural diagram of an apparatus for synchronously playing multimedia data in a server according to an embodiment of the present disclosure.
  • FIG. 1 is a process of synchronously playing multimedia data according to an embodiment of the present disclosure, which specifically includes the following steps:
  • the initiator terminal acquires a resource identifier of the multimedia data.
  • the terminal described in the embodiment of the present application includes but is not limited to: a mobile phone, a tablet computer, a smart watch, etc.
  • Mobile terminal A session can be established between different terminals, such as a separate session or a group session. Users who use different terminals can send instant messaging messages to each other through the session. Obviously, the establishment of a session requires at least two different terminals, that is, the number of terminals participating in the session is at least two.
  • the implementation of the session may be based on providing a corresponding session service in an operating system of the terminal, or providing a session service based on an application having a session function installed in the terminal. This does not constitute a limitation on the present application.
  • the terminal used by the user will acquire the resource identifier of the corresponding multimedia data, and The resource identifier is distributed to other terminals in the session for subsequent simultaneous playback.
  • the resource identifier may be a Uniform Resource Locator (URL).
  • URL Uniform Resource Locator
  • the resource identifier reflects the storage location of the multimedia data. Through the resource identifier, each terminal can obtain the substantial content of the multimedia data.
  • the initiator terminal After acquiring the multimedia data to be played according to the resource identifier, the initiator terminal sends a synchronization play notification to each receiver terminal, so that all terminals participating in the session synchronize the multimedia data. Play.
  • different receiver terminals may have a certain time difference when acquiring multimedia data. If the receiver terminal starts to play immediately after acquiring the multimedia data, it will cause different receiver terminals to play. There is a certain time difference in the progress of the content, so that synchronous playback cannot be achieved. Therefore, for the foregoing step S103, after acquiring the multimedia data according to the resource identifier, the initiator terminal sends a synchronization play notification to the receiver terminal, specifically, the initiator terminal receives the receiver. After the resource acquisition notification fed back by the terminal, the synchronization play notification is sent to the receiver terminal.
  • the resource acquisition notification indicates that the receiver terminal has successfully acquired the multimedia data corresponding to the resource identifier.
  • the receiver terminals in the session are not required to participate in the synchronous play, and as long as one receiver terminal participates, synchronous play with the initiator terminal can be performed. . That is to say, only when the at least one receiving terminal acquires the corresponding multimedia data according to the resource identifier, it will play synchronously with the initiator terminal (when the receiving party acquires the multimedia data, then the initiator terminal is waiting) status). Therefore, in the above content, the receiver terminal that feeds back the resource acquisition notification is the receiver terminal (the number is at least one) that acquires the multimedia data.
  • an extension is required.
  • the receiver terminal participating in the synchronous play is not all the receiver terminals, then in the subsequent process, the other is not involved.
  • the receiving terminal that plays synchronously can also join the synchronous playing at any time. At this time, the newly added receiving terminal will play synchronously according to the current playing progress.
  • Each receiving terminal in the embodiment of the present application obtains the multimedia data according to the received resource identifier, and only after receiving the synchronous play notification sent by the initiator terminal, The notification is played synchronously, and the multimedia data is played synchronously.
  • the receiver terminal receives the resource identifier of the multimedia data
  • the user wants to view and browse the multimedia content corresponding to the resource identifier
  • only the terminal in the terminal can be used.
  • the player either accesses the corresponding page according to the resource identifier and performs separate viewing. That is to say, for each terminal in the session, the progress and playing state of other terminals in the session are not known, that is, the interaction is low.
  • the initiator terminal initiates synchronous play to other terminals in the session, so that all terminals in the session simultaneously play the content in the multimedia data.
  • the initiator terminal in the same session sends the resource identifier corresponding to the acquired multimedia data to other terminals in the session, and the initiator terminal also sends synchronous play to each receiver terminal. Notification to notify all terminals to play the multimedia data at the same time. Therefore, all the terminals in the session realize synchronous play for the multimedia data, which changes the defect that the terminals participating in the session can only play the multimedia data by itself, which not only effectively improves the multimedia data.
  • the synchronism of playback also enhances the interactivity when sharing multimedia data, making the interaction when sharing multimedia data more convenient.
  • the playing state may be changed during the synchronous play of the multimedia data, and the instant messaging during the playing process may also be implemented.
  • the initiator terminal or the receiver terminal may use the play control to play the multimedia data when the multimedia data is played, wherein the play control may load the current session displayed by the terminal.
  • the play control may load the current session displayed by the terminal.
  • the upper part of the current session interface of the initiator terminal loads the play control, and the corresponding multimedia data is played in the play control (in FIG. 2, the current play control is in a pause state), of course.
  • the play control is operable.
  • the initiator terminal can perform a control operation in the play control, such as: click pause, then, in the play control of other receiver terminals, the multimedia data is also paused.
  • a control operation in the play control such as: click pause
  • the multimedia data is also paused.
  • the initiator terminal receives the corresponding control operation, the playback state during the synchronous playback has changed.
  • the method further includes: the initiator terminal receiving a play control operation for the play control, according to the play control operation, Adjusting a play status of the multimedia data, generating adjustment information according to the adjusted play status, and distributing the adjustment information to each receiver terminal in the same session, so that each receiver terminal adjusts synchronously according to the adjustment information The playback status of the respective multimedia data.
  • the play control operation includes at least one of a play operation, a pause operation, a play progress operation, and a stop operation.
  • the play control operation includes a play progress operation
  • adjusting a play status of the multimedia data according to the play control operation specifically: adjusting playback of the multimedia data according to the play progress operation schedule.
  • the adjustment information is generated according to the adjusted playing state, specifically: determining a playing time corresponding to the adjusted playing progress, and generating the progress adjusting information according to the playing time.
  • the initiator terminal has the right to control and adjust the play of the multimedia data
  • other receiver terminals in the same session only perform corresponding control adjustment according to the control information sent by the initiator terminal.
  • the method can avoid the chaos phenomenon that the different terminals can control and adjust the playing of the multimedia data in the session.
  • playback jams may occur.
  • the initiator terminal if the initiator terminal appears to be stuck in the process of playing multimedia data, and the playback of the other recipient terminals is normal, the playback progress of the initiator terminal is compared with other receiver terminals. The playback progress is inconsistent, and there is no guarantee that the playback will be synchronized.
  • the initiator terminal implements a session connection with other recipient terminals through the server.
  • the initiator terminal sends a synchronization play notification to the receiver terminals, specifically: the initiator terminal sends a synchronization play notification to the receiver terminals through a server, and synchronizes the broadcast notification.
  • a synchronization play notification to the receiver terminals, specifically: the initiator terminal sends a synchronization play notification to the receiver terminals through a server, and synchronizes the broadcast notification.
  • the method S101 to S103 described in FIG. 1 further includes: the initiator terminal monitors the playback. When it is stuck, Sending a card correction request to the server, so that the server sends the multimedia data corresponding to the current play time to the initiator terminal according to the card correction request, where the initiator terminal loads the current play time. Multimedia data is played.
  • the terminal in which the card is present can obtain the normal playback progress (the progress of the unstacking) to the server, so that the terminal will load the normal playback progress and eliminate the influence of the jam.
  • All terminals in the same session can perform real-time communication in real time, such as voice message communication and text message communication, even in the process of playing multimedia data.
  • the lower half of the interface in FIG. 2 is an instant messaging message display area, which provides instant messaging for users using different terminals.
  • the method S101-S103 as described in FIG. 1 further includes: when the initiator terminal receives the voice message input during the playing process, the current playing terminal is closed. The audio of the multimedia data is recorded, and the input voice message is recorded, the voice message is sent to each receiver terminal in the same session, and the audio of the currently played multimedia data is re-opened.
  • the above process is a process in which the originating terminal initiates a voice message.
  • the multimedia data contains corresponding audio data, that is, in the process of playing the multimedia data, the corresponding sound is played, then, in this case, when the voice is directly recorded, The sound of the multimedia data is simultaneously recorded, which affects the clarity of the voice message. Therefore, in this scenario, when the voice message is input, the initiator terminal turns off the audio (mute) of the multimedia data, and this can ensure the clarity of the voice message entered.
  • the initiator terminal When the initiator terminal sends the voice message, it indicates that the current input process has ended, so the initiator terminal resumes the playing of the audio, so that the user can hear the sound of the multimedia data again.
  • the process in which the originating terminal receives voice messages of other recipient terminals receives voice messages of other recipient terminals.
  • the method S101 to S103 as described in FIG. 1 further includes: the initiator terminal receiving the voice message sent by the receiver terminal, and the multimedia device currently being played.
  • the volume of the audio of the data is reduced to a preset volume threshold, and the received voice message is played, and when the voice message is played, the volume of the audio of the currently played multimedia data is restored.
  • the visible play control is only displayed on the upper part of the current interface, and the lower part of the interface is used to display instant messaging messages. And if the playback controls are displayed in full screen, then, in order to ensure the The instant messaging can be performed normally. Therefore, in the embodiment of the present application, the method S101 to S103 as described in FIG. 1 further includes: when the playback control enters the full-screen playback mode, in the current playback interface. Setting a session display area, the initiator terminal displays the instant messaging message sent by itself and the received instant messaging message sent by each receiver terminal according to the chronological order of each instant message In the session display area.
  • the play control enters the full-screen play mode.
  • a session display area is displayed, and in the session display area, according to the time sequence of each instant message, the next The top display of each instant messaging message, that is, the latest instant messaging message is displayed at the bottom of the session display area, and with the appearance of other latest messages, the instant messaging message will gradually move up and eventually move out of the session display area.
  • the session display area may be displayed in a floating layer, a floating control, or the like, and in order to ensure the user's viewing experience, the session display and the instant messaging message displayed therein are set to be translucent. Or other transparency.
  • the embodiment of the present application further provides a method for synchronously playing multimedia data, where the method includes:
  • the receiver terminal receives the resource identifier of the multimedia data sent by the initiator terminal.
  • all the receiver terminals in the same session acquire the corresponding multimedia data according to the resource identifier of the multimedia data sent by the initiator terminal, and participate in the session according to the synchronization play notification sent by the initiator terminal.
  • All the terminals in the middle play synchronous playback of the multimedia data. It not only effectively improves the synchronization for multimedia data playback, but also enhances the interactivity when sharing multimedia data, making the interaction when sharing multimedia data more convenient.
  • the method S401 to S404 shown in FIG. 4 further includes: after the receiver terminal acquires the multimedia data to be played according to the resource identifier, and returns a resource acquisition notification to the initiator terminal;
  • the resource acquisition notification indicates that the receiver terminal has successfully acquired the multimedia data corresponding to the resource identifier.
  • each receiving terminal may feed back a resource acquisition notification to the initiator terminal, so that the initiator terminal can learn the acquisition status of different receiver terminals, thereby performing the same Step play.
  • the method further includes The receiving terminal receives the adjustment information sent by the initiator terminal, and synchronously adjusts the playing state of the respective multimedia data according to the adjustment information, where the adjustment information is used to play, pause, and Adjust at least one of the playback progress and the stop playback state.
  • the receiving terminal receives the synchronization playing notification sent by the initiator terminal by using the server, and the method further includes: when the receiving terminal monitors the playing card, to the The server sends a card correction request, so that the server sends the multimedia data corresponding to the current play time to the receiver terminal according to the card correction request, and the receiver terminal loads the multimedia data corresponding to the current play time. Play.
  • the method further includes: when the receiving terminal receives the voice input operation during the playing, turning off the audio of the currently played multimedia data, and recording the input voice message, The voice message is sent to other terminals in the same session, and the audio of the currently played multimedia data is re-opened.
  • the method further includes: the receiving terminal receiving the voice message sent by the other terminal, and reducing the volume of the audio of the currently played multimedia data to a preset volume threshold. And playing the received voice message, and when the voice message is played, resuming the volume of the audio of the currently played multimedia data.
  • the receiving terminal loads the playback control to play the multimedia data in the currently displayed session interface, and the method further includes: when the playback control enters full-screen playback In the mode, the session display area is set in the current play interface, and the receiving terminal sends the instant messaging message sent by itself and the received instant messaging message sent by the initiator terminal according to the time sequence of each instant message. In order, the instant messaging message is displayed in the session display area.
  • a method for synchronously playing multimedia data the method specifically includes:
  • the server receives the resource identifier sent by the initiator terminal.
  • the server participates in the process of implementing synchronous play in the session.
  • the methods S501 to S503 as described in FIG. 5 further include: the server monitoring the occurrence of a jam in each terminal during the synchronous playback.
  • the server monitors the occurrence of the card in the synchronous play process, specifically: the server records the initial play progress of each terminal for synchronous play, and the system time corresponding to the start play progress, and sends the system time to the terminal.
  • the process queries the request and receives the feedback of each terminal. In the case that the adjustment information corresponding to the playback progress operation is not received, the time difference between the current playback progress and the initial playback progress according to the feedback, and the system corresponding to the current time The time difference between the time and the system time corresponding to the initial playback progress is monitored for the stuck.
  • the synchronously played multimedia data (such as video) does not necessarily start from the first frame of data.
  • the playback control may have the function of “skip the title”, thus The initial playback progress of the multimedia data is no longer from the first frame data, so for the server, it is necessary to record the initial playback progress during the synchronous playback.
  • the server In order to time the playback progress, the server also records the system time corresponding to the initial playback progress.
  • the server periodically sends a progress query request to all terminals participating in the session to query the playback progress in each terminal.
  • a certain video is played synchronously, assuming that the initial playback progress of the video recorded by the server is “00:30” (that is, the video starts playing from the 30th second), Also, the system time at the start of playback is "12:00:00".
  • the server sends a progress query request to each terminal every 20 seconds.
  • the server receives the playback progress of a certain terminal feedback at "12:00:20", the current playback progress is "00:48", then, for the terminal, between the current playback progress and the initial playback progress
  • the time difference is 18 seconds.
  • the time difference between the system time corresponding to the current playback progress and the system time corresponding to the initial playback progress is 20 seconds, which indicates that the playback progress of the terminal is stuck for 2 seconds, so that the server can determine The terminal is stuck.
  • the method further includes: after detecting that the terminal has a jam, the server feeds back the synchronized play progress of the current time to the terminal that appears to be stuck according to the recorded synchronized play progress, so that the terminal that appears to be stuck loads the synchronization at the current time. Play progress.
  • the server actively monitors whether each terminal has a jam
  • the terminal itself monitors the occurrence of the stuck, and sends the server to the server after the occurrence of the jam.
  • the card correction request at this time, the server receives the card correction request sent by the terminal, and feeds back the synchronized play progress of the current time to the terminal according to the recorded synchronized play progress, so that the terminal loads the synchronization at the current time. Play progress.
  • the above content is the adjustment of the card to the card in the case that the adjustment information corresponding to the playback progress operation is not received, and if the initiator terminal adjusts the play status of the video, the server receives the adjustment sent by the initiator terminal. And updating the synchronized play progress of the record according to the adjustment information.
  • the adjustment information is used to adjust at least one of playing state, pause, play progress, and stop of the multimedia data.
  • the server obtains the current playback progress of the initiator terminal, and feeds the obtained playback progress to the receiver terminal that sends the card correction request. That is, the playback progress of all terminals is consistent with the initiator terminal.
  • the specific process and manner of realizing synchronous playback of multimedia data between the initiator terminal, the receiver terminal, and the server are respectively described in the embodiments of the present application.
  • the initiator terminal and the receiver terminal may be in the same local area network environment (and the multimedia data is stored locally on the initiator terminal).
  • the process of synchronously playing the multimedia data may be performed. It does not depend on the server, but the initiator terminal and the receiver terminal, and realizes synchronous playback under the transmission of the network device (such as a wireless router).
  • the initiator terminal sends a notification message to each receiver terminal through the local area network to notify each receiver terminal to acquire the multimedia data locally stored by the initiator terminal, and obtain the multimedia data at the receiver terminal.
  • the synchronous play notification is sent to the receiver terminal, so that all the terminals participating in the session play the multimedia data synchronously.
  • the initiator terminal controls the synchronous play (including: start synchronous play, pause during synchronous play, play, progress adjustment, etc.), and the initiator terminal still sends the corresponding receiver to the corresponding receiver in the manner of adjusting information.
  • the terminal causes the receiver terminal to synchronously control the synchronous play according to the adjustment information.
  • the initiator terminal loads an operable play control in the currently displayed session interface to play the multimedia data, and when the initiator terminal receives a play control operation for the play control, Adjusting a play status of the multimedia data according to the play control operation, generating adjustment information according to the adjusted play status, and distributing the adjustment information to each receiver terminal in the same session through a local area network, so that each The receiving terminal synchronously adjusts the playing state of the respective multimedia data according to the adjustment information.
  • the play control operation includes at least one of a play operation, a pause operation, a play progress operation, and a stop operation.
  • both the initiator terminal and the receiver terminal can transmit the voice message and the instant message, and the specific process is similar to the above content, and details are not described herein again.
  • the sender terminal performs cardon monitoring and repair. specifically:
  • the initiator terminal For the monitoring of the card, the initiator terminal records the initial playing progress of the synchronous play, and the system time corresponding to the initial playing progress, sends a progress query request to the receiving terminal, and receives the receiving terminal Feedback, in the case that the playback progress operation is not received, according to the time difference between the current playback progress of the feedback and the initial playback progress, and the system time corresponding to the current playback progress and the system time corresponding to the initial playback progress The time difference is monitored for Caton.
  • the initiator terminal feeds back the synchronized playing progress of the current moment through the local area network to the receiving terminal of the occurrence of the Caton according to the recorded synchronized playing progress. So that the receiving terminal of the stuck one loads the synchronized playing progress of the current moment.
  • the originating terminal obtains the synchronized playing progress of the receiving terminal at the current moment from the receiving party through the local area network, and loads the synchronized playing progress of the current moment.
  • the embodiment of the present application provides a device for synchronously playing multimedia data, which is set in the initiator terminal, as shown in FIG. 6 .
  • the apparatus for synchronously playing multimedia data includes:
  • the obtaining module 601 is configured to obtain a resource identifier of the multimedia data.
  • the sending module 602 is configured to send the resource identifier to all receiver terminals in the same session.
  • the synchronization notification module 603 is configured to send a synchronization play notification to each receiver terminal after the multimedia data is acquired according to the resource identifier, so that all terminals participating in the session play the multimedia data synchronously.
  • the resource identifier includes: a URL.
  • the synchronization notification module 603 is specifically configured to receive resource feedback fed back by each receiver terminal. After the notification, a synchronous play notification is sent to each of the recipient terminals.
  • the resource acquisition notification indicates that the receiver terminal has successfully acquired the multimedia data corresponding to the resource identifier.
  • the initiator terminal loads an operable play control in the currently displayed session interface to play the multimedia data.
  • the device further includes: a play control module 604, configured to receive, by the initiator terminal, a play control operation for the play control, and adjust a play state of the multimedia data according to the play control operation, According to the adjusted playing state, the adjustment information is generated, and the adjustment information is distributed to each receiving terminal in the same session, so that each receiving terminal synchronously adjusts the playing state of the respective multimedia data according to the adjustment information.
  • the play control operation includes at least one of a play operation, a pause operation, a play progress operation, and a stop operation.
  • the play control module 604 is specifically configured to adjust a play progress of the multimedia data according to the play progress operation, and determine a play time corresponding to the adjusted play progress, according to the play time.
  • the progress adjustment information is generated.
  • the synchronization notification module 603 is specifically configured to send a synchronous play notification to the receiver terminals by using a server.
  • the device further includes: a card processing module 605, configured to send a card correction request to the server when the play card is detected, so that the server displays the current play time according to the card correction request.
  • the corresponding multimedia data is sent to the initiator terminal, and the initiator terminal loads the multimedia data corresponding to the current playing time for playing.
  • the device further includes: a voice message module 606, configured to: when receiving the voice message input during the playing, turn off the audio of the currently played multimedia data, and record the input The voice message sends the voice message to each receiver terminal in the same session, and re-opens the audio of the currently played multimedia data.
  • a voice message module 606 configured to: when receiving the voice message input during the playing, turn off the audio of the currently played multimedia data, and record the input The voice message sends the voice message to each receiver terminal in the same session, and re-opens the audio of the currently played multimedia data.
  • the voice message module 606 is further configured to receive a voice message sent by the receiver terminal, and reduce the volume of the audio of the currently played multimedia data to a preset volume.
  • the threshold value is played, and the received voice message is played, and when the voice message is played, the volume of the audio of the currently played multimedia data is restored.
  • the initiator terminal loads an operable play control in the currently displayed session interface to play the multimedia data.
  • the device further includes: an instant messaging message module 607, configured to play the current playback when the playback control enters the full-screen playback mode. Setting a session display area in the interface, the initiator terminal sends the instant messaging message sent by itself, and the received instant messaging message sent by each receiving terminal to the instant messaging message according to the chronological order of each instant messaging message. Displayed in the session display area.
  • the embodiment of the present application further provides an apparatus for synchronously playing multimedia data, which is disposed in a receiver terminal.
  • the apparatus includes:
  • the receiving module 701 is configured to: in a session in which at least two terminals participate, the receiver terminal receives the resource identifier of the multimedia data sent by the initiator terminal.
  • the obtaining module 702 is configured to obtain the multimedia data to be played according to the resource identifier.
  • the notification receiving module 703 is configured to receive a synchronization play notification sent by the initiator terminal.
  • the synchronous play module 704 is configured to play the multimedia data according to the synchronous play notification.
  • the acquiring module 702 is further configured to: after obtaining the multimedia data to be played according to the resource identifier, feed back a resource acquisition notification to the initiator terminal.
  • the resource acquisition notification indicates that the receiver terminal has successfully acquired the multimedia data corresponding to the resource identifier.
  • the initiator terminal adjusts a play state of the multimedia data according to a play control operation, and generates adjustment information to be sent to the receiver terminal
  • the device further includes
  • the play control module 705 is configured to receive, by the receiver terminal, adjustment information sent by the initiator terminal, and synchronously adjust a play state of the respective multimedia data according to the adjustment information.
  • the adjustment information is used to adjust at least one of playing state, pause, play progress, and stop of the multimedia data.
  • the receiver terminal receives a synchronization play notification sent by the initiator terminal by using a server
  • the device further includes: a card-and-click processing module 706, configured to monitor a play-back time Sending a card correction request to the server, so that the server sends the multimedia data corresponding to the current play time to the receiver terminal according to the card correction request, and the receiver terminal loads the current play time. Play corresponding to multimedia data.
  • the device further includes: a voice message module 707, configured to: when receiving the voice input operation during the playing, turn off the audio of the currently played multimedia data, and record the input The voice message is sent to other terminals in the same session, and the audio of the currently played multimedia data is re-opened.
  • a voice message module 707 configured to: when receiving the voice input operation during the playing, turn off the audio of the currently played multimedia data, and record the input The voice message is sent to other terminals in the same session, and the audio of the currently played multimedia data is re-opened.
  • the voice message module 707 is further configured to receive the language sent by other terminals. a voice message, reducing the volume of the audio of the currently played multimedia data to a preset volume threshold, and playing the received voice message, and restoring the currently played after the voice message is played. The volume of the audio of the multimedia data.
  • the device further includes: an instant messaging message module 708, configured to set a session display area in the current playing interface when the playing control enters the full-screen playing mode, and receive The instant messaging message sent by the party terminal itself, and the received instant messaging message sent by the initiator terminal, display the instant messaging message in the session display area according to the chronological order of each instant messaging message.
  • an instant messaging message module 708 configured to set a session display area in the current playing interface when the playing control enters the full-screen playing mode, and receive The instant messaging message sent by the party terminal itself, and the received instant messaging message sent by the initiator terminal, display the instant messaging message in the session display area according to the chronological order of each instant messaging message.
  • the embodiment of the present application further provides an apparatus for synchronously playing multimedia data, which is disposed in a server.
  • the apparatus includes:
  • the receiving module 801 is configured to: in a session in which at least two terminals participate, the server receives the resource identifier sent by the initiator terminal.
  • the distribution module 802 is configured to distribute the resource identifier to all receiver terminals in the same session.
  • the synchronization notification module 803 is configured to receive the synchronization play notification sent by the initiator terminal, and distribute the notification to all the receiver terminals, so that all the terminals participating in the session play the multimedia data synchronously.
  • the apparatus further includes a monitoring module 804 for monitoring the occurrence of a jam in each terminal during the synchronous playback.
  • the monitoring module 804 is specifically configured to record a starting play progress of each terminal for synchronous play, and a system time corresponding to the initial play progress, send a progress query request to each terminal, and receive feedback of each terminal, and not receive In the case of the adjustment information corresponding to the playback progress operation, according to the time difference between the current playback progress of the feedback and the initial playback progress, and the system time corresponding to the current playback progress and the system time corresponding to the initial playback progress. Time difference, monitoring Caton.
  • the device further includes: a card correction module 805, configured to: when the terminal is detected to be stuck, according to the recorded synchronized playback progress, feed the synchronized playback progress of the current moment to the terminal where the card is present, so that the occurrence of the stuck The terminal loads the synchronized play progress of the current moment.
  • a card correction module 805 configured to: when the terminal is detected to be stuck, according to the recorded synchronized playback progress, feed the synchronized playback progress of the current moment to the terminal where the card is present, so that the occurrence of the stuck The terminal loads the synchronized play progress of the current moment.
  • a computing device includes one or more processors (CPUs), input/output interfaces, network interfaces, and memory.
  • processors CPUs
  • input/output interfaces network interfaces
  • memory volatile and non-volatile memory
  • the memory may include non-persistent memory, random access memory (RAM), and/or non-volatile memory in a computer readable medium, such as read only memory (ROM) or flash memory.
  • RAM random access memory
  • ROM read only memory
  • Memory is an example of a computer readable medium.
  • Computer readable media includes both permanent and non-persistent, removable and non-removable media.
  • Information storage can be implemented by any method or technology.
  • the information can be computer readable instructions, data structures, modules of programs, or other data.
  • Examples of computer storage media include, but are not limited to, phase change memory (PRAM), static random access memory (SRAM), dynamic random access memory (DRAM), other types of random access memory (RAM), read only memory. (ROM), electrically erasable programmable read only memory (EEPROM), flash memory or other memory technology, compact disk read only memory (CD-ROM), digital versatile disk (DVD) or other optical storage, Magnetic tape cartridges, magnetic tape storage or other magnetic storage devices or any other non-transportable media can be used to store information that can be accessed by a computing device.
  • computer readable media does not include temporary storage of computer readable media, such as modulated data signals and carrier waves.
  • embodiments of the present application can be provided as a method, system, or computer program product.
  • the present application can take the form of an entirely hardware embodiment, an entirely software embodiment or an embodiment in combination of software and hardware.
  • the application can take the form of a computer program product embodied on one or more computer-usable storage media (including but not limited to disk storage, CD-ROM, optical storage, etc.) including computer usable program code.

Landscapes

  • Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • Signal Processing (AREA)
  • Computer Networks & Wireless Communication (AREA)
  • Two-Way Televisions, Distribution Of Moving Picture Or The Like (AREA)
  • Information Transfer Between Computers (AREA)
  • Telephonic Communication Services (AREA)

Abstract

La présente invention concerne un procédé et un dispositif de diffusion synchrone de données multimédia. Le procédé comporte les étapes consistant: dans une session faisant intervenir au moins deux terminaux, à faire acquérir, par un terminal initiateur, un identifiant de ressources de données multimédia; envoyer l'identifiant de ressources à tous les terminaux récepteurs de la même session; et après avoir acquis les données multimédia d'après l'identifiant de ressources, faire envoyer, par le terminal initiateur, une notification de diffusion synchrone à chacun des terminaux récepteurs, de telle sorte que tous les terminaux intervenant dans la session diffusent de façon synchrone les données multimédia. Le procédé remédie à un problème rencontré dans la technique conventionnelle, où chaque terminal intervenant dans une session lit indépendamment les données multimédia, améliorant ainsi efficacement la synchronisation de la diffusion de données multimédia et renforçant l'interactivité pendant le partage de données multimédia, facilitant l'interaction pendant le partage de données multimédia.
PCT/CN2016/084596 2015-06-11 2016-06-03 Procédé et dispositif de diffusion synchrone de données multimédia WO2016197859A1 (fr)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
CN201510320742.7A CN106303648A (zh) 2015-06-11 2015-06-11 一种同步播放多媒体数据的方法及装置
CN201510320742.7 2015-06-11

Publications (1)

Publication Number Publication Date
WO2016197859A1 true WO2016197859A1 (fr) 2016-12-15

Family

ID=57502986

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/CN2016/084596 WO2016197859A1 (fr) 2015-06-11 2016-06-03 Procédé et dispositif de diffusion synchrone de données multimédia

Country Status (2)

Country Link
CN (1) CN106303648A (fr)
WO (1) WO2016197859A1 (fr)

Cited By (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN109379617A (zh) * 2018-09-18 2019-02-22 平安科技（深圳）有限公司 基于数据处理的多媒体文件同步播放方法、终端和介质
CN111585865A (zh) * 2019-02-18 2020-08-25 腾讯科技（深圳）有限公司 数据处理方法、装置、计算机可读存储介质和计算机设备
CN112801705A (zh) * 2021-02-04 2021-05-14 西安万像电子科技有限公司 信息的投放方法、装置、存储介质和处理器
CN112887769A (zh) * 2021-01-21 2021-06-01 海信视像科技股份有限公司 一种显示设备
CN113965784A (zh) * 2020-07-20 2022-01-21 云米互联科技(广东)有限公司 电视节目播放方法、显示设备、电视及存储介质

Families Citing this family (13)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US10372298B2 (en) * 2017-09-29 2019-08-06 Apple Inc. User interface for multi-user communication session
DK201870364A1 (en) 2018-05-07 2019-12-03 Apple Inc. MULTI-PARTICIPANT LIVE COMMUNICATION USER INTERFACE
CN110719515B (zh) * 2018-07-12 2022-06-14 阿里巴巴（中国）有限公司 视频播放方法、装置及存储介质
US11128792B2 (en) 2018-09-28 2021-09-21 Apple Inc. Capturing and displaying images with multiple focal planes
CN110719516A (zh) * 2019-10-21 2020-01-21 北京字节跳动网络技术有限公司 视频同步的方法及装置、终端和存储介质
CN111107412A (zh) * 2019-12-30 2020-05-05 北京奇艺世纪科技有限公司 媒体播放进度同步方法、装置及存储介质
CN111327928A (zh) * 2020-03-11 2020-06-23 广州酷狗计算机科技有限公司 歌曲播放方法、装置及系统、计算机存储介质
US11431891B2 (en) 2021-01-31 2022-08-30 Apple Inc. User interfaces for wide angle video conference
US11907605B2 (en) 2021-05-15 2024-02-20 Apple Inc. Shared-content session user interfaces
US20220368548A1 (en) 2021-05-15 2022-11-17 Apple Inc. Shared-content session user interfaces
US11893214B2 (en) 2021-05-15 2024-02-06 Apple Inc. Real-time communication user interface
CN113873309A (zh) * 2021-07-30 2021-12-31 北京达佳互联信息技术有限公司 一种对象播放方法、装置、电子设备及存储介质
US11770600B2 (en) 2021-09-24 2023-09-26 Apple Inc. Wide angle video conference

Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101622610A (zh) * 2007-02-22 2010-01-06 雅虎公司 协作环境中媒体内容的同步传递
US20130124664A1 (en) * 2011-11-16 2013-05-16 Motorola Mobility, Inc Coordinating media presentations among peer devices
CN103796061A (zh) * 2014-03-03 2014-05-14 上海美琦浦悦通讯科技有限公司 多智能终端中实现媒体文件同步播放和控制的系统及方法
CN104426744A (zh) * 2013-08-30 2015-03-18 中兴通讯股份有限公司 多媒体内容的同步播放方法、服务器、客户端及系统
CN104602133A (zh) * 2014-11-21 2015-05-06 腾讯科技（北京）有限公司 多媒体文件共享方法和终端及服务器
CN104683854A (zh) * 2015-02-13 2015-06-03 广东欧珀移动通信有限公司 一种多媒体播放控制方法及装置

Family Cites Families (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN100596195C (zh) * 2006-03-30 2010-03-24 华为技术有限公司 一种控制流媒体播放的方法及装置
CN102970589B (zh) * 2012-11-26 2016-03-30 中国联合网络通信集团有限公司 多终端协同播放媒体流的控制方法及装置
CN103220301B (zh) * 2013-04-28 2016-04-27 青岛海信移动通信技术股份有限公司 一种媒体播放控制方法及其装置
CN103389890B (zh) * 2013-07-19 2015-12-09 西安诺瓦电子科技有限公司 播放控制装置、多显示终端同步播放控制系统及方法
CN103905879B (zh) * 2014-03-13 2018-07-06 北京奇艺世纪科技有限公司 一种视频数据和音频数据同步播放的方法、装置和设备
CN104581366A (zh) * 2014-12-30 2015-04-29 北京奇艺世纪科技有限公司 一种互联网电视播放方法和服务器
KR101520788B1 (ko) * 2015-01-26 2015-05-18 주식회사 비즈모델라인 동영상 동기화 재생 방법

Patent Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101622610A (zh) * 2007-02-22 2010-01-06 雅虎公司 协作环境中媒体内容的同步传递
US20130124664A1 (en) * 2011-11-16 2013-05-16 Motorola Mobility, Inc Coordinating media presentations among peer devices
CN104426744A (zh) * 2013-08-30 2015-03-18 中兴通讯股份有限公司 多媒体内容的同步播放方法、服务器、客户端及系统
CN103796061A (zh) * 2014-03-03 2014-05-14 上海美琦浦悦通讯科技有限公司 多智能终端中实现媒体文件同步播放和控制的系统及方法
CN104602133A (zh) * 2014-11-21 2015-05-06 腾讯科技（北京）有限公司 多媒体文件共享方法和终端及服务器
CN104683854A (zh) * 2015-02-13 2015-06-03 广东欧珀移动通信有限公司 一种多媒体播放控制方法及装置

Cited By (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN109379617A (zh) * 2018-09-18 2019-02-22 平安科技（深圳）有限公司 基于数据处理的多媒体文件同步播放方法、终端和介质
CN111585865A (zh) * 2019-02-18 2020-08-25 腾讯科技（深圳）有限公司 数据处理方法、装置、计算机可读存储介质和计算机设备
CN113965784A (zh) * 2020-07-20 2022-01-21 云米互联科技(广东)有限公司 电视节目播放方法、显示设备、电视及存储介质
CN112887769A (zh) * 2021-01-21 2021-06-01 海信视像科技股份有限公司 一种显示设备
CN112887769B (zh) * 2021-01-21 2023-09-19 青岛海信传媒网络技术有限公司 一种显示设备
CN112801705A (zh) * 2021-02-04 2021-05-14 西安万像电子科技有限公司 信息的投放方法、装置、存储介质和处理器

Also Published As

Publication number Publication date
CN106303648A (zh) 2017-01-04

Similar Documents

Publication Publication Date Title
WO2016197859A1 (fr) Procédé et dispositif de diffusion synchrone de données multimédia
US20220303599A1 (en) Synchronizing Program Presentation
US9131256B2 (en) Method and apparatus for synchronizing content playback
US10455291B2 (en) Live video stream sharing
CN103209360B (zh) 一种多方视频共享的方法和装置
US11316909B2 (en) Data transmission method and apparatus, and computer storage medium
US8737804B2 (en) System for delayed video viewing
WO2016050080A1 (fr) Procédé et système d'interaction en temps réel de visualisation de vidéos multi-utilisateurs
US20150365453A1 (en) Media projection method and device, control terminal and cloud server
US20080209075A1 (en) Synchronous delivery of media content and real-time communication for online dating
JP2015502672A (ja) 同期したワイヤレスディスプレイデバイス
WO2007121610A1 (fr) Procédé de transmission de contenu d'un réseau poste à poste et appareil de localisation et de lecture
US10021199B2 (en) Apparatus and method for providing streaming music service
WO2014169657A1 (fr) Méthode de lecture synchrone de contenu multimédia, serveur, client et système associés
WO2014036960A1 (fr) Procédé de publication automatique d'informations et terminal mobile
WO2015180446A1 (fr) Système et procédé de maintien de canal de connexion dans un service d'interfonctionnement multi-dispositif
US20230036682A1 (en) Resuming playback on multiple streaming devices
WO2017016266A1 (fr) Procédé et dispositif pour mettre en œuvre une lecture synchrone
JP2011228784A (ja) 同期再生システム、同期再生方法及び同期再生プログラム
US20230247074A1 (en) Synchronization of streaming content using live edge offsets
US9374613B2 (en) Media content flicking systems and methods
EP3238471B1 (fr) Procédé permettant de commander le partage d'au moins un contenu électronique entre un premier équipement utilisateur et au moins un second équipement utilisateur
JP5262675B2 (ja) 映像配信システムおよびユニキャスト型多地点映像配信方法
TWI697236B (zh) 視訊會議影音共享方法
US10523409B2 (en) Method of synchronization during the processing, by a multimedia player, of an item of multimedia content transmitted by an MBMS service

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 16806757

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 16806757

Country of ref document: EP

Kind code of ref document: A1