WO2016197859A1 - 一种同步播放多媒体数据的方法及装置 - Google Patents

一种同步播放多媒体数据的方法及装置 Download PDF

Info

Publication number
WO2016197859A1
WO2016197859A1 PCT/CN2016/084596 CN2016084596W WO2016197859A1 WO 2016197859 A1 WO2016197859 A1 WO 2016197859A1 CN 2016084596 W CN2016084596 W CN 2016084596W WO 2016197859 A1 WO2016197859 A1 WO 2016197859A1
Authority
WO
WIPO (PCT)
Prior art keywords
play
multimedia data
terminal
receiver
session
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Ceased
Application number
PCT/CN2016/084596
Other languages
English (en)
French (fr)
Inventor
於聪
陶媛
严飞军
裘钰钢
金琼瑶
黄种堃
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Alibaba Group Holding Ltd
Original Assignee
Alibaba Group Holding Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Alibaba Group Holding Ltd filed Critical Alibaba Group Holding Ltd
Publication of WO2016197859A1 publication Critical patent/WO2016197859A1/zh
Anticipated expiration legal-status Critical
Ceased legal-status Critical Current

Links

Images

Classifications

    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
    • H04N21/4302—Content synchronisation processes, e.g. decoder synchronisation
    • H04N21/4307—Synchronising the rendering of multiple content streams or additional data on devices, e.g. synchronisation of audio on a mobile phone with the video output on the TV screen
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L65/00—Network arrangements, protocols or services for supporting real-time applications in data packet communication
    • H04L65/40—Support for services or applications
    • H04L65/401—Support for services or applications wherein the services involve a main real-time session and one or more additional parallel real-time or time sensitive sessions, e.g. white board sharing or spawning of a subconference
    • H04L65/4015—Support for services or applications wherein the services involve a main real-time session and one or more additional parallel real-time or time sensitive sessions, e.g. white board sharing or spawning of a subconference where at least one of the additional parallel sessions is real time or time sensitive, e.g. white board sharing, collaboration or spawning of a subconference
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L65/00—Network arrangements, protocols or services for supporting real-time applications in data packet communication
    • H04L65/40—Support for services or applications
    • H04L65/403—Arrangements for multi-party communication, e.g. for conferences

Definitions

  • the present application relates to the field of computer technologies, and in particular, to a method and an apparatus for synchronously playing multimedia data.
  • the user uses the mobile terminal, in addition to the short message communication and the telephone communication through the telecommunication carrier network, the user can also use the communication application (Application, APP) installed in the mobile terminal to communicate through the Internet, thereby Communication is more and more convenient.
  • APP Application, APP
  • a user can use a communication application to establish a separate session with other users (the separate session consists of instant messaging messages exchanged between two users), a group session (described A group session consists of instant messaging messages exchanged between multiple users in a user group.
  • the separate session consists of instant messaging messages exchanged between two users
  • a group session consists of instant messaging messages exchanged between multiple users in a user group.
  • the user shares the multimedia data (such as video data and audio data) by using the above communication method
  • other users participating in the session can only browse the content of the multimedia data in the terminal used by the user, because the user browses each time.
  • the time is not uniform. If some users want to discuss and exchange a certain piece of content of the multimedia data, they can only wait for other users to browse the content, or let other users browse the content through progress adjustment. Obviously, when sharing multimedia data in such a way, the convenience of interaction is poor.
  • the embodiment of the present invention provides a method and an apparatus for synchronously playing multimedia data, which are used to solve the problem that the communication method in the prior art is inconvenient in interaction when performing multimedia data sharing.
  • the initiator terminal acquires a resource identifier of the multimedia data
  • the initiator terminal After acquiring the multimedia data according to the resource identifier, the initiator terminal sends a synchronization play notification to the receiver terminals, so that all terminals participating in the session play the multimedia data synchronously.
  • the receiver terminal receives the resource identifier of the multimedia data sent by the initiator terminal;
  • the multimedia data is played according to the synchronous play notification.
  • a method for synchronously playing multimedia data including:
  • the server receives the resource identifier sent by the initiator terminal;
  • An embodiment of the present application provides an apparatus for synchronously playing multimedia data, including:
  • An obtaining module configured to acquire a resource identifier of the multimedia data
  • a sending module configured to send the resource identifier to all receiver terminals in the same session
  • the synchronization notification module is configured to send a synchronization play notification to each of the receiver terminals after the multimedia data is acquired according to the resource identifier, so that all the terminals participating in the session play the multimedia data synchronously.
  • An embodiment of the present application further provides an apparatus for synchronously playing multimedia data, including:
  • a receiving module configured to receive, by the receiving terminal, a resource identifier of the multimedia data sent by the initiator terminal;
  • An acquiring module configured to acquire, according to the resource identifier, the multimedia data to be played
  • a notification receiving module configured to receive a synchronization play notification sent by the initiator terminal
  • a synchronous play module configured to play the multimedia data according to the synchronous play notification.
  • the embodiment of the present application further provides an apparatus for synchronously playing multimedia data, including:
  • a receiving module configured to receive, by a server, a resource identifier sent by the initiator terminal
  • a distribution module configured to distribute the resource identifier to all receiver terminals in the same session
  • the synchronization notification module is configured to receive the synchronization play notification sent by the initiator terminal, and distribute the notification to all the receiver terminals, so that all the terminals participating in the session play the multimedia data synchronously.
  • An embodiment of the present invention provides a method and an apparatus for synchronously playing multimedia data.
  • an initiator terminal in the same session sends the resource identifier corresponding to the acquired multimedia data to other terminals in the session.
  • the initiator terminal further sends a synchronization play notification to each receiver terminal to notify all terminals to play the multimedia data at the same time. Therefore, all the terminals in the session realize synchronous play for the multimedia data, which changes the defect that the terminals participating in the session can only play the multimedia data by itself, which not only effectively improves the multimedia data.
  • the synchronism of playback also enhances the interactivity when sharing multimedia data, making the interaction when sharing multimedia data more convenient.
  • FIG. 1 is a flowchart of synchronously playing multimedia data according to an embodiment of the present application
  • FIG. 2 is a schematic diagram of an interface in a terminal in an actual application scenario according to an embodiment of the present disclosure
  • FIG. 3 is a schematic diagram of a play control after entering a full screen mode in an actual application scenario according to an embodiment of the present disclosure
  • FIG. 5 is a flowchart of synchronously playing multimedia data in a server according to an embodiment of the present application
  • FIG. 6 is a schematic structural diagram of an apparatus for synchronously playing multimedia data in an initiator terminal according to an embodiment of the present disclosure
  • FIG. 7 is a schematic structural diagram of an apparatus for synchronously playing multimedia data in a receiver terminal according to an embodiment of the present disclosure
  • FIG. 8 is a schematic structural diagram of an apparatus for synchronously playing multimedia data in a server according to an embodiment of the present disclosure.
  • FIG. 1 is a process of synchronously playing multimedia data according to an embodiment of the present disclosure, which specifically includes the following steps:
  • the initiator terminal acquires a resource identifier of the multimedia data.
  • the terminal described in the embodiment of the present application includes but is not limited to: a mobile phone, a tablet computer, a smart watch, etc.
  • Mobile terminal A session can be established between different terminals, such as a separate session or a group session. Users who use different terminals can send instant messaging messages to each other through the session. Obviously, the establishment of a session requires at least two different terminals, that is, the number of terminals participating in the session is at least two.
  • the implementation of the session may be based on providing a corresponding session service in an operating system of the terminal, or providing a session service based on an application having a session function installed in the terminal. This does not constitute a limitation on the present application.
  • the terminal used by the user will acquire the resource identifier of the corresponding multimedia data, and The resource identifier is distributed to other terminals in the session for subsequent simultaneous playback.
  • the resource identifier may be a Uniform Resource Locator (URL).
  • URL Uniform Resource Locator
  • the resource identifier reflects the storage location of the multimedia data. Through the resource identifier, each terminal can obtain the substantial content of the multimedia data.
  • the initiator terminal After acquiring the multimedia data to be played according to the resource identifier, the initiator terminal sends a synchronization play notification to each receiver terminal, so that all terminals participating in the session synchronize the multimedia data. Play.
  • different receiver terminals may have a certain time difference when acquiring multimedia data. If the receiver terminal starts to play immediately after acquiring the multimedia data, it will cause different receiver terminals to play. There is a certain time difference in the progress of the content, so that synchronous playback cannot be achieved. Therefore, for the foregoing step S103, after acquiring the multimedia data according to the resource identifier, the initiator terminal sends a synchronization play notification to the receiver terminal, specifically, the initiator terminal receives the receiver. After the resource acquisition notification fed back by the terminal, the synchronization play notification is sent to the receiver terminal.
  • the resource acquisition notification indicates that the receiver terminal has successfully acquired the multimedia data corresponding to the resource identifier.
  • the receiver terminals in the session are not required to participate in the synchronous play, and as long as one receiver terminal participates, synchronous play with the initiator terminal can be performed. . That is to say, only when the at least one receiving terminal acquires the corresponding multimedia data according to the resource identifier, it will play synchronously with the initiator terminal (when the receiving party acquires the multimedia data, then the initiator terminal is waiting) status). Therefore, in the above content, the receiver terminal that feeds back the resource acquisition notification is the receiver terminal (the number is at least one) that acquires the multimedia data.
  • an extension is required.
  • the receiver terminal participating in the synchronous play is not all the receiver terminals, then in the subsequent process, the other is not involved.
  • the receiving terminal that plays synchronously can also join the synchronous playing at any time. At this time, the newly added receiving terminal will play synchronously according to the current playing progress.
  • Each receiving terminal in the embodiment of the present application obtains the multimedia data according to the received resource identifier, and only after receiving the synchronous play notification sent by the initiator terminal, The notification is played synchronously, and the multimedia data is played synchronously.
  • the receiver terminal receives the resource identifier of the multimedia data
  • the user wants to view and browse the multimedia content corresponding to the resource identifier
  • only the terminal in the terminal can be used.
  • the player either accesses the corresponding page according to the resource identifier and performs separate viewing. That is to say, for each terminal in the session, the progress and playing state of other terminals in the session are not known, that is, the interaction is low.
  • the initiator terminal initiates synchronous play to other terminals in the session, so that all terminals in the session simultaneously play the content in the multimedia data.
  • the initiator terminal in the same session sends the resource identifier corresponding to the acquired multimedia data to other terminals in the session, and the initiator terminal also sends synchronous play to each receiver terminal. Notification to notify all terminals to play the multimedia data at the same time. Therefore, all the terminals in the session realize synchronous play for the multimedia data, which changes the defect that the terminals participating in the session can only play the multimedia data by itself, which not only effectively improves the multimedia data.
  • the synchronism of playback also enhances the interactivity when sharing multimedia data, making the interaction when sharing multimedia data more convenient.
  • the playing state may be changed during the synchronous play of the multimedia data, and the instant messaging during the playing process may also be implemented.
  • the initiator terminal or the receiver terminal may use the play control to play the multimedia data when the multimedia data is played, wherein the play control may load the current session displayed by the terminal.
  • the play control may load the current session displayed by the terminal.
  • the upper part of the current session interface of the initiator terminal loads the play control, and the corresponding multimedia data is played in the play control (in FIG. 2, the current play control is in a pause state), of course.
  • the play control is operable.
  • the initiator terminal can perform a control operation in the play control, such as: click pause, then, in the play control of other receiver terminals, the multimedia data is also paused.
  • a control operation in the play control such as: click pause
  • the multimedia data is also paused.
  • the initiator terminal receives the corresponding control operation, the playback state during the synchronous playback has changed.
  • the method further includes: the initiator terminal receiving a play control operation for the play control, according to the play control operation, Adjusting a play status of the multimedia data, generating adjustment information according to the adjusted play status, and distributing the adjustment information to each receiver terminal in the same session, so that each receiver terminal adjusts synchronously according to the adjustment information The playback status of the respective multimedia data.
  • the play control operation includes at least one of a play operation, a pause operation, a play progress operation, and a stop operation.
  • the play control operation includes a play progress operation
  • adjusting a play status of the multimedia data according to the play control operation specifically: adjusting playback of the multimedia data according to the play progress operation schedule.
  • the adjustment information is generated according to the adjusted playing state, specifically: determining a playing time corresponding to the adjusted playing progress, and generating the progress adjusting information according to the playing time.
  • the initiator terminal has the right to control and adjust the play of the multimedia data
  • other receiver terminals in the same session only perform corresponding control adjustment according to the control information sent by the initiator terminal.
  • the method can avoid the chaos phenomenon that the different terminals can control and adjust the playing of the multimedia data in the session.
  • playback jams may occur.
  • the initiator terminal if the initiator terminal appears to be stuck in the process of playing multimedia data, and the playback of the other recipient terminals is normal, the playback progress of the initiator terminal is compared with other receiver terminals. The playback progress is inconsistent, and there is no guarantee that the playback will be synchronized.
  • the initiator terminal implements a session connection with other recipient terminals through the server.
  • the initiator terminal sends a synchronization play notification to the receiver terminals, specifically: the initiator terminal sends a synchronization play notification to the receiver terminals through a server, and synchronizes the broadcast notification.
  • a synchronization play notification to the receiver terminals, specifically: the initiator terminal sends a synchronization play notification to the receiver terminals through a server, and synchronizes the broadcast notification.
  • the method S101 to S103 described in FIG. 1 further includes: the initiator terminal monitors the playback. When it is stuck, Sending a card correction request to the server, so that the server sends the multimedia data corresponding to the current play time to the initiator terminal according to the card correction request, where the initiator terminal loads the current play time. Multimedia data is played.
  • the terminal in which the card is present can obtain the normal playback progress (the progress of the unstacking) to the server, so that the terminal will load the normal playback progress and eliminate the influence of the jam.
  • All terminals in the same session can perform real-time communication in real time, such as voice message communication and text message communication, even in the process of playing multimedia data.
  • the lower half of the interface in FIG. 2 is an instant messaging message display area, which provides instant messaging for users using different terminals.
  • the method S101-S103 as described in FIG. 1 further includes: when the initiator terminal receives the voice message input during the playing process, the current playing terminal is closed. The audio of the multimedia data is recorded, and the input voice message is recorded, the voice message is sent to each receiver terminal in the same session, and the audio of the currently played multimedia data is re-opened.
  • the above process is a process in which the originating terminal initiates a voice message.
  • the multimedia data contains corresponding audio data, that is, in the process of playing the multimedia data, the corresponding sound is played, then, in this case, when the voice is directly recorded, The sound of the multimedia data is simultaneously recorded, which affects the clarity of the voice message. Therefore, in this scenario, when the voice message is input, the initiator terminal turns off the audio (mute) of the multimedia data, and this can ensure the clarity of the voice message entered.
  • the initiator terminal When the initiator terminal sends the voice message, it indicates that the current input process has ended, so the initiator terminal resumes the playing of the audio, so that the user can hear the sound of the multimedia data again.
  • the process in which the originating terminal receives voice messages of other recipient terminals receives voice messages of other recipient terminals.
  • the method S101 to S103 as described in FIG. 1 further includes: the initiator terminal receiving the voice message sent by the receiver terminal, and the multimedia device currently being played.
  • the volume of the audio of the data is reduced to a preset volume threshold, and the received voice message is played, and when the voice message is played, the volume of the audio of the currently played multimedia data is restored.
  • the visible play control is only displayed on the upper part of the current interface, and the lower part of the interface is used to display instant messaging messages. And if the playback controls are displayed in full screen, then, in order to ensure the The instant messaging can be performed normally. Therefore, in the embodiment of the present application, the method S101 to S103 as described in FIG. 1 further includes: when the playback control enters the full-screen playback mode, in the current playback interface. Setting a session display area, the initiator terminal displays the instant messaging message sent by itself and the received instant messaging message sent by each receiver terminal according to the chronological order of each instant message In the session display area.
  • the play control enters the full-screen play mode.
  • a session display area is displayed, and in the session display area, according to the time sequence of each instant message, the next The top display of each instant messaging message, that is, the latest instant messaging message is displayed at the bottom of the session display area, and with the appearance of other latest messages, the instant messaging message will gradually move up and eventually move out of the session display area.
  • the session display area may be displayed in a floating layer, a floating control, or the like, and in order to ensure the user's viewing experience, the session display and the instant messaging message displayed therein are set to be translucent. Or other transparency.
  • the embodiment of the present application further provides a method for synchronously playing multimedia data, where the method includes:
  • the receiver terminal receives the resource identifier of the multimedia data sent by the initiator terminal.
  • all the receiver terminals in the same session acquire the corresponding multimedia data according to the resource identifier of the multimedia data sent by the initiator terminal, and participate in the session according to the synchronization play notification sent by the initiator terminal.
  • All the terminals in the middle play synchronous playback of the multimedia data. It not only effectively improves the synchronization for multimedia data playback, but also enhances the interactivity when sharing multimedia data, making the interaction when sharing multimedia data more convenient.
  • the method S401 to S404 shown in FIG. 4 further includes: after the receiver terminal acquires the multimedia data to be played according to the resource identifier, and returns a resource acquisition notification to the initiator terminal;
  • the resource acquisition notification indicates that the receiver terminal has successfully acquired the multimedia data corresponding to the resource identifier.
  • each receiving terminal may feed back a resource acquisition notification to the initiator terminal, so that the initiator terminal can learn the acquisition status of different receiver terminals, thereby performing the same Step play.
  • the method further includes The receiving terminal receives the adjustment information sent by the initiator terminal, and synchronously adjusts the playing state of the respective multimedia data according to the adjustment information, where the adjustment information is used to play, pause, and Adjust at least one of the playback progress and the stop playback state.
  • the receiving terminal receives the synchronization playing notification sent by the initiator terminal by using the server, and the method further includes: when the receiving terminal monitors the playing card, to the The server sends a card correction request, so that the server sends the multimedia data corresponding to the current play time to the receiver terminal according to the card correction request, and the receiver terminal loads the multimedia data corresponding to the current play time. Play.
  • the method further includes: when the receiving terminal receives the voice input operation during the playing, turning off the audio of the currently played multimedia data, and recording the input voice message, The voice message is sent to other terminals in the same session, and the audio of the currently played multimedia data is re-opened.
  • the method further includes: the receiving terminal receiving the voice message sent by the other terminal, and reducing the volume of the audio of the currently played multimedia data to a preset volume threshold. And playing the received voice message, and when the voice message is played, resuming the volume of the audio of the currently played multimedia data.
  • the receiving terminal loads the playback control to play the multimedia data in the currently displayed session interface, and the method further includes: when the playback control enters full-screen playback In the mode, the session display area is set in the current play interface, and the receiving terminal sends the instant messaging message sent by itself and the received instant messaging message sent by the initiator terminal according to the time sequence of each instant message. In order, the instant messaging message is displayed in the session display area.
  • a method for synchronously playing multimedia data the method specifically includes:
  • the server receives the resource identifier sent by the initiator terminal.
  • the server participates in the process of implementing synchronous play in the session.
  • the methods S501 to S503 as described in FIG. 5 further include: the server monitoring the occurrence of a jam in each terminal during the synchronous playback.
  • the server monitors the occurrence of the card in the synchronous play process, specifically: the server records the initial play progress of each terminal for synchronous play, and the system time corresponding to the start play progress, and sends the system time to the terminal.
  • the process queries the request and receives the feedback of each terminal. In the case that the adjustment information corresponding to the playback progress operation is not received, the time difference between the current playback progress and the initial playback progress according to the feedback, and the system corresponding to the current time The time difference between the time and the system time corresponding to the initial playback progress is monitored for the stuck.
  • the synchronously played multimedia data (such as video) does not necessarily start from the first frame of data.
  • the playback control may have the function of “skip the title”, thus The initial playback progress of the multimedia data is no longer from the first frame data, so for the server, it is necessary to record the initial playback progress during the synchronous playback.
  • the server In order to time the playback progress, the server also records the system time corresponding to the initial playback progress.
  • the server periodically sends a progress query request to all terminals participating in the session to query the playback progress in each terminal.
  • a certain video is played synchronously, assuming that the initial playback progress of the video recorded by the server is “00:30” (that is, the video starts playing from the 30th second), Also, the system time at the start of playback is "12:00:00".
  • the server sends a progress query request to each terminal every 20 seconds.
  • the server receives the playback progress of a certain terminal feedback at "12:00:20", the current playback progress is "00:48", then, for the terminal, between the current playback progress and the initial playback progress
  • the time difference is 18 seconds.
  • the time difference between the system time corresponding to the current playback progress and the system time corresponding to the initial playback progress is 20 seconds, which indicates that the playback progress of the terminal is stuck for 2 seconds, so that the server can determine The terminal is stuck.
  • the method further includes: after detecting that the terminal has a jam, the server feeds back the synchronized play progress of the current time to the terminal that appears to be stuck according to the recorded synchronized play progress, so that the terminal that appears to be stuck loads the synchronization at the current time. Play progress.
  • the server actively monitors whether each terminal has a jam
  • the terminal itself monitors the occurrence of the stuck, and sends the server to the server after the occurrence of the jam.
  • the card correction request at this time, the server receives the card correction request sent by the terminal, and feeds back the synchronized play progress of the current time to the terminal according to the recorded synchronized play progress, so that the terminal loads the synchronization at the current time. Play progress.
  • the above content is the adjustment of the card to the card in the case that the adjustment information corresponding to the playback progress operation is not received, and if the initiator terminal adjusts the play status of the video, the server receives the adjustment sent by the initiator terminal. And updating the synchronized play progress of the record according to the adjustment information.
  • the adjustment information is used to adjust at least one of playing state, pause, play progress, and stop of the multimedia data.
  • the server obtains the current playback progress of the initiator terminal, and feeds the obtained playback progress to the receiver terminal that sends the card correction request. That is, the playback progress of all terminals is consistent with the initiator terminal.
  • the specific process and manner of realizing synchronous playback of multimedia data between the initiator terminal, the receiver terminal, and the server are respectively described in the embodiments of the present application.
  • the initiator terminal and the receiver terminal may be in the same local area network environment (and the multimedia data is stored locally on the initiator terminal).
  • the process of synchronously playing the multimedia data may be performed. It does not depend on the server, but the initiator terminal and the receiver terminal, and realizes synchronous playback under the transmission of the network device (such as a wireless router).
  • the initiator terminal sends a notification message to each receiver terminal through the local area network to notify each receiver terminal to acquire the multimedia data locally stored by the initiator terminal, and obtain the multimedia data at the receiver terminal.
  • the synchronous play notification is sent to the receiver terminal, so that all the terminals participating in the session play the multimedia data synchronously.
  • the initiator terminal controls the synchronous play (including: start synchronous play, pause during synchronous play, play, progress adjustment, etc.), and the initiator terminal still sends the corresponding receiver to the corresponding receiver in the manner of adjusting information.
  • the terminal causes the receiver terminal to synchronously control the synchronous play according to the adjustment information.
  • the initiator terminal loads an operable play control in the currently displayed session interface to play the multimedia data, and when the initiator terminal receives a play control operation for the play control, Adjusting a play status of the multimedia data according to the play control operation, generating adjustment information according to the adjusted play status, and distributing the adjustment information to each receiver terminal in the same session through a local area network, so that each The receiving terminal synchronously adjusts the playing state of the respective multimedia data according to the adjustment information.
  • the play control operation includes at least one of a play operation, a pause operation, a play progress operation, and a stop operation.
  • both the initiator terminal and the receiver terminal can transmit the voice message and the instant message, and the specific process is similar to the above content, and details are not described herein again.
  • the sender terminal performs cardon monitoring and repair. specifically:
  • the initiator terminal For the monitoring of the card, the initiator terminal records the initial playing progress of the synchronous play, and the system time corresponding to the initial playing progress, sends a progress query request to the receiving terminal, and receives the receiving terminal Feedback, in the case that the playback progress operation is not received, according to the time difference between the current playback progress of the feedback and the initial playback progress, and the system time corresponding to the current playback progress and the system time corresponding to the initial playback progress The time difference is monitored for Caton.
  • the initiator terminal feeds back the synchronized playing progress of the current moment through the local area network to the receiving terminal of the occurrence of the Caton according to the recorded synchronized playing progress. So that the receiving terminal of the stuck one loads the synchronized playing progress of the current moment.
  • the originating terminal obtains the synchronized playing progress of the receiving terminal at the current moment from the receiving party through the local area network, and loads the synchronized playing progress of the current moment.
  • the embodiment of the present application provides a device for synchronously playing multimedia data, which is set in the initiator terminal, as shown in FIG. 6 .
  • the apparatus for synchronously playing multimedia data includes:
  • the obtaining module 601 is configured to obtain a resource identifier of the multimedia data.
  • the sending module 602 is configured to send the resource identifier to all receiver terminals in the same session.
  • the synchronization notification module 603 is configured to send a synchronization play notification to each receiver terminal after the multimedia data is acquired according to the resource identifier, so that all terminals participating in the session play the multimedia data synchronously.
  • the resource identifier includes: a URL.
  • the synchronization notification module 603 is specifically configured to receive resource feedback fed back by each receiver terminal. After the notification, a synchronous play notification is sent to each of the recipient terminals.
  • the resource acquisition notification indicates that the receiver terminal has successfully acquired the multimedia data corresponding to the resource identifier.
  • the initiator terminal loads an operable play control in the currently displayed session interface to play the multimedia data.
  • the device further includes: a play control module 604, configured to receive, by the initiator terminal, a play control operation for the play control, and adjust a play state of the multimedia data according to the play control operation, According to the adjusted playing state, the adjustment information is generated, and the adjustment information is distributed to each receiving terminal in the same session, so that each receiving terminal synchronously adjusts the playing state of the respective multimedia data according to the adjustment information.
  • the play control operation includes at least one of a play operation, a pause operation, a play progress operation, and a stop operation.
  • the play control module 604 is specifically configured to adjust a play progress of the multimedia data according to the play progress operation, and determine a play time corresponding to the adjusted play progress, according to the play time.
  • the progress adjustment information is generated.
  • the synchronization notification module 603 is specifically configured to send a synchronous play notification to the receiver terminals by using a server.
  • the device further includes: a card processing module 605, configured to send a card correction request to the server when the play card is detected, so that the server displays the current play time according to the card correction request.
  • the corresponding multimedia data is sent to the initiator terminal, and the initiator terminal loads the multimedia data corresponding to the current playing time for playing.
  • the device further includes: a voice message module 606, configured to: when receiving the voice message input during the playing, turn off the audio of the currently played multimedia data, and record the input The voice message sends the voice message to each receiver terminal in the same session, and re-opens the audio of the currently played multimedia data.
  • a voice message module 606 configured to: when receiving the voice message input during the playing, turn off the audio of the currently played multimedia data, and record the input The voice message sends the voice message to each receiver terminal in the same session, and re-opens the audio of the currently played multimedia data.
  • the voice message module 606 is further configured to receive a voice message sent by the receiver terminal, and reduce the volume of the audio of the currently played multimedia data to a preset volume.
  • the threshold value is played, and the received voice message is played, and when the voice message is played, the volume of the audio of the currently played multimedia data is restored.
  • the initiator terminal loads an operable play control in the currently displayed session interface to play the multimedia data.
  • the device further includes: an instant messaging message module 607, configured to play the current playback when the playback control enters the full-screen playback mode. Setting a session display area in the interface, the initiator terminal sends the instant messaging message sent by itself, and the received instant messaging message sent by each receiving terminal to the instant messaging message according to the chronological order of each instant messaging message. Displayed in the session display area.
  • the embodiment of the present application further provides an apparatus for synchronously playing multimedia data, which is disposed in a receiver terminal.
  • the apparatus includes:
  • the receiving module 701 is configured to: in a session in which at least two terminals participate, the receiver terminal receives the resource identifier of the multimedia data sent by the initiator terminal.
  • the obtaining module 702 is configured to obtain the multimedia data to be played according to the resource identifier.
  • the notification receiving module 703 is configured to receive a synchronization play notification sent by the initiator terminal.
  • the synchronous play module 704 is configured to play the multimedia data according to the synchronous play notification.
  • the acquiring module 702 is further configured to: after obtaining the multimedia data to be played according to the resource identifier, feed back a resource acquisition notification to the initiator terminal.
  • the resource acquisition notification indicates that the receiver terminal has successfully acquired the multimedia data corresponding to the resource identifier.
  • the initiator terminal adjusts a play state of the multimedia data according to a play control operation, and generates adjustment information to be sent to the receiver terminal
  • the device further includes
  • the play control module 705 is configured to receive, by the receiver terminal, adjustment information sent by the initiator terminal, and synchronously adjust a play state of the respective multimedia data according to the adjustment information.
  • the adjustment information is used to adjust at least one of playing state, pause, play progress, and stop of the multimedia data.
  • the receiver terminal receives a synchronization play notification sent by the initiator terminal by using a server
  • the device further includes: a card-and-click processing module 706, configured to monitor a play-back time Sending a card correction request to the server, so that the server sends the multimedia data corresponding to the current play time to the receiver terminal according to the card correction request, and the receiver terminal loads the current play time. Play corresponding to multimedia data.
  • the device further includes: a voice message module 707, configured to: when receiving the voice input operation during the playing, turn off the audio of the currently played multimedia data, and record the input The voice message is sent to other terminals in the same session, and the audio of the currently played multimedia data is re-opened.
  • a voice message module 707 configured to: when receiving the voice input operation during the playing, turn off the audio of the currently played multimedia data, and record the input The voice message is sent to other terminals in the same session, and the audio of the currently played multimedia data is re-opened.
  • the voice message module 707 is further configured to receive the language sent by other terminals. a voice message, reducing the volume of the audio of the currently played multimedia data to a preset volume threshold, and playing the received voice message, and restoring the currently played after the voice message is played. The volume of the audio of the multimedia data.
  • the device further includes: an instant messaging message module 708, configured to set a session display area in the current playing interface when the playing control enters the full-screen playing mode, and receive The instant messaging message sent by the party terminal itself, and the received instant messaging message sent by the initiator terminal, display the instant messaging message in the session display area according to the chronological order of each instant messaging message.
  • an instant messaging message module 708 configured to set a session display area in the current playing interface when the playing control enters the full-screen playing mode, and receive The instant messaging message sent by the party terminal itself, and the received instant messaging message sent by the initiator terminal, display the instant messaging message in the session display area according to the chronological order of each instant messaging message.
  • the embodiment of the present application further provides an apparatus for synchronously playing multimedia data, which is disposed in a server.
  • the apparatus includes:
  • the receiving module 801 is configured to: in a session in which at least two terminals participate, the server receives the resource identifier sent by the initiator terminal.
  • the distribution module 802 is configured to distribute the resource identifier to all receiver terminals in the same session.
  • the synchronization notification module 803 is configured to receive the synchronization play notification sent by the initiator terminal, and distribute the notification to all the receiver terminals, so that all the terminals participating in the session play the multimedia data synchronously.
  • the apparatus further includes a monitoring module 804 for monitoring the occurrence of a jam in each terminal during the synchronous playback.
  • the monitoring module 804 is specifically configured to record a starting play progress of each terminal for synchronous play, and a system time corresponding to the initial play progress, send a progress query request to each terminal, and receive feedback of each terminal, and not receive In the case of the adjustment information corresponding to the playback progress operation, according to the time difference between the current playback progress of the feedback and the initial playback progress, and the system time corresponding to the current playback progress and the system time corresponding to the initial playback progress. Time difference, monitoring Caton.
  • the device further includes: a card correction module 805, configured to: when the terminal is detected to be stuck, according to the recorded synchronized playback progress, feed the synchronized playback progress of the current moment to the terminal where the card is present, so that the occurrence of the stuck The terminal loads the synchronized play progress of the current moment.
  • a card correction module 805 configured to: when the terminal is detected to be stuck, according to the recorded synchronized playback progress, feed the synchronized playback progress of the current moment to the terminal where the card is present, so that the occurrence of the stuck The terminal loads the synchronized play progress of the current moment.
  • a computing device includes one or more processors (CPUs), input/output interfaces, network interfaces, and memory.
  • processors CPUs
  • input/output interfaces network interfaces
  • memory volatile and non-volatile memory
  • the memory may include non-persistent memory, random access memory (RAM), and/or non-volatile memory in a computer readable medium, such as read only memory (ROM) or flash memory.
  • RAM random access memory
  • ROM read only memory
  • Memory is an example of a computer readable medium.
  • Computer readable media includes both permanent and non-persistent, removable and non-removable media.
  • Information storage can be implemented by any method or technology.
  • the information can be computer readable instructions, data structures, modules of programs, or other data.
  • Examples of computer storage media include, but are not limited to, phase change memory (PRAM), static random access memory (SRAM), dynamic random access memory (DRAM), other types of random access memory (RAM), read only memory. (ROM), electrically erasable programmable read only memory (EEPROM), flash memory or other memory technology, compact disk read only memory (CD-ROM), digital versatile disk (DVD) or other optical storage, Magnetic tape cartridges, magnetic tape storage or other magnetic storage devices or any other non-transportable media can be used to store information that can be accessed by a computing device.
  • computer readable media does not include temporary storage of computer readable media, such as modulated data signals and carrier waves.
  • embodiments of the present application can be provided as a method, system, or computer program product.
  • the present application can take the form of an entirely hardware embodiment, an entirely software embodiment or an embodiment in combination of software and hardware.
  • the application can take the form of a computer program product embodied on one or more computer-usable storage media (including but not limited to disk storage, CD-ROM, optical storage, etc.) including computer usable program code.

Landscapes

  • Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • Signal Processing (AREA)
  • Computer Networks & Wireless Communication (AREA)
  • Two-Way Televisions, Distribution Of Moving Picture Or The Like (AREA)
  • Telephonic Communication Services (AREA)
  • Information Transfer Between Computers (AREA)

Abstract

本申请公开了一种同步播放多媒体数据的方法及装置，所述方法包括：在至少由两个终端参与的会话中，发起方终端获取多媒体数据的资源标识，将所述资源标识发送给处于同一会话中所有的接收方终端，在根据所述资源标识获取到所述多媒体数据后，所述发起方终端向所述各接收方终端发送同步播放通知，使得参与该会话的所有终端对所述多媒体数据进行同步播放。这样的方式改变了现有技术中，参与会话的各终端只能独自播放多媒体数据的缺陷，不仅有效地提升了针对多媒体数据播放的同步性，也提升了在对多媒体数据进行共享时的交互性，使得在共享多媒体数据时的交互更加便捷。

Description

一种同步播放多媒体数据的方法及装置
本申请要求2015年06月11日递交的申请号为201510320742.7、发明名称为“一种同步播放多媒体数据的方法及装置”的中国专利申请的优先权，其全部内容通过引用结合在本申请中。
技术领域
本申请涉及计算机技术领域，尤其涉及一种同步播放多媒体数据的方法及装置。
背景技术
随着信息技术的发展，移动终端成为了用户进行交流沟通的重要工具。用户使用移动终端，除了可以通过电信运营商网络进行短消息通信和电话通信外，用户还可以使用安装在移动终端内的通信应用(Application，APP)，通过互联网进行通信，从而，用户之间的沟通越来越便捷。
目前，尤其对于具有丰富功能的通信应用而言，用户可以使用通信应用，与其他用户建立单独会话(所述单独会话由两个用户之间交互的即时通讯消息构成)、群组会话(所述群组会话由一个用户群组中的多个用户之间交互的即时通讯消息构成)等多种通信方式。这些通信方式不仅可以实现文本、语音、视频等多种通信消息的交互外，还可以在不同的会话中共享视频、音频等多媒体信息。
但是，用户采用上述通信方式共享多媒体数据(如：视频数据、音频数据)时，参与该会话的其他用户只能各自在其使用的终端中，对多媒体数据的内容进行浏览，由于用户各自浏览时的时间并不统一，若某些用户想要对所述多媒体数据的某段内容进行讨论交流，只能等待其他用户浏览到该内容，或者，让其他用户通过进度调节的方式浏览到该内容，显然，这样的方式共享多媒体数据时，交互的便捷性较差。
发明内容
本申请实施例提供一种同步播放多媒体数据的方法及装置，用以解决现有技术中的通信方式在进行多媒体数据共享时交互不便捷的问题。
本申请实施例提供的一种同步播放多媒体数据的方法，包括：
在至少由两个终端参与的会话中，发起方终端获取多媒体数据的资源标识；
将所述资源标识发送给处于同一会话中所有的接收方终端；
在根据所述资源标识获取到所述多媒体数据后，所述发起方终端向所述各接收方终端发送同步播放通知，使得参与该会话的所有终端对所述多媒体数据进行同步播放。
本申请实施例另提供的一种同步播放多媒体数据的方法，包括：
在至少由两个终端参与的会话中，接收方终端接收所述发起方终端发送的多媒体数据的资源标识；
根据所述资源标识获取到待播放的所述多媒体数据；
接收所述发起方终端发送的同步播放通知；
根据所述同步播放通知，播放所述多媒体数据。
本申请实施例还提供的一种同步播放多媒体数据的方法，包括：
在至少由两个终端参与的会话中，服务器接收发起方终端发送的资源标识；
将所述资源标识分发给处于同一会话中所有的接收方终端；
接收所述发起方终端发送的同步播放通知，并分发至所有的接收方终端，使得参与该会话的所有终端对所述多媒体数据进行同步播放。
本申请实施例提供一种同步播放多媒体数据的装置，包括：
获取模块，用于获取多媒体数据的资源标识；
发送模块，用于将所述资源标识发送给处于同一会话中所有的接收方终端；
同步通知模块，用于在根据所述资源标识获取到所述多媒体数据后，向所述各接收方终端发送同步播放通知，使得参与该会话的所有终端对所述多媒体数据进行同步播放。
本申请实施例另提供一种同步播放多媒体数据的装置，包括：
接收模块，用于在至少由两个终端参与的会话中，接收方终端接收所述发起方终端发送的多媒体数据的资源标识；
获取模块，用于根据所述资源标识获取到待播放的所述多媒体数据；
通知接收模块，用于接收所述发起方终端发送的同步播放通知；
同步播放模块，用于根据所述同步播放通知，播放所述多媒体数据。
本申请实施例还提供一种同步播放多媒体数据的装置，包括：
接收模块，用于在至少由两个终端参与的会话中，服务器接收发起方终端发送的资源标识；
分发模块，用于将所述资源标识分发给处于同一会话中所有的接收方终端；
同步通知模块，用于接收所述发起方终端发送的同步播放通知，并分发至所有的接收方终端，使得参与该会话的所有终端对所述多媒体数据进行同步播放。
本申请实施例提供一种同步播放多媒体数据的方法及装置，在该方法中，同一会话中的发起方终端会将获取到的多媒体数据所对应的资源标识，发送给处于该会话中的其他终端，并且，该发起方终端还会向各个接收方终端发送同步播放通知，以通知所有终端在同一时刻播放所述多媒体数据。从而，处于该会话中的所有终端针对该多媒体数据实现了同步播放，这样的方式改变了现有技术中，参与会话的各终端只能独自播放多媒体数据的缺陷，不仅有效地提升了针对多媒体数据播放的同步性，也提升了在对多媒体数据进行共享时的交互性，使得在共享多媒体数据时的交互更加便捷。
附图说明
此处所说明的附图用来提供对本申请的进一步理解，构成本申请的一部分，本申请的示意性实施例及其说明用于解释本申请，并不构成对本申请的不当限定。在附图中：
图1为本申请实施例提供的同步播放多媒体数据的过程；
图2为本申请实施例提供的在实际应用场景下的终端中的界面示意图；
图3为本申请实施例提供的在实际应用场景下播放控件进入全屏模式后的示意图；
图4为本申请实施例提供的在接收方终端中的同步播放多媒体数据的过程；
图5为本申请实施例提供的在服务器中的同步播放多媒体数据的过程；
图6为本申请实施例提供的在发起方终端中同步播放多媒体数据的装置结构示意图；
图7为本申请实施例提供的在接收方终端中同步播放多媒体数据的装置结构示意图；
图8为本申请实施例提供的在服务器中同步播放多媒体数据的装置结构示意图。
具体实施方式
为使本申请的目的、技术方案和优点更加清楚，下面将结合本申请具体实施例及相应的附图对本申请技术方案进行清楚、完整地描述。显然，所描述的实施例仅是本申请一部分实施例，而不是全部的实施例。基于本申请中的实施例，本领域普通技术人员在没有做出创造性劳动前提下所获得的所有其他实施例，都属于本申请保护的范围。
图1为本申请实施例提供的同步播放多媒体数据的的过程，具体包括以下步骤：
S101：在由至少两个终端参与的会话中，发起方终端获取多媒体数据的资源标识。
本申请实施例中所述的终端，包括但不限于：智能手机、平板电脑、智能手表等移 动终端。不同的终端之间可以建立会话，如：单独会话或群组会话等，使用不同终端的用户可以通过所述会话互相发送即时通讯消息，进行交流。显然，会话的建立至少需要两个不同的终端，也即，参与到会话中的终端的数量至少也为两个。
其中，所述会话的实现，可以基于终端的操作系统中提供相应的会话服务，也可以基于安装在终端中的具有会话功能的应用提供会话服务。这里并不构成对本申请的限定。
当处在该会话中的某一用户想要共享某一多媒体数据，给该会话中的其他用户进行播放浏览时，那么，该用户所使用的终端将获取对应的多媒体数据的资源标识，并将该资源标识分发给该会话中的其他终端，以便后续进行同步播放。
其中，所述资源标识可以是统一资源定位符(Uniform Resource Locator，URL)。
S102，将所述资源标识发送给处于同一会话中所有的接收方终端。
资源标识反映了多媒体数据的存储位置，通过资源标识，各个终端就可以获取到该多媒体数据的实质内容。
S103，在根据所述资源标识获取到待播放的所述多媒体数据后，所述发起方终端向所述各接收方终端发送同步播放通知，使得参与该会话的所有终端对所述多媒体数据进行同步播放。
考虑到实际应用中，不同的接收方终端在获取多媒体数据时，可能有一定的时间差，如果接收方终端获取到多媒体数据后就立即开始进行播放，那么，就会造成不同接收方终端所播放的内容的进度有一定的时差，也就不能实现同步播放。因此，对于上述步骤S103而言，在根据所述资源标识获取到所述多媒体数据后，所述发起方终端向接收方终端发送同步播放通知，具体为：所述发起方终端在接收到接收方终端反馈的资源获取通知后，向该接收方终端发送同步播放通知。
其中，所述资源获取通知表示所述接收方终端已成功获取所述资源标识对应的多媒体数据。
这里需要说明的是，本申请中对于多媒体数据的同步播放，并不需要会话中所有的接收方终端全部参与同步播放，只要有一个接收方终端参与，就可以和发起方终端之间进行同步播放。也就是说，只有当至少一个接收方终端根据所述资源标识获取了相应的多媒体数据后，才会和发起方终端进行同步播放(没有接收方获取多媒体数据时，那么，发起方终端就处于等待状态)。所以，上述内容中，反馈资源获取通知的接收方终端，就是获取到所述多媒体数据的接收方终端(数量是至少一个)。这里需要延伸说明，若参与了同步播放的接收方终端并非是全部接收方终端，那么，在后续过程中，其他未参 与同步播放的接收方终端也可以随时加入到同步播放中，此时，新加入的接收方终端将根据当前的播放进度进行同步播放。
从而，可以认为，通过同步播放通知，使得不同的终端之间约定了一个统一的播放时间，也就可以消除因获取多媒体数据而生成的时间差，实现同步播放。
本申请实施例中的各接收方终端会根据接收到的资源标识去相应的存储位置中获取该多媒体数据，并只有在接收到了所述发起方终端发送的同步播放通知后，才会根据所述同步播放通知，对所述多媒体数据进行同步播放。
与现有技术不同的是，在现有技术中，当接收方终端接收到了多媒体数据的资源标识后，若用户想要观看浏览该资源标识对应的多媒体内容，通常，只能使用该终端中的播放器或者根据该资源标识访问相应的页面，进行单独观看。也就是说，对于该会话中的每一终端而言，该会话中其他终端播放进度和播放状态是无法获知的，也就是交互性较低。
而在本申请实施例中，发起方终端通过向该会话中的其他终端发起同步播放的方式，使得该会话中的所有终端均会同时播放该多媒体数据中的内容。
通过上述步骤，同一会话中的发起方终端会将获取到的多媒体数据所对应的资源标识，发送给处于该会话中的其他终端，并且，该发起方终端还会向各个接收方终端发送同步播放通知，以通知所有终端在同一时刻播放所述多媒体数据。从而，处于该会话中的所有终端针对该多媒体数据实现了同步播放，这样的方式改变了现有技术中，参与会话的各终端只能独自播放多媒体数据的缺陷，不仅有效地提升了针对多媒体数据播放的同步性，也提升了在对多媒体数据进行共享时的交互性，使得在共享多媒体数据时的交互更加便捷。
在本申请实施例中，对于所述发起方终端和接收方终端而言，在进行针对多媒体数据的同步播放的过程中，其播放状态可以发生变化，并且，还可以实现播放过程中的即时通讯，下面将对这些情况进行具体说明。
一、播放过程中的播放状态发生变化的场景
在本申请实施例中，发起方终端或接收方终端在对所述多媒体数据进行播放时，可以使用播放控件来播放所述多媒体数据，其中，所述播放控件可以加载在终端所显示的当前会话界面中。例如：如图2所示，发起方终端的当前会话界面的上半部分，加载了该播放控件，该播放控件中播放相应的多媒体数据(在图2中，当前播放控件处于暂停状态)，当然，在所述发起方终端中，所述的播放控件是可操作的。
也就是说，发起方终端可以在所述播放控件中进行控制操作，如：点击暂停，那么，其他接收方终端的播放控件中，也会暂停播放所述多媒体数据。显然，由于发起方终端接收了相应的控制操作，从而造成了同步播放过程中的播放状态发生了变化。
具体而言，对于本申请实施例中上述如图1所示的方法S101～S103而言，还包括：所述发起方终端接收针对所述播放控件的播放控制操作，根据所述播放控制操作，调节所述多媒体数据的播放状态，根据调节后的播放状态，生成调节信息，将所述调节信息分发给处于同一会话中的各接收方终端，使得各接收方终端根据所述调节信息，同步调节各自多媒体数据的播放状态。
其中，所述播放控制操作包括：播放操作、暂停操作、播放进度操作、停止操作中的至少一种。
需要说明的是，当所述播放控制操作包括播放进度操作时，根据所述播放控制操作，调节所述多媒体数据的播放状态，具体为：根据所述播放进度操作，调节所述多媒体数据的播放进度。在此基础上，根据调节后的播放状态，生成调节信息，具体为：确定调节后的播放进度对应的播放时间，根据所述播放时间生成所述进度调节信息。
可见，在该场景中，只有发起方终端有权对所述多媒体数据的播放进行控制调节，同一会话中的其他接收方终端只是根据发起方终端发送的控制信息，进行相应的控制调节，这样的方式可以避免会话中，不同终端均可对多媒体数据的播放进行控制调节而出现的混乱现象。
二、播放过程中出现播放卡顿的场景
在播放过程中，由于网络传输问题或多媒体数据本身的帧数据损坏，就会出现播放卡顿的现象。以发起方终端为例，若该发起方终端在播放多媒体数据的过程中出现了卡顿，而其他各个接收方终端的播放均正常，那么，该发起方终端的播放进度就与其他接收方终端的播放进度不一致，也就不能保证同步播放。
而考虑到实际应用中，发起方终端通过服务器实现与其他接收方终端的会话连接。在本申请实施例中，所述发起方终端向所述各接收方终端发送同步播放通知，具体为：所述发起方终端通过服务器向所述各接收方终端发送同步播放通知，而同步播放通知中包含有统一的播放起始时间。这样就表明了服务器已经获知参与了该会话的所有终端的统一播放起始时间。
因此，为了保证所有终端的播放均同步且不受卡顿现象的影响，在本申请实施例中，对于上述如图1所述的方法S101～S103，还包括：所述发起方终端监测到播放卡顿时， 向所述服务器发送卡顿修正请求，使得所述服务器根据所述卡顿修正请求，将当前播放时间对应的多媒体数据发送给所述发起方终端，所述发起方终端加载所述当前播放时间对应多媒体数据进行播放。
也即，出现了卡顿的终端可以向服务器获取到正常的播放进度(未卡顿的进度)，从而该终端会加载正常的播放进度，消除卡顿的影响。
三、播放过程中传输语音消息的场景
处在同一会话中的所有终端，即使在播放多媒体数据的过程中，各终端之间也可以实时进行即时通讯，如：语音消息通讯、文本消息通讯等方式。仍如图2所示，图2中的界面的下半部分就是即时通讯消息展示区，这就为使用不同终端的用户提供了即时通讯的功能。
对于该场景而言，在本申请实施例中，对于上述如图1所述的方法S101～S103，还包括：所述发起方终端接收在播放过程中输入的语音消息时，关闭当前播放的所述多媒体数据的音频，并记录输入的所述语音消息，将所述语音消息发送给处于同一会话中的各接收方终端，并重新开启当前播放的所述多媒体数据的音频。
显然，上述的过程是发起方终端发起语音消息的过程。在实际应用中，多媒体数据中均含有相应的音频数据，也就是说，在播放所述多媒体数据的过程中，会播放出相应的声音，那么，在这样的情况下，直接录入语音时，也会将多媒体数据的声音同时录入，这就会影响语音消息的清晰度。所以，在该场景下，在输入语音消息时，发起方终端会关闭多媒体数据的音频(静音)，那么，这可以保证录入的语音消息的清晰度。
而当发起方终端将该语音消息发送之后，就说明当前的输入过程已经结束，所以发起方终端会重新恢复音频的播放，使用户可以重新听到该多媒体数据的声音。
在该场景中的另一种方式下，是发起方终端接收其他接收方终端的语音消息的过程。为了保证在播放多媒体数据音频时，用户可以清楚地听到该语音消息，就需要调节当前多媒体数据的音频的音量。也就是说，在本申请实施例中，对于上述如图1所述的方法S101～S103，还包括：所述发起方终端接收所述接收方终端发送的语音消息，将当前播放的所述多媒体数据的音频的音量，降低至预设的音量阈值，并播放接收到的所述语音消息，当所述语音消息播放完毕后，重新恢复当前播放的所述多媒体数据的音频的音量。
四、播放过程中传输即时通讯消息的场景
在如图2所示的界面中，可见播放控件只显示在当前界面的上部，该界面的下部分用于显示即时通讯消息。而如果播放控件以全屏的方式显示，那么，为了保证各终端之 间可以正常的进行即时通讯，所以，在本申请实施例中，对于上述如图1所述的方法S101～S103，还包括：当所述播放控件进入全屏播放模式时，在当前的播放界面中设置会话展示区，所述发起方终端将自身发送的即时通讯消息，以及接收到的各接收方终端发送的即时通讯消息，按照各即时通讯消息的时间先后顺序，将所述即时通讯消息显示在所述会话展示区中。
具体而言，如图3所示，播放控件进入全屏播放模式，此时，在当前界面的左下方，显示有会话展示区，该会话展示区中，按照各即时通讯消息的时间顺序，由下至上的显示各即时通讯消息，也即，最新的即时通讯消息显示在该会话展示区的最下方，并随着其他最新消息的出现，该即时通讯消息将逐渐上移，最终移出该会话展示区。
当然，需要说明的是，所述会话展示区可以采用浮层、悬浮控件等方式展现，并且，为了保证用户的观看体验，所述会话展示去以及其中展示的即时通讯消息都设置为半透明，或者其他透明度。
上述内容是基于发起方终端，对于接收方终端而言，如图4所示，本申请实施例中还提供一种同步播放多媒体数据的方法，所述方法包括：
S401，在至少由两个终端参与的会话中，接收方终端接收所述发起方终端发送的多媒体数据的资源标识。
S402，根据所述资源标识获取到所述多媒体数据。
S403，接收所述发起方终端发送的同步播放通知。
S404，根据所述同步播放通知，播放所述多媒体数据。
通过上述方式，处在同一会话中的所有接收方终端，将根据发起方终端发送的多媒体数据的资源标识，获取对应的多媒体数据，并根据发起方终端发送的同步播放通知，与参与到该会话中的所有终端一并对所述多媒体数据进行同步播放。不仅有效地提升了针对多媒体数据播放的同步性，也提升了在对多媒体数据进行共享时的交互性，使得在共享多媒体数据时的交互更加便捷。
在本方法中，与上述发起方终端的场景相类似，具体地：
如图4所示的方法S401～S404，还包括：所述接收方终端根据所述资源标识获取到待播放的所述多媒体数据后，向所述发起方终端反馈资源获取通知；其中，所述资源获取通知表示所述接收方终端已成功获取所述资源标识对应的多媒体数据。
也即，各接收方终端在获取到了所述多媒体数据之后，均会向所述发起方终端反馈资源获取通知，以便所述发起方终端可以获知不同接收方终端的获取状态，从而进行同 步播放。
对于播放过程中的播放状态发生变化的场景，在所述发起方终端根据播放控制操作，调节所述多媒体数据的播放状态，并生成调节信息发送至所述接收方终端后，所述方法还包括：所述接收方终端接收所述发起方终端发送的调节信息，根据所述调节信息，同步调节各自多媒体数据的播放状态，其中，所述调节信息用以对所述多媒体数据进行播放、暂停、播放进度、停止中的至少一种播放状态进行调节。
对于播放过程中出现播放卡顿的场景，所述接收方终端通过服务器接收所述发起方终端发送的同步播放通知，所述方法还包括：所述接收方终端监测到播放卡顿时，向所述服务器发送卡顿修正请求，使得所述服务器根据所述卡顿修正请求，将当前播放时间对应的多媒体数据发送给所述接收方终端，所述接收方终端加载所述当前播放时间对应多媒体数据进行播放。
对于播放过程中传输语音消息的场景，所述方法还包括：所述接收方终端接收在播放过程中的语音输入操作时，关闭当前播放的所述多媒体数据的音频，并记录输入的语音消息，将所述语音消息发送给处于同一会话中的其他终端，并重新开启当前播放的所述多媒体数据的音频。
在该场景中的另一种方式下，所述方法还包括：所述接收方终端接收其他终端发送的语音消息，将当前播放的所述多媒体数据的音频的音量，降低至预设的音量阈值，并播放接收到的所述语音消息，当所述语音消息播放完毕后，重新恢复当前播放的所述多媒体数据的音频的音量。
对于播放过程中传输即时通讯消息的场景，所述接收方终端在当前显示的会话界面中，加载播放控件，对所述多媒体数据进行播放，所述方法还包括：当所述播放控件进入全屏播放模式时，在当前的播放界面中设置会话展示区，所述接收方终端将自身发送的即时通讯消息，以及接收到的所述发起方终端发送的即时通讯消息，按照各即时通讯消息的时间先后顺序，将所述即时通讯消息显示在所述会话展示区中。
上述内容是基于接收方终端，其中不同场景的具体内容与发送方终端相类似，故在此不再赘述。
在本申请实施例中，除了上述的发起方终端和接收方终端之外，服务器也参与了会话建立、多媒体数据播放的过程，因此，在本申请实施例中，如图5所示，还提供一种同步播放多媒体数据的方法，所述方法具体包括：
S501，在至少由两个终端参与的会话中，服务器接收发起方终端发送的资源标识。
S502，将所述资源标识分发给处于同一会话中所有的接收方终端。
S503，接收所述发起方终端发送的同步播放通知，并分发至所有的接收方终端，使得参与该会话的所有终端对所述多媒体数据进行同步播放。
从上述内容可见，所述服务器参与了会话中实现同步播放的过程。另外，需要说明的是，如图5所述的方法S501～S503，还包括：所述服务器监测在同步播放过程中各终端出现的卡顿。
具体地，所述服务器监测在同步播放过程中出现的卡顿，具体为：所述服务器记录各终端进行同步播放的起始播放进度，以及该起始播放进度对应的系统时间，向各终端发送进度查询请求，并接收各终端的反馈，在未接收到播放进度操作对应的调节信息的情况下，根据反馈的当前播放进度与起始播放进度之间的时间差，以及所述当前时刻对应的系统时间与起始播放进度对应的系统时间之间的时间差，对卡顿进行监测。
需要说明的是，同步播放的多媒体数据(如：视频)并不一定是从第一帧数据开始播放，例如：在实际应用中，播放控件有可能具有“跳过片头”等功能，这样一来，多媒体数据的起始播放进度就不再是从第一帧数据开始，所以，对于服务器而言，就需要记录同步播放时的起始播放进度。为了对播放进度进行计时，服务器还会记录该起始播放进度对应的系统时间。
在实际应用的场景下，服务器会定期向参与会话的所有终端发送进度查询请求，用以对各终端中的播放进度进行查询。
例如：多个终端参与的某一会话中，同步播放某视频，假设服务器记录的该视频的起始播放进度为“00:30”(也就是说，该视频从第30秒处开始播放)，并且，开始播放时的系统时间为“12:00:00”。服务器每隔20秒就会向各个终端发送进度查询请求。
假设服务器在“12:00:20”接收到某一终端反馈的播放进度，该当前播放进度为“00:48”，那么，对于该终端而言，当前播放进度与起始播放进度之间的时间差为18秒。但是，所述当前播放进度对应的系统时间与起始播放进度对应的系统时间之间的时间差却为20秒，这就表明该终端的播放进度卡顿了2秒，从而，服务器就可以确定出该终端卡顿了。
从上例可见，当反馈的当前播放进度与起始播放进度之间的时间差，和所述当前播放进度对应的系统时间与起始播放进度对应的系统时间之间的时间差不一致时，则认为该终端的播放出现了卡顿。
为了消除卡顿，在本申请实施例中的一种方式下，对于出现卡顿的情况，所述方法 还包括：当监测到终端出现卡顿后，所述服务器根据记录的同步播放进度，将当前时刻的同步播放进度反馈至出现卡顿的终端，使得出现卡顿的终端加载当前时刻的所述同步播放进度。
当然，上述内容是服务器主动监测各终端是否出现了卡顿，而在本申请实施例中的另一种方式下，终端自身会监测卡顿的发生，并在出现了卡顿后，向服务器发送卡顿修正请求，此时，服务器接收终端发送的卡顿修正请求，并根据记录的同步播放进度，将当前时刻的同步播放进度反馈至所述终端，使得所述终端加载当前时刻的所述同步播放进度。
以上内容是在未接收到播放进度操作对应的调节信息的情况下，服务器对卡顿的调节，而如果发起方终端对视频的播放状态进行了调节，那么，服务器会接收发起方终端发送的调节信息，根据所述调节信息，更新记录的所述同步播放进度。
其中，所述调节信息用以对所述多媒体数据进行播放、暂停、播放进度、停止中的至少一种播放状态进行调节。
此时，如果服务器接收到了终端发送卡顿修正请求时，那么，服务器会获取发起方终端当前的播放进度，将获取到的所述播放进度反馈给发送所述卡顿修正请求的接收方终端。也就是让所有终端的播放进度与发起方终端保持一致。
至此，本申请实施例中分别阐述了发起方终端、接收方终端以及服务器三者之间实现多媒体数据同步播放的具体过程和方式。考虑到实际应用中，发起方终端和接收方终端可能处于同一局域网环境中(并且，多媒体数据存储在发起方终端本地)，在这样的场景下，针对所述多媒体数据进行同步播放的过程将可以不依赖于服务器，而是发起方终端和接收方终端，在网络设备(如：无线路由器)的传输作用下，实现同步播放。
具体地，在已建立的会话中，发起方终端通过局域网络向各接收方终端发送通知消息，以通知各接收方终端获取该发起方终端本地存储的多媒体数据，在所述接收方终端获取到所述多媒体数据后，向所述接收方终端发送同步播放通知，使得参与该会话的所有终端对所述多媒体数据进行同步播放。
该场景下，由发起方终端对同步播放进行控制(包括：开始同步播放、同步播放过程中的暂停、播放、进度调节等)，发起方终端仍以调节信息的方式，发送至相应的接收方终端，使得接收方终端根据所述调节信息，对同步播放进行同步控制。
具体地，所述发起方终端在当前显示的会话界面中，加载可操作的播放控件，对所述多媒体数据进行播放，当所述发起方终端接收针对所述播放控件的播放控制操作时， 根据所述播放控制操作，调节所述多媒体数据的播放状态，根据调节后的播放状态，生成调节信息，并通过局域网络将所述调节信息分发给处于同一会话中的各接收方终端，使得各接收方终端根据所述调节信息，同步调节各自多媒体数据的播放状态。
其中，所述播放控制操作包括：播放操作、暂停操作、播放进度操作、停止操作中的至少一种。
类似地，在同步播放过程中，发起方终端和接收方终端均可以传输语音消息和即时通讯消息，具体过程与上述内容相类似，在此不再敖述。
另外，该场景下，由发送方终端进行卡顿监测及修复。具体地：
对于卡顿的监测而言，所述发起方终端记录同步播放的起始播放进度，以及该起始播放进度对应的系统时间，向接收方终端发送进度查询请求，并接收所述接收方终端的反馈，在未接收到播放进度操作的情况下，根据反馈的当前播放进度与起始播放进度之间的时间差，以及所述当前播放进度对应的系统时间与起始播放进度对应的系统时间之间的时间差，对卡顿进行监测。
对于卡顿的修复而言，当监测到接收方终端出现卡顿后，所述发起方终端根据记录的同步播放进度，将当前时刻的同步播放进度通过局域网络反馈至出现卡顿的接收方终端，使得出现卡顿的接收方终端加载当前时刻的同步播放进度。
如果发起方终端自身出现了卡顿，那么，该发起方终端通过局域网络，从所述接收方中获取当前时刻该接收方终端的同步播放进度，并加载当前时刻的同步播放进度。
通过上述内容可见，发起方终端和接收方终端之间进行同步播放的过程，不再依赖于服务器，均通过局域网络进行传输通讯并实现同步播放。
以上为本申请实施例提供的同步播放多媒体数据的方法，基于同样的思路，本申请实施例提供一种同步播放多媒体数据的装置，设置在发起方终端中，如图6所示。
在图6中，同步播放多媒体数据的装置包括：
获取模块601，用于获取多媒体数据的资源标识。
发送模块602，用于将所述资源标识发送给处于同一会话中所有的接收方终端。
同步通知模块603，用于在根据所述资源标识获取到所述多媒体数据后，向所述各接收方终端发送同步播放通知，使得参与该会话的所有终端对所述多媒体数据进行同步播放。
其中，所述资源标识包括：URL。
具体地，所述同步通知模块603，具体用于在接收到各接收方终端反馈的资源获取 通知后，向所述各接收方终端发送同步播放通知。
其中，所述资源获取通知表示所述接收方终端已成功获取所述资源标识对应的多媒体数据。
在播放过程中的播放状态发生变化的场景中，在所述发起方终端在当前显示的会话界面中，加载可操作的播放控件，对所述多媒体数据进行播放。在该场景下，所述装置还包括：播放控制模块604，用于所述发起方终端接收针对所述播放控件的播放控制操作，根据所述播放控制操作，调节所述多媒体数据的播放状态，根据调节后的播放状态，生成调节信息，将所述调节信息分发给处于同一会话中的各接收方终端，使得各接收方终端根据所述调节信息，同步调节各自多媒体数据的播放状态。
其中，所述播放控制操作包括：播放操作、暂停操作、播放进度操作、停止操作中的至少一种。
更为具体地，所述播放控制模块604，具体用于根据所述播放进度操作，调节所述多媒体数据的播放进度；以及用于确定调节后的播放进度对应的播放时间，根据所述播放时间生成所述进度调节信息。
在播放过程中出现播放卡顿的场景中，所述同步通知模块603，具体用于通过服务器向所述各接收方终端发送同步播放通知。该场景下，所述装置还包括：卡顿处理模块605，用于监测到播放卡顿时，向所述服务器发送卡顿修正请求，使得所述服务器根据所述卡顿修正请求，将当前播放时间对应的多媒体数据发送给所述发起方终端，所述发起方终端加载所述当前播放时间对应多媒体数据进行播放。
在播放过程中传输语音消息的场景中，所述装置还包括：语音消息模块606，用于接收在播放过程中输入的语音消息时，关闭当前播放的所述多媒体数据的音频，并记录输入的所述语音消息，将所述语音消息发送给处于同一会话中的各接收方终端，并重新开启当前播放的所述多媒体数据的音频。
在该场景的另一种方式下，所述语音消息模块606，还用于接收所述接收方终端发送的语音消息，将当前播放的所述多媒体数据的音频的音量，降低至预设的音量阈值，并播放接收到的所述语音消息，当所述语音消息播放完毕后，重新恢复当前播放的所述多媒体数据的音频的音量。
在播放过程中传输即时通讯消息的场景中，在所述发起方终端在当前显示的会话界面中，加载可操作的播放控件，对所述多媒体数据进行播放。该场景下，所述装置还包括：即时通讯消息模块607，用于当所述播放控件进入全屏播放模式时，在当前的播放 界面中设置会话展示区，所述发起方终端将自身发送的即时通讯消息，以及接收到的各接收方终端发送的即时通讯消息，按照各即时通讯消息的时间先后顺序，将所述即时通讯消息显示在所述会话展示区中。
本申请实施例还提供一种同步播放多媒体数据的装置，设置在接收方终端中，如图7所示，在图7中，所述装置包括：
接收模块701，用于用于在至少由两个终端参与的会话中，接收方终端接收所述发起方终端发送的多媒体数据的资源标识。
获取模块702，用于根据所述资源标识获取到待播放的所述多媒体数据。
通知接收模块703，用于接收所述发起方终端发送的同步播放通知。
同步播放模块704，用于根据所述同步播放通知，播放所述多媒体数据。
在本申请实施例中，所述获取模块702，还用于根据所述资源标识获取到待播放的所述多媒体数据后，向所述发起方终端反馈资源获取通知。
其中，所述资源获取通知表示所述接收方终端已成功获取所述资源标识对应的多媒体数据。
在播放过程中的播放状态发生变化的场景中，在所述发起方终端根据播放控制操作，调节所述多媒体数据的播放状态，并生成调节信息发送至所述接收方终端，所述装置还包括：播放控制模块705，用于所述接收方终端接收所述发起方终端发送的调节信息，根据所述调节信息，同步调节各自多媒体数据的播放状态。
其中，所述调节信息用以对所述多媒体数据进行播放、暂停、播放进度、停止中的至少一种播放状态进行调节。
在播放过程中出现播放卡顿的场景中，所述接收方终端通过服务器接收所述发起方终端发送的同步播放通知，所述装置还包括：卡顿处理模块706，用于监测到播放卡顿时，向所述服务器发送卡顿修正请求，使得所述服务器根据所述卡顿修正请求，将当前播放时间对应的多媒体数据发送给所述接收方终端，所述接收方终端加载所述当前播放时间对应多媒体数据进行播放。
在播放过程中传输语音消息的场景中，所述装置还包括：语音消息模块707，用于接收在播放过程中的语音输入操作时，关闭当前播放的所述多媒体数据的音频，并记录输入的语音消息，将所述语音消息发送给处于同一会话中的其他终端，并重新开启当前播放的所述多媒体数据的音频。
作为该场景中的一种方式，所述语音消息模块707，还用于接收其他终端发送的语 音消息，将当前播放的所述多媒体数据的音频的音量，降低至预设的音量阈值，并播放接收到的所述语音消息，当所述语音消息播放完毕后，重新恢复当前播放的所述多媒体数据的音频的音量。
在播放过程中传输即时通讯消息的场景中，所述装置还包括：即时通讯消息模块708，用于当所述播放控件进入全屏播放模式时，在当前的播放界面中设置会话展示区，将接收方终端自身发送的即时通讯消息，以及接收到的所述发起方终端发送的即时通讯消息，按照各即时通讯消息的时间先后顺序，将所述即时通讯消息显示在所述会话展示区中。
本申请实施例还提供一种同步播放多媒体数据的装置，设置在服务器中，如图8所示，所述装置包括：
接收模块801，用于在至少由两个终端参与的会话中，服务器接收发起方终端发送的资源标识。
分发模块802，用于将所述资源标识分发给处于同一会话中所有的接收方终端。
同步通知模块803，用于接收所述发起方终端发送的同步播放通知，并分发至所有的接收方终端，使得参与该会话的所有终端对所述多媒体数据进行同步播放。
所述装置还包括：监测模块804，用于监测在同步播放过程中各终端出现的卡顿。
所述监测模块804，具体用于记录各终端进行同步播放的起始播放进度，以及该起始播放进度对应的系统时间，向各终端发送进度查询请求，并接收各终端的反馈，在未接收到播放进度操作对应的调节信息的情况下，根据反馈的当前播放进度与起始播放进度之间的时间差，以及所述当前播放进度对应的系统时间与起始播放进度对应的系统时间之间的时间差，对卡顿进行监测。
所述装置还包括：卡顿修正模块805，用于当监测到终端出现卡顿后，根据记录的同步播放进度，将当前时刻的同步播放进度反馈至出现卡顿的终端，使得出现卡顿的终端加载当前时刻的所述同步播放进度。
在一个典型的配置中，计算设备包括一个或多个处理器(CPU)、输入/输出接口、网络接口和内存。
内存可能包括计算机可读介质中的非永久性存储器，随机存取存储器(RAM)和/或非易失性内存等形式，如只读存储器(ROM)或闪存(flash RAM)。内存是计算机可读介质的示例。
计算机可读介质包括永久性和非永久性、可移动和非可移动媒体可以由任何方法或技术来实现信息存储。信息可以是计算机可读指令、数据结构、程序的模块或其他数据。 计算机的存储介质的例子包括，但不限于相变内存(PRAM)、静态随机存取存储器(SRAM)、动态随机存取存储器(DRAM)、其他类型的随机存取存储器(RAM)、只读存储器(ROM)、电可擦除可编程只读存储器(EEPROM)、快闪记忆体或其他内存技术、只读光盘只读存储器(CD-ROM)、数字多功能光盘(DVD)或其他光学存储、磁盒式磁带，磁带磁磁盘存储或其他磁性存储设备或任何其他非传输介质，可用于存储可以被计算设备访问的信息。按照本文中的界定，计算机可读介质不包括暂存电脑可读媒体(transitory media)，如调制的数据信号和载波。
还需要说明的是，术语“包括”、“包含”或者其任何其他变体意在涵盖非排他性的包含，从而使得包括一系列要素的过程、方法、商品或者设备不仅包括那些要素，而且还包括没有明确列出的其他要素，或者是还包括为这种过程、方法、商品或者设备所固有的要素。在没有更多限制的情况下，由语句“包括一个……”限定的要素，并不排除在包括所述要素的过程、方法、商品或者设备中还存在另外的相同要素。
本领域技术人员应明白，本申请的实施例可提供为方法、系统或计算机程序产品。因此，本申请可采用完全硬件实施例、完全软件实施例或结合软件和硬件方面的实施例的形式。而且，本申请可采用在一个或多个其中包含有计算机可用程序代码的计算机可用存储介质(包括但不限于磁盘存储器、CD-ROM、光学存储器等)上实施的计算机程序产品的形式。
以上所述仅为本申请的实施例而已，并不用于限制本申请。对于本领域技术人员来说，本申请可以有各种更改和变化。凡在本申请的精神和原理之内所作的任何修改、等同替换、改进等，均应包含在本申请的权利要求范围之内。

Claims (40)

  1. 一种同步播放多媒体数据的方法，其特征在于，所述方法包括：
    在至少由两个终端参与的会话中，发起方终端获取多媒体数据的资源标识；
    将所述资源标识发送给处于同一会话中所有的接收方终端；
    在根据所述资源标识获取到所述多媒体数据后，所述发起方终端向所述各接收方终端发送同步播放通知，使得参与该会话的所有终端对所述多媒体数据进行同步播放。
  2. 如权利要求1所述的方法，其特征在于，在根据所述资源标识获取到所述多媒体数据后，所述发起方终端向所述各接收方终端发送同步播放通知，具体包括：
    所述发起方终端在接收到接收方终端反馈的资源获取通知后，向该接收方终端发送同步播放通知；其中，所述资源获取通知表示所述接收方终端已成功获取所述资源标识对应的多媒体数据。
  3. 如权利要求1所述的方法，其特征在于，所述发起方终端在当前显示的会话界面中，加载可操作的播放控件，对所述多媒体数据进行播放；
    所述方法还包括：
    所述发起方终端接收针对所述播放控件的播放控制操作；
    根据所述播放控制操作，调节所述多媒体数据的播放状态；
    根据调节后的播放状态，生成调节信息；
    将所述调节信息分发给处于同一会话中的各接收方终端，使得各接收方终端根据所述调节信息，同步调节各自多媒体数据的播放状态；
    其中，所述播放控制操作包括：播放操作、暂停操作、播放进度操作、停止操作中的至少一种。
  4. 如权利要求3所述的方法，其特征在于，当所述播放控制操作包括播放进度操作时，根据所述播放控制操作，调节所述多媒体数据的播放状态，具体包括：
    根据所述播放进度操作，调节所述多媒体数据的播放进度；
    根据调节后的播放状态，生成调节信息，具体包括：
    确定调节后的播放进度对应的播放时间；
    根据所述播放时间生成所述进度调节信息。
  5. 如权利要求1所述的方法，其特征在于，所述发起方终端向所述各接收方终端发送同步播放通知，具体包括：
    所述发起方终端通过服务器向所述各接收方终端发送同步播放通知。
  6. 如权利要求5所述的方法，其特征在于，所述方法还包括：
    所述发起方终端监测到播放卡顿时，向所述服务器发送卡顿修正请求，使得所述服务器根据所述卡顿修正请求，将当前播放时间对应的多媒体数据发送给所述发起方终端；
    所述发起方终端加载所述当前播放时间对应多媒体数据进行播放。
  7. 如权利要求1所述的方法，其特征在于，所述方法还包括：
    所述发起方终端接收在播放过程中输入的语音消息时，关闭当前播放的所述多媒体数据的音频，并记录输入的所述语音消息；
    将所述语音消息发送给处于同一会话中的各接收方终端，并重新开启当前播放的所述多媒体数据的音频。
  8. 如权利要求1所述的方法，其特征在于，所述方法还包括：
    所述发起方终端接收所述接收方终端发送的语音消息；
    将当前播放的所述多媒体数据的音频的音量，降低至预设的音量阈值，并播放接收到的所述语音消息；
    当所述语音消息播放完毕后，重新恢复当前播放的所述多媒体数据的音频的音量。
  9. 如权利要求1所述的方法，其特征在于，所述发起方终端在当前显示的会话界面中，加载可操作的播放控件，对所述多媒体数据进行播放；
    所述方法还包括：
    当所述播放控件进入全屏播放模式时，在当前的播放界面中设置会话展示区；
    所述发起方终端将自身发送的即时通讯消息，以及接收到的各接收方终端发送的即时通讯消息，按照各即时通讯消息的时间先后顺序，将所述即时通讯消息显示在所述会话展示区中。
  10. 一种同步播放多媒体数据的方法，其特征在于，所述方法包括：
    在至少由两个终端参与的会话中，接收方终端接收所述发起方终端发送的多媒体数据的资源标识；
    根据所述资源标识获取到待播放的所述多媒体数据；
    接收所述发起方终端发送的同步播放通知；
    根据所述同步播放通知，播放所述多媒体数据。
  11. 如权利要求10所述的方法，其特征在于，所述方法还包括：
    所述接收方终端根据所述资源标识获取到待播放的所述多媒体数据后，向所述发起 方终端反馈资源获取通知；其中，所述资源获取通知表示所述接收方终端已成功获取所述资源标识对应的多媒体数据。
  12. 如权利要求10所述的方法，其特征在于，在所述发起方终端根据播放控制操作，调节所述多媒体数据的播放状态，并生成调节信息发送至所述接收方终端后，所述方法还包括：
    所述接收方终端接收所述发起方终端发送的调节信息；
    根据所述调节信息，同步调节各自多媒体数据的播放状态；
    其中，所述调节信息用以对所述多媒体数据进行播放、暂停、播放进度、停止中的至少一种播放状态进行调节。
  13. 如权利要求10所述的方法，其特征在于，所述接收方终端通过服务器接收所述发起方终端发送的同步播放通知；
    所述方法还包括：
    所述接收方终端监测到播放卡顿时，向所述服务器发送卡顿修正请求，使得所述服务器根据所述卡顿修正请求，将当前播放时间对应的多媒体数据发送给所述接收方终端；
    所述接收方终端加载所述当前播放时间对应多媒体数据进行播放。
  14. 如权利要求10所述的方法，其特征在于，所述方法还包括：
    所述接收方终端接收在播放过程中的语音输入操作时，关闭当前播放的所述多媒体数据的音频，并记录输入的语音消息；
    将所述语音消息发送给处于同一会话中的其他终端，并重新开启当前播放的所述多媒体数据的音频。
  15. 如权利要求10所述的方法，其特征在于，所述方法还包括：
    所述接收方终端接收其他终端发送的语音消息；
    将当前播放的所述多媒体数据的音频的音量，降低至预设的音量阈值，并播放接收到的所述语音消息；
    当所述语音消息播放完毕后，重新恢复当前播放的所述多媒体数据的音频的音量。
  16. 如权利要求10所述的方法，其特征在于，所述接收方终端在当前显示的会话界面中，加载播放控件，对所述多媒体数据进行播放；
    所述方法还包括：
    当所述播放控件进入全屏播放模式时，在当前的播放界面中设置会话展示区；
    所述接收方终端将自身发送的即时通讯消息，以及接收到的所述发起方终端发送的即时通讯消息，按照各即时通讯消息的时间先后顺序，将所述即时通讯消息显示在所述会话展示区中。
  17. 一种同步播放多媒体数据的方法，其特征在于，所述方法包括：
    在至少由两个终端参与的会话中，服务器接收发起方终端发送的资源标识；
    将所述资源标识分发给处于同一会话中所有的接收方终端；
    接收所述发起方终端发送的同步播放通知，并分发至所有的接收方终端，使得参与该会话的所有终端对所述多媒体数据进行同步播放。
  18. 如权利要求17所述的方法，其特征在于，所述方法还包括：
    所述服务器监测在同步播放过程中各终端出现的卡顿。
  19. 如权利要求18所述的方法，其特征在于，所述服务器监测在同步播放过程中出现的卡顿，具体包括：
    所述服务器记录各终端进行同步播放的起始播放进度，以及该起始播放进度对应的系统时间；
    向各终端发送进度查询请求，并接收各终端的反馈；
    在未接收到播放进度操作对应的调节信息的情况下，根据反馈的当前播放进度与起始播放进度之间的时间差，以及所述当前播放进度对应的系统时间与起始播放进度对应的系统时间之间的时间差，对卡顿进行监测。
  20. 如权利要求18所述的方法，其特征在于，所述方法还包括：
    当监测到终端出现卡顿后，所述服务器根据记录的同步播放进度，将当前时刻的同步播放进度反馈至出现卡顿的终端，使得出现卡顿的终端加载当前时刻的同步播放进度。
  21. 一种同步播放多媒体数据的装置，其特征在于，所述装置包括：
    获取模块，用于获取多媒体数据的资源标识；
    发送模块，用于将所述资源标识发送给处于同一会话中所有的接收方终端；
    同步通知模块，用于在根据所述资源标识获取到所述多媒体数据后，向所述各接收方终端发送同步播放通知，使得参与该会话的所有终端对所述多媒体数据进行同步播放。
  22. 如权利要求21所述的装置，其特征在于，所述同步通知模块，具体用于在接收到接收方终端反馈的资源获取通知后，向该接收方终端发送同步播放通知；
    其中，所述资源获取通知表示所述接收方终端已成功获取所述资源标识对应的多媒体数据。
  23. 如权利要求21所述的装置，其特征在于，在所述发起方终端在当前显示的会话界面中，加载可操作的播放控件，对所述多媒体数据进行播放；
    所述装置还包括：播放控制模块，用于所述发起方终端接收针对所述播放控件的播放控制操作，根据所述播放控制操作，调节所述多媒体数据的播放状态，根据调节后的播放状态，生成调节信息，将所述调节信息分发给处于同一会话中的各接收方终端，使得各接收方终端根据所述调节信息，同步调节各自多媒体数据的播放状态；
    其中，所述播放控制操作包括：播放操作、暂停操作、播放进度操作、停止操作中的至少一种。
  24. 如权利要求23所述的装置，其特征在于，所述播放控制模块，具体用于根据所述播放进度操作，调节所述多媒体数据的播放进度；以及
    用于确定调节后的播放进度对应的播放时间，根据所述播放时间生成所述进度调节信息。
  25. 如权利要求21所述的装置，其特征在于，所述同步通知模块，具体用于通过服务器向所述各接收方终端发送同步播放通知。
  26. 如权利要求25所述的装置，其特征在于，所述装置还包括：卡顿处理模块，用于监测到播放卡顿时，向所述服务器发送卡顿修正请求，使得所述服务器根据所述卡顿修正请求，将当前播放时间对应的多媒体数据发送给所述发起方终端，所述发起方终端加载所述当前播放时间对应多媒体数据进行播放。
  27. 如权利要求21所述的装置，其特征在于，所述装置还包括：语音消息模块，用于接收在播放过程中输入的语音消息时，关闭当前播放的所述多媒体数据的音频，并记录输入的所述语音消息，将所述语音消息发送给处于同一会话中的各接收方终端，并重新开启当前播放的所述多媒体数据的音频。
  28. 如权利要求21所述的装置，其特征在于，所述语音消息模块，还用于接收所述接收方终端发送的语音消息，将当前播放的所述多媒体数据的音频的音量，降低至预设的音量阈值，并播放接收到的所述语音消息，当所述语音消息播放完毕后，重新恢复当前播放的所述多媒体数据的音频的音量。
  29. 如权利要求21所述的装置，其特征在于，在所述发起方终端在当前显示的会话界面中，加载可操作的播放控件，对所述多媒体数据进行播放；
    所述装置还包括：即时通讯消息模块，用于当所述播放控件进入全屏播放模式时，在当前的播放界面中设置会话展示区，所述发起方终端将自身发送的即时通讯消息，以及接收到的各接收方终端发送的即时通讯消息，按照各即时通讯消息的时间先后顺序，将所述即时通讯消息显示在所述会话展示区中。
  30. 一种同步播放多媒体数据的装置，其特征在于，所述装置包括：
    接收模块，用于在至少由两个终端参与的会话中，接收方终端接收所述发起方终端发送的多媒体数据的资源标识；
    获取模块，用于根据所述资源标识获取到待播放的所述多媒体数据；
    通知接收模块，用于接收所述发起方终端发送的同步播放通知；
    同步播放模块，用于根据所述同步播放通知，播放所述多媒体数据。
  31. 如权利要求30所述的装置，其特征在于，所述获取模块，还用于根据所述资源标识获取到待播放的所述多媒体数据后，向所述发起方终端反馈资源获取通知；
    其中，所述资源获取通知表示所述接收方终端已成功获取所述资源标识对应的多媒体数据。
  32. 如权利要求30所述的装置，其特征在于，在所述发起方终端根据播放控制操作，调节所述多媒体数据的播放状态，并生成调节信息发送至所述接收方终端，所述装置还包括：播放控制模块，用于所述接收方终端接收所述发起方终端发送的调节信息，根据所述调节信息，同步调节各自多媒体数据的播放状态；
    其中，所述调节信息用以对所述多媒体数据进行播放、暂停、播放进度、停止中的至少一种播放状态进行调节。
  33. 如权利要求30所述的装置，其特征在于，所述接收方终端通过服务器接收所述发起方终端发送的同步播放通知；所述装置还包括：卡顿处理模块，用于监测到播放卡顿时，向所述服务器发送卡顿修正请求，使得所述服务器根据所述卡顿修正请求，将当前播放时间对应的多媒体数据发送给所述接收方终端，所述接收方终端加载所述当前播放时间对应多媒体数据进行播放。
  34. 如权利要求30所述的装置，其特征在于，所述装置还包括：语音消息模块，用于接收在播放过程中的语音输入操作时，关闭当前播放的所述多媒体数据的音频，并记录输入的语音消息，将所述语音消息发送给处于同一会话中的其他终端，并重新开启当前播放的所述多媒体数据的音频。
  35. 如权利要求30所述的装置，其特征在于，所述语音消息模块，还用于接收其 他终端发送的语音消息，将当前播放的所述多媒体数据的音频的音量，降低至预设的音量阈值，并播放接收到的所述语音消息，当所述语音消息播放完毕后，重新恢复当前播放的所述多媒体数据的音频的音量。
  36. 如权利要求30所述的装置，其特征在于，所述装置还包括：即时通讯消息模块，用于当所述播放控件进入全屏播放模式时，在当前的播放界面中设置会话展示区，将接收方终端自身发送的即时通讯消息，以及接收到的所述发起方终端发送的即时通讯消息，按照各即时通讯消息的时间先后顺序，将所述即时通讯消息显示在所述会话展示区中。
  37. 一种同步播放多媒体数据的装置，其特征在于，所述装置包括：
    接收模块，用于在至少由两个终端参与的会话中，服务器接收发起方终端发送的资源标识；
    分发模块，用于将所述资源标识分发给处于同一会话中所有的接收方终端；
    同步通知模块，用于接收所述发起方终端发送的同步播放通知，并分发至所有的接收方终端，使得参与该会话的所有终端对所述多媒体数据进行同步播放。
  38. 如权利要求37所述的装置，其特征在于，所述装置还包括：监测模块，用于监测在同步播放过程中各终端出现的卡顿。
  39. 如权利要求38所述的装置，其特征在于，所述监测模块，具体用于记录各终端进行同步播放的起始播放进度，以及该起始播放进度对应的系统时间，向各终端发送进度查询请求，并接收各终端的反馈，在未接收到播放进度操作对应的调节信息的情况下，根据反馈的当前播放进度与起始播放进度之间的时间差，以及所述当前播放进度对应的系统时间与起始播放进度对应的系统时间之间的时间差，对卡顿进行监测。
  40. 如权利要求38所述的装置，其特征在于，所述装置还包括：卡顿修正模块，用于当监测到终端出现卡顿后，根据记录的同步播放进度，将当前时刻的同步播放进度反馈至出现卡顿的终端，使得出现卡顿的终端加载当前时刻的所述同步播放进度。
PCT/CN2016/084596 2015-06-11 2016-06-03 一种同步播放多媒体数据的方法及装置 Ceased WO2016197859A1 (zh)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
CN201510320742.7 2015-06-11
CN201510320742.7A CN106303648A (zh) 2015-06-11 2015-06-11 一种同步播放多媒体数据的方法及装置

Publications (1)

Publication Number Publication Date
WO2016197859A1 true WO2016197859A1 (zh) 2016-12-15

Family

ID=57502986

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/CN2016/084596 Ceased WO2016197859A1 (zh) 2015-06-11 2016-06-03 一种同步播放多媒体数据的方法及装置

Country Status (2)

Country Link
CN (1) CN106303648A (zh)
WO (1) WO2016197859A1 (zh)

Cited By (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN109379617A (zh) * 2018-09-18 2019-02-22 平安科技（深圳）有限公司 基于数据处理的多媒体文件同步播放方法、终端和介质
CN111585865A (zh) * 2019-02-18 2020-08-25 腾讯科技（深圳）有限公司 数据处理方法、装置、计算机可读存储介质和计算机设备
CN112801705A (zh) * 2021-02-04 2021-05-14 西安万像电子科技有限公司 信息的投放方法、装置、存储介质和处理器
CN112887769A (zh) * 2021-01-21 2021-06-01 海信视像科技股份有限公司 一种显示设备
CN113965784A (zh) * 2020-07-20 2022-01-21 云米互联科技(广东)有限公司 电视节目播放方法、显示设备、电视及存储介质
CN119883655A (zh) * 2025-03-26 2025-04-25 太仓中科信息技术研究院 高效协同的多媒体设备智能管理方法及系统

Families Citing this family (23)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US8502856B2 (en) 2010-04-07 2013-08-06 Apple Inc. In conference display adjustments
US10372298B2 (en) * 2017-09-29 2019-08-06 Apple Inc. User interface for multi-user communication session
DK180130B1 (da) 2018-05-07 2020-06-02 Apple Inc. Multi-participant live communication user interface
CN110719515B (zh) * 2018-07-12 2022-06-14 阿里巴巴（中国）有限公司 视频播放方法、装置及存储介质
US11128792B2 (en) 2018-09-28 2021-09-21 Apple Inc. Capturing and displaying images with multiple focal planes
CN110719516A (zh) * 2019-10-21 2020-01-21 北京字节跳动网络技术有限公司 视频同步的方法及装置、终端和存储介质
CN111107412A (zh) * 2019-12-30 2020-05-05 北京奇艺世纪科技有限公司 媒体播放进度同步方法、装置及存储介质
CN111327928A (zh) * 2020-03-11 2020-06-23 广州酷狗计算机科技有限公司 歌曲播放方法、装置及系统、计算机存储介质
US11079913B1 (en) 2020-05-11 2021-08-03 Apple Inc. User interface for status indicators
US11431891B2 (en) 2021-01-31 2022-08-30 Apple Inc. User interfaces for wide angle video conference
US12301979B2 (en) 2021-01-31 2025-05-13 Apple Inc. User interfaces for wide angle video conference
US12170579B2 (en) 2021-03-05 2024-12-17 Apple Inc. User interfaces for multi-participant live communication
US11907605B2 (en) 2021-05-15 2024-02-20 Apple Inc. Shared-content session user interfaces
CN120881039A (zh) 2021-05-15 2025-10-31 苹果公司 实时通信用户界面
US11893214B2 (en) 2021-05-15 2024-02-06 Apple Inc. Real-time communication user interface
US11822761B2 (en) 2021-05-15 2023-11-21 Apple Inc. Shared-content session user interfaces
US12449961B2 (en) 2021-05-18 2025-10-21 Apple Inc. Adaptive video conference user interfaces
CN113873309A (zh) * 2021-07-30 2021-12-31 北京达佳互联信息技术有限公司 一种对象播放方法、装置、电子设备及存储介质
US11770600B2 (en) 2021-09-24 2023-09-26 Apple Inc. Wide angle video conference
US12368946B2 (en) 2021-09-24 2025-07-22 Apple Inc. Wide angle video conference
US12267622B2 (en) 2021-09-24 2025-04-01 Apple Inc. Wide angle video conference
US12563299B2 (en) 2022-04-04 2026-02-24 Apple Inc. User interfaces for camera sharing
US12578837B2 (en) 2022-09-23 2026-03-17 Apple Inc. User interfaces for managing sharing of content in three-dimensional environments

Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101622610A (zh) * 2007-02-22 2010-01-06 雅虎公司 协作环境中媒体内容的同步传递
US20130124664A1 (en) * 2011-11-16 2013-05-16 Motorola Mobility, Inc Coordinating media presentations among peer devices
CN103796061A (zh) * 2014-03-03 2014-05-14 上海美琦浦悦通讯科技有限公司 多智能终端中实现媒体文件同步播放和控制的系统及方法
CN104426744A (zh) * 2013-08-30 2015-03-18 中兴通讯股份有限公司 多媒体内容的同步播放方法、服务器、客户端及系统
CN104602133A (zh) * 2014-11-21 2015-05-06 腾讯科技（北京）有限公司 多媒体文件共享方法和终端及服务器
CN104683854A (zh) * 2015-02-13 2015-06-03 广东欧珀移动通信有限公司 一种多媒体播放控制方法及装置

Family Cites Families (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN100596195C (zh) * 2006-03-30 2010-03-24 华为技术有限公司 一种控制流媒体播放的方法及装置
CN102970589B (zh) * 2012-11-26 2016-03-30 中国联合网络通信集团有限公司 多终端协同播放媒体流的控制方法及装置
CN103220301B (zh) * 2013-04-28 2016-04-27 青岛海信移动通信技术股份有限公司 一种媒体播放控制方法及其装置
CN103389890B (zh) * 2013-07-19 2015-12-09 西安诺瓦电子科技有限公司 播放控制装置、多显示终端同步播放控制系统及方法
CN103905879B (zh) * 2014-03-13 2018-07-06 北京奇艺世纪科技有限公司 一种视频数据和音频数据同步播放的方法、装置和设备
CN104581366A (zh) * 2014-12-30 2015-04-29 北京奇艺世纪科技有限公司 一种互联网电视播放方法和服务器
KR101520788B1 (ko) * 2015-01-26 2015-05-18 주식회사 비즈모델라인 동영상 동기화 재생 방법

Patent Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101622610A (zh) * 2007-02-22 2010-01-06 雅虎公司 协作环境中媒体内容的同步传递
US20130124664A1 (en) * 2011-11-16 2013-05-16 Motorola Mobility, Inc Coordinating media presentations among peer devices
CN104426744A (zh) * 2013-08-30 2015-03-18 中兴通讯股份有限公司 多媒体内容的同步播放方法、服务器、客户端及系统
CN103796061A (zh) * 2014-03-03 2014-05-14 上海美琦浦悦通讯科技有限公司 多智能终端中实现媒体文件同步播放和控制的系统及方法
CN104602133A (zh) * 2014-11-21 2015-05-06 腾讯科技（北京）有限公司 多媒体文件共享方法和终端及服务器
CN104683854A (zh) * 2015-02-13 2015-06-03 广东欧珀移动通信有限公司 一种多媒体播放控制方法及装置

Cited By (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN109379617A (zh) * 2018-09-18 2019-02-22 平安科技（深圳）有限公司 基于数据处理的多媒体文件同步播放方法、终端和介质
CN111585865A (zh) * 2019-02-18 2020-08-25 腾讯科技（深圳）有限公司 数据处理方法、装置、计算机可读存储介质和计算机设备
CN113965784A (zh) * 2020-07-20 2022-01-21 云米互联科技(广东)有限公司 电视节目播放方法、显示设备、电视及存储介质
CN112887769A (zh) * 2021-01-21 2021-06-01 海信视像科技股份有限公司 一种显示设备
CN112887769B (zh) * 2021-01-21 2023-09-19 青岛海信传媒网络技术有限公司 一种显示设备
CN112801705A (zh) * 2021-02-04 2021-05-14 西安万像电子科技有限公司 信息的投放方法、装置、存储介质和处理器
CN119883655A (zh) * 2025-03-26 2025-04-25 太仓中科信息技术研究院 高效协同的多媒体设备智能管理方法及系统

Also Published As

Publication number Publication date
CN106303648A (zh) 2017-01-04

Similar Documents

Publication Publication Date Title
WO2016197859A1 (zh) 一种同步播放多媒体数据的方法及装置
US9131256B2 (en) Method and apparatus for synchronizing content playback
US10455291B2 (en) Live video stream sharing
US11316909B2 (en) Data transmission method and apparatus, and computer storage medium
US8737804B2 (en) System for delayed video viewing
WO2016050080A1 (zh) 一种多人观看视频实时互动的方法及系统
US12137133B2 (en) Synchronization of streaming content using live edge offsets
US10021199B2 (en) Apparatus and method for providing streaming music service
WO2015180446A1 (zh) 一种多设备联动服务中的连接通道维护系统及方法
WO2014036960A1 (zh) 一种自动发布信息的方法和移动终端
CN100426299C (zh) 信息处理设备和信息处理方法
CN101351990B (zh) 实现定位播放的对等网络内容传输方法及装置
WO2017071356A1 (zh) 一种基于客户端的网络数据同步的方法、装置以及系统
US11089352B1 (en) Techniques for synchronizing content playback across devices
US12052554B2 (en) Audio synchronization using bluetooth low energy
WO2017016266A1 (zh) 一种实现同步播放的方法和装置
US9374613B2 (en) Media content flicking systems and methods
JP5262675B2 (ja) 映像配信システムおよびユニキャスト型多地点映像配信方法
CN104683854A (zh) 一种多媒体播放控制方法及装置
US12137130B2 (en) Broadcast message-based conference audio synchronization
CN111447480A (zh) 同步播放控制方法及系统
EP3238471A1 (en) A method for controlling the sharing of at least one electronic content between a first user equipment and at least a second user equipment
JP2013066045A (ja) 情報処理システム、情報処理装置及び情報処理プログラム
JP2018530944A (ja) 異種ネットワーキング環境におけるメディアレンダリングの同期化
US12495086B2 (en) Audio synchronization using broadcast messages

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 16806757

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 16806757

Country of ref document: EP

Kind code of ref document: A1