KR20200110459A - Methods, systems and media for adjusting the quality level during synchronized media content playback on multiple devices - Google Patents

Abstract

Methods, systems and media are provided for adjusting a quality level during a synchronized media content presentation. In some embodiments, the method includes transmitting, from the server to a first user device, first media content data corresponding to a first stream of media content items, and from the server to a second user device, the second media content item. Transmitting second media content data corresponding to the stream, wherein the first media content data is stored in a buffer of a first user device, and the second media content data is stored in a buffer of a second user device; Sending instructions from the server to the first user device and the second user device to cause the first user device and the second user device to start presenting the media content item simultaneously; Determining, by the server, that the first media content data is being stored in the buffer of the first user device at a slower rate than the second media content data is being stored in the buffer of the second user device; In response to determining that the first media content data is being stored in the buffer of the first user device at a slower rate than the second media content data is being stored in the buffer of the second user device, the first stream of media content items Selecting a third stream of corresponding media content items, the third stream of media content items having a lower quality level than the first stream of media content items; And transmitting third media content data corresponding to the third stream of the media content item to the first user device.

Description

Methods, systems and media for adjusting the quality level during synchronized media content playback on multiple devices

The disclosed subject matter relates to methods, systems and media for adjusting a quality level during synchronized media content playback on multiple devices.

People often watch media content, such as videos downloaded or streamed from a server, such as a server associated with a video sharing service. Also, people may want to watch media content simultaneously with other people, such as friends, but on separate devices. However, synchronizing the playback of media content across multiple devices can be difficult. For example, multiple devices may each buffer media content before and during playback of a media content item, but each device may buffer media content at a different rate. In some cases, this may cause devices that buffer media content slower than other devices to have to pause playback to buffer additional media content before resuming playback, which causes devices to synchronize during playback. Can make you miss

Accordingly, it is desirable to provide novel methods, systems and media for adjusting the quality level during synchronized media content playback on multiple devices.

Methods, systems and media are provided for adjusting the quality level during synchronized media content playback on multiple devices.

According to some embodiments of the disclosed subject matter, a method for synchronizing playback of media content is provided, the method comprising transmitting, from a server to a first user device, first media content data corresponding to a first stream of media content items. And transmitting second media content data corresponding to the second stream of the media content item from the server to the second user device-the first media content data is stored in the buffer of the first user device, and the second media content The data is stored in the buffer of the second user device; Sending instructions from the server to the first user device and the second user device to cause the first user device and the second user device to start presenting the media content item simultaneously; Determining, by the server, that the first media content data is being stored in the buffer of the first user device at a slower rate than the second media content data is being stored in the buffer of the second user device; In response to determining that the first media content data is being stored in the buffer of the first user device at a slower rate than the second media content data is being stored in the buffer of the second user device, the first stream of media content items Selecting a third stream of corresponding media content items, the third stream of media content items having a lower quality level than the first stream of media content items; And transmitting third media content data corresponding to the third stream of the media content item to the first user device.

In some embodiments, the instructions for causing the first user device and the second user device to start presenting the media content item simultaneously include a predetermined amount of media corresponding to the media content item by the first user device and the second user device. Based on the determination that the content data has been buffered.

In some embodiments, determining that the first media content data is being stored in the buffer of the first user device at a slower rate than the second media content data is being stored in the buffer of the second user device comprises: Based on messages received by the server from the device.

In some embodiments, the message indicates the current amount of first media content data stored in the buffer of the first user device at the time the message is transmitted by the first user device to the server.

In some embodiments, determining that the first media content data is being stored in the buffer of the first user device at a slower rate than the second media content data is being stored in the buffer of the second user device comprises: It is based on a comparison of the amount of first media content data stored in the buffer of the device and the amount of second media content data stored in the buffer of the second user device.

In some embodiments, the third stream of media content items has a lower bit rate than the first stream of media content items.

According to some embodiments of the disclosed subject matter, a system for synchronizing playback of media content is provided, the system comprising a memory and a hardware processor, the hardware processor being provided from a server when executing computer executable instructions stored in the memory. 1 transmits first media content data corresponding to a first stream of media content items to a user device, and transmits second media content data corresponding to a second stream of media content items from a server to a second user device, and -The first media content data is stored in the buffer of the first user device, and the second media content data is stored in the buffer of the second user device -; Send instructions from the server to the first user device and the second user device to cause the first user device and the second user device to simultaneously start presenting the media content item; Determine, by the server, that the first media content data is being stored in the buffer of the first user device at a slower rate than the second media content data is being stored in the buffer of the second user device; In response to determining that the first media content data is being stored in the buffer of the first user device at a slower rate than the second media content data is being stored in the buffer of the second user device, the first stream of media content items Selecting a third stream of the corresponding media content item, the third stream of media content items having a lower quality level than the first stream of media content items; And third media content data corresponding to the third stream of media content items to the first user device. Another embodiment of the disclosed subject matter provides a system for synchronizing playback of media content, the system comprising a memory and a hardware processor, the hardware processor, when executing computer-executable instructions stored in the memory, as described herein. Configured to perform a method according to any aspect or embodiment.

According to some embodiments of the disclosed subject matter, there is provided a non-transitory computer-readable medium comprising computer-executable instructions that, when executed by a processor, cause a processor to perform a method for synchronizing playback of media content, the method comprising: Transmitting first media content data corresponding to a first stream of media content items from a server to a first user device, and second media content data corresponding to a second stream of media content items from the server to a second user device Transmitting,-the first media content data is stored in a buffer of the first user device, and the second media content data is stored in a buffer of the second user device; Sending instructions from the server to the first user device and the second user device to cause the first user device and the second user device to start presenting the media content item simultaneously; Determining, by the server, that the first media content data is being stored in the buffer of the first user device at a slower rate than the second media content data is being stored in the buffer of the second user device; In response to determining that the first media content data is being stored in the buffer of the first user device at a slower rate than the second media content data is being stored in the buffer of the second user device, the first stream of media content items Selecting a third stream of corresponding media content items, the third stream of media content items having a lower quality level than the first stream of media content items; And transmitting third media content data corresponding to the third stream of the media content item to the first user device. Another embodiment of the disclosed subject matter includes computer-executable instructions (which may be a temporary or non-transitory medium) that, when executed by a processor, cause the processor to perform a method according to any aspect or embodiment described herein. ) Provide computer-readable media.

According to some embodiments of the disclosed subject matter, a system for synchronizing playback of media content is provided, the system transmitting, from a server to a first user device, first media content data corresponding to a first stream of media content items. And means for transmitting second media content data corresponding to a second stream of media content items from the server to a second user device, wherein the first media content data is stored in a buffer of the first user device, and the second media The content data is stored in the buffer of the second user device; Means for transmitting instructions from the server to the first user device and the second user device, causing the first user device and the second user device to start simultaneously presenting the media content item; Means for determining, by the server, that the first media content data is being stored in the buffer of the first user device at a slower rate than the second media content data is being stored in the buffer of the second user device; Responding to the first stream of media content items in response to a determination that the first media content data is being stored in the buffer of the first user device at a slower rate than the second media content data is being stored in the buffer of the second user device Means for selecting a third stream of media content items, the third stream of media content items having a lower quality level than the first stream of media content items; And means for transmitting to the first user device third media content data corresponding to the third stream of media content items.

The various objects, features, and advantages of the disclosed subject matter may be more fully appreciated with reference to the following detailed description of the disclosed subject matter when similar reference numbers are considered in connection with the following figures to identify similar elements.
1 shows an example of an information flow diagram for synchronized media content playback on multiple devices in accordance with some embodiments of the disclosed subject matter.
2 illustrates an example of a process for adjusting a quality level during synchronized media content playback on multiple devices in accordance with some embodiments of the disclosed subject matter.
3 shows a schematic diagram of an exemplary system suitable for implementation of the mechanisms described herein for adjusting the quality level during synchronized media content playback on multiple devices in accordance with some embodiments of the disclosed subject matter.
4 shows a detailed example of hardware that may be used in the server and/or user device of FIG. 3 in accordance with some embodiments of the disclosed subject matter.

In accordance with various embodiments, mechanisms (which may include methods, systems and media) are provided for adjusting the quality level during synchronized media content playback on multiple devices.

In some embodiments, the mechanisms described herein may synchronize playback of media content items across multiple user devices. For example, in some embodiments, mechanisms allow media content items to be presented simultaneously to multiple user devices such that each user device is at the same playback location of the media content item at the same time, allowing each of the user devices to “synchronize” the media content item. Presentation can be made. In some embodiments, the mechanisms may allow a synchronized presentation of the media content item to be maintained while streaming the media content item to each of the user devices. For example, in some embodiments, the mechanisms may include synchronization of a media content item when one of a plurality of user devices buffers media content data corresponding to the streamed media content item at a slower rate than other user devices. The presentation can be maintained across user devices. As a more specific example, in some embodiments, mechanisms may cause a user device that buffers media content data at a slower rate to present a media content item at a lower quality level. As another example, in some embodiments, the mechanisms may allow a synchronized presentation of a media content item to a user device when one of a plurality of user devices pauses playback of the media content item to buffer additional media content data. It can be maintained across devices. As a more specific example, in some embodiments, the mechanisms cause the user device to trigger the playback at an increased playback rate (i.e., once additional media content data is If it is buffered), you can have it resume.

It should be noted that, in some embodiments, the mechanisms described herein may synchronize playback of a media content item presented in a synchronized media playback session across multiple user devices. In some embodiments, a media playback session synchronized across multiple user devices may include any suitable features or combinations of features. For example, in some embodiments, a synchronized media playback session may enable each user device of multiple user devices to simultaneously present a particular item of media content, as described above. As another example, in some embodiments, a synchronized media playback session may contain a series of media content items (e.g., a playlist of media content items and/or any other suitable collection of media content items) on multiple user devices. Can be presented to each user device at the same time. As another example, in some embodiments, the synchronized media playback session may enable a user device participating in the synchronized media playback session to select a video, pause the video, and/or switch to another video, and In addition, it is possible to cause the action performed by the user device to be mirrored to other user devices participating in the session without the need for the user device to send commands individually to each other user device.

In some embodiments, the mechanisms described herein include streams transmitted to one or more user devices of multiple user devices participating in a synchronized media playback session to ensure that all devices in the session maintain a synchronized viewing experience. You can adjust the quality. In particular, in some embodiments, the server that transmits streams of media content corresponding to the media content item synchronously presented to each of the user devices participating in the session may adjust the rate at which each user device buffers the stream or the respective rates. You can decide. In some embodiments, the server may then adjust the quality of the stream for the user device of the user devices based on the buffering rate for the user device. For example, in some embodiments, in response to a determination that the user device is buffering the stream more slowly than other user devices participating in the synchronized media playback session, the server may transmit a lower quality stream, thereby This allows the user device to fill the buffer of the user device at the same rate as other user devices in the session. In some embodiments, the mechanisms described herein may additionally or alternatively adjust the playback speed at the user device of multiple user devices to enable the user device to catch up or slow down other user devices. As such, any other suitable techniques for maintaining synchronization of playback of media content across multiple user devices may be used.

By adjusting the quality of the stream of media content based on both the quality of the network connection between the server and the first user device as well as the quality of network connections between other user devices participating in the media playback session synchronized with the server, the present specification The mechanisms described are to keep all user devices in the session synchronized during the session (or that synchronization can be quickly reset) and to avoid having user devices pause playback to buffer additional data. It can be used to ensure both. Specifically, by adjusting the quality of the stream of media content (e.g., by lowering the quality level in response to a determination that the network connection between the server and the user device is poor), mechanisms allow the user device to provide a certain amount of media content data in a buffer. And/or fill the buffer quickly to have a certain amount of media content data. In addition, the mechanisms described herein prevent the user device from pausing playback to buffer additional media content data, particularly when viewing streamed media content in a synchronized media playback session, thereby preventing streamed media content from being played. It can be used to improve the user's experience while viewing.

In typical video streaming, a content server that provides streamed video provides rate control so that the streamed video is delivered to the user device at a rate and quality that the user device can handle. To make this possible, the user device can determine how quickly the user device can decode and process the received video, the bandwidth and/or latency of the network from which the video is being streamed to the user device, and the quality of the received video. Information on parameters can be provided to the content server. The content server may adjust the rate of video delivery to the client device based on information received from the client device. Aspects of the present disclosure provide coordinated rate control while streaming an item of video content to multiple client devices. The rate control is "adjusted" in that the rate at which streaming to one particular user device is determined based on information supplied to the content server by that particular user device as well as by at least one other user device. This can provide improved video delivery to multiple user devices. In most cases, servers that provide content for delivery to multiple user devices (known as “co-watching”) will use a third-party streaming platform, and the rate at which the content is streamed to multiple user devices (or Individual speeds). Moreover, although conventional rate control techniques may be applied to streaming content to multiple user devices, these techniques will apply independent rate control to each client device. This may cause user devices to have to pause playback to buffer again, suffer additional synchronization delays, and/or experience a lower video quality than may be provided.

Also, as noted above, in some embodiments, the synchronized media playback session allows user devices participating in the synchronized media playback session to select a video, pause the video, and/or switch to another video. And allows actions performed by the user device to be mirrored to other user devices participating in the session. This can be achieved without the need for the user device to communicate with each other user device individually-when notifying the content server that a particular user device has selected a video, paused the video, and/or has switched to another video. The content server can control the delivery of streamed content to all other user devices in the same way.

1, an example 100 of an information flow diagram for initiating a synchronized media playback session and presenting synchronized media content on multiple devices in accordance with some embodiments of the disclosed subject matter is shown. As illustrated, in some embodiments, the blocks of process 100 may be performed at a first user device, a second user device, and a server. Although the information flow diagram shown in FIG. 1 and described below generally describes a synchronized presentation of a video, in some embodiments, the techniques described below can be used with any suitable type of media content (e.g., video, movie). , Television programs, live streaming video content, live streaming audio content, music, audiobooks, and/or any other suitable type of media content). It is noted that although the information flow diagram shown in FIG. 1 includes a first user device and a second user device, this is merely exemplary. Any suitable number of user devices may participate in a synchronized media playback session.

At 102, the first user device may request a video to be presented in a synchronized playback session from the server. In some embodiments, the request may be initiated at the first user device in any suitable manner. For example, in some embodiments, the request is in response to a user of a first user device selecting a link to a particular media content item, such that the user of the first user device is directed to other user devices (e.g., a second User device) in response to selecting a link to initiate a synchronized media playback session of a particular media content item, and/or in any other suitable manner. It is noted that in some embodiments, the link to the synchronized media playback session may be created by any suitable user device and shared with other user devices in any suitable manner. For example, in some embodiments, a link to a synchronized media playback session is shared via message (e.g., instant message, text message, email, push notification, and/or any other suitable manner). Can be. As another example, in some embodiments, a synchronized media playback session in which the video content item is played may be created at a first user device, wherein a list of user accounts associated with other user devices is joined to the synchronized media playback session. Included when permitted.

Similarly, at 104, the second user device may request that the video be presented in a synchronized playback session from the server and/or may request to join a synchronized media playback session. Similar to as described above with respect to block 102, in some embodiments, the second user device may synchronize and/or join a synchronized media playback session through selection of a link and/or in any other suitable manner. May request to initiate a media playback session. For example, the second user device may accept the request and join a synchronized playback session in which the video content item is played. In another example, the second user device can launch the application and select a playback session from a list of playback sessions in which video content items are being played.

It is noted that, in some embodiments, a synchronized media playback session may be initiated between a first user device and a second user device (and/or any other suitable user devices) that do not yet contain video. In some such embodiments, the first user device and/or the second user device may select the video and/or series of videos for presentation in any suitable manner during the synchronized media playback session. For example, in some embodiments, a user device may select a particular video from a group of available videos. As another example, in some embodiments, a user device may create a playlist of videos by selecting videos from a group of available videos and/or arranging the videos in an order to be presented during a synchronized media playback session.

At 106, the server may start transmitting video data corresponding to the requested video to the first user device and the second user device. In some embodiments, the server may transmit the video data to the first user device and the second user device in any suitable manner. For example, in some embodiments, video data may be transmitted over a communication network as shown and described below with respect to FIG. 3.

At 108, the first user device may store the received video data in a buffer of the first user device. Similarly, at 110, the second user device may store the received video data in a buffer of the second user device.

At 112, the first user device may determine whether a predetermined amount of video data has been buffered. In some embodiments, the predetermined amount of video data may be any suitable amount of data. For example, in some embodiments, a predetermined amount of video data is a specific kilobyte number of data, a specific duration of the video (e.g., 5 seconds, 10 seconds, 30 seconds, 2 minutes, and/or any Different duration) and/or any other suitable amount of video data. Similarly, at 114, the second user device can determine whether a predetermined amount of video data has been buffered in the second user device. It is noted that in some embodiments, the first user device and the second user device may each determine whether a predetermined equal amount of video data has been buffered in each device.

If, at 112, the first user device determines that the predetermined amount of video data has not been buffered (“No” at 112), the first user device may loop back to 108 and send the received video data. It can be continuously stored in the buffer of the first user device. Similarly, if, at 114, the second user device determines that a predetermined amount of video data has not been buffered (“No” at 114), the second user device may loop back to 110 and receive The video data may be continuously stored in the buffer of the second user device.

If, at 112, the first user device determines that a predetermined amount of video data has been buffered by the first user device (“Yes” at 112), the first user device may proceed to 116 and the first 1 A message indicating that the user device has buffered a predetermined amount of video may be transmitted to the server. Similarly, at 114, if the second user device determines that a predetermined amount of video has been buffered by the second user device (“Yes” at 114), the second user device may proceed to 118. And a message indicating that the second user device has buffered a predetermined amount of video may be transmitted to the server. It is noted that in some embodiments, any suitable information may be included in messages sent by the first user device and the second user device, as described in more detail below with respect to FIG. 2.

At 120, the server has determined that all user devices (e.g., the first user device and the second user device in the example shown in FIG. 1) included in the synchronized media playback session have buffered a predetermined amount of video data. Can be determined. For example, in some embodiments, the server may determine whether a message indicating that a predetermined amount of video data has been buffered has been received from all user devices included in the synchronized media playback session.

If at (120) the server determines that the device included in the synchronized playback session has not yet buffered a predetermined amount of video data ("No" at (120)), then at (122) the server sends a predetermined amount of video data. Responses can be sent to any user device that has sent messages indicating that it has buffered. In particular, the server may transmit a response instructing user devices that have buffered a predetermined amount of video data to wait to start playing the video.

In this case, in response to receiving a response from the server to wait to start playing the video, the user device may send a message back to the server after any suitable delay indicating that a predetermined amount of video data has been buffered. For example, in some embodiments, the user device may send the message to the server at any suitable frequency (eg, once per second, twice per second, and/or any other suitable frequency). As a more specific example, in response to receiving a response from the server to wait for playback to begin, the first user device may loop back to block 116. As another more specific example, in response to receiving a response from the server to wait for playback to begin, the second user device may loop back to block 118. For example, in response to receiving an instruction from the server to wait for the video to start playing, the user device continues to store the video data in the user device's buffer (e.g., until the buffer fills the buffer's capacity). I can.

Conversely, if, at 120, the server determines that all user devices included in the synchronized media playback session have buffered a predetermined amount of video data, then at 124 the server sends instructions to start playing the video to all users. Can be transferred to the device. For example, the server may send instructions to start video playback to all user devices in a synchronized media playback session. In another example, the server may send an instruction to play the video at a specific clock time to all user devices in a synchronized media playback session. In some embodiments, the server may continue to transmit video data corresponding to the video, and user devices may continue to buffer video data received during playback of the video.

In some embodiments, the first user device and the second user device may cause a synchronized playback session to be started in any suitable manner. For example, in some embodiments, the presentation of the video may begin in any suitable type of video player window. In some embodiments, any suitable indication of other user devices involved in the synchronized playback session may be presented in connection with the presentation of the video. For example, in some embodiments, user names of users associated with other user devices included in the synchronized playback session and/or icons associated with users associated with other user devices included in the synchronized playback session are presented. Can be.

In some embodiments, a synchronized media playback session allows a user device participating in the session to interact with the presentation of media content in the session and/or interact in any suitable manner with other user devices participating in the session. I can do it. For example, as described above, in some embodiments, the user device may cause playback of the media content item to be paused on all user devices participating in the session. As another example, in some embodiments, the user device may cause playback of a media content item to jump or skip to a different playback location on all user devices. As another example, in some embodiments, the user device may cause another item of media content to begin to be presented. As another example, in some embodiments, the user device sends a message to be presented on all user devices attending the session, for example as an instant message, as a message in a group chat, and/or in any other suitable manner. can do.

2, an example of a process 200 for adjusting stream content in a synchronized media playback session in accordance with some embodiments of the disclosed subject matter is shown. In some embodiments, blocks of process 200 may include a server that stores media content and/or streams media content to user devices (e.g., server 302 shown and described below with respect to FIG. 3). It can be implemented in the same server.

At 202, process 200 may begin by sending media content streams to each of a number of user devices participating in a synchronized media playback session. As described above in connection with block 102 of FIG. 1, a synchronized media playback session may be initiated and/or joined in any suitable manner at each user device participating in the session, for example through selection of a link. It is noted that you can. In some embodiments, media content streams may correspond to any media content item to be presented simultaneously to each of multiple user devices during a synchronized media playback session. In some embodiments, the media content item may be selected by any user device, eg, a user device participating in a synchronized media playback session. Additionally or alternatively, in some embodiments, the media content item may be a media content item included in a playlist or other collection of media content items. In some embodiments, each user device of the user devices participating in the synchronized media playback session is configured with media content data corresponding to the received media content stream, as described above with respect to blocks 108 and 110 of FIG. Can be stored in the buffer of the user device.

In some embodiments, process 200 may transmit media content streams in any suitable manner. For example, in some embodiments, a server associated with process 200 (e.g., a server that stores media content and/or streams media content to a user device and/or any other suitable server) is The media content data associated with the stream may be transmitted to the user device using any suitable communication network (eg, communication network 304 shown and described below with respect to FIG. 3 ).

At 204, the process 200 retrieves, from a first user device of a plurality of user devices participating in the synchronized media playback session, media content data associated with the media content stream transmitted by the first user device to the first user device. Information indicating that other user devices participating in the session are buffering media content data corresponding to the media content streams transmitted to each of the other user devices at a slower rate than are buffering may be received. In some embodiments, information from the first user device may be received in any suitable manner. For example, in some embodiments, as described above with respect to blocks 112-118 of FIG. 1, each user device may have a predetermined amount of media content data associated with the media content item to be presented by the user device in the session. When buffered, a message to adjust the synchronized media playback session can be sent to the server. In some such embodiments, process 200 may determine that the first user device is buffering media content data at a slower rate than other user devices based on information associated with the received messages. For example, in some embodiments, process 200 may determine that a first user device is buffering media content data more slowly than other user devices based on the timing of messages received from each of the user devices. . As a more specific example, in some embodiments, process 200 is based on determining that the first user device was the last of the user devices to complete buffering of a predetermined amount of media content data. It can be determined that it is buffering media content data more slowly than user devices. As another more specific example, in some embodiments, process 200 is a session other than a first user device indicating that process 200 has not completed buffering of the predetermined media content data. It can be determined that the first user device is buffering the media content data more slowly than other user devices based on the determination that it has received messages from all user devices participating in the.

As another example, in some embodiments, process 200 may be performed at a slower rate than other user devices in which the first user device participates in a synchronized media playback session based on information contained in a message received from the first user device. It can be determined that the media content data is being buffered. For example, in some embodiments, process 200 may receive a message from the first user device indicating information about a current network connection between the first user device and a server associated with process 200. As a more specific example, in some embodiments, the message indicates the current speed of the network connection, the latency associated with the network connection, the bandwidth of the network connection, the number of times the network connection was lost or timed out, and/or the quality of the network connection. Any other suitable information to be displayed.

It is noted that, in some embodiments, process 200 may receive messages that may indicate any suitable information from any user devices participating in a synchronized media playback session. For example, in some embodiments, a message from a user device may indicate the quality of a network connection between the user device and a server associated with process 200. As another example, in some embodiments, the message from the user device is information about the user device, such as the type of user device (e.g., that the user device is a mobile device, that the user device is a smart television, and/or Any other suitable device type), information about the display of the user device (e.g., the size of the display, the current orientation of the display and/or any other suitable display information), and/or any other suitable information. I can. In some such embodiments, the information received from the user device determines parameters for the media content stream transmitted by process 200 to each user device, as described in more detail below with respect to block 206. Can be used to

At 206, process 200 may select and/or generate a media content stream corresponding to a media content item having a lower quality than the media content stream previously transmitted to the first user device. In some embodiments, the lower quality media content stream may be a reduced quality stream in any suitable manner. For example, in some embodiments, the lower quality media content stream may be encoded using a lower bit rate than the media content stream originally transmitted to the first user device. In some embodiments, process 200 may generate a lower quality media content stream starting from any suitable playback location. For example, in some embodiments, the process 200 may identify a playback position corresponding to the last portion of the media content data of the originally transmitted media content stream, and a lower quality media content stream that begins after the playback position. Can be created.

It is noted that in some embodiments, process 200 may select and/or determine stream parameters for a lower quality media content stream using any suitable information and any suitable technique(s). For example, in some embodiments, process 200 based on the stream parameters associated with the media content stream that was previously transmitted to the first user device at block 202, updated stream parameters (e.g., Select and/or determine the new bitrate and/or any other suitable stream parameters) at which the stream is encoded. As a more specific example, in some embodiments, process 200 may select an updated bitrate that is lower than the bitrate of the stream that was transmitted to the first user device at block 202. As another example, in some embodiments, process 200 may select and/or determine updated stream parameters based on information associated with the first user device. As a more specific example, in some embodiments, the process 200 is based on the amount of media content data currently stored in the buffer of the first user device and/or decoding frames of the media content stream prior to presentation. The updated stream parameters may be selected and/or determined based on the capability of As another more specific example, in some embodiments, process 200 includes information indicating the quality of the network connection between the first user device and the server associated with process 200 (e.g., latency associated with the connection, connection The updated stream parameters may be selected and/or determined based on the bandwidth, connection speed and/or any other suitable information associated with. As another more specific example, in some embodiments, process 200 may include updated stream parameters based on information indicative of the performance of other user devices participating in a synchronized media playback session, such as the process of each of the other user devices ( 200) and the quality of the network connection to the server associated with it (e.g., the speed of each network connection, the latency of each network connection, the bandwidth of each network connection and/or any other suitable information), and each user device in the session The ability to decode frames prior to presentation, the amount of data stored in the buffer of each device, and/or any other suitable performance information of devices other than the first user device may be selected and/or determined.

At 208, process 200 may begin transmitting the lower quality media content stream to the first user device. In some embodiments, process 200 may notify the first user device that a lower quality media content stream is being transmitted in any suitable manner. For example, in some embodiments, process 200 may send an indication of the bitrate associated with the lower quality media content stream to the first user device. In some embodiments, process 200 may send instructions that cause a notification to be presented to the first user device indicating that a lower quality media content stream is being transmitted (e.g., the message May indicate that it is receiving a lower quality media content stream due to poor network connectivity and/or any other suitable information)

At 210, process 200 may send instructions to each of the user devices participating in the synchronized media playback session to start presentation of the media content item using the media content streams sent to each user device. For example, as described above with respect to block 124 of FIG. 1, the instructions may cause each user device to initiate a simultaneous presentation of the media content item. In some embodiments, as described above with respect to block 124 of FIG. 1, the media content item presented in a synchronized media playback session may include any suitable features, such as indications of other user devices participating in the session, Features that allow a user device participating in a session to change the playback of a media content item, causing the playback to change on all user devices in the session (e.g., pausing a media content item, jumping to a different playback position) And/or altering the playback in any other suitable way), and/or features that allow users of user devices to interact with each other (eg, via a messaging interface and/or in any other suitable way). can do.

At 212, the process 200 includes media content data corresponding to the media content stream transmitted by the second user device to the second user device from a second user device among a plurality of user devices participating in the synchronized media playback session. Information indicating that it has stored less than other user devices participating in the synchronized media playback session. In some embodiments, process 200 may receive information from the second user device in any suitable manner. For example, in some embodiments, each user device participating in a synchronized media playback session may determine the current state of the user device's buffer (e.g., the amount of current data in the buffer, the duration of playback of the current data in the buffer, and A message indicating (or other suitable information indicating the state of the buffer) may be periodically transmitted to the server associated with the process 200. In some such embodiments, the process 200 is based on a comparison between the information received from the second user device and the information received from other user devices, wherein the second user device is configured with the media content data stored in the buffer of the second user device. It can be determined that other user devices have fewer than what other user devices have stored in their respective buffers. For example, the second user device sends a message indicating that the second user device currently has 2 seconds of playback data stored in the buffer of the second user device, and the other user devices substantially add to their respective buffers. If other user devices indicate that a lot of data (e.g., more than 8 seconds of play data, more than 10 seconds of play data, and/or any other suitable amount) is stored, the process 200 It can be determined that the device has less media content data stored in the buffer of the second user device compared to other user devices participating in the session.

At 214, process 200 may select and/or generate a media content stream of a lower quality level than a media content stream previously transmitted to the second user device. For example, as described above with respect to block 206, process 200 may select and/or generate a media content stream encoded at a lower bitrate than the originally transmitted media content stream. In some embodiments, process 200 may generate a lower quality media content stream starting from any suitable playback location of the corresponding media content item. For example, in some embodiments, process 200 may generate a lower quality media content stream starting at a location after the last playback location buffered by the second user device. In some such embodiments, the process 200 is based on any suitable information, such as information contained in a message received by the server associated with the process 200 sent from the second user device, by the second user device. It is possible to determine the last buffered playback position.

Similar to as described above with respect to block 206, process 200 based on any suitable information or any suitable combination of information, the stream parameters of the lower quality media content stream to be transmitted to the second user device. You can choose. For example, as described above, the process 200 includes information associated with the second user device, such as information indicating the amount of currently buffered data, the network between the second user device and the server associated with the process 200 Information indicative of the quality of the connection, information about the second user device (e.g., device type, information about the display of the second user device and/or any other suitable information), and/or any other suitable information. Stream parameters can be selected based on. As another example, in some embodiments, process 200 may include information about other user devices participating in a synchronized media playback session, such as information about the quality of network connections of each of the other user devices, each of the other user devices. The stream parameters can be selected based on the amount of data currently buffered by and/or any other suitable information. As a more specific example, in some embodiments, process 200 causes the second user device to cause the second user device to be within a predetermined duration of time (e.g., within 2 seconds, within 5 seconds, and/or any other suitable duration). Within) the amount of media content data equal to the average of the amount of data buffered by other user devices participating in the session (e.g., average, weighted average, median and/or any other suitable average). It can be determined that a lower quality stream should be encoded with a bitrate that is low enough to allow.

At 216, the process 200 may transmit the lower quality media content stream to the second user device. In some embodiments, the second user device may buffer the lower quality media content stream and then start presenting the lower quality media content stream from the buffer.

It is noted that, in some embodiments, process 200 may use any other suitable techniques to maintain synchronization among user devices participating in a synchronized media playback session. For example, if a user device participating in a synchronized media playback session pauses playback to buffer additional media content data, the process 200 may be performed by the user device that paused playback and/or the synchronized playback session. You can change the playback speed for other user devices participating in the game. As a more specific example, in some embodiments, the process 200 may increase the playback speed for a user device that has paused and resumed playback in order to buffer additional media content data, thereby allowing the user device to It allows you to keep up with other user devices in the playback session. As another more specific example, in some embodiments, process 200 may slow the playback speed for other user devices participating in a synchronized media playback session, thereby causing other user devices to pause playback. It allows user devices to keep up with synchronized media playback sessions. It is noted that, in some embodiments, process 200 may cause the playback speed to be changed for one or more user devices participating in a synchronized media playback session based on any suitable criteria. For example, in some embodiments, the process 200 exceeds a predetermined duration of time (e.g., more than 2 seconds, more than 5 seconds) by the user device being out of sync with other user devices participating in the session. , And/or any other suitable duration of time).

Further, it is noted that in some embodiments, process 200 may use any suitable techniques or combination of techniques to coordinate the synchronization of additional user devices joining an existing synchronized media playback session. For example, in some embodiments, the process 200 may be that the playback of the media content item is paused on all user devices in the session while the additional user device buffers the media content data to join other user devices of the synchronized playback. You can make it stop. As another example, in some embodiments, process 200 may be performed at a future playback position of a media content item presented in a synchronized media playback session (e.g., a playback position 5 seconds after the current playback position, 10 Seconds later playback position, and/or any other suitable future playback position), and media content data starting at the future playback position can be added to an additional user device (third) and transmitted for buffering at the user device. have. The process 200 may then send instructions to the additional user device to cause the additional user device to start playing the media content item from the future playback location at the time other user devices in the session reach the future playback location, and Accordingly, it is possible to allow additional user devices to join the synchronized session. As another example, in some embodiments, process 200 may begin to transmit media content data from the current playback location to an additional user device, and then add based on the buffering rate and/or network connection information of the additional user device. A future playback location at which the user device will buffer a predetermined amount of media content data (e.g., a certain kilobyte number of data, an amount corresponding to a certain duration of playback, and/or any other suitable amount of data). Can be estimated. The process 200 may then begin transmitting media content data corresponding to the estimated future playback location to the additional user device in connection with instructions to start presenting the media content item from the estimated future playback location.

3, an example 300 of hardware for adjusting the quality level during synchronized media content playback on multiple devices that may be used in accordance with some embodiments of the disclosed subject matter is shown. As illustrated, hardware 300 may include one or more user devices 306 such as server 302, communication network 304 and/or user devices 308 and 310. For example, multiple user devices 306, including user devices 308 and 310, may participate in a synchronized media playback session managed by one or more servers 302 via a communication network 304. In another example, server 302 may be configured to provide media content of a synchronized media playback session to one or more user devices 306, such as user devices 308 and 310, and also It can be configured to handle synchronization features. In another example, the first server 302 may be configured to provide media content of a synchronized media playback session to one or more user devices 306 and the second server 302 to handle the synchronized media playback session. Can be configured.

Server 302 may be any suitable server(s) for storing information, data and/or media content. For example, in some embodiments, server 302 may store media content items that may be transmitted to user devices 306 for presentation. In some such embodiments, the media content items are any suitable types of media content, such as videos, movies, television programs, live streaming content, audio content (e.g., music, audiobooks, radio programs, and And/or any other suitable audio content) and/or any other suitable type of media content. As another example, in some embodiments, server 302 may coordinate synchronized playback of media content on multiple user devices 306 as described above with respect to FIGS. 1 and 2. As a more specific example, in some embodiments, server 302 may receive a request from multiple user devices to initiate playback of a media content item in a synchronized media playback session, as described above with respect to FIG. As such, in response to a determination that all user devices have buffered a predetermined amount of media content data, the user devices may be instructed to start playing the media content item.

Communication network 304 may be any suitable combination of one or more wired and/or wireless networks in some embodiments. For example, the communication network 304 includes the Internet, an intranet, a wide-area network (WAN), a local-area network (LAN), a wireless network, a digital subscriber line ( DSL) network, frame relay network, asynchronous transfer mode (ATM) network, virtual private network (VPN) and/or any other suitable communication network. have. User devices 206 link to the server 302 via one or more communication links (e.g., communication links 312), via one or more communication links (e.g., communication links 314). May be connected to a communication network 304, which may be. Communication links are network links, dial-up links, wireless links, hard-wired links, any other suitable communication links or any suitable combination of these links. Such as may be any communication links suitable for communicating data between user devices 306 and server 302.

User devices 306 may include any one or more user devices suitable for presenting media content and/or participating in a synchronized media playback session. For example, in some embodiments, user devices 306 include mobile phones, tablet computers, smart televisions, media players, desktop computers, in-vehicle entertainment systems, wearable computers, and/or any other suitable type of user device. can do.

Although server 302 is shown as one device, the functions performed by server 302 may be performed using any suitable number of devices in some embodiments. For example, in some embodiments, multiple devices may be used to implement functions performed by server 302.

Although two user devices 308 and 310 are shown in FIG. 3 in order to avoid overcomplicating the drawing, in some embodiments any suitable number of user devices and/or any suitable types of user devices Can be used.

The server 302 and user devices 306 may be implemented using any suitable hardware in some embodiments. For example, in some embodiments, devices 302 and 306 may be implemented using any suitable general purpose computer or special purpose computer. For example, a mobile phone can be implemented using a special purpose computer. Any such general purpose computer or special purpose computer may include any suitable hardware. For example, as illustrated in the exemplary hardware 400 of FIG. 4, such hardware includes a hardware processor 402, memory and/or storage 404, an input device controller 406, an input device 408, Display/audio drivers 410, display and audio output circuitry 412, communication interface(s) 414, antenna 416, and bus 418.

Hardware processor 402 may be any suitable hardware processor, such as a microprocessor, micro-controller, digital signal processor(s), dedicated logic, and/or any suitable for controlling functions of a general purpose computer or special purpose computer in some embodiments. Other suitable circuits. In some embodiments, hardware processor 402 may be controlled by a server program stored in memory and/or storage of a server, such as server 402. For example, in some embodiments, the server program causes the hardware processor 402 to receive a request to coordinate a synchronized media content viewing session, and multiple user devices are ready to initiate a synchronized media content viewing session. Determine whether or not, send instructions to user devices to start a synchronized media content viewing session, adjust the quality of the stream of media content, and/or perform any other suitable functions. In some embodiments, hardware processor 402 may be controlled by a computer program stored in memory and/or storage 404 of user device 306. For example, the computer program causes the hardware processor 402 to store the received media content data in a buffer of the user device 306 and sends a message to the server in response to a determination that a predetermined amount of media content data has been buffered. Server 302 sends a message indicating the current state of the buffer of the user device 306 and/or the current quality of the network connection, and to present the media content as part of a synchronized media content playback session. And/or perform any other suitable function.

Memory and/or storage 404 may be any suitable memory and/or storage for storing programs, data, and/or any other suitable information in some embodiments. For example, memory and/or storage 404 may include random access memory, read only memory, flash memory, hard disk storage, optical media, and/or any other suitable memory.

The input device controller 406 may be any suitable circuit for controlling and receiving inputs from one or more input devices 408 in some embodiments. For example, the input device controller 406 can be used to control pressure from a touch screen, from a keyboard, from one or more buttons, from a speech recognition circuit, from a microphone, from a camera, from an optical sensor, from an accelerometer, from a temperature sensor, from a near field sensor, and It may be a circuit for receiving input from a sensor, from an encoder, and/or from any other type of input device.

Display/audio drivers 410 may be any suitable circuitry for controlling and driving output to one or more display/audio output devices 412 in some embodiments. For example, the display/audio drivers 410 may be circuitry for driving a touchscreen, a flat panel display, a cathode ray tube display, a projector, a speaker or speakers and/or any other suitable display and/or presentation devices. have.

The communication interface(s) 414 may be any suitable circuitry for interfacing with one or more communication networks (eg, computer network 304). For example, the interface(s) 414 may include a network interface card circuit, a wireless communication circuit, and/or any other suitable type of communication network circuit.

Antenna 416 may be any suitable one or more antennas for wirelessly communicating with a communication network (eg, communication network 304) in some embodiments. In some embodiments, the antenna 416 may be omitted.

Bus 418 may be any suitable mechanism for communicating between two or more components 402, 404, 406, 410, and 414 in some embodiments.

Any other suitable components may be included in hardware 400 in accordance with some embodiments.

In some embodiments, at least some of the above-described blocks of the processes of FIGS. 1 and 2 may be executed or performed in any order or sequence that is not limited to the order shown in the figures and described in connection with the figures. have. In addition, some of the above blocks in FIGS. 1 and 2 may be executed or performed substantially simultaneously or in parallel as appropriate to reduce latency and processing times. Additionally or alternatively, some of the above-described blocks of the processes of FIGS. 1 and 2 may be omitted. For example, a method as described with reference to blocks 212, 214, and 216 of FIG. 3 is, in principle, a synchronized media that is not started as described with reference to blocks 202-210 of FIG. It can be applied in the case of a playback session.

In some embodiments, any suitable computer-readable media may be used herein to store instructions for performing functions and/or processes. For example, in some embodiments, computer-readable media may be transitory or non-transitory. For example, a non-transitory computer-readable medium includes non-transitory forms of magnetic media (such as hard disks, floppy disks and/or any other suitable magnetic media), non-transitory forms of optical media (such as compact Discs, digital video discs, Blu-ray discs and/or any other suitable optical media), semiconductor media in non-transitory forms (such as flash memory, electrically programmable read-only memory) (Electrical Programmable Read-Only Memory) (EPROM), electrically erasable programmable read-only memory (EEPROM), and/or any other suitable semiconductor media), apparently during transfer It may include media such as any suitable media and/or any suitable tangible media that are not non-permanent or temporary. As another example, the transitory computer-readable medium includes networks, conductors, conductors, optical fibers, circuits, any suitable medium that is not transient and apparently non-persistent during transmission and/or any suitable intangible medium. (Intangible media) may contain signals.

Accordingly, methods, systems and media are provided for adjusting the quality level during synchronized media content presentation.

Although the present invention has been described and illustrated in the above-described exemplary embodiments, the present disclosure has been made by way of example only, and without departing from the spirit and scope of the present invention, which is limited only by the following claims. It is understood that many changes can be made in the details. Features of the disclosed embodiments can be combined and rearranged in various ways.

Claims (18)

As a method for synchronizing playback of media content,
A second media that transmits first media content data corresponding to a first stream of media content items from a server to a first user device, and from the server to a second user device, corresponding to a second stream of media content items Transmitting content data, wherein the first media content data is stored in a buffer of the first user device, and the second media content data is stored in a buffer of the second user device;
Sending instructions from the server to the first user device and the second user device, causing the first user device and the second user device to start simultaneously presenting the media content item;
Determining, by the server, that the first media content data is being stored in the buffer of the first user device at a slower rate than the second media content data is being stored in the buffer of the second user device Step to do;
In response to determining that the first media content data is being stored in the buffer of the first user device at a slower rate than the second media content data is being stored in the buffer of the second user device, the media Selecting a third stream of the media content item corresponding to the first stream of content items, the third stream of the media content item having a lower quality level than the first stream of the media content item; And
Transmitting third media content data corresponding to the third stream of the media content item to the first user device
A method for synchronizing playback of media content comprising a The method of claim 1,
The instructions for causing the first user device and the second user device to simultaneously start presenting the media content item are determined by a predetermined amount corresponding to the media content item by the first user device and the second user device. A method for synchronizing playback of media content based on a determination that the media content data has been buffered. The method according to claim 1 or 2,
Determining that the first media content data is being stored in the buffer of the first user device at a slower rate than the second media content data is being stored in the buffer of the second user device comprises: 1 A method for synchronizing playback of media content based on a message received by the server from a user device. The method of claim 3,
The message indicating a current amount of the first media content data stored in the buffer of the first user device at the time the message is transmitted by the first user device to the server, synchronizing playback of media content Way for you. The method according to claim 1 or 2,
Determining that the first media content data is being stored in the buffer of the first user device at a slower rate than the second media content data is being stored in the buffer of the second user device comprises: 1 A method for synchronizing playback of media content based on a comparison of an amount of the first media content data stored in the buffer of the second user device with the amount of the second media content data stored in the buffer of the second user device. The method according to any one of claims 1 to 5,
The method for synchronizing playback of media content, wherein the third stream of media content items has a lower bit rate than the first stream of media content items. As a system for synchronizing playback of media content,
Memory; And
Hardware processor on the server
Including, the hardware processor, when executing computer executable instructions stored in the memory,
Transmitting first media content data corresponding to a first stream of media content items from the server to a first user device, and transmitting a second media content data corresponding to a second stream of media content items from the server to a second user device Transmitting media content data, wherein the first media content data is stored in a buffer of the first user device, and the second media content data is stored in a buffer of the second user device;
Send instructions from the server to the first user device and the second user device to cause the first user device and the second user device to start simultaneously presenting the media content item;
Determining, by the server, that the first media content data is being stored in the buffer of the first user device at a slower rate than the second media content data is being stored in the buffer of the second user device and;
In response to determining that the first media content data is being stored in the buffer of the first user device at a slower rate than the second media content data is being stored in the buffer of the second user device, the media Selecting a third stream of the media content item corresponding to the first stream of content items, wherein the third stream of media content items has a lower quality level than the first stream of media content items;
To transmit third media content data corresponding to the third stream of the media content item to the first user device
Configured, a system for synchronizing playback of media content. The method of claim 7,
The instructions for causing the first user device and the second user device to simultaneously start presenting the media content item are determined by a predetermined amount corresponding to the media content item by the first user device and the second user device. A system for synchronizing playback of media content based on a determination that the media content data has been buffered. The method of claim 7,
Determining that the first media content data is being stored in the buffer of the first user device at a slower rate than the second media content data is being stored in the buffer of the second user device comprises the first A system for synchronizing playback of media content based on messages received by the server from a user device. The method of claim 9,
The message indicating a current amount of the first media content data stored in the buffer of the first user device at the time the message is transmitted by the first user device to the server, synchronizing playback of media content For the system. The method of claim 7,
Determining that the first media content data is being stored in the buffer of the first user device at a slower rate than the second media content data is being stored in the buffer of the second user device comprises the first A system for synchronizing playback of media content based on a comparison of the amount of the first media content data stored in the buffer of the user device with the amount of the second media content data stored in the buffer of the second user device. The method of claim 7,
The system for synchronizing playback of media content, wherein the third stream of media content items has a lower bit rate than the first stream of media content items. A non-transitory computer-readable medium containing computer executable instructions that, when executed by a processor on a server, cause the processor to perform a method for synchronizing playback of media content,
The above method,
Transmitting first media content data corresponding to a first stream of media content items from the server to a first user device, and transmitting a second media content data corresponding to a second stream of media content items from the server to a second user device Transmitting media content data, wherein the first media content data is stored in a buffer of the first user device, and the second media content data is stored in a buffer of the second user device;
Sending instructions from the server to the first user device and the second user device, causing the first user device and the second user device to start simultaneously presenting the media content item;
Determining, by the server, that the first media content data is being stored in the buffer of the first user device at a slower rate than the second media content data is being stored in the buffer of the second user device Step to do;
In response to determining that the first media content data is being stored in the buffer of the first user device at a slower rate than the second media content data is being stored in the buffer of the second user device, the media Selecting a third stream of the media content item corresponding to the first stream of content items, the third stream of the media content item having a lower quality level than the first stream of the media content item; And
Transmitting third media content data corresponding to the third stream of the media content item to the first user device
Containing, a non-transitory computer-readable medium. The method of claim 13,
The instructions for causing the first user device and the second user device to simultaneously start presenting the media content item are determined by a predetermined amount corresponding to the media content item by the first user device and the second user device. A non-transitory computer-readable medium based on a determination that the media content data has been buffered. The method of claim 13,
Determining that the first media content data is being stored in the buffer of the first user device at a slower rate than the second media content data is being stored in the buffer of the second user device comprises: 1 A non-transitory computer-readable medium based on a message received by the server from a user device. The method of claim 15,
The message indicating a current amount of the first media content data stored in the buffer of the first user device at the time the message is transmitted by the first user device to the server. The method of claim 13,
Determining that the first media content data is being stored in the buffer of the first user device at a slower rate than the second media content data is being stored in the buffer of the second user device comprises: A non-transitory computer-readable medium based on a comparison of an amount of the first media content data stored in the buffer of the first user device with the amount of the second media content data stored in the buffer of the second user device. The method of claim 13,
The third stream of media content items has a lower bit rate than the first stream of media content items.

Images