RU2487407C2 - System and method of compressing streaming interactive video - Google Patents

System and method of compressing streaming interactive video Download PDF

Info

Publication number
RU2487407C2
RU2487407C2 RU2010127314/08A RU2010127314A RU2487407C2 RU 2487407 C2 RU2487407 C2 RU 2487407C2 RU 2010127314/08 A RU2010127314/08 A RU 2010127314/08A RU 2010127314 A RU2010127314 A RU 2010127314A RU 2487407 C2 RU2487407 C2 RU 2487407C2
Authority
RU
Russia
Prior art keywords
data
user
data rate
video
fec
Prior art date
Application number
RU2010127314/08A
Other languages
Russian (ru)
Other versions
RU2010127314A (en
Inventor
ДЕР ЛАН Роджер ВАН
Стефен Г. ПЕРЛМАН
Original Assignee
Ол2, Инк.
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Ол2, Инк. filed Critical Ол2, Инк.
Publication of RU2010127314A publication Critical patent/RU2010127314A/en
Application granted granted Critical
Publication of RU2487407C2 publication Critical patent/RU2487407C2/en

Links

Images

Classifications

    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/60—Network structure or processes for video distribution between server and client or between remote clients; Control signalling between clients, server and network components; Transmission of management data between server and client, e.g. sending from server to client commands for recording incoming content stream; Communication details between server and client 
    • H04N21/65—Transmission of management data between client and server
    • H04N21/658—Transmission by the client directed to the server
    • H04N21/6587—Control parameters, e.g. trick play commands, viewpoint selection
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/10—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
    • H04N19/102—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the element, parameter or selection affected or controlled by the adaptive coding
    • H04N19/119—Adaptive subdivision aspects, e.g. subdivision of a picture into rectangular or non-rectangular coding blocks
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/10—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
    • H04N19/134—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the element, parameter or criterion affecting or controlling the adaptive coding
    • H04N19/136—Incoming video signal characteristics or properties
    • H04N19/137—Motion inside a coding unit, e.g. average field, frame or block difference
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/10—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
    • H04N19/134—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the element, parameter or criterion affecting or controlling the adaptive coding
    • H04N19/136—Incoming video signal characteristics or properties
    • H04N19/14—Coding unit complexity, e.g. amount of activity or edge presence estimation
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/10—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
    • H04N19/169—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding
    • H04N19/17—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding the unit being an image region, e.g. an object
    • H04N19/174—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding the unit being an image region, e.g. an object the region being a slice, e.g. a line of blocks or a group of blocks
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/20—Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
    • H04N21/23—Processing of content or additional data; Elementary server operations; Server middleware
    • H04N21/234—Processing of video elementary streams, e.g. splicing of video streams or manipulating encoded video stream scene graphs
    • H04N21/2343—Processing of video elementary streams, e.g. splicing of video streams or manipulating encoded video stream scene graphs involving reformatting operations of video signals for distribution or compliance with end-user requests or end-user device requirements
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/20—Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
    • H04N21/23—Processing of content or additional data; Elementary server operations; Server middleware
    • H04N21/238—Interfacing the downstream path of the transmission network, e.g. adapting the transmission rate of a video stream to network bandwidth; Processing of multiplex streams
    • H04N21/2383—Channel coding or modulation of digital bit-stream, e.g. QPSK modulation
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/20—Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
    • H04N21/23—Processing of content or additional data; Elementary server operations; Server middleware
    • H04N21/24—Monitoring of processes or resources, e.g. monitoring of server load, available bandwidth, upstream requests
    • H04N21/2402—Monitoring of the downstream path of the transmission network, e.g. bandwidth available
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/20—Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
    • H04N21/25—Management operations performed by the server for facilitating the content distribution or administrating data related to end-users or client devices, e.g. end-user or client device authentication, learning user preferences for recommending movies
    • H04N21/266—Channel or content management, e.g. generation and management of keys and entitlement messages in a conditional access system, merging a VOD unicast channel into a multicast channel
    • H04N21/2662—Controlling the complexity of the video stream, e.g. by scaling the resolution or bitrate of the video stream based on the client capabilities
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/47—End-user applications
    • H04N21/478—Supplemental services, e.g. displaying phone caller identification, shopping application
    • H04N21/4781—Games

Landscapes

  • Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • Signal Processing (AREA)
  • Databases & Information Systems (AREA)
  • Two-Way Televisions, Distribution Of Moving Picture Or The Like (AREA)
  • Compression Or Coding Systems Of Tv Signals (AREA)
  • Television Signal Processing For Recording (AREA)
  • Debugging And Monitoring (AREA)
  • Data Exchanges In Wide-Area Networks (AREA)

Abstract

FIELD: information technology.
SUBSTANCE: method of compressing video includes: running one or more applications, receiving packet streams from users and routing said packets to one or more applications, wherein said packet streams include user control signal input, one or more applications are configured to calculate A/V data in response to the user control signal input, receive A/V data from one or more applications and derive therefrom compressed streaming A/V data with short waiting time, estimating link quality. A user client determines whether to use or forward error correction (FEC) and, based on said estimation, determines a portion of video and audio of the compressed streaming A/V data with a short waiting time and user commands to which FEC should be applied, applying FEC based on said determination and routing the compressed streaming A/V data with a short waiting time to each of the clients over a corresponding link.
EFFECT: improved user capability of manipulating audio and video media and connection thereto.
28 cl, 38 dwg

Description

Текст описания приведен в факсимильном виде.

Figure 00000001
Figure 00000002
Figure 00000003
Figure 00000004
Figure 00000005
Figure 00000006
Figure 00000007
Figure 00000008
Figure 00000009
Figure 00000010
Figure 00000011
Figure 00000012
Figure 00000013
Figure 00000014
Figure 00000015
Figure 00000016
Figure 00000017
Figure 00000018
Figure 00000019
Figure 00000020
Figure 00000021
Figure 00000022
Figure 00000023
Figure 00000024
Figure 00000025
Figure 00000027
Figure 00000028
Figure 00000029
Figure 00000030
Figure 00000031
Figure 00000032
Figure 00000033
Figure 00000034
Figure 00000035
Figure 00000036
Figure 00000037
Figure 00000038
Figure 00000039
Figure 00000040
Figure 00000041
Figure 00000042
Figure 00000043
Figure 00000044
Figure 00000045
Figure 00000046
Figure 00000047
Figure 00000048
Figure 00000049
Figure 00000050
Figure 00000051
Figure 00000052
Figure 00000053
Figure 00000054
Figure 00000055
Figure 00000056
Figure 00000057
Figure 00000058
Figure 00000059
Figure 00000060
Figure 00000061
Figure 00000062
Figure 00000063
Figure 00000064
Figure 00000065
Figure 00000066
Figure 00000067
Figure 00000068
Figure 00000069
Figure 00000070
Figure 00000071
Figure 00000072
Figure 00000073
Figure 00000075
Figure 00000076
Figure 00000077
Figure 00000078
Figure 00000079
Figure 00000080
Figure 00000081
Figure 00000082
Figure 00000083
Figure 00000084
Figure 00000085
Figure 00000086
Figure 00000087
Figure 00000088
Figure 00000089
Figure 00000090
Figure 00000091
Figure 00000092
Figure 00000093
Figure 00000094
Figure 00000095
Figure 00000096
Figure 00000097
Figure 00000098
Figure 00000099
Figure 00000100
Figure 00000101
Figure 00000102
Figure 00000103
Figure 00000104
Figure 00000105
Figure 00000106
Figure 00000107
Figure 00000108
Figure 00000109
Figure 00000110
Figure 00000111
Figure 00000112
Figure 00000113
Figure 00000114
Figure 00000115
Figure 00000116
Figure 00000117
Figure 00000118
Figure 00000119
Figure 00000120
Figure 00000121
Figure 00000122
Figure 00000123
Figure 00000124
Figure 00000125
Figure 00000126
Figure 00000127
Figure 00000128
Figure 00000129
Figure 00000130
Figure 00000131
Figure 00000132
Figure 00000133
Figure 00000134
Figure 00000135
Figure 00000136
Figure 00000137
Figure 00000138
Figure 00000139
Figure 00000140
Figure 00000141
Figure 00000142
Figure 00000143
Figure 00000144
Figure 00000145
Figure 00000146
Figure 00000147
Figure 00000148
Figure 00000149
Figure 00000150
Figure 00000151
Figure 00000152
Figure 00000153
Figure 00000154
Figure 00000155
Figure 00000156
Figure 00000157
Figure 00000158
Figure 00000159
Figure 00000160
Figure 00000161
Figure 00000162
Figure 00000163
Figure 00000164
Figure 00000165
Figure 00000166
Figure 00000167
Figure 00000168
Figure 00000169
Figure 00000170
Figure 00000171
Figure 00000172
Figure 00000173
Figure 00000174
Figure 00000175
Figure 00000176
Figure 00000177
Figure 00000178
Figure 00000179
Figure 00000180
Figure 00000181
Figure 00000182
Figure 00000183
Figure 00000184
Figure 00000185
Figure 00000186
Figure 00000187
Figure 00000188
Figure 00000189
Figure 00000190
Figure 00000191
Figure 00000192
Figure 00000193
Figure 00000194
Figure 00000195
Figure 00000196
Figure 00000197
Figure 00000198
Figure 00000199
Figure 00000200
Figure 00000201
Figure 00000202
Figure 00000203
Figure 00000204
Figure 00000205
Figure 00000206
Figure 00000207
Figure 00000208
Figure 00000209
Figure 00000210
The text of the description is given in facsimile form.
Figure 00000001
Figure 00000002
Figure 00000003
Figure 00000004
Figure 00000005
Figure 00000006
Figure 00000007
Figure 00000008
Figure 00000009
Figure 00000010
Figure 00000011
Figure 00000012
Figure 00000013
Figure 00000014
Figure 00000015
Figure 00000016
Figure 00000017
Figure 00000018
Figure 00000019
Figure 00000020
Figure 00000021
Figure 00000022
Figure 00000023
Figure 00000024
Figure 00000025
Figure 00000027
Figure 00000028
Figure 00000029
Figure 00000030
Figure 00000031
Figure 00000032
Figure 00000033
Figure 00000034
Figure 00000035
Figure 00000036
Figure 00000037
Figure 00000038
Figure 00000039
Figure 00000040
Figure 00000041
Figure 00000042
Figure 00000043
Figure 00000044
Figure 00000045
Figure 00000046
Figure 00000047
Figure 00000048
Figure 00000049
Figure 00000050
Figure 00000051
Figure 00000052
Figure 00000053
Figure 00000054
Figure 00000055
Figure 00000056
Figure 00000057
Figure 00000058
Figure 00000059
Figure 00000060
Figure 00000061
Figure 00000062
Figure 00000063
Figure 00000064
Figure 00000065
Figure 00000066
Figure 00000067
Figure 00000068
Figure 00000069
Figure 00000070
Figure 00000071
Figure 00000072
Figure 00000073
Figure 00000075
Figure 00000076
Figure 00000077
Figure 00000078
Figure 00000079
Figure 00000080
Figure 00000081
Figure 00000082
Figure 00000083
Figure 00000084
Figure 00000085
Figure 00000086
Figure 00000087
Figure 00000088
Figure 00000089
Figure 00000090
Figure 00000091
Figure 00000092
Figure 00000093
Figure 00000094
Figure 00000095
Figure 00000096
Figure 00000097
Figure 00000098
Figure 00000099
Figure 00000100
Figure 00000101
Figure 00000102
Figure 00000103
Figure 00000104
Figure 00000105
Figure 00000106
Figure 00000107
Figure 00000108
Figure 00000109
Figure 00000110
Figure 00000111
Figure 00000112
Figure 00000113
Figure 00000114
Figure 00000115
Figure 00000116
Figure 00000117
Figure 00000118
Figure 00000119
Figure 00000120
Figure 00000121
Figure 00000122
Figure 00000123
Figure 00000124
Figure 00000125
Figure 00000126
Figure 00000127
Figure 00000128
Figure 00000129
Figure 00000130
Figure 00000131
Figure 00000132
Figure 00000133
Figure 00000134
Figure 00000135
Figure 00000136
Figure 00000137
Figure 00000138
Figure 00000139
Figure 00000140
Figure 00000141
Figure 00000142
Figure 00000143
Figure 00000144
Figure 00000145
Figure 00000146
Figure 00000147
Figure 00000148
Figure 00000149
Figure 00000150
Figure 00000151
Figure 00000152
Figure 00000153
Figure 00000154
Figure 00000155
Figure 00000156
Figure 00000157
Figure 00000158
Figure 00000159
Figure 00000160
Figure 00000161
Figure 00000162
Figure 00000163
Figure 00000164
Figure 00000165
Figure 00000166
Figure 00000167
Figure 00000168
Figure 00000169
Figure 00000170
Figure 00000171
Figure 00000172
Figure 00000173
Figure 00000174
Figure 00000175
Figure 00000176
Figure 00000177
Figure 00000178
Figure 00000179
Figure 00000180
Figure 00000181
Figure 00000182
Figure 00000183
Figure 00000184
Figure 00000185
Figure 00000186
Figure 00000187
Figure 00000188
Figure 00000189
Figure 00000190
Figure 00000191
Figure 00000192
Figure 00000193
Figure 00000194
Figure 00000195
Figure 00000196
Figure 00000197
Figure 00000198
Figure 00000199
Figure 00000200
Figure 00000201
Figure 00000202
Figure 00000203
Figure 00000204
Figure 00000205
Figure 00000206
Figure 00000207
Figure 00000208
Figure 00000209
Figure 00000210

Claims (28)

1. Машинно-реализуемый способ выполнения сжатия видео, содержащий:
исполнение одного или нескольких приложений,
прием потоков пакетов от пользователей и маршрутизацию этих пакетов в одно или несколько приложений, причем эти потоки пакетов включают в себя ввод сигнала управления пользователя, одно или несколько приложений выполнены с возможностью вычисления данных A/V в ответ на ввод сигнала управления пользователя,
прием данных A/V из одного или нескольких приложений и выведение из них потоковых сжатых данных A/V с малым временем ожидания,
оценку качества канала связи, причем клиент пользователя определяет то, использовать ли прямую коррекцию ошибок (FEC), и, на основе упомянутой оценки, определяет части видео и аудио потоковых сжатых данных A/V с малым временем ожидания и команды пользователя, к которым должна быть применена FEC,
применение FEC на основе упомянутого определения, и
маршрутизацию потоковых сжатых данных A/V с малым временем ожидания каждому из клиентов по соответствующему каналу связи.1. A computer-implemented method for performing video compression, comprising:
execution of one or more applications,
receiving packet streams from users and routing these packets to one or more applications, wherein these packet streams include inputting a user control signal, one or more applications are configured to calculate A / V data in response to inputting a user control signal,
receiving A / V data from one or more applications and deriving from them stream compressed A / V data with a low latency,
assessment of the quality of the communication channel, and the user’s client determines whether to use direct error correction (FEC), and, based on this assessment, determines the parts of the video and audio stream compressed data A / V with a low latency and user commands, which should be FEC applied
applying FEC based on the above definition, and
routing streaming compressed A / V data with a low latency to each of the clients on the corresponding communication channel. 2. Способ по п.1, в котором для каналов связи, имеющих качество ниже заданного порога, применение FEC ко всем видеокадрам, аудио и управляющим сигналам.2. The method according to claim 1, in which for communication channels having quality below a predetermined threshold, applying FEC to all video frames, audio, and control signals. 3. Способ по п.1, в котором для каналов связи, имеющих качество выше заданного порога, применение FEC только к аудио и управляющим сигналам.3. The method according to claim 1, in which for communication channels having quality above a predetermined threshold, applying FEC only to audio and control signals. 4. Способ по п.1, в котором для каналов связи, имеющих качество выше заданного порога, применение FEC только к аудио, управляющим сигналам и определенным частям видео.4. The method according to claim 1, in which for communication channels having quality above a given threshold, applying FEC only to audio, control signals and certain parts of the video. 5. Способ по п.4, в котором определенные части видео содержат I-фрагменты.5. The method according to claim 4, in which certain parts of the video contain I-fragments. 6. Способ по п.1, в котором качество канала связи оценивается посредством оценки потери пакетов и/или времени ожидания.6. The method according to claim 1, in which the quality of the communication channel is assessed by assessing packet loss and / or latency. 7. Способ по п.1, в котором, если сжатые видеоданные потеряны или задержаны и не могут быть восстановлены посредством FEC в клиенте, то клиент запрашивает, чтобы фрагмент интракадра был отправлен службой хостинга.7. The method according to claim 1, in which if the compressed video data is lost or delayed and cannot be restored by FEC in the client, the client requests that the fragment of the intra-frame be sent by the hosting service. 8. Способ по п.1, также содержащий уменьшение пиков ширины полосы канала посредством распределения больших пиков ширины полосы сжатого видео по последовательности последовательных кадров.8. The method according to claim 1, also comprising reducing peaks of the channel bandwidth by distributing large peaks of the compressed video bandwidth over a sequence of consecutive frames. 9. Способ по п.8, в котором распределение больших пиков ширины полосы сжатого видео по последовательности последовательных кадров дополнительно содержит передачу сжатых кадров, в которых существует больше данных, чем может быть передано при пиковой скорости передачи данных в одном периоде кадра, за один или несколько дополнительных периодов кадра.9. The method of claim 8, in which the distribution of large peaks of the compressed video bandwidth over a sequence of consecutive frames further comprises transmitting compressed frames in which there is more data than can be transmitted at a peak data rate in one frame period, in one or several additional frame periods. 10. Способ по п.9, в котором во время упомянутых дополнительных периодов кадра клиент продолжает выводить на экран ранее декомпрессированный кадр.10. The method of claim 9, wherein during said additional frame periods, the client continues to display a previously decompressed frame. 11. Способ по п.10, дополнительно содержащий игнорирование кадров, принятых во время дополнительных периодов кадра.11. The method of claim 10, further comprising ignoring frames received during additional frame periods. 12. Способ по п.9, в котором частота видеокадров временно уменьшается во время упомянутых дополнительных периодов кадра.12. The method according to claim 9, in which the frequency of the video frames is temporarily reduced during said additional frame periods. 13. Способ по п.9, в котором дополнительным периодом кадра является 1 период кадра.13. The method according to claim 9, in which the additional frame period is 1 frame period. 14. Способ по п.9, в котором дополнительным периодом кадра является более, чем 1 период кадра.14. The method of claim 9, wherein the additional frame period is more than 1 frame period. 15. Способ по п.10, в котором во время дополнительных периодов кадра, аудиочасть потока A/V продолжают сжимать и декомпрессировать в клиентском устройстве без ослабления.15. The method according to claim 10, in which during additional periods of the frame, the audio part of the stream A / V continue to compress and decompress in the client device without attenuation. 16. Способ по п.1, дополнительно содержащий динамическую настройку скорости передачи данных сжатых данных A/V.16. The method according to claim 1, further comprising dynamically adjusting the data rate of the compressed A / V data. 17. Способ по п.16, в котором скорость передачи данных настраивается в ответ на обнаруженную максимальную скорость передачи данных канала.17. The method according to clause 16, in which the data rate is configured in response to the detected maximum channel data rate. 18. Способ по п.16, в котором скорость передачи данных настраивается посредством модификации частоты кадров.18. The method according to clause 16, in which the data rate is adjusted by modifying the frame rate. 19. Способ по п.16, в котором скорость передачи данных настраивается посредством модификации качества сжатого видео.19. The method according to clause 16, in which the data rate is adjusted by modifying the quality of the compressed video. 20. Способ по п.16, в котором скорость передачи данных настраивается посредством модификации разрешения изображения.20. The method according to clause 16, in which the data rate is adjusted by modifying the image resolution. 21. Способ по п.20, в котором, когда разрешение изображения модифицировано, клиент увеличивает масштаб изображения для поддержания идентичного размера изображения на экране дисплея.21. The method according to claim 20, in which, when the resolution of the image is modified, the client zooms in to maintain an identical image size on the display screen. 22. Способ по п.1, в котором, когда канал связи для канала пользователя полностью выходит из строя, один или несколько серверов приостанавливают игру, в которую играет пользователь.22. The method according to claim 1, in which when the communication channel for the user channel completely fails, one or more servers suspend the game that the user plays. 23. Способ по п.22, в котором, если пользователь выбывает, и этот пользователь играет в игру с несколькими участниками, то остальных пользователей уведомляют о том, что упомянутый пользователь выбыл.23. The method according to item 22, in which, if the user leaves, and this user plays a game with several participants, then the remaining users are notified that the said user has left. 24. Способ по п.23, в котором игра приостанавливается для других пользователей, когда пользователь выбывает.24. The method according to item 23, in which the game is paused for other users when the user leaves. 25. Способ по п.1, дополнительно содержащий первоначальное определение пиковой скорости передачи данных посредством отправки тестового потока с более высокой скоростью передачи данных по сети выходной маршрутизации до тех пор, пока потеря пакетов и/или большее время ожидания не укажут на то, что пропускная способность канала связи превышена.25. The method according to claim 1, further comprising initially determining a peak data rate by sending a test stream with a higher data rate over the output routing network until packet loss and / or a longer latency indicate that the throughput communication channel capacity exceeded. 26. Способ по п.25, дополнительно содержащий:
определение того, что пропускная способность канала связи уменьшилась, на основе обнаруженного увеличения потери пакетов и/или увеличения времени ожидания, и
в ответ уменьшение пиковой скорости передачи данных до тех пор, пока потеря пакетов и/или время ожидания не достигнут приемлемых значений.26. The method according A.25, further comprising:
determining that the communication channel capacity has decreased, based on a detected increase in packet loss and / or increase in latency, and
in response, reducing the peak data rate until packet loss and / or latency is reached acceptable. 27. Способ по п.25, дополнительно содержащий:
определение того, что пропускная способность канала связи, возможно, увеличилась, на основе непрерывных измерений потери пакетов и/или времени ожидания, и
в ответ увеличение пиковой скорости передачи данных до тех пор, пока потеря пакетов и/или время ожидания не достигнут неприемлемого уровня.27. The method according A.25, further comprising:
determining that communication channel capacity may have increased based on continuous measurements of packet loss and / or latency, and
in response, increasing the peak data rate until packet loss and / or latency is reached an unacceptable level. 28. Способ по п.1, дополнительно содержащий передачу пакетов данных в порядке, отличном от того, в котором они выводятся на экран. 28. The method according to claim 1, further comprising transmitting data packets in an order different from the one in which they are displayed.
RU2010127314/08A 2007-12-05 2008-12-04 System and method of compressing streaming interactive video RU2487407C2 (en)

Applications Claiming Priority (3)

Application Number Priority Date Filing Date Title
US99965707A 2007-12-05 2007-12-05
US11/999,657 2007-12-05
PCT/US2008/085600 WO2009073825A1 (en) 2007-12-05 2008-12-04 System and method for compressing video by adjusting tile size based on detected intraframe motion or scene complexity

Publications (2)

Publication Number Publication Date
RU2010127314A RU2010127314A (en) 2012-01-10
RU2487407C2 true RU2487407C2 (en) 2013-07-10

Family

ID=40718183

Family Applications (1)

Application Number Title Priority Date Filing Date
RU2010127314/08A RU2487407C2 (en) 2007-12-05 2008-12-04 System and method of compressing streaming interactive video

Country Status (10)

Country Link
EP (1) EP2218037A4 (en)
JP (1) JP2011507346A (en)
KR (1) KR20100112567A (en)
CN (1) CN101918956A (en)
AU (1) AU2008333827A1 (en)
CA (1) CA2707715A1 (en)
NZ (1) NZ585904A (en)
RU (1) RU2487407C2 (en)
TW (2) TW200952496A (en)
WO (1) WO2009073825A1 (en)

Families Citing this family (18)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US8888592B1 (en) 2009-06-01 2014-11-18 Sony Computer Entertainment America Llc Voice overlay
US8968087B1 (en) 2009-06-01 2015-03-03 Sony Computer Entertainment America Llc Video game overlay
US8147339B1 (en) 2007-12-15 2012-04-03 Gaikai Inc. Systems and methods of serving game video
US8613673B2 (en) 2008-12-15 2013-12-24 Sony Computer Entertainment America Llc Intelligent game loading
US8926435B2 (en) 2008-12-15 2015-01-06 Sony Computer Entertainment America Llc Dual-mode program execution
US9723319B1 (en) 2009-06-01 2017-08-01 Sony Interactive Entertainment America Llc Differentiation for achieving buffered decoding and bufferless decoding
US8771064B2 (en) 2010-05-26 2014-07-08 Aristocrat Technologies Australia Pty Limited Gaming system and a method of gaming
US8560331B1 (en) 2010-08-02 2013-10-15 Sony Computer Entertainment America Llc Audio acceleration
KR101956639B1 (en) 2010-09-13 2019-03-11 소니 인터랙티브 엔터테인먼트 아메리카 엘엘씨 A method and system of providing a computer game at a computer game system including a video server and a game server
US10039978B2 (en) 2010-09-13 2018-08-07 Sony Interactive Entertainment America Llc Add-on management systems
US20210271364A1 (en) * 2011-01-26 2021-09-02 Benjamin Firooz Ghassabian Data entry systems
CN104835187B (en) * 2015-05-19 2020-04-03 北京三六三教育科技股份有限公司 Animation editor and editing method thereof
US11640626B2 (en) * 2017-11-03 2023-05-02 Universal City Studios Llc Queue monitoring techniques
JP7330518B2 (en) * 2018-06-22 2023-08-22 ミントフラッグ株式会社 GAME SYSTEM, GAME SYSTEM CONTROL METHOD, AND GAME PROGRAM
CN109743628A (en) * 2019-01-10 2019-05-10 四川长虹电器股份有限公司 A kind of method that IP set-top box promotes video on live smoothness
CN110996057B (en) * 2019-12-02 2021-11-16 腾讯云计算（北京）有限责任公司 Media data processing method and device, computer equipment and storage medium
CN111669589B (en) * 2020-06-23 2021-03-16 腾讯科技（深圳）有限公司 Image encoding method, image encoding device, computer device, and storage medium
CN112104867B (en) * 2020-11-09 2021-03-02 腾讯科技（深圳）有限公司 Video processing method, video processing device, intelligent equipment and storage medium

Citations (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
RU2282888C2 (en) * 2001-09-26 2006-08-27 Интерэкт Дивайсиз, Инк. System and method for exchanging signals of audio-visual information
WO2007119236A2 (en) * 2006-04-13 2007-10-25 Yosef Mizrachi Method and apparatus for providing gaming services and for handling video content

Family Cites Families (11)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US5608458A (en) * 1994-10-13 1997-03-04 Lucent Technologies Inc. Method and apparatus for a region-based approach to coding a sequence of video images
WO1997033402A1 (en) * 1996-03-04 1997-09-12 Ericsson Inc. Digital communication system for adapting communications protocol based on a current communication channel condition
JP3413759B2 (en) * 1998-07-17 2003-06-09 株式会社ケンウッド BS digital broadcast receiver
JP3439361B2 (en) * 1999-02-04 2003-08-25 日本電気株式会社 Image encoding device and moving image transmission system
US6711283B1 (en) * 2000-05-03 2004-03-23 Aperio Technologies, Inc. Fully automatic rapid microscope slide scanner
US6999432B2 (en) * 2000-07-13 2006-02-14 Microsoft Corporation Channel and quality of service adaptation for multimedia over wireless networks
WO2003009590A1 (en) * 2001-07-19 2003-01-30 Thomson Licensing S.A. Fade resistant digital transmission and reception system
WO2005065085A2 (en) * 2003-12-21 2005-07-21 Kremen Stanley H System and apparatus for recording, transmitting, and projecting digital three-dimensional images
EP1869599A2 (en) * 2005-03-21 2007-12-26 Yosef Mizrahi Method, system and computer-readable code for providing a computer gaming service
EP1768346A1 (en) * 2005-09-23 2007-03-28 Microsoft Corporation Provision of game applications across a network according to the display characteristics of a user terminal
JP4649615B2 (en) * 2006-02-16 2011-03-16 国立大学法人三重大学 Video encoding / decoding device, video encoding / decoding method, and program thereof

Patent Citations (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
RU2282888C2 (en) * 2001-09-26 2006-08-27 Интерэкт Дивайсиз, Инк. System and method for exchanging signals of audio-visual information
WO2007119236A2 (en) * 2006-04-13 2007-10-25 Yosef Mizrachi Method and apparatus for providing gaming services and for handling video content

Non-Patent Citations (1)

* Cited by examiner, † Cited by third party
Title
KUMAR S. et al. Error resiliency schemes in H.264/AVC standard, Elsevier J. of Visual Communication & Image Representation, Special issue on Emerging H264/AVC Video Coding Standard, vol.17(2), April 2006. *

Also Published As

Publication number Publication date
AU2008333827A1 (en) 2009-06-11
WO2009073825A1 (en) 2009-06-11
EP2218037A1 (en) 2010-08-18
JP2011507346A (en) 2011-03-03
CN101918956A (en) 2010-12-15
TW200935916A (en) 2009-08-16
KR20100112567A (en) 2010-10-19
CA2707715A1 (en) 2009-06-11
RU2010127314A (en) 2012-01-10
NZ585904A (en) 2013-06-28
EP2218037A4 (en) 2013-06-05
TW200952496A (en) 2009-12-16

Similar Documents

Publication Publication Date Title
RU2487407C2 (en) System and method of compressing streaming interactive video
US9800883B2 (en) Parallel video transcoding
CN104394486B (en) A kind of video stream processing method and device based on cloud desktop
US7423978B2 (en) Delivery of streaming media
AU2015296540B2 (en) Receiver driven up-switching in video telephony
AU2008202703B2 (en) Apparatus and method for providing multimedia content
JP2012521722A5 (en)
WO2020220902A1 (en) Method and apparatus for distributing transmission parameters of video resources
US20170347159A1 (en) Qoe analysis-based video frame management method and apparatus
US10869072B2 (en) Audio-visual quality estimation device, method for estimating audio-visual quality, and program
CN101795264A (en) Video data transmission method and system
KR20100106383A (en) Apparatus and method for simulcast over a variable bandwidth channel
Nguyen et al. A client-based adaptation framework for 360-degree video streaming
CN113905257A (en) Video code rate switching method and device, electronic equipment and storage medium
Muntean et al. Region of interest-based adaptive multimedia streaming scheme
KR101795537B1 (en) System and method for providing of cloud streaming service which is adapting to network environment
JP2005322995A (en) Buffer control method in real-time video image transfer, transmitting terminal, receiving terminal, video image distributing system and program
WO2021181724A1 (en) Mathematical model deriving device, mathematical model deriving method and program
US9363574B1 (en) Video throttling based on individual client delay
CN114866763A (en) Video quality evaluation method and device, terminal equipment and storage medium
TWI305467B (en)
Luthra et al. Server-Based Smart Adaptive Bit Rate (SABR) Streaming With Statistical Multiplexing
JP5592913B2 (en) Video encoding apparatus, video encoding method, and video encoding program
KR20220068636A (en) System and method for providing ultra low latency over the top service
JP2012004970A (en) Content distribution apparatus, distribution server device and program

Legal Events

Date Code Title Description
PC41 Official registration of the transfer of exclusive right

Effective date: 20150522