JP2023547287A - Systems, methods, and computer-readable media for rendering streaming - Google Patents

Abstract

Systems, methods, and computer-readable media for rendering streaming. The present invention relates to a system, method, and computer-readable medium for rendering a stream at a user terminal, the method comprising: rendering a stream in a first mode; and an environment of the user terminal. a step of receiving a parameter; a step of receiving a timing at which the user terminal closes streaming; a step of determining a threshold value of the environmental parameter based on the timing at which the user terminal closes streaming; and updating the user terminal. and, if the updated environmental parameter reaches a threshold, rendering the streaming in a second mode, the second mode being the first one. mode, or include downgraded versions of the data objects in the first mode in the rendering. The present invention can customize the rendering mode for each user and maximize the satisfaction level of streaming viewing for each user. [Selection diagram] Figure 3

Description

The present invention relates to systems, methods, and computer-readable media for rendering streaming.

Live streaming refers to the simultaneous recording and broadcasting of online streaming media or live video in real time. Live streaming topics range from social media to video games to professional sports.

User interaction through chat rooms is also a major feature of live streaming. Traditionally, applications and platforms for viewing live streaming provide features such as sending gifts and games to increase the viewer's desire to participate in the live streaming, and engage viewers and streamers (or broadcasters) We are deepening our exchanges.

It is an object of the present invention to provide a system, method, and computer-readable medium for rendering streaming.

A method according to an embodiment of the invention is a method for rendering a stream on a user terminal executed by one or more computers, comprising: rendering the stream in a first mode; a step of receiving an environmental parameter of the user terminal; a step of receiving a timing at which the user terminal closes streaming; a step of determining a threshold value of the environmental parameter based on the timing at which the user terminal closes streaming; and, if the updated environmental parameters reach a threshold, rendering the streaming in a second mode. The second mode includes fewer data objects than the first mode, or includes downgraded versions of the data objects in the first mode for rendering.

A system according to one embodiment of the invention is a system for rendering streaming at a user terminal that includes one or more processors, the one or more computer processors executing machine-readable instructions to render the streaming. Rendering in a first mode; receiving environmental parameters of the user terminal; receiving timing for the user terminal to close streaming; and based on the timing for the user terminal to close streaming; determining a threshold for an environmental parameter; receiving the updated environmental parameter of the user terminal; and rendering the streaming in a second mode if the updated environmental parameter reaches the threshold; , the second mode includes fewer data objects than the first mode, or includes downgraded versions of the data objects in the first mode for rendering.

A computer-readable medium according to one embodiment of the present invention is a non-transitory computer-readable medium that includes a program for rendering streaming at a user terminal, the program causing one or more computers to a step of receiving an environmental parameter of the user terminal, a step of receiving a timing at which the user terminal closes the streaming, and a step of rendering the environmental parameter based on the timing at which the user terminal closes the streaming. receiving updated environmental parameters of the user terminal; and rendering the streaming in a second mode if the updated environmental parameters reach the threshold. When executed, the second mode includes fewer data objects than the first mode, or includes downgraded versions of the data objects in the first mode for rendering.

1 is a schematic diagram illustrating a configuration of a communication system according to some embodiments of the present invention. FIG. 1 is an exemplary functional block diagram of a communication system according to some embodiments of the present invention. FIG. 1 is an exemplary sequence diagram illustrating the operation of a communication system according to some embodiments of the present invention. FIG. 1 is a flowchart illustrating steps according to some embodiments of the invention.

Streams that a user (such as a viewer) views on a display of a user terminal (such as a smartphone) are the result of processing or rendering various data objects. Some data objects reside on the user terminal (e.g., were downloaded with an application used to view a live stream), while others are received by the user terminal over a network. For example, in a live streaming chat room, data objects include streaming data from other users (such as streamers), live video/audio data, and other objects used to perform functions such as games, special effects, gifts, or avatars. can include.

For providers of live streaming (which may also be providers of applications through which viewers view live streaming), it is important that viewers enjoy the streaming as long as possible, ie stay in the chat room. Prevent viewers from leaving your stream or chat room due to environmental or device factors such as poor network quality or device overload that can cause delays, lags, or freezes that can ruin the viewing experience. This is very important.

Therefore, a method to ensure a smooth viewing experience under various environment or device conditions is essential. The present invention provides systems, methods, and computer-readable media that can dynamically or adaptively adjust data objects used to render a stream to optimize the viewing experience based on user behavior and preferences under various conditions. It provides:

FIG. 1 shows a schematic diagram showing the configuration of a communication system 1 based on some embodiments of the present invention. The communication system 1 provides a live streaming service with interaction through content. "Content" here refers to digital content that can be played back on a computer device. In other words, the communication system 1 allows users to participate in real-time interactions with other users online. The communication system 1 includes a plurality of user terminals 10, a backend server 30, and a streaming server 40. The user terminal 10, the backend server 30, and the streaming server 40 are connected via a network 90 (for example, the Internet may be used). Backend server 30 may be a server that synchronizes interactions between user terminals and/or streaming server 40 . In some implementations, backend server 30 may be an application (APP) provider's backend server. Streaming server 40 is a server for handling or providing streaming data or video data. In some embodiments, the streaming server 40 may be a server from a CDN (Content Delivery Network) provider. In some implementations, backend server 30 and streaming server 40 may be independent servers. In some implementations, backend server 30 and streaming server 40 may be integrated into one server. The user terminal 10 is a client device for live streaming. In some implementations, user terminal 10 may be referred to as a viewer, streamer, anchor, podcaster, audience, listener, etc. The user terminal 10, the backend server 30, and the streaming server 40 are each examples of information processing devices. In some implementations, streaming can be live streaming or video playback. In some implementations, streaming can be audio streaming and/or video streaming. In some implementations, streaming can include content such as online shopping, talk shows, talent shows, entertainment events, sporting events, music videos, movies, comedies, concerts, and the like.

FIG. 2 shows an exemplary functional configuration diagram of the communication system 1. In this embodiment, the user terminal 10 includes a UI unit 102, a storage unit 104, a user behavior tracker 106, an environmental condition tracker 108, a controller 110, a renderer 112, a decoder 114, and a display 116. In some implementations, each of the components described above may be considered a processing unit or processor.

The UI unit 102 is an interface through which the user of the user terminal 10 operates or plays an application, and in some embodiments, the application may be an application that provides a streaming service. The user behavior tracker 106 is configured to monitor or track the behavior or operation of the user terminal 10 and provide the results to the controller 110. For example, the operations may include joining/opening a stream or leaving/closing a stream on the app.

The storage unit 104 is configured to store the program of the app, including instructions or data objects necessary for the app to operate on the user terminal 10 . The storage unit 104 can be configured with, for example, DRAM. In some implementations, the storage unit 104 is comprised of, for example, a magnetic disk, flash memory, or the like. The storage unit 104 stores various programs including an OS, various data, and the like.

The environmental condition tracker 108 is configured to monitor or track the environmental conditions under which the app operates and provide the results to the controller 110. The environmental condition tracker 108 can detect various environmental parameters related to streaming operation/playback and thus the user's viewing experience. In some embodiments, the environmental parameters include CPU usage of the user terminal 10, memory usage of the user terminal 10, time or number of times freezes or lags occur during streaming, A network quality parameter indicating the length of time during which the FPS (frames per second) number is less than or equal to a predetermined value and the quality of the network 90 may be included. For example, such network quality parameters may include Application Programming Interface (API) response time, Transmission Control Protocol (TCP) connection time, Domain Name System (DNS) lookup time, Security Sockets Layer (SSL) handshake time, and network quality parameters. This may include downstream bandwidth for streaming services via.

The controller 110 receives user behavior data and environmental parameters from the user behavior tracker 106 and the environmental condition tracker 108 and determines how to render or present subsequent streams. For example, the controller determines a rendering mode based on user behavior data and environmental parameters, accesses the storage unit 104 and/or streaming server 40, and directs the renderer 112 to perform streaming rendering for the corresponding data object. can be instructed.

In some embodiments, the controller 110 is configured as a CPU, GPU, etc., and loads various programs stored in the storage unit 104, etc., which may be part of an application, into a main memory (not shown), Executes various commands and machine-readable instructions contained in a program.

The decoder 114 is configured to convert streaming data from the streaming server 40 into video data or frame images for the renderer 112 to render the stream. The streaming data may be provided to the streaming server 40 by another user, sometimes referred to as a streamer, broadcaster, or anchor. There may be various versions or grades of streaming data from one streamer. For example, the streaming server 40 may receive streaming media from a streamer and convert it into versions with different resolutions, such as 360p, 480p, 720p, etc. Different versions or grades of streaming data may be stored on the streaming server 40 at different URLs (uniform resource locators). In some implementations, the URLs are assigned by the backend server 30 and directed to the user terminal 10 by the backend server 30. The decoder 114 can reach the URL of streaming data of a particular grade according to the rendering mode determined by the controller 110.

The renderer 112 receives an instruction regarding a rendering mode from the controller 110, receives a data object corresponding to the rendering mode from the storage unit 104, and receives streaming data (another data object and another data object) corresponding to the rendering mode from the decoder 114. The streaming media may be configured to receive the streaming media (which may also be referred to as a streaming media service) and render the streaming media to the display 116. The display 116 can be or include a screen on which the user terminal 10 can enjoy streaming media.

FIG. 3 shows an exemplary sequence diagram illustrating the operation of the communication system 1 according to some embodiments of the present invention.

In step S1, the controller 110 instructs the renderer 112 to render streaming or streaming media in a first mode, such as joining or opening a stream on an app. According to the user's operation. In step S2, the renderer 112 receives a data object corresponding to the first mode from the storage unit 104. In step S3, the renderer 112 receives streaming data or video data (which may be from another user) corresponding to the first mode from the decoder 114. In step S4, the rendered streaming is displayed on the display 116.

In some implementations, the first mode indicates a higher performance mode, which allows the renderer 112 to extract more or higher grade data from the storage unit 104 for streaming rendering. data objects and/or to obtain a high-resolution version of the streaming data from the decoder 114.

In step S5, the controller 110 receives various environmental parameters from the environmental condition tracker 108. In step S6, the user behavior tracker 106 monitors the user's behavior via the UI unit 102. In step S7, the user behavior tracker 106 detects when the user closes or turns off streaming and reports it to the controller 110.

In step S8, the controller 110 determines a threshold value for each of the environmental parameters based on the timing at which the user closes streaming. The threshold may be used by the controller 110 to determine subsequent rendering modes in comparison to environmental parameters obtained through subsequent monitoring.

In some implementations, the threshold value of the environmental parameter may be determined by a predetermined offset from the received value of the environmental parameter at the time the user closes streaming. For example, regarding the CPU usage rate parameter of the user terminal, if the CPU usage rate received at the timing when the user closes streaming is N1%, the CPU usage rate threshold is (N1-T1)% (of which T1 is a predetermined value). may be determined to be an offset of In some embodiments, T1 may be between 2.5 and 5. In another example, regarding the memory usage rate parameter of the user terminal, if the memory usage rate received at the timing when the user closes streaming is N2%, the memory usage rate threshold is (N2-T2)% (of which , T2 is a predetermined offset). In some embodiments, T2 may be between 2.5 and 5.

In some implementations, the environmental parameter may include the number of times freezing or lag occurred while rendering the stream in the first mode. Freezes and lags indicate that streaming content or the entire user device is paused, stopped, or delayed, for example, for a period of about 2 to 5 seconds. For example, if N3 is the number of times a freeze or lag is detected within a certain period of time (e.g., 3 minutes, 5 minutes, 10 minutes) before the user closes the stream, then T3 is e.g. 2, 3, or 5. A threshold (N3-T3) may be determined, which may be a predetermined value, where T3 may be a predetermined value (eg, 2 or 3, 5).

In some implementations, the environmental parameter may include the length of time that the number of FPS (frames per second) that the stream is being rendered is below a specified value. For example, if the FPS remains below a specified value (e.g. 30 frames) for N4 seconds within a specific period (e.g. 3 minutes, 5 minutes, 10 minutes) before the user closes the stream. , a threshold (N4-T4) seconds can be determined, of which T4 can be a predetermined value, for example, from 2 to 5.

In some implementations, the environmental parameters include network quality parameters whose values are determined by quality factors such as API response time, TCP connection time, DNS lookup time, SSL handshake time, and downstream bandwidth. be able to. For example, the score for each of the above factors may be determined according to Table 1 below, and the value of the network quality parameter may be the average value of the scores for each factor considered. Depending on the actual application or practice, all or some of the factors can be considered to determine the network quality parameters. In some implementations, some quality factors may be weighted higher than others when calculating network quality parameters.

In some implementations, if the value of the network quality parameter is N5 near the time the user closes the stream, a threshold (N5+T5) may be determined, where T5 is a predetermined value, e.g., 5 to 10. It can be done. The threshold value (N5+T5) indicates a stricter criterion for switching subsequent streaming rendering to a lower performance or less demanding mode (e.g., a second mode) before the network quality parameter decreases to the value of N5. I can do it.

In step S9, the threshold determined in step S8 is stored in the storage unit 104. In step S10, the controller 110 again receives environmental parameters (or updated environmental parameters) from the environmental condition tracker 108. In step S11, the controller 110 reads the threshold value of the environmental parameter stored in the storage unit 104.

In step S12, the controller 110 compares the threshold value with the environmental parameter and checks whether any environmental parameter satisfies or reaches the threshold value. In some implementations, if any environment reaches its threshold, the controller 110 decides to render the streaming in a second mode and accordingly in step S13, e.g. The renderer 112 is instructed to operate according to the user's operation of rejoining the streaming or reopening the streaming. In step S12, if no environmental parameter has reached its threshold, the controller 110 decides to maintain the first mode of rendering and instructs the renderer 112 to act accordingly, and the flow continues. A return may be made to step S1, which may be, for example, in accordance with a user operation of rejoining the streaming on the app or reopening the streaming.

In step S14, the renderer 112 receives a data object corresponding to the second mode from the storage unit 104. In step S15, the renderer 112 receives streaming data or video data (which may be from another user) corresponding to the second mode from the decoder 114. In step S16, the rendered streaming is displayed on the display 116.

In some implementations, the second mode represents a lower performance mode, which allows the renderer 112 to load the storage unit 104 (compared to the first mode) from the storage unit 104 for streaming rendering. including) fewer or lower grade data objects (compared to the first mode) and/or lower resolution (compared to the first mode) of streaming data from said decoder 114; or request to obtain a downgraded version.

In some implementations, the environmental parameter that is found to have reached a threshold is CPU usage, memory usage, number of freezes or lags during rendering of the stream in the first mode, or If the streaming mode includes a length of time in which the rendered FPS is below a predetermined value, then the second mode, as directed by the controller 110, renders a gift as compared to the first mode. Fewer special effects, game features, avatars, or animations. Rendering a stream with fewer gifts, special effects, game features, avatars, or animations can ease or reduce the load on the user device in terms of CPU usage and memory usage, reducing freezes and lags. The number of times this can occur or the length of time that FPS is below a desired or sufficient value can be reduced. This rendering mode adaptation can improve the user experience by preventing users from closing or leaving the stream due to unsmooth rendering.

In some embodiments, the environmental parameter for which the threshold is found to have been reached is a network quality parameter determined by API response time, TCP connection time, DNS lookup time, SSL handshake time, and/or downstream bandwidth. , the second mode directed by the controller 110 requires downloading of video data from other users for rendering as compared to the video data (e.g., 720p) used in the first mode. A grade version (eg, 360p or 480p) may be included. By rendering the streaming with a downgraded version of the video data, the load on the user terminal regarding the network connection state can be reduced or alleviated. This rendering mode adaptation can improve the user experience by preventing users from closing or leaving the stream due to unsmooth rendering.

FIG. 4 is a flowchart illustrating steps according to some embodiments of the invention. FIG. 4 shows how the threshold for the environmental parameter is dynamically updated for each user terminal.

In step S400, the streaming is rendered. This may be the first mode, the second mode, or any default mode. In step S402, the environmental parameters are monitored, for example, by the environmental condition tracker 108. In step S404, for example, the user behavior tracker 106 detects that the streaming has been closed.

In step S406, the viewing time of the streaming is compared to a predetermined period V1, which may be performed by the controller 110, for example. If the viewing time is equal to or greater than V1, the flow proceeds to step S408 and the thresholds for all parameters remain unchanged. In this case, the user is determined to have left the stream for reasons unrelated to the monitored environmental parameters, and the environmental parameter thresholds used to determine the rendering mode for subsequent streaming viewing may be updated or tightened. There is no need to do this. For example, if the viewing time is greater than the predetermined period V1, it may indicate that the user is already satisfied with the streaming. In some embodiments, the predetermined period V1 may be 30 minutes or more, or 60 minutes or more.

If the viewing time is found to be less than the predetermined period V1, then in step S406 it can be assumed that closing the streaming is related to the environmental parameter and the flow continues to step S410.

In step S410, the monitored environmental parameters are checked, for example by the controller 110, whether their values are within their respective safety ranges. If all such environmental parameters are within the safe range, flow proceeds to step S408 and the thresholds for all parameters remain unchanged. If any environmental parameter is greater than or exceeds its safety range, flow continues to step S412.

The safe area is a range of corresponding environmental parameters in which it is considered unlikely that an excessive burden will be placed on the user terminal due to streaming rendering. In other words, if a detected environmental parameter is in that safe area when the stream is closed, that environmental parameter will not be considered the cause of the poor viewing experience that may have resulted in the stream being closed. ,Therefore, there is no need to update or tighten the,thresholds of its environmental parameters used to determine the,rendering mode of subsequent streams. The range of each safety area can be defined according to the actual application. Examples are shown in Table 2 below.

In step S412, updated thresholds are assigned to the environmental parameters found to be outside their respective safety ranges. An example of the threshold updating method is as described in the explanation regarding step S8 in FIG. 3, and a similar method may be applied in step S412.

Environmental parameters outside the safe range are likely to result in the user closing the stream because the particular environmental parameter has reached a value that impairs or degrades the user's viewing experience. For example, CPU usage of 80% can impair the viewing experience, which can occur when a user operates various applications at the same time. Therefore, an updated, more stringent threshold for that environmental parameter is required for that particular user to prevent that user from leaving the stream for the same reason on subsequent streaming viewings. For example, the CPU usage threshold for that particular user terminal may be updated to 75% of (80-5)%. According to this method, the next time the user is watching a stream and the CPU usage increases until it reaches 75%, the rendering mode is switched (e.g., switched to the second mode described above). , including fewer data objects (e.g. gifts, game features, avatars, special effects, etc.) or downgraded versions of data objects (e.g. streaming data or other users' video data) to reduce the load on the user terminal. It is possible to reduce and alleviate the problem and maintain a satisfying viewing experience.

After step S408 or step S412, the flow may return to step S400 for subsequent streaming rendering, which may continue, for example, the next time the user terminal starts streaming.

Embodiments of the present invention dynamically or adaptively adjust rendering modes for streaming on a user terminal based on environmental parameters of the user terminal to ensure a satisfactory viewing experience on the user terminal. Methods, systems, and computer-readable media for switching are disclosed. The monitored environmental parameters are compared with respective threshold values to determine whether a rendering mode switching is necessary to reduce the load on the user terminal and perform smooth rendering. The setting of the threshold value of the environmental parameter may vary greatly from user to user, as it is set depending on the relationship and correlation between each user's behavior and the environmental parameter monitored by the user terminal of that user. It is.

Different users may have different tolerance levels regarding different environmental parameters. For example, if user A turns off streaming whenever the network quality parameter reaches or drops to 70, and user B turns off streaming whenever the network quality parameter reaches or drops to 60, then user A and user B The network quality parameter thresholds may be set to 75 (70+5) and 65 (60+5). The threshold value of each user terminal is dynamically and continuously adjusted according to each user's behavior and preferences as described above. The present invention can effectively maximize each user's streaming viewing satisfaction by dynamically switching rendering modes based on thresholds of various environmental parameters customized for each user.

In some implementations, there may be a learning period before setting the threshold for the environmental parameter. A learning period is a period during which a user's action to close a stream is not immediately used to determine or update a threshold. For example, during the initial stages of a user watching a stream on an app, a learning period allows the system or app to learn the user's (or user terminal's) behavioral patterns. In the learning process, through watching the stream several times, the app can understand or calculate the correlation between the user's actions (such as closing the stream) and various environmental parameters. Therefore, the degree of interest and tolerance of the user regarding each environmental parameter can be ascertained, and the priority and degree of strictness of threshold setting for various environmental parameters can be determined. In some implementations, the learning period can be a predetermined period of time, which can be, for example, one week or one month. In some implementations, the learning period may be a variable period until the user terminal finishes viewing the stream X1 times, where X1 times may be, for example, 5 to 10 times.

For example, during the learning period, user A is more influenced by the network quality parameter, i.e. the closing behavior is highly correlated with low values of the network quality parameter, and the correlation with other environmental parameters is high. If found to be low, a threshold for the network quality parameter can be set and then thresholds for other environmental parameters can be set. Such a mechanism prevents streaming from being unnecessarily downgraded (e.g., from a first mode to a second mode) due to changes in other environmental parameters that are of no concern to the user. can.

In some implementations, for example, there may be a mechanism in which the controller 110 relaxes the threshold value of the environmental parameter when a certain condition is met. For example, if an environmental parameter reaches a threshold and the streaming is switched to a lower-performance rendering mode accordingly, the user on the app providing the streaming An option may be provided that allows the user to revert to normal/default/higher performance rendering mode.

In some implementations, a user may continuously (e.g., three or five times in a row) request higher performance rendering for a particular environmental parameter (even though that environmental parameter has already reached a threshold). When implementing the option to request a mode, the environmental parameter thresholds may be set more relaxed for subsequent streaming rendering, depending on the user's personal preferences. For example, if the environment parameter in question is CPU usage, each time the rendering mode is downgraded because the CPU usage reaches the original threshold of 70%, the user is given the option to revert back to a higher performance rendering mode in succession. If implemented, the threshold can be relaxed from 70% to 75%.

The processes and procedures described in this invention, in addition to those explicitly described, may be implemented by software, hardware, or any combination thereof. For example, the processes and procedures described herein implement logic corresponding to the processes and procedures in a medium such as an integrated circuit, volatile memory, non-volatile memory, non-transitory computer-readable medium, magnetic disk, etc. This can be achieved by Further, the processes and procedures described in this specification can be realized as a computer program corresponding to the processes and procedures, and can be executed by various computers.

In some embodiments, the factors, subscores, scores, and weights are selected for specific data or operations such that more recent data or operations are more relevant when calculating the factors, subscores, scores, and weights. A damping element may be included to reduce the intensity over time. The factors, subscores, scores, and weights may be continuously updated based on continued tracking of data or operations. Any type of process or algorithm may be employed to assign, combine, average, etc. the scores of each element and the weights assigned to the elements and scores. In certain embodiments, the highlight detection unit 35 uses a machine learning algorithm trained based on historical data, past operations, and past user terminal responses, or by exposing the user terminal to various options to respond. The data collected from the user terminal by measuring can be used to determine factors, subscores, scores and weights. In some embodiments, the factors, subscores, scores, and weights may be determined in any suitable manner.

Additionally, the systems or methods described in the above embodiments may be integrated into programs stored on non-transitory computer-readable media, such as solid state storage, optical disk storage, magnetic disk storage, and the like. Alternatively, the program may be downloaded from a server via the Internet and executed by the processor.

Although the technical contents and features of the present invention have been described above, those with ordinary knowledge in the technical field to which the present invention pertains will appreciate that many variations and modifications can be made without departing from the teachings and disclosure of the present invention. It can be performed. Therefore, the scope of the invention is not limited to the embodiments already disclosed, but includes other variations and modifications that do not depart from the invention and are included in the scope of the claims.

1 Communication system 10 User terminal 102 UI unit 104 Storage unit 106 User behavior tracker 108 Environmental condition tracker 110 Controller 112 Renderer 114 Decoder 116 Display 30 Back-end server 40 Streaming server 90 Network

Claims (19)

A method for rendering streaming on a user terminal, the method comprising:
rendering the streaming in a first mode;
receiving environmental parameters of the user terminal;
the user terminal receiving timing to close the streaming;
determining a threshold value for the environmental parameter based on a timing at which the user terminal closes the streaming;
receiving updated environmental parameters of the user terminal;
rendering the streaming in a second mode if the updated environmental parameter reaches the threshold;
Streaming, wherein the second mode includes fewer data objects for rendering than the first mode, or includes downgraded versions of data objects in the first mode. How to render. A method according to claim 1, characterized in that the threshold value of the environmental parameter is determined by a predetermined offset from the value of the environmental parameter at which the user terminal closes the streaming. . The method of rendering streaming according to claim 2, characterized in that the environmental parameter is a CPU usage rate of the user terminal or a memory usage rate of the user terminal. The environmental parameter is characterized in that the number of occurrences of freezing or lag during rendering of the streaming in the first mode within a specific period before the timing at which the user terminal closes the streaming. , A method for rendering streaming according to claim 2. Streaming according to claim 2, characterized in that the environmental parameter is the length of time during which the number of FPS (frames per second) during which the streaming is rendered in the first mode is below a specified value. How to render. Claim characterized in that the environmental parameter is a network quality parameter determined by quality factors including API response time, TCP connection time, DNS lookup time, SSL handshake time, or downstream bandwidth. 2. The method for rendering streaming as described in 2. The method of rendering streaming according to claim 1, characterized in that the data objects include gifts, special effects, game features, avatars, animations, or video data from another user. 3. The data objects include gifts, special effects, game features, avatars, or animations, and the second mode includes fewer data objects for rendering than the first mode. 6. The method of rendering streaming according to any one of 5 to 5. Streaming according to claim 6, characterized in that the data object includes video data from another user, and the second mode includes a downgraded version of the video data from another user in rendering. How to render. Claim characterized in that the score of each quality element is defined based on the performance grade of the quality element, and the value of the network quality parameter is determined to be the average of the scores of the quality element. 6. The method of rendering streaming as described in 6. The step of determining a threshold value of the environmental parameter comprises:
defining a safe area for the environmental parameters;
determining whether the environmental parameter is within the safe range at a timing when the user terminal closes the streaming;
If the environmental parameter is within the safe range at the timing when the user terminal closes the streaming, maintaining the threshold value as it is;
If the environmental parameter is outside the safe area at the timing when the user terminal closes the streaming, tightening the threshold;
A method for rendering streaming according to claim 1, characterized in that the method comprises: moreover,
receiving a plurality of environmental parameters of the user terminal during a learning period;
receiving a plurality of timings when the user terminal closes the streaming during the learning period;
calculating a correlation between the action of the user terminal to close the streaming and each environmental parameter;
determining a threshold for an environmental parameter that is most highly correlated with the action of the user terminal to close the streaming, and then determining thresholds for the remaining environmental parameters;
A method for rendering streaming according to claim 1, characterized in that the method comprises: A system for rendering streaming on a user terminal, the system comprising one or more processors, the one or more processors executing machine-readable instructions;
rendering the streaming in a first mode;
receiving environmental parameters of the user terminal;
the user terminal receiving timing to close the streaming;
determining a threshold value for the environmental parameter based on a timing at which the user terminal closes the streaming;
receiving updated environmental parameters of the user terminal;
rendering the streaming in a second mode if the updated environmental parameter reaches the threshold;
, wherein the second mode includes fewer data objects in rendering than the first mode, or includes downgraded versions of the data objects in the first mode. A system for rendering streaming. 14. For rendering a stream according to claim 13, characterized in that the threshold value of the environmental parameter is determined by a predetermined offset from the value of the environmental parameter at which the user terminal closes the streaming. system. The environmental parameters include a CPU usage rate of the user terminal, a memory usage rate of the user terminal, and rendering of the streaming in the first mode within a specific period before a timing at which the user terminal closes the streaming. the number of times freezes or lags occur in the first mode; the amount of time the stream is rendered in FPS (frames per second) is below a specified value in the first mode; or API response time, TCP connection time, DNS look 14. The system for rendering streaming according to claim 13, characterized in that the network quality parameters are determined by quality factors including up time, SSL handshake time, or downstream bandwidth. 14. A system for rendering streaming according to claim 13, characterized in that the data objects include gifts, special effects, game features, avatars, animations, or video data from another user. The step of determining a threshold value of the environmental parameter comprises:
defining a safe area for the environmental parameters;
determining whether the environmental parameter is within the safe range at a timing when the user terminal closes the streaming;
If the environmental parameter is within the safe range at the timing when the user terminal closes the streaming, maintaining the threshold value as it is;
If the environmental parameter is outside the safe area at the timing when the user terminal closes the streaming, tightening the threshold;
14. A system for rendering streaming according to claim 13, characterized in that it comprises: The one or more processors execute machine readable instructions, and further:
receiving a plurality of environmental parameters of the user terminal during a learning period;
receiving a plurality of timings when the user terminal closes the streaming during the learning period;
calculating a correlation between the action of the user terminal to close the streaming and each environmental parameter;
determining a threshold for an environmental parameter that is most highly correlated with the action of the user terminal to close the streaming, and then determining thresholds for the remaining environmental parameters;
14. The system for rendering streaming according to claim 13, characterized in that the system performs the following. A non-transitory computer-readable medium comprising a program for rendering streaming on a user terminal, the program comprising:
rendering the streaming in a first mode;
receiving environmental parameters of the user terminal;
the user terminal receiving timing to close the streaming;
determining a threshold value for the environmental parameter based on a timing at which the user terminal closes the streaming;
receiving updated environmental parameters of the user terminal;
rendering the streaming in a second mode if the updated environmental parameter reaches the threshold;
, wherein the second mode includes fewer data objects in rendering than the first mode, or includes downgraded versions of the data objects in the first mode. Non-transitory computer-readable medium.