CN113596561A - Video stream playing method and device, electronic equipment and computer readable storage medium - Google Patents
Video stream playing method and device, electronic equipment and computer readable storage medium Download PDFInfo
- Publication number
- CN113596561A CN113596561A CN202110861883.5A CN202110861883A CN113596561A CN 113596561 A CN113596561 A CN 113596561A CN 202110861883 A CN202110861883 A CN 202110861883A CN 113596561 A CN113596561 A CN 113596561A
- Authority
- CN
- China
- Prior art keywords
- video stream
- input
- target
- rendering
- scale
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
Images
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
- H04N21/431—Generation of visual interfaces for content selection or interaction; Content or additional data rendering
- H04N21/4312—Generation of visual interfaces for content selection or interaction; Content or additional data rendering involving specific graphical features, e.g. screen layout, special fonts or colors, blinking icons, highlights or animations
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
- H04N21/44—Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream, rendering scenes according to MPEG-4 scene graphs
- H04N21/44008—Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream, rendering scenes according to MPEG-4 scene graphs involving operations for analysing video streams, e.g. detecting features or characteristics in the video stream
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
- H04N21/44—Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream, rendering scenes according to MPEG-4 scene graphs
- H04N21/44012—Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream, rendering scenes according to MPEG-4 scene graphs involving rendering scenes according to scene graphs, e.g. MPEG-4 scene graphs
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/47—End-user applications
- H04N21/485—End-user interface for client configuration
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/47—End-user applications
- H04N21/485—End-user interface for client configuration
- H04N21/4858—End-user interface for client configuration for modifying screen layout parameters, e.g. fonts, size of the windows
Abstract
The present disclosure relates to a video stream playing method, device, electronic device and computer readable storage medium, the video stream playing method comprising: playing the target video stream; receiving an adjustment input for adjusting a rendering area of a target video stream; and adjusting the rendering area of the target video stream according to the adjustment input. By configuring the function of the adjustment input, the rendering area of the target video stream in the picture can be adjusted according to the adjustment input in the process of playing the target video stream, so that the rendering area is not fixed any more, a user can freely change the playing style of the video stream according to own preference, and the playing flexibility is improved.
Description
Technical Field
The present disclosure relates to the field of mobile internet applications, and in particular, to a method and an apparatus for playing a video stream, an electronic device, and a computer-readable storage medium.
Background
The live broadcast room is a basic place for audience to consume live broadcast audio and video streams, and electronic equipment such as mobile phones of the audience can pull stream addresses to the local from a server side and then decode and play the stream addresses to obtain watching experience. The video streams viewed on the mobile phone are all streams processed by the server, and rendering areas in the mobile phone pictures are fixed, so that the flexibility of the playing mode of the video streams is poor.
Disclosure of Invention
The present disclosure provides a video stream playing method, device, electronic device and computer readable storage medium, so as to at least solve the problems of fixed playing style and poor flexibility in the related art.
According to a first aspect of the present disclosure, there is provided a video stream playing method, including: playing the target video stream; receiving an adjustment input for adjusting a rendering area of the target video stream; and adjusting the rendering area of the target video stream according to the adjustment input.
Optionally, the adjustment input comprises a scaling input to adjust a size of a rendering region, the scaling input comprising a first scaling input to scale the size of the rendering region of the target video stream to a first scale and a second scaling input to scale the size of the rendering region of the target video stream to a second scale to scale the size of the rendering region of the target video stream to the second scale.
Optionally, in a case that the target video stream is a composite video stream composed of at least two original video streams, before receiving the adjustment input, the video stream playing method further includes: receiving a selection input selecting a target rendering region corresponding to a target original video stream of the at least two original video streams; and sending a switching request to a server according to the selected input, wherein the switching request is used for requesting the server to switch the issued composite video stream into the at least two original video streams.
Optionally, the adjusting input includes a movement input for adjusting a position of a rendering region, and the adjusting the rendering region of the target video stream according to the adjusting input includes: adjusting a position of the target rendering area according to the movement input to the target rendering area; and under the condition that the change of the position of the target rendering area meets the set condition, switching the arrangement mode of the rendering areas of the at least two original video streams.
Optionally, the determining that the change in the position of the target rendering area satisfies a set condition includes: and determining that the moving distance of the target rendering area and the height or width of the target rendering area meet a set relation.
According to a second aspect of the present disclosure, there is provided a video stream playback apparatus including: a playback unit configured to: playing the target video stream; a receiving unit configured to: receiving an adjustment input for adjusting a rendering area of the target video stream; an adjustment unit configured to: and adjusting the rendering area of the target video stream according to the adjustment input.
Optionally, the adjustment input comprises a scaling input to adjust a size of a rendering region, the scaling input comprising a first scaling input to scale the size of the rendering region of the target video stream to a first scale and a second scaling input to scale the size of the rendering region of the target video stream to a second scale to scale the size of the rendering region of the target video stream to the second scale.
Optionally, in a case where the target video stream is a composite video stream composed of at least two original video streams, the receiving unit is further configured to: prior to receiving the adjustment input, receiving a selection input selecting a target rendering region corresponding to a target original video stream of the at least two original video streams; the video stream playing apparatus further includes a request unit configured to: and sending a switching request to a server according to the selected input, wherein the switching request is used for requesting the server to switch the issued composite video stream into the at least two original video streams.
Optionally, the adjustment input comprises a movement input to adjust the position of the rendering area, the adjustment unit is further configured to: adjusting a position of the target rendering area according to the movement input to the target rendering area; and under the condition that the change of the position of the target rendering area meets the set condition, switching the arrangement mode of the rendering areas of the at least two original video streams.
Optionally, the adjusting unit is further configured to: and determining that the moving distance of the target rendering area and the height or width of the target rendering area meet a set relation.
According to a third aspect of the present disclosure, there is provided an electronic device comprising: at least one processor; at least one memory storing computer-executable instructions, wherein the computer-executable instructions, when executed by the at least one processor, cause the at least one processor to perform a video stream playback method according to the present disclosure.
According to a fourth aspect of the present disclosure, there is provided a computer-readable storage medium, wherein instructions, when executed by at least one processor, cause the at least one processor to perform a video stream playback method according to the present disclosure.
According to a fifth aspect of the present disclosure, there is provided a computer program product comprising computer instructions which, when executed by at least one processor, implement a video stream playback method according to the present disclosure.
The technical scheme provided by the embodiment of the disclosure at least brings the following beneficial effects:
according to the video stream playing method and the video stream playing device disclosed by the embodiment of the disclosure, by configuring the function of the adjustment input, the rendering area of the target video stream in the picture can be adjusted according to the adjustment input in the process of playing the target video stream, so that the rendering area is not fixed any more, a user can freely change the playing style of the video stream according to the preference of the user, and the playing flexibility is improved.
It is to be understood that both the foregoing general description and the following detailed description are exemplary and explanatory only and are not restrictive of the disclosure.
Drawings
The accompanying drawings, which are incorporated in and constitute a part of this specification, illustrate embodiments consistent with the present disclosure and, together with the description, serve to explain the principles of the disclosure and are not to be construed as limiting the disclosure.
Fig. 1 is a flowchart illustrating a video stream playing method according to an exemplary embodiment of the present disclosure.
Fig. 2 is a block diagram illustrating a video stream playback apparatus according to an exemplary embodiment of the present disclosure.
Fig. 3 is a block diagram of an electronic device according to an example embodiment of the present disclosure.
Detailed Description
In order to make the technical solutions of the present disclosure better understood by those of ordinary skill in the art, the technical solutions in the embodiments of the present disclosure will be clearly and completely described below with reference to the accompanying drawings.
It should be noted that the terms "first," "second," and the like in the description and claims of the present disclosure and in the above-described drawings are used for distinguishing between similar elements and not necessarily for describing a particular sequential or chronological order. It is to be understood that the data so used is interchangeable under appropriate circumstances such that the embodiments of the disclosure described herein are capable of operation in sequences other than those illustrated or otherwise described herein. The embodiments described in the following examples do not represent all embodiments consistent with the present disclosure. Rather, they are merely examples of apparatus and methods consistent with certain aspects of the present disclosure, as detailed in the appended claims.
In this case, the expression "at least one of the items" in the present disclosure means a case where three types of parallel expressions "any one of the items", "a combination of any plural ones of the items", and "the entirety of the items" are included. For example, "include at least one of a and B" includes the following three cases in parallel: (1) comprises A; (2) comprises B; (3) including a and B. For another example, "at least one of the first step and the second step is performed", which means that the following three cases are juxtaposed: (1) executing the step one; (2) executing the step two; (3) and executing the step one and the step two.
Live broadcast is increasingly popular with viewers because it provides instant, wide-range online interaction. Generally, video streams watched by audiences on mobile phones are streams processed by a server, and have a single main video stream and live content with a screen which is fused with two or more video streams. However, in any video stream, the playing style (i.e., the arrangement style of the rendering area of the video stream rendered in the mobile phone screen) is often fixed. Dimensionally, for a single video stream, a conventional handset typically employs 16: the video stream is rendered to the full screen in the proportion of 9, and for the merged video stream, for example, two paths of live PK video streams are merged, 4: and 3, rendering. In addition, for the live content of the connected screen with two or more video streams fused, the arrangement style of the rendering area of each video stream is a fixed template, for example, the style of the connected screen with two persons left and right, a three-person character shape or a four-person character shape, and cannot be adjusted.
Fig. 1 is a flowchart illustrating a video stream playing method according to an exemplary embodiment of the present disclosure.
Referring to fig. 1, in step 101, a target video stream is played. The process of playing the video stream locally mainly comprises the steps of receiving a data packet of the video stream, decoding the data packet to obtain video data, carrying out necessary processing, rendering an image corresponding to the processed video data into a picture to be displayed, wherein an area for displaying the corresponding image in the picture is a rendering area. This is well established in the art and will not be described further herein.
At step 102, an adjustment input to adjust a rendering region of a target video stream is received. By configuring the adjustment input for the rendering area of the target video stream, the input operation can be made consistent with the adjustment result generated by the input operation, thereby being helpful for improving the operation convenience of users.
In step 103, the rendering area of the target video stream is adjusted according to the adjustment input. The rendering area of the target video stream in the picture is adjusted according to the adjustment input, so that the rendering area is not fixed any more, a user can freely change the playing style of the video stream according to own preference, and the playing flexibility is improved.
Optionally, the adjustment input may specifically include a zoom input for adjusting the size of the rendering region and a move input for adjusting the position of the rendering region, and in combination, the flexible adjustment of the rendering region may be achieved. It will be appreciated that the adjustment inputs may be configured to include both zoom and movement inputs, but in the actual adjustment process, the user may choose to perform at least one of the inputs as desired to meet their adjustment needs.
For the zoom input, a zoom-out input and a zoom-in input may be further included. For the case that a device (e.g., a mobile phone, hereinafter referred to as a client) executing the video stream playing method has a touch screen, the zoom-out input may be an input in which two touch points are close to each other, the zoom-in input may be an input in which two touch points are far from each other, and corresponds to an operation gesture of a user, the zoom-out input may correspond to an operation of a user that a pair of directions are retracted inward, and the zoom-in input may correspond to an operation that a pair of directions of the user are expanded outward.
Alternatively, when the rendering area is enlarged in size according to the enlargement input, a part of the rendering area may be caused to go outside the display screen, for which only the rendering area within the screen may be displayed.
Optionally, when the size of the rendering region is adjusted according to the scaling input, the geometric center of the rendering region may be used as an anchor for scaling, and other points of the rendering region may also be used as anchors for scaling, for example, one of the two touch points.
Further, the scaling input includes a first scaling input for scaling the size of the rendered area of the target video stream to a first scale and a second scaling input for scaling the size of the rendered area of the target video stream to a second scale to scale the size of the rendered area of the target video stream to the second scale. When the first zooming input is received, the size of the rendering area of the target video stream is adjusted firstly, so that the user can be interactively responded to the operation of the user and visually and intuitively prompted, and the operation which is currently done can change the size of the rendering area. On this basis, if the second zoom input continues to be received, it indicates that the user does have a desire to zoom the rendering region. The size of the received target video stream is fundamentally scaled to the second proportion, and only the rendering is carried out according to the default size, so that the operation load of the playing equipment is reduced, the playing response speed is improved, and the playing pause is reduced. At this time, the resolution of the target video stream can be positively correlated with the size of the target video stream, and for the case that the scaling input is the reduction input, the data transmission quantity between the server and the playing device can be reduced, and the dependence on the network quality is reduced; for the case that the zoom input is the zoom-in input, the resolution of the target video stream can be improved as required, and the definition of the video image is ensured. Alternatively, the first zoom input may be an input in which two touch points are close to or far from each other, and accordingly, the second zoom input may be an input in which the two touch points continue to be close to or far from each other. Alternatively, the first ratio may be a fixed ratio, for example 85% for a zoom-out input and 115% for a zoom-in input, which may serve both to prompt the user and to facilitate a control scheme and reduce the computational load. The second scale may be associated with the second scaling input and may vary with the degree of scaling of the second scaling input. It will be appreciated that in the event that the second zoom input ceases, the user may be deemed to have adjusted the size of the rendering region, and the rendering region may be fixed at the current size and position; after the second zoom input is stopped, if a new first zoom input is received, the new first zoom input can be executed, and the two inputs are not contradictory.
For the movement input, the movement input may be input in which a touch point moves after staying at the same position for more than a set time period, and the movement input may correspond to an operation gesture of the user, and may correspond to an operation of long pressing the rendering area and dragging the rendering area by a finger of the user.
It is understood that, for a client with an auto-rotation function on a display screen, a rendering area of a target video stream may rotate as the client rotates. For the target video stream with the rendering area adjusted, if the client rotates, the rendering area of the target video stream can be integrally and correspondingly rotated so as to keep the adjustment effect and also can be restored to the original state. Of course, a selection function may also be configured, and the user selects whether to maintain the adjustment effect or restore the original state, which is an implementation manner of the present disclosure and falls within the protection scope of the present disclosure.
In some embodiments, the target video stream is a composite video stream composed of at least two original video streams, and accordingly, the rendering region of the target video stream further includes at least two sub-regions, each sub-region corresponding to one original video stream. It is understood that, in order to improve the visual effect, the rendering area of the target video stream may further include a sub-area located between two adjacent sub-areas for spacing, and this sub-area may be blank, may be the same as the background color, and may be filled with other colors or images.
For this case, before step 102, the video stream playing method according to an exemplary embodiment of the present disclosure further includes: receiving a selection input selecting a target rendering region corresponding to a target original video stream of the at least two original video streams; and sending a switching request to the server according to the selected input, wherein the switching request is used for requesting the server to switch the issued composite video stream into at least two original video streams. By configuring the selected input of the selected target rendering area, the mode of issuing the video stream by the server can be switched in response to the input, so that the client acquires the original video streams, and accordingly, each original video stream is decoded and rendered separately during playing, the rendering area of any original video stream in the original video streams can be adjusted conveniently, and the playing flexibility of the composite video stream is improved sufficiently.
Optionally, in these embodiments, for the movement input, the foregoing step 103 may include: adjusting the position of the target rendering area according to the movement input of the target rendering area; and under the condition that the change of the position of the target rendering area meets the set condition, switching the arrangement mode of the rendering areas of at least two original video streams. By detecting the position change of the target rendering area in response to the movement input, the position change can be compared with a set condition, the movement intention of a user can be predicted, the arrangement modes of the rendering areas of all original video streams can be directly switched according to the predicted movement intention, the movement input of the user can be reduced, the operation load of the movement input detection can be reduced, and the automation level of the playing style adjustment can be improved.
Optionally, determining that the change in the position of the target rendering area satisfies a set condition includes: and determining that the moving distance of the target rendering area and the height or width of the target rendering area meet a set relationship. By comparing the moving distance of the target rendering area with the height or width of the target rendering area, the size of the target rendering area can be used as a reference to predict the movement intention of the user, so that the prediction accuracy is improved, the movement input of the user is effectively reduced, the operation load is reduced, and the automation level of playing style adjustment is improved.
Next, taking live broadcast as an example, an embodiment is described for a case where a target video stream is a single-channel video stream and a case where a target video stream is a multi-channel video stream merged with the target video stream. It is to be understood that the video stream playing method according to the exemplary embodiment of the present disclosure is also applicable to playing of other video streams than live.
Optionally, in an embodiment, when the client pulls to a single live video stream, it is detected that the user performs a two-finger zoom operation on the video stream. When the user performs the double-pointing inward zooming operation, the area of the video rendered by the player is firstly zoomed to 85% by taking the central point as the anchor point, and the purpose of the experience is to interactively respond to the gesture of the user so that the user perceives that the double-pointing zooming can adjust the rendering area of the video stream.
When the user continues zooming, the size of the video stream is reduced according to the operation of the gesture, and the resolution of the video stream is dynamically adjusted, wherein the resolution is 720P when the width of the video stream is larger than 750, and the resolution is 540P when the width of the video stream is smaller than or equal to 750.
And the client scales according to the double fingers, and when the video rendering area is adjusted, the double fingers are lifted up to fix the video rendering area in the adjusted area for display. At the moment, the user can select the video stream by long pressing at the client, black edges exist around the video stream because of reduced display, and the user can move on the mobile phone through fingers to drag the position of the video stream. The above technology is essentially that the client dynamically renders the position of the video stream by recognizing that after the user selects the video, the finger triggers the movement event.
Optionally, in another embodiment, when the client pulls multiple live video streams, 2 people are defaulted to connect the screen left and right and 3 people are defaulted to display the video streams in a character form. And calculating the positions of the multi-path video streams by taking the lower left corner of the mobile phone screen as the 0 starting point of the X axis and the Y axis, the width as the X axis and the height as the Y axis. For example, the positions of the video streams on the left side are calculated to be described as { x 1-x 2, Y1-Y2 } on the coordinates when 2 people are connected, and the positions of the video streams on the right side are described as { x 3-x 4, Y1-Y2 } on the coordinates, so that the positions are consistent in the Y-axis range due to the fact that the video streams are connected left and right.
The user carries out long press selection operation on a rendering area corresponding to a certain video stream, at the moment, the client identifies that the long press operation of the user on the certain video stream is reported to the server side, the server side switches the issuing mode of the video stream, and two paths of original video streams which are synthesized by the issuing server side and are not synthesized are sent to the issuing server side. That is, when the user presses the selected video stream for a long time at the client, the server has switched the addresses of the user pull streams into two separate video streams, and the two separate video streams are pulled and rendered left and right respectively. And when the user performs a mode of sliding up and down or sliding left and right on the selected video stream, the client calculates the height difference of the two streams on the Y axis. Assuming that the Y-axis coordinate of the moved path stream is Y1 ' -Y2 ', when | Y1-Y1 ' |/| Y1-Y2| ≧ 50%, the rendering of the video stream after the user lifts hands is changed from left-right screen connection to up-down screen connection.
In the above embodiment, the rendering of the two paths of video streams is dynamically adjusted to be in a left-right structure or an up-down structure according to the gesture dragging of the user, and the technical principle of the position adjustment of the 3 paths of video streams is the same as the above two embodiments.
Fig. 2 is a block diagram illustrating a video stream playback apparatus according to an exemplary embodiment of the present disclosure.
Referring to fig. 2, the video stream playback apparatus 200 includes a playback unit 201, a receiving unit 202, and an adjusting unit 203.
The playback unit 201 can play back the target video stream. The process of playing the video stream locally mainly comprises the steps of receiving a data packet of the video stream, decoding the data packet to obtain video data, carrying out necessary processing, rendering an image corresponding to the processed video data into a picture to be displayed, wherein an area for displaying the corresponding image in the picture is a rendering area. This is well established in the art and will not be described further herein.
The receiving unit 202 may receive an adjustment input to adjust a rendering area of the target video stream. By configuring the adjustment input for the rendering area of the target video stream, the input operation can be made consistent with the adjustment result generated by the input operation, thereby being helpful for improving the operation convenience of users.
The adjusting unit 203 may adjust a rendering area of the target video stream according to the adjustment input. The rendering area of the target video stream in the picture is adjusted according to the adjustment input, so that the rendering area is not fixed any more, a user can freely change the playing style of the video stream according to own preference, and the playing flexibility is improved.
Optionally, the adjustment input may specifically include a zoom input for adjusting the size of the rendering region and a move input for adjusting the position of the rendering region, and in combination, the flexible adjustment of the rendering region may be achieved. It will be appreciated that the adjustment inputs may be configured to include both zoom and movement inputs, but in the actual adjustment process, the user may choose to perform at least one of the inputs as desired to meet their adjustment needs.
For the zoom input, a zoom-out input and a zoom-in input may be further included. For a device (such as a mobile phone, hereinafter referred to as a client) configured with the video stream playing apparatus, in case that the device is provided with a touch screen, the zoom-out input may be an input in which two touch points are close to each other, the zoom-in input may be an input in which two touch points are far from each other, corresponding to an operation gesture of a user, the zoom-out input may correspond to an operation of a user that the two directions are retracted inwards, and the zoom-in input may correspond to an operation that the two directions of the user are expanded outwards.
Alternatively, when the rendering area is enlarged in size according to the enlargement input, a part of the rendering area may be caused to go outside the display screen, for which only the rendering area within the screen may be displayed.
Optionally, when the size of the rendering region is adjusted according to the scaling input, the geometric center of the rendering region may be used as an anchor for scaling, and other points of the rendering region may also be used as anchors for scaling, for example, one of the two touch points.
Further, the scaling input includes a first scaling input for scaling the size of the rendered area of the target video stream to a first scale and a second scaling input for scaling the size of the rendered area of the target video stream to a second scale to scale the size of the rendered area of the target video stream to the second scale. When the first zooming input is received, the size of the rendering area of the target video stream is adjusted firstly, so that the user can be interactively responded to the operation of the user and visually and intuitively prompted, and the operation which is currently done can change the size of the rendering area. On this basis, if the second zoom input continues to be received, it indicates that the user does have a desire to zoom the rendering region. The size of the received target video stream is fundamentally scaled to the second proportion, and only the rendering is carried out according to the default size, so that the operation load of the playing equipment is reduced, the playing response speed is improved, and the playing pause is reduced. At this time, the resolution of the target video stream can be positively correlated with the size of the target video stream, and for the case that the scaling input is the reduction input, the data transmission quantity between the server and the playing device can be reduced, and the dependence on the network quality is reduced; for the case that the zoom input is the zoom-in input, the resolution of the target video stream can be improved as required, and the definition of the video image is ensured. Alternatively, the first zoom input may be an input in which two touch points are close to or far from each other, and accordingly, the second zoom input may be an input in which the two touch points continue to be close to or far from each other. Alternatively, the first ratio may be a fixed ratio, for example 85% for a zoom-out input and 115% for a zoom-in input, which may serve both to prompt the user and to facilitate a control scheme and reduce the computational load. The second scale may be associated with the second scaling input and may vary with the degree of scaling of the second scaling input. It will be appreciated that in the event that the second zoom input ceases, the user may be deemed to have adjusted the size of the rendering region, and the rendering region may be fixed at the current size and position; after the second zoom input is stopped, if a new first zoom input is received, the new first zoom input can be executed, and the two inputs are not contradictory.
For the movement input, the movement input may be input in which a touch point moves after staying at the same position for more than a set time period, and the movement input may correspond to an operation gesture of the user, and may correspond to an operation of long pressing the rendering area and dragging the rendering area by a finger of the user.
It is understood that, for a client with an auto-rotation function on a display screen, a rendering area of a target video stream may rotate as the client rotates. For the target video stream with the rendering area adjusted, if the client rotates, the rendering area of the target video stream can be integrally and correspondingly rotated so as to keep the adjustment effect and also can be restored to the original state. Of course, a selection function may also be configured, and the user selects whether to maintain the adjustment effect or restore the original state, which is an implementation manner of the present disclosure and falls within the protection scope of the present disclosure.
In some embodiments, the target video stream is a composite video stream composed of at least two original video streams, and accordingly, the rendering region of the target video stream further includes at least two sub-regions, each sub-region corresponding to one original video stream. It is understood that, in order to improve the visual effect, the rendering area of the target video stream may further include a sub-area located between two adjacent sub-areas for spacing, and this sub-area may be blank, may be the same as the background color, and may be filled with other colors or images.
For this case, before receiving the adjustment input, the receiving unit 202 may further receive a selection input selecting a target rendering region corresponding to a target original video stream of the at least two original video streams; the video stream playing apparatus 200 may further include a request unit, and the request unit may send a switching request to the server according to the selected input, where the switching request is used to request the server to switch the delivered composite video stream into at least two original video streams. By configuring the selected input of the selected target rendering area, the mode of issuing the video stream by the server can be switched in response to the input, so that the client acquires the original video streams, and accordingly, each original video stream is decoded and rendered separately during playing, the rendering area of any original video stream in the original video streams can be adjusted conveniently, and the playing flexibility of the composite video stream is improved sufficiently.
Alternatively, in these embodiments, for the movement input, the adjusting unit 203 may adjust the position of the target rendering area according to the movement input to the target rendering area; and under the condition that the change of the position of the target rendering area meets the set condition, switching the arrangement mode of the rendering areas of at least two original video streams. By detecting the position change of the target rendering area in response to the movement input, the position change can be compared with a set condition, the movement intention of a user can be predicted, the arrangement modes of the rendering areas of all original video streams can be directly switched according to the predicted movement intention, the movement input of the user can be reduced, the operation load of the movement input detection can be reduced, and the automation level of the playing style adjustment can be improved.
Alternatively, the determining, performed by the adjusting unit 203, that the change in the position of the target rendering region satisfies the setting condition includes: and determining that the moving distance of the target rendering area and the height or width of the target rendering area meet a set relationship. By comparing the moving distance of the target rendering area with the height or width of the target rendering area, the size of the target rendering area can be used as a reference to predict the movement intention of the user, so that the prediction accuracy is improved, the movement input of the user is effectively reduced, the operation load is reduced, and the automation level of playing style adjustment is improved.
Fig. 3 is a block diagram of an electronic device according to an example embodiment of the present disclosure.
Referring to fig. 3, the electronic device 300 includes at least one memory 301 and at least one processor 302, the at least one memory 301 having stored therein a set of computer-executable instructions that, when executed by the at least one processor 302, perform a video stream playback method according to an exemplary embodiment of the present disclosure.
By way of example, the electronic device 300 may be a PC computer, tablet device, personal digital assistant, smartphone, or other device capable of executing the set of instructions described above. Here, the electronic device 300 need not be a single electronic device, but can be any collection of devices or circuits that can execute the above instructions (or sets of instructions) either individually or in combination. The electronic device 300 may also be part of an integrated control system or system manager, or may be configured as a portable electronic device that interfaces with local or remote (e.g., via wireless transmission).
In the electronic device 300, the processor 302 may include a Central Processing Unit (CPU), a Graphics Processing Unit (GPU), a programmable logic device, a special purpose processor system, a microcontroller, or a microprocessor. By way of example, and not limitation, processors may also include analog processors, digital processors, microprocessors, multi-core processors, processor arrays, network processors, and the like.
The processor 302 may execute instructions or code stored in the memory 301, wherein the memory 301 may also store data. The instructions and data may also be transmitted or received over a network via a network interface device, which may employ any known transmission protocol.
The memory 301 may be integrated with the processor 302, for example, by having RAM or flash memory disposed within an integrated circuit microprocessor or the like. Further, memory 301 may comprise a stand-alone device, such as an external disk drive, storage array, or any other storage device usable by a database system. The memory 301 and the processor 302 may be operatively coupled or may communicate with each other, e.g., through I/O ports, network connections, etc., such that the processor 302 is able to read files stored in the memory.
Further, the electronic device 300 may also include a video display (such as a liquid crystal display) and a user interaction interface (such as a keyboard, mouse, touch input device, etc.). All components of the electronic device 300 may be connected to each other via a bus and/or a network.
According to an exemplary embodiment of the present disclosure, there may also be provided a computer-readable storage medium, in which instructions, when executed by at least one processor, cause the at least one processor to perform a video stream playing method according to an exemplary embodiment of the present disclosure. Examples of the computer-readable storage medium herein include: read-only memory (ROM), random-access programmable read-only memory (PROM), electrically erasable programmable read-only memory (EEPROM), random-access memory (RAM), dynamic random-access memory (DRAM), static random-access memory (SRAM), flash memory, non-volatile memory, CD-ROM, CD-R, CD + R, CD-RW, CD + RW, DVD-ROM, DVD-R, DVD + R, DVD-RW, DVD + RW, DVD-RAM, BD-ROM, BD-R, BD-R LTH, BD-RE, Blu-ray or compact disc memory, Hard Disk Drive (HDD), solid-state drive (SSD), card-type memory (such as a multimedia card, a Secure Digital (SD) card or a extreme digital (XD) card), magnetic tape, a floppy disk, a magneto-optical data storage device, an optical data storage device, a hard disk, a magnetic tape, a magneto-optical data storage device, a hard disk, a magnetic tape, a magnetic data storage device, a magnetic tape, a magnetic data storage device, a magnetic tape, a magnetic data storage device, a magnetic tape, a magnetic data storage device, a magnetic tape, a magnetic data storage device, A solid state disk, and any other device configured to store and provide a computer program and any associated data, data files, and data structures to a processor or computer in a non-transitory manner such that the processor or computer can execute the computer program. The computer program in the computer-readable storage medium described above can be run in an environment deployed in a computer apparatus, such as a client, a host, a proxy device, a server, and the like, and further, in one example, the computer program and any associated data, data files, and data structures are distributed across a networked computer system such that the computer program and any associated data, data files, and data structures are stored, accessed, and executed in a distributed fashion by one or more processors or computers.
According to an exemplary embodiment of the present disclosure, a computer program product may also be provided, the computer program product comprising computer instructions that, when executed by at least one processor, cause the at least one processor to perform a video stream playing method according to an exemplary embodiment of the present disclosure.
According to the video stream playing method and the video stream playing device disclosed by the exemplary embodiment of the disclosure, the ability and experience of freely changing the front-end display style of the video stream according to the preference of the audience are given, and the playing flexibility is improved. There are two kinds of operations on the viewer side for video streaming at the client: one is that for a single video stream, according to the user gesture, the player can freely adjust the rendering size and resolution of the video stream; and the other is that aiming at two or more paths of video streams, the client can identify the gestures of the audiences and dynamically adjust the position and the rendering area of each path of video stream according to the display size of the screen of the mobile phone.
Other embodiments of the disclosure will be apparent to those skilled in the art from consideration of the specification and practice of the disclosure disclosed herein. This application is intended to cover any variations, uses, or adaptations of the disclosure following, in general, the principles of the disclosure and including such departures from the present disclosure as come within known or customary practice within the art to which the disclosure pertains. It is intended that the specification and examples be considered as exemplary only, with a true scope and spirit of the disclosure being indicated by the following claims.
It will be understood that the present disclosure is not limited to the precise arrangements described above and shown in the drawings and that various modifications and changes may be made without departing from the scope thereof. The scope of the present disclosure is limited only by the appended claims.
Claims (10)
1. A video stream playing method is characterized in that the video stream playing method comprises the following steps:
playing the target video stream;
receiving an adjustment input for adjusting a rendering area of the target video stream;
and adjusting the rendering area of the target video stream according to the adjustment input.
2. The video stream playback method of claim 1,
the adjustment input includes a scaling input to adjust a size of a rendering region, the scaling input including a first scaling input to scale the size of the rendering region of the target video stream to a first scale and a second scaling input to scale the size of the rendering region of the target video stream to a second scale to scale the size of the rendering region of the target video stream to the second scale.
3. The video stream playing method according to claim 1 or 2, wherein in a case where the target video stream is a composite video stream composed of at least two original video streams, before receiving the adjustment input, the video stream playing method further comprises:
receiving a selection input selecting a target rendering region corresponding to a target original video stream of the at least two original video streams;
and sending a switching request to a server according to the selected input, wherein the switching request is used for requesting the server to switch the issued composite video stream into the at least two original video streams.
4. The video stream playing method according to claim 3, wherein the adjustment input includes a movement input for adjusting a position of a rendering region, and the adjusting the rendering region of the target video stream according to the adjustment input includes:
adjusting a position of the target rendering area according to the movement input to the target rendering area;
and under the condition that the change of the position of the target rendering area meets the set condition, switching the arrangement mode of the rendering areas of the at least two original video streams.
5. The method for playing video stream according to claim 4, wherein the determining that the change of the position of the target rendering area satisfies a set condition comprises:
and determining that the moving distance of the target rendering area and the height or width of the target rendering area meet a set relation.
6. A video stream playback apparatus, characterized in that the video stream playback apparatus comprises:
a playback unit configured to: playing the target video stream;
a receiving unit configured to: receiving an adjustment input for adjusting a rendering area of the target video stream;
an adjustment unit configured to: and adjusting the rendering area of the target video stream according to the adjustment input.
7. The video stream playback device of claim 6,
the adjustment input includes a scaling input to adjust a size of a rendering region, the scaling input including a first scaling input to scale the size of the rendering region of the target video stream to a first scale and a second scaling input to scale the size of the rendering region of the target video stream to a second scale to scale the size of the rendering region of the target video stream to the second scale.
8. An electronic device, comprising:
at least one processor;
at least one memory storing computer-executable instructions,
wherein the computer-executable instructions, when executed by the at least one processor, cause the at least one processor to perform the video stream playback method of any of claims 1 to 5.
9. A computer-readable storage medium, wherein instructions in the computer-readable storage medium, when executed by at least one processor, cause the at least one processor to perform the video stream playback method of any of claims 1 to 5.
10. A computer program product comprising computer instructions, characterized in that the computer instructions, when executed by at least one processor, implement the video stream playback method according to any of claims 1 to 5.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202110861883.5A CN113596561B (en) | 2021-07-29 | 2021-07-29 | Video stream playing method, device, electronic equipment and computer readable storage medium |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202110861883.5A CN113596561B (en) | 2021-07-29 | 2021-07-29 | Video stream playing method, device, electronic equipment and computer readable storage medium |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN113596561A true CN113596561A (en) | 2021-11-02 |
| CN113596561B CN113596561B (en) | 2023-06-27 |
Family
ID=78251552
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202110861883.5A Active CN113596561B (en) | 2021-07-29 | 2021-07-29 | Video stream playing method, device, electronic equipment and computer readable storage medium |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN113596561B (en) |
Cited By (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN114900731A (en) * | 2022-03-31 | 2022-08-12 | 咪咕文化科技有限公司 | Video definition switching method and device |
Citations (20)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20080252662A1 (en) * | 2007-04-11 | 2008-10-16 | Edward Craig Hyatt | Methods of Displaying Information at Different Zoom Settings and Related Devices and Computer Program Products |
| CN106802759A (en) * | 2016-12-21 | 2017-06-06 | 华为技术有限公司 | The method and terminal device of video playback |
| US20170180788A1 (en) * | 2015-12-18 | 2017-06-22 | Le Holdings (Beijing) Co., Ltd. | Method for video image switch and electronic device |
| US9894318B1 (en) * | 2016-11-24 | 2018-02-13 | Hong Fu Jin Precision Industry (Shenzhen) Co., Ltd. | Method for output control of videos from multiple available sources and user terminal using the same |
| CN107801093A (en) * | 2017-10-26 | 2018-03-13 | 深圳市量子视觉科技有限公司 | Video Rendering method, apparatus, computer equipment and readable storage medium storing program for executing |
| CN109151497A (en) * | 2018-08-06 | 2019-01-04 | 广州虎牙信息科技有限公司 | A kind of even wheat live broadcasting method, device, electronic equipment and storage medium |
| CN109168040A (en) * | 2018-10-29 | 2019-01-08 | 广州华多网络科技有限公司 | A kind of program listing display methods, equipment and readable storage medium storing program for executing |
| CN110798697A (en) * | 2019-11-22 | 2020-02-14 | 广州华多网络科技有限公司 | Video display method, device and system and electronic equipment |
| CN111246232A (en) * | 2020-01-17 | 2020-06-05 | 广州华多网络科技有限公司 | Live broadcast interaction method and device, electronic equipment and storage medium |
| CN111510780A (en) * | 2020-04-10 | 2020-08-07 | 广州华多网络科技有限公司 | Video live broadcast control, bridging, flow control and broadcast control method and client |
| CN111541930A (en) * | 2020-04-27 | 2020-08-14 | 广州酷狗计算机科技有限公司 | Live broadcast picture display method and device, terminal and storage medium |
| CN111556357A (en) * | 2020-04-30 | 2020-08-18 | 广州华多网络科技有限公司 | Method, device and equipment for playing live video and storage medium |
| CN111818359A (en) * | 2020-09-14 | 2020-10-23 | 北京达佳互联信息技术有限公司 | Processing method and device for live interactive video, electronic equipment and server |
| CN111935532A (en) * | 2020-08-14 | 2020-11-13 | 腾讯科技（深圳）有限公司 | Video interaction method and device, electronic equipment and storage medium |
| CN112104880A (en) * | 2020-08-31 | 2020-12-18 | 广州华多网络科技有限公司 | Network connection live broadcast control and display method and device, equipment and storage medium |
| CN112261434A (en) * | 2020-10-22 | 2021-01-22 | 广州华多网络科技有限公司 | Interface layout control and processing method and corresponding device, equipment and medium |
| CN112399123A (en) * | 2021-01-19 | 2021-02-23 | 游密科技(深圳)有限公司 | Video definition adjusting method and device, electronic equipment and storage medium |
| WO2021047420A1 (en) * | 2019-09-11 | 2021-03-18 | 广州华多网络科技有限公司 | Virtual gift special effect rendering method and apparatus, and live streaming system |
| CN112543350A (en) * | 2020-12-03 | 2021-03-23 | 湖南快乐阳光互动娱乐传媒有限公司 | Live broadcast interaction method and device |
| CN112752116A (en) * | 2020-12-30 | 2021-05-04 | 广州繁星互娱信息科技有限公司 | Display method, device, terminal and storage medium of live video picture |
-
2021
- 2021-07-29 CN CN202110861883.5A patent/CN113596561B/en active Active
Patent Citations (20)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20080252662A1 (en) * | 2007-04-11 | 2008-10-16 | Edward Craig Hyatt | Methods of Displaying Information at Different Zoom Settings and Related Devices and Computer Program Products |
| US20170180788A1 (en) * | 2015-12-18 | 2017-06-22 | Le Holdings (Beijing) Co., Ltd. | Method for video image switch and electronic device |
| US9894318B1 (en) * | 2016-11-24 | 2018-02-13 | Hong Fu Jin Precision Industry (Shenzhen) Co., Ltd. | Method for output control of videos from multiple available sources and user terminal using the same |
| CN106802759A (en) * | 2016-12-21 | 2017-06-06 | 华为技术有限公司 | The method and terminal device of video playback |
| CN107801093A (en) * | 2017-10-26 | 2018-03-13 | 深圳市量子视觉科技有限公司 | Video Rendering method, apparatus, computer equipment and readable storage medium storing program for executing |
| CN109151497A (en) * | 2018-08-06 | 2019-01-04 | 广州虎牙信息科技有限公司 | A kind of even wheat live broadcasting method, device, electronic equipment and storage medium |
| CN109168040A (en) * | 2018-10-29 | 2019-01-08 | 广州华多网络科技有限公司 | A kind of program listing display methods, equipment and readable storage medium storing program for executing |
| WO2021047420A1 (en) * | 2019-09-11 | 2021-03-18 | 广州华多网络科技有限公司 | Virtual gift special effect rendering method and apparatus, and live streaming system |
| CN110798697A (en) * | 2019-11-22 | 2020-02-14 | 广州华多网络科技有限公司 | Video display method, device and system and electronic equipment |
| CN111246232A (en) * | 2020-01-17 | 2020-06-05 | 广州华多网络科技有限公司 | Live broadcast interaction method and device, electronic equipment and storage medium |
| CN111510780A (en) * | 2020-04-10 | 2020-08-07 | 广州华多网络科技有限公司 | Video live broadcast control, bridging, flow control and broadcast control method and client |
| CN111541930A (en) * | 2020-04-27 | 2020-08-14 | 广州酷狗计算机科技有限公司 | Live broadcast picture display method and device, terminal and storage medium |
| CN111556357A (en) * | 2020-04-30 | 2020-08-18 | 广州华多网络科技有限公司 | Method, device and equipment for playing live video and storage medium |
| CN111935532A (en) * | 2020-08-14 | 2020-11-13 | 腾讯科技（深圳）有限公司 | Video interaction method and device, electronic equipment and storage medium |
| CN112104880A (en) * | 2020-08-31 | 2020-12-18 | 广州华多网络科技有限公司 | Network connection live broadcast control and display method and device, equipment and storage medium |
| CN111818359A (en) * | 2020-09-14 | 2020-10-23 | 北京达佳互联信息技术有限公司 | Processing method and device for live interactive video, electronic equipment and server |
| CN112261434A (en) * | 2020-10-22 | 2021-01-22 | 广州华多网络科技有限公司 | Interface layout control and processing method and corresponding device, equipment and medium |
| CN112543350A (en) * | 2020-12-03 | 2021-03-23 | 湖南快乐阳光互动娱乐传媒有限公司 | Live broadcast interaction method and device |
| CN112752116A (en) * | 2020-12-30 | 2021-05-04 | 广州繁星互娱信息科技有限公司 | Display method, device, terminal and storage medium of live video picture |
| CN112399123A (en) * | 2021-01-19 | 2021-02-23 | 游密科技(深圳)有限公司 | Video definition adjusting method and device, electronic equipment and storage medium |
Cited By (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN114900731A (en) * | 2022-03-31 | 2022-08-12 | 咪咕文化科技有限公司 | Video definition switching method and device |
| CN114900731B (en) * | 2022-03-31 | 2024-04-09 | 咪咕文化科技有限公司 | Video definition switching method and device |
Also Published As
| Publication number | Publication date |
|---|---|
| CN113596561B (en) | 2023-06-27 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US11188208B2 (en) | Display apparatus for classifying and searching content, and method thereof | |
| US11727079B2 (en) | Cooperative web browsing using multiple devices | |
| US9723123B2 (en) | Multi-screen control method and device supporting multiple window applications | |
| US10657928B2 (en) | Projected content based display device and display method | |
| US8918737B2 (en) | Zoom display navigation | |
| JP2021516911A (en) | Video generation methods, devices, electronics and computer readable storage media | |
| US9898241B2 (en) | Information sharing system, image processing apparatus, and image processing method | |
| WO2019007227A1 (en) | Method and apparatus for continuing to display view after switching pages | |
| JP6566698B2 (en) | Display control apparatus and display control method | |
| US20150339026A1 (en) | User terminal device, method for controlling user terminal device, and multimedia system thereof | |
| WO2022052653A1 (en) | Video playback method and apparatus, computer device, and storage medium | |
| JP2020527883A5 (en) | ||
| WO2017054142A1 (en) | Video data acquisition method, apparatus and system, and computer readable storage medium | |
| JP2020527883A (en) | Video processing methods, equipment and storage media | |
| CN113342248A (en) | Live broadcast display method and device, storage medium and electronic equipment | |
| US20140195980A1 (en) | Display apparatus and method for providing user interface thereof | |
| US8856827B1 (en) | System for conveying and reproducing images for interactive applications | |
| CN113596561A (en) | Video stream playing method and device, electronic equipment and computer readable storage medium | |
| CN112188219A (en) | Video receiving method and device and video transmitting method and device | |
| KR20200116378A (en) | Apparatus and method for displaying videoes of a plurality of broadcast channels | |
| CN112367550A (en) | Method for realizing multi-title dynamic display of media asset list and display equipment | |
| KR101895865B1 (en) | System and method for adaptive playing of landscape video content | |
| US20240078070A1 (en) | Video distribution device, display control device, video distribution method, display control method, and non-transitory computer readable medium | |
| CN106020607B (en) | Image display method and electronic equipment | |
| TW202411831A (en) | Information processing terminals and programs |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |