CN113596561B - Video stream playing method, device, electronic equipment and computer readable storage medium - Google Patents
Video stream playing method, device, electronic equipment and computer readable storage medium Download PDFInfo
- Publication number
- CN113596561B CN113596561B CN202110861883.5A CN202110861883A CN113596561B CN 113596561 B CN113596561 B CN 113596561B CN 202110861883 A CN202110861883 A CN 202110861883A CN 113596561 B CN113596561 B CN 113596561B
- Authority
- CN
- China
- Prior art keywords
- video stream
- input
- target
- rendering area
- rendering
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
Images
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
- H04N21/431—Generation of visual interfaces for content selection or interaction; Content or additional data rendering
- H04N21/4312—Generation of visual interfaces for content selection or interaction; Content or additional data rendering involving specific graphical features, e.g. screen layout, special fonts or colors, blinking icons, highlights or animations
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
- H04N21/44—Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream, rendering scenes according to MPEG-4 scene graphs
- H04N21/44008—Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream, rendering scenes according to MPEG-4 scene graphs involving operations for analysing video streams, e.g. detecting features or characteristics in the video stream
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
- H04N21/44—Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream, rendering scenes according to MPEG-4 scene graphs
- H04N21/44012—Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream, rendering scenes according to MPEG-4 scene graphs involving rendering scenes according to scene graphs, e.g. MPEG-4 scene graphs
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/47—End-user applications
- H04N21/485—End-user interface for client configuration
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/47—End-user applications
- H04N21/485—End-user interface for client configuration
- H04N21/4858—End-user interface for client configuration for modifying screen layout parameters, e.g. fonts, size of the windows
Abstract
The present disclosure relates to a video stream playing method, apparatus, electronic device and computer readable storage medium, the video stream playing method comprising: playing the target video stream; receiving an adjustment input for adjusting a rendering area of a target video stream; and adjusting the rendering area of the target video stream according to the adjustment input. By configuring the function of adjusting input, the rendering area of the target video stream in the picture can be adjusted according to the adjustment input in the process of playing the target video stream, so that the rendering area is not fixed any more, a user can freely change the playing style of the video stream according to own preference, and the playing flexibility is improved.
Description
Technical Field
The present disclosure relates to the field of mobile internet applications, and in particular, to a video stream playing method, apparatus, electronic device, and computer readable storage medium.
Background
The live broadcasting room is a basic place for the audience to consume live audio and video streams, and electronic equipment such as mobile phones of the audience can pull stream addresses to the local place from a server, and then decoding and playing are carried out to obtain viewing experience. The video stream watched by the mobile phone is processed by the server, and the rendering area in the mobile phone picture is fixed, so that the flexibility of the playing mode of the video stream is poor.
Disclosure of Invention
The disclosure provides a video stream playing method, a video stream playing device, an electronic device and a computer readable storage medium, so as to at least solve the problems of fixed playing style and poor flexibility in the related art.
According to a first aspect of the present disclosure, there is provided a video stream playing method, including: playing the target video stream; receiving an adjustment input to adjust a rendering region of the target video stream; and adjusting the rendering area of the target video stream according to the adjustment input.
Optionally, the adjustment input comprises a scaling input to adjust a size of the rendering area, the scaling input comprising a first scaling input to scale the size of the rendering area of the target video stream to a first scale and a second scaling input to scale the size of the target video stream to a second scale to scale the size of the rendering area of the target video stream to the second scale.
Optionally, in the case that the target video stream is a composite video stream synthesized from at least two original video streams, before receiving the adjustment input, the video stream playing method further includes: receiving a selected input selecting a target rendering area corresponding to a target original video stream of the at least two original video streams; and sending a switching request to a server according to the selected input, wherein the switching request is used for requesting the server to switch the issued synthesized video stream into the at least two original video streams.
Optionally, the adjusting input includes a movement input for adjusting a position of a rendering area, and the adjusting the rendering area of the target video stream according to the adjusting input includes: adjusting the position of the target rendering area according to the movement input to the target rendering area; and switching the arrangement mode of the rendering areas of the at least two original video streams under the condition that the change of the position of the target rendering area meets the set condition.
Optionally, the determining that the change of the position of the target rendering area meets a setting condition includes: and determining that the moving distance of the target rendering area and the height or width of the target rendering area meet a set relation.
According to a second aspect of the present disclosure, there is provided a video stream playback apparatus including: a playback unit configured to: playing the target video stream; a receiving unit configured to: receiving an adjustment input to adjust a rendering region of the target video stream; an adjustment unit configured to: and adjusting the rendering area of the target video stream according to the adjustment input.
Optionally, the adjustment input comprises a scaling input to adjust a size of the rendering area, the scaling input comprising a first scaling input to scale the size of the rendering area of the target video stream to a first scale and a second scaling input to scale the size of the target video stream to a second scale to scale the size of the rendering area of the target video stream to the second scale.
Optionally, in the case that the target video stream is a composite video stream synthesized from at least two original video streams, the receiving unit is further configured to: before receiving the adjustment input, receiving a selection input selecting a target rendering area corresponding to a target original video stream of the at least two original video streams; the video stream playing device further includes a requesting unit configured to: and sending a switching request to a server according to the selected input, wherein the switching request is used for requesting the server to switch the issued synthesized video stream into the at least two original video streams.
Optionally, the adjustment input comprises a movement input to adjust a position of the rendering area, the adjustment unit being further configured to: adjusting the position of the target rendering area according to the movement input to the target rendering area; and switching the arrangement mode of the rendering areas of the at least two original video streams under the condition that the change of the position of the target rendering area meets the set condition.
Optionally, the adjusting unit is further configured to: and determining that the moving distance of the target rendering area and the height or width of the target rendering area meet a set relation.
According to a third aspect of the present disclosure, there is provided an electronic device comprising: at least one processor; at least one memory storing computer-executable instructions, wherein the computer-executable instructions, when executed by the at least one processor, cause the at least one processor to perform a video stream playback method according to the present disclosure.
According to a fourth aspect of the present disclosure, there is provided a computer readable storage medium, which when executed by at least one processor, causes the at least one processor to perform a video stream playing method according to the present disclosure.
According to a fifth aspect of the present disclosure, there is provided a computer program product comprising computer instructions which, when executed by at least one processor, implement a video stream playback method according to the present disclosure.
The technical scheme provided by the embodiment of the disclosure at least brings the following beneficial effects:
according to the video stream playing method and the video stream playing device, through configuration of the function of adjusting input, the rendering area of the target video stream in a picture can be adjusted according to the adjustment input in the process of playing the target video stream, so that the rendering area is not fixed any more, a user can freely change the playing style of the video stream according to own preference, and the playing flexibility is improved.
It is to be understood that both the foregoing general description and the following detailed description are exemplary and explanatory only and are not restrictive of the disclosure.
Drawings
The accompanying drawings, which are incorporated in and constitute a part of this specification, illustrate embodiments consistent with the disclosure and together with the description, serve to explain the principles of the disclosure and do not constitute an undue limitation on the disclosure.
Fig. 1 is a flowchart illustrating a video stream playing method according to an exemplary embodiment of the present disclosure.
Fig. 2 is a block diagram illustrating a video stream playback apparatus according to an exemplary embodiment of the present disclosure.
Fig. 3 is a block diagram of an electronic device according to an exemplary embodiment of the present disclosure.
Detailed Description
In order to enable those skilled in the art to better understand the technical solutions of the present disclosure, the technical solutions of the embodiments of the present disclosure will be clearly and completely described below with reference to the accompanying drawings.
It should be noted that the terms "first," "second," and the like in the description and claims of the present disclosure and in the foregoing figures are used for distinguishing between similar objects and not necessarily for describing a particular sequential or chronological order. It is to be understood that the data so used may be interchanged where appropriate such that the embodiments of the disclosure described herein may be capable of operation in sequences other than those illustrated or described herein. The embodiments described in the examples below are not representative of all embodiments consistent with the present disclosure. Rather, they are merely examples of apparatus and methods consistent with some aspects of the present disclosure as detailed in the accompanying claims.
It should be noted that, in this disclosure, "at least one of the items" refers to a case where three types of juxtaposition including "any one of the items", "a combination of any of the items", "an entirety of the items" are included. For example, "including at least one of a and B" includes three cases side by side as follows: (1) comprises A; (2) comprising B; (3) includes A and B. For example, "at least one of the first and second steps is executed", that is, three cases are juxtaposed as follows: (1) performing step one; (2) executing the second step; (3) executing the first step and the second step.
Live broadcasts are becoming popular with viewers because of the ability to provide immediate, wide-ranging online interaction. In general, the video streams watched by the audience on the mobile phone are all processed by the server, and there is a single video stream of the host, and there is a live broadcast content of the continuous screen which combines two or more video streams. However, whatever the video stream, its play pattern (i.e., the arrangement pattern of the video stream rendered to the rendering area in the cell phone screen) tends to be fixed. For size, conventional handsets typically employ 16 for a single video stream: 9, rendering the video stream to a full screen, and for a fused video stream, for example, a PK video stream fused with two live broadcast channels, 4: 3. In addition, for the live broadcast content of the continuous screen, which merges two or more video streams, the arrangement pattern of the rendering area of each video stream is a fixed template, such as a pattern of two people on the left and right Lian Bing, three-person or four-person character pattern, which cannot be adjusted.
Fig. 1 is a flowchart illustrating a video stream playing method according to an exemplary embodiment of the present disclosure.
Referring to fig. 1, in step 101, a target video stream is played. The process of playing the video stream locally mainly comprises the steps of receiving a data packet of the video stream, decoding the data packet to obtain video data, performing necessary processing, and rendering an image corresponding to the processed video data into a picture to be displayed, wherein the area in the picture, in which the corresponding image is displayed, is a rendering area. This is well known in the art and will not be described in detail herein.
At step 102, an adjustment input to adjust a rendering region of a target video stream is received. By configuring the adjustment input for the rendering area of the target video stream, the input operation can be consistent with the adjustment result generated by the input operation, thereby being beneficial to improving the operation convenience of the user.
In step 103, the rendering area of the target video stream is adjusted according to the adjustment input. By adjusting the rendering area of the target video stream in the picture according to the adjustment input, the rendering area is not fixed any more, and the user can freely change the playing style of the video stream according to own preference, thereby improving the playing flexibility.
Optionally, the adjustment input may specifically include a zoom input for adjusting the size of the rendering area and a movement input for adjusting the position of the rendering area, which, in combination, may enable flexible adjustment of the rendering area. It will be appreciated that the adjustment input may be configured to include both a zoom input and a move input, but that during actual adjustment, the user may choose to perform at least one of the inputs as desired to meet their adjustment needs.
For the zoom input, a zoom-out input and a zoom-in input may be further included. For the case that the device (such as a mobile phone, hereinafter referred to as a client for convenience of description) executing the video stream playing method is provided with a touch screen, the zoom-in input may be an input in which two touch points are close to each other, the zoom-out input may be an input in which two touch points are far away from each other, the zoom-out input may correspond to a user's operation gesture, the zoom-in input may correspond to a user's operation of bi-directional inward contraction, and the zoom-out input may correspond to a user's operation of bi-directional outward expansion.
Alternatively, when the rendering area is enlarged in size according to the enlarged input, a portion of the rendering area may be caused to go beyond the display screen, for which only the rendering area within the screen may be displayed.
Alternatively, when the size of the rendering area is adjusted according to the scaling input, the geometric center of the rendering area may be scaled as an anchor, and other points of the rendering area may be scaled as anchors, for example, one of the two touch points.
Further, the scaling inputs include a first scaling input for scaling a size of the rendered area of the target video stream to a first scale and a second scaling input for scaling a size of the target video stream to a second scale such that the size of the rendered area of the target video stream is scaled to the second scale. When the first zoom input is received, the size of the rendering area of the target video stream is adjusted, the user can be interactively and intuitively prompted in response to the operation of the user, and the currently-made operation can change the size of the rendering area. On this basis, if the second zoom input is continuously received, the user is indicated to have a wish to zoom the rendering area. By fundamentally scaling the size of the received target video stream to the second proportion, only the target video stream is rendered according to the default size, so that the operation load of the playing device is reduced, the playing response rate is improved, and the playing jamming is reduced. At this time, the resolution of the target video stream can be positively correlated with the size of the target video stream, and for the case that the zoom input is the zoom input, the data transmission amount between the server and the playing device can be reduced, and the dependence on the network quality is reduced; for the case that the zoom input is the amplified input, the resolution of the target video stream can be improved as required, and the definition of the video image is ensured. Alternatively, the first zoom input may be an input in which two touch points are close to or far from each other, and accordingly, the second zoom input may be an input in which the two touch points continue to be close to or far from each other. Alternatively, the first ratio may be a fixed ratio, for example, 85% for a reduced input and 115% for an enlarged input, which may serve as both a prompt for the user and facilitate simplifying the control scheme and reducing the computational load. The second scale may be associated with the second zoom input and may vary with a degree of zoom of the second zoom input. It will be appreciated that in the event that the second zoom input ceases, the user may be considered to have adjusted the size of the rendered area, which may be fixed at the current size and location; when the second scaling input is stopped, if a new first scaling input is received, the new first scaling input may be executed, which are not contradictory.
For the movement input, the touch point can stay at the same position for longer than a set time period and then move, and the movement input corresponds to the operation gesture of the user, and the movement input corresponds to the operation of pressing the rendering area by the finger of the user for a long time and dragging the rendering area.
It will be appreciated that for a client with an auto-rotate function for a display, the rendering area of the target video stream may rotate as the client rotates. For the target video stream with the adjusted rendering area, if the client rotates, the rendering area of the target video stream can rotate correspondingly, so as to maintain the adjustment effect, and the target video stream can also be restored to the original state. Of course, the selection function may also be configured to give the user the option of maintaining the adjustment effect or restoring the original state, which is an implementation of the present disclosure, and falls within the scope of the present disclosure.
In some embodiments, the target video stream is a composite video stream synthesized from at least two original video streams, and accordingly, the rendering region of the target video stream further includes at least two sub-regions, each corresponding to one of the original video streams. It will be appreciated that, to enhance the visual effect, the rendering area of the target video stream may also include a sub-area located between two adjacent sub-areas that may be left white, may be the same as the background color, or may be filled with other colors or images.
For this case, before step 102, the video stream playing method according to the exemplary embodiment of the present disclosure further includes: receiving a selected input of selecting a target rendering area corresponding to a target original video stream of at least two original video streams; and sending a switching request to the server according to the selected input, wherein the switching request is used for requesting the server to switch the issued composite video stream into at least two original video streams. By configuring the selected input of the selected target rendering area, the mode of the server for issuing the video stream can be switched in response to the input, so that the client acquires the original video stream, and accordingly, each original video stream is separately decoded and rendered during playing, the rendering area of any original video stream in the original video stream is convenient to adjust, and the playing flexibility of the synthesized video stream is fully improved.
Optionally, in these embodiments, for movement input, the foregoing step 103 may include: according to the movement input of the target rendering area, the position of the target rendering area is adjusted; and switching the arrangement mode of the rendering areas of at least two original video streams under the condition that the change of the positions of the target rendering areas meets the set condition. By detecting the position change of the target rendering area in response to the movement input, the position change can be compared with the set condition, the movement intention of the user can be predicted, the arrangement mode of the rendering areas of all original video streams can be directly switched according to the predicted movement intention, the movement input of the user can be reduced, the operation load of detecting the movement input is further reduced, and the automation level of the adjustment of the playing style can be improved.
Optionally, determining that the change in the position of the target rendering area satisfies the setting condition includes: and determining that the moving distance of the target rendering area and the height or width of the target rendering area meet a set relation. By comparing the moving distance of the target rendering area with the height or width of the target rendering area, the size of the target rendering area can be used as a reference to predict the moving intention of the user, so that the accuracy of prediction is improved, the moving input of the user is effectively reduced, the operation load is reduced, and the automation level of the adjustment of the playing style is improved.
Next, taking live broadcast as an example, an embodiment is described for a case where the target video stream is a single-channel video stream and a case where the target video stream merges multiple video streams, respectively. It is understood that the video stream playing method according to the exemplary embodiment of the present disclosure is equally applicable to playing of video streams other than live.
Optionally, in one implementation, when the client pulls a single live video stream, it detects that the user performs a double-finger zoom operation on the video stream. When the user performs the bi-directional inward shrinking operation, the area of the player for rendering the video is anchored and reduced to 85% by taking the central point as the anchor, and the experience aims to interactively respond to the gesture of the user so that the user perceives the bi-directional scaling to adjust the rendering area of the video stream.
The user can reduce the size of the video stream according to the gesture operation when continuing zooming, and dynamically adjust the resolution of the video stream, wherein the resolution is 720P when the video stream width is more than 750, and the resolution is 540P when the video stream width is less than or equal to 750.
And the client lifts the double fingers to fix the video rendering area to the adjusted area for display when the video rendering area is adjusted according to the double-finger scaling. At this time, the user can select the video stream by pressing the client for a long time, and the surrounding of the video stream has black edges due to the reduced display, so that the user can drag the position of the video stream by moving the finger on the mobile phone. The above technique essentially dynamically renders the position of the video stream by the client recognizing that the user selected the video, and then the finger triggers a movement event.
Optionally, in another embodiment, when the client pulls the multi-path live video stream, the client defaults to 2 people left and right with screen and 3 chevron show video streams. And calculating the positions of the multiple paths of video streams by taking the left lower corner of the mobile phone screen as the starting point of 0 points of the X axis and the Y axis, the width as the X axis and the height as the Y axis. For example, when 2 persons are connected to the screen, the position calculated to the left side video stream is described as { x1 to x2, Y1 to Y2} on the coordinates, and the position of the right side video stream is described as { x3 to x4, Y1 to Y2} on the coordinates, and the positions are consistent in the Y-axis range because of the left and right connection.
The user performs long-time pressing selection operation on a rendering area corresponding to a certain video stream, at the moment, the client identifies long-time pressing operation on the certain video stream by the user and reports the long-time pressing operation to the server, the server switches the issuing mode of the video stream, and one path of video stream synthesized by the issuing server is sent to two paths of original video streams which are not synthesized by the issuing server. That is, when the client presses one video stream for a long time, the server has switched the addresses of the user stream to two independent video streams, and the streams are respectively pulled and rendered. When the user slides up and down or left and right according to the selected video stream, the client calculates the height difference of the two paths of streams on the Y axis. Assuming that the Y-axis coordinate of the moved one-way stream is Y1' to Y2', when the Y1-Y1' |/|y1-y2| is more than or equal to 50%, the rendering of the video stream after the user lifts hands is changed from left and right continuous screens to up and down continuous screens.
The technical principle of the above embodiment of dynamically adjusting whether the rendering of the two paths of video streams is a left-right structure or an up-down structure according to the gesture dragging of the user and the position adjustment of the 3 paths of video streams is the same as the above two embodiments.
Fig. 2 is a block diagram illustrating a video stream playback apparatus according to an exemplary embodiment of the present disclosure.
Referring to fig. 2, the video stream playback apparatus 200 includes a playback unit 201, a reception unit 202, and an adjustment unit 203.
The playback unit 201 may play the target video stream. The process of playing the video stream locally mainly comprises the steps of receiving a data packet of the video stream, decoding the data packet to obtain video data, performing necessary processing, and rendering an image corresponding to the processed video data into a picture to be displayed, wherein the area in the picture, in which the corresponding image is displayed, is a rendering area. This is well known in the art and will not be described in detail herein.
The receiving unit 202 may receive an adjustment input to adjust a rendering region of the target video stream. By configuring the adjustment input for the rendering area of the target video stream, the input operation can be consistent with the adjustment result generated by the input operation, thereby being beneficial to improving the operation convenience of the user.
The adjustment unit 203 may adjust the rendering area of the target video stream according to the adjustment input. By adjusting the rendering area of the target video stream in the picture according to the adjustment input, the rendering area is not fixed any more, and the user can freely change the playing style of the video stream according to own preference, thereby improving the playing flexibility.
Optionally, the adjustment input may specifically include a zoom input for adjusting the size of the rendering area and a movement input for adjusting the position of the rendering area, which, in combination, may enable flexible adjustment of the rendering area. It will be appreciated that the adjustment input may be configured to include both a zoom input and a move input, but that during actual adjustment, the user may choose to perform at least one of the inputs as desired to meet their adjustment needs.
For the zoom input, a zoom-out input and a zoom-in input may be further included. For the case that the device (such as a mobile phone, hereinafter referred to as a client for convenience of description) provided with the video stream playing device is provided with a touch screen, the zoom-in input may be an input in which two touch points are close to each other, the zoom-out input may be an input in which two touch points are far away from each other, the zoom-out input may correspond to a bi-directional inward operation of the user, and the zoom-in input may correspond to a bi-directional outward operation of the user.
Alternatively, when the rendering area is enlarged in size according to the enlarged input, a portion of the rendering area may be caused to go beyond the display screen, for which only the rendering area within the screen may be displayed.
Alternatively, when the size of the rendering area is adjusted according to the scaling input, the geometric center of the rendering area may be scaled as an anchor, and other points of the rendering area may be scaled as anchors, for example, one of the two touch points.
Further, the scaling inputs include a first scaling input for scaling a size of the rendered area of the target video stream to a first scale and a second scaling input for scaling a size of the target video stream to a second scale such that the size of the rendered area of the target video stream is scaled to the second scale. When the first zoom input is received, the size of the rendering area of the target video stream is adjusted, the user can be interactively and intuitively prompted in response to the operation of the user, and the currently-made operation can change the size of the rendering area. On this basis, if the second zoom input is continuously received, the user is indicated to have a wish to zoom the rendering area. By fundamentally scaling the size of the received target video stream to the second proportion, only the target video stream is rendered according to the default size, so that the operation load of the playing device is reduced, the playing response rate is improved, and the playing jamming is reduced. At this time, the resolution of the target video stream can be positively correlated with the size of the target video stream, and for the case that the zoom input is the zoom input, the data transmission amount between the server and the playing device can be reduced, and the dependence on the network quality is reduced; for the case that the zoom input is the amplified input, the resolution of the target video stream can be improved as required, and the definition of the video image is ensured. Alternatively, the first zoom input may be an input in which two touch points are close to or far from each other, and accordingly, the second zoom input may be an input in which the two touch points continue to be close to or far from each other. Alternatively, the first ratio may be a fixed ratio, for example, 85% for a reduced input and 115% for an enlarged input, which may serve as both a prompt for the user and facilitate simplifying the control scheme and reducing the computational load. The second scale may be associated with the second zoom input and may vary with a degree of zoom of the second zoom input. It will be appreciated that in the event that the second zoom input ceases, the user may be considered to have adjusted the size of the rendered area, which may be fixed at the current size and location; when the second scaling input is stopped, if a new first scaling input is received, the new first scaling input may be executed, which are not contradictory.
For the movement input, the touch point can stay at the same position for longer than a set time period and then move, and the movement input corresponds to the operation gesture of the user, and the movement input corresponds to the operation of pressing the rendering area by the finger of the user for a long time and dragging the rendering area.
It will be appreciated that for a client with an auto-rotate function for a display, the rendering area of the target video stream may rotate as the client rotates. For the target video stream with the adjusted rendering area, if the client rotates, the rendering area of the target video stream can rotate correspondingly, so as to maintain the adjustment effect, and the target video stream can also be restored to the original state. Of course, the selection function may also be configured to give the user the option of maintaining the adjustment effect or restoring the original state, which is an implementation of the present disclosure, and falls within the scope of the present disclosure.
In some embodiments, the target video stream is a composite video stream synthesized from at least two original video streams, and accordingly, the rendering region of the target video stream further includes at least two sub-regions, each corresponding to one of the original video streams. It will be appreciated that, to enhance the visual effect, the rendering area of the target video stream may also include a sub-area located between two adjacent sub-areas that may be left white, may be the same as the background color, or may be filled with other colors or images.
For this case, the receiving unit 202 may further receive a selection input of selecting a target rendering area corresponding to a target original video stream of the at least two original video streams before receiving the adjustment input; the video stream playing apparatus 200 may further include a request unit, which may send a switching request to the server according to the selected input, where the switching request is used to request the server to switch the delivered composite video stream to at least two original video streams. By configuring the selected input of the selected target rendering area, the mode of the server for issuing the video stream can be switched in response to the input, so that the client acquires the original video stream, and accordingly, each original video stream is separately decoded and rendered during playing, the rendering area of any original video stream in the original video stream is convenient to adjust, and the playing flexibility of the synthesized video stream is fully improved.
Alternatively, in these embodiments, for the movement input, the adjustment unit 203 may adjust the position of the target rendering area according to the movement input to the target rendering area; and switching the arrangement mode of the rendering areas of at least two original video streams under the condition that the change of the positions of the target rendering areas meets the set condition. By detecting the position change of the target rendering area in response to the movement input, the position change can be compared with the set condition, the movement intention of the user can be predicted, the arrangement mode of the rendering areas of all original video streams can be directly switched according to the predicted movement intention, the movement input of the user can be reduced, the operation load of detecting the movement input is further reduced, and the automation level of the adjustment of the playing style can be improved.
Alternatively, the change in the position of the determination target rendering area performed by the adjustment unit 203 satisfies the setting condition, including: and determining that the moving distance of the target rendering area and the height or width of the target rendering area meet a set relation. By comparing the moving distance of the target rendering area with the height or width of the target rendering area, the size of the target rendering area can be used as a reference to predict the moving intention of the user, so that the accuracy of prediction is improved, the moving input of the user is effectively reduced, the operation load is reduced, and the automation level of the adjustment of the playing style is improved.
Fig. 3 is a block diagram of an electronic device according to an exemplary embodiment of the present disclosure.
Referring to fig. 3, an electronic device 300 includes at least one memory 301 and at least one processor 302, the at least one memory 301 having stored therein a set of computer-executable instructions that, when executed by the at least one processor 302, perform a video stream playback method according to an exemplary embodiment of the present disclosure.
By way of example, electronic device 300 may be a PC computer, tablet device, personal digital assistant, smart phone, or other device capable of executing the above-described set of instructions. Here, the electronic device 300 is not necessarily a single electronic device, but may be any apparatus or a collection of circuits capable of executing the above-described instructions (or instruction sets) individually or in combination. The electronic device 300 may also be part of an integrated control system or system manager, or may be configured as a portable electronic device that interfaces with either locally or remotely (e.g., via wireless transmission).
In electronic device 300, processor 302 may include a Central Processing Unit (CPU), a Graphics Processor (GPU), a programmable logic device, a special purpose processor system, a microcontroller, or a microprocessor. By way of example, and not limitation, processors may also include analog processors, digital processors, microprocessors, multi-core processors, processor arrays, network processors, and the like.
The processor 302 may execute instructions or code stored in the memory 301, wherein the memory 301 may also store data. The instructions and data may also be transmitted and received over a network via a network interface device, which may employ any known transmission protocol.
The memory 301 may be integrated with the processor 302, for example, RAM or flash memory disposed within an integrated circuit microprocessor or the like. In addition, the memory 301 may include a stand-alone device, such as an external disk drive, a storage array, or any other storage device usable by a database system. The memory 301 and the processor 302 may be operatively coupled or may communicate with each other, for example, through an I/O port, network connection, etc., such that the processor 302 is able to read files stored in the memory.
In addition, the electronic device 300 may also include a video display (such as a liquid crystal display) and a user interaction interface (such as a keyboard, mouse, touch input device, etc.). All components of the electronic device 300 may be connected to each other via a bus and/or a network.
According to an exemplary embodiment of the present disclosure, there may also be provided a computer-readable storage medium, which when executed by at least one processor, causes the at least one processor to perform a video stream playback method according to an exemplary embodiment of the present disclosure. Examples of the computer readable storage medium herein include: read-only memory (ROM), random-access programmable read-only memory (PROM), electrically erasable programmable read-only memory (EEPROM), random-access memory (RAM), dynamic random-access memory (DRAM), static random-access memory (SRAM), flash memory, nonvolatile memory, CD-ROM, CD-R, CD + R, CD-RW, CD+RW, DVD-ROM, DVD-R, DVD + R, DVD-RW, DVD+RW, DVD-RAM, BD-ROM, BD-R, BD-R LTH, BD-RE, blu-ray or optical disk storage, hard Disk Drives (HDD), solid State Disks (SSD), card memory (such as multimedia cards, secure Digital (SD) cards or ultra-fast digital (XD) cards), magnetic tape, floppy disks, magneto-optical data storage, hard disks, solid state disks, and any other means configured to store computer programs and any associated data, data files and data structures in a non-transitory manner and to provide the computer programs and any associated data, data files and data structures to a processor or computer to enable the processor or computer to execute the programs. The computer programs in the computer readable storage media described above can be run in an environment deployed in a computer device, such as a client, host, proxy device, server, etc., and further, in one example, the computer programs and any associated data, data files, and data structures are distributed across networked computer systems such that the computer programs and any associated data, data files, and data structures are stored, accessed, and executed in a distributed fashion by one or more processors or computers.
According to an exemplary embodiment of the present disclosure, there may also be provided a computer program product comprising computer instructions which, when executed by at least one processor, cause the at least one processor to perform a video stream playing method according to an exemplary embodiment of the present disclosure.
According to the video stream playing method and the video stream playing device, the capability and experience of freely changing the display style of the video stream at the front end according to the preference of the audience can be given, and the playing flexibility is improved. There are two types of operations on the client side for video streams: one is that for a single video stream, according to user gestures, the player can freely adjust the rendering size and resolution of the video stream; the other is to aim at two or more paths of video streams, the client can recognize gestures of audiences and dynamically adjust the position and the rendering area of each path of video stream according to the display size of a mobile phone screen.
Other embodiments of the disclosure will be apparent to those skilled in the art from consideration of the specification and practice of the disclosure disclosed herein. This application is intended to cover any adaptations, uses, or adaptations of the disclosure following, in general, the principles of the disclosure and including such departures from the present disclosure as come within known or customary practice within the art to which the disclosure pertains. It is intended that the specification and examples be considered as exemplary only, with a true scope and spirit of the disclosure being indicated by the following claims.
It is to be understood that the present disclosure is not limited to the precise arrangements and instrumentalities shown in the drawings, and that various modifications and changes may be effected without departing from the scope thereof. The scope of the present disclosure is limited only by the appended claims.
Claims (10)
1. A video stream playing method, characterized in that the video stream playing method comprises:
playing the target video stream;
receiving an adjustment input to adjust a rendering region of the target video stream;
according to the adjustment input, adjusting a rendering area of the target video stream;
in the case where the target video stream is a composite video stream composed of at least two original video streams, the video stream playing method further includes, before receiving the adjustment input:
receiving a selected input selecting a target rendering area corresponding to a target original video stream of the at least two original video streams;
and sending a switching request to a server according to the selected input, wherein the switching request is used for requesting the server to switch the issued composite video stream into the at least two original video streams, and the composite video stream is a live video stream of the at least two original video streams.
2. The video stream playing method as claimed in claim 1, wherein,
the adjustment input includes a scaling input to adjust a size of a rendering area, the scaling input including a first scaling input to scale the size of the rendering area of the target video stream to a first scale and a second scaling input to scale the size of the target video stream to a second scale to scale the size of the rendering area of the target video stream to the second scale.
3. The video stream playing method according to claim 1 or 2, wherein the adjustment input includes a movement input to adjust a position of a rendering area, and the adjusting the rendering area of the target video stream according to the adjustment input includes:
adjusting the position of the target rendering area according to the movement input to the target rendering area;
and switching the arrangement mode of the rendering areas of the at least two original video streams under the condition that the change of the position of the target rendering area meets the set condition.
4. The video stream playing method according to claim 3, wherein the determining that the change in the position of the target rendering area satisfies a set condition includes:
and determining that the moving distance of the target rendering area and the height or width of the target rendering area meet a set relation.
5. A video stream playback device, the video stream playback device comprising:
a playback unit configured to: playing the target video stream;
a receiving unit configured to: receiving an adjustment input to adjust a rendering region of the target video stream;
an adjustment unit configured to: according to the adjustment input, adjusting a rendering area of the target video stream;
in case the target video stream is a composite video stream of a composite of at least two original video streams,
the receiving unit is further configured to: before receiving the adjustment input, receiving a selection input selecting a target rendering area corresponding to a target original video stream of the at least two original video streams;
the video stream playing device further includes a requesting unit configured to: and sending a switching request to a server according to the selected input, wherein the switching request is used for requesting the server to switch the issued composite video stream into the at least two original video streams, and the composite video stream is a live video stream of the at least two original video streams.
6. The video stream playback device as set forth in claim 5, wherein,
the adjustment input includes a scaling input to adjust a size of a rendering area, the scaling input including a first scaling input to scale the size of the rendering area of the target video stream to a first scale and a second scaling input to scale the size of the target video stream to a second scale to scale the size of the rendering area of the target video stream to the second scale.
7. The video stream playback device of claim 5 or 6, wherein the adjustment input comprises a movement input that adjusts a position of a rendering area, the adjustment unit further configured to:
adjusting the position of the target rendering area according to the movement input to the target rendering area;
and switching the arrangement mode of the rendering areas of the at least two original video streams under the condition that the change of the position of the target rendering area meets the set condition.
8. The video stream playback device of claim 7, wherein the adjustment unit is further configured to:
and determining that the moving distance of the target rendering area and the height or width of the target rendering area meet a set relation.
9. An electronic device, comprising:
at least one processor;
at least one memory storing computer-executable instructions,
wherein the computer executable instructions, when executed by the at least one processor, cause the at least one processor to perform the video stream playback method of any one of claims 1 to 4.
10. A computer readable storage medium, wherein instructions in the computer readable storage medium, when executed by at least one processor, cause the at least one processor to perform the video stream playback method of any one of claims 1 to 4.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202110861883.5A CN113596561B (en) | 2021-07-29 | 2021-07-29 | Video stream playing method, device, electronic equipment and computer readable storage medium |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202110861883.5A CN113596561B (en) | 2021-07-29 | 2021-07-29 | Video stream playing method, device, electronic equipment and computer readable storage medium |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN113596561A CN113596561A (en) | 2021-11-02 |
| CN113596561B true CN113596561B (en) | 2023-06-27 |
Family
ID=78251552
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202110861883.5A Active CN113596561B (en) | 2021-07-29 | 2021-07-29 | Video stream playing method, device, electronic equipment and computer readable storage medium |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN113596561B (en) |
Families Citing this family (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN114900731B (en) * | 2022-03-31 | 2024-04-09 | 咪咕文化科技有限公司 | Video definition switching method and device |
Citations (10)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN107801093A (en) * | 2017-10-26 | 2018-03-13 | 深圳市量子视觉科技有限公司 | Video Rendering method, apparatus, computer equipment and readable storage medium storing program for executing |
| CN109151497A (en) * | 2018-08-06 | 2019-01-04 | 广州虎牙信息科技有限公司 | A kind of even wheat live broadcasting method, device, electronic equipment and storage medium |
| CN109168040A (en) * | 2018-10-29 | 2019-01-08 | 广州华多网络科技有限公司 | A kind of program listing display methods, equipment and readable storage medium storing program for executing |
| CN110798697A (en) * | 2019-11-22 | 2020-02-14 | 广州华多网络科技有限公司 | Video display method, device and system and electronic equipment |
| CN111510780A (en) * | 2020-04-10 | 2020-08-07 | 广州华多网络科技有限公司 | Video live broadcast control, bridging, flow control and broadcast control method and client |
| CN111556357A (en) * | 2020-04-30 | 2020-08-18 | 广州华多网络科技有限公司 | Method, device and equipment for playing live video and storage medium |
| CN111818359A (en) * | 2020-09-14 | 2020-10-23 | 北京达佳互联信息技术有限公司 | Processing method and device for live interactive video, electronic equipment and server |
| CN112104880A (en) * | 2020-08-31 | 2020-12-18 | 广州华多网络科技有限公司 | Network connection live broadcast control and display method and device, equipment and storage medium |
| WO2021047420A1 (en) * | 2019-09-11 | 2021-03-18 | 广州华多网络科技有限公司 | Virtual gift special effect rendering method and apparatus, and live streaming system |
| CN112543350A (en) * | 2020-12-03 | 2021-03-23 | 湖南快乐阳光互动娱乐传媒有限公司 | Live broadcast interaction method and device |
Family Cites Families (10)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US7768536B2 (en) * | 2007-04-11 | 2010-08-03 | Sony Ericsson Mobile Communications Ab | Methods of displaying information at different zoom settings and related devices and computer program products |
| CN105916036A (en) * | 2015-12-18 | 2016-08-31 | 乐视云计算有限公司 | Video image switching method and apparatus |
| TWI617969B (en) * | 2016-11-24 | 2018-03-11 | 新加坡商雲網科技新加坡有限公司 | Method for output control and user terminal using the same |
| CN106802759A (en) * | 2016-12-21 | 2017-06-06 | 华为技术有限公司 | The method and terminal device of video playback |
| CN111246232A (en) * | 2020-01-17 | 2020-06-05 | 广州华多网络科技有限公司 | Live broadcast interaction method and device, electronic equipment and storage medium |
| CN111541930B (en) * | 2020-04-27 | 2023-04-25 | 广州酷狗计算机科技有限公司 | Live broadcast picture display method and device, terminal and storage medium |
| CN111935532B (en) * | 2020-08-14 | 2024-03-01 | 腾讯科技（深圳）有限公司 | Video interaction method and device, electronic equipment and storage medium |
| CN112261434A (en) * | 2020-10-22 | 2021-01-22 | 广州华多网络科技有限公司 | Interface layout control and processing method and corresponding device, equipment and medium |
| CN112752116A (en) * | 2020-12-30 | 2021-05-04 | 广州繁星互娱信息科技有限公司 | Display method, device, terminal and storage medium of live video picture |
| CN112399123B (en) * | 2021-01-19 | 2021-06-01 | 游密科技(深圳)有限公司 | Video definition adjusting method and device, electronic equipment and storage medium |
-
2021
- 2021-07-29 CN CN202110861883.5A patent/CN113596561B/en active Active
Patent Citations (10)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN107801093A (en) * | 2017-10-26 | 2018-03-13 | 深圳市量子视觉科技有限公司 | Video Rendering method, apparatus, computer equipment and readable storage medium storing program for executing |
| CN109151497A (en) * | 2018-08-06 | 2019-01-04 | 广州虎牙信息科技有限公司 | A kind of even wheat live broadcasting method, device, electronic equipment and storage medium |
| CN109168040A (en) * | 2018-10-29 | 2019-01-08 | 广州华多网络科技有限公司 | A kind of program listing display methods, equipment and readable storage medium storing program for executing |
| WO2021047420A1 (en) * | 2019-09-11 | 2021-03-18 | 广州华多网络科技有限公司 | Virtual gift special effect rendering method and apparatus, and live streaming system |
| CN110798697A (en) * | 2019-11-22 | 2020-02-14 | 广州华多网络科技有限公司 | Video display method, device and system and electronic equipment |
| CN111510780A (en) * | 2020-04-10 | 2020-08-07 | 广州华多网络科技有限公司 | Video live broadcast control, bridging, flow control and broadcast control method and client |
| CN111556357A (en) * | 2020-04-30 | 2020-08-18 | 广州华多网络科技有限公司 | Method, device and equipment for playing live video and storage medium |
| CN112104880A (en) * | 2020-08-31 | 2020-12-18 | 广州华多网络科技有限公司 | Network connection live broadcast control and display method and device, equipment and storage medium |
| CN111818359A (en) * | 2020-09-14 | 2020-10-23 | 北京达佳互联信息技术有限公司 | Processing method and device for live interactive video, electronic equipment and server |
| CN112543350A (en) * | 2020-12-03 | 2021-03-23 | 湖南快乐阳光互动娱乐传媒有限公司 | Live broadcast interaction method and device |
Also Published As
| Publication number | Publication date |
|---|---|
| CN113596561A (en) | 2021-11-02 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US11188208B2 (en) | Display apparatus for classifying and searching content, and method thereof | |
| WO2019007227A1 (en) | Method and apparatus for continuing to display view after switching pages | |
| JP5681191B2 (en) | Method and apparatus for providing an application interface on a computer peripheral | |
| JP6754968B2 (en) | A computer-readable storage medium that stores a video playback method, video playback device, and video playback program. | |
| US8918737B2 (en) | Zoom display navigation | |
| US10657928B2 (en) | Projected content based display device and display method | |
| JP2021516911A (en) | Video generation methods, devices, electronics and computer readable storage media | |
| CN110446110B (en) | Video playing method, video playing device and storage medium | |
| US20150339026A1 (en) | User terminal device, method for controlling user terminal device, and multimedia system thereof | |
| US9137509B2 (en) | Systems and methods for instructional video navigation and note taking | |
| CN111866423A (en) | Screen recording method for electronic terminal and corresponding equipment | |
| JP5344651B2 (en) | Information processing apparatus, control method, program, and information processing system | |
| CN113342248A (en) | Live broadcast display method and device, storage medium and electronic equipment | |
| CN111510788B (en) | Display method and display device for double-screen double-system screen switching animation | |
| JP2018521550A (en) | Method, client and computer storage medium for playing video | |
| CN113596561B (en) | Video stream playing method, device, electronic equipment and computer readable storage medium | |
| JP2007074603A (en) | Electronic program guide display device | |
| KR20150066112A (en) | display apparatus controlled by remote controller, display system comprising the display apparatus and methods thereof | |
| US8856827B1 (en) | System for conveying and reproducing images for interactive applications | |
| KR101799381B1 (en) | Display apparatus and control method thereof | |
| KR101895865B1 (en) | System and method for adaptive playing of landscape video content | |
| CN112367550A (en) | Method for realizing multi-title dynamic display of media asset list and display equipment | |
| KR20210001069A (en) | Apparatus and method for displaying video contents | |
| US20120268575A1 (en) | Electronic apparatus and video display method | |
| CN114466252B (en) | Page video playing method and device, electronic equipment and storage medium |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |