CN112788276A - Video stream display method, transmission method, device, terminal, server and medium - Google Patents
Video stream display method, transmission method, device, terminal, server and medium Download PDFInfo
- Publication number
- CN112788276A CN112788276A CN201911096173.7A CN201911096173A CN112788276A CN 112788276 A CN112788276 A CN 112788276A CN 201911096173 A CN201911096173 A CN 201911096173A CN 112788276 A CN112788276 A CN 112788276A
- Authority
- CN
- China
- Prior art keywords
- video stream
- terminal
- target video
- information
- server
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Images
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N7/00—Television systems
- H04N7/14—Systems for two-way working
- H04N7/15—Conference systems
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/20—Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
- H04N21/23—Processing of content or additional data; Elementary server operations; Server middleware
- H04N21/234—Processing of video elementary streams, e.g. splicing of video streams, manipulating MPEG-4 scene graphs
- H04N21/2343—Processing of video elementary streams, e.g. splicing of video streams, manipulating MPEG-4 scene graphs involving reformatting operations of video signals for distribution or compliance with end-user requests or end-user device requirements
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/20—Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
- H04N21/23—Processing of content or additional data; Elementary server operations; Server middleware
- H04N21/234—Processing of video elementary streams, e.g. splicing of video streams, manipulating MPEG-4 scene graphs
- H04N21/2343—Processing of video elementary streams, e.g. splicing of video streams, manipulating MPEG-4 scene graphs involving reformatting operations of video signals for distribution or compliance with end-user requests or end-user device requirements
- H04N21/234363—Processing of video elementary streams, e.g. splicing of video streams, manipulating MPEG-4 scene graphs involving reformatting operations of video signals for distribution or compliance with end-user requests or end-user device requirements by altering the spatial resolution, e.g. for clients with a lower screen resolution
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/20—Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
- H04N21/25—Management operations performed by the server for facilitating the content distribution or administrating data related to end-users or client devices, e.g. end-user or client device authentication, learning user preferences for recommending movies
- H04N21/266—Channel or content management, e.g. generation and management of keys and entitlement messages in a conditional access system, merging a VOD unicast channel into a multicast channel
- H04N21/2662—Controlling the complexity of the video stream, e.g. by scaling the resolution or bitrate of the video stream based on the client capabilities
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
- H04N21/431—Generation of visual interfaces for content selection or interaction; Content or additional data rendering
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
- H04N21/431—Generation of visual interfaces for content selection or interaction; Content or additional data rendering
- H04N21/4312—Generation of visual interfaces for content selection or interaction; Content or additional data rendering involving specific graphical features, e.g. screen layout, special fonts or colors, blinking icons, highlights or animations
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/60—Network structure or processes for video distribution between server and client or between remote clients; Control signalling between clients, server and network components; Transmission of management data between server and client, e.g. sending from server to client commands for recording incoming content stream; Communication details between server and client
- H04N21/65—Transmission of management data between client and server
- H04N21/658—Transmission by the client directed to the server
- H04N21/6587—Control parameters, e.g. trick play commands, viewpoint selection
Abstract
The application provides a video stream layout method, device, system, terminal, server and medium. The method sends picture layout information to a server; requesting a target video stream with a corresponding resolution from a server according to the picture layout information; and receiving the target video stream and displaying the target video stream according to the picture layout information.
Description
Technical Field
The present application relates to video processing, and for example, to a video stream display method, a video stream transmission device, a terminal, a server, and a medium.
Background
Cloud video conferences, multi-party videos and the like become effective cooperation modes of office and communication at different places, can replace on-site conferences, and bring great convenience to people. Taking a cloud video conference as an example, in a multi-screen mode, a media server generally synthesizes video streams acquired from various terminals and then sends the video streams to all participating terminals, and the terminals receive and display the synthesized screen. In the prior art, the picture layout and the quality are fixed and unchangeable, and the picture layout and the quality cannot be flexibly adjusted, so that various requirements of participants are difficult to meet.
Disclosure of Invention
The application provides a video stream display method, a video stream transmission device, a terminal, a server and a medium, so as to adjust the picture layout of a video stream and improve the flexibility of the layout and the picture quality.
The embodiment of the application provides a video stream display method, which is applied to a first terminal and comprises the following steps:
sending picture layout information to a server;
requesting a target video stream with a corresponding resolution from a server according to the picture layout information;
and receiving the target video stream and displaying the target video stream according to the picture layout information.
The embodiment of the present application further provides a video stream sending method, applied to a server, including:
receiving picture layout information and a target video stream request of a first terminal;
and sending the target video stream with the corresponding resolution to the first terminal according to the picture layout information and the target video stream request.
An embodiment of the present application further provides a video stream display device, including:
an information sending module configured to send the screen layout information to a server;
the request module is arranged to request a target video stream with corresponding resolution from a server according to the picture layout information;
and the video stream display module is used for receiving the target video stream and displaying the target video stream according to the picture layout information.
An embodiment of the present application further provides a video stream transmitting apparatus, including:
the information receiving module is used for receiving the picture layout information and the target video stream request of the first terminal;
and the video stream sending module is set to send the target video stream with the corresponding resolution to the first terminal according to the picture layout information and the target video stream request.
An embodiment of the present application further provides a terminal, including:
one or more processors;
storage means for storing one or more programs;
when the one or more programs are executed by the one or more processors, the one or more processors implement the video stream display method applied to the terminal described above.
An embodiment of the present application further provides a server, including:
one or more processors;
storage means for storing one or more programs;
when the one or more programs are executed by the one or more processors, the one or more processors implement the video streaming method applied to the server.
An embodiment of the present application further provides a computer-readable storage medium, on which a computer program is stored, where the computer program, when executed by a processor, implements the video stream display method or the video stream transmission method described above.
Drawings
Fig. 1 is a flowchart of a video stream display method according to an embodiment;
FIG. 2 is a diagram illustrating a layout of a video stream in one embodiment;
FIG. 3 is a flow chart of another method for displaying a video stream according to one embodiment;
fig. 4 is a flowchart of a method for transmitting a video stream according to an embodiment;
fig. 5 is a flowchart of another method for transmitting a video stream according to an embodiment;
FIG. 6 is a schematic diagram of a video stream display apparatus according to an embodiment;
fig. 7 is a schematic structural diagram of a video stream transmitting apparatus according to an embodiment;
FIG. 8 is a schematic diagram of a video stream display system according to an embodiment;
fig. 9 is a schematic structural diagram of a terminal according to an embodiment;
fig. 10 is a schematic structural diagram of a server according to an embodiment.
Detailed Description
The present application will be described with reference to the accompanying drawings and examples. It is to be understood that the specific embodiments described herein are merely illustrative of the application and are not limiting of the application. It should be noted that the embodiments and features of the embodiments in the present application may be arbitrarily combined with each other without conflict. It should be further noted that, for the convenience of description, only some of the structures related to the present application are shown in the drawings, not all of the structures.
In scenes such as a cloud video conference, a multi-party video and the like, in a multi-picture mode, each terminal sends one video stream to a server, the server receives the video streams sent by the terminals and then carries out picture synthesis, the synthesized video streams are sent to all terminals participating in the conference, and each terminal receives one video stream. In this way, the terminal can only receive the synthesized video stream, and the picture layout and picture quality of the video stream are fixed and cannot be adjusted at the terminal. However, in many video scenes, each terminal and user have different requirements for the layout and quality of the synthesized picture, for example, one or more video streams need to be displayed in an enlarged manner, or need to be watched with emphasis, or need only watch the video streams of a part of terminals, and other terminals do not need to provide voice or video signals.
In the embodiment of the application, a video stream display method is provided, in which a terminal sends multiple paths of video streams to a server, the server does not perform picture synthesis but directly sends target video streams according to a request of the terminal, and the terminal decodes each path of target video stream to autonomously perform picture layout and display, so that the terminal can flexibly adjust the picture layout, and one path of transmitted video streams is changed into multiple paths.
Fig. 1 is a flowchart of a video stream display method according to an embodiment. The video stream display method provided by the embodiment can be applied to a first terminal, namely a terminal which actively initiates picture layout adjustment. As shown in fig. 1, the method includes step 110, step 120, and step 130.
In step 110, screen layout information is transmitted to the server.
In this embodiment, the screen layout information refers to information that is sent by the first terminal to the server to reflect a layout adjustment status when the first terminal initiates adjustment of the screen layout.
FIG. 2 is a diagram illustrating a picture layout of a video stream according to an embodiment. As shown in fig. 2, taking the multi-video screen of the multi-party conference as an example, the participant terminals at least include A, B, C, D, E and F, and the default screen layout is: the display areas of A and B are equal in size and relatively large and are arranged above; C. d, E and F are of equal size and are relatively small, arranged below. In some embodiments, the resolution of the video stream with the larger display area is also larger, such as resolution r of A and B in FIG. 21Greater than resolution r of the video stream of the other terminal2. In the video conference process, each terminal sends video streams with different resolutions to the server, and the resolution of each video stream displayed by the terminal corresponds to the size of a display area. The host (for example, a) or any one of the hosts of the conference may adjust the screen layout by means of voice, touch screen, mouse click, etc., and change the number of the displayed video streams, the arrangement positions of the video streams from the respective terminals, and/or the size of the display area. For example, a and B may be interchanged (only the arrangement position is changed), a and C may be interchanged (the arrangement position is changed, the display area of a is changed from large to small, the display area of C is changed from small to large), or a part of the video stream of the terminal is removed so that the display area is not occupied. In a case where the adjustment of the screen layout is initiated, the first terminal transmits screen layout information to the server.
In step 120, a target video stream with a corresponding resolution is requested from a server according to the picture layout information.
In this embodiment, the first terminal pulls the target video stream with the corresponding resolution from the server according to the screen layout information and performs multi-screen synthesis locally. For example, in the case where the display areas of the video streams from each terminal are equal in size, the target video streams of the same resolution may be acquired to the server, for example, the video streams of 180P for each of a-F are synthesized and displayed; if the display area of the video stream from each terminal is different in the picture layout, the target video streams with different resolutions can be acquired from the server, for example, the target video stream with a larger display area can acquire the video stream of 720P, the target video stream with a smaller display area can acquire the video stream of 90P, and the like, thereby ensuring the picture quality. And sending picture layout information to the server every time a terminal initiates picture layout adjustment, and re-pulling the target video stream with the corresponding resolution.
In one embodiment, the screen layout information includes at least one of: source information, number information, arrangement position information, and display area information of the target video stream; the resolution of the target video stream is positively correlated with the display area information. The source information and the quantity information indicate from which terminal the target video stream comes and need to occupy several display areas, for example, the video streams of all terminals (a-F) can be displayed to occupy 3 display areas in total, or the video streams of only a part of terminals can be adjusted to be displayed, for example, the video streams from the terminal A, B, C can be displayed to occupy 3 display areas in total. The arrangement position information is the arrangement position or the arrangement order of the target video streams from the terminals, and may be A, B, C, D, E, F in order or may be a random arrangement, for example. The display area information is used to reflect the size of the display area of each target video stream from each terminal, and may be understood as a size, an area, a shape, or the like. When the display area information changes, the terminal needs to acquire a video stream with a corresponding resolution from the server again, for example, a in fig. 2 corresponds to a video stream of 720P, and when a is adjusted to the position of C, the display area becomes smaller, and a corresponding video stream of 90P is pulled from the server. The larger the display area, the higher the corresponding resolution. When the layout of the video streams with the same display area size is changed, the resolution of the pull video stream is not changed, so that the first terminal can only send the arrangement position information to the server.
In step 130, the target video stream is received and displayed according to the screen layout information.
According to the video stream display method, the first terminal sends the picture layout information and the target video stream request to the server, receives the video streams with the corresponding resolution, and the picture synthesis is carried out at the first terminal, so that the picture layout is customized, the layout flexibility is improved, and the problem that the layout cannot be adjusted in various conferences so that the diversity requirements cannot be met is solved.
Fig. 3 is a flowchart of another video stream display method according to an embodiment. The video stream display method provided by the embodiment can be applied to the first terminal. As shown in fig. 3, the method includes steps 210 and 270.
In step 210, a video stream of a preset resolution is sent to a server, where the preset resolution includes at least two resolutions.
In this embodiment, taking a scene of a multi-party conference as an example, each party participating terminal sends a video stream with a preset resolution to a server, where the preset resolution includes, for example, 720P, 180P, and 90P, that is, each terminal sends three video streams to the server, and the three video streams correspond to different resolutions.
In an embodiment, after receiving a video stream with a preset resolution, a server may send default picture layout information to each terminal, and send a default video stream with a corresponding resolution; and under the condition that the picture layout is not adjusted, each terminal displays a default video stream according to default picture layout information until the first terminal initiates the picture layout adjustment, and the first terminal sends the picture layout information to the server.
In step 220, the screen layout information is transmitted to the server.
In step 230, a first target video stream of a corresponding resolution is requested from the server according to the screen layout information.
In this embodiment, the first target video stream represents a target video stream of a corresponding resolution obtained by the first terminal itself initiating the screen layout adjustment.
In step 240, the first target video stream is received and displayed according to the screen layout information.
In step 250, a layout broadcast message transmitted by a server is received, the layout broadcast message including screen layout information from a second terminal.
In this embodiment, the layout broadcast message is sent by the server after the second terminal initiates the screen layout adjustment. After any terminal initiates picture layout adjustment, the server broadcasts the adjustment condition of the picture layout to all terminals, so that other terminals keep consistency with the adjusted new picture layout, and synchronous proceeding of a multi-party conference or videos is guaranteed.
In step 260, a second target video stream of a corresponding resolution is requested from the server according to the layout broadcast message.
In this embodiment, the second target video stream indicates a target video stream of a resolution corresponding to the adjusted new screen layout, which is requested to be acquired from the server by the first terminal in accordance with the layout broadcast message in order to keep the screen layout adjustment of the other terminal (second terminal) consistent. By displaying the second target video stream in accordance with the new picture layout in the layout broadcast message, the consistency of the picture layouts of the terminals is maintained.
In step 270, the second target video stream is received and displayed according to the layout broadcast message.
In the execution sequence between step 210 and step 240 and step 260 of this embodiment, that is, any one terminal may actively initiate the screen layout adjustment, or after the screen layout is adjusted by other terminals, the screen layout may be synchronously adjusted by receiving the layout broadcast message of the server to keep the screen layouts of the terminals consistent.
The embodiment of the application further provides a video stream sending method, the server does not perform picture synthesis after receiving the multiple paths of video streams sent by the terminal, but directly sends the target video streams with corresponding resolutions to the terminal according to a request of the terminal, and the terminal independently performs picture layout and display on each path of target video stream in decoding, so that the flexibility of picture layout and the picture quality are improved.
Fig. 4 is a flowchart of a method for transmitting a video stream according to an embodiment. The video stream transmission method provided by this embodiment can be applied to a server, where the first terminal is a terminal that actively initiates screen layout adjustment. As shown in fig. 4, the method includes step 310 and step 320.
In step 310, screen layout information and a target video stream request of a first terminal are received.
In step 320, a target video stream with a corresponding resolution is sent to the first terminal according to the screen layout information and the target video stream request.
In one embodiment, the screen layout information includes at least one of: source information, number information, arrangement position information, and display area information of the target video stream; the resolution of the target video stream is positively correlated with the display area information.
Fig. 5 is a flowchart of another method for transmitting a video stream according to an embodiment. As shown in fig. 5, the method includes steps 410-450.
In step 410, a video stream of a preset resolution is received from each terminal, wherein the preset resolution comprises at least two resolutions.
In this embodiment, each participant terminal first sends a video stream with a preset resolution to the server, where the preset resolution includes, for example, 720P, 180P, and 90P, that is, each terminal sends three video streams to the server, and the video streams correspond to different resolutions.
In an embodiment, after receiving a video stream with a preset resolution, the server may send default screen layout information to each terminal, and send a default video stream with a corresponding resolution, so that each terminal displays the default video stream according to the default screen layout information without initiating an adjustment of the screen layout.
In step 420, screen layout information and a target video stream request of the first terminal are received.
In step 430, a first target video stream with a corresponding resolution is sent to the first terminal according to the picture layout information and the target video stream request.
In this embodiment, the first target video stream represents a target video stream with a corresponding resolution that the server requests to send according to the picture layout information of the first terminal itself and the target video stream.
In step 440, a layout broadcast message including the screen layout information from the first terminal is transmitted to the second terminal.
In this embodiment, after the first terminal initiates the screen layout adjustment, the server notifies the other terminal (second terminal) of the screen layout information thereof by a layout broadcast message. After any terminal initiates the picture layout adjustment, the server broadcasts the adjustment condition of the picture layout to all terminals, so that other terminals can keep consistent with the adjusted new picture layout, and the multiparty conference or the video can be ensured to be synchronously carried out.
In step 450, a second target video stream with a corresponding resolution is sent to the second terminal according to the layout broadcast message.
In this embodiment, the second target video stream indicates a target video stream of a resolution corresponding to the adjusted new screen layout, which is transmitted according to the layout broadcast message in order to keep the screen layouts of the other terminal (second terminal) and the first terminal consistent.
In an embodiment, the server may also send the second target video stream to the second terminal according to the layout broadcast message and the target video stream request after receiving the target video stream request for obtaining the second target video stream sent by the second terminal according to the layout broadcast message.
The embodiment of the application also provides a video stream display device. Fig. 6 is a schematic structural diagram of a video stream display apparatus according to an embodiment. As shown in fig. 6, the video stream display apparatus includes: an information sending module 510, a request module 520 and a video stream display module 530.
An information sending module 510 configured to send screen layout information to a server;
a request module 520 configured to request a target video stream with a corresponding resolution from a server according to the picture layout information;
a video stream display module 530 configured to receive the target video stream and display the target video stream according to the screen layout information.
The video stream display device of the embodiment displays the target video stream according to the picture layout information by sending the picture layout information to the server and requesting the target video stream corresponding to the resolution, so that the picture layout can be flexibly adjusted at the terminal side, the quality of the displayed picture is ensured, and the flexibility and diversity of the multi-picture layout are improved.
In one embodiment, the video stream display apparatus further includes:
the system comprises a preset video stream sending module, a server and a video stream processing module, wherein the preset video stream sending module is used for sending a video stream with preset resolution to the server, and the preset resolution comprises at least two resolutions.
In one embodiment, the screen layout information includes at least one of:
source information, number information, arrangement position information, and display area information of the target video stream;
the resolution of the target video stream is positively correlated with the display area information.
In one embodiment, the video stream display apparatus further includes:
a broadcast message receiving module configured to receive a layout broadcast message transmitted by the server, the layout broadcast message including picture layout information from the second terminal.
In one embodiment, the request module 520 is further configured to:
and requesting a target video stream with a corresponding resolution from a server according to the layout broadcast message.
In one embodiment, the video stream display module 530 is further configured to:
and receiving the target video stream and displaying the target video stream according to the layout broadcast message.
The video stream display apparatus proposed by the present embodiment belongs to the same inventive concept as the video stream display method proposed by the above embodiments, and technical details that are not described in detail in the present embodiment can be referred to any of the above embodiments, and the present embodiment has the same advantageous effects as the video stream display method is performed.
The embodiment of the application also provides a video stream sending device. Fig. 7 is a schematic structural diagram of a video stream transmitting apparatus according to an embodiment. As shown in fig. 7, the video stream transmitting apparatus includes: an information receiving module 610, and a video stream transmitting module 620.
An information receiving module 610 configured to receive screen layout information and a target video stream request of a first terminal;
and a video stream sending module 620 configured to send a target video stream with a corresponding resolution to the first terminal according to the picture layout information and the target video stream request.
The video stream transmitting device of the embodiment transmits the target video stream with the corresponding resolution to the terminal according to the picture layout information, and can provide the corresponding video stream to the terminal to ensure the picture quality on the premise that the terminal can flexibly adjust the picture layout of the video stream, thereby improving the flexibility and diversity of multi-picture layout.
In one embodiment, the video stream transmission apparatus further includes:
the device comprises a preset video stream receiving module, a preset video stream receiving module and a preset resolution processing module, wherein the preset resolution processing module is used for receiving a video stream with preset resolution from each terminal, and the preset resolution comprises at least two resolutions.
In one embodiment, the screen layout information includes at least one of:
source information, number information, arrangement position information, and display area information of the target video stream;
the resolution of the target video stream is positively correlated with the display area information.
In one embodiment, the video stream transmission apparatus further includes:
a broadcast message transmitting module configured to transmit a layout broadcast message to the second terminal, the layout broadcast message including the picture layout information from the first terminal.
In an embodiment, the information receiving module 610 is further configured to:
a target video stream request of the second terminal is received.
In an embodiment, the video stream sending module 620 is further configured to:
and sending the target video stream with the corresponding resolution to the second terminal according to the layout broadcast message and the target video stream request.
The video stream transmission apparatus proposed by the present embodiment belongs to the same inventive concept as the video stream transmission method proposed by the above-described embodiment, and technical details that are not described in detail in the present embodiment can be referred to any of the above-described embodiments, and the present embodiment has the same advantageous effects as performing the video stream transmission method.
The embodiment of the application also provides a video stream display system. Fig. 8 is a schematic structural diagram of a video stream display system according to an embodiment. As shown in fig. 8, the system includes: the terminal comprises a server 710 and at least two terminals 720, wherein the terminal which actively initiates the picture layout adjustment is a first terminal, and the terminal which passively receives the picture layout adjustment initiated by other terminals and needs to keep the same layout with the terminal which initiates the adjustment is a second terminal. The video stream display apparatus according to any of the above embodiments is integrated in each terminal, and can be used to implement the video stream display method according to any of the above embodiments, that is, the screen layout of the terminal itself can be adjusted, and the terminal can also receive the layout broadcast message and keep the same as the adjusted screen layout of another terminal. The server 710 is integrated with the video stream transmitting apparatus according to any of the embodiments described above, and may be configured to implement the video stream transmitting method according to any of the embodiments described above, that is, the target video stream with a corresponding resolution is transmitted according to the screen layout information of the terminal and the target video stream request, so that the terminal adjusts and correspondingly displays the screen layout, and the screen layout information may be broadcast to other terminals, so that each terminal maintains the consistency of the screen layout, thereby ensuring reliable execution of multiple videos. In this embodiment, the adjusting of the screen layout includes adjusting the source, the arrangement position, and the display area (size, dimension, and area) of each target video stream, and the resolution of the target video stream acquired by the terminal has a preset corresponding relationship with the display area information.
The video stream display system proposed by the present embodiment belongs to the same inventive concept as the video stream display method and the video stream transmission method proposed by the above embodiments, and has the same beneficial effects. Technical details that are not elaborated in this embodiment may be referred to any of the embodiments described above.
The embodiment of the application also provides a terminal. The video stream display method may be performed by a video stream display apparatus, which may be implemented in software and/or hardware, and integrated in the terminal. The terminal can be a computer, a tablet, a mobile phone, a network television and other user equipment. Under the condition that the terminal actively initiates picture layout adjustment, the terminal is a first terminal; and under the condition that the terminal passively accepts the picture layout adjustment initiated by other terminals and needs to keep the layout consistent with the terminal initiating the adjustment, the terminal is the second terminal.
Fig. 9 is a schematic structural diagram of a terminal according to an embodiment. As shown in fig. 9, the terminal provided in this embodiment includes: a processor 810 and a storage 820. The number of the processors in the terminal may be one or more, fig. 9 illustrates one processor 810, the processor 810 and the storage 820 in the device may be connected by a bus or in other manners, and fig. 9 illustrates the connection by a bus.
The one or more programs are executed by the one or more processors 810, so that the one or more processors implement the video stream display method according to any of the embodiments described above.
The storage device 820 in the terminal, which is a computer-readable storage medium, can be used to store one or more programs, which can be software programs, computer-executable programs, and modules, such as program instructions/modules corresponding to the video stream display method in the embodiment of the present invention (for example, the modules in the video stream display device shown in fig. 6, including the information sending module 510, the request module 520, and the video stream display module 530). The processor 810 executes various functional applications and data processing of the terminal by executing software programs, instructions and modules stored in the storage device 820, that is, implements the video stream display method in the above-described method embodiment.
The storage device 820 mainly includes a storage program area and a storage data area, wherein the storage program area can store an operating system and an application program required by at least one function; the storage data area may store data created according to the use of the apparatus, etc. (picture layout information, target video stream, etc. as in the above-described embodiments). Further, storage 820 may include high speed random access memory, and may also include non-volatile memory, such as at least one magnetic disk storage device, flash memory device, or other non-volatile solid state storage device. In some examples, storage 820 may further include memory located remotely from processor 810, which may be connected to the terminal over a network. Examples of such networks include, but are not limited to, the internet, intranets, local area networks, mobile communication networks, and combinations thereof.
And, when one or more programs included in the above terminal are executed by the one or more processors 810, implement the following operations: sending picture layout information to a server; requesting a target video stream with a corresponding resolution from a server according to the picture layout information; and receiving the target video stream and displaying the target video stream according to the picture layout information.
The terminal proposed by the present embodiment belongs to the same inventive concept as the video stream display method proposed by the above embodiments, and technical details that are not described in detail in the present embodiment can be referred to any of the above embodiments, and the present embodiment has the same beneficial effects as the video stream display method.
The embodiment of the application also provides a server. The video streaming method may be performed by a video streaming apparatus, which may be implemented in software and/or hardware, and integrated in the server. The server can be an industrial integrated server, a system background server and a cloud server. The first terminal is a terminal which initiatively initiates picture layout adjustment; the second terminal is a terminal which passively receives the screen layout adjustment initiated by other terminals and needs to keep the layout consistent with the terminal initiating the adjustment.
Fig. 10 is a schematic structural diagram of a server according to an embodiment. As shown in fig. 10, the present embodiment provides a server, including: a processor 910 and a storage 920. The number of the processors in the server may be one or more, fig. 10 illustrates one processor 910, the processor 910 and the storage 920 in the device may be connected by a bus or in other manners, and fig. 10 illustrates the connection by a bus.
The one or more programs are executed by the one or more processors 910, so that the one or more processors implement the method for transmitting a video stream according to any of the embodiments described above.
The storage device 920 in the server, which is a computer-readable storage medium, can be used to store one or more programs, which may be software programs, computer-executable programs, and modules, such as program instructions/modules corresponding to the video stream transmission method in the embodiment of the present invention (for example, the modules in the video stream transmission device shown in fig. 6 include the information receiving module 610 and the video stream transmission module 620). The processor 910 executes various functional applications and data processing of the server by running software programs, instructions and modules stored in the storage 920, that is, implements the video stream transmission method in the above method embodiment.
The storage device 920 mainly includes a storage program area and a storage data area, wherein the storage program area can store an operating system and an application program required by at least one function; the storage data area may store data created according to the use of the apparatus, etc. (picture layout information, target video stream, etc. as in the above-described embodiments). Additionally, the storage 920 may include high speed random access memory, and may also include non-volatile memory, such as at least one magnetic disk storage device, flash memory device, or other non-volatile solid state storage device. In some examples, the storage 920 may further include memory located remotely from the processor 910, which may be connected to a server over a network. Examples of such networks include, but are not limited to, the internet, intranets, local area networks, mobile communication networks, and combinations thereof.
And, when one or more programs included in the above server are executed by the one or more processors 910, the following operations are implemented: sending picture layout information to a server; requesting a target video stream with a corresponding resolution from a server according to the picture layout information; and receiving the target video stream and displaying the target video stream according to the picture layout information.
The server proposed by the present embodiment belongs to the same inventive concept as the video stream transmission method proposed by the above embodiments, and details of the technique that are not described in detail in the present embodiment can be referred to any of the above embodiments, and the present embodiment has the same advantageous effects as performing the video stream transmission method.
Embodiments of the present application also provide a storage medium containing computer-executable instructions, which when executed by a computer processor, are configured to perform a video stream display method or a video stream transmission method.
Through the above description of the embodiments, those skilled in the art will appreciate that the present application can be implemented by software, general hardware, or hardware. Based on such understanding, the technical solution of the present application may be embodied in the form of a software product, and the computer software product may be stored in a computer-readable storage medium, such as a floppy disk, a Read-Only Memory (ROM), a Random Access Memory (RAM), a FLASH Memory (FLASH), a hard disk or an optical disk of a computer, and includes a plurality of instructions for enabling a computer device (which may be a personal computer, a server, or a network device) to execute the method according to any embodiment of the present application.
The above description is only exemplary embodiments of the present application, and is not intended to limit the scope of the present application.
Any logic flow block diagrams in the figures of this application may represent program steps, or may represent interconnected logic circuits, modules, and functions, or may represent a combination of program steps and logic circuits, modules, and functions. The computer program may be stored on a memory. The memory may be of any type suitable to the local technical environment and may be implemented using any suitable data storage technology, such as, but not limited to, Read Only Memory (ROM), Random Access Memory (RAM), optical storage devices and systems (digital versatile disks, DVDs, or CD discs), etc. The computer readable medium may include a non-transitory storage medium. The data processor may be of any type suitable to the local technical environment, such as but not limited to general purpose computers, special purpose computers, microprocessors, Digital Signal Processors (DSPs), Application Specific Integrated Circuits (ASICs), programmable logic devices (FGPAs), and processors based on a multi-core processor architecture.
The foregoing has provided by way of exemplary and non-limiting examples a detailed description of exemplary embodiments of the present application. Various modifications and adaptations to the foregoing embodiments may become apparent to those skilled in the relevant arts in view of the following drawings and the appended claims without departing from the scope of the invention. Therefore, the proper scope of the invention is to be determined according to the claims.
Claims (13)
1. A video stream display method applied to a first terminal is characterized by comprising the following steps:
sending picture layout information to a server;
requesting a target video stream with a corresponding resolution from a server according to the picture layout information;
and receiving the target video stream and displaying the target video stream according to the picture layout information.
2. The method according to claim 1, further comprising, before said sending screen layout information to a server:
and sending a video stream with preset resolution to a server, wherein the preset resolution comprises at least two resolutions.
3. The method according to claim 1, wherein the screen layout information includes at least one of:
source information, number information, arrangement position information, and display area information of the target video stream;
the resolution of the target video stream is positively correlated with the display area information.
4. The method according to any one of claims 1-3, further comprising:
receiving a layout broadcast message transmitted by a server, the layout broadcast message including picture layout information from a second terminal.
5. A method for sending video stream, applied to a server, is characterized by comprising:
receiving picture layout information and a target video stream request of a first terminal;
and sending the target video stream with the corresponding resolution to the first terminal according to the picture layout information and the target video stream request.
6. The method of claim 5, further comprising, prior to said receiving picture layout information and a target video stream request:
receiving a video stream of a preset resolution from each terminal, wherein the preset resolution comprises at least two resolutions.
7. The method according to claim 5, wherein the screen layout information comprises at least one of:
source information, number information, arrangement position information, and display area information of the target video stream;
the resolution of the target video stream is positively correlated with the display area information.
8. The method of any one of claims 5-7, further comprising:
transmitting a layout broadcast message including the picture layout information from the first terminal to the second terminal.
9. A video stream display apparatus, comprising:
an information sending module configured to send the screen layout information to a server;
the request module is arranged to request a target video stream with corresponding resolution from a server according to the picture layout information;
and the video stream display module is used for receiving the target video stream and displaying the target video stream according to the picture layout information.
10. A video stream transmission apparatus, comprising:
the information receiving module is used for receiving the picture layout information and the target video stream request of the first terminal;
and the video stream sending module is set to send the target video stream with the corresponding resolution to the first terminal according to the picture layout information and the target video stream request.
11. A terminal, comprising:
one or more processors;
storage means for storing one or more programs;
when executed by the one or more processors, cause the one or more processors to implement the display method of any one of claims 1-4.
12. A server, comprising:
one or more processors;
storage means for storing one or more programs;
when executed by the one or more processors, cause the one or more processors to implement the transmission method of claims 5-8.
13. A computer-readable storage medium, on which a computer program is stored, which, when being executed by a processor, carries out the display method according to any one of claims 1 to 4 or the transmission method according to any one of claims 5 to 8.
Priority Applications (2)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201911096173.7A CN112788276A (en) | 2019-11-11 | 2019-11-11 | Video stream display method, transmission method, device, terminal, server and medium |
| PCT/CN2020/124044 WO2021093575A1 (en) | 2019-11-11 | 2020-10-27 | Video stream display method and apparatus, video stream sending method and apparatus, terminal, server and medium |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201911096173.7A CN112788276A (en) | 2019-11-11 | 2019-11-11 | Video stream display method, transmission method, device, terminal, server and medium |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN112788276A true CN112788276A (en) | 2021-05-11 |
Family
ID=75749784
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201911096173.7A Pending CN112788276A (en) | 2019-11-11 | 2019-11-11 | Video stream display method, transmission method, device, terminal, server and medium |
Country Status (2)
| Country | Link |
|---|---|
| CN (1) | CN112788276A (en) |
| WO (1) | WO2021093575A1 (en) |
Cited By (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN113315927A (en) * | 2021-05-27 | 2021-08-27 | 维沃移动通信有限公司 | Video processing method and device, electronic equipment and storage medium |
| CN114449205A (en) * | 2022-04-08 | 2022-05-06 | 浙江华创视讯科技有限公司 | Data processing method, terminal device, electronic device and storage medium |
| US20220353434A1 (en) * | 2020-10-30 | 2022-11-03 | Boe Technology Group Co., Ltd. | Method, apparatus and system for implementing video conference, and storage medium |
| CN115802093A (en) * | 2023-02-06 | 2023-03-14 | 杭州阿启视科技有限公司 | Video playing method and device, electronic equipment and storage medium |
Family Cites Families (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101742223B (en) * | 2010-01-19 | 2012-08-22 | 华平信息技术股份有限公司 | Intelligent video stream bandwidth regulating method |
| CN102695035B (en) * | 2011-03-24 | 2015-05-20 | 创想空间软件技术(北京)有限公司 | Bandwidth-adaptive video conference |
| CN104683729A (en) * | 2013-11-27 | 2015-06-03 | 华为技术有限公司 | Method and device for issuing video layout |
| CN107241564B (en) * | 2016-03-29 | 2020-09-18 | 华为技术有限公司 | Multi-stream video conference method, device and system based on IMS network architecture |
| CN107277425A (en) * | 2016-04-08 | 2017-10-20 | 中兴通讯股份有限公司 | A kind of server, meeting-place terminal and cloud meeting processing method |
| US10110831B2 (en) * | 2016-09-27 | 2018-10-23 | Panasonic Intellectual Property Management Co., Ltd. | Videoconference device |
| CN107493498A (en) * | 2017-08-08 | 2017-12-19 | 陕西中联电科电子有限公司 | By can touch-control moving icon realize method that video conference multi-screen video shows |
-
2019
- 2019-11-11 CN CN201911096173.7A patent/CN112788276A/en active Pending
-
2020
- 2020-10-27 WO PCT/CN2020/124044 patent/WO2021093575A1/en active Application Filing
Cited By (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20220353434A1 (en) * | 2020-10-30 | 2022-11-03 | Boe Technology Group Co., Ltd. | Method, apparatus and system for implementing video conference, and storage medium |
| CN113315927A (en) * | 2021-05-27 | 2021-08-27 | 维沃移动通信有限公司 | Video processing method and device, electronic equipment and storage medium |
| CN114449205A (en) * | 2022-04-08 | 2022-05-06 | 浙江华创视讯科技有限公司 | Data processing method, terminal device, electronic device and storage medium |
| CN114449205B (en) * | 2022-04-08 | 2022-07-29 | 浙江华创视讯科技有限公司 | Data processing method, terminal device, electronic device and storage medium |
| CN115802093A (en) * | 2023-02-06 | 2023-03-14 | 杭州阿启视科技有限公司 | Video playing method and device, electronic equipment and storage medium |
Also Published As
| Publication number | Publication date |
|---|---|
| WO2021093575A1 (en) | 2021-05-20 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN112788276A (en) | Video stream display method, transmission method, device, terminal, server and medium | |
| WO2018095174A1 (en) | Control method, device, and terminal apparatus for synthesizing video stream of live streaming room | |
| US9154737B2 (en) | User-defined content magnification and multi-point video conference system, method and logic | |
| CN112543297B (en) | Video conference live broadcast method, device and system | |
| CN111970524B (en) | Control method, device, system, equipment and medium for interactive live broadcast and microphone connection | |
| CN104038722A (en) | Content interaction method and content interaction system for video conference | |
| WO2021204139A1 (en) | Video displaying method, device, equipment, and storage medium | |
| US10079995B1 (en) | Methods and systems for generating resolution based content | |
| WO2011140812A1 (en) | Multi-picture synthesis method and system, and media processing device | |
| WO2019233314A1 (en) | Method for echo imaging on television wall, service device and television wall system | |
| US20230091539A1 (en) | Information processing method, device, system, storage medium, and computer program product | |
| CN106131700A (en) | A kind of sharing files method and device during net cast | |
| WO2013048618A1 (en) | Systems and methods for synchronizing the presentation of a combined video program | |
| CN112291502B (en) | Information interaction method, device and system and electronic equipment | |
| JP2019022181A (en) | Conference system, display method and changeover device for sharing display device | |
| CN107005681B (en) | Universal image receiver | |
| CN113542660A (en) | Method, system and storage medium for realizing conference multi-picture high-definition display | |
| CN104427295A (en) | Method for processing video in video conference and terminal | |
| WO2016206471A1 (en) | Multimedia service processing method, system and device | |
| US20200329083A1 (en) | Video conference transmission method and apparatus, and mcu | |
| CN102572367B (en) | Multiple auxiliary stream control method, device and network system | |
| US20230195403A1 (en) | Information processing method and electronic device | |
| CN111385590A (en) | Live broadcast data processing method and device and terminal | |
| CN114143600A (en) | Live broadcast picture adjusting method, device, equipment and storage medium | |
| KR102168948B1 (en) | Mobile video control system and and operation method thereof |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination |