CN112672174A - Split-screen live broadcast method, acquisition equipment, playing equipment and storage medium - Google Patents
Split-screen live broadcast method, acquisition equipment, playing equipment and storage medium Download PDFInfo
- Publication number
- CN112672174A CN112672174A CN202011456812.9A CN202011456812A CN112672174A CN 112672174 A CN112672174 A CN 112672174A CN 202011456812 A CN202011456812 A CN 202011456812A CN 112672174 A CN112672174 A CN 112672174A
- Authority
- CN
- China
- Prior art keywords
- video
- split
- screen
- live
- picture
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
Images
Classifications
-
- Y—GENERAL TAGGING OF NEW TECHNOLOGICAL DEVELOPMENTS; GENERAL TAGGING OF CROSS-SECTIONAL TECHNOLOGIES SPANNING OVER SEVERAL SECTIONS OF THE IPC; TECHNICAL SUBJECTS COVERED BY FORMER USPC CROSS-REFERENCE ART COLLECTIONS [XRACs] AND DIGESTS
- Y02—TECHNOLOGIES OR APPLICATIONS FOR MITIGATION OR ADAPTATION AGAINST CLIMATE CHANGE
- Y02D—CLIMATE CHANGE MITIGATION TECHNOLOGIES IN INFORMATION AND COMMUNICATION TECHNOLOGIES [ICT], I.E. INFORMATION AND COMMUNICATION TECHNOLOGIES AIMING AT THE REDUCTION OF THEIR OWN ENERGY USE
- Y02D30/00—Reducing energy consumption in communication networks
- Y02D30/70—Reducing energy consumption in communication networks in wireless communication networks
Abstract
The embodiment of the invention relates to the field of live video, and discloses a split-screen live broadcasting method, acquisition equipment, playing equipment and a storage medium. The split-screen live broadcasting method comprises the following steps: acquiring original videos simultaneously acquired by at least two cameras of the same equipment; adjusting the picture of the original video according to a preset picture rule to obtain an adjusted video; and generating a live video stream of the adjusted video, sending the live video stream to the playing end, analyzing the live video stream received by the playing end to obtain the adjusted video, playing the adjusted video in a split-screen playing window, performing split-screen live broadcasting, and automatically adjusting a split-screen live broadcasting picture.
Description
Technical Field
The embodiment of the invention relates to the field of live video, in particular to a split-screen live broadcasting method, acquisition equipment, playing equipment and a storage medium.
Background
The live video broadcasting refers to live broadcasting by utilizing the internet and a streaming media technology, the video gradually becomes a mainstream expression mode of the internet due to the fact that rich elements such as images, characters and sounds are fused, and in order to better display a live broadcasting scene, a split-screen live broadcasting mode is often used for playing live broadcasting pictures shot from multiple angles.
In the related split-screen live broadcast technology, different acquisition devices are used for acquiring videos, the acquired videos are played in different split screens, and when inconsistent conditions such as overlarge figure size difference exist in video pictures of different screens, workers are required to adjust the acquisition devices to shoot the videos with coordinated pictures.
Therefore, the related split-screen live broadcasting method has the following problems: the devices need to be manually adjusted to obtain live video with coordinated picture content.
Disclosure of Invention
The embodiment of the invention aims to provide a split-screen live broadcast method, acquisition equipment, playing equipment and a storage medium, which can realize automatic adjustment of a split-screen live broadcast picture.
In order to solve the technical problem, an embodiment of the present invention provides a split-screen live broadcasting method, which is applied to a collection end, and includes the following steps: acquiring original videos simultaneously acquired by at least two cameras of the same equipment; adjusting the picture of the original video according to a preset picture rule to obtain an adjusted video; and generating a video live stream for adjusting the video, and sending the video live stream to the playing end for playing by the playing end.
The embodiment of the invention also provides a split-screen live broadcasting method which is applied to a playing end and comprises the following steps: receiving a video live stream sent by a collection end; analyzing the live video stream to obtain an adjusted video; and respectively playing the adjusted video in each split-screen playing window to carry out split-screen live broadcasting.
An embodiment of the present invention further provides an acquisition apparatus, including: at least one processor; a memory communicatively coupled to the at least one processor; at least two cameras in communicative connection with one processor; the memory stores instructions executable by the at least one processor to cause the at least one processor to perform the split-screen live broadcast method applied to the acquisition side.
An embodiment of the present invention further provides a playback device, including: at least one processor; a memory communicatively coupled to the at least one processor; the memory stores instructions executable by the at least one processor to cause the at least one processor to perform the above-described split-screen live method applied to the playback end.
The embodiment of the invention also provides a computer readable storage medium, which stores a computer program, and when the computer program is executed by a processor, the split-screen live broadcast method applied to the acquisition end or the playing end is realized.
Compared with the prior art, the method and the device have the advantages that the original videos which are simultaneously acquired by at least two cameras of the same equipment are obtained; adjusting the picture of the original video according to a preset picture rule to obtain an adjusted video; the method comprises the steps of generating a live video stream of an adjusted video, sending the live video stream to a playing end, enabling the playing end to receive the live video stream, analyzing the adjusted video from the live video stream, playing the adjusted video in a split-screen playing window, performing split-screen live broadcasting, obtaining the adjusted video as a collecting end adjusts pictures of original videos collected by at least two cameras on the same equipment according to preset picture rules, generating the live video stream of the adjusted video, sending the live video stream to the playing end, performing picture adjustment on the collecting end, obtaining a coordinated split-screen live video picture, and achieving automatic adjustment of the split-screen live video picture.
In addition, adjusting the picture of the original video according to the preset picture rule to obtain an adjusted video, comprising: and adjusting the picture of the original video according to a preset picture rule set for the content of the video picture to obtain an adjusted video. The picture of the original video is adjusted according to the preset picture rule set for the video picture content to obtain the adjusted video, the picture of the original video can be adjusted according to the video picture content, and the purpose of automatically adjusting the split-screen live broadcast picture according to the video content in a personalized mode is achieved.
In addition, the preset picture rules include: making the sizes of the characters in the video pictures the same; according to a preset picture rule set for the video picture content, adjusting the picture of the original video to obtain an adjusted video, comprising: respectively detecting the sizes of people in the original video; respectively calculating amplification coefficients for enabling the sizes of the people in the original video to be equal according to the sizes of the people in the original video; and adjusting the picture of the original video according to the amplification factor to obtain an adjusted video with the same size of the person. The method comprises the steps of respectively detecting the sizes of characters in an original video, respectively calculating amplification coefficients for enabling the sizes of the characters in the original video to be equal according to the sizes of the characters in the original video, and adjusting pictures of the original video according to the amplification coefficients to obtain adjusted videos with the sizes of the characters being equal, so that automatic adjustment of split-screen live pictures with the sizes of the characters being equal in each split-screen live video picture is achieved.
In addition, play the adjustment video in each split-screen playing window respectively, after carrying out the split-screen live broadcast, still include: and adjusting the size of the split-screen playing window according to a preset window rule. The size of the split-screen playing window is adjusted according to the preset window rule, and then the size of a display picture of the played adjusting video on the playing end equipment is adjusted, so that the split-screen live broadcast picture is automatically adjusted.
Drawings
One or more embodiments are illustrated by way of example in the accompanying drawings, which correspond to the figures in which like reference numerals refer to similar elements and which are not to scale unless otherwise specified.
Fig. 1 is a flowchart of a split-screen live broadcasting method provided according to a first embodiment of the present invention;
fig. 2 is a flowchart of a split-screen live broadcasting method provided according to a second embodiment of the present invention;
fig. 3 is a schematic size diagram of an original video character of a split-screen live broadcast method according to a second embodiment of the present invention;
fig. 4 is a schematic diagram illustrating a video character size adjustment of a split-screen live broadcasting method according to a second embodiment of the present invention;
fig. 5 is a flowchart of a split-screen live broadcasting method provided according to a third embodiment of the present invention;
fig. 6 is a flowchart of a split-screen live broadcasting method provided according to a fourth embodiment of the present invention;
fig. 7 is a schematic structural diagram of an acquisition device provided according to a fifth embodiment of the invention;
fig. 8 is a schematic structural diagram of a playing device according to a sixth embodiment of the present invention.
Detailed Description
In order to make the objects, technical solutions and advantages of the embodiments of the present invention more apparent, embodiments of the present invention will be described in detail below with reference to the accompanying drawings. However, it will be appreciated by those of ordinary skill in the art that numerous technical details are set forth in order to provide a better understanding of the present application in various embodiments of the present invention. However, the technical solution claimed in the present application can be implemented without these technical details and various changes and modifications based on the following embodiments. The following embodiments are divided for convenience of description, and should not constitute any limitation to the specific implementation manner of the present invention, and the embodiments may be mutually incorporated and referred to without contradiction.
The first embodiment of the invention relates to a split-screen live broadcasting method which is applied to a collection end. The specific flow is shown in figure 1.
and 103, generating a live video stream for adjusting the video, and sending the live video stream to the playing end for the playing end to play.
The split-screen live broadcasting method is used for live video broadcasting. Live video can be realized through live broadcast system, through the live broadcast collection software of operation on collection end equipment, acquire the original video that two at least cameras gathered simultaneously in the collection end equipment, adjust original video, obtain the adjustment video, generate the live video stream of adjustment video, through live broadcast collection software, give the server in the live broadcast system on the live video stream, transmit the broadcast end by the server, broadcast end equipment watches the software through the operation live broadcast, the analysis obtains the adjustment video in the live video stream of follow receipt, broadcast the adjustment video in dividing screen broadcast window, divide the screen live broadcast. The live video can also be realized in a point-to-point transmission mode, and the acquisition end equipment directly sends the live stream to the playing end equipment. The acquisition terminal equipment can be a mobile phone with front and rear cameras, and also can be a camera with at least two cameras. The playing end device can be any device capable of receiving video data and playing video, such as a mobile phone, a computer and the like.
The implementation details of the split-screen live broadcasting method according to the present embodiment are specifically described below, and the following description is only provided for facilitating understanding, and is not necessary for implementing the present solution.
In step 101, an acquisition-side device acquires an original video acquired by at least two cameras in the device at the same time. Wherein, two at least cameras can be opened simultaneously, also can have the front and back order to open, and the collection end equipment only need obtain two at least make a video recording and open the back two at least original videos of gathering simultaneously can.
In one example, before acquiring original videos acquired by at least two cameras of the same device at the same time, when the acquisition end device receives a live broadcast start command, the acquisition end device simultaneously opens the at least two cameras to acquire the original videos. When the acquisition end equipment has more than two cameras, the cameras with different numbers can be opened as required, the split-screen live broadcast method only limits the number of the opened cameras to be at least two, and does not limit specific numerical values.
In step 102, the frames of the original videos are adjusted according to preset frame rules to obtain adjusted videos, where the frames of the original videos are respectively adjusted according to preset frame rules preset by a user at a collection end, such as a live anchor, to obtain each adjusted video. The preset screen rule may be: enlarging the video picture of a certain camera, reducing the video picture of a certain camera, making all the video pictures have the same size or directly adopting the original pictures, and the like. Preferably, in order to identify the original videos captured by different cameras and the corresponding adjusted videos, an identifier may be set for each original video and its corresponding adjusted video.
In step 103, a live video stream of the adjusted video is generated, each adjusted video may be encoded and encapsulated to generate a live video stream, and each live video stream is sent to the playing end. When the live video streaming data is transmitted, the live video streaming data block can be immediately transmitted to a playing end when each live video stream generates the live video streaming data block in real time according to a transmission protocol adopted by live broadcasting.
Preferably, corresponding identifiers can be set for various live video streams corresponding to different adjusted videos, and when live video stream transmission is performed, the corresponding identifiers are carried in a live video stream data block, so that after a playing end receives the live video stream data block, the live video stream to which the live video stream data block belongs can be quickly identified from the received live video stream data block, and accordingly the corresponding adjusted videos are identified.
In the embodiment, original videos which are simultaneously acquired by at least two cameras of the same equipment are acquired; adjusting the picture of the original video according to a preset picture rule to obtain an adjusted video; the method comprises the steps of generating a live video stream of an adjusted video, sending the live video stream to a playing end, enabling the playing end to receive the live video stream, analyzing the adjusted video from the live video stream, playing the adjusted video in a split-screen playing window, performing split-screen live broadcasting, obtaining the adjusted video as a collecting end adjusts pictures of original videos collected by at least two cameras on the same equipment according to preset picture rules, generating the live video stream of the adjusted video, sending the live video stream to the playing end, performing picture adjustment on the collecting end, obtaining a coordinated split-screen live video picture, and achieving automatic adjustment of the split-screen live video picture.
The steps of the above methods are divided for clarity, and the implementation may be combined into one step or split some steps, and the steps are divided into multiple steps, so long as the same logical relationship is included, which are all within the protection scope of the present patent; it is within the scope of the patent to add insignificant modifications to the algorithms or processes or to introduce insignificant design changes to the core design without changing the algorithms or processes.
The second embodiment of the invention relates to a split-screen live broadcasting method which is applied to a collecting end. The second embodiment is substantially the same as the first embodiment, and mainly differs therefrom in that: in the first embodiment, the original video picture is adjusted according to a preset picture rule preset by a user at the acquisition end. In the second embodiment of the present invention, the picture of the original video is adjusted according to the preset picture rule set for the content of the video picture.
As shown in fig. 2, a specific flow of the present embodiment includes:
and 203, generating a video live stream for adjusting the video, and sending the video live stream to the playing end for the playing end to play.
Step 201 and step 203 are substantially the same as step 101 and step 103 in the first embodiment, and are not described again.
In step 202, according to the preset picture rule set for the video picture content, the preset picture rule set for different live broadcast contents may be used, for example, for a live broadcast of a basketball game, the picture of the position where the basketball is located may be enlarged and adjusted.
In the embodiment, the picture of the original video is adjusted according to the preset picture rule set for the video picture content to obtain the adjusted video, the picture of the original video can be adjusted according to the video picture content, and the purpose of automatically adjusting the split-screen live broadcast picture according to the video content in a personalized manner is achieved.
In one example, the preset picture rule may be to make the size of the person in each video picture the same. The acquisition terminal equipment can detect the sizes of the characters in the original videos, and if a single hero exists in each original video, the original video pictures can be adjusted according to the size of the hero characters. Assuming that the acquisition terminal device is a mobile phone with front and back double-shot, two original videos are obtained by shooting with front and back cameras of the mobile phone, the picture sizes of the two original videos are w × h, and the device detects that one person is larger than the other persons in the pictures of the two original videos respectively through detecting the persons in the pictures, and the size difference between the person and the other persons is larger than a preset threshold value or only one person is in the pictures, then the person is determined to be a single main corner of the original video, as shown in fig. 3. In order to obtain an adjusted video with two hero characters having the same size, the two original video characters need to be magnified and adjusted to different degrees, wherein the magnified video characters have the same picture size as the original video. The acquisition end equipment obtains detection frames of two main character characters by utilizing a character detection algorithm, and establishes a rectangular coordinate system by taking the upper left corner as the origin of coordinates and the pixel points of the video picture as units based on the original video. Then the coordinates of the upper left corner and the lower right corner of the leading character detection box of the first original video in the two original videos are respectively:
the width and height of the hero character detection box of the first original video are respectively as follows:
the coordinates of the upper left corner and the lower right corner of the main character detection frame of the second original video are respectively as follows:
the width and height of the leading character detection frame of the second original video are respectively as follows:
because the detection frame of the leading role figure after being amplified does not exceedThe picture size of the original video can be calculated, and the maximum magnification factor of the character detection frame of the leading character of the first original video can be calculated
Maximum magnification factor of leading character detection frame of second original video
In order to make the sizes of the two hero characters the same, the heights of the hero character detection box of the first original video and the hero character detection box of the second original video after enlargement are the same, whereby the enlargement coefficients used at the time of actual enlargement of the two detection boxes can be calculated according to the following procedure: if it is not
The actual magnification factor of the hero character detection box of the first original video
Actual amplification factor of hero character detection frame of second original video
If it is not
The actual magnification factor of the hero character detection box of the first original video
Actual amplification factor of hero character detection frame of first original video
After the original video picture is amplified, because the size of the amplified picture is the same as that of the original video picture, a part of the picture in the original video picture can be cut, and the picture is amplified according to the character detection frame of the heroCalculating the coordinates Of a reserved ROI (Region Of Interest, abbreviated as "ROI") Region in the original video picture according to the preset rules Of longitudinal bottom alignment and transverse centering in the picture: the coordinates of the upper left corner and the lower right corner of the first original video ROI area are respectively as follows:
coordinates of the upper left corner and the lower right corner of the ROI of the second original video are respectively as follows:
and reserving an ROI (region of interest) area of the original video to cut the picture of the original video, and multiplying the picture sizes of the cut ROI areas of the two original videos by corresponding actual amplification coefficients respectively to obtain the picture of the adjusted video as shown in the figure 4. And generating a live video stream of the adjusted video according to the step 203, sending the live video stream to a playing end, and after the playing end acquires the adjusted video and performs split-screen playing, a user can view live video pictures with the same size of the characters of the two leading roles.
In this embodiment, the sizes of the characters in the original video are detected respectively, the amplification coefficients for equalizing the sizes of the characters in the original video are calculated respectively according to the sizes of the characters in the original video, and the pictures of the original video are adjusted according to the amplification coefficients to obtain adjusted videos with the same sizes of the characters, so that automatic adjustment of split-screen live broadcast pictures with the same sizes of the characters in the split-screen live broadcast video pictures is realized.
The steps of the above methods are divided for clarity, and the implementation may be combined into one step or split some steps, and the steps are divided into multiple steps, so long as the same logical relationship is included, which are all within the protection scope of the present patent; it is within the scope of the patent to add insignificant modifications to the algorithms or processes or to introduce insignificant design changes to the core design without changing the algorithms or processes.
The third embodiment of the present invention relates to a split-screen live broadcasting method, which is applied to a broadcast end, that is, the split-screen live broadcasting method of the present embodiment is applied to a video live broadcasting, and is implemented by a broadcast end device in a live broadcasting system or a point-to-point live broadcasting manner as described in the first embodiment. And analyzing the received live video stream, namely the live video stream generated by the acquisition end by the playing end equipment to obtain and play the adjusted video, and performing split-screen live broadcasting.
As shown in fig. 5, a specific flow of the present embodiment includes:
and 503, respectively playing the adjusted video in each split-screen playing window, and performing split-screen live broadcasting.
In step 501, the playing end device receives each live video stream respectively sent by the acquisition end device, and receives a data block of each live video stream according to a transmission protocol adopted by live broadcasting.
In step 502, the playing end device extracts live video data from each live video stream data block, sorts each live video stream data block, analyzes each live video stream data block according to a used transport protocol to obtain encoded and encapsulated adjusted video data, and decodes the adjusted video data to obtain an adjusted video.
In step 503, each adjusted video is played in the corresponding split-screen playing window according to a preset rule. And performing split screen live broadcasting. The number of the split-screen playing windows is equal to the number of the live video streams, namely the number of the adjusted videos. And a video player is arranged in one split screen playing window to play the adjusted video.
In an example, after receiving a live video stream sent by a collection end, a playing end device may set the number and position of split-screen playing windows according to the number of the live video streams, and set the size of each split-screen playing window, where a default window setting preset scheme is the number of the live video streams corresponding to each playing window, and the number is arranged from top to bottom, and the size is an average equal division of the screen size of a user device.
In the embodiment, the live video stream sent by the acquisition end is received, the live video stream is analyzed to obtain the adjustment video, the adjustment video is played in each split-screen playing window respectively to perform split-screen live broadcasting, and the adjustment video after the video picture adjustment is performed through the acquisition end is contained in the received live video stream, so that the coordinated split-screen live video picture is played in the playing end, and the automatic adjustment of the split-screen live broadcasting picture is realized.
It should be understood that this embodiment is a method example corresponding to the first to second embodiments, and may be implemented in cooperation with the first to second embodiments. The related technical details mentioned in the first embodiment are still valid in this embodiment, and are not described herein again in order to reduce repetition. Accordingly, the related-art details mentioned in the present embodiment can also be applied to the first embodiment.
The steps of the above methods are divided for clarity, and the implementation may be combined into one step or split some steps, and the steps are divided into multiple steps, so long as the same logical relationship is included, which are all within the protection scope of the present patent; it is within the scope of the patent to add insignificant modifications to the algorithms or processes or to introduce insignificant design changes to the core design without changing the algorithms or processes.
The fourth embodiment of the invention relates to a split-screen live broadcasting method which is applied to a playing end. The fourth embodiment is substantially the same as the third embodiment, and mainly differs therefrom in that: in the fourth embodiment, the size of the split-screen playing window is fixed, but in the fourth embodiment of the present invention, the size of the split-screen playing window may be adjusted according to the preset window rule.
As shown in fig. 6, a specific flow of the present embodiment includes:
601, receiving a live video stream sent by a collection end;
and step 604, adjusting the size of each split-screen playing window according to a preset window rule.
In step 604, the preset window rule may be preset by the user at the playing end, or the playing end device may perform personalized customization for the user according to the user data counted by the live viewing software, or may preset the content of the video frame, for example, for live basketball game, the split-screen playing window where a basketball is located may be adjusted, and the like. When the split-screen playing window is adjusted, the size of the video picture in the split-screen playing window is also correspondingly adjusted so as to adapt to the adjustment of the split-screen playing window.
In one example, the preset window rule is: the user viewing window is enlarged. The playing end equipment can capture facial images of a user by using the camera, analyzes the sight line change of the user by using a sight line tracking algorithm, judges the split-screen playing window watched by the user, amplifies the split-screen playing window watched by the user to a preset size, and correspondingly reduces other split-screen playing windows.
In one example, let the window rule be: and amplifying the wonderful picture window. The rule is applied to competitive live broadcasting, when the player terminal equipment identifies that the live video content is a competitive type, the competitive activity is identified, and an action scoring algorithm corresponding to the competitive activity is obtained. And grading the real-time action of the figure in the adjusted video according to a pre-trained action grading algorithm, and adjusting the size of the split-screen playing window according to a grading result. Specifically, the adjusted video can be subjected to real-time screenshot, the actions of the people in the screenshot can be scored, and an action scoring algorithm can be constructed by using two deep neural networks. The first deep neural network is used for human body detection, and a rectangular detection frame of a human body is obtained; the input of the second deep neural network is a human body partial image in the rectangular detection frame, and the output is an action score. The training data of the action scoring algorithm is an exercise action image with a score, the image is from the event video, the score of the image is positively correlated with the decibel of the palm sound of the audience after the image is played, the no palm sound is defined as 0 point, the highest decibel palm sound is defined as 100 points, and other palm sounds linearly correspond to 0-100 points according to the decibel. And the playing end equipment adjusts the size of the split screen playing window in real time according to the scored fraction proportion.
Preferably, in order to avoid frequent and large-scale adjustment of the size and the size of the split-screen playing window, a recent average score of the human motion in each split-screen playing window, such as an average score of the last 100 frames, may be calculated, and the window size may be adjusted according to the average score. Assuming that there are two split-screen playing windows, the average scores are: s1And s2The screen size of the playing end equipment is as follows: w is au*huThen, the display widths of the two split-screen playing windows are respectively: w is au*s1/(s1+s2) And wu*s2/(s1+s2)。
In one example, the playing end device can also perform live broadcast on sports, judge the head pose of the character of each frame in real time in the adjusted video by using a head pose estimation algorithm, and keep the face of the character in the picture deflected to the center of the screen of the device through operations such as position exchange or mirror surface turning of each live broadcast picture, so as to create a fighting atmosphere.
In the embodiment, the size of the split-screen playing window is adjusted according to the preset window rule, so that the size of a display picture of the played adjusting video on the playing end equipment is adjusted, and the split-screen live broadcast picture is automatically adjusted.
The steps of the above methods are divided for clarity, and the implementation may be combined into one step or split some steps, and the steps are divided into multiple steps, so long as the same logical relationship is included, which are all within the protection scope of the present patent; it is within the scope of the patent to add insignificant modifications to the algorithms or processes or to introduce insignificant design changes to the core design without changing the algorithms or processes.
A fifth embodiment of the present invention relates to an acquisition apparatus, as shown in fig. 7, including: at least one processor 701; a memory 702 communicatively coupled to the at least one processor; at least two cameras 703 communicatively connected to one processor 701; the memory 702 stores instructions executable by the at least one processor 701, and the instructions are executed by the at least one processor 701 to perform the split-screen live broadcast method of the first and second embodiments.
Taking an acquisition device with two cameras as an example, the memory 702, the processor 701, the a camera 7031, and the B camera 7032 are connected in a bus manner, where the bus may include any number of interconnected buses and bridges, and the buses connect various circuits of one or more of the processor 701, the memory 702, the camera 7031, and the camera 7032 together. The bus may also connect various other circuits such as peripherals, voltage regulators, power management circuits, and the like, which are well known in the art, and therefore, will not be described any further herein. A bus interface provides an interface between the bus and the transceiver. The transceiver may be one element or a plurality of elements, such as a plurality of receivers and transmitters, providing a means for communicating with various other apparatus over a transmission medium. Information processed by processor 701 is transmitted over a wireless medium through an antenna, which receives the information and passes the information to processor 701.
The processor 701 is responsible for managing the bus and general processing and may also provide various functions including timing, peripheral interfaces, voltage regulation, power management, and other control functions. And memory 702 may be used to store information used by the processor in performing operations.
A sixth embodiment of the present invention relates to a playback device, as shown in fig. 8, including: at least one processor 801; a memory 802 communicatively coupled to the at least one processor; the memory 802 stores instructions executable by the at least one processor 801, and the instructions are executed by the at least one processor 801 to perform the split-screen live broadcasting method according to the third embodiment or the fourth embodiment.
The memory 802 and the processor 801 are coupled by a bus, which may include any number of interconnecting buses and bridges that couple one or more of the various circuits of the processor 801 and the memory 802 together. The bus may also connect various other circuits such as peripherals, voltage regulators, power management circuits, and the like, which are well known in the art, and therefore, will not be described any further herein. A bus interface provides an interface between the bus and the transceiver. The transceiver may be one element or a plurality of elements, such as a plurality of receivers and transmitters, providing a means for communicating with various other apparatus over a transmission medium. Information processed by processor 801 is transmitted over a wireless medium through an antenna, which receives the information and passes the information to processor 801.
The processor 801 is responsible for managing the bus and general processing and may also provide various functions including timing, peripheral interfaces, voltage regulation, power management, and other control functions. And memory 802 may be used to store information used by the processor in performing operations.
A seventh embodiment of the present invention relates to a computer-readable storage medium storing a computer program. The computer program realizes the above-described method embodiments when executed by a processor.
That is, as can be understood by those skilled in the art, all or part of the steps in the method for implementing the embodiments described above may be implemented by a program instructing related hardware, where the program is stored in a storage medium and includes several instructions to enable a device (which may be a single chip, a chip, or the like) or a processor (processor) to execute all or part of the steps of the method described in the embodiments of the present application. And the aforementioned storage medium includes: a U-disk, a removable hard disk, a Read-Only Memory (ROM), a Random Access Memory (RAM), a magnetic disk or an optical disk, and other various media capable of storing program codes.
It will be understood by those of ordinary skill in the art that the foregoing embodiments are specific examples for carrying out the invention, and that various changes in form and details may be made therein without departing from the spirit and scope of the invention in practice.
Claims (10)
1. A split screen live broadcast method is applied to a collection end and comprises the following steps:
acquiring original videos simultaneously acquired by at least two cameras of the same equipment;
adjusting the picture of the original video according to a preset picture rule to obtain an adjusted video;
and generating a video live stream of the adjusted video, and sending the video live stream to a playing end for playing by the playing end.
2. The split-screen live broadcasting method of claim 1, wherein the adjusting the picture of the original video according to a preset picture rule to obtain an adjusted video comprises:
and adjusting the picture of the original video according to a preset picture rule set for the content of the video picture to obtain the adjusted video.
3. The split-screen live broadcasting method according to claim 2, wherein the preset picture rule comprises: making the sizes of the characters in the video pictures the same;
the adjusting the picture of the original video according to the preset picture rule set for the video picture content to obtain the adjusted video comprises:
respectively detecting the sizes of the people in the original video;
respectively calculating amplification coefficients for enabling the sizes of the people in the original video to be equal according to the sizes of the people in the original video;
and adjusting the picture of the original video according to the amplification factor to obtain the adjusted video with the same person size.
4. The split-screen live broadcasting method according to claim 1, further comprising, before the obtaining of the original videos simultaneously captured by at least two cameras of the same device:
and after receiving a screen splitting live broadcast command, simultaneously opening the at least two cameras and collecting the original video.
5. A split screen live broadcast method is characterized in that the split screen live broadcast method is applied to a playing end and comprises the following steps:
receiving a video live broadcast stream sent by the acquisition end;
analyzing the live video stream to obtain the adjusted video;
and respectively playing the adjusted video in each split-screen playing window to carry out split-screen live broadcasting.
6. The split-screen live broadcasting method of claim 5, wherein after the adjusting video is played in each split-screen playing window respectively and split-screen live broadcasting is performed, the method further comprises:
capturing a face image of a user by using a camera of a playing end device, judging a split-screen playing window watched by the user currently, and adjusting and amplifying the split-screen playing window watched by the user currently.
7. The split-screen live broadcasting method of claim 5, wherein after the adjusting video is played in each split-screen playing window respectively and split-screen live broadcasting is performed, the method further comprises:
scoring real-time actions of people in the adjusted video;
and adjusting the size of each split-screen playing window according to the grading result.
8. An acquisition device, comprising:
at least one processor;
a memory communicatively coupled to the at least one processor;
at least two cameras in communicative connection with the at least one processor;
the memory stores instructions executable by the at least one processor to enable the at least one processor to perform the split screen live method of any one of claims 1 to 4.
9. A playback device, comprising:
at least one processor;
a memory communicatively coupled to the at least one processor;
the memory stores instructions executable by the at least one processor to enable the at least one processor to perform the split screen live method of any one of claims 5 to 7.
10. A computer-readable storage medium storing a computer program, wherein the computer program, when executed by a processor, implements the split-screen live broadcasting method of any one of claims 1 to 4 or the split-screen live broadcasting method of any one of claims 5 to 7.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202011456812.9A CN112672174B (en) | 2020-12-11 | 2020-12-11 | Split-screen live broadcast method, acquisition device, playing device and storage medium |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202011456812.9A CN112672174B (en) | 2020-12-11 | 2020-12-11 | Split-screen live broadcast method, acquisition device, playing device and storage medium |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN112672174A true CN112672174A (en) | 2021-04-16 |
| CN112672174B CN112672174B (en) | 2023-07-07 |
Family
ID=75404215
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202011456812.9A Active CN112672174B (en) | 2020-12-11 | 2020-12-11 | Split-screen live broadcast method, acquisition device, playing device and storage medium |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN112672174B (en) |
Cited By (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN113891103A (en) * | 2021-08-24 | 2022-01-04 | 广州方硅信息技术有限公司 | Live broadcast display method and device, storage medium and computer equipment |
| CN114363685A (en) * | 2021-12-20 | 2022-04-15 | 咪咕文化科技有限公司 | Video interaction method and device, computing equipment and computer storage medium |
| CN114449303A (en) * | 2022-01-26 | 2022-05-06 | 广州繁星互娱信息科技有限公司 | Live broadcast picture generation method and device, storage medium and electronic device |
| CN114979746A (en) * | 2022-05-13 | 2022-08-30 | 北京字跳网络技术有限公司 | Video processing method, device, equipment and storage medium |
Citations (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20150341598A1 (en) * | 2013-01-10 | 2015-11-26 | Hangzhou Hikvision Digital Technology Co., Ltd. | Method of multi-screen pagination playing |
| CN106165430A (en) * | 2016-06-29 | 2016-11-23 | 北京小米移动软件有限公司 | Net cast method and device |
| CN110062252A (en) * | 2019-04-30 | 2019-07-26 | 广州酷狗计算机科技有限公司 | Live broadcasting method, device, terminal and storage medium |
| CN110784735A (en) * | 2019-11-12 | 2020-02-11 | 广州虎牙科技有限公司 | Live broadcast method and device, mobile terminal, computer equipment and storage medium |
| CN111405339A (en) * | 2020-03-11 | 2020-07-10 | 咪咕互动娱乐有限公司 | Split screen display method, electronic equipment and storage medium |
| CN111919451A (en) * | 2020-06-30 | 2020-11-10 | 深圳盈天下视觉科技有限公司 | Live broadcasting method, live broadcasting device and terminal |
-
2020
- 2020-12-11 CN CN202011456812.9A patent/CN112672174B/en active Active
Patent Citations (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20150341598A1 (en) * | 2013-01-10 | 2015-11-26 | Hangzhou Hikvision Digital Technology Co., Ltd. | Method of multi-screen pagination playing |
| CN106165430A (en) * | 2016-06-29 | 2016-11-23 | 北京小米移动软件有限公司 | Net cast method and device |
| CN110062252A (en) * | 2019-04-30 | 2019-07-26 | 广州酷狗计算机科技有限公司 | Live broadcasting method, device, terminal and storage medium |
| CN110784735A (en) * | 2019-11-12 | 2020-02-11 | 广州虎牙科技有限公司 | Live broadcast method and device, mobile terminal, computer equipment and storage medium |
| CN111405339A (en) * | 2020-03-11 | 2020-07-10 | 咪咕互动娱乐有限公司 | Split screen display method, electronic equipment and storage medium |
| CN111919451A (en) * | 2020-06-30 | 2020-11-10 | 深圳盈天下视觉科技有限公司 | Live broadcasting method, live broadcasting device and terminal |
Cited By (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN113891103A (en) * | 2021-08-24 | 2022-01-04 | 广州方硅信息技术有限公司 | Live broadcast display method and device, storage medium and computer equipment |
| CN114363685A (en) * | 2021-12-20 | 2022-04-15 | 咪咕文化科技有限公司 | Video interaction method and device, computing equipment and computer storage medium |
| CN114449303A (en) * | 2022-01-26 | 2022-05-06 | 广州繁星互娱信息科技有限公司 | Live broadcast picture generation method and device, storage medium and electronic device |
| CN114979746A (en) * | 2022-05-13 | 2022-08-30 | 北京字跳网络技术有限公司 | Video processing method, device, equipment and storage medium |
| CN114979746B (en) * | 2022-05-13 | 2024-03-12 | 北京字跳网络技术有限公司 | Video processing method, device, equipment and storage medium |
Also Published As
| Publication number | Publication date |
|---|---|
| CN112672174B (en) | 2023-07-07 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN112672174B (en) | Split-screen live broadcast method, acquisition device, playing device and storage medium | |
| US7423669B2 (en) | Monitoring system and setting method for the same | |
| JP5305557B2 (en) | Method for viewing audiovisual records at a receiver and receiver for viewing such records | |
| US20220046291A1 (en) | Method and device for generating live streaming video data and method and device for playing live streaming video | |
| US20150016747A1 (en) | Image processor and image combination method thereof | |
| JP7295950B2 (en) | Video enhancement control method, device, electronic device and storage medium | |
| JP2010503006A5 (en) | ||
| JP2003250141A (en) | Video distribution server | |
| CN110234015A (en) | Live-broadcast control method, device, storage medium, terminal | |
| CN112907617B (en) | Video processing method and device | |
| CN111405339A (en) | Split screen display method, electronic equipment and storage medium | |
| JP4029316B2 (en) | Image type identification method and apparatus and image processing program | |
| CN110913118B (en) | Video processing method, device and storage medium | |
| CN114531564A (en) | Processing method and electronic equipment | |
| JP4100146B2 (en) | Bi-directional communication system, video communication device | |
| CN113315927B (en) | Video processing method and device, electronic equipment and storage medium | |
| CN112347849B (en) | Video conference processing method, electronic equipment and storage medium | |
| CN111491124B (en) | Video processing method and device and electronic equipment | |
| CN109788311B (en) | Character replacement method, electronic device, and storage medium | |
| CN111432154A (en) | Video playing method, video processing method and electronic equipment | |
| KR102457176B1 (en) | Electronic apparatus and method for generating contents | |
| CN112507798B (en) | Living body detection method, electronic device and storage medium | |
| CN113784084A (en) | Processing method and device | |
| CN115423728A (en) | Image processing method, device and system | |
| CN114079777A (en) | Video processing method and device |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |