CN108769565B - Automatic switching method of picture layout, server and local recording and broadcasting system - Google Patents
Automatic switching method of picture layout, server and local recording and broadcasting system Download PDFInfo
- Publication number
- CN108769565B CN108769565B CN201810695227.0A CN201810695227A CN108769565B CN 108769565 B CN108769565 B CN 108769565B CN 201810695227 A CN201810695227 A CN 201810695227A CN 108769565 B CN108769565 B CN 108769565B
- Authority
- CN
- China
- Prior art keywords
- recording
- broadcasting system
- local
- layout
- remote
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
Images
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N7/00—Television systems
- H04N7/14—Systems for two-way working
- H04N7/141—Systems for two-way working between two video terminals, e.g. videophone
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
- H04N21/431—Generation of visual interfaces for content selection or interaction; Content or additional data rendering
- H04N21/4312—Generation of visual interfaces for content selection or interaction; Content or additional data rendering involving specific graphical features, e.g. screen layout, special fonts or colors, blinking icons, highlights or animations
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/47—End-user applications
- H04N21/478—Supplemental services, e.g. displaying phone caller identification, shopping application
- H04N21/4788—Supplemental services, e.g. displaying phone caller identification, shopping application communicating with other users, e.g. chatting
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N7/00—Television systems
- H04N7/14—Systems for two-way working
- H04N7/15—Conference systems
Landscapes
- Engineering & Computer Science (AREA)
- Multimedia (AREA)
- Signal Processing (AREA)
- General Engineering & Computer Science (AREA)
- Studio Circuits (AREA)
- Two-Way Televisions, Distribution Of Moving Picture Or The Like (AREA)
Abstract
The invention discloses an automatic switching method of picture layout, a server and a local recording and broadcasting system, which are used for solving the problem that the picture layout mode of the existing recording and broadcasting system is difficult to meet the interaction requirement. The method provided by the invention comprises the following steps: if the remote picture layout of the remote recording and broadcasting system is updated, the local recording and broadcasting system acquires the updated remote picture layout of the remote recording and broadcasting system; the local recording and broadcasting system determines the current local picture layout of the local recording and broadcasting system according to the updated remote picture layout; the local recording and playing system determines a video input source required by the current local picture layout; the local recording and broadcasting system sends a request to the remote recording and broadcasting system so that the remote recording and broadcasting system provides an input source address corresponding to the video input source to the local recording and broadcasting system; and the local recording and broadcasting system acquires video data according to the input source address and displays the acquired video data through the current local picture layout.
Description
Technical Field
The invention relates to the technical field of video processing, in particular to a picture layout automatic switching method, a server and a local recording and playing system.
Background
In the field of recording and broadcasting, with the need of informatization and globalization development, a gradually mature audio and video interaction technology becomes a key for solving the problem of interactive recording and broadcasting. The interactive recording and broadcasting system can cross the space geographic position to realize multi-party communication and share high-quality resources.
At present, in the application of an interactive recording and playing system, when local and remote video interaction is performed, only a certain picture of the remote interactive video can be received generally, and the picture is often fixedly set as a teacher picture. However, in practical applications, for example, when a teacher goes to a class at a remote end, the teacher needs to interact with remote students, or when giving a class, a screen of the PPT lecture needs to be displayed to the remote students. Therefore, when video interaction is performed, the mode of fixedly setting the picture of the received far-end interactive video to be a certain picture is difficult to meet the existing interaction requirements.
Disclosure of Invention
The embodiment of the invention provides an automatic switching method of picture layout, a server and a local recording and broadcasting system, which can automatically adjust the picture layout of the recording and broadcasting system and meet the requirement of automatic switching of the picture layout in the video interaction process.
In a first aspect, a method for automatically switching a screen layout is provided, which includes:
if the remote picture layout of the remote recording and broadcasting system is updated, the local recording and broadcasting system acquires the updated remote picture layout of the remote recording and broadcasting system;
the local recording and broadcasting system determines the current local picture layout of the local recording and broadcasting system according to the updated remote picture layout;
the local recording and playing system determines a video input source required by the current local picture layout;
the local recording and broadcasting system sends a request to the remote recording and broadcasting system so that the remote recording and broadcasting system provides an input source address corresponding to the video input source to the local recording and broadcasting system;
and the local recording and broadcasting system acquires video data according to the input source address and displays the acquired video data through the current local picture layout.
In a second aspect, a local recording and broadcasting system is provided, where the local recording and broadcasting system performs video interaction with a remote recording and broadcasting system, and the local recording and broadcasting system includes:
the updating layout obtaining module is used for obtaining the updated remote picture layout of the remote recording and broadcasting system if the remote picture layout of the remote recording and broadcasting system is updated;
the local layout determining module is used for determining the current local picture layout of the local recording and broadcasting system according to the updated remote picture layout;
an input source determining module, configured to determine a video input source required by the current local screen layout;
the address request module is used for sending a request to the remote recording and broadcasting system so that the remote recording and broadcasting system provides an input source address corresponding to the video input source for the local recording and broadcasting system;
and the video acquisition and display module is used for acquiring video data according to the input source address and displaying the acquired video data through the current local picture layout.
In a third aspect, a server is provided, which includes a memory, a processor, and a computer program stored in the memory and executable on the processor, and the processor implements the steps of the automatic switching method for screen layout provided in the first aspect when executing the computer program.
In a fourth aspect, a computer-readable storage medium is provided, where a computer program is stored, and the computer program, when executed by a processor, implements the steps of the screen layout automatic switching method provided by the first aspect.
According to the technical scheme, the embodiment of the invention has the following advantages:
in the embodiment of the invention, if the remote picture layout of the remote recording and broadcasting system is updated, the local recording and broadcasting system acquires the updated remote picture layout of the remote recording and broadcasting system; then, the local recording and broadcasting system determines the current local picture layout of the local recording and broadcasting system according to the updated remote picture layout; then, the local recording and playing system determines a video input source required by the current local picture layout; then, the local recording and broadcasting system sends a request to the remote recording and broadcasting system so that the remote recording and broadcasting system provides an input source address corresponding to the video input source to the local recording and broadcasting system; and finally, the local recording and broadcasting system acquires video data according to the input source address and displays the acquired video data through the current local picture layout. Therefore, the local recording and broadcasting system can dynamically adjust the local picture layout according to the picture layout update of the remote recording and broadcasting system and switch the corresponding video input source, so that the picture layout of the local recording and broadcasting system can be automatically adjusted when the local recording and broadcasting system and the remote recording and broadcasting system perform video interaction, the requirement of automatic switching of the picture layout in the video interaction process can be met, and the experience of a user in using the recording and broadcasting system to perform video interaction is improved.
Drawings
In order to more clearly illustrate the technical solutions in the embodiments of the present invention, the drawings needed to be used in the embodiments or the prior art descriptions will be briefly described below, and it is obvious that the drawings in the following description are only some embodiments of the present invention, and it is obvious for those skilled in the art to obtain other drawings based on these drawings without inventive exercise.
FIG. 1 is a flowchart illustrating an exemplary embodiment of a method for automatically switching a screen layout according to the present invention;
fig. 2 is a schematic view of a picture layout of a recording and playing system in a certain situation of a teaching interactive scene;
FIG. 3 is a schematic flow chart illustrating an updated remote screen layout notified by an automatic screen layout switching method in an application scenario according to an embodiment of the present invention;
FIG. 4 is a schematic diagram of a main meeting place layout when the branch meeting place is ST layout in a certain application scenario of the present invention;
FIG. 5 is a diagram illustrating a layout of a main conference room when a branch conference room is a TV layout according to an application scenario of the present invention;
FIG. 6 is a schematic diagram of a main conference room layout when a branch conference room is an SV layout in an application scenario of the present invention;
fig. 7 is a structural diagram of an embodiment of a local recording and playing system in an embodiment of the present invention;
fig. 8 is a schematic diagram of a server according to an embodiment of the present invention.
Detailed Description
The embodiment of the invention provides an automatic switching method of picture layout, a server and a local recording and broadcasting system, which are used for solving the problem that the picture layout mode of the existing recording and broadcasting system is difficult to meet the interaction requirement.
In order to make the objects, features and advantages of the present invention more obvious and understandable, the technical solutions in the embodiments of the present invention will be clearly and completely described below with reference to the accompanying drawings in the embodiments of the present invention, and it is obvious that the embodiments described below are only a part of the embodiments of the present invention, and not all of the embodiments. All other embodiments, which can be derived by a person skilled in the art from the embodiments given herein without making any creative effort, shall fall within the protection scope of the present invention.
The technical scheme provided by the invention is mainly applied to the video interaction process of the local recording and broadcasting system and the remote recording and broadcasting system, and the video data, the audio data and other communication data can be mutually transmitted when the local recording and broadcasting system and the remote recording and broadcasting system carry out video interaction. It should be noted that the local recording and broadcasting system in the present invention refers to a recording and broadcasting system in two or more parties of video interaction, and the other recording and broadcasting systems can be regarded as remote recording and broadcasting systems relative to the local recording and broadcasting system. It can be seen that the local recording and broadcasting system and the remote recording and broadcasting system are relative concepts. For example, assume that there are 3 recording and broadcasting systems for interaction, which are a recording and broadcasting system a, a recording and broadcasting system B, and a recording and broadcasting system C. If the recording and broadcasting system A is regarded as a local recording and broadcasting system, the recording and broadcasting system B and the recording and broadcasting system C are far-end recording and broadcasting systems; similarly, if the recording and broadcasting system B is regarded as a local recording and broadcasting system, the recording and broadcasting system A and the recording and broadcasting system C are far-end recording and broadcasting systems; if the recording and broadcasting system C is regarded as a local recording and broadcasting system, the recording and broadcasting system A and the recording and broadcasting system B are far-end recording and broadcasting systems. For convenience of description and understanding, the present invention is generally described in the following embodiments with respect to the interaction between a local recording and broadcasting system and a remote recording and broadcasting system, and it should be understood that the technical features and solutions of the present invention with respect to the interaction between two parties are also applicable to the case of multi-party interaction.
Referring to fig. 1, an embodiment of a method for automatically switching a screen layout according to an embodiment of the present invention includes:
101. if the remote picture layout of the remote recording and broadcasting system is updated, the local recording and broadcasting system acquires the updated remote picture layout of the remote recording and broadcasting system;
in this embodiment, the local recording and playing system and the remote recording and playing system may establish a communication connection for video interaction in an active triggering manner. For example, a user at the remote end may manually click a button on an interface of the remote recording and playing system, after the button is clicked, the remote recording and playing system sends a connection request to the local recording and playing system, after the local recording and playing system confirms the connection request, the local recording and playing system and the remote recording and playing system can establish a communication connection of video interaction, and the two parties can mutually push streams (streaming media data of a video picture of an input source to be formulated is transmitted through a network), so that the local recording and playing system can acquire a picture image (data) of the remote recording and playing system. Conversely, if necessary, the remote recording and broadcasting system can also acquire the picture image (data) of the local recording and broadcasting system.
It can be understood that after the local recording and playing system and the remote recording and playing system perform video interaction, both the local recording and playing system and the remote recording and playing system have their own currently used picture layouts, which are respectively recorded as a local picture layout and a remote picture layout. Generally, whether the local screen layout or the remote screen layout is adopted, the screen layout is generally divided into a main screen and a sub-screen, the main screen occupies a larger area on the whole screen, and the sub-screen occupies a smaller area. Fig. 2 is a schematic diagram of a screen layout of the recording and playing system in a certain situation of the teaching interactive scene, and a screen area for displaying a teacher in fig. 2 is a main screen of the screen layout.
For the above step 101, in the video interaction process between the local recording and playing system and the remote recording and playing system, the local picture layout or the remote picture layout may be updated, that is, one picture layout is switched to another picture layout. The switching of the picture layout may be manually switched by the user, or automatically switched by a local or remote recording and playing system. It can be understood that, when the picture layout is switched from one to another, the picture layout is updated, and step 101 in this embodiment only considers the situation that the remote picture layout is updated, but as can be seen from the above, because of the relativity between the local recording and playing system and the remote recording and playing system, step 101 is also applicable to "when the local picture layout is updated, the remote recording and playing system obtains the updated local picture layout of the local recording and playing system", which is not described again in this embodiment.
Further, the local recording and playing system may adopt various ways to know whether the remote screen layout is updated. For example, the local recording and playing system may obtain a current remote screen layout of the remote recording and playing system in real time, compare the obtained current remote screen layout with a previous obtained remote screen layout, and if the comparison result is consistent, indicate that the remote screen layout is not updated; otherwise, if the comparison result is not consistent, it indicates that the remote screen layout is updated.
In addition, the remote recording and broadcasting system can actively inform the local recording and broadcasting system of the message of 'the remote screen layout is updated'. Specifically, before the local recording and broadcasting system acquires the updated remote picture layout of the remote recording and broadcasting system, the remote recording and broadcasting system can detect whether the remote picture layout of the remote recording and broadcasting system is updated; and if the remote recording and broadcasting system detects that the self remote picture layout is updated, the remote recording and broadcasting system informs the local recording and broadcasting system of the updated remote picture layout. It is understood that, before the remote screen layout is updated, the remote recording and playing system receives the corresponding switching command. The switching instruction may be a switching instruction manually input by a user to the remote recording and playing system, or may be a switching instruction automatically triggered by the remote recording and playing system when a preset condition is met. When the far-end recording and broadcasting system receives the switching instructions, the far-end recording and broadcasting system can switch the current far-end picture layout according to the switching instructions and determine that the far-end picture layout detected by the far-end recording and broadcasting system is updated.
Further, for the updated remote screen layout of the remote recording and broadcasting system, the remote recording and broadcasting system can actively inform the local recording and broadcasting system. As shown in fig. 3, the screen layout automatic switching method in this embodiment may further include:
301. the remote recording and broadcasting system determines the current use scene of the remote recording and broadcasting system according to the video signal and/or the audio signal input by the remote recording and broadcasting system;
302. the remote recording and broadcasting system determines an applicable picture layout applicable to the current use scene;
303. the remote recording and broadcasting system judges whether the current remote picture layout of the remote recording and broadcasting system is the same as the applicable picture layout, if so, step 304 is executed, and if not, step 305 is executed;
304. processing according to a normal flow;
305. and the remote recording and broadcasting system switches the current remote picture layout into the applicable picture layout and determines that the self remote picture layout is updated.
As to step 301, it can be understood that the remote recording and playing system may analyze the input video signal and audio signal, and then determine the current usage scenario of the remote recording and playing system according to the analysis result. For example, when the remote recording and playing system is applied to the teaching field, if the video signal input to the remote recording and playing system is a picture signal of a teacher, and the audio signal input to the remote recording and playing system is also a voice signal of the teacher, it can be considered that the current usage scene of the remote recording and playing system is a scene of "teacher lecture".
For step 302, the correspondence between the usage scenarios and the applicable screen layouts, that is, which usage scenarios a certain applicable screen layout is applicable to, can be preset on the remote recording and broadcasting system. Therefore, after the current use scene is determined, the applicable picture layout corresponding to the current use scene can be determined.
In step 303, since the remote recording and playing system generally has a currently used remote screen layout, it may be determined whether the current remote screen layout is consistent with the applicable screen layout, so as to determine whether the current remote screen layout needs to be switched. It should be noted that if the two are consistent, the switching is not required, and the step 304 is executed to perform the processing according to the normal flow. Otherwise, if the two are not consistent, in order to be applicable to the current usage scenario, step 305 should be executed to switch the current remote screen layout to the applicable screen layout, and the remote recording system may determine that its own remote screen layout has been updated.
102. The local recording and broadcasting system determines the current local picture layout of the local recording and broadcasting system according to the updated remote picture layout;
it can be understood that, after the local recording and broadcasting system obtains the updated far-end picture layout of the far-end recording and broadcasting system, the local recording and broadcasting system can correspondingly adjust the current local picture layout of the local recording and broadcasting system according to the updated far-end picture layout, so as to realize the automatic adjustment of the picture layout of the local recording and broadcasting system.
Specifically, the local recording and playing system may determine, according to a preset layout correspondence, a current local picture layout of the local recording and playing system corresponding to the updated remote picture layout, where the layout correspondence records a correspondence between the remote picture layout and the local picture layout. For example, if the layout of the remote screen is an ST layout (the ST layout refers to a layout screen on which a teacher screen and a student screen are displayed), and the main screen of the current layout of the remote screen is a student screen, the local recording and playing system can determine that the current layout of the local screen is an ST layout with the teacher screen as the main screen.
It should be noted that, in this embodiment, the local recording and broadcasting system and the remote recording and broadcasting system may preset respective layout corresponding relationships, and the layout corresponding relationships on different recording and broadcasting systems may be the same or different, which is not limited in this embodiment.
103. The local recording and playing system determines a video input source required by the current local picture layout;
it can be understood that, during the video interaction between the local recording and playing system and the remote recording and playing system, the local recording and playing system generally needs to acquire a video input source from the remote end and display the video input source on the local recording and playing system. After the local recording and broadcasting system determines the current local picture layout, the main picture and/or the secondary picture on the local picture layout need corresponding input sources, some input sources are provided by the local recording and broadcasting system, and some input sources need to be provided by the remote recording and broadcasting system.
In this embodiment, since the local recording and playing system interacts with the remote recording and playing system, at least one main picture or sub-picture on the local picture layout needs the remote recording and playing system to provide the required video input source. For example, when the local screen layout is an ST layout taking a teacher screen as a main screen, the main screen of the ST layout is the teacher screen, and the video input source required by the teacher screen is the video input source in step 103.
It can be seen that, further, the step 103 may include: firstly, a local recording and broadcasting system acquires a main picture in the current local picture layout; the local recording system then determines the video input source required for the main picture. The determined video input source is the video input source required by the current local picture layout.
104. The local recording and broadcasting system sends a request to the remote recording and broadcasting system so that the remote recording and broadcasting system provides an input source address corresponding to the video input source to the local recording and broadcasting system;
after the local recording and broadcasting system determines the required video input source, a request is sent to the remote recording and broadcasting system, and the remote recording and broadcasting system sends the input source address corresponding to the video input source to the local recording and broadcasting system. Therefore, the local recording and playing system can play the video according to the received input source address.
105. And the local recording and broadcasting system acquires video data according to the input source address and displays the acquired video data through the current local picture layout.
After step 104 is executed, the local recording and playing system obtains an input source address, obtains video data according to the input source address, and displays the video data on the current local screen layout. For example, in the above example, if the local screen layout is an ST layout in which the teacher screen is the main screen, the local recording and playing system performs screen coding processing on the video data, and then continues to play and display the video data on the main screen.
It should be noted that the steps 101 to 105 are generally performed in the process of video interaction between the local recording and playing system and the remote recording and playing system. If the user at any end wants to end the video interaction, the user can manually click a corresponding button on the interface of the recording and playing system to end the video interaction, so that the video data transmission between the local recording and playing system and the remote recording and playing system is ended. After the local recording and broadcasting system receives the ending signal, the local recording and broadcasting system ends the far-end picture and can restore the current local picture layout to other picture layouts which do not contain the far-end picture.
In this embodiment, if the remote picture layout of the remote recording and broadcasting system is updated, the local recording and broadcasting system obtains the updated remote picture layout of the remote recording and broadcasting system; then, the local recording and broadcasting system determines the current local picture layout of the local recording and broadcasting system according to the updated remote picture layout; then, the local recording and playing system determines a video input source required by the current local picture layout; then, the local recording and broadcasting system sends a request to the remote recording and broadcasting system so that the remote recording and broadcasting system provides an input source address corresponding to the video input source to the local recording and broadcasting system; and finally, the local recording and broadcasting system acquires video data according to the input source address and displays the acquired video data through the current local picture layout. Therefore, the local recording and broadcasting system can dynamically adjust the local picture layout according to the picture layout update of the remote recording and broadcasting system and switch the corresponding video input source, so that the picture layout of the local recording and broadcasting system can be automatically adjusted when the local recording and broadcasting system and the remote recording and broadcasting system perform video interaction, the requirement on automatic switching of the picture layout in the video interaction process can be met, and the experience of a user in using the recording and broadcasting system to perform video interaction is improved.
For ease of understanding, according to the embodiment described in fig. 1, a picture layout automatic switching method in the embodiment of the present invention is described as follows in a practical application scenario:
in the interactive scene, a plurality of recording and broadcasting systems are arranged in different places, wherein one recording and broadcasting system is used as the recording and broadcasting system of the main meeting place, and the other recording and broadcasting systems are used as the recording and broadcasting systems of the branch meeting places. The local area described below refers to a recording and broadcasting system of a main meeting place; the remote end refers to a recording and broadcasting system of the branch meeting place; usually, the main conference room is used as the main control and content playing place, and the branch conference room is used as the auxiliary or audition to the content of the main conference room.
In the recording and broadcasting system, the recording and broadcasting system can carry out the coding layout processing of the final watching picture on the videos of a plurality of video input sources, and in addition, the input source picture of the recording and broadcasting system can be used as the video input source of another recording and broadcasting system; in the application scenario, the recording and playing system just discusses the video layout of the final picture of the recording and playing system and the switching processing of the video input sources among the recording and playing systems.
The video accessed by the recording and broadcasting system in the main meeting place comprises three input sources, wherein the first input source is obtained from a camera gun for shooting pictures of teachers, the second input source is obtained from a camera gun for shooting pictures of students, and the third input source is obtained from a computer for shooting pictures of computers. A recording and broadcasting system in a conference branch site is set to be connected with three input sources of video, the first input source is obtained from a camera gun for shooting pictures of teachers, the second input source is obtained from a camera gun for shooting pictures of students, and the third input source is obtained from a computer for shooting pictures of computers.
After the recording and broadcasting system is started, the recording and broadcasting system can automatically acquire video data from three input sources and encode the video data, so that the video of the final output picture is laid out as shown in fig. 2, the lecture picture is displayed on the upper left of the final video picture, the student picture is displayed on the lower left of the final video picture, and the picture of the teacher is displayed on the right of the final video picture. Since the right frame occupies a large area, the right frame is called a main frame, and usually the right frame can express the main frame of the application scene.
The method for automatically switching the picture layout under the application scene mainly comprises the following processes:
1. clicking, triggering a remote access signal, and outputting a picture according to an input source;
the remote recording and broadcasting system has a button which can trigger the communication between the conference places, the name of the button is 'application dialogue', the system sends the request of 'application dialogue' to the main conference place by the background by manually clicking the 'application dialogue' button from the remote end, after the main conference place confirms, the remote access signal of the recording and broadcasting system of the main conference place is triggered, the main conference place informs the branch conference place, the branch conference place starts to push stream to the main conference place (the media stream of the video picture of the appointed input source is transmitted through the network) after receiving the notification signal, at this moment, the main conference place outputs the final image with the dynamic change of the layout generated by the picture of the branch conference place and the picture change according to the following steps 2 to 4.
2. Remote layout change notification (ST, TV, SV);
the ST layout means can present a layout mainly including a teacher's screen and a student's screen, the TV layout means can present a layout mainly including a teacher's screen and an electronic lecture screen, and the SV screen means a layout mainly including a student's screen and an electronic lecture screen.
The remote recording and broadcasting system can generate an ST layout picture when a teacher talks with a student; when the teacher speaks the content to the electronic lecture, a picture of the TV layout is generated; when the student answers the questions in the electronic lecture or reads the contents in the electronic lecture, an SV layout picture is generated; when the remote end generates the pictures from the different scenes, namely the picture layout changes, the remote recording and playing system informs the local recording and playing system of the main meeting place of the new layout mode (and signals) through the network.
3. Judging an input source required by switching through a remote layout;
and the recording and broadcasting system of the main meeting place can judge the scene of the sub-meeting place at the moment after receiving the layout mode of the sub-meeting place, and the recording and broadcasting system of the main meeting place switches the main picture of the main meeting place to the required video input source and picture layout according to the strategy through the judgment of the scene of the sub-meeting place. The strategy specifically comprises the following steps: when the branch meeting place is in ST layout, the main meeting place can be known to possibly let the branch meeting place to say a certain class content and need a scene for an external teacher of the branch meeting place to assist in the lecturing, at the moment, the local recording and broadcasting system requests an input source to be a far-end teacher picture, and the picture layout of the main meeting place is switched to a picture layout with a far-end teacher picture; when the branch meeting place is in a TV layout, the main meeting place is known to possibly listen to the scene of the content of the electronic lecture in the branch meeting place, at the moment, the local recording and broadcasting system requests an input source to be a far-end electronic lecture picture, and the picture layout of the main meeting place is switched to be the picture layout with the far-end electronic lecture picture; when the branch meeting place is in SV layout, the students mainly discuss the content of the electronic lecture, and at the moment, the local recording and broadcasting system requests the input source to be a remote student picture and switches the picture layout of the main meeting place into a picture layout with a remote student picture.
As shown in fig. 4, when the branch conference room is ST-laid, the recording and broadcasting system of the main conference room switches the picture layout of the main conference room to a picture layout with a picture of a remote teacher. In fig. 4, the "teacher", "lecture", and "student" screens on the left side are local screens, and the "teacher" screen on the right side is a remote screen. Similarly, when the branch meeting place is in a TV layout, the main meeting place picture layout is as shown in FIG. 5; when the branch conference room is the SV layout, the main conference room screen layout is as shown in fig. 6.
4. Giving an input source address;
after the main conference place confirms the type of the required far-end input source, the far-end recording and broadcasting system obtains a far-end input source address according to the type of the far-end input source, the input source address is sent to the recording and broadcasting system of the main conference place, the main conference place can obtain video data of the input source according to a new input source address, and picture coding processing is carried out on the video data, so that the final image effect is achieved.
5. Clicking to finish the remote access signal.
The user can click the 'end' button of the branch meeting place, the remote end finishes the transmission of the input source data, and the main meeting place restores the watching picture and the layout to the layout without the picture of the branch meeting place.
From the above, the automatic switching method of the screen layout provided by the invention has the following advantages:
1) The local picture layout can be automatically switched and the corresponding input source address can be adjusted through communication and analysis between the local picture and the remote end, so that the local picture layout can continuously and dynamically change;
2) When the layout of the far-end picture is changed, the far-end newspaper with the layout mode is local, and the application scene can be judged locally directly according to the layout mode, so that the dependence on the actual scene of the far-end is reduced, and the efficiency of locally judging the application scene is improved.
It should be understood that, the sequence numbers of the steps in the foregoing embodiments do not imply an execution sequence, and the execution sequence of each process should be determined by its function and inherent logic, and should not constitute any limitation to the implementation process of the embodiments of the present invention.
The above mainly describes a method for automatically switching picture layouts, and a detailed description will be given below of a local recording and playing system.
Fig. 7 is a block diagram illustrating an embodiment of a local recording and playing system according to an embodiment of the present invention.
In this embodiment, the local recording and playing system performs video interaction with the remote recording and playing system, which includes:
an update layout obtaining module 701, configured to obtain a remote screen layout after the remote recording and playing system is updated if the remote screen layout of the remote recording and playing system is updated;
a local layout determining module 702, configured to determine a current local picture layout of the local recording and playing system according to the updated remote picture layout;
an input source determining module 703, configured to determine a video input source required by the current local screen layout;
an address request module 704, configured to send a request to a remote recording and playing system, so that the remote recording and playing system provides an input source address corresponding to the video input source to a local recording and playing system;
the video obtaining and displaying module 705 is configured to obtain video data according to the input source address, and display the obtained video data through the current local picture layout.
Further, the local layout determination module may include:
and the layout determining unit is used for determining the current local picture layout of the local recording and broadcasting system corresponding to the updated remote picture layout according to a preset layout corresponding relationship, and the layout corresponding relationship records the corresponding relationship between the remote picture layout and the local picture layout.
Further, the input source determination module may include:
a main picture acquiring unit, configured to acquire a main picture in the current local picture layout;
and the required input source determining unit is used for determining the video input source required by the main picture.
Fig. 8 is a schematic diagram of a server according to an embodiment of the present invention. As shown in fig. 8, the server 8 of this embodiment includes: the processor 80, the memory 81, and the computer program 82 stored in the memory 81 and operable on the processor 80 are, for example, programs for executing the screen layout automatic switching method described above. The processor 80 executes the computer program 82 to implement the steps in the above-mentioned embodiments of the automatic switching method for screen layout, such as the steps 101 to 105 shown in fig. 1. Alternatively, the processor 80, when executing the computer program 82, implements the functions of each module/unit in each device embodiment described above, for example, the functions of the modules 701 to 705 shown in fig. 7.
Illustratively, the computer program 82 may be partitioned into one or more modules/units that are stored in the memory 81 and executed by the processor 80 to implement the present invention. The one or more modules/units may be a series of computer program instruction segments capable of performing specific functions, which are used to describe the execution of the computer program 82 in the server 8.
The server 8 may be a computing device such as a desktop computer, a notebook, a palm computer, and a cloud server. The server may include, but is not limited to, a processor 80, a memory 81. Those skilled in the art will appreciate that fig. 8 is merely an example of a server 8, and does not constitute a limitation of server 8, and may include more or fewer components than shown, or some components in combination, or different components, e.g., the server may also include input output devices, network access devices, buses, etc.
The Processor 80 may be a Central Processing Unit (CPU), other general purpose Processor, a Digital Signal Processor (DSP), an Application Specific Integrated Circuit (ASIC), a Field-Programmable Gate Array (FPGA) or other Programmable logic device, discrete Gate or transistor logic device, discrete hardware component, etc. A general purpose processor may be a microprocessor or the processor may be any conventional processor or the like.
The storage 81 may be an internal storage unit of the server 8, such as a hard disk or a memory of the server 8. The memory 81 may also be an external storage device of the server 8, such as a plug-in hard disk, a Smart Media Card (SMC), a Secure Digital (SD) Card, a Flash memory Card (Flash Card) and the like provided on the server 8. Further, the memory 81 may also include both an internal storage unit of the server 8 and an external storage device. The memory 81 is used for storing the computer program and other programs and data required by the server. The memory 81 may also be used to temporarily store data that has been output or is to be output.
It can be clearly understood by those skilled in the art that, for convenience and simplicity of description, the specific working processes of the above-described systems, apparatuses and units may refer to the corresponding processes in the foregoing method embodiments, and are not described herein again.
In the above embodiments, the descriptions of the respective embodiments have respective emphasis, and reference may be made to the related descriptions of other embodiments for parts that are not described or illustrated in a certain embodiment.
Those of ordinary skill in the art would appreciate that the modules, elements, and/or method steps of the various embodiments described in connection with the embodiments disclosed herein may be implemented as electronic hardware, or combinations of computer software and electronic hardware. Whether such functionality is implemented as hardware or software depends upon the particular application and design constraints imposed on the technical solution. Skilled artisans may implement the described functionality in varying ways for each particular application, but such implementation decisions should not be interpreted as causing a departure from the scope of the present invention.
In the several embodiments provided in the present application, it should be understood that the disclosed system, apparatus and method may be implemented in other manners. For example, the above-described apparatus embodiments are merely illustrative, and for example, the division of the units is only one logical division, and other divisions may be realized in practice, for example, a plurality of units or components may be combined or integrated into another system, or some features may be omitted, or not executed. In addition, the shown or discussed mutual coupling or direct coupling or communication connection may be an indirect coupling or communication connection through some interfaces, devices or units, and may be in an electrical, mechanical or other form.
The units described as separate parts may or may not be physically separate, and parts displayed as units may or may not be physical units, may be located in one position, or may be distributed on multiple network units. Some or all of the units can be selected according to actual needs to achieve the purpose of the solution of the embodiment.
In addition, functional units in the embodiments of the present invention may be integrated into one processing unit, or each unit may exist alone physically, or two or more units are integrated into one unit. The integrated unit may be implemented in the form of hardware, or may also be implemented in the form of a software functional unit.
The integrated unit, if implemented in the form of a software functional unit and sold or used as a stand-alone product, may be stored in a computer readable storage medium. Based on such understanding, all or part of the flow of the method according to the embodiments of the present invention may also be implemented by a computer program, which may be stored in a computer-readable storage medium, and when the computer program is executed by a processor, the steps of the method embodiments may be implemented. . Wherein the computer program comprises computer program code, which may be in the form of source code, object code, an executable file or some intermediate form, etc. The computer-readable medium may include: any entity or device capable of carrying the computer program code, recording medium, U.S. disk, removable hard disk, magnetic diskette, optical disk, computer Memory, read-Only Memory (ROM), random Access Memory (RAM), electrical carrier wave signal, telecommunications signal, and software distribution medium, etc. It should be noted that the computer-readable medium may contain suitable additions or subtractions depending on the requirements of legislation and patent practice in jurisdictions, for example, in some jurisdictions, computer-readable media may not include electrical carrier signals or telecommunication signals in accordance with legislation and patent practice.
The above-mentioned embodiments are only used for illustrating the technical solutions of the present invention, and not for limiting the same; although the present invention has been described in detail with reference to the foregoing embodiments, it will be understood by those of ordinary skill in the art that: the technical solutions described in the foregoing embodiments may still be modified, or some technical features may be equivalently replaced; and such modifications or substitutions do not depart from the spirit and scope of the corresponding technical solutions of the embodiments of the present invention.
Claims (9)
1. An automatic switching method of picture layout is characterized by comprising the following steps:
if the remote picture layout of the remote recording and broadcasting system is updated, the local recording and broadcasting system acquires the updated remote picture layout of the remote recording and broadcasting system, and the local recording and broadcasting system and the remote recording and broadcasting system establish video interactive communication connection;
the local recording and broadcasting system determines the current local picture layout of the local recording and broadcasting system according to the updated remote picture layout;
the local recording and playing system determines a video input source required by the current local picture layout;
the local recording and broadcasting system sends a request to the remote recording and broadcasting system so that the remote recording and broadcasting system provides an input source address corresponding to the video input source to the local recording and broadcasting system;
the local recording and broadcasting system acquires video data according to the input source address and displays the acquired video data through the current local picture layout;
the local recording and broadcasting system determining the current local picture layout of the local recording and broadcasting system according to the updated remote picture layout comprises:
the local recording and broadcasting system determines the current local picture layout of the local recording and broadcasting system corresponding to the updated far-end picture layout according to a preset layout corresponding relationship, the layout corresponding relationship records the corresponding relationship between the far-end picture layout and the local picture layout, and the obtained local picture layout is determined to be different from the updated far-end picture layout;
the local recording and broadcasting system and the far-end recording and broadcasting system can mutually push streams, the local recording and broadcasting system can acquire the picture image of the far-end recording and broadcasting system, and the far-end recording and broadcasting system can also acquire the picture image of the local recording and broadcasting system;
when the local picture layout is updated, the remote recording and broadcasting system acquires the updated local picture layout of the local recording and broadcasting system;
the corresponding relation between the use scene and the applicable picture layout can be preset on the remote recording and broadcasting system;
after the local recording and broadcasting system acquires the updated remote picture layout of the remote recording and broadcasting system, the local recording and broadcasting system can correspondingly adjust the current local picture layout according to the updated remote picture layout so as to realize the automatic adjustment of the picture layout of the local recording and broadcasting system;
the local recording and broadcasting system and the remote recording and broadcasting system can preset respective layout corresponding relations, and the layout corresponding relations on different recording and broadcasting systems can be the same or different;
at least one main picture or secondary picture on the local picture layout needs a remote recording and playing system to provide a required video input source;
the local recording and playing system can dynamically adjust the local picture layout according to the picture layout update of the remote recording and playing system and switch the corresponding video input source.
2. The method of claim 1, wherein before the local recording and playing system obtains the updated remote screen layout from the remote recording and playing system, the method further comprises:
the remote recording and broadcasting system detects whether the self remote picture layout is updated;
and if the remote recording and broadcasting system detects that the self remote picture layout is updated, the remote recording and broadcasting system informs the local recording and broadcasting system of the updated remote picture layout.
3. The screen layout automatic switching method according to claim 2, characterized in that the screen layout automatic switching method further comprises: the remote recording and broadcasting system determines the current use scene of the remote recording and broadcasting system according to the video signal and/or the audio signal input by the remote recording and broadcasting system;
the remote recording and broadcasting system determines an applicable picture layout applicable to the current use scene;
and if the current remote picture layout of the remote recording and broadcasting system is different from the applicable picture layout, the remote recording and broadcasting system switches the current remote picture layout into the applicable picture layout and determines that the self remote picture layout is updated.
4. The picture layout automatic switching method according to any one of claims 1 to 3, wherein the determining, by the local recording and playing system, a video input source required for the current local picture layout comprises:
the local recording and broadcasting system acquires a main picture in the current local picture layout;
and the local recording and playing system determines the video input source required by the main picture.
5. A local recording and broadcasting system is characterized in that the local recording and broadcasting system performs video interaction with a remote recording and broadcasting system, and the local recording and broadcasting system comprises:
the updating layout acquisition module is used for acquiring the updated remote picture layout of the remote recording and broadcasting system if the remote picture layout of the remote recording and broadcasting system is updated, and the local recording and broadcasting system is in video interaction communication connection with the remote recording and broadcasting system;
a local layout determining module, configured to determine a current local picture layout of a local recording and playing system according to the updated remote picture layout;
an input source determining module, configured to determine a video input source required by the current local screen layout; the address request module is used for sending a request to the remote recording and broadcasting system so that the remote recording and broadcasting system provides an input source address corresponding to the video input source for the local recording and broadcasting system;
the video acquisition and display module is used for acquiring video data according to the input source address and displaying the acquired video data through the current local picture layout;
the local layout determination module includes:
and the layout determining unit is used for determining the current local picture layout of the local recording and broadcasting system corresponding to the updated remote picture layout according to a preset layout corresponding relationship, wherein the layout corresponding relationship records the corresponding relationship between the remote picture layout and the local picture layout, and the obtained local picture layout is different from the updated remote picture layout.
6. The local recording and broadcasting system of claim 5, wherein the local layout determination module comprises:
and the layout determining unit is used for determining the current local picture layout of the local recording and broadcasting system corresponding to the updated remote picture layout according to a preset layout corresponding relationship, and the layout corresponding relationship records the corresponding relationship between the remote picture layout and the local picture layout.
7. The local recording system as claimed in claim 5 or 6, wherein said input source determining module comprises:
a main picture acquiring unit, configured to acquire a main picture in the current local picture layout;
and the required input source determining unit is used for determining the video input source required by the main picture.
8. A server comprising a memory, a processor and a computer program stored in the memory and executable on the processor, wherein the processor implements the steps of the screen layout automatic switching method according to any one of claims 1 to 4 when executing the computer program.
9. A computer-readable storage medium storing a computer program, wherein the computer program is executed by a processor to implement the steps of the screen layout automatic switching method according to any one of claims 1 to 4.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201810695227.0A CN108769565B (en) | 2018-06-29 | 2018-06-29 | Automatic switching method of picture layout, server and local recording and broadcasting system |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201810695227.0A CN108769565B (en) | 2018-06-29 | 2018-06-29 | Automatic switching method of picture layout, server and local recording and broadcasting system |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN108769565A CN108769565A (en) | 2018-11-06 |
| CN108769565B true CN108769565B (en) | 2022-10-21 |
Family
ID=63974881
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201810695227.0A Active CN108769565B (en) | 2018-06-29 | 2018-06-29 | Automatic switching method of picture layout, server and local recording and broadcasting system |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN108769565B (en) |
Families Citing this family (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN112752037A (en) * | 2019-10-30 | 2021-05-04 | 北京国双科技有限公司 | Processing method and device for mixed audio and video stream |
Family Cites Families (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101478642A (en) * | 2009-01-14 | 2009-07-08 | 镇江畅联通信科技有限公司 | Multi-picture mixing method and apparatus for video meeting system |
| CN101662611A (en) * | 2009-09-08 | 2010-03-03 | 上海华平信息技术股份有限公司 | Template display method in video conference system |
| CN101984659A (en) * | 2010-11-16 | 2011-03-09 | 中兴通讯股份有限公司 | Method, terminal and system for flexibly sending video source in video conference communication |
| US8537195B2 (en) * | 2011-02-09 | 2013-09-17 | Polycom, Inc. | Automatic video layouts for multi-stream multi-site telepresence conferencing system |
| CN104822038A (en) * | 2015-04-30 | 2015-08-05 | 广州瀚唐电子科技有限公司 | Recording and broadcasting system and picture switching method thereof |
| CN106056988A (en) * | 2016-06-17 | 2016-10-26 | 陈�胜 | Multifunctional recording and playing equipment |
-
2018
- 2018-06-29 CN CN201810695227.0A patent/CN108769565B/en active Active
Also Published As
| Publication number | Publication date |
|---|---|
| CN108769565A (en) | 2018-11-06 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US9473741B2 (en) | Teleconference system and teleconference terminal | |
| CN110874959B (en) | Multi-terminal same-screen teaching system and teaching method | |
| CN111031368B (en) | Multimedia playing method, device, equipment and storage medium | |
| US12047430B2 (en) | Receiving virtual relocation during a network conference | |
| US20170195384A1 (en) | Video Playing Method and Electronic Device | |
| CN109982134B (en) | Video teaching method based on diagnosis equipment, diagnosis equipment and system | |
| US11349886B2 (en) | Control method of multimedia conference terminal and multimedia conference server | |
| US12058183B2 (en) | Virtual relocation during network conferences | |
| CN110928509B (en) | Display control method, display control device, storage medium, and communication terminal | |
| CN108769565B (en) | Automatic switching method of picture layout, server and local recording and broadcasting system | |
| CN113923498A (en) | Processing method and device | |
| CN114257572B (en) | Data processing method, device, computer readable medium and electronic equipment | |
| CN113345281A (en) | Intelligent teaching system | |
| CN110418180B (en) | Grouping-based screen projection display method and system and central control equipment | |
| CN115529485B (en) | Live video processing method, device, equipment and medium | |
| US20230195403A1 (en) | Information processing method and electronic device | |
| CN115396684B (en) | Wheat connecting display method and device, electronic equipment and computer readable medium | |
| CN108882004B (en) | Video recording method, device, equipment and storage medium | |
| CN113271474B (en) | Method, device, equipment and storage medium for testing streaming media server | |
| CN115767191A (en) | Method, device, equipment and storage medium for live broadcast | |
| KR102174290B1 (en) | Overlay boarding function service system and method on video and image screen during video conference | |
| CN113259314A (en) | Split screen display method and device, terminal equipment and storage medium | |
| CN113141519B (en) | Live broadcast data processing method and device | |
| CN114765695B (en) | Live broadcast data processing method, device, equipment and medium | |
| US20240184615A1 (en) | Electronic device capable of performing multi-camera intelligent switching and multi-camera intelligent switching method thereof |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |