CN112272284A - Multi-party video communication method, device and system based on double cameras - Google Patents
Multi-party video communication method, device and system based on double cameras Download PDFInfo
- Publication number
- CN112272284A CN112272284A CN202010963669.6A CN202010963669A CN112272284A CN 112272284 A CN112272284 A CN 112272284A CN 202010963669 A CN202010963669 A CN 202010963669A CN 112272284 A CN112272284 A CN 112272284A
- Authority
- CN
- China
- Prior art keywords
- video data
- video
- data
- client
- display
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
Images
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N7/00—Television systems
- H04N7/18—Closed-circuit television [CCTV] systems, i.e. systems in which the video signal is not broadcast
- H04N7/181—Closed-circuit television [CCTV] systems, i.e. systems in which the video signal is not broadcast for receiving images from a plurality of remote sources
-
- Y—GENERAL TAGGING OF NEW TECHNOLOGICAL DEVELOPMENTS; GENERAL TAGGING OF CROSS-SECTIONAL TECHNOLOGIES SPANNING OVER SEVERAL SECTIONS OF THE IPC; TECHNICAL SUBJECTS COVERED BY FORMER USPC CROSS-REFERENCE ART COLLECTIONS [XRACs] AND DIGESTS
- Y02—TECHNOLOGIES OR APPLICATIONS FOR MITIGATION OR ADAPTATION AGAINST CLIMATE CHANGE
- Y02D—CLIMATE CHANGE MITIGATION TECHNOLOGIES IN INFORMATION AND COMMUNICATION TECHNOLOGIES [ICT], I.E. INFORMATION AND COMMUNICATION TECHNOLOGIES AIMING AT THE REDUCTION OF THEIR OWN ENERGY USE
- Y02D30/00—Reducing energy consumption in communication networks
- Y02D30/70—Reducing energy consumption in communication networks in wireless communication networks
Landscapes
- Engineering & Computer Science (AREA)
- Multimedia (AREA)
- Signal Processing (AREA)
- Two-Way Televisions, Distribution Of Moving Picture Or The Like (AREA)
Abstract
The invention provides a multiparty video communication method, a device and a system based on double cameras, which are applied to a server side, wherein the method comprises the following steps: receiving original video data sent by each video client, wherein the original video data comprise first video data for collecting a preset target at a first visual angle, second video data for collecting the preset target at a second visual angle and audio data; acquiring a first control signaling of each video client; according to the first control signaling of each video client, configuring a display area of each original video data to generate target display video data; sending the target display video data to each video client to enable the target display video data to be displayed in each video client; the problem that clients in a traditional modern remote education system can only watch online live videos and cannot display portraits or real objects of the clients is solved, real-time interaction among multiple parties is achieved, and the demand of online teaching is met.
Description
Technical Field
The invention relates to the technical field of video communication, in particular to a multiparty video communication method, device and system based on double cameras.
Background
Modern distance education is education in which courses are delivered outside a campus via audio, video, and computer technologies including real-time and non-real-time; with the development of computer technology, multimedia technology and communication technology, the means of distance education is greatly leap, and the remote education becomes modern distance education under the condition of high and new technology.
However, in the prior art, a client in a modern remote education system can only watch online live videos generally, and cannot perform portrait display or physical demonstration of the client, so that multi-party interaction cannot be realized, and the demand of online teaching cannot be met.
Disclosure of Invention
Aiming at the defects in the prior art, the multi-party video communication method, the device and the system based on the double cameras solve the problems that a client in the traditional modern remote education system can only watch online live video and cannot perform portrait display or physical demonstration on the client, realize real-time interaction of multiple parties and meet the demand of online teaching.
In a first aspect, the present invention provides a multiparty video communication method based on two cameras, which is applied to a server side, and the method includes: receiving original video data sent by each video client, wherein the original video data comprise first video data for collecting a preset target at a first visual angle, second video data for collecting the preset target at a second visual angle and audio data; acquiring a first control signaling of each video client; according to the first control signaling of each video client, configuring a display area of each original video data to generate target display video data; and sending the target display video data to each video client, so that the target display video data is displayed in each video client.
Optionally, configuring a display area of each original video data according to the display signaling of each video client, and generating target display video data, including: if the first control signaling of the current video client is a display signaling, configuring an original video data display area of the current video client as a main area; if the first control signaling of the current video client is a silent signaling, configuring an original video data display area of the current video client as an auxiliary area; and generating the target display video data from all the original video data according to the display areas of all the original video data.
Optionally, the method further comprises: and if the first control signaling of the current video client is a display signaling, configuring the first control signaling of other video clients into the silence signaling.
Optionally, the obtaining the first control signaling of each video client includes: performing image recognition on first video data corresponding to each video client in real time to obtain a plurality of recognition results; comparing the plurality of identification results with a preset result, and judging whether an identification result which is consistent with the preset result exists or not; and when the identification result which is consistent with the preset result exists, configuring the first control signaling of the video client corresponding to the identification result into display signaling.
Optionally, after sending the target display video data to each video client and displaying the target display video data in each video client, the method further includes: acquiring a second control signaling of the original video data displayed in the main area, wherein the second control signaling comprises a zooming instruction and a zooming area; and according to the zooming instruction, correspondingly zooming the original video data in the zooming area according to a first preset rule and then displaying the zoomed original video data.
In a second aspect, the present invention provides a multiparty video communication method based on two cameras, which is applied to a video client, and the method includes: acquiring first video data, second video data and audio data of a preset target, wherein the first video data is acquired at a first visual angle, and the second video data is acquired at a second visual angle; compressing and encoding the first video data, the second video data and the audio data to obtain original video data; sending the original video data to a server, and enabling the server to configure a display area of each original video data according to a first control signaling of each video client to generate target display video data; and receiving and displaying the target display video data.
Optionally, compressing and encoding the first video data, the second video data, and the audio data to obtain original video data, including: acquiring a superposition instruction, wherein the superposition instruction comprises character information and superposition position information; acquiring a character file corresponding to the character information according to the character information; writing the character file into a corresponding position in a preset image layer according to the superposition position information; respectively superposing the preset image layers on the first video data and the second video data to obtain first superposed video data and second superposed video data; and compressing and encoding the first superposed video data, the second superposed video data and the audio data to obtain original video data.
In a third aspect, the present invention provides a multiparty video communication device based on two cameras, which is applied to a server side, and the device includes: the system comprises an original data receiving module, a first video data processing module and a second video data processing module, wherein the original data receiving module is used for receiving original video data sent by each video client, and the original video data comprises first video data for collecting a preset target at a first visual angle, second video data for collecting the preset target at a second visual angle and audio data; the control signaling acquisition module is used for acquiring a first control signaling of each video client; the target data generation module is used for configuring a display area of each original video data according to the first control signaling of each video client to generate target display video data; and the target data sending module is used for sending the target display video data to each video client so that the target display video data is displayed in each video client.
In a fourth aspect, the present invention provides a multiparty video communication device based on dual cameras, applied to a video client, the device comprising: the data acquisition module is used for acquiring first video data, second video data and audio data of a preset target, wherein the first video data is acquired at a first visual angle, and the second video data is acquired at a second visual angle; the data processing module is used for compressing and coding the first video data, the second video data and the audio data to obtain original video data; the original data sending module is used for sending the original video data to the server, so that the server performs display area configuration on each original video data according to the first control signaling of each video client to generate target display video data; and the display module is used for receiving and displaying the target display video data.
In a fifth aspect, the present invention provides a multiparty video communication system based on dual cameras, the system comprising: the system comprises a multi-party video acquisition system, a video communication system, a signaling system and a server; each video acquisition system comprises an image acquisition device, a sound acquisition device, a video processor and a display terminal; the image acquisition device comprises a first camera and a second camera, wherein the first camera is used for acquiring first video data of a preset target at a first visual angle, and the second camera is used for acquiring second video data of the preset target at a second visual angle; the sound acquisition device is used for acquiring audio data of the preset target; the video processor is connected with the image acquisition device and the sound acquisition device and is used for carrying out compression coding on the first data, the second video data and the audio data to obtain original video data; the server is connected with the plurality of video processors, is also connected with the signaling system, and is used for configuring display areas of a plurality of original video data sent by the plurality of video processors according to the control signaling sent by the signaling system to generate target display video data, and is also used for sending the target display video data to all display terminals so that the target display video data is displayed on all the display terminals.
The invention carries out video communication in a multi-point, multi-area and double-camera mode, two cameras at each point position can shoot the front and top visual angles of users, each visual angle adopts independent video stream, all point position users can carry out video broadcasting, and each path of video stream can be independently amplified and watched; the invention controls the display area in the video communication through the control signaling, all the displayed videos are two independent video pictures of the front side and the top side, and the multi-point simultaneous multi-angle real-time video communication is realized. The invention can be applied to scenes such as online education scenes, demonstration interaction and the like, solves the communication problem when portrait display and real object demonstration are simultaneously carried out in multi-party interaction, can more conveniently carry out demonstration teaching and realizes high-quality demonstration interaction.
Drawings
Fig. 1 is a schematic flowchart illustrating a multiparty video communication method based on two cameras according to an embodiment of the present invention;
fig. 2 is a flow chart showing another multiparty video communication method based on two cameras according to an embodiment of the present invention;
fig. 3 is a schematic structural diagram of a multi-party video communication device based on two cameras according to an embodiment of the present invention;
fig. 4 is a schematic structural diagram of another multiparty video communication apparatus based on two cameras according to an embodiment of the present invention;
fig. 5 is a schematic structural diagram of a multi-party video communication system based on two cameras according to an embodiment of the present invention.
Detailed Description
In order to make the objects, technical solutions and advantages of the embodiments of the present application clearer, the technical solutions in the embodiments of the present application will be clearly and completely described below with reference to the drawings in the embodiments of the present application, and it is obvious that the described embodiments are some embodiments of the present application, but not all embodiments. All other embodiments, which can be derived by a person skilled in the art from the embodiments given herein without making any creative effort, shall fall within the protection scope of the present application.
Example one
Fig. 1 is a schematic flowchart illustrating a multiparty video communication method based on two cameras according to an embodiment of the present invention; as shown in fig. 1, when applied to a server, the multiparty video communication method based on two cameras specifically includes the following steps:
step S101, receiving original video data sent by each video client.
In this embodiment, the multiparty video communication method based on two cameras is applied to a multiparty video communication system based on two cameras, the communication system includes a plurality of video clients and a server, each video client sends collected original video data to the server for processing, the original video data includes first video data collected at a first view angle to a preset target, second video data collected at a second view angle to the preset target, and the first view angle is a front view angle of a face of a user and can collect first video data of a close-up front of the user; the second visual angle is a visual angle right above the head of the user, and second video data of the note or job content of the user can be collected.
Step S102, a first control signaling of each video client is obtained.
In this embodiment, the first control signaling includes a display signaling and a silence signaling, and the server may obtain the first control signaling configured in advance for each video client, or obtain the first control signaling according to input or operation of first control information of an administrator or a user.
Further, the obtaining the first control signaling of each video client further includes: performing image recognition on first video data corresponding to each video client in real time to obtain a plurality of recognition results; comparing the plurality of identification results with a preset result, and judging whether an identification result which is consistent with the preset result exists or not; and when the identification result which is consistent with the preset result exists, configuring the first control signaling of the video client corresponding to the identification result into display signaling.
It should be noted that, in this embodiment, the image recognition on the first video data includes, but is not limited to, whether there is a hand-lifting action and whether there is a mouth-opening action, when the first video data including a frontal face close-up of the user is captured, the facial feature of the captured image is recognized, and if it is determined that the facial feature includes a mouth-opening action, it indicates that the user is speaking, so the first control signaling of the video client is configured to display signaling.
Further, if the first control signaling of the current video client is a display signaling, configuring the first control signaling of other video clients as the silence signaling.
It should be noted that, at the same time, the first control signaling of one and only one video client is the display signaling.
Step S103, according to the first control signaling of each video client, configuring a display area of each original video data, and generating target display video data.
In this embodiment, if the first control signaling of the current video client is a display signaling, configuring an original video data display area of the current video client as a main area; if the first control signaling of the current video client is a silent signaling, configuring an original video data display area of the current video client as an auxiliary area; and generating the target display video data from all the original video data according to the display areas of all the original video data.
It should be noted that the target display video data generated by the server is composed of a main area and a plurality of auxiliary areas, and the video display adjustment of the main area and the plurality of auxiliary areas is performed according to the first control signaling of each video client, wherein the first video data and the second video data of each video client are displayed in both the main area and the auxiliary areas, that is, both the front sketch video of the user and the content video for taking notes are displayed in the main area or the auxiliary areas.
Step S104, sending the target display video data to each video client, and displaying the target display video data in each video client.
Specifically, the server sends target display video data generated after the display area of the original video content of each video client is configured to each video client, so that the target display video data is displayed in each video client.
It should be noted that, when the total number of simultaneous online of the video clients is large and exceeds the main area and the auxiliary area, the first control signaling further includes a hidden signaling, and when the first control signaling of the video client is the hidden signaling, the original video data sent by the video client is not displayed in an area, and the display of the corresponding area can be performed after the first control signaling is modified to be a silent signaling or a display signaling.
In another embodiment of the present invention, after the target display video data is transmitted to each video client and the target display video data is displayed in each video client, the method further comprises: acquiring a second control signaling of the original video data displayed in the main area, wherein the second control signaling comprises a zooming instruction and a zooming area; and according to the zooming instruction, correspondingly zooming the original video data in the zooming area according to a first preset rule and then displaying the zoomed original video data.
The invention carries out video communication in a multi-point, multi-area and double-camera mode, two cameras at each point position can shoot the front and top visual angles of users, each visual angle adopts independent video stream, all point position users can carry out video broadcasting, and each path of video stream can be independently amplified and watched; the invention controls the display area in the video communication through the control signaling, all the displayed videos are two independent video pictures of the front side and the top side, and the multi-point simultaneous multi-angle real-time video communication is realized. The invention can be applied to scenes such as online education scenes, demonstration interaction and the like, solves the communication problem when portrait display and real object demonstration are simultaneously carried out in multi-party interaction, can more conveniently carry out demonstration teaching and realizes high-quality demonstration interaction.
Example two
Fig. 2 is a schematic flow chart of another multiparty video communication method based on two cameras according to an embodiment of the present invention, where the multiparty video communication method based on two cameras further includes the following steps:
step S201, collecting first video data, second video data and audio data of a preset target.
Step S202, compressing and encoding the first video data, the second video data, and the audio data to obtain original video data.
Step S203, sending the original video data to a server, so that the server performs display area configuration on each original video data according to the first control signaling of each video client, and generates target display video data.
And step S204, receiving and displaying the target display video data.
In this embodiment, the first video data is video data acquired at a first viewing angle, and the second video data is video data acquired at a second viewing angle.
In this embodiment, compressing and encoding the first video data, the second video data, and the audio data to obtain original video data includes: acquiring a superposition instruction, wherein the superposition instruction comprises character information and superposition position information; acquiring a character file corresponding to the character information according to the character information; writing the character file into a corresponding position in a preset image layer according to the superposition position information; respectively superposing the preset image layers on the first video data and the second video data to obtain first superposed video data and second superposed video data; and compressing and encoding the first superposed video data, the second superposed video data and the audio data to obtain original video data.
It should be noted that after the video client acquires the first video data on the front face of the user and the second video data right above the head, the first video data and the second video data are subjected to character superposition, so that the acquisition time and the name of the video client can be displayed in real time in the original video data sent to the server, and the video data can be conveniently edited and processed in the later period; after receiving all original video data after character superposition, compression and encoding of each video client, the server performs corresponding display area configuration on each original video data according to a first control signaling of each video client to generate target display video data, and then sends the target display video data to each video client for display.
EXAMPLE III
Fig. 3 is a schematic structural diagram of a multi-party video communication device based on two cameras according to an embodiment of the present invention; as shown in fig. 3, the apparatus for multiparty video communication based on two cameras applied to the server specifically includes:
the original data receiving module 310 is configured to receive original video data sent by each video client, where the original video data includes first video data acquired at a first viewing angle and second video data and audio data acquired at a second viewing angle, where the first video data is a preset target;
a control signaling obtaining module 320, configured to obtain a first control signaling of each video client;
a target data generating module 330, configured to configure a display area for each original video data according to the first control signaling of each video client, and generate target display video data;
and a target data sending module 340, configured to send the target display video data to each video client, so that the target display video data is displayed in each video client.
In this embodiment, the target data generating module 330 includes: the main area configuration module is used for configuring an original video data display area of the current video client into a main area if the first control signaling of the current video client is a display signaling; an auxiliary area configuration module, configured to configure an original video data display area of the current video client as an auxiliary area if the first control signaling of the current video client is a silence signaling; and the generating module is used for generating the target display video data from all the original video data according to the display areas of all the original video data.
In this embodiment, the apparatus further includes: and if the first control signaling of the current video client is a display signaling, configuring the first control signaling of other video clients into the silence signaling.
In this embodiment, the control signaling obtaining module 320 includes: and identifying the module. The system comprises a video client, a server and a server, wherein the video client is used for carrying out image recognition on first video data corresponding to each video client in real time to obtain a plurality of recognition results; the judging module is used for comparing the plurality of identification results with preset results and judging whether the identification results which are consistent with the preset results exist or not; and the signaling configuration module is used for configuring the first control signaling of the video client corresponding to the identification result into display signaling when the identification result which is consistent with the preset result exists.
In this embodiment, the apparatus further includes: a second control signaling obtaining module, configured to obtain a second control signaling of original video data displayed in the main area, where the second control signaling includes a zoom instruction and a zoom area; and the zooming display module is used for correspondingly zooming the original video data in the zooming area according to a first preset rule and then displaying the zoomed original video data according to the zooming instruction.
Example four
Fig. 4 is a schematic structural diagram of a multi-party video communication device based on two cameras according to an embodiment of the present invention; as shown in fig. 4, the apparatus for multiparty video communication based on dual cameras applied to a video client specifically includes:
the data acquisition module 410 is configured to acquire first video data, second video data and audio data of a preset target, where the first video data is acquired at a first viewing angle, and the second video data is acquired at a second viewing angle;
a data processing module 420, configured to compress and encode the first video data, the second video data, and the audio data to obtain original video data;
the original data sending module 430 is configured to send the original video data to a server, so that the server performs display area configuration on each original video data according to the first control signaling of each video client, and generates target display video data;
and a display module 440, configured to receive and display the target display video data.
In this embodiment, the data processing module 420 includes: the superposition instruction acquisition module is used for acquiring a superposition instruction, and the superposition instruction comprises character information and superposition position information; the character file acquisition module is used for acquiring a character file corresponding to the character information according to the character information; the character file writing module is used for writing the character file into a corresponding position in a preset image layer according to the superposition position information; the layer overlapping module is used for respectively overlapping the preset layer on the first video data and the second video data to obtain first overlapped video data and second overlapped video data; and the coding module is used for compressing and coding the first superposed video data, the second superposed video data and the audio data to obtain original video data.
EXAMPLE five
Fig. 5 is a schematic structural diagram of a multiparty video communication system based on two cameras according to an embodiment of the present invention, and as shown in fig. 5, in this embodiment, the present invention provides a multiparty video communication system based on two cameras, where the system includes: the system comprises a multi-party video acquisition system, a video communication system, a signaling system and a server; each video acquisition system comprises an image acquisition device, a sound acquisition device, a video processor and a display terminal; the image acquisition device comprises a first camera and a second camera, wherein the first camera is used for acquiring first video data of a preset target at a first visual angle, and the second camera is used for acquiring second video data of the preset target at a second visual angle; the sound acquisition device is used for acquiring audio data of the preset target; the video processor is connected with the image acquisition device and the sound acquisition device and is used for carrying out compression coding on the first data, the second video data and the audio data to obtain original video data; the server is connected with the plurality of video processors, is also connected with the signaling system, and is used for configuring display areas of a plurality of original video data sent by the plurality of video processors according to a control signaling sent by the signaling system to generate target display video data, and is also used for sending the target display video data to all display terminals to display the target display video data on all the display terminals; in this embodiment, the display terminal includes, but is not limited to, an intelligent tablet, a notebook computer, or a desktop computer.
It will be understood by those skilled in the art that all or part of the processes of the methods of the embodiments described above can be implemented by a computer program, which can be stored in a non-volatile computer-readable storage medium, and can include the processes of the embodiments of the methods described above when the program is executed. Any reference to memory, storage, database, or other medium used in the embodiments provided herein may include non-volatile and/or volatile memory, among others. Non-volatile memory can include read-only memory (ROM), Programmable ROM (PROM), Electrically Programmable ROM (EPROM), Electrically Erasable Programmable ROM (EEPROM), or flash memory. Volatile memory can include Random Access Memory (RAM) or external cache memory. By way of illustration and not limitation, RAM is available in a variety of forms such as Static RAM (SRAM), Dynamic RAM (DRAM), Synchronous DRAM (SDRAM), Double Data Rate SDRAM (DDRSDRAM), Enhanced SDRAM (ESDRAM), Synchronous Link DRAM (SLDRAM), Rambus Direct RAM (RDRAM), direct bus dynamic RAM (DRDRAM), and memory bus dynamic RAM (RDRAM).
It is noted that, in this document, relational terms such as "first" and "second," and the like, may be used solely to distinguish one entity or action from another entity or action without necessarily requiring or implying any actual such relationship or order between such entities or actions. Also, the terms "comprises," "comprising," or any other variation thereof, are intended to cover a non-exclusive inclusion, such that a process, method, article, or apparatus that comprises a list of elements does not include only those elements but may include other elements not expressly listed or inherent to such process, method, article, or apparatus. Without further limitation, an element defined by the phrase "comprising an … …" does not exclude the presence of other identical elements in a process, method, article, or apparatus that comprises the element.
Claims (10)
1. A multiparty video communication method based on double cameras is characterized in that the method is applied to a server side and comprises the following steps:
receiving original video data sent by each video client, wherein the original video data comprise first video data for collecting a preset target at a first visual angle, second video data for collecting the preset target at a second visual angle and audio data;
acquiring a first control signaling of each video client;
according to the first control signaling of each video client, configuring a display area of each original video data to generate target display video data;
and sending the target display video data to each video client, so that the target display video data is displayed in each video client.
2. The dual-camera based multiparty video communication method of claim 1, wherein the generating of the target display video data by performing display area configuration on each original video data according to the display signaling of each video client comprises:
if the first control signaling of the current video client is a display signaling, configuring an original video data display area of the current video client as a main area;
if the first control signaling of the current video client is a silent signaling, configuring an original video data display area of the current video client as an auxiliary area;
and generating the target display video data from all the original video data according to the display areas of all the original video data.
3. The dual-camera based multi-party video communication method of claim 2, wherein the method further comprises:
and if the first control signaling of the current video client is a display signaling, configuring the first control signaling of other video clients into the silence signaling.
4. The dual-camera multi-party video communication method according to claim 3, wherein said obtaining the first control signaling of each video client comprises:
performing image recognition on first video data corresponding to each video client in real time to obtain a plurality of recognition results;
comparing the plurality of identification results with a preset result, and judging whether an identification result which is consistent with the preset result exists or not;
and when the identification result which is consistent with the preset result exists, configuring the first control signaling of the video client corresponding to the identification result into display signaling.
5. The dual-camera multi-party video communication method as recited in claim 2, wherein after transmitting the target display video data to each video client such that the target display video data is displayed in the each video client, the method further comprises:
acquiring a second control signaling of the original video data displayed in the main area, wherein the second control signaling comprises a zooming instruction and a zooming area;
and according to the zooming instruction, correspondingly zooming the original video data in the zooming area according to a first preset rule and then displaying the zoomed original video data.
6. A multiparty video communication method based on double cameras is applied to a video client, and comprises the following steps:
acquiring first video data, second video data and audio data of a preset target, wherein the first video data is acquired at a first visual angle, and the second video data is acquired at a second visual angle;
compressing and encoding the first video data, the second video data and the audio data to obtain original video data;
sending the original video data to a server, and enabling the server to configure a display area of each original video data according to a first control signaling of each video client to generate target display video data;
and receiving and displaying the target display video data.
7. The dual-camera based multiparty video communication method of claim 6, wherein compressing and encoding the first video data, the second video data and the audio data to obtain original video data comprises:
acquiring a superposition instruction, wherein the superposition instruction comprises character information and superposition position information;
acquiring a character file corresponding to the character information according to the character information;
writing the character file into a corresponding position in a preset image layer according to the superposition position information;
respectively superposing the preset image layers on the first video data and the second video data to obtain first superposed video data and second superposed video data;
and compressing and encoding the first superposed video data, the second superposed video data and the audio data to obtain original video data.
8. A multiparty video communication device based on double cameras is characterized in that the device is applied to a server side and comprises:
the system comprises an original data receiving module, a first video data processing module and a second video data processing module, wherein the original data receiving module is used for receiving original video data sent by each video client, and the original video data comprises first video data for collecting a preset target at a first visual angle, second video data for collecting the preset target at a second visual angle and audio data;
the control signaling acquisition module is used for acquiring a first control signaling of each video client;
the target data generation module is used for configuring a display area of each original video data according to the first control signaling of each video client to generate target display video data;
and the target data sending module is used for sending the target display video data to each video client so that the target display video data is displayed in each video client.
9. A multiparty video communication device based on double cameras, which is applied to a video client, the device comprises:
the data acquisition module is used for acquiring first video data, second video data and audio data of a preset target, wherein the first video data is acquired at a first visual angle, and the second video data is acquired at a second visual angle;
the data processing module is used for compressing and coding the first video data, the second video data and the audio data to obtain original video data;
the original data sending module is used for sending the original video data to the server, so that the server performs display area configuration on each original video data according to the first control signaling of each video client to generate target display video data;
and the display module is used for receiving and displaying the target display video data.
10. A dual-camera based multi-party video communication system, the system comprising:
the system comprises a multi-party video acquisition system, a video communication system, a signaling system and a server;
each video acquisition system comprises an image acquisition device, a sound acquisition device, a video processor and a display terminal;
the image acquisition device comprises a first camera and a second camera, wherein the first camera is used for acquiring first video data of a preset target at a first visual angle, and the second camera is used for acquiring second video data of the preset target at a second visual angle;
the sound acquisition device is used for acquiring audio data of the preset target;
the video processor is connected with the image acquisition device and the sound acquisition device and is used for carrying out compression coding on the first data, the second video data and the audio data to obtain original video data;
the server is connected with the plurality of video processors, is also connected with the signaling system, and is used for configuring display areas of a plurality of original video data sent by the plurality of video processors according to the control signaling sent by the signaling system to generate target display video data, and is also used for sending the target display video data to all display terminals so that the target display video data is displayed on all the display terminals.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202010963669.6A CN112272284B (en) | 2020-09-14 | 2020-09-14 | Multi-party video communication method, device and system based on double cameras |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202010963669.6A CN112272284B (en) | 2020-09-14 | 2020-09-14 | Multi-party video communication method, device and system based on double cameras |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN112272284A true CN112272284A (en) | 2021-01-26 |
| CN112272284B CN112272284B (en) | 2023-04-14 |
Family
ID=74349976
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202010963669.6A Active CN112272284B (en) | 2020-09-14 | 2020-09-14 | Multi-party video communication method, device and system based on double cameras |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN112272284B (en) |
Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN103581608A (en) * | 2012-07-20 | 2014-02-12 | Polycom通讯技术（北京）有限公司 | Spokesman detecting system, spokesman detecting method and audio/video conference system |
| CN106851176A (en) * | 2017-03-23 | 2017-06-13 | 江苏大学 | Video meeting implementing method based on wechat |
| CN107528938A (en) * | 2017-07-26 | 2017-12-29 | 维沃移动通信有限公司 | A kind of video call method, terminal and computer-readable recording medium |
| CN108833987A (en) * | 2018-09-17 | 2018-11-16 | 广州航帆计算机科技有限公司 | A kind of extensive video conference split screen method and system |
| CN110300278A (en) * | 2018-03-23 | 2019-10-01 | 阿里巴巴集团控股有限公司 | Video transmission method and equipment |
-
2020
- 2020-09-14 CN CN202010963669.6A patent/CN112272284B/en active Active
Patent Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN103581608A (en) * | 2012-07-20 | 2014-02-12 | Polycom通讯技术（北京）有限公司 | Spokesman detecting system, spokesman detecting method and audio/video conference system |
| CN106851176A (en) * | 2017-03-23 | 2017-06-13 | 江苏大学 | Video meeting implementing method based on wechat |
| CN107528938A (en) * | 2017-07-26 | 2017-12-29 | 维沃移动通信有限公司 | A kind of video call method, terminal and computer-readable recording medium |
| CN110300278A (en) * | 2018-03-23 | 2019-10-01 | 阿里巴巴集团控股有限公司 | Video transmission method and equipment |
| CN108833987A (en) * | 2018-09-17 | 2018-11-16 | 广州航帆计算机科技有限公司 | A kind of extensive video conference split screen method and system |
Also Published As
| Publication number | Publication date |
|---|---|
| CN112272284B (en) | 2023-04-14 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US9912907B2 (en) | Dynamic video and sound adjustment in a video conference | |
| CN106792092B (en) | Live video stream split-mirror display control method and corresponding device thereof | |
| US9641585B2 (en) | Automated video editing based on activity in video conference | |
| JP6939037B2 (en) | How to represent meeting content, programs, and equipment | |
| US7355623B2 (en) | System and process for adding high frame-rate current speaker data to a low frame-rate video using audio watermarking techniques | |
| US20080235724A1 (en) | Face Annotation In Streaming Video | |
| WO2016177262A1 (en) | Collaboration method for intelligent conference and conference terminal | |
| US9197856B1 (en) | Video conferencing framing preview | |
| WO2020119032A1 (en) | Biometric feature-based sound source tracking method, apparatus, device, and storage medium | |
| WO2012072008A1 (en) | Method and device for superposing auxiliary information of video signal | |
| US20050243167A1 (en) | System and process for adding high frame-rate current speaker data to a low frame-rate video using delta frames | |
| US9819906B2 (en) | Selective data content sharing | |
| US20170048284A1 (en) | Non-transitory computer readable medium, information processing apparatus, and information processing system | |
| CN111651632A (en) | Method and device for outputting voice and video of speaker in video conference | |
| CN112004046A (en) | Image processing method and device based on video conference | |
| CN114128255A (en) | Video conferencing using hybrid edge/cloud reasoning in conjunction with machine learning systems | |
| CN113453022B (en) | Image display method and device, television and storage medium | |
| CN114531564A (en) | Processing method and electronic equipment | |
| JP2024500956A (en) | Systems and methods for expanded views in online meetings | |
| CN112272284B (en) | Multi-party video communication method, device and system based on double cameras | |
| US20230231973A1 (en) | Streaming data processing for hybrid online meetings | |
| JP4649640B2 (en) | Image processing method, image processing apparatus, and content creation system | |
| CN115499677A (en) | Audio and video synchronization detection method and device based on live broadcast | |
| KR20190029999A (en) | System for generating documents of minutes by using multi-connection and the method thereof | |
| CN111585865A (en) | Data processing method, data processing device, computer readable storage medium and computer equipment |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant | ||
| TR01 | Transfer of patent right | ||
| TR01 | Transfer of patent right |
Effective date of registration: 20230801 Address after: Room 1, 6th Floor, Building 7, No. 106, West Section of Jinkai Avenue, Dazhulin Street, Liangjiang New District, Chongqing, 401120 Patentee after: Chongqing Qiqu Space Technology Co.,Ltd. Address before: 402560 baituba Industrial Park, Nancheng sub district office, Tongliang District, Chongqing Patentee before: CHONGQING GUOXIANG INNOVATION TEACHING EQUIPMENT Co.,Ltd. |