CN112272283A - Multi-party online learning method based on double cameras, client and server - Google Patents
Multi-party online learning method based on double cameras, client and server Download PDFInfo
- Publication number
- CN112272283A CN112272283A CN202010963002.6A CN202010963002A CN112272283A CN 112272283 A CN112272283 A CN 112272283A CN 202010963002 A CN202010963002 A CN 202010963002A CN 112272283 A CN112272283 A CN 112272283A
- Authority
- CN
- China
- Prior art keywords
- video data
- display area
- main
- client
- speaking
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
- 238000000034 method Methods 0.000 title claims abstract description 26
- 230000011664 signaling Effects 0.000 claims abstract description 64
- 238000004891 communication Methods 0.000 claims abstract description 24
- 230000001360 synchronised effect Effects 0.000 claims description 13
- 230000008859 change Effects 0.000 claims description 11
- 230000003993 interaction Effects 0.000 abstract description 7
- 230000000694 effects Effects 0.000 abstract description 3
- 230000000007 visual effect Effects 0.000 description 19
- 238000005457 optimization Methods 0.000 description 6
- 230000002452 interceptive effect Effects 0.000 description 3
- 230000003111 delayed effect Effects 0.000 description 2
- 238000010586 diagram Methods 0.000 description 2
- 208000035473 Communicable disease Diseases 0.000 description 1
- 230000006399 behavior Effects 0.000 description 1
- 230000009286 beneficial effect Effects 0.000 description 1
- 230000007547 defect Effects 0.000 description 1
- 238000012986 modification Methods 0.000 description 1
- 230000004048 modification Effects 0.000 description 1
- 230000008569 process Effects 0.000 description 1
- 230000004044 response Effects 0.000 description 1
Images
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N7/00—Television systems
- H04N7/18—Closed-circuit television [CCTV] systems, i.e. systems in which the video signal is not broadcast
- H04N7/181—Closed-circuit television [CCTV] systems, i.e. systems in which the video signal is not broadcast for receiving images from a plurality of remote sources
-
- G—PHYSICS
- G09—EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
- G09B—EDUCATIONAL OR DEMONSTRATION APPLIANCES; APPLIANCES FOR TEACHING, OR COMMUNICATING WITH, THE BLIND, DEAF OR MUTE; MODELS; PLANETARIA; GLOBES; MAPS; DIAGRAMS
- G09B5/00—Electrically-operated educational appliances
- G09B5/08—Electrically-operated educational appliances providing for individual presentation of information to a plurality of student stations
- G09B5/10—Electrically-operated educational appliances providing for individual presentation of information to a plurality of student stations all student stations being capable of presenting the same information simultaneously
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N5/00—Details of television systems
- H04N5/04—Synchronising
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N5/00—Details of television systems
- H04N5/222—Studio circuitry; Studio devices; Studio equipment
- H04N5/262—Studio circuits, e.g. for mixing, switching-over, change of character of image, other special effects ; Cameras specially adapted for the electronic generation of special effects
- H04N5/268—Signal distribution or switching
Landscapes
- Engineering & Computer Science (AREA)
- Multimedia (AREA)
- Signal Processing (AREA)
- Business, Economics & Management (AREA)
- Physics & Mathematics (AREA)
- Educational Administration (AREA)
- Educational Technology (AREA)
- General Physics & Mathematics (AREA)
- Theoretical Computer Science (AREA)
- Electrically Operated Instructional Devices (AREA)
- Two-Way Televisions, Distribution Of Moving Picture Or The Like (AREA)
Abstract
The invention discloses a multi-party online learning method based on double cameras, a client and a server, wherein the method comprises the following steps: receiving multi-path media data sent by at least two clients; the multi-path media data are collected from each client and comprise character video data, desktop video data and audio data; the client comprises a main speaking end and a listening end; distributing display areas for the character video data and the desktop video data from the clients according to a preset mode; the display area comprises a main display area and an auxiliary display area; respectively sending multi-path media data which are not collected from the client to each client so that the client synchronously displays the multi-path media data according to the distributed display areas; receiving a control signaling from a main speaking end; and changing the distribution of the display area according to the control signaling of the main speaking end. The invention realizes multi-point and multi-angle real-time video communication at the same time, is easy to master the learning state of students and has better demonstration and interaction effect.
Description
Technical Field
The invention belongs to the technical field of multimedia communication, and particularly relates to a multi-party online learning method based on double cameras, a client and a server.
Background
On-line learning generally refers to a learning behavior based on network in the current concept, and as the name suggests, a teaching mode taking network as a medium is adopted, and students and teachers can develop teaching activities even if the students and teachers are separated by ten thousand miles; in addition, by means of the network courseware, the students can learn at any time and any place, the limitation of time and space is broken really, and the network remote education is the most convenient learning mode for employees who work busy and have unfixed learning time. Under the condition of meeting the epidemic situation of the large-scale infectious diseases, because many schools are closed and cannot be used for class, online learning becomes a necessary mode for school teaching, and the online learning is rapidly popularized and developed in various places.
However, in the online learning system in the prior art, usually, only the visual angle of a teacher or a student is demonstrated, the teacher cannot easily master the learning state of the student when speaking, the student lacks interaction because of being passively live-broadcasting, the attention is hard to be continuously focused when the student is in class, and the learning efficiency is reduced.
Disclosure of Invention
Aiming at the defects in the prior art, the invention provides a multi-party online learning method based on double cameras, a client and a server, which realize multi-point simultaneous multi-angle real-time video communication, are easy to master the learning state of students and have better demonstration interaction effect.
In a first aspect, the multiparty online learning method based on two cameras is applied to a server and comprises the following steps:
receiving multi-path media data sent by at least two clients; the multi-path media data are collected from each client and comprise character video data, desktop video data and audio data; the client comprises a main speaking end and a listening end;
distributing display areas for the character video data and the desktop video data from the clients according to a preset mode; the display area comprises a main display area and an auxiliary display area;
respectively sending multi-path media data which are not collected from the client to each client so that the client synchronously displays the multi-path media data according to the distributed display areas;
receiving a control signaling from a main speaking end;
and changing the distribution of the display area according to the control signaling of the main speaking end.
As an optimization, the allocating display areas for the character video data and the desktop video data from each client according to a preset mode includes:
and distributing the character video data and the desktop video data of the main speaking end to the main display area, and distributing the character video data and the desktop video data of the listening and speaking end to the auxiliary display area.
As an optimization, the changing the allocation of the display area according to the control signaling of the main speaking end comprises:
if the control signaling of the main speaking end is a signaling for enabling one of the client sides to be on the screen, distributing the figure video data and the desktop video data of the client side to a main display area;
and if the control signaling of the main speaking end is a signaling for enabling the character video data or the desktop video data of one of the client sides to be displayed on the screen, distributing the character video data or the desktop video data of the client side to a main display area.
As optimization, before distributing display areas for the character video data and the desktop video data from the clients according to a preset mode, judging whether the number of the listening and speaking ends exceeds a preset display upper limit of the auxiliary display area; if the number of the characters exceeds the preset number, distributing display areas for the character video data and the desktop video data from the clients according to a preset mode, wherein the display areas comprise:
distributing the character video data and the desktop video data of the main speaking end to a main display area; and grouping the listening and speaking ends according to the preset display upper limit, and alternately distributing the listening and speaking ends to the auxiliary display area according to the grouping at intervals of preset polling time.
In a second aspect, a multi-party online learning method based on two cameras is applied to a client, wherein the client is a main speaking end or a listening and speaking end, and the method comprises the following steps:
collecting multi-channel media data; the multi-path media data comprises character video data, desktop video data and audio data;
sending the multi-path media data to a server;
receiving multi-channel media data which are sent by the server and collected by other clients;
synchronously displaying the multi-channel media data according to a display area distributed by the server in a preset mode; the display area comprises a main display area and an auxiliary display area;
and updating the display content of the display area on the client by the server according to the change of the distribution of the display area by the control signaling of the main speaking end.
As an optimization, the updating the display content of the display area on the client according to the change made by the server to the allocation of the display area according to the control signaling of the main speaker includes:
if the control signaling of the main speaking end is the signaling of the main display area on one of the client sides, updating the figure video data and the desktop video data of the client side to the main display area for synchronous display;
and if the control signaling of the main speaking end is the signaling of the main display area on the character video data or the desktop video data of one of the client sides, updating the character video data or the desktop video data of the client side to the main display area for synchronous display.
As optimization, the synchronously displaying the multiple paths of media data according to the display area allocated by the server in a preset manner includes: if the number of the listening and speaking ends exceeds the preset display upper limit of the auxiliary display area, synchronously displaying the figure video data and the desktop video data of the main speaking end in the main display area; the listening and speaking terminals are grouped according to the preset display upper limit, and the listening and speaking terminals are synchronously displayed in the auxiliary display area according to the grouping in turn at intervals of preset polling time;
and if the number of the listening and speaking ends does not exceed the preset display upper limit of the auxiliary display area, synchronously displaying the character video data and the desktop video data of the main speaking end in the main display area, and synchronously displaying the character video data and the desktop video data of the listening and speaking end in the auxiliary display area.
In a third aspect, a multi-party online learning client based on two cameras is a main speaking end or a listening end, and includes:
the system comprises a control unit, a first camera, a second camera, an audio acquisition device, a client communication module, an audio output device and a display device, wherein the first camera is used for acquiring character video data, the second camera is used for acquiring desktop video data, the audio acquisition device is used for acquiring audio data, the client communication module is used for communicating with a server, the audio output device is used for displaying the audio data, and the display device is used for displaying the character video data and the desktop video data;
the client communication module is used for sending the character video data, the desktop video data and the audio data to a server; the system comprises a client, a server and a server, wherein the client is used for receiving character video data, desktop video data and audio data acquired by other clients;
the control unit is used for updating the figure video data and the desktop video data of the client to the main display area of the display device for synchronous display if the control signaling for the server to change the distribution of the display areas is the signaling for the main display area on one of the clients; if the control signaling for the server to change the distribution of the display area is the signaling for the main display area on the character video data or the desktop video data of one of the clients, the character video data or the desktop video data of the client is updated to the main display area of the display device for synchronous display.
In a fourth aspect, a dual-camera based multi-party online learning server includes:
the server communication module is used for receiving multi-path media data sent by at least two clients, wherein the multi-path media data comprise character video data, desktop video data and audio data, and the clients comprise a main speaking end and a listening end; the system comprises a client, a server and a server, wherein the client is used for acquiring multi-channel media data from the server; the control signaling is used for receiving the control signaling from the main speaking end;
the processing unit is used for distributing display areas for the character video data and the desktop video data from the clients according to a preset mode, and the display areas comprise a main display area and an auxiliary display area; the display area is also used for changing the distribution of the display area according to the control signaling of the main speaking end;
the server communication module is connected with the processing unit.
As an optimization, the processing unit is further configured to determine whether the number of the listening and speaking terminals exceeds a preset upper limit of display of the secondary display area, and if so, allocate display areas for the character video data and the desktop video data from each client according to a preset manner, including: distributing the character video data and the desktop video data of the main speaking end to a main display area; grouping the listening and speaking ends according to the preset display upper limit, and alternately distributing the listening and speaking ends to the auxiliary display area according to the grouping at intervals of preset polling time;
if the number of the characters does not exceed the preset number, distributing display areas for the character video data and the desktop video data from the clients according to a preset mode, wherein the display areas comprise: and distributing the character video data and the desktop video data of the main speaking end to the main display area, and distributing the character video data and the desktop video data of the listening and speaking end to the auxiliary display area.
Compared with the prior art, the invention has the following beneficial effects:
1. the method comprises the steps that two cameras are used for collecting video data of two visual angles of a character and a desktop, each visual angle adopts an independent video stream, and each video stream can be independently controlled and a main display area and an auxiliary display area can be independently switched; the display area in the video communication is controlled through the control signaling, so that the multi-point simultaneous multi-angle real-time video communication is realized; the method can be applied to scenes such as online education and the like, solves the communication problem when portrait display and physical demonstration are simultaneously and concurrently performed during one-to-many teaching, also solves the problem that a speaker is difficult to master the learning state of students during lectures, can more conveniently perform demonstration teaching and realize better demonstration interaction;
2. the time for additionally adjusting the video pictures of the main display area and the auxiliary display area during the opening can be saved by presetting a common display area distribution state;
3. the teacher can conveniently observe the student state while performing interactive teaching by switching to the view angles of the student characters and the desktop at any time; the person visual angle or the desktop visual angle of the student is independently switched to the main display area, so that the student can simultaneously observe and communicate with the person visual angle or the desktop visual angle of a teacher, better interaction can be realized, comparison, observation and learning can be more easily carried out, and the learning efficiency is improved;
4. by setting a rotation display scheme based on the auxiliary display area, all listening and speaking ends are divided into a plurality of groups according to the preset display upper limit, and rotation operation is performed according to the preset time, so that the pressure of a client is reduced, and the learning state of a student is not delayed to be mastered.
Drawings
In order to more clearly illustrate the embodiments of the present invention or the technical solutions in the prior art, the drawings used in the description of the embodiments or the prior art will be briefly described below, it is obvious that the drawings in the following description are only some embodiments of the present invention, and for those skilled in the art, other drawings can be obtained according to the drawings without creative efforts.
FIG. 1 is a schematic flow chart of a multi-party online learning method based on two cameras according to a first aspect of the present invention;
FIG. 2 is a flow chart of a multi-party online learning method based on two cameras according to a second aspect of the present invention;
FIG. 3 is a schematic structural diagram of a multi-party online learning client based on two cameras according to a third aspect of the present invention;
fig. 4 is a schematic structural diagram of a multiparty online learning server based on two cameras according to a fourth aspect of the present invention.
Detailed Description
The technical solutions in the embodiments of the present invention will be clearly and completely described below with reference to the drawings in the embodiments of the present invention, and it is obvious that the described embodiments are only a part of the embodiments of the present invention, and not all of the embodiments. All other embodiments, which can be derived by a person skilled in the art from the embodiments given herein without making any creative effort, shall fall within the protection scope of the present invention.
In order to make the objects, technical solutions and advantages of the present invention more apparent, the present invention is described in further detail below with reference to the accompanying drawings and embodiments. It should be understood that the specific embodiments described herein are merely illustrative of the invention and are not intended to limit the invention.
In a first aspect of the present invention, as shown in fig. 1, a multiparty online learning method based on two cameras is applied to a server, and includes the following steps:
s101: receiving multi-path media data sent by at least two clients; the multi-path media data are collected from each client and comprise character video data, desktop video data and audio data; the client comprises a main speaking end and a listening end;
s102: distributing display areas for the character video data and the desktop video data from the clients according to a preset mode; the display area comprises a main display area and an auxiliary display area;
s103: respectively sending multi-path media data which are not collected from the client to each client so that the client synchronously displays the multi-path media data according to the distributed display areas;
s104: receiving a control signaling from a main speaking end;
s105: and changing the distribution of the display area according to the control signaling of the main speaking end.
The character video data can be collected from the front visual angle of an autonomous speaker or a listener, and the desktop video data can be collected from the desktop visual angle of the autonomous speaker or the listener. The main speaking end is the client used by the main speaker, and the listening end is the client used by the listening and speaking person. Generally, the main display area can accommodate two larger video pictures and the auxiliary display area can accommodate a plurality of pairs of smaller video pictures. The synchronous display can be realized by adding a time stamp on the audio and video data.
In the embodiment, two cameras are adopted to collect video data of two visual angles of a character and a desktop, each visual angle adopts an independent video stream, and each video stream can be independently controlled and a main display area and an auxiliary display area can be switched; the display area in the video communication is controlled through the control signaling, so that the multi-point simultaneous multi-angle real-time video communication is realized; can be applied to scenes such as online education, solve when a to many teaching, the communication problem when portrait show and the demonstration in kind are concurrent simultaneously has still been solved mr and is difficult to master student's study state's problem when the lecture, can be more convenient demonstrate the teaching, realize better demonstration interdynamic.
In one embodiment, the allocating display areas for the character video data and the desktop video data from the clients in a preset manner includes:
and distributing the character video data and the desktop video data of the main speaking end to the main display area, and distributing the character video data and the desktop video data of the listening and speaking end to the auxiliary display area.
Generally, for online learning, a teacher is mainly used for lecturing, and student interaction is used as an assistant, so a commonly used display area allocation state is preset in the embodiment, that is, a video image of the teacher is in a main display area, and a video image of the student is in a sub-display area. Therefore, the time for additionally adjusting the video pictures in the main display area and the auxiliary display area during the talking can be saved.
In one embodiment, the changing the allocation of the display area according to the control signaling of the main speaker comprises:
if the control signaling of the main speaking end is a signaling for enabling one of the client sides to be on the screen, distributing the figure video data and the desktop video data of the client side to a main display area;
and if the control signaling of the main speaking end is a signaling for enabling the character video data or the desktop video data of one of the client sides to be displayed on the screen, distributing the character video data or the desktop video data of the client side to a main display area.
Wherein interaction between a teacher and a student is often required during a real online learning process. And just having set up the camera at student's visual angle among the prior art, also can only or switching mr's visual angle, or switching student's visual angle, it is comparatively inconvenient interactive. In this embodiment, not only can let the mr switch to student's personage and desktop visual angle at any time, observe student's state when making things convenient for the mr to carry out interactive teaching, can also switch student's personage visual angle or desktop visual angle to main display area alone, just so can observe and exchange with mr's personage visual angle or desktop visual angle simultaneously, can interact better, contrast more easily and observe the study, improve learning efficiency.
In one embodiment, before the display areas are allocated for the character video data and the desktop video data from the clients according to the preset mode, whether the number of the listening and speaking ends exceeds the preset display upper limit of the auxiliary display area is judged; if the number of the characters exceeds the preset number, distributing display areas for the character video data and the desktop video data from the clients according to a preset mode, wherein the display areas comprise:
distributing the character video data and the desktop video data of the main speaking end to a main display area; and grouping the listening and speaking ends according to the preset display upper limit, and alternately distributing the listening and speaking ends to the auxiliary display area according to the grouping at intervals of preset polling time.
Considering that if a large number of students are accessed for learning, the number of videos displayed in the auxiliary display area is increased in proportion, on one hand, the processing capacity of the network and the client side is greatly stressed, and problems of unstable connection, network blockage, long response time and the like can be caused; on the other hand, too many video pictures occupy the display space and are not attractive, or the pictures are too small and cannot be seen clearly. It is therefore conceivable to set an upper limit of display on the number of the listeners and the clients in such a manner as to relieve the server and the clients from stress, but this brings about a problem that the talker cannot observe the learning state of the whole listeners well. In view of this, the applicant proposes a polling scheme based on the sub-display area, in which all listening/speaking terminals are divided into several groups according to a preset display upper limit, for example, if 20 persons listen and speak, and the display upper limit is 5, then the terminals can be divided into 4 groups. And then setting a polling time, wherein the character video data and the desktop video data displayed in the auxiliary display area are changed into one group every time the polling time passes, and the polling time are sequentially and circularly carried out. Therefore, the pressure of the client side is reduced, and the learning state of the student is not delayed.
In a second aspect of the present invention, as shown in fig. 2, a multiparty online learning method based on two cameras is applied to a client, where the client is a main speaking end or a listening and speaking end, and includes the following steps:
s201: collecting multi-channel media data; the multi-path media data comprises character video data, desktop video data and audio data;
s202: sending the multi-path media data to a server;
s203: receiving multi-channel media data which are sent by the server and collected by other clients;
s204: synchronously displaying the multi-channel media data according to a display area distributed by the server in a preset mode; the display area comprises a main display area and an auxiliary display area;
s205: and updating the display content of the display area on the client by the server according to the change of the distribution of the display area by the control signaling of the main speaking end.
In one embodiment, the updating the display content of the display area on the client according to the change made by the server to the allocation of the display area according to the control signaling of the main speaker comprises:
if the control signaling of the main speaking end is the signaling of the main display area on one of the client sides, updating the figure video data and the desktop video data of the client side to the main display area for synchronous display;
and if the control signaling of the main speaking end is the signaling of the main display area on the character video data or the desktop video data of one of the client sides, updating the character video data or the desktop video data of the client side to the main display area for synchronous display.
In one embodiment, the synchronously displaying the multiple paths of media data according to the display areas allocated by the server in a preset manner includes: if the number of the listening and speaking ends exceeds the preset display upper limit of the auxiliary display area, synchronously displaying the figure video data and the desktop video data of the main speaking end in the main display area; the listening and speaking terminals are grouped according to the preset display upper limit, and the listening and speaking terminals are synchronously displayed in the auxiliary display area according to the grouping in turn at intervals of preset polling time;
and if the number of the listening and speaking ends does not exceed the preset display upper limit of the auxiliary display area, synchronously displaying the character video data and the desktop video data of the main speaking end in the main display area, and synchronously displaying the character video data and the desktop video data of the listening and speaking end in the auxiliary display area.
In a third aspect of the present invention, as shown in fig. 3, a multi-party online learning client based on two cameras is a main speaking end or a listening and speaking end, and includes:
the system comprises a control unit, a first camera, a second camera, an audio acquisition device, a client communication module, an audio output device and a display device, wherein the first camera is used for acquiring character video data, the second camera is used for acquiring desktop video data, the audio acquisition device is used for acquiring audio data, the client communication module is used for communicating with a server, the audio output device is used for displaying the audio data, and the display device is used for displaying the character video data and the desktop video data;
the client communication module is used for sending the character video data, the desktop video data and the audio data to a server; the system comprises a client, a server and a server, wherein the client is used for receiving character video data, desktop video data and audio data acquired by other clients;
the control unit is used for updating the figure video data and the desktop video data of the client to the main display area of the display device for synchronous display if the control signaling for the server to change the distribution of the display areas is the signaling for the main display area on one of the clients; if the control signaling for the server to change the distribution of the display area is the signaling for the main display area on the character video data or the desktop video data of one of the clients, the character video data or the desktop video data of the client is updated to the main display area of the display device for synchronous display.
In a fourth aspect of the present invention, as shown in fig. 4, a multi-party online learning server based on two cameras includes:
the server communication module is used for receiving multi-path media data sent by at least two clients, wherein the multi-path media data comprise character video data, desktop video data and audio data, and the clients comprise a main speaking end and a listening end; the system comprises a client, a server and a server, wherein the client is used for acquiring multi-channel media data from the server; the control signaling is used for receiving the control signaling from the main speaking end;
the processing unit is used for distributing display areas for the character video data and the desktop video data from the clients according to a preset mode, and the display areas comprise a main display area and an auxiliary display area; the display area is also used for changing the distribution of the display area according to the control signaling of the main speaking end;
the server communication module is connected with the processing unit.
In one embodiment, the processing unit is further configured to determine whether the number of the listening and speaking terminals exceeds a preset upper limit of display in the sub-display area, and if so, allocate display areas for the character video data and the desktop video data from each client according to a preset manner, and the method includes: distributing the character video data and the desktop video data of the main speaking end to a main display area; grouping the listening and speaking ends according to the preset display upper limit, and alternately distributing the listening and speaking ends to the auxiliary display area according to the grouping at intervals of preset polling time;
if the number of the characters does not exceed the preset number, distributing display areas for the character video data and the desktop video data from the clients according to a preset mode, wherein the display areas comprise: and distributing the character video data and the desktop video data of the main speaking end to the main display area, and distributing the character video data and the desktop video data of the listening and speaking end to the auxiliary display area.
The technical features of the above embodiments can be arbitrarily combined, and for the sake of brevity, all possible combinations of the technical features in the above embodiments are not described, but should be considered as the scope of the present specification as long as there is no contradiction between the combinations of the technical features.
The above examples are merely illustrative of several embodiments of the present invention, and the description thereof is more specific and detailed, but not to be construed as limiting the scope of the invention. It should be noted that, for a person skilled in the art, several variations and modifications can be made without departing from the inventive concept, which falls within the scope of the present invention. Therefore, the protection scope of the present invention should be subject to the appended claims.
Claims (10)
1. The multiparty online learning method based on the double cameras is characterized by being applied to a server and comprising the following steps of:
receiving multi-path media data sent by at least two clients; the multi-path media data are collected from each client and comprise character video data, desktop video data and audio data; the client comprises a main speaking end and a listening end;
distributing display areas for the character video data and the desktop video data from the clients according to a preset mode; the display area comprises a main display area and an auxiliary display area;
respectively sending multi-path media data which are not collected from the client to each client so that the client synchronously displays the multi-path media data according to the distributed display areas;
receiving a control signaling from a main speaking end;
and changing the distribution of the display area according to the control signaling of the main speaking end.
2. The dual-camera based multi-party online learning method of claim 1, wherein:
the method for distributing display areas for the character video data and the desktop video data from the clients according to the preset mode comprises the following steps:
and distributing the character video data and the desktop video data of the main speaking end to the main display area, and distributing the character video data and the desktop video data of the listening and speaking end to the auxiliary display area.
3. The dual-camera based multi-party online learning method of claim 1, wherein:
the changing the allocation of the display area according to the control signaling of the main speaking end comprises:
if the control signaling of the main speaking end is a signaling for enabling one of the client sides to be on the screen, distributing the figure video data and the desktop video data of the client side to a main display area;
and if the control signaling of the main speaking end is a signaling for enabling the character video data or the desktop video data of one of the client sides to be displayed on the screen, distributing the character video data or the desktop video data of the client side to a main display area.
4. The dual-camera based multi-party online learning method of claim 1, wherein:
before distributing display areas for the character video data and the desktop video data from the clients according to the preset mode, judging whether the number of the listening and speaking ends exceeds the preset display upper limit of the auxiliary display area; if the number of the characters exceeds the preset number, distributing display areas for the character video data and the desktop video data from the clients according to a preset mode, wherein the display areas comprise:
distributing the character video data and the desktop video data of the main speaking end to a main display area; and grouping the listening and speaking ends according to the preset display upper limit, and alternately distributing the listening and speaking ends to the auxiliary display area according to the grouping at intervals of preset polling time.
5. The multiparty online learning method based on the double cameras is characterized by being applied to a client, wherein the client is a main speaking end or a listening and speaking end, and the method comprises the following steps:
collecting multi-channel media data; the multi-path media data comprises character video data, desktop video data and audio data;
sending the multi-path media data to a server;
receiving multi-channel media data which are sent by the server and collected by other clients;
synchronously displaying the multi-channel media data according to a display area distributed by the server in a preset mode; the display area comprises a main display area and an auxiliary display area;
and updating the display content of the display area on the client by the server according to the change of the distribution of the display area by the control signaling of the main speaking end.
6. The dual-camera based multi-party online learning method of claim 5, wherein:
the changing of the server to the distribution of the display area according to the control signaling of the main speaking end, updating the display content of the display area on the client end, including:
if the control signaling of the main speaking end is the signaling of the main display area on one of the client sides, updating the figure video data and the desktop video data of the client side to the main display area for synchronous display;
and if the control signaling of the main speaking end is the signaling of the main display area on the character video data or the desktop video data of one of the client sides, updating the character video data or the desktop video data of the client side to the main display area for synchronous display.
7. The dual-camera based multi-party online learning method of claim 5, wherein:
the synchronously displaying the multi-channel media data according to the display area distributed by the server in a preset mode comprises the following steps: if the number of the listening and speaking ends exceeds the preset display upper limit of the auxiliary display area, synchronously displaying the figure video data and the desktop video data of the main speaking end in the main display area; the listening and speaking terminals are grouped according to the preset display upper limit, and the listening and speaking terminals are synchronously displayed in the auxiliary display area according to the grouping in turn at intervals of preset polling time;
and if the number of the listening and speaking ends does not exceed the preset display upper limit of the auxiliary display area, synchronously displaying the character video data and the desktop video data of the main speaking end in the main display area, and synchronously displaying the character video data and the desktop video data of the listening and speaking end in the auxiliary display area.
8. Many parties on-line learning customer end based on two cameras, its characterized in that is the main terminal of speaking or the end of listening and speaking, includes:
the system comprises a control unit, a first camera, a second camera, an audio acquisition device, a client communication module, an audio output device and a display device, wherein the first camera is used for acquiring character video data, the second camera is used for acquiring desktop video data, the audio acquisition device is used for acquiring audio data, and the client communication module, the audio output device and the display device are used for communicating with a server;
the client communication module is used for sending the character video data, the desktop video data and the audio data to a server; the system comprises a client, a server and a server, wherein the client is used for receiving character video data, desktop video data and audio data acquired by other clients;
the control unit is used for updating the figure video data and the desktop video data of the client to the main display area of the display device for synchronous display if the control signaling for the server to change the distribution of the display areas is the signaling for the main display area on one of the clients; if the control signaling for the server to change the distribution of the display area is the signaling for the main display area on the character video data or the desktop video data of one of the clients, the character video data or the desktop video data of the client is updated to the main display area of the display device for synchronous display.
9. Many parties on-line learning server based on two cameras, its characterized in that includes:
the server communication module is used for receiving multi-path media data sent by at least two clients, wherein the multi-path media data comprise character video data, desktop video data and audio data, and the clients comprise a main speaking end and a listening end; the system comprises a client, a server and a server, wherein the client is used for acquiring multi-channel media data from the server; the control signaling is used for receiving the control signaling from the main speaking end;
the processing unit is used for distributing display areas for the character video data and the desktop video data from the clients according to a preset mode, and the display areas comprise a main display area and an auxiliary display area; the display area is also used for changing the distribution of the display area according to the control signaling of the main speaking end;
the server communication module is connected with the processing unit.
10. The dual-camera based multiparty online learning server of claim 9, comprising:
the processing unit is also used for judging whether the number of the listening and speaking ends exceeds the preset display upper limit of the auxiliary display area; if the number of the characters exceeds the preset number, distributing display areas for the character video data and the desktop video data from the clients according to a preset mode, wherein the display areas comprise: distributing the character video data and the desktop video data of the main speaking end to a main display area; grouping the listening and speaking ends according to the preset display upper limit, and alternately distributing the listening and speaking ends to the auxiliary display area according to the grouping at intervals of preset polling time;
if the number of the characters does not exceed the preset number, distributing display areas for the character video data and the desktop video data from the clients according to a preset mode, wherein the display areas comprise: and distributing the character video data and the desktop video data of the main speaking end to the main display area, and distributing the character video data and the desktop video data of the listening and speaking end to the auxiliary display area.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202010963002.6A CN112272283A (en) | 2020-09-14 | 2020-09-14 | Multi-party online learning method based on double cameras, client and server |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202010963002.6A CN112272283A (en) | 2020-09-14 | 2020-09-14 | Multi-party online learning method based on double cameras, client and server |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN112272283A true CN112272283A (en) | 2021-01-26 |
Family
ID=74349981
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202010963002.6A Pending CN112272283A (en) | 2020-09-14 | 2020-09-14 | Multi-party online learning method based on double cameras, client and server |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN112272283A (en) |
Cited By (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN114374682A (en) * | 2022-01-07 | 2022-04-19 | 深圳看到科技有限公司 | Data sharing method and system, storage medium and terminal equipment |
Citations (8)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20050021805A1 (en) * | 2001-10-01 | 2005-01-27 | Gianluca De Petris | System and method for transmitting multimedia information streams, for instance for remote teaching |
| JP2014102664A (en) * | 2012-11-20 | 2014-06-05 | Talkie System Co Ltd | Content creation, recording, reproduction system |
| CN105447795A (en) * | 2015-12-31 | 2016-03-30 | 米科互动教育科技（北京）有限公司 | Online curriculum processing method and device |
| CN106454200A (en) * | 2016-08-10 | 2017-02-22 | 惠州紫旭科技有限公司 | Video interaction method and video interaction system based on scene switching |
| CN207115790U (en) * | 2017-05-02 | 2018-03-16 | 刘明珠 | A kind of English-Assisted Instruction system |
| WO2018095174A1 (en) * | 2016-11-22 | 2018-05-31 | 广州华多网络科技有限公司 | Control method, device, and terminal apparatus for synthesizing video stream of live streaming room |
| CN110213609A (en) * | 2019-06-12 | 2019-09-06 | 珠海读书郎网络教育有限公司 | The method, apparatus and storage medium of the company of progress wheat live streaming in Web education live streaming |
| CN111182250A (en) * | 2019-11-29 | 2020-05-19 | 安徽文香信息技术有限公司 | Audio and video teaching recording and playing system and control method thereof |
-
2020
- 2020-09-14 CN CN202010963002.6A patent/CN112272283A/en active Pending
Patent Citations (8)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20050021805A1 (en) * | 2001-10-01 | 2005-01-27 | Gianluca De Petris | System and method for transmitting multimedia information streams, for instance for remote teaching |
| JP2014102664A (en) * | 2012-11-20 | 2014-06-05 | Talkie System Co Ltd | Content creation, recording, reproduction system |
| CN105447795A (en) * | 2015-12-31 | 2016-03-30 | 米科互动教育科技（北京）有限公司 | Online curriculum processing method and device |
| CN106454200A (en) * | 2016-08-10 | 2017-02-22 | 惠州紫旭科技有限公司 | Video interaction method and video interaction system based on scene switching |
| WO2018095174A1 (en) * | 2016-11-22 | 2018-05-31 | 广州华多网络科技有限公司 | Control method, device, and terminal apparatus for synthesizing video stream of live streaming room |
| CN207115790U (en) * | 2017-05-02 | 2018-03-16 | 刘明珠 | A kind of English-Assisted Instruction system |
| CN110213609A (en) * | 2019-06-12 | 2019-09-06 | 珠海读书郎网络教育有限公司 | The method, apparatus and storage medium of the company of progress wheat live streaming in Web education live streaming |
| CN111182250A (en) * | 2019-11-29 | 2020-05-19 | 安徽文香信息技术有限公司 | Audio and video teaching recording and playing system and control method thereof |
Cited By (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN114374682A (en) * | 2022-01-07 | 2022-04-19 | 深圳看到科技有限公司 | Data sharing method and system, storage medium and terminal equipment |
| CN114374682B (en) * | 2022-01-07 | 2023-03-28 | 深圳看到科技有限公司 | Data sharing method and system, storage medium and terminal equipment |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN110213609B (en) | Method, device and storage medium for live broadcast of online education | |
| CN102460487B (en) | The system and method for mixing course teaching | |
| CN104539983B (en) | Online class management system and method | |
| CN211578106U (en) | Remote teaching system and platform based on mobile internet | |
| CN112581814B (en) | Method for realizing interactive live broadcast classroom | |
| WO2015089888A1 (en) | Interactive teaching method between teachers and students based on panoramic learning system platform | |
| CN207115790U (en) | A kind of English-Assisted Instruction system | |
| CN108573624A (en) | A kind of e-classroom tutoring system | |
| KR20100060289A (en) | System and method for lecturing interactively in on-line | |
| RU126492U1 (en) | COMPREHENSIVE SYSTEM OF REMOTE LEARNING AND VIDEO CONFERENCE COMMUNICATION | |
| CN112272283A (en) | Multi-party online learning method based on double cameras, client and server | |
| CN203813877U (en) | Extensible dual-stream video sharing system | |
| CN103531049A (en) | Remote synchronous interactive network teaching platform | |
| CN205486925U (en) | Information -based video teaching system | |
| US20240155012A1 (en) | Web-based video conferencing system and method | |
| CN105139704A (en) | Internet remote teaching system | |
| Smyth et al. | Internet-Based Videoconferencing for Teaching and Learning. | |
| Klein | Teleteaching scenarios for high bandwidth networks | |
| CN213458491U (en) | Fusion interactive classroom teaching management system | |
| CN206907261U (en) | A kind of smart cloud teaching platform management system | |
| He et al. | study on the integrative practice of university teaching space and information platform——taking Xi’an Eurasia University as an example | |
| CN104952303A (en) | Classroom live broadcast system | |
| CN214202723U (en) | Remote synchronous virtual classroom | |
| KR100451957B1 (en) | A Real-Time Remote Education System Using Intercommunication | |
| Baimagambetova | Zoom platform for online training |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| RJ01 | Rejection of invention patent application after publication |
Application publication date: 20210126 |
|
| RJ01 | Rejection of invention patent application after publication |