CN111770301B - Video conference data processing method and device - Google Patents
Video conference data processing method and device Download PDFInfo
- Publication number
- CN111770301B CN111770301B CN202010684009.4A CN202010684009A CN111770301B CN 111770301 B CN111770301 B CN 111770301B CN 202010684009 A CN202010684009 A CN 202010684009A CN 111770301 B CN111770301 B CN 111770301B
- Authority
- CN
- China
- Prior art keywords
- video
- video data
- data
- conference
- participating users
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
- 238000003672 processing method Methods 0.000 title abstract description 17
- 238000000034 method Methods 0.000 claims abstract description 82
- 238000012545 processing Methods 0.000 claims abstract description 43
- 238000012795 verification Methods 0.000 claims description 10
- 230000004044 response Effects 0.000 claims description 5
- 230000000903 blocking effect Effects 0.000 claims description 3
- 230000005540 biological transmission Effects 0.000 abstract description 9
- 230000008569 process Effects 0.000 description 13
- 238000010586 diagram Methods 0.000 description 10
- 238000004590 computer program Methods 0.000 description 5
- 230000000694 effects Effects 0.000 description 5
- 230000003993 interaction Effects 0.000 description 5
- 230000004048 modification Effects 0.000 description 4
- 238000012986 modification Methods 0.000 description 4
- 230000009471 action Effects 0.000 description 3
- 230000008878 coupling Effects 0.000 description 3
- 238000010168 coupling process Methods 0.000 description 3
- 238000005859 coupling reaction Methods 0.000 description 3
- 238000013475 authorization Methods 0.000 description 2
- 238000004891 communication Methods 0.000 description 2
- 238000000354 decomposition reaction Methods 0.000 description 2
- 238000005516 engineering process Methods 0.000 description 2
- 230000006872 improvement Effects 0.000 description 2
- 238000003491 array Methods 0.000 description 1
- 230000009286 beneficial effect Effects 0.000 description 1
- 230000007812 deficiency Effects 0.000 description 1
- 238000011161 development Methods 0.000 description 1
- 235000019800 disodium phosphate Nutrition 0.000 description 1
- 230000003287 optical effect Effects 0.000 description 1
Images
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N7/00—Television systems
- H04N7/14—Systems for two-way working
- H04N7/15—Conference systems
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/20—Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
- H04N21/23—Processing of content or additional data; Elementary server operations; Server middleware
- H04N21/234—Processing of video elementary streams, e.g. splicing of video streams or manipulating encoded video stream scene graphs
- H04N21/2347—Processing of video elementary streams, e.g. splicing of video streams or manipulating encoded video stream scene graphs involving video stream encryption
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
- H04N21/44—Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream or rendering scenes according to encoded video stream scene graphs
- H04N21/4405—Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream or rendering scenes according to encoded video stream scene graphs involving video stream decryption
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N7/00—Television systems
- H04N7/14—Systems for two-way working
- H04N7/15—Conference systems
- H04N7/155—Conference systems involving storage of or access to video conference sessions
Landscapes
- Engineering & Computer Science (AREA)
- Multimedia (AREA)
- Signal Processing (AREA)
- Two-Way Televisions, Distribution Of Moving Picture Or The Like (AREA)
- Telephonic Communication Services (AREA)
Abstract
The application provides a video conference data processing method and device, and relates to the technical field of video conferences. Wherein, the method can comprise the following steps: receiving an indication message sent by a target client, wherein the indication message is used for indicating a video traffic mode of other participating users to be received, and the video traffic mode comprises the following steps: a small flow mode and a large flow mode; processing the video data of other participating users into data corresponding to the video flow mode according to the indication message, and acquiring the processed video data; and sending the processed video data to the target client. By applying the embodiment of the application, less transmission space can be occupied by the video data in the transmission process, and the number of the participating users in the video conference can be increased.
Description
Technical Field
The present application relates to the technical field of video conferences, and in particular, to a method and an apparatus for processing video conference data.
Background
With the development of intelligent terminals and the internet, audio and video transmission becomes clearer and clearer, and accordingly, video conferences become current hotspots. For the leaders of a plurality of companies or the employees who often go out, the video conference can start a conference anytime and anywhere, so that the participants in different spaces can meet in a virtual conference room.
At present, when video images corresponding to other participating users are displayed on a target client, a video conference server sends all video flow modes (a small flow mode and a large flow mode) of the other participating users to the target client, and the target client solves video data corresponding to the video flow modes according to the requirements of the participating users.
However, the video conference server sends all the video traffic modes of other participating users to the target client, so that the transmission space of video data is occupied, and the number of the participating users in the video conference is limited.
Disclosure of Invention
The present application aims to provide a method and an apparatus for processing video data streams, which can increase the number of participating users in a video conference, in view of the above-mentioned deficiencies in the prior art.
In order to achieve the above purpose, the technical solutions adopted in the embodiments of the present application are as follows:
in a first aspect, an embodiment of the present application provides a method for processing videoconference data, where the method includes:
receiving an indication message sent by a target conference client, wherein the indication message is used for indicating a video traffic mode of other conference users needing to be received, and the video traffic mode comprises the following steps: a small flow mode and a large flow mode;
processing the video data of other participating users into data corresponding to the video flow mode according to the indication message, and acquiring the processed video data;
and sending the processed video data to the target client.
Optionally, before processing the video data of the other participating users into data corresponding to the video traffic manner according to the indication message and acquiring the processed video data, the method further includes:
and decomposing the audio and video corresponding to other participating users into audio data and video data, and marking corresponding user identifications on the audio data and the video data.
Optionally, the method further comprises:
and sending the audio data corresponding to the other participating users to the target client.
Optionally, before sending the processed video data to the target client, the method further includes:
and quantum encryption is carried out on the video data to obtain the encrypted video data.
Optionally, before receiving the indication message sent by the target participating client, the method further includes:
receiving conference entrance information sent by clients corresponding to the participating users, wherein the conference entrance information comprises: user identification and a conference-entering password;
and when the conference information is successfully verified, adding the conference user corresponding to the client into the corresponding conference room.
In a second aspect, an embodiment of the present application provides a method for processing videoconference data, where the method includes:
sending an indication message to a server, wherein the indication message is used for indicating a video traffic mode of other participating users to be received, and the video traffic mode comprises: a small flow mode and a large flow mode;
and receiving the processed video data sent by the server according to the indication message.
Optionally, the method further comprises:
and receiving the audio data corresponding to the other participating users sent by the server.
Optionally, the video data is quantum encrypted; after receiving the processed video data sent by the server according to the indication message, the method further includes:
requesting, by a vector servant, to validate the video data;
and decoding the video data after receiving the verification response of the quantum server.
Optionally, after receiving the processed video data sent by the server according to the indication message, the method further includes:
and playing the video data according to the display mode corresponding to the video flow mode of the video data.
In a third aspect, an embodiment of the present application provides an apparatus for processing videoconference data, where the apparatus includes:
a first receiving module, configured to receive an indication message sent by a target participating client, where the indication message is used to indicate a video traffic manner of other participating users that needs to be received, and the video traffic manner includes: a small flow mode and a large flow mode;
the acquisition module is used for processing the video data of other participating users into data corresponding to the video flow mode according to the indication message and acquiring the processed video data;
and the first sending module is used for sending the processed video data to the target client.
Optionally, before the obtaining module, the method further includes:
and the decomposition module is used for decomposing the audios and videos corresponding to other participating users into audio data and video data, and marking corresponding user identifications on the audio data and the video data.
Optionally, the first sending module is further configured to send the audio data corresponding to the other participating users to the target client.
Optionally, before the first sending module, the method further includes:
and the quantum encryption module is used for carrying out quantum encryption on the video data to obtain the encrypted video data.
Optionally, before the first receiving module, the method further includes:
a third receiving module, configured to receive conference entry information sent by a client corresponding to each participating user, where the conference entry information includes: user identification and a conference-entering password;
and the joining module is used for joining the conference users corresponding to the client into the corresponding conference rooms after the conference joining information is verified successfully.
In a fourth aspect, an embodiment of the present application provides an apparatus for processing videoconference data, where the apparatus includes:
a second sending module, configured to send an indication message to a server, where the indication message is used to indicate a video traffic manner of other participating users that needs to be received, where the video traffic manner includes: a small flow mode and a large flow mode;
and the second receiving module is used for receiving the processed video data sent by the server according to the indication message.
Optionally, the second receiving module is further configured to receive the audio data sent by the server and corresponding to the other participating users.
Optionally, the video data is quantum encrypted; correspondingly, before the second receiving module, the apparatus further includes:
the request module is used for requesting the verification of the video data to the vector sub server;
and the decoding module is used for decoding the video data after receiving the verification response of the quantum server.
Optionally, after the second receiving module, the apparatus further includes:
and the playing module is used for playing the video data according to the display mode corresponding to the video flow mode of the video data.
In a fifth aspect, an embodiment of the present application provides an electronic device, including: a processor, a storage medium and a bus, the storage medium storing machine-readable instructions executable by the processor, the processor and the storage medium communicating via the bus when the electronic device is operating, the processor executing the machine-readable instructions to perform the steps of the method for processing videoconference data according to the first or second aspect.
In a sixth aspect, an embodiment of the present application provides a storage medium, where a computer program is stored on the storage medium, and the computer program is executed by a processor to perform the steps of the processing method for video conference data according to the first aspect or the second aspect.
The invention has the beneficial effects that:
the embodiment of the application provides a method and a device for processing video conference data, wherein the method can comprise the following steps: receiving an indication message sent by a target client, wherein the indication message is used for indicating a video traffic mode of other participating users to be received, and the video traffic mode comprises the following steps: a small flow mode and a large flow mode; processing the video data of other participating users into data corresponding to the video flow mode according to the indication message, and acquiring the processed video data; and sending the processed video data to the target client. By adopting the method for processing the video conference data provided by the embodiment of the application, the server can process the acquired video data of other conference participating users into the video data of the video traffic mode matched with the requirement of the target client according to the requirement (video traffic mode) of the target client, and then send the video data of the matched video traffic mode to the target client. That is to say, the server only sends the small video flow mode or the large video flow mode of some other participating user to the target client, so that the video data can occupy less transmission space in the transmission process, and the number of participating users in the video conference can be increased.
Drawings
In order to more clearly illustrate the technical solutions of the embodiments of the present application, the drawings that are required to be used in the embodiments will be briefly described below, it should be understood that the following drawings only illustrate some embodiments of the present application and therefore should not be considered as limiting the scope, and for those skilled in the art, other related drawings can be obtained from the drawings without inventive effort.
Fig. 1 is a schematic flowchart of a method for processing videoconference data according to embodiments of the present application;
fig. 2 is a schematic flowchart of another video conference data processing method according to an embodiment of the present application;
fig. 3 is a schematic flowchart of another video conference data processing method according to an embodiment of the present application;
fig. 4 is a schematic flowchart of another video conference data processing method according to an embodiment of the present application;
fig. 5 is a schematic flowchart of another video conference data processing method according to an embodiment of the present application;
fig. 6 is a schematic flowchart of another video conference data processing method according to an embodiment of the present application;
fig. 7 is a schematic flowchart of another video conference data processing method according to an embodiment of the present application;
fig. 8 is a schematic flowchart of another video conference data processing method according to an embodiment of the present application;
fig. 9 is a schematic structural diagram of a video conference data processing apparatus according to an embodiment of the present application;
fig. 10 is a schematic structural diagram of another video conference data processing apparatus according to an embodiment of the present application;
fig. 11 is a schematic structural diagram of another video conference data processing apparatus according to an embodiment of the present application;
fig. 12 is a schematic structural diagram of another video conference data processing apparatus according to an embodiment of the present application;
fig. 13 is a schematic structural diagram of an electronic device according to an embodiment of the present application.
Detailed Description
In order to make the objects, technical solutions and advantages of the embodiments of the present application clearer, the technical solutions in the embodiments of the present application will be clearly and completely described below with reference to the drawings in the embodiments of the present application, and it is obvious that the described embodiments are some embodiments of the present application, but not all embodiments. The components of the embodiments of the present application, generally described and illustrated in the figures herein, can be arranged and designed in a wide variety of different configurations.
Thus, the following detailed description of the embodiments of the present application, presented in the accompanying drawings, is not intended to limit the scope of the claimed application, but is merely representative of selected embodiments of the application. All other embodiments, which can be derived by a person skilled in the art from the embodiments given herein without making any creative effort, shall fall within the protection scope of the present application.
It should be noted that: like reference numbers and letters refer to like items in the following figures, and thus, once an item is defined in one figure, it need not be further defined and explained in subsequent figures.
Fig. 1 is a flowchart illustrating a method for processing videoconference data according to an embodiment of the present disclosure, where an execution subject of the method may be a server that performs data interaction with a target client, and the target client may be a mobile terminal (e.g., a mobile phone, a tablet computer, etc.), a fixed terminal (e.g., a desktop computer), or another type of terminal, which is not limited herein. As shown in fig. 1, the method may include:
s101, receiving an indication message sent by a target client.
The indication message is used for indicating a video traffic mode of other participating users to be received, and the video traffic mode includes: a small flow mode and a large flow mode. The small flow mode and the large flow mode can be defined by image resolution, code rate and frame rate, wherein the image resolution represents the number of pixels of one picture; the code rate represents the number of data bits transmitted per unit time during video data transmission, and the unit is kbps, namely kilobits per second; the frame rate indicates the number of picture frames transmitted in 1 second time.
In general, the small traffic mode is defined almost the same regardless of the type of the target client (e.g., the target client is a desktop computer or a mobile terminal), for example, the video traffic mode adopted by video data with a video image resolution of (320 × 180), a bit rate of 200Kbps and a frame rate of 25 can be expressed as the small traffic mode; the high traffic mode definition is related to the type of the target client, for example, when the target client is a desktop computer, the video traffic mode adopted by the video data with the video image resolution of (1920 × 1080), the bitrate of 1024Kbps and the frame rate of 25 can be expressed as the high traffic mode, and when the target client is a mobile terminal (mobile phone), the video traffic mode adopted by the video data with the video image resolution of (960 × 540), the bitrate of 800Kbps and the frame rate of 25 can also be expressed as the high traffic mode. The present application does not limit the specific definition of the low flow rate mode and the high flow rate mode, and may set the modes according to actual requirements.
Specifically, in a video conference scene, when the video display interface on the target client needs to display the video images of other participating users, the video images of the other participating users can be respectively displayed in the main area and the sub area of the video display interface of the target client. The conference users corresponding to the target client can operate on the video display interface, the video image windows of other conference users needing to be displayed in the main area are selected to be the main area, and the video image windows of other conference users needing to be displayed in the secondary area are selected to be the secondary area.
Further, the difference of the areas also represents the difference of the video flow modes for displaying the video images, and generally, the video flow modes can be divided into a small video flow mode (small flow mode) and a large video flow mode (large flow mode), wherein the video image window adopting the small video flow mode can be displayed in the main area, and the video image window adopting the large video flow mode can be displayed in the main area. The operation instruction (indication message) of the target client corresponding to the participating user can be transmitted to the server in real time, and the server can respond to the operation instruction.
And S102, processing the video data of other participating users into data corresponding to the video flow mode according to the indication message, and acquiring the processed video data.
Specifically, the client performing data interaction with the server includes, in addition to the target client, other clients performing interaction with the client, and the server may process video data sent by each corresponding other client according to the indication message sent by the target client. The specific processing principle is that the indication message includes the area position displayed on the target client video display interface by the participating user corresponding to each other client. That is, the server may convert the received video data of the other participating users into data corresponding to the video traffic manner in the content of the indication message according to the corresponding relationship between the video traffic manner and the other participating users, which is equivalent to knowing the video traffic manner of each other participating user that needs to be displayed on the video display interface of the target client.
And S103, sending the processed video data to the target client.
Specifically, after converting the video data of the other participating users into the data corresponding to the video traffic mode according to the content of the indication message, the server may compress the processed video data of the other participating users and send the compressed video data to the target client.
For example, the main area on the target client a needs to display the video image of the participating user corresponding to the client B, and the sub-area needs to display the video image of the participating user corresponding to the client C, so that the server needs to process the video data sent by the client B into data corresponding to a large video traffic mode, process the video data sent by the client C into data corresponding to a small video traffic mode, compress the processed video data, and transmit the compressed video data to the target client.
To sum up, in the method for processing video conference data provided by the present application, the server may process the acquired video data of the other participating users into video data of a video traffic manner that matches the demand of the target client according to the demand (video traffic manner) of the target client, and then send the video data of the matched video traffic manner to the target client. That is to say, the server only sends the small video flow mode or the large video flow mode of some other participant user to the target client, so that the video data can occupy less transmission space in the transmission process, and the number of participants in the video conference can be increased.
Fig. 2 is a schematic flowchart of another video conference data processing method according to an embodiment of the present application. Optionally, as shown in fig. 2, before processing the video data of the other participating users into data corresponding to the video traffic manner according to the indication message and acquiring the processed video data, the method further includes:
s201, decomposing the audio and video corresponding to other participating users into audio data and video data, and marking corresponding user identifications on the audio data and the video data.
Specifically, the server may receive audio and video data of participating users corresponding to the clients performing data interaction with the server at the same time, and with respect to a target client, the server may decompose the audio and video of the participating users corresponding to other clients into audio data and video data, and may mark user identifiers corresponding to the audio data and the video data according to objects sent by the audio and video data, that is, the clients, where the user identifier information may include names of the participating users, nicknames and identification cards in a video conference, and may also include other types of identifiers, such as time information and client identifiers, and it should be noted that the application does not limit the types of the identifiers.
Optionally, the method may further include: and sending the audio data corresponding to the other participating users to the target client.
Specifically, the server may send the audio data decomposed from the audio/video data to the target client, and in the sending process, the synchronicity of the audio data and the video data needs to be ensured.
Fig. 3 is a schematic flowchart of another video conference data processing method according to an embodiment of the present application. Optionally, as shown in fig. 3, before the sending the processed video data to the target client, the method further includes:
s301, quantum encryption is carried out on the video data, and the encrypted video data are obtained.
Specifically, the server may store a quantum key in advance, the quantum key may be stored in the quantum server specifically, and after the server processes the video data of the other participating users into video data corresponding to the video traffic mode, the quantum key stored in advance in the quantum server may be used to perform quantum encryption on the video data of the other participating users respectively, and compress and send the encrypted video data of the other participating users to the target client.
Fig. 4 is a schematic flowchart of another video conference data processing method according to an embodiment of the present application. Optionally, before receiving the indication message sent by the target participating client, the method further includes:
s401, receiving conference entrance information sent by the client corresponding to each conference participating user.
Wherein, the conference information comprises: user identification, and a conference password. Specifically, before a video conference starts, an organizer is often needed to manage the video conference, the organizer can create the video conference, for example, the organizer can initiate the video conference on a video conference APP or a Web browser, and can set a conference-entering password for entering the video conference at the same time, a background server in the server generates a conference number when receiving an instruction to initiate the video conference, synchronizes the conference number to a streaming media server in the server, and the streaming media server verifies the conference number and generates a corresponding conference room. After the organizer has created the meeting room required for the video conference, the organizer can send its link to the participating users who need to participate in the video conference, or the organizer sends the conference number to the participating users who need to participate in the video conference.
Regardless of the manner in which the participant enters the conference room created by the organizer, the participant enters the conference entry interface with the conference entry interface having the participant enter a conference password in the conference password field, e.g., 123011, and a user identification in the user identification field, e.g., Zhang III. The client corresponding to each participating user can send the input information to the server, and the server can respond to the input information.
And S402, when the conference information is successfully verified, adding the conference user corresponding to the client into the corresponding conference room.
Specifically, a background server in the server directly verifies conference entering information sent by a client, if the conference entering information sent by the client is matched with the conference entering information pre-stored in a database, which is equivalent to successful verification of a conference participating user corresponding to the client, a verification success message can be sent to a streaming media server in the server, and the streaming media server can directly add the conference participating user corresponding to the client into a corresponding conference room. After the conference user corresponding to the client joins the conference room, the streaming media server may send the audio data acquired by the acquisition device (camera and microphone) on the client to other clients in the same conference room.
In another practical embodiment, after the server first verifies the conference joining information sent by the client successfully, the server may send the verification success information to the client corresponding to the organizer, and the organizer determines whether the conference joining user corresponding to the client can enter the corresponding conference room. Assuming that the organizer agrees that the participating user corresponding to the client enters the corresponding conference room, the streaming media server in the server can join the participating user corresponding to the client into the corresponding conference room after receiving an agreement instruction sent by the client corresponding to the organizer. And the organizer can decide whether to move the participating user out of the conference room according to the behavior of the participating user who is participating. If for a particularly confidential video conference, the organizer may set the video conference to a locked state after a period of time.
That is, in the video conference in the locked state, any participating user cannot enter the conference room corresponding to the video conference. The security of the video conference can be improved through the setting of the conference access password, the authority set by the organizer and the locking state, and the phenomenon that the conference content leaks is avoided.
Fig. 5 is a flowchart of another method for processing videoconference data according to an embodiment of the present disclosure, where an execution subject of the method may be a target client performing data interaction with a server, where the target client may be a mobile terminal (e.g., a mobile phone, a tablet computer, etc.), a fixed terminal (e.g., a desktop computer), or another type of terminal, and the present disclosure is not limited herein, and as shown in fig. 5, the method may include:
s501, an indication message is sent to a server.
The indication message is used for indicating a video traffic mode of other participating users to be received, and the video traffic mode includes: a small flow mode and a large flow mode. Specifically, after receiving the operation instruction of the participating user, the target client may send the operation instruction (instruction message) to the server. The operation instruction may include selecting which video image windows of other participants are in the area corresponding to the large flow mode, and selecting which video image windows of other participants are in the area corresponding to the small flow mode.
And S502, receiving the processed video data sent by the server according to the indication message.
Specifically, after receiving the instruction information, the server may process video data of other participating users, and send the processed video data to the target client, which may be referred to the foregoing related parts, and details of this part are not described herein again.
Optionally, the method may further include: and receiving audio data corresponding to other participating users sent by the server.
Specifically, the target client can receive the audio data with the identifier sent by the server, the audio data comprises audio data streams corresponding to other participating users, the number of people is limited according to preset audio playing and the identifier information, the audio data meeting the preset requirement is decoded, the target client plays the sound of the corresponding participating users, and the audio data not meeting the preset requirement is subjected to blocking processing. According to the actual survey, the preset audio playing limit number can be set to 4, that is, in general, at most 4 participating users speak in the same time period in the video conference, and the identification information can be time identification information, that is, the time when the participating users start speaking. When the decoded 4-bit participant users stop speaking, the audio data of the participant user who speaks first can be decoded according to the time identification information. The mode can further enable the video conference to accommodate more conference users, and can also enable the sound in the conference room not to be noisy.
Fig. 6 is a schematic flowchart of another video conference data processing method according to an embodiment of the present application. Alternatively, as shown in fig. 6, the video data employs quantum encryption; after receiving the processed video data sent by the server according to the indication message, the method further includes:
s601, the vector servant requests to verify the video data.
And S602, after receiving the verification response of the quantum server, decoding the video data.
Specifically, if the video data adopts a quantum encryption technology, before video images of other participating users are displayed on a target client, the target client first needs to send identity authentication information to a quantum server in a server through a quantum channel, the quantum server judges whether the target client is subjected to quantum identity authorization according to the identity authentication information, and if the quantum server judges that the target client is not subjected to quantum identity authorization, the target terminal cannot decode the video data into a corresponding video image and display the video image on a video display interface of the target terminal; if the quantum server judges that the target client is authorized by the quantum identity, the target terminal can decode the video data into a corresponding video image and display the video image on a video display interface of the target terminal. That is to say, the content of the video conference can be further protected by the quantum encryption technology, and the content of the video conference is prevented from being acquired by an illegal terminal.
Fig. 7 is a schematic flowchart of another video conference data processing method according to an embodiment of the present application. Optionally, as shown in fig. 7, after receiving the processed video data sent by the server according to the indication message, the method further includes:
and S701, playing the video data according to the display mode corresponding to the video flow mode of the video data.
Specifically, the video display interface of the target client may be divided into a large window area and a small window area according to a video flow mode, where the video flow mode corresponding to the large window area is a large flow mode, and the video flow mode corresponding to the small window area is a small flow mode. When the video flow mode corresponding to the video data sent by the server is a large flow mode, the video of the participant user corresponding to the video data can be played in the large window area; and when the video flow mode corresponding to the video data sent by the server is a small flow mode, the video of the participating user corresponding to the video data can be played in the small window area.
Fig. 8 is a schematic flowchart of another video conference data processing method according to an embodiment of the present application. Optionally, as shown in fig. 8, the method includes:
s801, the target client sends an indication message to the server.
And S803, the server processes the video data of other participating users into data corresponding to the video flow mode according to the indication message, and acquires the processed video data.
S804, the server sends the processed video data to the target client.
For the details of the method, reference may be made to the relevant portions of the foregoing method embodiments, and details are not repeated herein.
Fig. 9 is a schematic structural diagram of a video conference data processing apparatus according to an embodiment of the present application, the basic principle and the technical effects of the apparatus are the same as those of the foregoing corresponding method embodiment, and for brief description, reference may be made to corresponding contents in the method embodiment for a part not mentioned in this embodiment. As shown in fig. 9, the apparatus may include:
a first receiving module 901, configured to receive an indication message sent by a target client;
an obtaining module 902, configured to process video data of other participating users into data corresponding to the video traffic manner according to the indication message, and obtain the processed video data;
a first sending module 903, configured to send the processed video data to the target client.
Fig. 10 is a schematic structural diagram of another video conference data processing apparatus according to an embodiment of the present application. As shown in fig. 10, the apparatus further includes:
the decomposition module 1001 is configured to decompose the audio and video corresponding to other participating users into audio data and video data, and mark corresponding user identifiers on the audio data and the video data.
Optionally, the first sending module 903 is further configured to send audio data corresponding to other participating users to the target client.
Fig. 11 is a schematic structural diagram of another video conference data processing apparatus according to an embodiment of the present application. As shown in fig. 11, the apparatus further includes:
the quantum encryption module 1101 is configured to perform quantum encryption on the video data to obtain encrypted video data.
Optionally, before the first receiving module 901, the method further includes: the third receiving module is used for receiving the conference entering information sent by the client corresponding to each conference participating user; and the joining module is used for joining the participating user corresponding to the client into the corresponding conference room after the conference joining information is successfully verified.
Fig. 12 is a schematic structural diagram of another video conference data processing apparatus according to an embodiment of the present application, the basic principle and the technical effect of the apparatus are the same as those of the corresponding method embodiment, and for brief description, reference may be made to corresponding contents in the method embodiment for a part not mentioned in this embodiment. As shown in fig. 12, the apparatus may include:
a second sending module 1201, configured to send an indication message to the server;
a second receiving module 1202, configured to receive the processed video data sent by the server according to the indication message.
Optionally, the second receiving module 1202 is further configured to receive audio data sent by the server and corresponding to other participating users.
Optionally, the video data is encrypted by quantum, and accordingly, the apparatus further includes:
the request module is used for requesting the verification of the video data to the vector sub server;
and the decoding module is used for decoding the video data after receiving the verification response of the quantum server.
Optionally, the apparatus may further include:
and the playing module is used for playing the video data according to the display mode corresponding to the video flow mode of the video data.
The above-mentioned apparatus is used for executing the method provided by the foregoing embodiment, and the implementation principle and technical effect are similar, which are not described herein again.
These above modules may be one or more integrated circuits configured to implement the above methods, such as: one or more Application Specific Integrated Circuits (ASICs), or one or more microprocessors (DSPs), or one or more Field Programmable Gate Arrays (FPGAs), among others. For another example, when one of the above modules is implemented in the form of a Processing element scheduler code, the Processing element may be a general-purpose processor, such as a Central Processing Unit (CPU) or other processor capable of calling program code. For another example, these modules may be integrated together and implemented in the form of a system-on-a-chip (SOC).
Fig. 13 is a schematic structural diagram of an electronic device according to an embodiment of the present application, where the electronic device may be a server or a target client. If the electronic device is a server, the steps of the methods of fig. 1-4 may be executed; if the electronic device is the target client, the steps of the methods of fig. 5-7 may be performed. As shown in fig. 13, the electronic device may include: the electronic device comprises a processor 1301, a storage medium 1302 and a bus 1303, wherein the storage medium 1302 stores machine-readable instructions executable by the processor 1301, when the electronic device runs, the processor 1301 and the storage medium 1302 communicate with each other through the bus 1303, and the processor 1301 executes the machine-readable instructions to execute the steps of the above method embodiments. The specific implementation and technical effects are similar, and are not described herein again.
Optionally, the present application further provides a storage medium, on which a computer program is stored, and when the computer program is executed by a processor, the computer program performs the steps of the above method embodiments. The specific implementation and technical effects are similar, and are not described herein again.
In the several embodiments provided in the present application, it should be understood that the disclosed apparatus and method may be implemented in other ways. For example, the above-described apparatus embodiments are merely illustrative, and for example, the division of the units is only one logical division, and other divisions may be realized in practice, for example, a plurality of units or components may be combined or integrated into another system, or some features may be omitted, or not executed. In addition, the shown or discussed mutual coupling or direct coupling or communication connection may be an indirect coupling or communication connection through some interfaces, devices or units, and may be in an electrical, mechanical or other form.
The units described as separate parts may or may not be physically separate, and parts displayed as units may or may not be physical units, may be located in one place, or may be distributed on a plurality of network units. Some or all of the units can be selected according to actual needs to achieve the purpose of the solution of the embodiment.
In addition, functional units in the embodiments of the present application may be integrated into one processing unit, or each unit may exist alone physically, or two or more units are integrated into one unit. The integrated unit can be realized in a form of hardware, or in a form of hardware plus a software functional unit.
The integrated unit implemented in the form of a software functional unit may be stored in a computer readable storage medium. The software functional unit is stored in a storage medium and includes several instructions for enabling a computer device (which may be a personal computer, a server, or a network device) or a processor (processor) to perform some steps of the methods according to the embodiments of the present application. And the aforementioned storage medium includes: a U disk, a removable hard disk, a Read-Only Memory (ROM), a Random Access Memory (RAM), a magnetic disk or an optical disk, and other various media capable of storing program codes.
It is noted that, in this document, relational terms such as "first" and "second," and the like, may be used solely to distinguish one entity or action from another entity or action without necessarily requiring or implying any actual such relationship or order between such entities or actions. Also, the terms "comprises," "comprising," or any other variation thereof, are intended to cover a non-exclusive inclusion, such that a process, method, article, or apparatus that comprises a list of elements does not include only those elements but may include other elements not expressly listed or inherent to such process, method, article, or apparatus. Without further limitation, an element defined by the phrase "comprising an … …" does not exclude the presence of other identical elements in a process, method, article, or apparatus that comprises the element.
The above description is only a preferred embodiment of the present application and is not intended to limit the present application, and various modifications and changes may be made by those skilled in the art. Any modification, equivalent replacement, improvement and the like made within the spirit and principle of the present application shall be included in the protection scope of the present application. It should be noted that: like reference numbers and letters refer to like items in the following figures, and thus, once an item is defined in one figure, it need not be further defined and explained in subsequent figures. The above description is only a preferred embodiment of the present application and is not intended to limit the present application, and various modifications and changes may be made by those skilled in the art. Any modification, equivalent replacement, improvement and the like made within the spirit and principle of the present application shall be included in the protection scope of the present application.
Claims (8)
1. A method for processing videoconference data, the method comprising:
receiving an indication message sent by a target client, wherein the indication message is used for indicating a video traffic mode of other meeting participating users to be received, and the video traffic mode comprises: a small flow mode and a large flow mode;
processing the video data of other participating users into data corresponding to the video flow mode according to the indication message, and acquiring the processed video data;
sending the processed video data to the target client;
the method further comprises the following steps:
and sending the audio data corresponding to other participating users to the target client, so that the target client decodes the audio data meeting the preset requirement according to the preset limited number of the users playing the audio and the identification information, plays the sound of the corresponding participating users, and blocks the audio data not meeting the preset requirement, wherein the identification information is time identification information, namely the time when the participating users start speaking.
2. The method according to claim 1, wherein before processing video data of other participating users into data corresponding to the video traffic manner according to the indication message and acquiring the processed video data, the method further comprises:
and decomposing the audio and video corresponding to other participating users into audio data and video data, and marking corresponding user identifications on the audio data and the video data.
3. The method according to any of claims 1-2, wherein before sending the processed video data to the target client, further comprising:
and quantum encryption is carried out on the video data to obtain the encrypted video data.
4. The method according to claim 1, wherein before receiving the indication message sent by the target participating client, the method further comprises:
receiving conference entrance information sent by clients corresponding to the participating users, wherein the conference entrance information comprises: user identification and a conference-entering password;
and when the conference information is successfully verified, adding the conference user corresponding to the client into the corresponding conference room.
5. A method for processing videoconference data, the method comprising:
sending an indication message to a server, wherein the indication message is used for indicating a video traffic mode of other participating users to be received, and the video traffic mode comprises: a small flow mode and a large flow mode;
receiving processed video data sent by the server according to the indication message, wherein the processed video data are video data which are obtained by processing the video data of the other participating users by the server and correspond to the video flow modes of the other participating users needing to be received;
the method further comprises the following steps:
and receiving audio data corresponding to other conference participating users sent by the server, decoding the audio data meeting the preset requirement according to the preset audio playing limit number and identification information, playing the sound of the corresponding conference participating users, and performing blocking processing on the audio data not meeting the preset requirement, wherein the identification information is time identification information, namely the time when the conference participating users start speaking.
6. The method of claim 5, wherein the video data employs quantum cryptography; after receiving the processed video data sent by the server according to the indication message, the method further includes:
requesting, by a vector servant, to validate the video data;
and decoding the video data after receiving the verification response of the quantum server.
7. The method according to claim 5, wherein after receiving the processed video data sent by the server according to the indication message, further comprising:
and playing the video data according to the display mode corresponding to the video flow mode of the video data.
8. An apparatus for processing videoconference data, the apparatus comprising:
a first receiving module, configured to receive an indication message sent by a target client, where the indication message is used to indicate a video traffic manner of other participating users that needs to be received, and the video traffic manner includes: a small flow mode and a large flow mode;
the acquisition module is used for processing the video data of other participating users into data corresponding to the video flow mode according to the indication message and acquiring the processed video data;
the first sending module is used for sending the processed video data to the target client;
the first sending module is further configured to send audio data corresponding to other conference participating users to the target client, so that the target client decodes the audio data meeting the preset requirement according to the preset limited number of people for audio playing and the identification information, plays the sound of the corresponding conference participating user, and performs blocking processing on the audio data not meeting the preset requirement, where the identification information is time identification information, that is, the time when the conference participating user starts speaking.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202010684009.4A CN111770301B (en) | 2020-07-16 | 2020-07-16 | Video conference data processing method and device |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202010684009.4A CN111770301B (en) | 2020-07-16 | 2020-07-16 | Video conference data processing method and device |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN111770301A CN111770301A (en) | 2020-10-13 |
| CN111770301B true CN111770301B (en) | 2021-12-10 |
Family
ID=72725574
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202010684009.4A Active CN111770301B (en) | 2020-07-16 | 2020-07-16 | Video conference data processing method and device |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN111770301B (en) |
Families Citing this family (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN112383738B (en) * | 2020-11-11 | 2023-03-03 | 浙江讯盟科技有限公司 | Multi-user audio and video conference method and system with low traffic and resource consumption |
Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101365096A (en) * | 2007-08-09 | 2009-02-11 | 华为技术有限公司 | Method for providing video content, related service apparatus and system |
| CN105635797A (en) * | 2015-12-25 | 2016-06-01 | 深圳市路通网络技术有限公司 | Video playing control method, middleware and system |
| CN108400956A (en) * | 2017-02-07 | 2018-08-14 | 阿里巴巴集团控股有限公司 | Distribution method, the device and system of video data stream |
| CN108810575A (en) * | 2017-05-04 | 2018-11-13 | 杭州海康威视数字技术股份有限公司 | A kind of method and apparatus sending target video |
Family Cites Families (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| JP5521414B2 (en) * | 2009-07-08 | 2014-06-11 | 株式会社ナカヨ通信機 | Recording device |
| CN102270456B (en) * | 2010-06-07 | 2012-11-21 | 华为终端有限公司 | Method and device for audio signal mixing processing |
| CN103607556B (en) * | 2013-11-25 | 2017-06-13 | 广东威创视讯科技股份有限公司 | Video conferencing system and its implementation |
| CN105933558B (en) * | 2016-04-25 | 2019-01-04 | 四川联友电讯技术有限公司 | A kind of intelligent shielding and release method of videoconference strong noise participant |
-
2020
- 2020-07-16 CN CN202010684009.4A patent/CN111770301B/en active Active
Patent Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101365096A (en) * | 2007-08-09 | 2009-02-11 | 华为技术有限公司 | Method for providing video content, related service apparatus and system |
| CN105635797A (en) * | 2015-12-25 | 2016-06-01 | 深圳市路通网络技术有限公司 | Video playing control method, middleware and system |
| CN108400956A (en) * | 2017-02-07 | 2018-08-14 | 阿里巴巴集团控股有限公司 | Distribution method, the device and system of video data stream |
| CN108810575A (en) * | 2017-05-04 | 2018-11-13 | 杭州海康威视数字技术股份有限公司 | A kind of method and apparatus sending target video |
Also Published As
| Publication number | Publication date |
|---|---|
| CN111770301A (en) | 2020-10-13 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN111935443B (en) | Method and device for sharing instant messaging tool in real-time live broadcast of video conference | |
| US9888046B2 (en) | Systems, methods and media for identifying and associating user devices with media cues | |
| CN111182169B (en) | Image processing method, image processing device, computer readable medium and electronic equipment | |
| US7184531B2 (en) | System and method for authorizing a party to join a conference | |
| US20090154707A1 (en) | Method and system for distributing group key in video conference system | |
| US20140372517A1 (en) | Systems and Methods for a Video Sharing Social Network | |
| CN107483505B (en) | Method and system for protecting user privacy in video chat | |
| EP3266192A1 (en) | Communication system and method of using the same | |
| CN104883367B (en) | A kind of method, system and applications client that auxiliary verification logs in | |
| CN101356773A (en) | Ad-hoc creation of group based on contextual information | |
| CN111478905B (en) | Communication data acquisition method and device, electronic equipment and storage medium | |
| CN113467674B (en) | Virtual space operation method and device, electronic equipment and storage medium | |
| KR101867326B1 (en) | Method and system for providing social media using partition function | |
| CN112165596A (en) | Monitoring video data transmission method and device, terminal equipment and storage medium | |
| US12028385B2 (en) | Electronic conferencing | |
| JP7236042B2 (en) | Face Recognition Application Using Homomorphic Encryption | |
| CN111770301B (en) | Video conference data processing method and device | |
| EP4260539B1 (en) | Electronic conferencing | |
| EP3148185B1 (en) | Accessing method, system and storage medium for video conference | |
| CN112929353A (en) | Method, device, server and storage medium for realizing teleconference | |
| WO2023141049A1 (en) | Expo floor layout | |
| CN114025192A (en) | Live broadcast data encryption and decryption method and device, storage medium and computer equipment | |
| MX2013004223A (en) | Authenticated broadcast transmission utilizing a content retransmitter. | |
| CN107306385B (en) | Video transmission and verification method based on short message | |
| US20140137148A1 (en) | System for Managing the Streaming and Recording of Audiovisual Data |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| TA01 | Transfer of patent application right | ||
| TA01 | Transfer of patent application right |
Effective date of registration: 20210426 Address after: 100000 B104, 1st floor, building 12, Zhongguancun Software Park, Haidian District, Beijing Applicant after: Beijing Baijia Shilian Technology Co.,Ltd. Address before: No.02, 10th floor, block a, Huaxin headquarters base, no.426, Gaoxin Avenue, Donghu New Technology Development Zone, Wuhan, Hubei Province Applicant before: Wuhan Baijia cloud Technology Co.,Ltd. |
|
| GR01 | Patent grant | ||
| GR01 | Patent grant |