CN111629011B - Instant video communication method, equipment, system and readable storage medium - Google Patents
Instant video communication method, equipment, system and readable storage medium Download PDFInfo
- Publication number
- CN111629011B CN111629011B CN202010737987.0A CN202010737987A CN111629011B CN 111629011 B CN111629011 B CN 111629011B CN 202010737987 A CN202010737987 A CN 202010737987A CN 111629011 B CN111629011 B CN 111629011B
- Authority
- CN
- China
- Prior art keywords
- client
- video
- encryption algorithm
- instant
- server
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
Images
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L65/00—Network arrangements, protocols or services for supporting real-time applications in data packet communication
- H04L65/10—Architectures or entities
- H04L65/1045—Proxies, e.g. for session initiation protocol [SIP]
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L63/00—Network architectures or network communication protocols for network security
- H04L63/08—Network architectures or network communication protocols for network security for authentication of entities
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N7/00—Television systems
- H04N7/14—Systems for two-way working
- H04N7/141—Systems for two-way working between two video terminals, e.g. videophone
Landscapes
- Engineering & Computer Science (AREA)
- Signal Processing (AREA)
- Multimedia (AREA)
- Computer Networks & Wireless Communication (AREA)
- Computer Hardware Design (AREA)
- Computer Security & Cryptography (AREA)
- Computing Systems (AREA)
- General Engineering & Computer Science (AREA)
- Two-Way Televisions, Distribution Of Moving Picture Or The Like (AREA)
- Data Exchanges In Wide-Area Networks (AREA)
Abstract
The invention discloses an instant video communication method, equipment, a system and a readable storage medium, which belong to the technical field of video communication and image processing. By newly establishing the user datagram protocol and the communication agent module, the communication with a plurality of clients can be completed through one gateway monitoring interface of the WebRTC gateway, and processing resources and network resources are saved.
Description
Technical Field
The present invention relates to the field of video communication and image processing technologies, and in particular, to a method, device, system, and readable storage medium for instant video communication.
Background
At present, in a service scene of performing instant video call based on an open-source WebRTC technology, a WebRTC gateway plays a role in performing instant video transfer between terminal users, some open-source WebRTC gateways, such as Janus, microcode and other bottom layers, perform WebRTC-ICE negotiation with a communication terminal by means of an open-source ICE library Libnice, allocate a unique transfer port to each terminal user through negotiation, and perform instant communication with the user through the transfer port.
However, the authentication of the video initiator by the method provided by the prior art is limited to the user name and the password, which may result in the security reduction.
Disclosure of Invention
In order to solve the problems in the prior art, embodiments of the present invention provide an instant video communication method, device, system and readable storage medium. The technical scheme is as follows:
in a first aspect, an instant video communication method is provided, where the method includes:
a client initiates a video communication request to a server, wherein the video communication request at least comprises an instant image of a user;
the server receives and verifies the instant image in the video communication request, and sends gateway monitoring information to the client after the verification is completed;
the client generates a communication check packet according to the gateway monitoring information and sends the communication check packet to the server;
the server distributes and sends user identification and encryption algorithm for video communication to the client;
a user datagram protocol and a communication agent module are newly built in a gateway, wherein an interface of the user datagram protocol is a gateway monitoring interface in gateway monitoring information, and the user datagram protocol is bound with a network address of the client;
the server establishes video communication connection with the client through the communication agent module based on the user datagram protocol;
and the client encrypts the instant video according to the encryption algorithm to generate and send the encrypted instant video to the server.
Optionally, the receiving and verifying the instant image in the video communication request by the server includes:
acquiring an instant image meeting a preset condition from the video;
acquiring feature data of the instant image, wherein the feature data is used for describing a user in the instant image;
and verifying the identity of the user according to the characteristic data.
Optionally, the allocating and sending, by the server, the user identifier and the encryption algorithm for video communication to the client includes:
acquiring network parameters of a communication link between the client and the client;
acquiring an encryption algorithm corresponding to the network parameter;
and sending the encryption algorithm and the user identification to the client.
Optionally, the encrypting, by the client, the instant video according to the encryption algorithm, and generating and sending the encrypted instant video to the server includes:
coding the instant video to generate a coded instant video;
and encrypting the coded instant video according to a preset time interval to generate an encrypted instant video.
In a second aspect, there is provided an instant video communication device, the device comprising:
the receiving module is used for receiving a video communication request sent by a client, wherein the video communication request at least comprises an instant image of a user;
the verification module is used for verifying the instant image in the video communication request and sending the gateway monitoring information to the client after the verification is finished;
the receiving module is further configured to receive a communication check packet generated by the client according to the gateway monitoring information;
the distribution module is used for distributing and sending the user identification and the encryption algorithm for video communication to the client;
the establishing module is used for newly establishing a user datagram protocol and a communication agent module, wherein an interface of the user datagram protocol is a gateway monitoring interface in the gateway monitoring information, and the user datagram protocol is bound with a network address of the client;
the establishing module is also used for establishing video communication connection with the client through the communication agent module based on the user datagram protocol;
and the processing module is used for encrypting the instant video according to the encryption algorithm, generating and sending the encrypted instant video to the server.
Optionally, the verification module is specifically configured to:
acquiring an instant image meeting a preset condition from the video;
acquiring feature data of the instant image, wherein the feature data is used for describing a user in the instant image;
and verifying the identity of the user according to the characteristic data.
Optionally, the allocation module is specifically configured to:
acquiring network parameters of a communication link between the client and the client;
acquiring an encryption algorithm corresponding to the network parameter;
and sending the encryption algorithm and the user identification to the client.
In a third aspect, an instant video communication system is provided, the system includes a client, a gateway and a server, wherein:
the client is used for initiating a video communication request to the server, and the video communication request at least comprises an instant image of a user;
the server is used for receiving and verifying the instant image in the video communication request and sending gateway monitoring information to the client after verification is completed;
the client is also used for generating a communication check packet according to the gateway monitoring information and sending the communication check packet to the server;
the server is also used for distributing and sending the user identification and the encryption algorithm for video communication to the client;
the gateway is used for newly establishing a user datagram protocol and a communication proxy module, wherein an interface of the user datagram protocol is a gateway monitoring interface in the gateway monitoring information, and the user datagram protocol is bound with a network address of the client;
the server is also used for establishing video communication connection with the client through the communication agent module based on the user datagram protocol;
and the client is also used for encrypting the instant video according to the encryption algorithm, generating and sending the encrypted instant video to the server.
Optionally, the server is specifically configured to:
acquiring an instant image meeting a preset condition from the video;
acquiring feature data of the instant image, wherein the feature data is used for describing a user in the instant image;
and verifying the identity of the user according to the characteristic data.
Optionally, the server is specifically configured to:
acquiring network parameters of a communication link between the client and the client;
acquiring an encryption algorithm corresponding to the network parameter;
and sending the encryption algorithm and the user identification to the client.
Optionally, the client is specifically configured to:
coding the instant video to generate a coded instant video;
and encrypting the coded instant video according to a preset time interval to generate an encrypted instant video.
In a fourth aspect, a computer-readable storage medium is provided, said readable storage medium storing a computer program which, when executed by a processor, performs the steps of the method of any one of the first aspect:
the embodiment of the invention provides an instant video communication method, equipment, a system and a readable storage medium, wherein the method comprises the following steps: a client initiates a video communication request to a server; the server receives and verifies the instant image in the video communication request, and sends the gateway monitoring information to the client after the verification is finished; the client side generates a communication check packet according to the gateway monitoring information and sends the communication check packet to the server; the server distributes and sends the user identification and the encryption algorithm for video communication to the client; a server establishes a user datagram protocol and a communication agent module; the server establishes video communication connection with the client through a communication agent module based on a user datagram protocol; and the client encrypts the instant video according to the encryption algorithm to generate and send the encrypted instant video to the server.
The technical scheme provided by the embodiment of the invention has the following beneficial effects:
1. by receiving and verifying the instant image in the video communication request, compared with the prior art, the method can further authenticate whether the initiator is the user or not because the instant image contains the real image of the user, thereby improving the safety.
2. The gateway can realize that the communication with a plurality of clients is completed through one gateway monitoring interface of the WebRTC gateway by newly establishing a user datagram protocol and a communication agent module, thereby saving processing resources and network resources.
Drawings
In order to more clearly illustrate the technical solutions in the embodiments of the present invention, the drawings needed to be used in the description of the embodiments will be briefly introduced below, and it is obvious that the drawings in the following description are only some embodiments of the present invention, and it is obvious for those skilled in the art to obtain other drawings based on these drawings without creative efforts.
Fig. 1 is a flowchart of an instant video communication method according to an embodiment of the present invention;
fig. 2 is a flowchart of an instant video communication method according to an embodiment of the present invention;
fig. 3 is a schematic structural diagram of an instant video communication device according to an embodiment of the present invention;
fig. 4 is a schematic diagram of an instant video communication system according to an embodiment of the present invention.
Detailed Description
In order to make the objects, technical solutions and advantages of the present invention clearer, the technical solutions in the embodiments of the present invention will be clearly and completely described below with reference to the accompanying drawings in the embodiments of the present invention, and it is obvious that the described embodiments are only a part of the embodiments of the present invention, and not all of the embodiments. All other embodiments, which can be derived by a person skilled in the art from the embodiments given herein without making any creative effort, shall fall within the protection scope of the present invention.
The embodiment of the invention provides an instant video communication method, which is applied to a scene of video call based on an open-source WebRTC (Web Real-time communication, webpage instant communication), in particular to a scene of video call of multiple persons, such as a video conference and the like. In addition, the method according to the embodiment of the present invention may also be applied to other scenarios, and the specific application scenario is not limited in the embodiment of the present invention.
Example one
An embodiment of the present invention provides an instant video communication method, which is shown in fig. 1 and includes:
101. the client initiates a video communication request to the server, wherein the video communication request at least comprises an instant image of the user.
102. And the server receives and verifies the instant image in the video communication request, and sends the gateway monitoring information to the client after the verification is finished.
Specifically, an instant image meeting a preset condition is obtained from a video;
acquiring feature data of the instant image, wherein the feature data is used for describing a user in the instant image;
and verifying the identity of the user according to the characteristic data.
103. And the client side generates a communication check packet according to the gateway monitoring information and sends the communication check packet to the server.
104. The server assigns and transmits the user identification and encryption algorithm for video communication to the client.
Specifically, network parameters of a communication link between the client and the client are obtained;
acquiring an encryption algorithm corresponding to the network parameters;
and sending the encryption algorithm and the user identification to the client.
105. The server establishes a new user datagram protocol and a communication agent module.
Specifically, the interface of the user datagram protocol is a gateway monitoring interface in the gateway monitoring information, and the user datagram protocol is bound with the network address of the client.
106. The server establishes video communication connection with the client through the communication agent module based on a user datagram protocol.
107. And the client encrypts the instant video according to the encryption algorithm to generate and send the encrypted instant video to the server.
Specifically, an instant video is coded to generate a coded instant video;
and encrypting the coded instant video according to a preset time interval to generate the encrypted instant video.
Example two
An embodiment of the present invention provides an instant video communication method, which is shown in fig. 2 and includes:
201. the client initiates a video communication request to the server, wherein the video communication request at least comprises an instant image of the user.
Specifically, in the process that a client initiates a video communication request to a server, the video communication request is a webpage instant video communication request, after the client initiates the request, a camera of the client is started, or a camera connected with the client in a wired or wireless manner is started, and a video shot by the camera for a preset time length is obtained;
detecting whether the video contains a human face, wherein the process can be as follows:
detecting whether the video contains a face or not, if the video contains the face, detecting whether the face moves within a preset time, wherein the detection process can be realized by judging whether eyes on the face blink or whether a mouth is closed or not, and the detection process can be realized by a depth image recognition algorithm;
adding the video containing the face to the video communication request.
Optionally, the method may further include:
after the client initiates the request, a microphone of the client is started, or a microphone connected with the client in a wired or wireless mode is started, and a user is prompted to input voice with a preset time length after the microphone is started, or the voice with the preset time length input by the user is acquired;
adding the voice and the video containing the human face to a video communication request;
initiating a video communication request to a server, wherein the process can be as follows:
the client sends an offer (offer) of a Session Description Protocol (SDP for short) to the server, the Session Description Protocol at least includes the voice and the video containing the face, and in addition, the Protocol also includes a media type, a transmission Protocol, a media format, a multicast or unicast address and port, bandwidth information of the client, and encryption information of the client.
202. The server acquires an instant image meeting preset conditions from the video.
Specifically, the process of the server acquiring the instant image meeting the preset condition from the video including the face may be as follows:
acquiring the face in each video frame contained in the video;
recognizing the pose of the face in each video frame contained in the video, wherein the pose of the face is used for indicating that the face is any one of the front face and the side face;
identifying the background illumination intensity of each video frame contained in the video, wherein the identification process can be realized by identifying and judging whether the gray value of pixel points of a background part except the face in the video frame is greater than a preset value;
the instant image meeting the preset condition can be a video frame with the human face posture as the front side and the minimum background illumination intensity.
Optionally, the method may further include:
recognizing and extracting voice in the video call request;
the voiceprint of the user in the voice is extracted, the extraction process can be realized by a depth recognition algorithm, and the embodiment of the invention does not limit the specific extraction mode.
203. The server obtains characteristic data of the instant image, and the characteristic data is used for describing the user in the instant image.
Specifically, the iris, the nasal wing and the mouth corner of the user in the instant image are identified;
the feature data describing the iris, the nasal wing and the mouth angle of the eye is acquired, the feature data can be a feature vector, and the embodiment of the invention does not limit the specific acquisition mode.
204. And the server verifies the user identity according to the characteristic data.
Specifically, the characteristic data is compared with a user image prestored in the system, and whether the user in the instant image is consistent with the user prestored in the system is judged;
if the identity information is consistent with the identity information, indicating that the user identity authentication is successful; otherwise, the video call request is rejected.
Optionally, the method further includes:
comparing the voiceprint with a user voiceprint prestored in the system, and judging whether the user in the instant image is consistent with the user prestored in the system;
if the identity information is consistent with the identity information, indicating that the user identity authentication is successful; otherwise, the video call request is rejected.
205. And if the verification is successful, the server sends the gateway monitoring information to the client.
Specifically, the server sends an offer (offer) of a Session Description Protocol (SDP for short) to a gateway, which may be a Janus gateway and a microcode gateway;
the gateway distributes gateway monitoring information for the video call, wherein the gateway monitoring information comprises a gateway monitoring address and a gateway monitoring interface;
the gateway sends the gateway monitoring information to a server;
and the server sends the gateway monitoring information to the client.
It should be noted that, steps 202 to 205 are processes of implementing that the server receives and verifies the instant image in the video communication request, and sends the gateway monitoring information to the client after completing the verification, and besides the above-mentioned steps, the processes may be implemented in other manners, and the specific manner is not limited in the embodiment of the present invention.
206. And the client side generates a communication check packet according to the gateway monitoring information and sends the communication check packet to the server.
Specifically, after receiving the gateway monitoring information, the client assembles a first communication check packet according to a gateway monitoring address and a gateway monitoring interface in the gateway monitoring information, where the communication check packet may be a Simple traversal UDP (User datagram protocol) traversal NAT (Simple traversal UDP Through NATs, abbreviated as STUN) packet, that is, a STUN packet;
it should be noted that the first STUN includes network parameters of a communication link between the server and the client for video communication; the network parameter may be a packet loss rate or a transmission rate;
the embodiment of the present invention does not limit the specific collection manner of the network parameters.
207. The server obtains network parameters of a communication link for video communication with the client.
Specifically, the server obtains the network parameters sent by the client from the communication check packet.
208. The server obtains an encryption algorithm corresponding to the network parameter.
Specifically, a plurality of levels of the encryption algorithm are set in advance according to the encryption time of the encryption algorithm, and the plurality of levels respectively correspond to the network parameters; the corresponding method may be:
if the transmission rate is higher, the encryption time of the encryption algorithm is longer, otherwise, the encryption time of the encryption algorithm is shorter; or
If the packet loss rate is higher, the encryption time of the encryption algorithm is shorter, otherwise, the encryption time of the encryption algorithm is longer.
209. The server sends the encryption algorithm and the user identification to the client.
Specifically, the server sends the encryption algorithm to the gateway;
the gateway distributes a user identification for the video call and sends the user identification to a server;
the server sends the encryption algorithm and the user identification to the client;
after receiving the encryption algorithm and the user identifier, the client generates a second communication check packet, where the second communication check packet includes the user identifier, and in actual application, the user identifier may be a user name;
the client encrypts the second communication check packet according to an encryption algorithm and sends the second communication check packet to the server;
the server speaks the second check packet to the gateway.
It should be noted that steps 207 to 209 are processes for implementing that the server allocates and transmits the user identifier and the encryption algorithm for video communication to the client, and besides the above-described manners, the processes may also be implemented in other manners, and the embodiment of the present invention is not limited to the specific manners.
210. The gateway establishes a user datagram protocol and a communication agent module.
Specifically, an interface of a new user datagram protocol of the gateway is a gateway monitoring interface in gateway monitoring information, and the user datagram protocol is bound with a network address of a client;
the gateway newly establishes a communication agent module, and sets the communication agent module to correspond to the client.
It should be noted that, if there are multiple clients communicating with the gateway, the process in step 210 may further be:
for any one of the clients, the following operations are performed:
the gateway establishes a new user datagram protocol interface as a gateway monitoring interface in gateway monitoring information, and the user datagram protocol is bound with the network address of the client;
a communication agent module is newly built in a gateway and is arranged to correspond to a client;
and for other clients, the operation is continuously executed until all the clients finish the operation.
211. The server establishes video communication connection with the client through the communication agent module based on a user datagram protocol.
Specifically, the embodiment of the present invention does not limit the specific establishment manner.
The communication agent module is used for communicating with the client in the video call process.
212. The client encodes the instant video to generate the encoded instant video.
Specifically, the process may be implemented by a coding algorithm in the process of instant video transmission, and the embodiment of the present invention does not limit the specific coding algorithm.
213. And the client encrypts the encoded instant video according to a preset time interval to generate the encrypted instant video.
Specifically, the preset time interval corresponds to a network parameter, and the corresponding manner includes:
if the transmission rate is higher, the preset time interval is longer, otherwise, the preset time interval is shorter; or
If the packet loss rate is higher, the preset time interval is short, otherwise, the preset time interval is longer.
The embodiment of the present invention does not limit the specific encryption method.
It should be noted that steps 212 to 213 are processes for implementing that the client encrypts the instant video according to an encryption algorithm, generates and sends the encrypted instant video to the server, and besides the above-described manners, the processes may also be implemented in other manners, and the specific manner is not limited in the embodiment of the present invention.
EXAMPLE III
An embodiment of the present invention provides an instant video communication device 3, and as shown in fig. 3, the instant video communication device 3 includes:
a receiving module 31, configured to receive a video communication request sent by a client, where the video communication request at least includes an instant image of a user;
the verification module 32 is used for verifying the instant image in the video communication request and sending the gateway monitoring information to the client after the verification is finished;
the receiving module 33 is further configured to receive a communication check packet generated by the client according to the gateway monitoring information;
an assigning module 34 for assigning and transmitting a user identification and an encryption algorithm for video communication to the client;
the establishing module 35 is further configured to establish a video communication connection with the client through the communication agent module based on a user datagram protocol;
and the processing module 36 is configured to encrypt the instant video according to an encryption algorithm, and generate and send the encrypted instant video to the server.
Optionally, the verification module 32 is specifically configured to:
acquiring a video recorded by a client after a camera is started;
acquiring an instant image meeting a preset condition from a video;
acquiring feature data of the instant image, wherein the feature data is used for describing a user in the instant image;
and verifying the identity of the user according to the characteristic data.
Optionally, the allocating module 34 is specifically configured to:
acquiring network parameters of a communication link between the client and the client;
acquiring an encryption algorithm corresponding to the network parameters;
and sending the encryption algorithm and the user identification to the client.
Example four
An embodiment of the present invention provides an instant video communication system, and as shown in fig. 4, the system includes a client 41, a gateway 42, and a server 43, where:
the client 41 is used for initiating a video communication request to the server 43, wherein the video communication request at least comprises an instant image of a user;
the server 43 is configured to receive and verify the instant image in the video communication request, and send the gateway monitoring information to the client 41 after the verification is completed;
the client 41 is further configured to generate a communication check packet according to the gateway monitoring information, and send the communication check packet to the server 43;
the server 43 is also used to assign and send the user identification and encryption algorithm for video communication to the client 41;
the gateway 42 is configured to create a new user datagram protocol and a new communication proxy module, where an interface of the user datagram protocol is a gateway monitoring interface in the gateway monitoring information, and the user datagram protocol is bound to a network address of the client 41;
the server 43 is further configured to establish a video communication connection with the client 41 through the communication proxy module based on a user datagram protocol;
the client 41 is further configured to encrypt the instant video according to an encryption algorithm, and generate and send the encrypted instant video to the server 43.
Optionally, the server 43 is specifically configured to:
acquiring a video recorded by the client 41 after the camera is started;
acquiring an instant image meeting a preset condition from a video;
acquiring feature data of the instant image, wherein the feature data is used for describing a user in the instant image;
and verifying the identity of the user according to the characteristic data.
Optionally, the server 43 is specifically configured to:
acquiring network parameters of a communication link with the client 41;
acquiring an encryption algorithm corresponding to the network parameters;
the encryption algorithm and the user identification are sent to the client 41.
Optionally, the client 41 is specifically configured to:
coding the instant video to generate a coded instant video;
and encrypting the coded instant video according to a preset time interval to generate the encrypted instant video.
EXAMPLE five
The embodiment of the invention provides a computer readable storage medium, which stores a computer program, and the program realizes the steps of the method of the first embodiment and/or the second embodiment when being executed by a processor.
Embodiments of the present invention provide an instant video communication method, device, system, and readable storage medium, where by receiving and verifying an instant image in a video communication request, since the instant image includes a real image of a user, compared with the prior art, the method can further authenticate whether an initiator is the user, thereby improving security. By newly establishing the user datagram protocol and the communication agent module, the communication with a plurality of clients can be completed through one gateway monitoring interface of the WebRTC gateway, and processing resources and network resources are saved.
All the above-mentioned optional technical solutions can be combined arbitrarily to form the optional embodiments of the present invention, and are not described herein again.
It should be noted that: when the instant video communication device and the instant video communication system provided by the above embodiments execute the instant video communication method, only the division of the above functional modules is exemplified, and in practical applications, the above function distribution can be completed by different functional modules according to needs, that is, the internal structures of the device and the system are divided into different functional modules, so as to complete all or part of the above described functions. In addition, the embodiments of the instant video communication method, device, system and readable storage medium provided by the above embodiments belong to the same concept, and specific implementation processes thereof are detailed in the method embodiments and are not described herein again.
It will be understood by those skilled in the art that all or part of the steps for implementing the above embodiments may be implemented by hardware, or may be implemented by a program instructing relevant hardware, where the program may be stored in a computer-readable storage medium, and the above-mentioned storage medium may be a read-only memory, a magnetic disk or an optical disk, etc.
The above description is only for the purpose of illustrating the preferred embodiments of the present invention and is not to be construed as limiting the invention, and any modifications, equivalents, improvements and the like that fall within the spirit and principle of the present invention are intended to be included therein.
Claims (5)
1. An instant video communication method, the method comprising:
a client initiates a video communication request to a server, wherein the video communication request at least comprises an instant image of a user;
the server receives and verifies the instant image in the video communication request, and sends gateway monitoring information to the client after the verification is completed;
the client generates a communication check packet according to the gateway monitoring information and sends the communication check packet to the server;
the server distributes and sends user identification and encryption algorithm for video communication to the client;
a user datagram protocol and a communication agent module are newly built in a gateway, wherein an interface of the user datagram protocol is a gateway monitoring interface in gateway monitoring information, and the user datagram protocol is bound with a network address of the client;
the server establishes video communication connection with the client through the communication agent module based on the user datagram protocol;
the client encrypts the instant video according to the encryption algorithm to generate and send the encrypted instant video to the server;
wherein the server receiving and verifying the instant image in the video communication request comprises:
acquiring an instant image meeting a preset condition from a video;
acquiring feature data of the instant image, wherein the feature data is used for describing a user in the instant image, the feature data is used for describing an iris, a nasal wing and a mouth angle of the user, and the feature data is a feature vector;
verifying the identity of the user according to the characteristic data;
the obtaining of the instant image meeting the preset condition from the video comprises:
acquiring the face in each video frame contained in the video;
recognizing the pose of the face in each video frame, wherein the pose of the face is used for indicating that the face is any one of the front face and the side face;
identifying a background illumination intensity for the respective video frame;
the instant image meeting the preset condition can be a video frame with the face posture being the front side and the minimum background illumination intensity;
the server allocating and sending the user identification and the encryption algorithm for video communication to the client comprises the following steps:
acquiring network parameters of a communication link between the client and the client;
acquiring an encryption algorithm corresponding to the network parameter;
sending the encryption algorithm and the user identification to the client;
the obtaining of the encryption algorithm corresponding to the network parameter includes:
setting a plurality of grades of the encryption algorithm in advance according to the encryption time of the encryption algorithm, wherein the grades respectively correspond to network parameters; the corresponding method is as follows:
if the transmission rate is higher, the encryption time of the encryption algorithm is longer, otherwise, the encryption time of the encryption algorithm is shorter; or
If the packet loss rate is higher, the encryption time of the encryption algorithm is shorter, otherwise, the encryption time of the encryption algorithm is longer.
2. The method of claim 1, wherein the client encrypts the instant video according to the encryption algorithm, and wherein generating and sending the encrypted instant video to the server comprises:
coding the instant video to generate a coded instant video;
and encrypting the coded instant video according to a preset time interval to generate an encrypted instant video.
3. An instant video communication device, wherein the instant video communication device is a server, the device comprising:
the receiving module is used for receiving a video communication request sent by a client, wherein the video communication request at least comprises an instant image of a user;
the verification module is used for verifying the instant image in the video communication request and sending the gateway monitoring information to the client after the verification is finished;
the receiving module is further configured to receive a communication check packet generated by the client according to the gateway monitoring information;
the distribution module is used for distributing and sending the user identification and the encryption algorithm for video communication to the client;
the establishing module is used for establishing video communication connection with the client through the communication agent module based on a user datagram protocol;
wherein the verification module is specifically configured to:
acquiring an instant image meeting a preset condition from a video;
acquiring feature data of the instant image, wherein the feature data is used for describing a user in the instant image, the feature data is used for describing an iris, a nasal wing and a mouth angle of the user, and the feature data is a feature vector;
verifying the identity of the user according to the characteristic data;
the verification module is specifically configured to:
acquiring the face in each video frame contained in the video;
recognizing the pose of the face in each video frame, wherein the pose of the face is used for indicating that the face is any one of the front face and the side face;
identifying a background illumination intensity for the respective video frame;
the instant image meeting the preset condition can be a video frame with the face posture being the front side and the minimum background illumination intensity;
the allocation module is specifically configured to:
acquiring network parameters of a communication link between the client and the client;
acquiring an encryption algorithm corresponding to the network parameter;
sending the encryption algorithm and the user identification to the client;
the obtaining of the encryption algorithm corresponding to the network parameter includes:
setting a plurality of grades of the encryption algorithm in advance according to the encryption time of the encryption algorithm, wherein the grades respectively correspond to network parameters; the corresponding method is as follows:
if the transmission rate is higher, the encryption time of the encryption algorithm is longer, otherwise, the encryption time of the encryption algorithm is shorter; or
If the packet loss rate is higher, the encryption time of the encryption algorithm is shorter, otherwise, the encryption time of the encryption algorithm is longer.
4. An instant video communication system, comprising a client, a gateway and a server, wherein:
the client is used for initiating a video communication request to the server, and the video communication request at least comprises an instant image of a user;
the server is used for receiving and verifying the instant image in the video communication request and sending gateway monitoring information to the client after verification is completed;
the client is also used for generating a communication check packet according to the gateway monitoring information and sending the communication check packet to the server;
the server is also used for distributing and sending the user identification and the encryption algorithm for video communication to the client;
the gateway is used for newly establishing a user datagram protocol and a communication proxy module, wherein an interface of the user datagram protocol is a gateway monitoring interface in the gateway monitoring information, and the user datagram protocol is bound with a network address of the client;
the server is also used for establishing video communication connection with the client through the communication agent module based on the user datagram protocol;
the client is also used for encrypting the instant video according to the encryption algorithm, generating and sending the encrypted instant video to the server;
wherein the server is further specifically configured to:
acquiring an instant image meeting a preset condition from a video;
acquiring feature data of the instant image, wherein the feature data is used for describing a user in the instant image, the feature data is used for describing an iris, a nasal wing and a mouth angle of the user, and the feature data is a feature vector;
verifying the identity of the user according to the characteristic data;
the server is further specifically configured to:
acquiring the face in each video frame contained in the video;
recognizing the pose of the face in each video frame, wherein the pose of the face is used for indicating that the face is any one of the front face and the side face;
identifying a background illumination intensity for the respective video frame;
the instant image meeting the preset condition can be a video frame with the face posture being the front side and the minimum background illumination intensity;
the server is further specifically configured to:
acquiring network parameters of a communication link between the client and the client;
acquiring an encryption algorithm corresponding to the network parameter;
sending the encryption algorithm and the user identification to the client;
the obtaining of the encryption algorithm corresponding to the network parameter includes:
setting a plurality of grades of the encryption algorithm in advance according to the encryption time of the encryption algorithm, wherein the grades respectively correspond to network parameters; the corresponding method is as follows:
if the transmission rate is higher, the encryption time of the encryption algorithm is longer, otherwise, the encryption time of the encryption algorithm is shorter; or
If the packet loss rate is higher, the encryption time of the encryption algorithm is shorter, otherwise, the encryption time of the encryption algorithm is longer.
5. A computer-readable storage medium, characterized in that the computer-readable storage medium stores a computer program which, when being executed by a processor, carries out the steps of the method according to any one of claims 1-2.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202010737987.0A CN111629011B (en) | 2020-07-28 | 2020-07-28 | Instant video communication method, equipment, system and readable storage medium |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202010737987.0A CN111629011B (en) | 2020-07-28 | 2020-07-28 | Instant video communication method, equipment, system and readable storage medium |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN111629011A CN111629011A (en) | 2020-09-04 |
| CN111629011B true CN111629011B (en) | 2020-11-13 |
Family
ID=72272374
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202010737987.0A Active CN111629011B (en) | 2020-07-28 | 2020-07-28 | Instant video communication method, equipment, system and readable storage medium |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN111629011B (en) |
Citations (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN1684491A (en) * | 2004-02-27 | 2005-10-19 | 卡西欧计算机株式会社 | Image processing device and method, image projection apparatus, and program |
| CN108596008A (en) * | 2017-12-12 | 2018-09-28 | 南京理工大学 | The facial jitter compensation method measured for three-dimensional face |
Family Cites Families (8)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN105376051A (en) * | 2014-08-29 | 2016-03-02 | 宇龙计算机通信科技(深圳)有限公司 | Encryption method and apparatus, and terminal |
| CN106886697A (en) * | 2015-12-15 | 2017-06-23 | 中国移动通信集团公司 | Authentication method, authentication platform, user terminal and Verification System |
| US10305850B1 (en) * | 2016-11-15 | 2019-05-28 | Majid Aziz | Enhanced instant messaging social network system |
| CN109274634B (en) * | 2017-07-18 | 2021-06-11 | 腾讯科技（深圳）有限公司 | Multimedia communication method and device, and storage medium |
| CN109921918B (en) * | 2017-12-12 | 2020-10-23 | 华为技术有限公司 | Quality of service (QoS) control method and device |
| CN108650082B (en) * | 2018-05-08 | 2020-10-30 | 腾讯科技（深圳）有限公司 | Encryption and verification method of information to be verified, related device and storage medium |
| CN109684927A (en) * | 2018-11-21 | 2019-04-26 | 北京蜂盒科技有限公司 | Biopsy method, device, computer readable storage medium and electronic equipment |
| CN111343083B (en) * | 2020-05-22 | 2020-08-11 | 支付宝(杭州)信息技术有限公司 | Instant messaging method, instant messaging device, electronic equipment and readable storage medium |
-
2020
- 2020-07-28 CN CN202010737987.0A patent/CN111629011B/en active Active
Patent Citations (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN1684491A (en) * | 2004-02-27 | 2005-10-19 | 卡西欧计算机株式会社 | Image processing device and method, image projection apparatus, and program |
| CN108596008A (en) * | 2017-12-12 | 2018-09-28 | 南京理工大学 | The facial jitter compensation method measured for three-dimensional face |
Also Published As
| Publication number | Publication date |
|---|---|
| CN111629011A (en) | 2020-09-04 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN110213522B (en) | Video data processing method and device and related equipment | |
| US9106648B2 (en) | Method and apparatus for data transmission | |
| EP2605471B1 (en) | Relay-based media channel establishing method and the system thereof | |
| US10194180B2 (en) | Systems and methods for transmitting video data over a network | |
| WO2018184433A1 (en) | Internet-of-things authentication system and internet-of-things authentication method | |
| CN109309866B (en) | Image processing method and device, and storage medium | |
| CN111083102A (en) | Internet of things data processing method, device and equipment | |
| CN104883367B (en) | A kind of method, system and applications client that auxiliary verification logs in | |
| CN103179104B (en) | A kind of access method of remote service, system and equipment thereof | |
| CN105656850B (en) | Data processing method, related device and system | |
| CN105429959A (en) | Image processing method, client equipment, image verification method and server | |
| WO2015196817A1 (en) | Account number login method, apparatus and system | |
| CN111953656B (en) | Method, device, equipment and medium for monitoring video encryption transmission | |
| CN104580553A (en) | Identification method and device for network address translation device | |
| CN109194906A (en) | Video conference Verification System, method, apparatus and storage medium | |
| CN102802150B (en) | phone number verification method, system and terminal | |
| CN106850502A (en) | Service request retransmission method, storage method, apparatus and system based on connection long | |
| CN111683072A (en) | Remote verification method and remote verification system | |
| CN111629011B (en) | Instant video communication method, equipment, system and readable storage medium | |
| CN105516172A (en) | Identity authentication terminal, identity authentication system and online affair handling platform | |
| CN105516168A (en) | Off-line iris authentication device and method | |
| JP4593943B2 (en) | Method and system for delayed allocation of resources | |
| CN105516070A (en) | Authentication credential replacing method and authentication credential replacing device | |
| CN104065913A (en) | Instant messaging client | |
| CN110809014B (en) | Service request, negotiation and response method, device, network equipment and system |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |