CN111432242B - Encrypted video call method, device, equipment and storage medium - Google Patents
Encrypted video call method, device, equipment and storage medium Download PDFInfo
- Publication number
- CN111432242B CN111432242B CN202010244156.XA CN202010244156A CN111432242B CN 111432242 B CN111432242 B CN 111432242B CN 202010244156 A CN202010244156 A CN 202010244156A CN 111432242 B CN111432242 B CN 111432242B
- Authority
- CN
- China
- Prior art keywords
- video
- coding
- parameter
- data
- preset
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
- 238000000034 method Methods 0.000 title claims abstract description 84
- 230000005540 biological transmission Effects 0.000 claims description 31
- 238000004590 computer program Methods 0.000 claims description 3
- 238000004364 calculation method Methods 0.000 abstract description 10
- 238000010586 diagram Methods 0.000 description 8
- 230000002123 temporal effect Effects 0.000 description 4
- 230000006870 function Effects 0.000 description 3
- 230000009286 beneficial effect Effects 0.000 description 2
- 238000004891 communication Methods 0.000 description 2
- 230000006835 compression Effects 0.000 description 2
- 238000007906 compression Methods 0.000 description 2
- 230000003247 decreasing effect Effects 0.000 description 1
- 230000001419 dependent effect Effects 0.000 description 1
- 230000000694 effects Effects 0.000 description 1
- 230000002708 enhancing effect Effects 0.000 description 1
- 238000010295 mobile communication Methods 0.000 description 1
- 230000003287 optical effect Effects 0.000 description 1
- 230000008707 rearrangement Effects 0.000 description 1
- 239000007787 solid Substances 0.000 description 1
- 238000006467 substitution reaction Methods 0.000 description 1
Images
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/20—Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
- H04N21/23—Processing of content or additional data; Elementary server operations; Server middleware
- H04N21/234—Processing of video elementary streams, e.g. splicing of video streams or manipulating encoded video stream scene graphs
- H04N21/2347—Processing of video elementary streams, e.g. splicing of video streams or manipulating encoded video stream scene graphs involving video stream encryption
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/20—Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
- H04N21/23—Processing of content or additional data; Elementary server operations; Server middleware
- H04N21/234—Processing of video elementary streams, e.g. splicing of video streams or manipulating encoded video stream scene graphs
- H04N21/2343—Processing of video elementary streams, e.g. splicing of video streams or manipulating encoded video stream scene graphs involving reformatting operations of video signals for distribution or compliance with end-user requests or end-user device requirements
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
- H04N21/44—Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream or rendering scenes according to encoded video stream scene graphs
- H04N21/4402—Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream or rendering scenes according to encoded video stream scene graphs involving reformatting operations of video signals for household redistribution, storage or real-time display
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N7/00—Television systems
- H04N7/14—Systems for two-way working
Landscapes
- Engineering & Computer Science (AREA)
- Multimedia (AREA)
- Signal Processing (AREA)
- Compression Or Coding Systems Of Tv Signals (AREA)
- Two-Way Televisions, Distribution Of Moving Picture Or The Like (AREA)
Abstract
The invention discloses an encrypted video call method, an encrypted video call device, encrypted video call equipment and a storage medium, wherein the method comprises the following steps: determining coding parameters of a video image, and determining coding parameter indexes corresponding to the coding parameters according to a preset index information set; and transmitting the coding parameter index and the video coding data. The technical scheme of the embodiment of the invention realizes safe video call, reduces the calculation overhead in the video call process, can improve the real-time performance of the video call and enhances the user experience.
Description
Technical Field
The embodiment of the invention relates to the technical field of video image processing, in particular to an encrypted video call method, device, equipment and storage medium.
Background
Video calls are a common application scenario for mobile internet. The internet communication line has very low capability of dealing with threats, and is very easy to be attacked by illegal users, for example, the communication line of a video call can be physically damaged and eavesdropped by a wiring mode. Has great threat to the private data of the user.
In order to solve the above problems, in the prior art, video encoding data transmitted by a user is often encrypted to achieve the purpose of protecting the privacy of the user. A common video encoding data encryption method mainly uses video encoding data as common data to perform full-volume encryption, for example, a secure socket layer protocol is used to transmit the video encoding data, or encryption is performed before and after the video encoding data is transmitted through a custom encryption method, so as to improve the security of video call.
Disclosure of Invention
The embodiment of the invention provides an encrypted video call method, an encrypted video call device, encrypted video call equipment and a storage medium, which are used for realizing the safety of video calls, reducing the calculation overhead of the encryption process of video encoding data and improving the real-time performance of video calls.
In a first aspect, an embodiment of the present invention provides an encrypted video call method, applied to a sending end, where the method includes:
determining coding parameters of a video image, and determining coding parameter indexes corresponding to the coding parameters according to a preset index information set;
performing encoding processing on the video image to generate video encoding data;
and transmitting the coding parameter index and the video coding data.
In a second aspect, an embodiment of the present invention provides an encrypted video call method, which is applied to a receiving end, and the method includes:
receiving video coding data and a coding parameter index;
determining a decoding parameter in a preset coding index set according to the coding parameter index;
and restoring the video coding data according to the decoding parameters to generate a call video.
In a third aspect, an embodiment of the present invention provides an encrypted video call device, which is applied to a sending end, and includes:
the index determining module is used for determining the coding parameters of the video images and determining the coding parameter indexes corresponding to the coding parameters according to a preset index information set;
the encoding processing module is used for carrying out encoding processing on the video image so as to generate video encoding data;
and the data sending module is used for sending the coding parameter index and the video coding data.
In a fourth aspect, an embodiment of the present invention provides an encrypted video call device, which is applied to a receiving end, and the device includes:
the data receiving module is used for receiving video coding data and a coding parameter index;
the parameter determining module is used for determining decoding parameters in a preset coding index set according to the coding parameter indexes;
and the video restoration module is used for restoring the video coding data according to the decoding parameters to generate a call video.
In a fifth aspect, an embodiment of the present invention provides an apparatus, where the apparatus includes:
one or more processors;
a memory for storing one or more programs,
when executed by the one or more processors, cause the one or more processors to implement the method for encrypted video call according to any one of the embodiments of the present invention.
In a sixth aspect, an embodiment of the present invention provides a computer-readable storage medium, on which a computer program is stored, where the computer program, when executed by a processor, implements the encrypted video call method according to any one of the embodiments of the present invention.
According to the technical scheme of the embodiment of the invention, the coding parameter index is determined in the preset coding parameter index of the video image, the video coding data of the processed video image is obtained, the transmission of the video image is realized by transmitting the coding parameter index and the video coding data, an attacker cannot restore the video coding data into the video image by using the coding parameter index only, the safety of video call is improved, the coding parameter index of the video image is only generated in the video call process, the full encryption of the video image is not needed, the calculation expense of the video call is reduced, and the real-time performance of the video call can be improved.
Drawings
Fig. 1 is a flowchart of an encrypted video call method according to an embodiment of the present invention;
fig. 2 is a flowchart of an encrypted video call method according to a second embodiment of the present invention;
fig. 3 is a flowchart of an encrypted video call method according to a third embodiment of the present invention;
fig. 4 is a flowchart of an encrypted video call method according to a fourth embodiment of the present invention;
fig. 5 is an exemplary diagram of an encrypted video call method according to a fourth embodiment of the present invention;
fig. 6 is a schematic structural diagram of an encrypted video call device according to a fifth embodiment of the present invention;
fig. 7 is a schematic structural diagram of an encrypted video call device according to a sixth embodiment of the present invention;
fig. 8 is a schematic structural diagram of an apparatus according to a seventh embodiment of the present invention.
Detailed Description
The present invention will be described in further detail with reference to the accompanying drawings and examples. It is to be understood that the specific embodiments described herein are merely illustrative of the invention and are not limiting of the invention. It should be noted that, for convenience of description, only a part of the structures related to the present invention, not all of the structures, are shown in the drawings, and furthermore, embodiments of the present invention and features of the embodiments may be combined with each other without conflict.
When a Video call is performed, a sending end needs to process a Video image into Video encoding data and encoding parameters according to encoding rules, and then the sending end sends the Video encoding data and the encoding parameters to a receiving end, where the Video encoding data may be a parameter Set for restoring the Video encoding data into the Video image, and for example, in an Advanced Video Coding (MPEG-4Part 10) rule, the encoding parameters may include a Sequence Parameter Set (SPS) and a Picture Parameter Set (PPS). The encoding parameters may include Profile parameters, level parameters, image width, image height, deblocking filter, and other information for processing the video image, and the encoded video data may be restored to the video image through the encoding parameters. In the embodiment of the invention, when the video image is transmitted, only the coding parameter index and the video coding data of the video image are transmitted, so that an attacker cannot restore the video image according to the transmitted information, the safety of video call is ensured, the transmitted video coding data does not need to be encrypted in a full amount in the video call process, the calculation overhead in the video call process is reduced, and the real-time performance of the video call can be improved.
Example one
Fig. 1 is a flowchart of an encrypted video call method according to an embodiment of the present invention, where this embodiment is applicable to a case of enhancing video call security, and the method may be executed by an encrypted video call device, where the device may be implemented in a hardware and/or software manner, and generally, the device may be applied to a sending end, where the sending end may specifically be an intelligent terminal and may be used for video call, and referring to fig. 1, the encrypted video call method according to the embodiment of the present invention includes:
The video image may be a component of the call video, for example, one frame image or several frames of images of the call video, and the video image may be acquired and acquired by a camera of the receiving end. The preset index information set may be a data set storing relevant parameters for processing video images, and may include encoding parameters and encoding parameter indexes for processing video images, the preset index information set may be generated by counting encoding parameters commonly used for video images with different code rates, the encoding parameters and the encoding parameter indexes in the preset index information set may be stored in association, and the encoding parameter indexes may be unique identification numbers of the encoding parameters.
Specifically, the encoding parameters required for encoding the video image during transmission of the video image may be selected according to information such as a code rate or a resolution of the video image, it may be understood that the encoding parameters may include related information for organizing video encoded data, and may include Profile parameters, level parameters, an image width, an image height, a deblocking filter, a maximum available reference frame number, an entropy encoding type, and the like, after the encoding parameters of the video image are determined, an encoding parameter index of the encoding parameters may be determined in a preset index information set, the encoding parameter index may represent the encoding parameters during transmission, and is used for secure transmission of the encoding parameters, which may prevent an attacker from obtaining the restoration information of the video image, and it may be understood that the encoding parameter index and the encoding parameters in the preset index information set may be stored in association, and a group of encoding parameters may correspond to one encoding parameter index, it can be understood that the encoding parameter index may also be stored corresponding to the parameter set code stream in the preset encoding, and the corresponding parameter set code stream may be found through the encoding parameter index.
And 102, carrying out coding processing on the video image to generate video coded data.
The encoding processing may be processing for compressing video images, and because redundant data such as spatial redundancy, temporal redundancy, and temporal redundancy exist in video images, the data amount of video images is very large and cannot be transmitted through a transmission channel, and the proportion of redundant data such as spatial redundancy, temporal redundancy, and temporal redundancy in video images can be reduced through encoding processing, so as to achieve the effect of compressing data. The video coded data can be a video image subjected to coding processing, the data volume of the identification coded data can be smaller than the original data volume of the video image, the video coded data can be a binary data string specifically, and the restoration of the video coded data needs the assistance of coding parameters to analyze the specific meaning of the binary data string.
In the embodiment of the present invention, the video image may be encoded according to the determined encoding rule, and the data after the encoding process may be used as the video encoded data. For example, after determining the encoding parameters of the video image, an encoder used in the encoding process may be initialized using the encoding parameters and SPS data or PPS data used in the encoding process may be acquired, where the SPS data or PPS data may be used to store specific meanings of parsing the video encoding data, for example, Profile parameters, level parameters, image width, image height, deblocking filter, maximum available reference frame number, entropy coding type, and the like of the video encoding data may be included, and after completing the initialization of the encoder, the encoder may be used to perform the encoding process on the video image to acquire the video encoding data.
Specifically, after the coding parameter index and the video coded data corresponding to the video image are obtained, the coding parameter index and the video coded data may be sent, the coding parameter index may be sent together with the video coded data, and in order to further improve security, the coding parameter index and the video coded data may also be sent through different channels. So that the receiving side can restore the video image after receiving the coding parameter index and the video coding data.
According to the technical scheme of the embodiment of the invention, the video coding data of the video image are obtained by determining the coding parameters of the video image and determining the coding parameter index of the coding parameters in the preset index information set, and the coding parameter index and the video coding data are sent, so that the encrypted video call is realized, the safety of the video call is improved, the calculation overhead in the video call process is reduced, the real-time performance of the video call is improved, and the experience degree of a user is enhanced.
Further, on the basis of the above embodiment of the invention, the method further includes:
and updating the coding parameters and/or the coding parameter indexes in the preset index information set at regular time.
In the embodiment of the invention, in order to further improve the security of the video call, the index information set can be updated at regular time, so that the corresponding coding parameters are prevented from being estimated through the transmitted coding parameter indexes. The updating may include updating the coding parameters in the preset index information set, for example, the coding parameters may be increased, decreased, or updated, and may also include updating the coding parameter indexes in the preset index information set, for example, the corresponding relationship between the coding parameters and the coding parameter indexes may be changed.
Example two
Fig. 2 is a flowchart of an encrypted video call method according to a second embodiment of the present invention, which is embodied in the embodiments of the present invention, and determines encoding parameters according to transmission capability and processing capability corresponding to a video image, and uses a video encoding file with a generated sequence parameter set and an image parameter set removed as video encoding data used for transmission during encoding processing. Referring to fig. 2, the encrypted video call method provided in the embodiment of the present invention includes:
In the embodiment of the present invention, the sending end may send the preset index information set to the receiving end before transmitting the image video, and it can be understood that the sending of the preset index information set and the sending of the image video are in an isolated state, and the sending of the preset index information set and the sending of the image video are not affected by each other.
Specifically, the manner of sending the preset index information set may include sending the preset index information set using a dedicated transmission channel, or by copying the preset index information set into a usb disk, a specially-assigned person may transfer the usb disk stored with the preset index information set to a receiving end. The method includes the steps that after a receiver acquires a preset index information set, a video call can be carried out, the preset index information set can be sent only once before the video call, the preset index information set can be used in the subsequent video call process, it can be understood that a coding parameter index in the preset index information set can be stored in association with a coding parameter and a parameter set code stream, wherein the coding parameter can be parameter information for initializing a preset coder, the parameter set code stream can be parameter information for initializing a preset decoder, and the parameter set code stream can specifically include VPS data, SPS data, PPS data and the like.
The transmission channel may be a channel for transmitting video images, and the transmission channel may have different transmission capabilities according to the quality of the network, and when the network quality is good, the transmission capability of the transmission channel may be stronger. The processing capability may be a capability of the terminal device to display or present an image video, for example, the terminal device may support a video image in a high definition 4K mode, and the processing capability of the terminal device may include a capability of supporting a high definition 4K mode, and it is understood that the processing capability of the terminal device may present a video image.
Specifically, the current network quality may be determined to determine the transmission capability of a transmission channel for transmitting a video image, the capability of a terminal device at a transmitting end or a receiving end for displaying the video image may be obtained, when the transmission capability of the transmission channel is stronger, a coding parameter for improving the definition of the video image may be selected, or when the processing capability of the terminal device for displaying the video image is stronger, a coding parameter for improving the definition of the video image may be selected, further, the transmission capability of the transmission channel and the processing capability of the terminal device may be simultaneously considered to select the coding parameter, for example, the coding parameter corresponding to the maximum processing capability of the terminal device may be selected on the premise of ensuring that the transmission capability of the transmission channel is satisfied.
Specifically, the preset index information set may store the coding parameters and the coding parameter indexes in an associated manner, the association relationship between the coding parameters and the coding parameter indexes may be in a one-to-one correspondence, a unique coding parameter index may exist in a group of coding parameters, and the coding parameter indexes may be specifically identification symbols formed by letters, numbers or special symbols. The corresponding encoding parameter index can be found in the preset index information set according to the encoding parameter.
And step 204, inputting the coding parameters and the video image into a preset coder and acquiring original coding data.
The preset encoder may be a device that performs encoding processing according to a preset encoding rule, and may be specifically implemented in a software and/or hardware manner, and the preset encoder may be internally provided with a plurality of video encoding rules to implement encoding processing of video images. The original video coding may be data information generated by encoding a video image according to the encoding parameters, the original video coding may include video encoding data and auxiliary data for parsing the video encoding data, and the auxiliary data for parsing the video encoding data may specifically include a sequence parameter set or a picture parameter set, and the like.
Specifically, the encoding parameters and the video image to be processed can be input into a preset encoder as input information, the preset encoder performs compression encoding on the video image according to the encoding parameters, redundant information in the video image data is reduced, and data output by the preset encoder can be stored as original video encoding. It is understood that the preset encoding rules may be different encoders.
Further, on the basis of the above embodiment of the present invention, the preset encoder at least includes one of an h.264 encoder and an h.265 encoder.
In the embodiment of the present invention, the preset encoder at least includes an h.264 or h.265 encoding rule, and the preset encoder may generate different original video encodings according to different encoding rules, and it is understood that the original video encodings may include two parts, one part may include video encoding data, and the other part may include a sequence parameter set and a picture parameter set.
The Sequence parameter set may be a global parameter of a Coded Video Sequence (Coded Video Sequence) in which Video images are stored, where the Coded Video Sequence may be a Sequence composed of a structure in which pixel data of one frame of an original Video image is Coded, and may describe a coding structure of the Video Coded data, and the picture parameter set may be a dependent parameter of the Video Coded data generated after parsing and coding in which the original Video image is stored, and may describe data content of the Coded data.
In the embodiment of the invention, the sequence parameter set and/or the image parameter set for assisting the restoration of the video image can not be transmitted when the video image is transmitted, and the coded video image can be ensured to be intercepted by an attacker and can not be restored into a normal video image. Specifically, data used for assisting in restoring a video image in original video coding may be deleted, a storage location of the sequence parameter set and the image parameter set in the video coding file may be obtained, data at the location may be cleared or covered, it is ensured that the sequence parameter set and the image parameter set cannot be restored from the video coding file after being deleted, the video coding file from which the sequence parameter set and the image parameter set are removed may be used as video coding data, and the actually transmitted video coding data may be original coding data that does not include the sequence parameter set and the image parameter set.
And step 206, sending the coding parameter index and the video coding data.
Specifically, after the coding parameter index and the video coded data corresponding to the video image are obtained, the coding parameter index and the video coded data may be sent, the coding parameter index may be sent together with the video coded data, and in order to further improve security, the coding parameter index and the video coded data may also be sent through different channels. So that the receiving side can restore the video image after receiving the coding parameter index and the video coding data. In the embodiment of the invention, the video coding data can be transmitted in a plaintext without encrypting the video coding data, so that extra encryption and decryption performance overhead is caused.
According to the technical scheme, the preset index information set is sent to the receiving end, when video call is carried out, the coding parameters are determined through the transmission capacity of a transmission channel corresponding to a video image and the processing capacity of corresponding terminal equipment, the corresponding coding parameter index is determined in the preset index information set through the coding parameters, the video image is processed through the preset encoder and the coding parameters to generate an original video code, the sequence parameter set and the image parameter set are deleted from the original video code to serve as the video coded data, and the video coded data and the coding parameter index are sent. The encryption call of the video call is realized, the security of video image transmission is ensured, the encryption parameters are identified by using the coding parameter index, the video image does not need to be encrypted in full, the calculation overhead and the transmission load of the video call process are reduced, the real-time performance of the video call process can be improved, and the experience degree of a user is enhanced.
Further, on the basis of the above embodiment of the present invention, before sending the preset index information set, the method further includes:
and encrypting the preset index information set according to a preset encryption rule.
The preset encryption rule may be a rule for encrypting the preset index information set, and may include a symmetric encryption rule or an asymmetric encryption rule.
Specifically, in order to further improve the security of the video call, a preset index information set storing coding parameters and coding parameter indexes may be encrypted, so as to ensure that an attacker cannot obtain the coding parameters for restoring the video image, and the preset index information set may be encrypted before the preset index information set is sent, for example, all contents in the preset index information set may be encrypted according to encryption rules such as RSA or ECC using a secret key set by a user, or only the coding parameters in the preset index information set may be encrypted, so that a receiver that is not authorized cannot restore the video image according to the coding parameter indexes.
EXAMPLE III
Fig. 3 is a flowchart of an encrypted video call method according to a third embodiment of the present invention, where this embodiment is applicable to a situation where video call security is enhanced, the method may be executed by an encrypted video call device, and the device may be implemented in a hardware and/or software manner, and generally, the device may be applied to a receiving end, where the receiving end may specifically be an intelligent terminal and may be used for video call, and further, the receiving end and the sending end in this embodiment of the present invention may be located in the same intelligent terminal. Referring to fig. 3, the encrypted video call method according to the embodiment of the present invention includes the following steps:
The encoded video data may be a video image subjected to encoding processing, the data amount of the identification encoded data may be smaller than the original data amount of the video image, and the encoded video data may specifically be a binary data string. The encoding parameter index may be information for assisting in restoring the encoded video data, and specifically may be identification information of a decoding parameter for restoring the encoded video data.
Specifically, the video encoding data and the encoding parameter index may be received, the video encoding data and the encoding parameter index may be transmitted through the same channel, and the video encoding data and the encoding parameter index may also be transmitted through different channels. When the video coded data and the coding parameter index are transmitted through different channels, there may be an association between the video coded data and the coding parameter index, and it can be understood that there is an association between the received video coded data and the coding parameter index, for example, one video coded data may correspond to only one coding parameter index.
The preset coding index set may be a data set storing relevant parameters for restoring video coded data, and may include a data set for restoring video coded data, and the preset index information set may be generated by counting coding parameters commonly used for video images with different code rates, and it can be understood that the preset coding index sets in the receiving end and the sending end may be the same or different. The encoding parameter index in the preset encoding index set may be stored in association with a decoding parameter, the decoding parameter may specifically be a parameter set code stream, and may be used to initialize a decoder that restores video encoded data, the decoding parameter may also generate an encoding parameter of the encoded data, the encoding parameter may store a corresponding relationship with the parameter set code stream, and the decoder may be initialized by acquiring a corresponding parameter data set code stream through the encoding parameter.
Specifically, the preset encoding index set may store a decoding parameter and an encoding parameter index in an associated manner, and may find a corresponding decoding parameter through the encoding parameter index, where the encoding parameter may be used to restore video encoded data and may restore related information of the video encoded data, for example, the decoding parameter may be a parameter set code stream such as VPS, SPS, and/or PPS, and may be used to initialize a decoder, and the initialized decoder may restore the encoded video encoded data to a call video.
And step 303, restoring the video coding data according to the decoding parameters to generate a call video.
The call video may be a video image generated after the video coded data is restored, and the call video may be composed of one frame of video image or multiple frames of video images.
Specifically, the video encoded data may be data after compression encoding, and may only include binary data, each binary data in the video encoded data needs to be analyzed by decoding parameters to obtain a specific meaning of each binary data, and the video encoded data may be restored to a video image through the corresponding meaning, for example, the image height and the image width of the encoding parameter, the video encoded data may be filled into the video image corresponding to the image height and the image width, and the video encoded data is filled one by one according to a filling manner specified by the encoding parameter to realize a restoration process of the video image, and one or more frames of the video images after restoration may be sequentially arranged according to a time sequence to generate a call video. For example, the decoding parameters may be input to a decoder to initialize the decoder, and the video encoding data may be restored to the call video through the initialized decoder.
According to the technical scheme of the embodiment of the invention, the video coding data and the coding parameter index are received, the corresponding decoding parameter is determined in the preset coding index set according to the coding parameter index, the video coding data is restored through the decoding parameter to generate the call video, and the coding parameter index is used for replacing the coding parameter to be transmitted in the video call process, so that the leakage of the coding parameter for restoring the video coding data can be prevented, the safety of the video call process is improved, the encryption and decryption processes of the video coding data are reduced, the calculation cost of the video call process is reduced, the real-time performance of the video call is improved, and the user experience is enhanced.
Further, on the basis of the above embodiment of the invention, the method further includes: and receiving and storing the preset coding index set.
In the embodiment of the present invention, before a video call is performed, a preset coding index set of a sending end may be received, and the preset coding index set is stored locally. It can be understood that the manner of transmitting the preset index information set at the receiving end and the transmitting end may include transmitting the preset index information set using a dedicated transmission channel, or transmitting the U disk storing the preset index information set to the receiving end by a specially-assigned person by copying the preset index information set into the U disk.
Example four
Fig. 4 is a flowchart of an encrypted video call method according to a fourth embodiment of the present invention, which is embodied based on the foregoing embodiments and can be generally integrated in a receiving end, and referring to fig. 4, the encrypted video call method according to the fourth embodiment of the present invention includes:
And step 402, acquiring a decryption key and decrypting a preset coding index set according to the decryption key.
The decryption key may be used to decrypt data in the preset index set, and may specifically be a character string composed of special characters, numbers, and letters, and the decryption key may be pre-stored at the receiving end or may be input by a user.
Specifically, the preset index information set storing the decoding parameters and the encoding parameter indexes can be in an encrypted state at the receiving end, and when a video call is performed, the decryption key can be obtained to decrypt the preset index information set. The preset index information set encryption mode may include encrypting all contents in the preset index information set, and may also include encrypting only decoding parameters in the preset index information set, so that the preset index information set cannot be obtained without obtaining a decryption key.
In the embodiment of the present invention, the decoding parameters and the encoding parameter indexes in the preset index information set may be stored in association, and the encoding parameter indexes may specifically be identification symbols composed of letters, numbers, or characters. The decoding parameter may specifically be a parameter set code stream, which may include a sequence parameter set and a picture parameter set. The corresponding sequence parameter set and image parameter set may be looked up in a preset index information set according to the received encoding parameter index. Furthermore, in order to improve the security, the encoding parameter indexes can have low discrimination, so that an attacker is prevented from deducing the corresponding encoding parameters according to the encoding parameter indexes.
The preset decoder can restore the video coding data into a video image according to a preset decoding rule, and can be specifically realized in a software and/or hardware mode, and various video coding rules can be set in the preset decoder, so that the video coding data can be restored and decoded.
Specifically, the preset decoder may be initialized according to the generated sequence parameter set and the generated image parameter set, determine auxiliary information for restoring the encoded video data, and may be configured to be used for correspondingly restoring the encoded video data. For example, the initialized preset decoder may sequentially pad the video encoding data to the video image according to the data content and the encoding structure in the auxiliary information.
And 405, inputting the video coding data into the preset decoder, and decoding and restoring to generate a call video.
Specifically, the video coded data can be input into a preset decoder, the preset decoder can restore the video coded data from an unreadable binary data state into video images, and the video images can be connected in a time sequence to generate a call video, so that the restoration of the video coded data is realized.
According to the embodiment of the invention, by receiving the video coding data and the coding parameter index, decrypting the preset coding index set according to the decryption key, searching the sequence parameter set and the image parameter set in the decoding parameters corresponding to the coding parameter index in the preset coding index set, initializing the preset decoder according to the sequence parameter set and the image parameter set and decoding the video coding data to generate the call video, and transmitting the coding parameter index instead of the coding parameters in the video call process, the leakage of the coding parameters for restoring the video coding data can be prevented, the safety of the video call process is improved, the calculation overhead of the video call process is reduced, the real-time performance of the video call is improved, and the user experience is enhanced.
For example, fig. 5 is an exemplary diagram of an encrypted video call method according to a fourth embodiment of the present invention, and referring to fig. 5, the encrypted video call method includes a sending end a and a receiving end B, where the receiving end a may collect a video image, select a suitable encoding parameter and initialize an h.264 encoder, encode and process the video image by the h.264 encoder to generate video encoded data, the video encoded data may not include SPS and PPS data describing an encoding structure and encoding content, determine an encoding parameter index by the encoding parameter, and send the encoding parameter index and the video encoded data from the sending end a to the receiving end B. The receiving end B can receive video coding data and coding parameter indexes, the coding parameter indexes are used for searching the SPS and PPS data plaintext which are built in the receiving end B, the SPS and PPS data are in an encryption state when being stored, a decryption key can be built in the receiving end B or input by a user, an H.264 decoder can be started through the SPS and PPS data, the video coding data are decoded and restored according to the decoder, and the decoded and restored conversation video can be displayed.
EXAMPLE five
Fig. 6 is a schematic structural diagram of an encrypted video call device provided in the fifth embodiment of the present invention, which is capable of executing the encrypted video call method provided in any embodiment of the present invention, and has functional modules and beneficial effects corresponding to the execution method. The device can be realized by software and/or hardware, and can be generally integrated in an intelligent terminal of a sending end, and specifically comprises: an index determination module 410, an encoding processing module 420, and a data transmission module 430.
The index determining module 410 is configured to determine a coding parameter of the video image, and determine a coding parameter index corresponding to the coding parameter according to a preset index information set.
And the encoding processing module 420 is configured to perform encoding processing on the video image to generate encoded video data.
A data sending module 430, configured to send the coding parameter index and the video coding data.
According to the embodiment of the invention, the encoding parameter of the video image is determined through the index determining module, the encoding parameter index of the encoding parameter is determined in the preset index information set, the encoding processing module acquires the video encoding data of the video image, and the data transmitting module transmits the encoding parameter index and the video encoding data, so that the encrypted video call is realized, the safety of the video call is improved, the calculation overhead in the video call process is reduced, the real-time performance of the video call is improved, and the experience degree of a user is enhanced.
EXAMPLE six
Fig. 7 is a schematic structural diagram of an encrypted video call device according to a sixth embodiment of the present invention, which is capable of executing an encrypted video call method according to any embodiment of the present invention, and has functional modules and beneficial effects corresponding to the execution method. The device can be realized by software and/or hardware, and can be generally integrated in an intelligent terminal of a sending end, and specifically comprises: a data receiving module 510, a parameter determining module 520, and a video restoring module 530.
A data receiving module 510, configured to receive the video coding data and the coding parameter index.
A parameter determining module 520, configured to determine a decoding parameter in a preset encoding index set according to the encoding parameter index.
A video restoring module 530, configured to restore the video encoded data according to the decoding parameter to generate a call video.
According to the embodiment of the invention, the video coding data and the coding parameter index are received by the data receiving module, the parameter determining module determines the corresponding decoding parameter in the preset coding index set according to the coding parameter index, the video restoring module restores the video coding data through the decoding parameter to generate the conversation video, and the coding parameter index is used for replacing the coding parameter to be transmitted in the video conversation process, so that the leakage of the coding parameter for restoring the video coding data can be prevented, the safety of the video conversation process is improved, the encryption and decryption processes of the video coding data are reduced, the calculation expense of the video conversation process is reduced, the real-time performance of the video conversation is improved, and the experience degree of a user is enhanced.
EXAMPLE seven
Fig. 8 is a schematic structural diagram of an apparatus according to a seventh embodiment of the present invention, as shown in fig. 8, the apparatus includes a processor 70, a memory 71, an input device 72, and an output device 73; the number of processors 70 in the device may be one or more, and one processor 70 is taken as an example in fig. 8; the processor 70, the memory 71, the input device 72 and the output device 73 of the apparatus may be connected by a bus or other means, as exemplified by the bus connection in fig. 8.
The memory 71 is a computer-readable storage medium, and can be used for storing software programs, computer-executable programs, and modules, such as program modules corresponding to the encrypted video call method in the embodiment of the present invention (for example, the index determining module 410, the encoding processing module 420, and the data transmitting module 430 in the encrypted video call apparatus, or the data receiving module 510, the parameter determining module 520, and the video restoring module 530). The processor 70 executes various functional applications and data processing of the device by running software programs, instructions and modules stored in the memory 71, that is, implements the above-described encrypted video call method.
The memory 71 may mainly include a storage program area and a storage data area, wherein the storage program area may store an operating system, an application program required for at least one function; the storage data area may store data created according to the use of the terminal, and the like. Further, the memory 71 may include high speed random access memory, and may also include non-volatile memory, such as at least one magnetic disk storage device, flash memory device, or other non-volatile solid state storage device. In some examples, the memory 71 may further include memory located remotely from the processor 70, which may be connected to the device over a network. Examples of such networks include, but are not limited to, the internet, intranets, local area networks, mobile communication networks, and combinations thereof.
The input device 72 may be used to receive entered numeric or character information and to generate key signal inputs relating to user settings and function controls of the apparatus. The output device 73 may include a display device such as a display screen.
Example eight
An eighth embodiment of the present invention further provides a storage medium containing computer-executable instructions, which when executed by a computer processor, are configured to perform a method for encrypted video call, where the method includes:
determining coding parameters of a video image, and determining coding parameter indexes corresponding to the coding parameters according to a preset index information set; performing encoding processing on the video image to generate video encoding data; and transmitting the coding parameter index and the video coding data.
And/or the presence of a gas in the gas,
receiving video coding data and a coding parameter index;
determining a decoding parameter in a preset coding index set according to the coding parameter index;
and restoring the video coding data according to the decoding parameters to generate a call video.
Of course, the storage medium containing the computer-executable instructions provided by the embodiments of the present invention is not limited to the method operations described above, and may also perform related operations in the encrypted video call method provided by any embodiment of the present invention.
From the above description of the embodiments, it is obvious for those skilled in the art that the present invention can be implemented by software and necessary general hardware, and certainly, can also be implemented by hardware, but the former is a better embodiment in many cases. Based on such understanding, the technical solutions of the present invention may be embodied in the form of a software product, which can be stored in a computer-readable storage medium, such as a floppy disk, a Read-Only Memory (ROM), a Random Access Memory (RAM), a FLASH Memory (FLASH), a hard disk or an optical disk of a computer, and includes several instructions for enabling a computer device (which may be a personal computer, a server, or a network device) to execute the methods according to the embodiments of the present invention.
It should be noted that, in the embodiment of the encrypted video call device, the included units and modules are only divided according to functional logic, but are not limited to the above division, as long as the corresponding functions can be implemented; in addition, specific names of the functional units are only for convenience of distinguishing from each other, and are not used for limiting the protection scope of the present invention.
It is to be noted that the foregoing is only illustrative of the preferred embodiments of the present invention and the technical principles employed. It will be understood by those skilled in the art that the present invention is not limited to the particular embodiments described herein, but is capable of various obvious changes, rearrangements and substitutions as will now become apparent to those skilled in the art without departing from the scope of the invention. Therefore, although the present invention has been described in some detail by the above embodiments, the invention is not limited to the above embodiments, and may include other equivalent embodiments without departing from the spirit of the invention, and the scope of the invention is determined by the scope of the appended claims.
Claims (12)
1. An encrypted video call method is applied to a sending end, and is characterized by comprising the following steps:
determining coding parameters of a video image, and determining coding parameter indexes corresponding to the coding parameters according to a preset index information set;
performing encoding processing on the video image to generate video encoding data;
transmitting the coding parameter index and the video coding data;
the encoding the video image to generate video encoding data comprises:
inputting the coding parameters and the video image into a preset coder and acquiring original coding data;
removing the sequence parameter set and/or the picture parameter set within the original encoded data as the actually transmitted video encoded data.
2. The method of claim 1, wherein determining the encoding parameter of the video image and determining the encoding parameter index corresponding to the encoding parameter according to a preset index information set comprises:
determining encoding parameters according to the transmission capacity of a transmission channel bearing the video images and/or the processing capacity of terminal equipment bearing the video images;
and searching for the coding parameter index corresponding to the coding parameter in the preset index information set.
3. The method of claim 1, further comprising:
and updating the coding parameters and/or the coding parameter indexes in the preset index information set at regular time.
4. The method of claim 1, further comprising:
and sending the preset index information set.
5. The method of claim 4, further comprising, before transmitting the preset index information set:
and encrypting the preset index information set according to a preset encryption rule.
6. An encrypted video call method is applied to a receiving end, and is characterized by comprising the following steps:
receiving video coding data and a coding parameter index;
determining a decoding parameter in a preset coding index set according to the coding parameter index;
restoring the video coding data according to the decoding parameters to generate a call video;
the determining a decoding parameter in a preset coding index set according to the coding parameter index includes:
acquiring a decryption key and decrypting the preset coding index set according to the decryption key;
and searching a decoding parameter in the preset coding index set according to the coding parameter index, wherein the decoding parameter at least comprises one of a sequence parameter set and/or an image parameter set.
7. The method of claim 6, further comprising:
and receiving and storing the preset coding index set.
8. The method according to claim 6 or 7, wherein the searching for the decoding parameter in the preset set of coding indexes according to the coding parameter index comprises:
inputting a sequence parameter set and/or an image parameter set in the decoding parameters into a preset decoder to realize initialization of the preset decoder;
and inputting the video coded data into the preset decoder to be decoded and restored to generate a call video.
9. An encrypted video call device is applied to a sending end, and is characterized in that the device comprises:
the index determining module is used for determining the coding parameters of the video images and determining the coding parameter indexes corresponding to the coding parameters according to a preset index information set;
the encoding processing module is used for carrying out encoding processing on the video image so as to generate video encoding data;
a data sending module, configured to send the coding parameter index and the video coding data;
the encoding processing module is specifically configured to input the encoding parameters and the video image into a preset encoder and obtain original encoded data;
removing the sequence parameter set and/or the picture parameter set within the original encoded data as the actually transmitted video encoded data.
10. An encrypted video call device applied to a receiving end, the device comprising:
the data receiving module is used for receiving video coding data and a coding parameter index;
the parameter determining module is used for determining decoding parameters in a preset coding index set according to the coding parameter indexes;
the video restoration module is used for restoring the video coding data according to the decoding parameters to generate a call video;
the parameter determining module is specifically configured to obtain a decryption key and decrypt the preset encoding index set according to the decryption key;
and searching a decoding parameter in the preset coding index set according to the coding parameter index, wherein the decoding parameter at least comprises one of a sequence parameter set and/or an image parameter set.
11. A computer device, the device comprising:
one or more processors;
a memory for storing one or more programs,
when executed by the one or more processors, cause the one or more processors to implement the encrypted video call method of any of claims 1-8.
12. A computer-readable storage medium, on which a computer program is stored, which, when being executed by a processor, carries out the method for encrypted video telephony according to any one of claims 1 to 8.
Priority Applications (2)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202010244156.XA CN111432242B (en) | 2020-03-31 | 2020-03-31 | Encrypted video call method, device, equipment and storage medium |
| PCT/CN2021/078843 WO2021196960A1 (en) | 2020-03-31 | 2021-03-03 | Encrypted video call method and apparatus, and device and storage medium |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202010244156.XA CN111432242B (en) | 2020-03-31 | 2020-03-31 | Encrypted video call method, device, equipment and storage medium |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN111432242A CN111432242A (en) | 2020-07-17 |
| CN111432242B true CN111432242B (en) | 2022-05-27 |
Family
ID=71550235
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202010244156.XA Active CN111432242B (en) | 2020-03-31 | 2020-03-31 | Encrypted video call method, device, equipment and storage medium |
Country Status (2)
| Country | Link |
|---|---|
| CN (1) | CN111432242B (en) |
| WO (1) | WO2021196960A1 (en) |
Families Citing this family (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN111432242B (en) * | 2020-03-31 | 2022-05-27 | 广州市百果园信息技术有限公司 | Encrypted video call method, device, equipment and storage medium |
| CN111935500B (en) * | 2020-09-22 | 2021-08-10 | 腾讯科技（深圳）有限公司 | Video decoding method and device and electronic equipment |
Citations (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN103313097A (en) * | 2013-06-28 | 2013-09-18 | 贝壳网际（北京）安全技术有限公司 | Method and system for encrypting and decrypting encoded file |
| CN106358004A (en) * | 2015-07-14 | 2017-01-25 | 腾讯科技（深圳）有限公司 | Video call method and video call device |
| CN108900868A (en) * | 2018-08-14 | 2018-11-27 | 苏州科达科技股份有限公司 | Based on video transmission method, device and storage medium H.264 |
Family Cites Families (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101009553A (en) * | 2006-12-30 | 2007-08-01 | 中兴通讯股份有限公司 | Secret key safety method and system for realizing multi-network integration mobile multi-media broadcasting system |
| US20120008686A1 (en) * | 2010-07-06 | 2012-01-12 | Apple Inc. | Motion compensation using vector quantized interpolation filters |
| KR101851479B1 (en) * | 2014-01-03 | 2018-04-23 | 노키아 테크놀로지스 오와이 | Parameter set coding |
| US20170134732A1 (en) * | 2015-11-05 | 2017-05-11 | Broadcom Corporation | Systems and methods for digital media communication using syntax planes in hierarchical trees |
| CN107948676A (en) * | 2017-12-08 | 2018-04-20 | 苏州科达科技股份有限公司 | Method of transmitting video data and device |
| CN108111532A (en) * | 2018-01-05 | 2018-06-01 | 上海小蚁科技有限公司 | The control method for playing back and device of video stream data, storage medium, terminal |
| CN111432242B (en) * | 2020-03-31 | 2022-05-27 | 广州市百果园信息技术有限公司 | Encrypted video call method, device, equipment and storage medium |
-
2020
- 2020-03-31 CN CN202010244156.XA patent/CN111432242B/en active Active
-
2021
- 2021-03-03 WO PCT/CN2021/078843 patent/WO2021196960A1/en active Application Filing
Patent Citations (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN103313097A (en) * | 2013-06-28 | 2013-09-18 | 贝壳网际（北京）安全技术有限公司 | Method and system for encrypting and decrypting encoded file |
| CN106358004A (en) * | 2015-07-14 | 2017-01-25 | 腾讯科技（深圳）有限公司 | Video call method and video call device |
| CN108900868A (en) * | 2018-08-14 | 2018-11-27 | 苏州科达科技股份有限公司 | Based on video transmission method, device and storage medium H.264 |
Also Published As
| Publication number | Publication date |
|---|---|
| CN111432242A (en) | 2020-07-17 |
| WO2021196960A1 (en) | 2021-10-07 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US10320557B2 (en) | Encoder, decoder and methods employing partial data encryption | |
| EP3668104B1 (en) | Video scrambling method and device with adaptive mode selection, network camera and readable storage medium | |
| CN111432242B (en) | Encrypted video call method, device, equipment and storage medium | |
| Bhole et al. | Steganography over video file using Random Byte Hiding and LSB technique | |
| CN107959885B (en) | Motion detection method of encrypted video | |
| CN111431716B (en) | Data transmission method and device, computer equipment and storage medium | |
| CN108322750B (en) | Encrypted domain HEVC video data hiding method based on residual coefficient modulation | |
| Tabash et al. | Efficient encryption technique for H. 264/AVC videos based on CABAC and logistic map | |
| CN114640855A (en) | Data processing method and system | |
| Hasimoto-Beltran et al. | Secure real-time chaotic partial encryption of entropy-coded multimedia information for mobile devices: Smartphones | |
| Qiu et al. | A case study for practical issues of DCT based bitmap selective encryption methods | |
| Vivek et al. | Video steganography using chaos encryption algorithm with high efficiency video coding for data hiding | |
| CN115292726A (en) | Semantic communication method and device, electronic equipment and storage medium | |
| Kuo et al. | Secure multi-group data hiding based on gemd map | |
| CN113012033A (en) | Method, device and system for image display processing | |
| JPH1118070A (en) | Image compressing device, image extending device and transmission equipment | |
| CN113795861A (en) | Privacy protection method for transmitting end and receiving end, electronic device, and computer-readable storage medium | |
| CN101118580A (en) | Digital products content protective system and method | |
| Yi et al. | Reversible data hiding method in encrypted images using secret sharing and Huffman coding | |
| CN116847036B (en) | Image display method, apparatus, electronic device, and computer-readable medium | |
| CN111698534B (en) | Video processing method and device, electronic equipment and storage medium | |
| Abdmouleh et al. | Effective Crypto-compression Scheme for Medical Images | |
| Mashkour et al. | A Secure Data Hiding For H. 264 Video Based on Chaotic Map Methods and RC4 Algorithm | |
| Lokesh et al. | An efficient security for privacy information through hiding data in encrypted compressed videobit streams | |
| JP2007193137A (en) | Encryption device, encryption method, decryption device, and decryption method |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant | ||
| TR01 | Transfer of patent right | ||
| TR01 | Transfer of patent right |
Effective date of registration: 20221215 Address after: 31a, 15 / F, building 30, maple mall, bangrang Road, Brazil, Singapore Patentee after: Baiguoyuan Technology (Singapore) Co.,Ltd. Address before: 5-13 / F, West Tower, building C, 274 Xingtai Road, Shiqiao street, Panyu District, Guangzhou, Guangdong 510000 Patentee before: GUANGZHOU BAIGUOYUAN INFORMATION TECHNOLOGY Co.,Ltd. |