CN115086730B - Subscription video generation method, subscription video generation system, computer equipment and subscription video generation medium - Google Patents

Subscription video generation method, subscription video generation system, computer equipment and subscription video generation medium Download PDF

Info

Publication number
CN115086730B
CN115086730B CN202210681111.8A CN202210681111A CN115086730B CN 115086730 B CN115086730 B CN 115086730B CN 202210681111 A CN202210681111 A CN 202210681111A CN 115086730 B CN115086730 B CN 115086730B
Authority
CN
China
Prior art keywords
video
subscription
data
target format
audio
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
CN202210681111.8A
Other languages
Chinese (zh)
Other versions
CN115086730A (en
Inventor
纪晓龙
魏星
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Ping An International Financial Leasing Co Ltd
Original Assignee
Ping An International Financial Leasing Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Ping An International Financial Leasing Co Ltd filed Critical Ping An International Financial Leasing Co Ltd
Priority to CN202210681111.8A priority Critical patent/CN115086730B/en
Publication of CN115086730A publication Critical patent/CN115086730A/en
Application granted granted Critical
Publication of CN115086730B publication Critical patent/CN115086730B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Classifications

    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/41Structure of client; Structure of client peripherals
    • H04N21/422Input-only peripherals, i.e. input devices connected to specially adapted client devices, e.g. global positioning system [GPS]
    • H04N21/4223Cameras
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
    • H04N21/44Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream or rendering scenes according to encoded video stream scene graphs
    • H04N21/44016Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream or rendering scenes according to encoded video stream scene graphs involving splicing one content stream with another content stream, e.g. for substituting a video clip
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
    • H04N21/44Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream or rendering scenes according to encoded video stream scene graphs
    • H04N21/4408Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream or rendering scenes according to encoded video stream scene graphs involving video stream encryption, e.g. re-encrypting a decrypted video stream for redistribution in a home network

Landscapes

  • Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • Signal Processing (AREA)
  • Television Signal Processing For Recording (AREA)

Abstract

The invention discloses a subscription video generation method, a subscription video generation system, computer equipment and a subscription video generation medium, wherein the subscription video generation method comprises the following steps: when a video recording instruction is received, acquiring an original image sequence and original audio data in a subscription scene in real time; constructing target format image data according to the original image sequence; constructing a target format audio file according to the original audio data; and synthesizing the target format image data and the target format audio file into the subscription video. According to the method and the device, the original image data and the original audio data collected by the camera are processed according to the unified format, so that the file sizes of the signed videos generated by different camera devices are consistent, meanwhile, the space occupied by the data can be greatly reduced by constructing the target format image data and the target format audio file, further, the time cost and the data flow of the subsequent processing of the videos are reduced, and the signing efficiency is improved.

Description

Subscription video generation method, subscription video generation system, computer equipment and subscription video generation medium
Technical Field
The present invention relates to the field of data processing technologies, and in particular, to a subscription video generation method, a subscription video generation system, a subscription video generation computer device, and a subscription video generation medium.
Background
In the business signing process, in order to ensure the compliance of signing, important nodes in the process need to be subjected to signing position determination, video recording and photographing, and generated files need to be subjected to data encryption, data storage, data uploading and data previewing, and the maximum photographing time can be limited to 60 seconds in consideration of larger photographed video files.
At present, the traditional video shooting is performed based on calling a system camera, and because the camera shooting parameters of each terminal are different, the size of the generated video file is different, and even the video file generated by the mobile phone shooting 60s with higher partial pixels can reach hundreds of megabytes, so that a large amount of storage space of the mobile phone of a user is occupied, the processing of the subsequent video file is not facilitated, the user needs to wait for a long time to upload the video, and more data flow is consumed, and the signing efficiency is greatly reduced.
Disclosure of Invention
Accordingly, it is necessary to provide a subscription video generation method, system, computer device and medium for the problem that the storage space occupied by the subscription video is large.
A subscription video generation method includes: when a video recording instruction is received, acquiring an original image sequence and original audio data in a subscription scene in real time; constructing target format image data according to the original image sequence; constructing a target format audio file according to the original audio data; and synthesizing the target format image data and the target format audio file into the subscription video.
In one embodiment, when receiving the video recording instruction, before collecting the original image sequence and the original audio data in the subscription scene in real time, the method further includes: when a camera starting instruction aiming at a subscription scene is received, determining whether the current shooting authority meets the preset shooting authority; if the current shooting authority meets the preset shooting authority, starting the camera based on the pre-defined shooting parameters, and displaying the image acquired by the started camera into a pre-defined user interface.
In one embodiment, after generating the subscription video based on the target format image data and the target format audio file, the method further includes: when video recording is stopped, starting a timer to count down a preset time period; if a subscription video uploading instruction is received before the countdown is finished, the subscription video is sent to a blockchain for storage; or if the signing video uploading instruction is not received before the countdown is finished, acquiring a dynamic key table; acquiring an optimal dynamic key at the current moment from a dynamic key table; symmetric encryption is carried out on the subscription video by adopting an AES encryption algorithm and an optimal dynamic key, so as to generate an encrypted video, and the subscription video is deleted after the encrypted video is stored in a database; inquiring the encrypted video in the database according to the video identification when the video identification is received; the encrypted video is decrypted and then sent to a block chain for storage, and decrypted video data are deleted; each key in the dynamic key table is dynamically generated by adopting a preset rule in each preset period.
In one embodiment, sending the contracted video to the blockchain for saving includes: transmitting a data saving request to the block chain and receiving random string information fed back from the block chain; feature coding is carried out on the signed video according to the random string information, so that certification storage information is obtained; constructing a merck tree for storing the evidence information by adopting a hash function, and calculating root hash values of all nodes in the merck tree; and constructing transaction data according to the root hash value of each node, and sending the transaction data to the blockchain for storage.
In one embodiment, obtaining the optimal dynamic key at the current time in the dynamic key table includes: determining the importance level of a subscription scene; constructing a directed node diagram according to the sequence of each key generation moment in the dynamic key table; searching a target node in the directed node diagram by adopting a depth-first traversal algorithm according to the importance level; and determining the dynamic key on the target node as the optimal dynamic key at the current moment.
In one embodiment, constructing target format image data from an original image sequence includes: coding the original image sequences one by one according to preset coding parameters to obtain coding feature map sequences; performing visual analysis on each feature map in the coding feature map sequence to obtain a plurality of analysis results; recording the code rate, the signal distortion degree and the visual analysis distortion degree of each original image corresponding to the analysis result; analyzing the relation between the signal distortion degree and the visual analysis distortion degree of each original image to obtain a joint distortion function; and according to the joint distortion function and the code rate of each original image, encoding each original image by adopting a preset image compression format to obtain image data in a target format.
In one embodiment, constructing a target format audio file from raw audio data includes: framing the original audio data based on a preset audio framing device to obtain multi-frame audio signals; performing sparse Fourier transform on each frame of audio signal by adopting a basis function to obtain sparse coefficients and an edge information matrix of each frame of audio signal; and merging the sparse coefficient of each frame of audio signal and the edge information matrix, and coding the merged data by adopting a preset audio compression format to obtain the audio file in the target format.
A subscription video generation system, the system comprising: the data acquisition module is used for acquiring an original image sequence and original audio data in a subscription scene in real time when receiving a video recording instruction; the image data construction module is used for constructing target format image data according to the original image sequence; the audio file construction module is used for constructing a target format audio file according to the original audio data; and the signature video generation module is used for synthesizing the target format image data and the target format audio file into a signature video.
A computer device comprising a memory and a processor, the memory having stored therein computer readable instructions which, when executed by the processor, cause the processor to perform the steps of the subscription video generation method described above.
A medium storing computer-readable instructions that, when executed by one or more processors, cause the one or more processors to perform the steps of the subscription video generation method described above.
According to the subscription video generation method, system, equipment and medium, when a video recording instruction is received, the subscription video generation system firstly collects an original image sequence and original audio data in a subscription scene in real time, then constructs target format image data according to the original image sequence, constructs a target format audio file according to the original audio data, and finally synthesizes the target format image data and the target format audio file into the subscription video. According to the method and the device, the original image data and the original audio data collected by the camera are processed according to the unified format, so that the file sizes of the signed videos generated by different camera devices are consistent, meanwhile, the space occupied by the data can be greatly reduced by constructing the target format image data and the target format audio file, further, the time cost and the data flow of the subsequent processing of the videos are reduced, and the signing efficiency is improved.
Drawings
The accompanying drawings, which are incorporated in and constitute a part of this specification, illustrate embodiments consistent with the invention and together with the description, serve to explain the principles of the invention.
Fig. 1 is an environment diagram for implementing a subscription video generation method according to an embodiment of the present application;
FIG. 2 is a schematic diagram of the internal architecture of a computing device in one embodiment of the present application;
fig. 3 is a method schematic diagram of a subscription video generation method according to an embodiment of the present application;
FIG. 4 is a schematic block diagram of a subscription video processing flow provided herein;
fig. 5 is a schematic system structure diagram of a subscription video generation system according to an embodiment of the present application.
Detailed Description
The present invention will be described in further detail with reference to the drawings and examples, in order to make the objects, technical solutions and advantages of the present invention more apparent. It should be understood that the specific embodiments described herein are for purposes of illustration only and are not intended to limit the scope of the invention.
It will be understood that the terms "first," "second," and the like, as used herein, may be used to describe various elements, but these elements are not limited by these terms. These terms are only used to distinguish one element from another element.
Fig. 1 is a diagram of an implementation environment of a subscription video generation method provided in one embodiment, as shown in fig. 1, in the implementation environment, a server 110 and a client 120 are included.
The server 110 may be a server, which may specifically be an independent server, or may be a cloud server that provides cloud services, cloud databases, cloud computing, cloud functions, cloud storage, network services, cloud communication, middleware services, domain name services, security services, content delivery networks (Content Delivery Network, CDN), and basic cloud computing services such as big data and artificial intelligence platforms, for example, a server device that provides blockchain services. When receiving the video recording instruction, the client 120 collects the original image sequence and the original audio data in the subscription scene in real time, the client 120 constructs target format image data according to the original image sequence, the client 120 constructs a target format audio file according to the original audio data, the client 120 synthesizes the target format image data and the target format audio file into a subscription video, when the video recording is stopped, the client 120 starts a timer to count down a preset time period, and if the client 120 receives a subscription video uploading instruction before the counting down is finished, the subscription video is sent to a blockchain on the server 110 to be stored.
It should be noted that, the client 120 may be a smart phone, a tablet computer, a notebook computer, a desktop computer, etc., but is not limited thereto. The server 110 and the client 120 may be connected by bluetooth, USB (Universal Serial Bus ) or other communication connection, which is not limited herein.
FIG. 2 is a schematic diagram of the internal structure of a computer device in one embodiment. As shown in fig. 2, the computer device includes a processor, a medium, a memory, and a network interface connected by a system bus. The medium of the computer device stores an operating system, a database and a computer readable instruction, the database can store a control information sequence, and the computer readable instruction can enable the processor to realize a subscription video generation method when being executed by the processor. The processor of the computer device is used to provide computing and control capabilities, supporting the operation of the entire device. The memory of the computer device may have stored therein computer readable instructions that, when executed by the processor, cause the processor to perform a subscription video generation method. The network interface of the computer device is for communicating with a terminal connection. It will be appreciated by those skilled in the art that the structure shown in fig. 2 is merely a block diagram of some of the structures associated with the present application and is not limiting of the computer device to which the present application may be applied, and that a particular computer device may include more or fewer components than shown, or may combine certain components, or have a different arrangement of components. Wherein the medium is a readable storage medium.
The subscription video generation method provided in the embodiment of the present application will be described in detail with reference to fig. 3 to 4. The method may be implemented in dependence on a computer program, and may be run on a von neumann system-based subscription video generation system. The computer program may be integrated in the application or may run as a stand-alone tool class application.
The embodiment of the application can acquire and process the related data based on the artificial intelligence technology. Among these, artificial intelligence (Artificial Intelligence, AI) is the theory, method, technique and application system that uses a digital computer or a digital computer-controlled machine to simulate, extend and extend human intelligence, sense the environment, acquire knowledge and use knowledge to obtain optimal results.
Artificial intelligence infrastructure technologies generally include technologies such as sensors, dedicated artificial intelligence chips, cloud computing, distributed storage, big data processing technologies, operation/interaction systems, mechatronics, and the like. The artificial intelligence software technology mainly comprises a computer vision technology, a robot technology, a biological recognition technology, a voice processing technology, a natural language processing technology, machine learning/deep learning and other directions.
Referring to fig. 3, a flowchart of a subscription video generation method is provided in an embodiment of the present application. As shown in fig. 3, the method of the embodiment of the present application may include the following steps:
s101, when a video recording instruction is received, acquiring an original image sequence and original audio data in a subscription scene in real time;
the video recording instruction is automatically generated by a user after triggering a video recording key on a pre-defined user interface. The subscription scenario is a realistic scenario of a business subscription.
In the embodiment of the application, firstly, when a camera starting instruction aiming at a subscription scene is received, whether the current shooting authority meets the preset shooting authority is determined; if the current shooting authority meets the preset shooting authority, starting a camera based on a predefined shooting parameter, and displaying an image acquired by the started camera into a predefined user interface; if not, generating right opening information for display so as to prompt the user to timely open the corresponding right.
It should be noted that, the predefined shooting parameters may include the following: setting continuous focusing in the shooting process by acquiring a focusing mode supported by a camera, so as to ensure that the image quality of the video is not blurred; in terms of resolution, generally 720p can meet the requirements of image quality and video file size, and most mobile phones support the resolution, so that image acquisition can be performed by setting the resolution, frame rate and encoding bit rate.
Further, after the images acquired by the started camera are displayed in a pre-defined user interface, when a video recording instruction is received, an original image sequence and original audio data in a subscription scene are acquired in real time.
It should be noted that, the user interface is customized in advance, instead of the system camera interface, so that operations that are not allowed by other services of the camera interface, such as browsing videos and finding out video file copying, are reduced, and thus the secrecy of shooting videos can be ensured.
In one possible implementation manner, after a user selects to shoot a video on a mobile phone terminal according to a subscription scene, a camera start instruction is generated, and the terminal system then judges whether the terminal system has relevant shooting rights, where the required shooting rights at least include: a camera start right for shooting video, a positioning right for acquiring user position information, and a microphone right for acquiring sound; if the user does not allow the permission to be opened, information of the related permission to be opened is needed to be generated, a prompt box is popped up, the permission is requested for the user, the user allows the permission to continue with the subsequent steps, and otherwise, the process is finished.
Specifically, when a video recording instruction is received, firstly, a positioning plug-in is called to acquire terminal position information, then, whether the current position is a subscription scene position is judged according to the terminal position information, if so, an original image sequence and original audio data in the subscription scene are acquired in real time, and if not, video recording is finished.
It should be noted that, the authenticity of the video can be determined through the judgment of the position, the generation of counterfeit video is prevented, and the security of video recording is improved.
S102, constructing target format image data according to an original image sequence;
the target format image data is image data generated by further processing the original image according to a preset image compression format, for example, formats of H.261, H.264, H.265 and the like. For example, the h.264 digital Video compression format is a highly compressed digital Video codec standard proposed by the Joint Video Team (JVT) consisting of the ITU-T Video Coding Experts Group (VCEG) and the ISO/IEC Moving Picture Experts Group (MPEG) Joint.
In the embodiment of the application, when image data in a target format is constructed according to an original image sequence, the original image sequence is firstly encoded one by one according to preset encoding parameters to obtain an encoding feature image sequence, then each feature image in the encoding feature image sequence is visually analyzed to obtain a plurality of analysis results, then the code rate, the signal distortion degree and the visual analysis distortion degree of each original image corresponding to the encoding feature image sequence are recorded according to the analysis results, then the relation between the signal distortion degree and the visual analysis distortion degree of each original image is analyzed to obtain a joint distortion function, and finally each original image is encoded according to the joint distortion function and the code rate of each original image by adopting a preset image compression format to obtain the image data in the target format.
Specifically, when each original image is encoded according to a joint distortion function and a code rate of each original image and by adopting a preset image compression format, an image compression model is firstly constructed according to the joint distortion function and historical data, the preset image compression format is integrated on the compression model, then each original image in an original image sequence is decoded to generate a decoded texture feature variable of each original image, and finally the decoded texture feature variable of each original image and the code rate corresponding to the decoded texture feature variable are input into the compression model for compression reconstruction to obtain image data in a target format.
It should be noted that, the target format image data constructed according to the original image sequence can ensure high definition of the image frames while greatly reducing the space occupied by the images.
S103, constructing a target format audio file according to the original audio data;
the target format audio file is obtained by further processing the original audio data according to a preset audio compression format, wherein the preset audio compression format comprises an APE format, an AAC format and a CDA format. For example, AAC format AAC compression format, full name Advanced Audio Coding, is a file compression format specifically designed for sound data. By using the AAC format, the occupied space is smaller on the premise that people feel that the sound quality is not obviously reduced.
In the embodiment of the application, when an audio file in a target format is constructed according to original audio data, firstly, the original audio data is framed based on a preset audio framing device to obtain multi-frame audio signals, then, sparse Fourier transform is carried out on each frame of audio signals by adopting a basis function to obtain sparse coefficients and an edge information matrix of each frame of audio signals, finally, the sparse coefficients and the edge information matrix of each frame of audio signals are combined, and the combined data are encoded by adopting a preset audio compression format to obtain the audio file in the target format.
Specifically, the sparse fourier transform (Sparse Fourier Transform, SFT) is mainly applied to the field of digital signal processing, and is a simplified algorithm of discrete fourier transform, and the core of the simplified algorithm is that the sparse fourier transform is based on the fact that signals have "sparsity": i.e. only a small part of the large value points in the frequency domain, the values of the remaining large part of points approach 0.
It should be noted that, the target format audio file is constructed according to the original audio data, so that the space occupied by the audio signal can be greatly reduced, and meanwhile, the definition of the tone quality is ensured to be high.
S104, synthesizing the target format image data and the target format audio file into the subscription video.
In one possible implementation manner, when the target format image data and the target format audio file are combined into the subscription video, first determining a first recording time of each frame of image in the target format image data, then determining a second recording time of each audio signal in the target format audio file, finally determining each frame of image and each audio signal at the same moment according to each first recording time and each second recording time, and combining each frame of image and each audio signal at the same moment one by one to obtain a plurality of combined data, and combining the combined data again according to the sequence of the moments to obtain the subscription video.
For example, the first recording time of the first frame image is 21 minutes 30 seconds, the first recording time of the second frame image is 21 minutes 45 seconds, the first recording time of the third frame image is 21 minutes 50 seconds, the first recording time of the fourth frame image is 22 minutes 12 seconds, and the first recording time of the fifth frame image is 22 minutes 09 seconds.
The second recording time of the first audio signal is 22 minutes 09 seconds, the second recording time of the second audio signal is 22 minutes 12 seconds, the second recording time of the third audio signal is 21 minutes 50 seconds, the second recording time of the fourth audio signal is 21 minutes 45 seconds, and the second recording time of the fifth audio signal is 21 minutes 30 seconds.
It can be seen that, based on the combination mode of the same time, the first frame image and the fifth audio signal can be combined, the second frame image and the fourth audio signal can be combined, the third frame image and the third audio signal can be combined, a plurality of combination data can be obtained after the combination, and then the combination data can be synthesized according to the sequence of the time, so as to obtain the subscription video.
In another possible implementation manner, when the target format image data and the target format audio file are combined into the subscription video, first determining a first recording time of each frame of image in the target format image data, then determining a second recording time of each audio signal in the target format audio file, finally determining each frame of image and each audio signal with a time difference within a preset range according to each first recording time and each second recording time, combining each frame of image and each audio signal with a time difference within the preset range one by one to obtain a plurality of combined data, and combining the combined data again according to the sequence of the time to obtain the subscription video.
Further, after the subscription video is obtained, the subscription video needs to be processed.
In one possible implementation manner, when the subscription video is processed, and when video recording is stopped, a timer is started to count down a preset time period, and if a subscription video uploading instruction is received before the count down is finished, the subscription video is sent to a blockchain to be stored.
Further, if the subscription video uploading instruction is not received before the countdown is finished, firstly acquiring a dynamic key table, then acquiring an optimal dynamic key at the current moment in the dynamic key table, secondly adopting an AES encryption algorithm and the optimal dynamic key to carry out symmetric encryption on the subscription video, generating an encrypted video, storing the encrypted video in a database, deleting the subscription video, finally inquiring the encrypted video in the database according to the video identifier when the video identifier is received, decrypting the encrypted video, then sending the decrypted video to a blockchain for storage, and deleting the decrypted video data. Each key in the dynamic key table is dynamically generated by adopting a preset rule in each preset period.
Specifically, when the subscription video is sent to the blockchain for storage, firstly, a data storage request is sent to the blockchain and random string information fed back from the blockchain is received, then feature encoding is carried out on the subscription video according to the random string information to obtain certification storage information, secondly, a hash function is adopted to construct a merck tree of the certification storage information, root hash values of all nodes in the merck tree are calculated, and finally transaction data are constructed according to the root hash values of all the nodes and are sent to the blockchain for storage.
Specifically, when the optimal dynamic key at the current moment is obtained in the dynamic key table, firstly determining the importance level of the subscription scene, then constructing a directed node diagram according to the sequence of the key generation moments in the dynamic key table, secondly searching a target node in the directed node diagram according to the importance level by adopting a depth-first traversal algorithm, and finally determining the dynamic key on the target node as the optimal dynamic key at the current moment.
For example, the AES encryption algorithm can be adopted, and the key with the optimal current moment is determined in the dynamic key table, for example, the key length is 128 bits, and the encryption algorithm is a symmetrical encryption algorithm and has the advantages of high speed, compact coding and difficult cracking. When the subscription video is encrypted, the file stream is read for encryption, the subscription video is deleted after encryption is completed, and meanwhile, the encrypted file is stored in a local database, and the storage content comprises: shooting location, shooting time, file path, file size, and generated upload key value. The purpose of the save is that the user may not upload in real time, and may upload later, so the file needs to be saved for acquisition at the time of upload. The video file can be previewed at any time when the video file is not uploaded, the video file is found from the local database according to the id, then the file is decrypted by using an AES algorithm, the uploading function method is called to upload the file, firstly, the encrypted file is decrypted, the uploading function is called after the decryption, and the decrypted video file is deleted after the uploading is completed.
For example, as shown in fig. 4, fig. 4 is a schematic block diagram of a subscription video generation processing flow, firstly, when a user shoots a video on a subscription scene, it is determined whether the user has shooting authority, if not, it is finished, if yes, it is called a positioning plug-in and whether the position is consistent with the position of the subscription scene, if not, it is finished, if the call is successful and the position is consistent, it is started up, the acquired picture is loaded into a pre-defined UI interface, after the video is recorded and synthesized into the subscription video, it can encrypt and decrypt data according to the actual scene, and upload the video to a blockchain on a server for storing.
It should be noted that a blockchain is a chain composed of blocks. Each block holds certain information which is linked in a chain according to the time sequence of their respective generation. This chain is stored in all servers. By storing the synthesized video on the blockchain, the security of the data can be improved, and the signed video is ensured not to be tampered.
In the embodiment of the application, when a video recording instruction is received, the subscription video generation system firstly acquires an original image sequence and original audio data in a subscription scene in real time, then constructs target format image data according to the original image sequence, constructs a target format audio file according to the original audio data, and finally synthesizes the target format image data and the target format audio file into the subscription video. According to the method and the device, the original image data and the original audio data collected by the camera are processed according to the unified format, so that the file sizes of the signed videos generated by different camera devices are consistent, meanwhile, the space occupied by the data can be greatly reduced by constructing the target format image data and the target format audio file, further, the time cost and the data flow of the subsequent processing of the videos are reduced, and the signing efficiency is improved.
The following are system embodiments of the present invention that may be used to perform method embodiments of the present invention. For details not disclosed in the system embodiments of the present invention, please refer to the method embodiments of the present invention.
Referring to fig. 5, a schematic structural diagram of a subscription video generation system according to an exemplary embodiment of the present invention is shown. The subscription video generation system may be implemented as all or part of the device by software, hardware, or a combination of both. The system 1 comprises a data acquisition module 10, an image data construction module 20, an audio file construction module 30 and a subscription video generation module 40.
The data acquisition module 10 is used for acquiring an original image sequence and original audio data in a subscription scene in real time when receiving a video recording instruction;
an image data construction module 20 for constructing target format image data from the original image sequence;
an audio file construction module 30 for constructing a target format audio file from the original audio data;
the subscription video generation module 40 is configured to synthesize the target format image data and the target format audio file into a subscription video.
It should be noted that, when the subscription video generation system provided in the foregoing embodiment performs the subscription video generation method, only the division of the foregoing functional modules is used as an example, in practical application, the foregoing functional allocation may be performed by different functional modules according to needs, that is, the internal structure of the device is divided into different functional modules, so as to complete all or part of the functions described above. In addition, the subscription video generation system provided in the above embodiment and the subscription video generation method embodiment belong to the same concept, which embody the detailed implementation process in the method embodiment, and are not repeated here.
The foregoing embodiment numbers of the present application are merely for describing, and do not represent advantages or disadvantages of the embodiments.
In the embodiment of the application, when a video recording instruction is received, the subscription video generation system firstly acquires an original image sequence and original audio data in a subscription scene in real time, then constructs target format image data according to the original image sequence, constructs a target format audio file according to the original audio data, and finally synthesizes the target format image data and the target format audio file into the subscription video. According to the method and the device, the original image data and the original audio data collected by the camera are processed according to the unified format, so that the file sizes of the signed videos generated by different camera devices are consistent, meanwhile, the space occupied by the data can be greatly reduced by constructing the target format image data and the target format audio file, further, the time cost and the data flow of the subsequent processing of the videos are reduced, and the signing efficiency is improved.
In one embodiment, a computer device is provided, the device comprising a memory, a processor, and a computer program stored on the memory and executable on the processor, the processor implementing the steps of: collecting an original image sequence and original audio data in a subscription scene in real time; constructing target format image data according to the original image sequence; constructing a target format audio file according to the original audio data; and synthesizing the target format image data and the target format audio file into the subscription video.
In one embodiment, the processor performs the following operations when receiving the video recording instruction and before collecting the original image sequence and the original audio data in the subscription scene in real time:
when a camera starting instruction aiming at a subscription scene is received, determining whether the current shooting authority meets the preset shooting authority; if the current shooting authority meets the preset shooting authority, starting the camera based on the pre-defined shooting parameters, and displaying the image acquired by the started camera into a pre-defined user interface.
In one embodiment, after the processor performs the generation of the subscription video based on the target format image data and the target format audio file, the processor further performs the following operations:
when video recording is stopped, starting a timer to count down a preset time period; if a subscription video uploading instruction is received before the countdown is finished, the subscription video is sent to a blockchain for storage; or if the signing video uploading instruction is not received before the countdown is finished, acquiring a dynamic key table; acquiring an optimal dynamic key at the current moment from a dynamic key table; symmetric encryption is carried out on the subscription video by adopting an AES encryption algorithm and an optimal dynamic key, so as to generate an encrypted video, and the subscription video is deleted after the encrypted video is stored in a database; inquiring the encrypted video in the database according to the video identification when the video identification is received; the encrypted video is decrypted and then sent to a block chain for storage, and decrypted video data are deleted; each key in the dynamic key table is dynamically generated by adopting a preset rule in each preset period.
In one embodiment, the processor performs the following operations when sending the contracted video to the blockchain for saving:
transmitting a data saving request to the block chain and receiving random string information fed back from the block chain; feature coding is carried out on the signed video according to the random string information, so that certification storage information is obtained; constructing a merck tree for storing the evidence information by adopting a hash function, and calculating root hash values of all nodes in the merck tree; and constructing transaction data according to the root hash value of each node, and sending the transaction data to the blockchain for storage.
In one embodiment, the processor performs the following operations when the optimal dynamic key at the current time is to be obtained in the dynamic key table:
determining the importance level of a subscription scene; constructing a directed node diagram according to the sequence of each key generation moment in the dynamic key table; searching a target node in the directed node diagram by adopting a depth-first traversal algorithm according to the importance level; and determining the dynamic key on the target node as the optimal dynamic key at the current moment.
In one embodiment, the processor, when executing the construction of the target format image data from the original image sequence, specifically performs the following operations:
Coding the original image sequences one by one according to preset coding parameters to obtain coding feature map sequences; performing visual analysis on each feature map in the coding feature map sequence to obtain a plurality of analysis results; recording the code rate, the signal distortion degree and the visual analysis distortion degree of each original image corresponding to the analysis result; analyzing the relation between the signal distortion degree and the visual analysis distortion degree of each original image to obtain a joint distortion function; and according to the joint distortion function and the code rate of each original image, encoding each original image by adopting a preset image compression format to obtain image data in a target format.
In one embodiment, the processor, when executing the construction of the target format audio file from the original audio data, specifically performs the following operations:
framing the original audio data based on a preset audio framing device to obtain multi-frame audio signals; performing sparse Fourier transform on each frame of audio signal by adopting a basis function to obtain sparse coefficients and an edge information matrix of each frame of audio signal; and merging the sparse coefficient of each frame of audio signal and the edge information matrix, and coding the merged data by adopting a preset audio compression format to obtain the audio file in the target format.
In the embodiment of the application, when a video recording instruction is received, the subscription video generation system firstly acquires an original image sequence and original audio data in a subscription scene in real time, then constructs target format image data according to the original image sequence, constructs a target format audio file according to the original audio data, and finally synthesizes the target format image data and the target format audio file into the subscription video. According to the method and the device, the original image data and the original audio data collected by the camera are processed according to the unified format, so that the file sizes of the signed videos generated by different camera devices are consistent, meanwhile, the space occupied by the data can be greatly reduced by constructing the target format image data and the target format audio file, further, the time cost and the data flow of the subsequent processing of the videos are reduced, and the signing efficiency is improved.
In one embodiment, a medium storing computer-readable instructions that, when executed by one or more processors, cause the one or more processors to perform the steps of: collecting an original image sequence and original audio data in a subscription scene in real time; constructing target format image data according to the original image sequence; constructing a target format audio file according to the original audio data; and synthesizing the target format image data and the target format audio file into the subscription video.
In one embodiment, the processor performs the following operations when receiving the video recording instruction and before collecting the original image sequence and the original audio data in the subscription scene in real time:
when a camera starting instruction aiming at a subscription scene is received, determining whether the current shooting authority meets the preset shooting authority; if the current shooting authority meets the preset shooting authority, starting the camera based on the pre-defined shooting parameters, and displaying the image acquired by the started camera into a pre-defined user interface.
In one embodiment, after the processor performs the generation of the subscription video based on the target format image data and the target format audio file, the processor further performs the following operations:
when video recording is stopped, starting a timer to count down a preset time period; if a subscription video uploading instruction is received before the countdown is finished, the subscription video is sent to a blockchain for storage; or if the signing video uploading instruction is not received before the countdown is finished, acquiring a dynamic key table; acquiring an optimal dynamic key at the current moment from a dynamic key table; symmetric encryption is carried out on the subscription video by adopting an AES encryption algorithm and an optimal dynamic key, so as to generate an encrypted video, and the subscription video is deleted after the encrypted video is stored in a database; inquiring the encrypted video in the database according to the video identification when the video identification is received; the encrypted video is decrypted and then sent to a block chain for storage, and decrypted video data are deleted; each key in the dynamic key table is dynamically generated by adopting a preset rule in each preset period.
In one embodiment, the processor performs the following operations when sending the contracted video to the blockchain for saving:
transmitting a data saving request to the block chain and receiving random string information fed back from the block chain; feature coding is carried out on the signed video according to the random string information, so that certification storage information is obtained; constructing a merck tree for storing the evidence information by adopting a hash function, and calculating root hash values of all nodes in the merck tree; and constructing transaction data according to the root hash value of each node, and sending the transaction data to the blockchain for storage.
In one embodiment, the processor performs the following operations when the optimal dynamic key at the current time is to be obtained in the dynamic key table:
determining the importance level of a subscription scene; constructing a directed node diagram according to the sequence of each key generation moment in the dynamic key table; searching a target node in the directed node diagram by adopting a depth-first traversal algorithm according to the importance level; and determining the dynamic key on the target node as the optimal dynamic key at the current moment.
In one embodiment, the processor, when executing the construction of the target format image data from the original image sequence, specifically performs the following operations:
Coding the original image sequences one by one according to preset coding parameters to obtain coding feature map sequences; performing visual analysis on each feature map in the coding feature map sequence to obtain a plurality of analysis results; recording the code rate, the signal distortion degree and the visual analysis distortion degree of each original image corresponding to the analysis result; analyzing the relation between the signal distortion degree and the visual analysis distortion degree of each original image to obtain a joint distortion function; and according to the joint distortion function and the code rate of each original image, encoding each original image by adopting a preset image compression format to obtain image data in a target format.
In one embodiment, the processor, when executing the construction of the target format audio file from the original audio data, specifically performs the following operations:
framing the original audio data based on a preset audio framing device to obtain multi-frame audio signals; performing sparse Fourier transform on each frame of audio signal by adopting a basis function to obtain sparse coefficients and an edge information matrix of each frame of audio signal; and merging the sparse coefficient of each frame of audio signal and the edge information matrix, and coding the merged data by adopting a preset audio compression format to obtain the audio file in the target format.
In the embodiment of the application, when a video recording instruction is received, the subscription video generation system firstly acquires an original image sequence and original audio data in a subscription scene in real time, then constructs target format image data according to the original image sequence, constructs a target format audio file according to the original audio data, and finally synthesizes the target format image data and the target format audio file into the subscription video. According to the method and the device, the original image data and the original audio data collected by the camera are processed according to the unified format, so that the file sizes of the signed videos generated by different camera devices are consistent, meanwhile, the space occupied by the data can be greatly reduced by constructing the target format image data and the target format audio file, further, the time cost and the data flow of the subsequent processing of the videos are reduced, and the signing efficiency is improved.
Those skilled in the art will appreciate that implementing all or part of the above described methods may be accomplished by way of a computer program stored on a computer readable medium, which when executed may comprise the steps of the embodiments of the methods described above. The medium may be a nonvolatile medium such as a magnetic disk, an optical disk, a Read-Only Memory (ROM), or a random access Memory (Random Access Memory, RAM).
The technical features of the above embodiments may be arbitrarily combined, and all possible combinations of the technical features in the above embodiments are not described for brevity of description, however, as long as there is no contradiction between the combinations of the technical features, they should be considered as the scope of the description.
The foregoing examples illustrate only a few embodiments of the invention, which are described in detail and are not to be construed as limiting the scope of the invention. It should be noted that it will be apparent to those skilled in the art that several variations and modifications can be made without departing from the spirit of the invention, which are all within the scope of the invention. Accordingly, the scope of protection of the present invention is to be determined by the appended claims.

Claims (7)

1. A subscription video generation method, applied to a client, the method comprising:
when a video recording instruction is received, acquiring an original image sequence and original audio data in a subscription scene in real time;
constructing target format image data according to the original image sequence; wherein,
the constructing target format image data according to the original image sequence comprises the following steps:
Coding the original image sequences one by one according to preset coding parameters to obtain coding feature map sequences;
performing visual analysis on each feature map in the coding feature map sequence to obtain a plurality of analysis results;
recording the code rate, the signal distortion degree and the visual analysis distortion degree of each original image corresponding to the analysis result;
analyzing the relation between the signal distortion degree and the visual analysis distortion degree of each original image to obtain a joint distortion function;
according to the joint distortion function and the code rate of each original image, encoding each original image by adopting a preset image compression format to obtain image data in a target format;
constructing a target format audio file according to the original audio data; wherein,
the constructing a target format audio file according to the original audio data comprises the following steps:
framing the original audio data based on a preset audio framing device to obtain multi-frame audio signals;
performing sparse Fourier transform on each frame of audio signal by adopting a basis function to obtain sparse coefficients and an edge information matrix of each frame of audio signal;
combining the sparse coefficient of each frame of audio signal and the edge information matrix, and encoding the combined data by adopting a preset audio compression format to obtain a target format audio file;
Synthesizing the target format image data and the target format audio file into a subscription video; wherein,
after the target format image data and the target format audio file are synthesized into the subscription video, the method further comprises the following steps:
when video recording is stopped, starting a timer to count down a preset time period;
if a subscription video uploading instruction is received before the countdown is finished, the subscription video is sent to a block chain for storage;
if the signed video uploading instruction is not received before the countdown is finished, a dynamic key table is obtained;
acquiring an optimal dynamic key at the current moment from the dynamic key table;
symmetrically encrypting the subscription video by adopting an AES encryption algorithm and the optimal dynamic key to generate an encrypted video, and deleting the subscription video after storing the encrypted video into a database;
inquiring the encrypted video in the database according to the video identification when the video identification is received;
the encrypted video is decrypted and then sent to a blockchain for storage, and decrypted video data are deleted;
each key in the dynamic key table is dynamically generated by adopting a preset rule in each preset period.
2. The method according to claim 1, wherein before the capturing the original image sequence and the original audio data in the subscription scene in real time when the video recording command is received, the method further comprises:
when a camera starting instruction aiming at a subscription scene is received, determining whether the current shooting authority meets the preset shooting authority;
if the current shooting authority meets the preset shooting authority, starting the camera based on the pre-defined shooting parameters, and displaying the image acquired by the started camera into a pre-defined user interface.
3. The method of claim 1, wherein the sending the contracted video to a blockchain for saving comprises:
sending a data saving request to a block chain and receiving random string information fed back from the block chain;
feature coding is carried out on the signing video according to the random string information, so that certification storage information is obtained;
constructing a merck tree of the evidence storage information by adopting a hash function, and calculating root hash values of all nodes in the merck tree;
and constructing transaction data according to the root hash values of the nodes, and sending the transaction data to a blockchain for storage.
4. The method according to claim 1, wherein the obtaining the optimal dynamic key at the current time in the dynamic key table comprises:
Determining the importance level of the subscription scene;
constructing a directed node diagram according to the sequence of each key generation moment in the dynamic key table;
searching a target node in the directed node diagram by adopting a depth-first traversal algorithm according to the importance level;
and determining the dynamic key on the target node as the optimal dynamic key at the current moment.
5. A subscription video generation system, the system comprising:
the data acquisition module is used for acquiring an original image sequence and original audio data in a subscription scene in real time when receiving a video recording instruction;
the image data construction module is used for constructing image data in a target format according to the original image sequence;
the image data construction module is specifically configured to:
coding the original image sequences one by one according to preset coding parameters to obtain coding feature map sequences;
performing visual analysis on each feature map in the coding feature map sequence to obtain a plurality of analysis results;
recording the code rate, the signal distortion degree and the visual analysis distortion degree of each original image corresponding to the analysis result;
analyzing the relation between the signal distortion degree and the visual analysis distortion degree of each original image to obtain a joint distortion function;
According to the joint distortion function and the code rate of each original image, encoding each original image by adopting a preset image compression format to obtain image data in a target format;
the audio file construction module is used for constructing a target format audio file according to the original audio data;
the audio file construction module is specifically configured to:
framing the original audio data based on a preset audio framing device to obtain multi-frame audio signals;
performing sparse Fourier transform on each frame of audio signal by adopting a basis function to obtain sparse coefficients and an edge information matrix of each frame of audio signal;
combining the sparse coefficient of each frame of audio signal and the edge information matrix, and encoding the combined data by adopting a preset audio compression format to obtain a target format audio file;
the subscription video generation module is used for synthesizing the target format image data and the target format audio file into subscription video; wherein,
the subscription video generation system is also specifically configured to:
when video recording is stopped, starting a timer to count down a preset time period;
if a subscription video uploading instruction is received before the countdown is finished, the subscription video is sent to a block chain for storage;
If the signed video uploading instruction is not received before the countdown is finished, a dynamic key table is obtained;
acquiring an optimal dynamic key at the current moment from the dynamic key table;
symmetrically encrypting the subscription video by adopting an AES encryption algorithm and the optimal dynamic key to generate an encrypted video, and deleting the subscription video after storing the encrypted video into a database;
inquiring the encrypted video in the database according to the video identification when the video identification is received;
the encrypted video is decrypted and then sent to a blockchain for storage, and decrypted video data are deleted;
each key in the dynamic key table is dynamically generated by adopting a preset rule in each preset period.
6. A computer device comprising a memory and a processor, the memory having stored therein computer readable instructions which, when executed by the processor, cause the processor to perform the steps of the subscription video generation method of any of claims 1 to 4.
7. A medium storing computer readable instructions which, when executed by one or more processors, cause the one or more processors to perform the steps of the subscription video generation method of any one of claims 1 to 4.
CN202210681111.8A 2022-06-16 2022-06-16 Subscription video generation method, subscription video generation system, computer equipment and subscription video generation medium Active CN115086730B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN202210681111.8A CN115086730B (en) 2022-06-16 2022-06-16 Subscription video generation method, subscription video generation system, computer equipment and subscription video generation medium

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN202210681111.8A CN115086730B (en) 2022-06-16 2022-06-16 Subscription video generation method, subscription video generation system, computer equipment and subscription video generation medium

Publications (2)

Publication Number Publication Date
CN115086730A CN115086730A (en) 2022-09-20
CN115086730B true CN115086730B (en) 2024-04-02

Family

ID=83253439

Family Applications (1)

Application Number Title Priority Date Filing Date
CN202210681111.8A Active CN115086730B (en) 2022-06-16 2022-06-16 Subscription video generation method, subscription video generation system, computer equipment and subscription video generation medium

Country Status (1)

Country Link
CN (1) CN115086730B (en)

Citations (9)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CA2732550A1 (en) * 2010-02-26 2011-08-26 Research In Motion Limited Unified visual presenter
CN104899893A (en) * 2015-07-01 2015-09-09 电子科技大学 Image quality detection method based on vision attention
US9402050B1 (en) * 2015-05-07 2016-07-26 SnipMe, Inc. Media content creation application
CN109547198A (en) * 2018-11-16 2019-03-29 南京钟山虚拟现实技术研究院有限公司 The method and system of network transmission video file
CN110096944A (en) * 2019-02-15 2019-08-06 重庆易保全网络科技有限公司 A kind of signature method, system and the terminal device of electronic contract
WO2020050787A2 (en) * 2018-09-06 2020-03-12 Fenomen Medya Bi̇li̇şi̇m Ve Yazilim Anoni̇m Şi̇rketi̇ Video imitation and challenging system and method
CN111800575A (en) * 2020-06-30 2020-10-20 南京好签软件技术有限公司 On-line signing video recording device and recording method thereof
WO2021159689A1 (en) * 2020-02-14 2021-08-19 平安科技(深圳)有限公司 Electronic contract signing double-recording method and apparatus, and computer device and storage medium
CN114173150A (en) * 2021-12-22 2022-03-11 Oppo广东移动通信有限公司 Live video recording method, device and system and terminal equipment

Family Cites Families (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2005018136A1 (en) * 2003-07-11 2005-02-24 Canon Kabushiki Kaisha Key information processing method, device thereof, and program
US20130039633A1 (en) * 2011-08-10 2013-02-14 Cina Wong Method and system for document authentication
US11055436B2 (en) * 2019-05-03 2021-07-06 International Business Machines Corporation Conflict resolution for blockchain storage structure

Patent Citations (9)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CA2732550A1 (en) * 2010-02-26 2011-08-26 Research In Motion Limited Unified visual presenter
US9402050B1 (en) * 2015-05-07 2016-07-26 SnipMe, Inc. Media content creation application
CN104899893A (en) * 2015-07-01 2015-09-09 电子科技大学 Image quality detection method based on vision attention
WO2020050787A2 (en) * 2018-09-06 2020-03-12 Fenomen Medya Bi̇li̇şi̇m Ve Yazilim Anoni̇m Şi̇rketi̇ Video imitation and challenging system and method
CN109547198A (en) * 2018-11-16 2019-03-29 南京钟山虚拟现实技术研究院有限公司 The method and system of network transmission video file
CN110096944A (en) * 2019-02-15 2019-08-06 重庆易保全网络科技有限公司 A kind of signature method, system and the terminal device of electronic contract
WO2021159689A1 (en) * 2020-02-14 2021-08-19 平安科技(深圳)有限公司 Electronic contract signing double-recording method and apparatus, and computer device and storage medium
CN111800575A (en) * 2020-06-30 2020-10-20 南京好签软件技术有限公司 On-line signing video recording device and recording method thereof
CN114173150A (en) * 2021-12-22 2022-03-11 Oppo广东移动通信有限公司 Live video recording method, device and system and terminal equipment

Also Published As

Publication number Publication date
CN115086730A (en) 2022-09-20

Similar Documents

Publication Publication Date Title
US11023618B2 (en) Systems and methods for detecting modifications in a video clip
CN108683826B (en) Video data processing method, video data processing device, computer equipment and storage medium
US11323407B2 (en) Methods, systems, apparatuses, and devices for facilitating managing digital content captured using multiple content capturing devices
US9210372B2 (en) Communication method and device for video simulation image
WO2019227429A1 (en) Method, device, apparatus, terminal, server for generating multimedia content
Huamán et al. Authentication and integrity of smartphone videos through multimedia container structure analysis
KR20150083491A (en) Methed and system for synchronizing usage information between device and server
CN111698522A (en) Live system based on mixed reality
KR102130076B1 (en) Method for improving the resolution of streaming files based on the learning importance of feature areas
CN115086730B (en) Subscription video generation method, subscription video generation system, computer equipment and subscription video generation medium
CN110661805B (en) Data processing method, device, storage medium and client
CN114466145B (en) Video processing method, device, equipment and storage medium
JP2017192080A (en) Image compression device, image decoding device, image compression method, and image compression program
EP3985989A1 (en) Detection of modification of an item of content
JP3859989B2 (en) Image matching method and image processing method and apparatus capable of using the method
US11469881B2 (en) Apparatus and method for forgery prevention of digital information
CN114666622A (en) Special effect video determination method and device, electronic equipment and storage medium
WO2020175176A1 (en) Information processing device and method, and reproduction device and method
CN113992866B (en) Video production method and device
KR102130078B1 (en) System for changing AI parameters based on resolution improvement
KR102130077B1 (en) System to improve the resolution based on pattern information of grid generation
CN114220051B (en) Video processing method, application program testing method and electronic equipment
US20210287322A1 (en) Robust selective image, video, and audio content authentication
CN114298931A (en) Image processing method, image processing device, electronic equipment and storage medium
JP2008165559A (en) Information delivery device and program

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant