CN108388649A - Handle method, system, equipment and the storage medium of audio and video - Google Patents

Handle method, system, equipment and the storage medium of audio and video Download PDF

Info

Publication number
CN108388649A
CN108388649A CN201810167141.0A CN201810167141A CN108388649A CN 108388649 A CN108388649 A CN 108388649A CN 201810167141 A CN201810167141 A CN 201810167141A CN 108388649 A CN108388649 A CN 108388649A
Authority
CN
China
Prior art keywords
video
audio
mentioned
location information
recording
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Granted
Application number
CN201810167141.0A
Other languages
Chinese (zh)
Other versions
CN108388649B (en
Inventor
袁晖
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Shenzhen quanbaotong Network Technology Co.,Ltd.
Original Assignee
Shenzhen Comexe Ikang Science And Technology Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Shenzhen Comexe Ikang Science And Technology Co Ltd filed Critical Shenzhen Comexe Ikang Science And Technology Co Ltd
Priority to CN201810167141.0A priority Critical patent/CN108388649B/en
Priority to PCT/CN2018/091115 priority patent/WO2019165723A1/en
Publication of CN108388649A publication Critical patent/CN108388649A/en
Application granted granted Critical
Publication of CN108388649B publication Critical patent/CN108388649B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/40Information retrieval; Database structures therefor; File system structures therefor of multimedia data, e.g. slideshows comprising image and additional audio data
    • G06F16/48Retrieval characterised by using metadata, e.g. metadata not derived from the content or metadata generated manually
    • G06F16/489Retrieval characterised by using metadata, e.g. metadata not derived from the content or metadata generated manually using time information
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N5/00Details of television systems
    • H04N5/76Television signal recording
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/40Information retrieval; Database structures therefor; File system structures therefor of multimedia data, e.g. slideshows comprising image and additional audio data
    • G06F16/48Retrieval characterised by using metadata, e.g. metadata not derived from the content or metadata generated manually
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/40Information retrieval; Database structures therefor; File system structures therefor of multimedia data, e.g. slideshows comprising image and additional audio data
    • G06F16/48Retrieval characterised by using metadata, e.g. metadata not derived from the content or metadata generated manually
    • G06F16/487Retrieval characterised by using metadata, e.g. metadata not derived from the content or metadata generated manually using geographical or spatial information, e.g. location
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N5/00Details of television systems
    • H04N5/76Television signal recording
    • H04N5/91Television signal processing therefor

Abstract

Present invention is disclosed a kind of method, system, equipment and the storage mediums of processing audio and video, and method includes step:Generate location information label, environment weather information labels and the temporal information label of recording audio/video position;The identical history audio and video of described information label are matched from database;Target audio and video are generated according to the recording audio/video and the processing of history audio and video.The method of processing audio and video of the present invention, system, equipment and storage medium have the beneficial effect that:By the location information label, environment weather information labels and temporal information label that add position for recording audio/video, enable the reference by the identical history audio and video of information labels as the recording audio/video when handling audio and video, so as to more accurately by audio and video into edlin and processing, operation difficulty and the operating time of user are reduced, and improves the authenticity of target audio and video after processing.

Description

Handle method, system, equipment and the storage medium of audio and video
Technical field
The present invention relates to field of wireless communication, especially relate to a kind of method of processing audio and video, system, equipment and Storage medium.
Background technology
With the continuous development of photography technology, more and more users can voluntarily shoot audio and video by video camera, be The quality for ensureing audio and video is usually also needed to the audio and video of shooting into edlin, such as right audio and video are shot after the completion of Partial Fragment in audio and video extracts, deletes and merges.
In the prior art, when user needs to audio and video into edlin, user usually requires to pass through personal computer Download and install the audio and video software for editing, such as Adobe After Effects or Adobe Premiere etc. of profession.
Existing audio and video software for editing be usually according to embedded algorithm to audio and video edit segment and nearby content into Row intelligence computation obtains edited audio-video frequency content, and the algorithm dependence that this kind of method embeds software is strong, audio and video editor Authenticity afterwards is relatively low, and the profile of the accuracy and user that depend primarily on algorithm is horizontal, to user and editor The requirement of machine is high, the experience of strong influence user.
Invention content
The main object of the present invention is to provide a kind of method, system, equipment and the storage medium of processing audio and video, and raising is repaiied Change the authenticity of rear audio and video Scene.
The present invention proposes a kind of method of processing audio and video, including step to achieve the above object:
Generate location information label, environment weather information labels and the temporal information label of recording audio/video position;
It is matched from database identical as above-mentioned location information label, environment weather information labels and temporal information label Or approximate history audio and video;
Target audio and video are generated according to above-mentioned recording audio/video and the processing of history audio and video.
Further, in the method for above-mentioned processing audio and video, the step of above-mentioned processing generates target audio and video, including Step:
Choose the target area in above-mentioned recording audio/video;
Obtain the image data that target area is corresponded in above-mentioned history audio and video;
The image data that above-mentioned image data is replaced to above-mentioned target area generates above-mentioned target audio and video.
Further, in the method for above-mentioned processing audio and video, the step of above-mentioned processing generates target audio and video, including Step:
Choose the target image in above-mentioned recording audio/video and above-mentioned history audio and video;
Above-mentioned target image is integrated to obtain the three-dimensional data of above-mentioned target image;
Above-mentioned target audio and video are generated according to the three-dimensional data of above-mentioned target image.
Further, in the method for above-mentioned processing audio and video, the correspondence location information of above-mentioned generation recording audio/video The step of label, environment weather information labels and temporal information label, including step:
Obtain the location information of camera-shooting and recording device position;
The real time environment weather information and current time of above-mentioned location information corresponding position are obtained according to above-mentioned location information Information;
According to above-mentioned location information, real time environment weather information and current time information generate above-mentioned location information label, Environment weather information labels and temporal information label are simultaneously attached in above-mentioned recording audio/video.
Further, in the method for above-mentioned processing audio and video, in determining for above-mentioned generation recording audio/video position Further include step before the step of position information labels, environment weather information labels and temporal information label:
Generate the sound of the content combination of corresponding different location information labels, environment weather information labels and temporal information label List of videos;
It obtains corresponding with above-mentioned audio and video list history audio and video, and above-mentioned history audio and video is stored on corresponding It states in audio and video list;
It collects above-mentioned audio and video list and content to form above-mentioned database.
Further, in the method for above-mentioned processing audio and video, above-mentioned acquisition is corresponding with above-mentioned audio and video list to go through The step of history audio and video, including step:
By the way that existing audio and video in cloud shared data bank are carried out location information calculating, environment weather information inquiry and record The corresponding time judgement of system generates above-mentioned history audio and video.
Further, in the method for above-mentioned processing audio and video, above-mentioned location information calculating includes step:
Extract the picture of designated frame number in above-mentioned audio and video;
Significant image in above-mentioned picture is subjected to image recognition and search obtains the institute possession of above-mentioned significant image Manage position;
The size between the dimension scale and corresponding material object of image is specified according to two or more in above-mentioned picture Ratio calculates the recording distance of above-mentioned audio and video;
Above-mentioned location information is calculated according to the content of above-mentioned significant image, geographical location and recording distance.
The present invention proposes a kind of system of processing audio and video to achieve the above object, including:
Generation module, for generate the location information label of recording audio/video position, environment weather information labels and Temporal information label;
Matching module, for matching the identical history audio and video of above- mentioned information label from database;
Processing module, for generating target audio and video according to above-mentioned recording audio/video and the processing of history audio and video.
The present invention proposes a kind of computer equipment to achieve the above object, including memory, processor and is stored in On reservoir and the computer program that can run on a processor, above-mentioned processor realize such as above-described embodiment when executing above procedure Any one of above-mentioned method.
The present invention proposes a kind of computer readable storage medium to achieve the above object, is stored thereon with computer program, It is realized such as any one of above-described embodiment above-mentioned method when the program is executed by processor.
The method of processing audio and video of the present invention, system, equipment and storage medium have the beneficial effect that:By for record sound Location information label, environment weather information labels and the temporal information label of Video Add-On position make in processing audio and video When can be by the identical history audio and video of information labels as the reference of the recording audio/video, so as to more accurately regard sound Frequency into edlin and processing, reduce operation difficulty and the operating time of user, and improve processing after target audio and video it is true Reality.
Description of the drawings
Fig. 1 is the flow diagram of the method for the processing audio and video of one embodiment of the invention;
Fig. 2 is the flow diagram of the method for the processing audio and video of one embodiment of the invention;
Fig. 3 is the flow diagram of the method for the processing audio and video of one embodiment of the invention;
Fig. 4 is the flow diagram of the method for the processing audio and video of one embodiment of the invention;
Fig. 5 is the flow diagram of the method for the processing audio and video of one embodiment of the invention;
Fig. 6 is the flow diagram of the method for the processing audio and video of one embodiment of the invention;
Fig. 7 is the flow diagram of the method for the processing audio and video of one embodiment of the invention;
Fig. 8 is the modular structure schematic diagram of the system of the processing audio and video of one embodiment of the invention;
Fig. 9 is the modular structure schematic diagram of the system of the processing audio and video of one embodiment of the invention;
Figure 10 is the modular structure schematic diagram of the system of the processing audio and video of one embodiment of the invention;
Figure 11 is the modular structure schematic diagram of the system of the processing audio and video of one embodiment of the invention;
Figure 12 is the modular structure schematic diagram of the system of the processing audio and video of one embodiment of the invention;
Figure 13 is the modular structure schematic diagram of the system of the processing audio and video of one embodiment of the invention;
Figure 14 is the modular structure schematic diagram of the system of the processing audio and video of one embodiment of the invention;
Figure 15 is a kind of structural schematic diagram of computer equipment of one embodiment of the invention.
12, computer equipment;14, external equipment;16, processing unit;18, bus;20, network adapter;22、(I/O) Interface;24, display;28, system storage;30, random access memory (RAM);32, cache memory;34, it stores System;40, program/utility;42, program module;101, generation module;102, matching module;103, processing module;111、 First acquisition submodule;112, the second acquisition submodule;113, additional submodule;131, first module is chosen;132, picture number According to module;133, replacement module;134, second module is chosen;135, module is integrated;136, audio and video generation module;401, it stores Module;501, List Generating Module;601, list memory module;610, history trendline submodule;611, submodule is extracted;612、 Identify submodule;613, the first computational submodule;614, the second computational submodule;620, prerecording submodule;701, list is returned Collect module.
The object of the invention is realized, the embodiments will be further described with reference to the accompanying drawings for functional characteristics and advantage.
Specific implementation mode
Following will be combined with the drawings in the embodiments of the present invention, and technical solution in the embodiment of the present invention carries out clear, complete Site preparation describes, it is clear that described embodiment is only a part of the embodiment of the present invention, instead of all the embodiments.Base Embodiment in the present invention, those of ordinary skill in the art obtained without creative efforts it is all its His embodiment, shall fall within the protection scope of the present invention.
In addition, the description for being related to " first ", " second " etc. in the present invention is used for description purposes only, and should not be understood as referring to Show or imply its relative importance or implicitly indicates the quantity of indicated technical characteristic." first ", " are defined as a result, Two " feature can explicitly or implicitly include at least one of the features.In addition, the technical solution between each embodiment can To be combined with each other, but must can be implemented as basis with those of ordinary skill in the art, when the combination of technical solution occurs Conflicting or cannot achieve when, will be understood that the combination of this technical solution is not present, also not the present invention claims protection model Within enclosing.
Referring to Fig.1, in embodiments of the present invention, the present invention provides a kind of method of processing audio and video, including step:
S101, location information label, environment weather information labels and the temporal information for generating recording audio/video position Label;
S102, it is matched from database and above-mentioned location information label, environment weather information labels and temporal information mark Sign identical or approximate history audio and video;
S103, target audio and video are generated according to above-mentioned recording audio/video and the processing of history audio and video.
Such as above-mentioned steps S101, location information label, the environment weather information labels of recording audio/video position are generated The location information of position is carried out to the recording arrangement after the completion of above-mentioned recording audio/video is recorded with temporal information label It obtains, and the location information got is integrated in the data of above-mentioned recording audio/video, form determining for above-mentioned recording audio/video Position information labels, above-mentioned location information label is generally using longitude and latitude as performance numerical value, after confirming above-mentioned location information label, The environment weather parameter and real-time time of this area are inquired according to the location information of above-mentioned location information label, which generally wraps --- but being not limited to --- temperature, air pressure, humidity, wind direction, wind speed, intensity of illumination, uitraviolet intensity and weather are included, by above-mentioned ring Border meteorologic parameter and real-time time are integrated in the data of above-mentioned recording audio/video, obtain above-mentioned environment weather information labels and when Between information labels,
Such as above-mentioned steps S102, matched from database with above-mentioned location information label, environment weather information labels and Temporal information label is identical or approximate history audio and video, in the database to above-mentioned location information label, environment weather information Label and temporal information label carry out matching search and are marked with identical above-mentioned location information mark with above-mentioned recording audio/video to obtain Label, environment weather information labels and temporal information label and history audio and video,
Such as above-mentioned steps S103, target audio and video are generated according to above-mentioned recording audio/video and the processing of history audio and video, are passed through Above-mentioned steps S102 is got editing and processing is carried out to obtain processing to above-mentioned recording audio/video after enough history audio and video after Above-mentioned target audio and video, wherein above-mentioned target audio and video generally comprise --- but being not limited to --- 3D audio and video or specific field Scape audio and video etc., above-mentioned processing generally comprise --- but being not limited to --- video trimming and deletion or increase video in specify figure Picture can also carry out above-mentioned recording audio/video wherein after getting enough history audio and video in S102 through the above steps The detection of authenticity, the detection process only need the diversity ratio by comparing above-mentioned history audio and video and above-mentioned recording audio/video Example, you can show whether video is modified, the detection process is than now by checking whether video data has modification trace Mark is easier, it is shorter to take.
With reference to Fig. 2, in the present embodiment, in the method for above-mentioned processing audio and video, above-mentioned processing generates target sound and regards The step of frequency, including step:
Target area in S131, the above-mentioned recording audio/video of selection;
S132, the image data that target area is corresponded in above-mentioned history audio and video is obtained;
S133, the image data that above-mentioned image data is replaced to above-mentioned target area generate above-mentioned target audio and video.
Such as above-mentioned steps S131, choose the target area in above-mentioned recording audio/video, choose target area be generally from Specify a frame picture basic as choosing in above-mentioned recording audio/video, wherein above-mentioned target area is generally on-fixed region, when After user chooses above-mentioned target area, the target image in above-mentioned target area is selected, states target figure in the choice As after, the identification of target image is carried out to obtain and above-mentioned target image phase to remaining frame number picture in above-mentioned recording audio/video The image position is simultaneously newly defined as above-mentioned target area by same or similar image, to obtain the movement of target area Track,
Such as above-mentioned steps S132, the image data that target area is corresponded in above-mentioned history audio and video is obtained, in above-mentioned steps After S131 is executed, the movement locus of above-mentioned target area is arranged in above-mentioned history audio and video, and obtain above-mentioned target area Movement locus say covering image data,
Such as above-mentioned steps S133, the image data that above-mentioned image data is replaced to above-mentioned target area generates above-mentioned target sound Video.
With reference to Fig. 3, in the present embodiment, in the method for above-mentioned processing audio and video, above-mentioned processing generates target sound and regards The step of frequency, including step:
Target image in S134, the above-mentioned recording audio/video of selection and above-mentioned history audio and video;
S135, above-mentioned target image is integrated to obtain the three-dimensional data of above-mentioned target image;
S136, above-mentioned target audio and video are generated according to the three-dimensional data of above-mentioned target image.
Such as above-mentioned steps S134, the target image in above-mentioned recording audio/video and above-mentioned history audio and video, user are chosen Choose corresponding target image respectively from above-mentioned recording audio/video and history audio and video, each from above-mentioned recording audio/video or on It states the target image chosen in history audio and video and is generally --- but being not limited to --- and object or scene is specified to be regarded in the audio and video Image under angle, wherein above-mentioned image generally comprises --- but being not limited to ---, and this specifies object or front view, the backsight of scene Multiple in figure, left view, right view, top and bottom perspective views, can also according to the quantity of practical above-mentioned history audio and video with And record difference or image or the corresponding visual angle of reduction of specifying the complexity of object or scene to increase other visual angles at visual angle Image;
Such as above-mentioned steps S135, above-mentioned target image is integrated to obtain the three-dimensional data of above-mentioned target image, will be led to It crosses the above-mentioned target image that above-mentioned steps S134 is obtained and carries out corresponding three-dimensional merging, be integrally formed the three-dimensional of above-mentioned target image Data, to obtain the 3-D view for specifying object or scene,
Such as above-mentioned steps S136, above-mentioned target audio and video are generated according to the three-dimensional data of above-mentioned target image, according to above-mentioned The three-dimensional data of target image, i.e., the audio or video image generation that the 3-D view cooperation of specified object or scene is specified are above-mentioned Target audio and video.
With reference to Fig. 4, in the present embodiment, in the method for above-mentioned processing audio and video, above-mentioned generation recording audio/video The step of corresponding location information label, environment weather information labels and temporal information label, including step:
S111, the location information for obtaining camera-shooting and recording device position;
S112, the real time environment weather information that above-mentioned location information corresponding position is obtained according to above-mentioned location information and current Temporal information;
S113, above-mentioned location information is generated according to above-mentioned location information, real time environment weather information and current time information Label, environment weather information labels and temporal information label are simultaneously attached in above-mentioned recording audio/video.
Such as above-mentioned steps S111, the location information of camera-shooting and recording device position is obtained, is obtaining video recording equipment position Location information when the location information that obtains be generally --- but being not limited to --- longitude and latitude, further include height above sea level, but when sea Degree of lifting on the contents of audio and video influence it is smaller in addition without when, user can cancel the acquisition to height above sea level manually, only preserve Longitude and latitude,
Such as above-mentioned steps S112, the real time environment that above-mentioned location information corresponding position is obtained according to above-mentioned location information is meteorological Information and current time information work as ground vapour after S111 through the above steps obtains above-mentioned location information by connection this area Image information shared platform or weather site obtain the environment weather information of corresponding position, in the local weather information by this area While shared platform or weather site obtain the environment weather information of corresponding position, the synchronization of real-time time is carried out, to obtain The above-mentioned current time information of corresponding position, above-mentioned current time information are generally the corresponding time zone real-time time in the position, obtain Take above-mentioned current time information can also by obtaining the recording initial time of above-mentioned recording audio/video or record the end time, then Each frame time of above-mentioned recording audio/video is converted according to the timing module in recording arrangement,
Such as above-mentioned steps S113, generated according to above-mentioned location information, real time environment weather information and current time information It states location information label, environment weather information labels and temporal information label and is attached in above-mentioned recording audio/video.
With reference to Fig. 5, in the present embodiment, in the method for above-mentioned processing audio and video, above-mentioned according to above-mentioned recording sound Generally further include step after the step of video and the processing of history audio and video generate target audio and video:
S401, above-mentioned recording audio/video is stored into the corresponding audio and video list of above-mentioned database.
Such as above-mentioned steps S401, above-mentioned recording audio/video is stored into the corresponding audio and video list of above-mentioned database, After above-mentioned steps S103 is executed, above-mentioned recording audio/video is stored to corresponding above-mentioned audio and video list to reach the above-mentioned sound of update The purpose of list of videos has reached and update synchronous to the optimization of scene change on position.
With reference to Fig. 5, in the present embodiment, in the method for above-mentioned processing audio and video, in above-mentioned generation recording audio/video Further include step before the step of location information label of position, environment weather information labels and temporal information label:
S501, the content group for generating corresponding different location information labels, environment weather information labels and temporal information label The audio and video list of conjunction;
S601, history audio and video corresponding with above-mentioned audio and video list are obtained, and above-mentioned history audio and video is stored to right In the above-mentioned audio and video list answered;
S701, it collects above-mentioned audio and video list and content to form above-mentioned database.
Such as above-mentioned steps S501, corresponding different location information labels, environment weather information labels and temporal information mark are generated The audio and video list of the content combination of label, believes according to different above-mentioned location information labels, environment weather information labels and time Cease the different above-mentioned audio and video list of the content combination producing of label, and the above-mentioned positioning letter in different above-mentioned audio and video lists The above combination for ceasing label, environment weather information labels and temporal information label is different,
Such as above-mentioned steps S601, history audio and video corresponding with above-mentioned audio and video list are obtained, and above-mentioned history sound is regarded Frequency is stored into corresponding above-mentioned audio and video list, after above-mentioned steps S501 is executed, according to the above-mentioned audio and video list of generation Corresponding history audio and video are stored to above-mentioned audio and video list, wherein the method for obtaining above-mentioned history audio and video is generally wrapped --- but being not limited to --- is included to carry out prerecording or obtained from cloud shared data bank,
Such as above-mentioned steps S701, collects above-mentioned audio and video list and content to form above-mentioned database, work as above-mentioned steps After S601 is executed, the audio and video list of above-mentioned generation and the above-mentioned history audio and video for being stored in list are integrated into above-mentioned data Library.
With reference to Fig. 6, in the present embodiment, in the method for above-mentioned processing audio and video, above-mentioned acquisition and above-mentioned audio and video The step of list corresponding history audio and video, including step:
S610, by the way that existing audio and video in cloud shared data bank are carried out location information calculating, environment weather information is looked into It askes and records corresponding time judgement and generate above-mentioned history audio and video.
Such as above-mentioned steps S610, by the way that existing audio and video in cloud shared data bank are carried out location information calculating, environment Weather information is inquired and is recorded corresponding time judgement and generates above-mentioned history audio and video.
With reference to Fig. 6, in a specific the present embodiment, in the method for above-mentioned processing audio and video, above-mentioned acquisition with it is above-mentioned The step of audio and video list corresponding history audio and video, can also be replaced above-mentioned steps S610 by step once, the step Suddenly include:
S620, the prerecording for carrying out audio and video simultaneously add it corresponding location information label, environment weather information labels Above-mentioned history audio and video are formed with temporal information label.
Such as above-mentioned steps S620, carries out the prerecording of audio and video and add corresponding location information label, environment gas to it Image information label and temporal information label form above-mentioned history audio and video, by a large amount of audio and video of prerecording and will be corresponding fixed Position information labels, environment weather information labels and temporal information label form above-mentioned history sound after being attached in the audio and video and regard Frequently.
With reference to Fig. 7, in the present embodiment, in the method for above-mentioned processing audio and video, above-mentioned location information calculating includes Step:
S611, the picture for extracting designated frame number in above-mentioned audio and video;
S612, the institute that the significant image in above-mentioned picture is carried out to image recognition and the above-mentioned significant image of search acquisition Belong to geographical location;
S613, the dimension scale that image is specified according to two or more in above-mentioned picture and it is corresponding in kind between Dimension scale calculates the recording distance of above-mentioned audio and video;
S614, above-mentioned location information is calculated according to the content of above-mentioned significant image, geographical location and recording distance.
Such as above-mentioned steps S611, the picture of designated frame number in above-mentioned audio and video is extracted, wherein the picture of above-mentioned specified frame number Generally include prominent identification feature or it is significant change face, such as landmark, article, personage,
Such as above-mentioned steps S612, the significant image in above-mentioned picture is subjected to image recognition and search obtains above-mentioned mark Property image affiliated geographical location, wherein the general user again of the significant image chooses, when user abandons choosing The region that color of image otherness larger region or history select number more in selection picture is defined as significant image, Above-mentioned significant image includes at least one, it is generally preferable to including --- but being not limited to --- two,
Such as above-mentioned steps S613, the dimension scale and correspondence of image are specified according to two or more in above-mentioned picture Dimension scale between material object calculates the recording distance of above-mentioned audio and video, obtains the ruler of multiple specified images in above-mentioned picture The ratio of the distance between very little ratio or two images and actual scene, to obtain in above-mentioned recording arrangement and specified image The recording distance of actual scene,
Such as above-mentioned steps S614, it is calculated according to the content of above-mentioned significant image, geographical location and recording distance State location information.
With reference to Fig. 8, in embodiments of the present invention, the present invention provides a kind of system of processing audio and video, including:
Generation module 101, location information label, environment weather information labels for generating recording audio/video position With temporal information label;
Matching module 102, for matched from database with above-mentioned location information label, environment weather information labels and Temporal information label is identical or approximate history audio and video;
Processing module 103, for generating target audio and video according to above-mentioned recording audio/video and the processing of history audio and video.
Above-mentioned generation module 101 is generally used for generating location information label, the environment weather of recording audio/video position Information labels and temporal information label carry out position after the completion of above-mentioned recording audio/video is recorded to the recording arrangement Location information obtains, and the location information got is integrated in the data of above-mentioned recording audio/video, forms above-mentioned recording sound The location information label of video, above-mentioned location information label are confirming above-mentioned positioning letter generally using longitude and latitude as performance numerical value After ceasing label, the environment weather parameter and real-time time of this area are inquired according to the location information of above-mentioned location information label, it should Parameter generally comprises --- but being not limited to --- temperature, air pressure, humidity, wind direction, wind speed, intensity of illumination, uitraviolet intensity and day Above-mentioned environment weather parameter and real-time time are integrated in the data of above-mentioned recording audio/video, obtain above-mentioned environment weather by gas Information labels and temporal information label,
Above-mentioned matching module 102 is generally used for matching from from database and above-mentioned location information label, environment weather Information labels are identical with temporal information label or approximate history audio and video, in the database to above-mentioned location information label, ring Border weather information label and temporal information label carry out matching search with obtain be marked with above-mentioned recording audio/video it is identical above-mentioned Location information label, environment weather information labels and temporal information label and history audio and video,
Above-mentioned processing module 103 is generally used for generating target sound according to above-mentioned recording audio/video and the processing of history audio and video Video is got after enough history audio and video to above-mentioned recording audio/video by above-mentioned matching module 102 into edlin Processing is with the above-mentioned target audio and video that obtain that treated, wherein above-mentioned target audio and video generally comprise --- but being not limited to --- 3D audio and video or special scenes audio and video etc., above-mentioned processing generally comprise --- but being not limited to --- video trimming and deletion or Increase and specifies image in video, wherein after getting enough history audio and video by above-mentioned matching module 102, it can also be right Above-mentioned recording audio/video carries out the detection of authenticity, which only needs by comparing above-mentioned history audio and video and above-mentioned record The difference ratio of audio and video processed, you can show whether video is modified, the detection process is than now by checking video Whether data have modification trace easier, time-consuming shorter.
With reference to Fig. 9, in the present embodiment, in the system of above-mentioned processing audio and video, above-mentioned processing module 103 includes:
First chooses module 131, for choosing the target area in above-mentioned recording audio/video;
Image data module 132, for obtaining the image data for corresponding to target area in above-mentioned history audio and video;
Replacement module 133, the image data for above-mentioned image data to be replaced to above-mentioned target area generate above-mentioned target Audio and video.
Above-mentioned first chooses module 131, is generally used for choosing the target area in above-mentioned recording audio/video, is choosing target Region is to specify a frame picture basic as choosing generally from above-mentioned recording audio/video, wherein above-mentioned target area is generally On-fixed region selects the target image in above-mentioned target area, is selecting after user chooses above-mentioned target area After selecting above-mentioned target image, in above-mentioned recording audio/video remaining frame number picture carry out target image identification with obtain with it is upper It states the same or similar image of target image and the image position is newly defined as above-mentioned target area, to obtain mesh The movement locus in region is marked,
Above-mentioned image data module 132 is generally used for obtaining the picture number for corresponding to target area in above-mentioned history audio and video According to after above-mentioned first chooses the execution of module 131, by the movement locus setting of above-mentioned target area in above-mentioned history audio and video In, and the movement locus for obtaining above-mentioned target area says the image data of covering,
Above-mentioned replacement module 133, the image data for being generally used for replacing above-mentioned image data above-mentioned target area generate Above-mentioned target audio and video.
Referring to Fig.1 0, in the present embodiment, in the system of above-mentioned processing audio and video, above-mentioned processing module 103 includes:
Second chooses module 134, for choosing the target image in above-mentioned recording audio/video and above-mentioned history audio and video;
Module 135 is integrated, the three-dimensional data of above-mentioned target image is obtained for being integrated above-mentioned target image;
Audio and video generation module 136, for generating above-mentioned target audio and video according to the three-dimensional data of above-mentioned target image.
Above-mentioned second chooses module 134, is generally used for choosing the mesh in above-mentioned recording audio/video and above-mentioned history audio and video Logo image, user chooses corresponding target image respectively from above-mentioned recording audio/video and history audio and video, each from above-mentioned The target image chosen in recording audio/video or above-mentioned history audio and video is generally --- but being not limited to --- and specifies object or field Image of the scape under the audio and video visual angle, wherein above-mentioned image generally comprises --- but being not limited to ---, and this specifies object or field Multiple in the front view of scape, rearview, left view, right view, top and bottom perspective views, can also be according to practical above-mentioned history The quantity of audio and video and the difference or the image for specifying the complexity of object or scene to increase other visual angles for recording visual angle Or reduce the image at corresponding visual angle;
Above-mentioned integration module 135 is generally used for being integrated above-mentioned target image to obtain the three-dimensional of above-mentioned target image Data carry out corresponding three-dimensional merging by the above-mentioned target image that module 134 obtains is chosen by above-mentioned second, are integrally formed The three-dimensional data for stating target image, to obtain the 3-D view for specifying object or scene,
Above-mentioned audio and video generation module 136 is generally used for generating above-mentioned target according to the three-dimensional data of above-mentioned target image Audio and video, according to the three-dimensional data of above-mentioned target image, i.e., the specified audio of the 3-D view cooperation of specified object or scene or Video image generates above-mentioned target audio and video.
Referring to Fig.1 1, in the present embodiment, in the system of above-mentioned processing audio and video, above-mentioned generation module 101 includes:
First acquisition submodule 111, the location information for obtaining camera-shooting and recording device position;
Second acquisition submodule 112, for obtaining the real-time of above-mentioned location information corresponding position according to above-mentioned location information Environment weather information and current time information;
Additional submodule 113, for being generated according to above-mentioned location information, real time environment weather information and current time information Above-mentioned location information label, environment weather information labels and temporal information label are simultaneously attached in above-mentioned recording audio/video.
Above-mentioned first acquisition submodule 111 is generally used for obtaining the location information of camera-shooting and recording device position, be recorded obtaining As equipment position location information when the location information that obtains be generally --- but being not limited to --- longitude and latitude, further include sea Degree of lifting, but when height above sea level on the contents of audio and video influence it is smaller in addition without when, user can manually cancel to height above sea level Acquisition, only preserve longitude and latitude,
Above-mentioned second acquisition submodule 112 is generally used for corresponding to position according to the above-mentioned location information of above-mentioned location information acquisition The real time environment weather information and current time information set are believed obtaining above-mentioned positioning by above-mentioned first acquisition submodule 111 The environment weather information of corresponding position is obtained after breath by the local Meteorological Information Sharing Platform or weather site that connect this area, While obtaining the environment weather information of corresponding position by the local Meteorological Information Sharing Platform or weather site of this area, The synchronization for carrying out real-time time, to obtain the above-mentioned current time information of corresponding position, above-mentioned current time information generally should The corresponding time zone real-time time in position, obtaining above-mentioned current time information can also be by the recording of the above-mentioned recording audio/video of acquisition Initial time or record the end time, further according to the timing module in recording arrangement by each frame time of above-mentioned recording audio/video into Row conversion,
Above-mentioned additional submodule 113 is generally used for according to above-mentioned location information, real time environment weather information and current time Information generates above-mentioned location information label, environment weather information labels and temporal information label and is attached to above-mentioned recording audio/video In.
Referring to Fig.1 2, in the present embodiment, in the system of above-mentioned processing audio and video, generally further include:
Memory module 401, for storing above-mentioned recording audio/video into the corresponding audio and video list of above-mentioned database.
Above-mentioned memory module 401 is generally used for above-mentioned recording audio/video storing audio and video corresponding to above-mentioned database In list, after the execution of above-mentioned processing module 103, above-mentioned recording audio/video is stored to corresponding above-mentioned audio and video list to reach To the purpose for updating above-mentioned audio and video list, and update synchronous to the optimization of scene change on position is had reached.
Referring to Fig.1 2, in the present embodiment, in the system of above-mentioned processing audio and video, further include:
List Generating Module 501, for generating corresponding different location information labels, environment weather information labels and time letter Cease the audio and video list of the content combination of label;
List memory module 601, for obtaining corresponding with above-mentioned audio and video list history audio and video, and by above-mentioned history Audio and video are stored into corresponding above-mentioned audio and video list;
List collects module 701, for collecting above-mentioned audio and video list and content to form above-mentioned database.
Above-mentioned List Generating Module 501 is generally used for generating corresponding different location information labels, environment weather information labels The audio and video list combined with the content of temporal information label, according to different above-mentioned location information labels, environment weather information The label above-mentioned audio and video list different with the content combination producing of temporal information label, and in different above-mentioned audio and video lists Above-mentioned location information label, the above combination of environment weather information labels and temporal information label it is different,
Above-mentioned list memory module 601 is generally used for obtaining history audio and video corresponding with above-mentioned audio and video list, and will Above-mentioned history audio and video are stored into corresponding above-mentioned audio and video list, after the execution of above-mentioned List Generating Module 501, according to life At above-mentioned audio and video list corresponding history audio and video are stored to above-mentioned audio and video list, wherein obtain above-mentioned history sound The method of video, which generally comprises, --- but being not limited to --- carries out prerecording or is obtained from cloud shared data bank,
Above-mentioned list collects module 701, is generally used for collecting above-mentioned audio and video list and content to form above-mentioned database, After above-mentioned list memory module 601 executes, by the audio and video list of above-mentioned generation and it is stored in the above-mentioned history sound of list Video is integrated into above-mentioned database.
Referring to Fig.1 3, in the present embodiment, in the system of above-mentioned processing audio and video, above-mentioned list memory module 601 Including:
History trendline submodule 610, by by carrying out existing audio and video in cloud shared data bank based on location information It calculates, environment weather information inquiry and the corresponding time judgement of recording generate above-mentioned history audio and video.
Above-mentioned history trendline submodule 610 is generally used for by being determined existing audio and video in cloud shared data bank Position information calculates, environment weather information inquiry and the corresponding time judgement of recording generate above-mentioned history audio and video.
Referring to Fig.1 3, in a specific the present embodiment, in the system of above-mentioned processing audio and video, above-mentioned history trendline Module 610 can by being replaced with lower module, including:
Prerecording submodule 620, prerecording for carrying out audio and video simultaneously add it on corresponding location information label, ring Border weather information label and temporal information label form above-mentioned history audio and video.
Above-mentioned prerecording submodule 620 is generally used for carrying out the prerecording of audio and video and adds corresponding positioning letter to it Breath label, environment weather information labels and temporal information label form above-mentioned history audio and video, are regarded by a large amount of sound of prerecording Corresponding location information label, environment weather information labels and temporal information label are simultaneously attached in the audio and video rear formation by frequency Above-mentioned history audio and video.
Referring to Fig.1 4, in the present embodiment, in the system of above-mentioned processing audio and video, above-mentioned location information calculating includes Step:
Extract submodule 611, the picture for extracting designated frame number in above-mentioned audio and video;
Identify submodule 612, it is above-mentioned for obtaining the significant image progress image recognition in above-mentioned picture with search The affiliated geographical location of significant image;
First computational submodule 613, the dimension scale for specifying image according to two or more in above-mentioned picture And the dimension scale between corresponding material object calculates the recording distance of above-mentioned audio and video;
Second computational submodule 614, for being calculated according to the content of above-mentioned significant image, geographical location and recording distance Obtain above-mentioned location information.
Above-mentioned extraction submodule 611 is generally used for extracting the picture of designated frame number in above-mentioned audio and video, wherein above-mentioned specified The picture of frame number be generally include prominent identification feature or it is significant change face, such as landmark, article, personage,
Above-mentioned identification submodule 612 is generally used for the significant image in above-mentioned picture carrying out image recognition and search Obtain the affiliated geographical location of above-mentioned significant image, wherein the general user again of the significant image chooses, and works as use The region that color of image otherness larger region or history select number more in selection picture when person abandons choosing is defined as Significant image, above-mentioned significant image includes at least one, it is generally preferable to including --- but being not limited to --- two,
Above-mentioned first computational submodule 613 is generally used for specifying image according to two or more in above-mentioned picture Dimension scale between dimension scale and corresponding material object calculates the recording distance of above-mentioned audio and video, obtains in above-mentioned picture The ratio of the distance between the dimension scale of multiple specified images or two images with actual scene, to show that above-mentioned recording is set The standby recording distance with the actual scene in specified image,
Above-mentioned second computational submodule 614 is generally used for content, geographical location and recording according to above-mentioned significant image Above-mentioned location information is calculated in distance.
Referring to Fig.1 1, in embodiments of the present invention, the present invention also provides a kind of computer equipment, above computer equipment 12 It is showed in the form of universal computing device, the component of computer equipment 12 can include but is not limited to:One or more processing Device or processing unit 16, system storage 28, connection different system component (including system storage 28 and processing unit 16) Bus 18.
Bus 18 indicates one or more in a few 18 structures of class bus, including memory bus 18 or memory control Device, peripheral bus 18, graphics acceleration port, processor or the office using 18 structure of arbitrary bus in a variety of 18 structures of bus Domain bus 18.For example, these architectures include but not limited to industry standard architecture (ISA) bus 18, microchannel Architecture (MAC) bus 18, enhanced isa bus 18, audio and video frequency electronic standard association (VESA) local bus 18 and outer Enclose component interconnection (PCI) bus 18.
Computer equipment 12 typically comprises a variety of computer system readable media.These media can be it is any can be by The usable medium that computer equipment 12 accesses, including volatile and non-volatile media, moveable and immovable medium.
System storage 28 may include the computer system readable media of form of volatile memory, such as arbitrary access Memory (RAM) 30 and/or cache memory 32.Computer equipment 12 may further include other movement/it is not removable Dynamic, volatile/non-volatile computer decorum storage medium.Only as an example, storage system 34 can be used for read and write can not Mobile, non-volatile magnetic media (commonly referred to as " hard disk drive ").Although being not shown in Figure 11, can provide for pair can The disc driver of mobile non-volatile magnetic disk (such as " floppy disk ") read-write, and to removable anonvolatile optical disk (such as CD~ ROM, DVD~ROM or other optical mediums) read-write CD drive.In these cases, each driver can pass through one A or multiple data media interfaces are connected with bus 18.Memory may include at least one program product, the program product With one group of (for example, at least one) program module 42, these program modules 42 are configured to perform the work(of various embodiments of the present invention Energy.
Program/utility 40 with one group of (at least one) program module 42 can store in memory, for example, Such program module 42 includes --- but being not limited to --- operating system, one or more application program, other program moulds Block 42 and program data may include the realization of network environment in each or certain combination in these examples.Program mould Block 42 usually executes function and/or method in embodiment described in the invention.
Computer equipment 12 can also with one or more external equipments 14 (such as keyboard, sensing equipment, display 24, Camera etc.) communication, the equipment interacted with the computer equipment 12 can be also enabled a user to one or more to be communicated, and/ Or with enable any equipment that the computer equipment 12 communicated with one or more of the other computing device (such as network interface card, Modem etc.) communication.This communication can be carried out by input/output (I/O) interface 22.Also, computer equipment 12 can also by network adapter 20 and one or more network (such as LAN (LAN)), wide area network (WAN) and/or Public network (such as internet) communicates.As shown, network adapter 20 passes through other of bus 18 and computer equipment 12 Module communicates.It should be understood that although being not shown in Figure 11, other hardware and/or software can be used in conjunction with computer equipment 12 Module, including but not limited to:Microcode, device driver, redundant processing unit 16, external disk drive array, RAID system, Tape drive and data backup storage system 34 etc..
Processing unit 16 is stored in program in system storage 28 by operation, to perform various functions application and Data processing, such as realize the method for processing audio and video that the embodiment of the present invention is provided.
That is, above-mentioned processing unit 16 is realized when executing above procedure:Generate the positioning letter of recording audio/video position Cease label, environment weather information labels and temporal information label;It is matched from database and above-mentioned location information label, environment Weather information label is identical with temporal information label or approximate history audio and video;It is regarded according to above-mentioned recording audio/video and history sound Frequency processing generates target audio and video.
In embodiments of the present invention, the present invention also provides a kind of computer readable storage medium, it is stored thereon with computer Program, the method that the processing audio and video provided such as all embodiments of the application are provided when which is executed by processor:
That is, being realized when being executed by processor to program:Generate location information label, the ring of recording audio/video position Border weather information label and temporal information label;It is matched from database and above-mentioned location information label, environment weather information Label is identical with temporal information label or approximate history audio and video;According to above-mentioned recording audio/video and the processing life of history audio and video At target audio and video.
The arbitrary combination of one or more computer-readable media may be used.Computer-readable medium can be calculated Machine gram signal media or computer readable storage medium.Computer readable storage medium for example can be --- but it is unlimited In --- electricity, system, device or the device of magnetic, optical, electromagnetic, infrared ray or semiconductor, or the arbitrary above combination.Computer The more specific example (non exhaustive list) of readable storage medium storing program for executing includes:Being electrically connected, be portable with one or more conducting wires Formula computer disk, hard disk, random access memory (RAM), read-only memory (ROM), erasable programmable read-only memory (EPOM or flash memory), optical fiber, portable compact disc read-only memory (CD~ROM), light storage device, magnetic memory device or Above-mentioned any appropriate combination.In this document, can be any include computer readable storage medium or storage program Tangible medium, the program can be commanded the either device use or in connection of execution system, device.
Computer-readable signal media may include in a base band or as the data-signal that a carrier wave part is propagated, Wherein carry computer-readable program code.Diversified forms may be used in the data-signal of this propagation, including --- but It is not limited to --- electromagnetic signal, optical signal or above-mentioned any appropriate combination.Computer-readable signal media can also be Any computer-readable medium other than computer readable storage medium, change computer-readable medium can send, propagate or Transmission for by instruction execution system, device either device use or program in connection.
It can be write with one or more programming languages or combinations thereof for executing the computer that operates of the present invention Program code, above procedure design language include object oriented program language --- such as Java, Smalltalk, C+ +, further include conventional procedural programming language --- such as " C " language or similar programming language.Program code It can fully execute on the user computer, partly execute, held as an independent software package on the user computer Execution is either held on remote computer or server completely on the remote computer for part on the user computer for row, part Row.In situations involving remote computers, remote computer can pass through the network of any kind --- including LAN (LAN) or wide area network (WAN) --- it is connected to subscriber computer, or, it may be connected to outer computer (such as using because of spy Service provider is netted to be connected by internet).
The method of processing audio and video of the present invention, system, equipment and storage medium have the beneficial effect that:By for record sound Location information label, environment weather information labels and the temporal information label of Video Add-On position make in processing audio and video When can be by the identical history audio and video of information labels as the reference of the recording audio/video, so as to more accurately regard sound Frequency into edlin and processing, reduce operation difficulty and the operating time of user, and improve processing after target audio and video it is true Reality.
The foregoing is merely the preferred embodiment of the present invention, are not intended to limit the scope of the invention, every utilization Equivalent structure or equivalent flow shift made by description of the invention and accompanying drawing content is applied directly or indirectly in other correlations Technical field, be included within the scope of the present invention.

Claims (10)

1. a kind of method of processing audio and video, which is characterized in that including step:
Generate location information label, environment weather information labels and the temporal information label of recording audio/video position;
It is matched from database identical or close as the location information label, environment weather information labels and temporal information label As history audio and video;
Target audio and video are generated according to the recording audio/video and the processing of history audio and video.
2. the method for processing audio and video according to claim 1, which is characterized in that the processing generates target audio and video Step, including step:
Choose the target area in the recording audio/video;
Obtain the image data that target area is corresponded in the history audio and video;
The image data that described image data are replaced to the target area generates the target audio and video.
3. the method for processing audio and video according to claim 1, which is characterized in that the processing generates target audio and video Step, including step:
Choose the target image in the recording audio/video and the history audio and video;
The target image is integrated to obtain the three-dimensional data of the target image;
The target audio and video are generated according to the three-dimensional data of the target image.
4. the method for processing audio and video according to claim 1, which is characterized in that the correspondence for generating recording audio/video The step of location information label, environment weather information labels and temporal information label, including step:
Obtain the location information of camera-shooting and recording device position;
The real time environment weather information and current time information of the location information corresponding position are obtained according to the location information;
The location information label, environment are generated according to the location information, real time environment weather information and current time information Weather information label and temporal information label are simultaneously attached in the recording audio/video.
5. the method for processing audio and video according to claim 1, which is characterized in where the generation recording audio/video Further include step before the step of location information label of position, environment weather information labels and temporal information label:
Generate the audio and video of the content combination of corresponding different location information labels, environment weather information labels and temporal information label List;
History audio and video corresponding with the audio and video list are obtained, and the history audio and video are stored to the corresponding sound In list of videos;
It collects the audio and video list and content to form the database.
6. the method for processing audio and video according to claim 5, which is characterized in that the acquisition and the audio and video list The step of corresponding history audio and video, including step:
By the way that existing audio and video in cloud shared data bank are carried out location information calculating, environment weather information inquiry and recording pair Judgement generates the history audio and video between seasonable.
7. the method for processing audio and video according to claim 6, which is characterized in that the location information calculating includes step Suddenly:
Extract the picture of designated frame number in the audio and video;
Significant image in the picture is subjected to image recognition and search obtains the affiliated geographical position of the significant image It sets;
The dimension scale between the dimension scale and corresponding material object of image is specified according to two or more in the picture Calculate the recording distance of the audio and video;
The location information is calculated according to the content of the significant image, geographical location and recording distance.
8. a kind of system of processing audio and video, which is characterized in that including:
Generation module, location information label, environment weather information labels and time for generating recording audio/video position Information labels;
Matching module, for matching the identical history audio and video of described information label from database;
Processing module, for generating target audio and video according to the recording audio/video and the processing of history audio and video.
9. a kind of computer equipment, including memory, processor and storage can be run on a memory and on a processor Computer program, which is characterized in that the processor is realized when executing described program such as any one of claim 1~7 institute The method stated.
10. a kind of computer readable storage medium, is stored thereon with computer program, which is characterized in that the program is by processor The method as described in any one of claim 1~7 is realized when execution.
CN201810167141.0A 2018-02-28 2018-02-28 Method, system, device and storage medium for processing audio and video Active CN108388649B (en)

Priority Applications (2)

Application Number Priority Date Filing Date Title
CN201810167141.0A CN108388649B (en) 2018-02-28 2018-02-28 Method, system, device and storage medium for processing audio and video
PCT/CN2018/091115 WO2019165723A1 (en) 2018-02-28 2018-06-13 Method and system for processing audio/video, and device and storage medium

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201810167141.0A CN108388649B (en) 2018-02-28 2018-02-28 Method, system, device and storage medium for processing audio and video

Publications (2)

Publication Number Publication Date
CN108388649A true CN108388649A (en) 2018-08-10
CN108388649B CN108388649B (en) 2021-06-22

Family

ID=63069030

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201810167141.0A Active CN108388649B (en) 2018-02-28 2018-02-28 Method, system, device and storage medium for processing audio and video

Country Status (2)

Country Link
CN (1) CN108388649B (en)
WO (1) WO2019165723A1 (en)

Cited By (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN110675922A (en) * 2019-09-23 2020-01-10 北京阳光欣晴健康科技有限责任公司 Multi-mode-based intelligent follow-up method and system
CN110851625A (en) * 2019-10-16 2020-02-28 联想(北京)有限公司 Video creation method and device, electronic equipment and storage medium
WO2021103890A1 (en) * 2019-11-27 2021-06-03 深圳市万普拉斯科技有限公司 Method for generating video file, device, computer apparatus, and storage medium
CN114025116A (en) * 2021-11-25 2022-02-08 北京字节跳动网络技术有限公司 Video generation method and device, readable medium and electronic equipment
CN116456057A (en) * 2023-04-26 2023-07-18 河南铭视科技股份有限公司 Video processing system and method based on Internet of things

Families Citing this family (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN113891151A (en) * 2021-09-28 2022-01-04 北京字跳网络技术有限公司 Audio processing method and device, electronic equipment and storage medium

Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2015173001A1 (en) * 2014-05-12 2015-11-19 Koninklijke Philips N.V. Verification of images captured using a timestamp decoded from illumination from a modulated light source
CN105827959A (en) * 2016-03-21 2016-08-03 深圳市至壹科技开发有限公司 Geographic position-based video processing method
CN105933651A (en) * 2016-05-04 2016-09-07 深圳市至壹科技开发有限公司 Method and apparatus for jumper connection of video on the basis of object route
CN106251271A (en) * 2016-07-29 2016-12-21 北京云海寰宇信息技术有限责任公司 City intelligent management platform
CN106596888A (en) * 2016-12-12 2017-04-26 刘邦楠 Online water quality detection system employing terminal and cellphone
CN107623838A (en) * 2016-07-15 2018-01-23 索尼公司 Message processing device, method and computer program product

Family Cites Families (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20130294746A1 (en) * 2012-05-01 2013-11-07 Wochit, Inc. System and method of generating multimedia content
US9460205B2 (en) * 2012-07-20 2016-10-04 Google Inc. Crowdsourced video collaboration
US20150187390A1 (en) * 2013-12-30 2015-07-02 Lyve Minds, Inc. Video metadata
CN107147959B (en) * 2017-05-05 2020-06-19 中广热点云科技有限公司 Broadcast video clip acquisition method and system

Patent Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2015173001A1 (en) * 2014-05-12 2015-11-19 Koninklijke Philips N.V. Verification of images captured using a timestamp decoded from illumination from a modulated light source
CN105827959A (en) * 2016-03-21 2016-08-03 深圳市至壹科技开发有限公司 Geographic position-based video processing method
CN105933651A (en) * 2016-05-04 2016-09-07 深圳市至壹科技开发有限公司 Method and apparatus for jumper connection of video on the basis of object route
CN107623838A (en) * 2016-07-15 2018-01-23 索尼公司 Message processing device, method and computer program product
CN106251271A (en) * 2016-07-29 2016-12-21 北京云海寰宇信息技术有限责任公司 City intelligent management platform
CN106596888A (en) * 2016-12-12 2017-04-26 刘邦楠 Online water quality detection system employing terminal and cellphone

Cited By (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN110675922A (en) * 2019-09-23 2020-01-10 北京阳光欣晴健康科技有限责任公司 Multi-mode-based intelligent follow-up method and system
CN110851625A (en) * 2019-10-16 2020-02-28 联想(北京)有限公司 Video creation method and device, electronic equipment and storage medium
WO2021103890A1 (en) * 2019-11-27 2021-06-03 深圳市万普拉斯科技有限公司 Method for generating video file, device, computer apparatus, and storage medium
CN114025116A (en) * 2021-11-25 2022-02-08 北京字节跳动网络技术有限公司 Video generation method and device, readable medium and electronic equipment
CN114025116B (en) * 2021-11-25 2023-08-04 北京字节跳动网络技术有限公司 Video generation method, device, readable medium and electronic equipment
CN116456057A (en) * 2023-04-26 2023-07-18 河南铭视科技股份有限公司 Video processing system and method based on Internet of things
CN116456057B (en) * 2023-04-26 2023-11-14 河南铭视科技股份有限公司 Video processing system and method based on Internet of things

Also Published As

Publication number Publication date
CN108388649B (en) 2021-06-22
WO2019165723A1 (en) 2019-09-06

Similar Documents

Publication Publication Date Title
CN108388649A (en) Handle method, system, equipment and the storage medium of audio and video
JP7096902B2 (en) Image processing methods, equipment, computer programs and computer devices
US11422671B2 (en) Defining, displaying and interacting with tags in a three-dimensional model
AU2022256192B2 (en) Multi-sync ensemble model for device localization
CN115151947B (en) Cross-reality system with WIFI/GPS-based map merging
CN104268939B (en) Transformer substation virtual-reality management system based on three-dimensional panoramic view and implementation method of transformer substation virtual-reality management system based on three-dimensional panoramic view
US20220076072A1 (en) System and method using augmented reality for efficient collection of training data for machine learning
CN115398484A (en) Cross reality system with geolocation information priority for location
US9542975B2 (en) Centralized database for 3-D and other information in videos
CN115398314A (en) Cross reality system for map processing using multi-resolution frame descriptors
CN109887003A (en) A kind of method and apparatus initialized for carrying out three-dimensional tracking
CN104781849A (en) Fast initialization for monocular visual simultaneous localization and mapping (SLAM)
CN109688343A (en) The implementation method and device of augmented reality studio
US20240038274A1 (en) 3d media elements in 2d video
JP2008181515A (en) Method of describing object area information, method of processing video information, and information processor
US11601632B2 (en) Device and method of creating an augmented interactive virtual reality system
CN117475062A (en) Method, device, equipment and storage medium for creating three-dimensional navigation logo
EP4282158A1 (en) Methods and system for coordinating uncoordinated content based on multi-modal metadata through data filtration and synchronization in order to generate composite media assets
Uribe et al. New usability evaluation model for a personalized adaptive media search engine based on interface complexity metrics

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant
TR01 Transfer of patent right

Effective date of registration: 20220402

Address after: 518000 a1713, building 9, zone 2, Shenzhen Bay science and technology ecological park, No. 3609 Baishi Road, high tech Zone community, Yuehai street, Nanshan District, Shenzhen, Guangdong

Patentee after: Shenzhen quanbaotong Network Technology Co.,Ltd.

Address before: 518000 Room 302, building 8, Shenzhen Software Park Phase I, kejizhong Third Road, Yuehai street, Nanshan District, Shenzhen City, Guangdong Province

Patentee before: SHENZHEN IKMAK TECH. Co.,Ltd.

TR01 Transfer of patent right