CN107018442B - A kind of video recording synchronized playback method and device - Google Patents

A kind of video recording synchronized playback method and device Download PDF

Info

Publication number
CN107018442B
CN107018442B CN201610061280.6A CN201610061280A CN107018442B CN 107018442 B CN107018442 B CN 107018442B CN 201610061280 A CN201610061280 A CN 201610061280A CN 107018442 B CN107018442 B CN 107018442B
Authority
CN
China
Prior art keywords
video
video camera
image data
caching
data
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
CN201610061280.6A
Other languages
Chinese (zh)
Other versions
CN107018442A (en
Inventor
付建辉
李世明
张东斌
魏钦敏
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Zhejiang Uniview Technologies Co Ltd
Original Assignee
Zhejiang Uniview Technologies Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Zhejiang Uniview Technologies Co Ltd filed Critical Zhejiang Uniview Technologies Co Ltd
Priority to CN201610061280.6A priority Critical patent/CN107018442B/en
Publication of CN107018442A publication Critical patent/CN107018442A/en
Application granted granted Critical
Publication of CN107018442B publication Critical patent/CN107018442B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Classifications

    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
    • H04N21/432Content retrieval operation from a local storage medium, e.g. hard-disk
    • H04N21/4325Content retrieval operation from a local storage medium, e.g. hard-disk by playing back content from the storage medium
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
    • H04N21/433Content storage operation, e.g. storage operation in response to a pause request, caching operations
    • H04N21/4331Caching operations, e.g. of an advertisement for later insertion during playback
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N5/00Details of television systems
    • H04N5/76Television signal recording
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N7/00Television systems
    • H04N7/18Closed-circuit television [CCTV] systems, i.e. systems in which the video signal is not broadcast
    • H04N7/181Closed-circuit television [CCTV] systems, i.e. systems in which the video signal is not broadcast for receiving images from a plurality of remote sources

Landscapes

  • Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • Signal Processing (AREA)
  • Databases & Information Systems (AREA)
  • Television Signal Processing For Recording (AREA)

Abstract

The present invention provides a kind of video recording synchronized playback method and device, this method comprises: receive client send video recording synchronized playback information, and according to video recording synchronized playback acquisition of information synchronized playback in need each video camera Video data;The corresponding Video data of each video camera that will acquire successively is decoded, synthesizes, coded treatment obtains splicing Video data;Send splicing Video data to corresponding client be used for each video camera of synchronized playback in need carry out video recording synchronized playback.The present invention is suitable for various network environments, and greatly improves the synchronism of playing back videos.

Description

A kind of video recording synchronized playback method and device
Technical field
The present invention relates to field of video monitoring more particularly to a kind of video recording synchronized playback method and devices.
Background technique
Important means of the playing back videos business as post-mordem forensics is always the major function of video monitoring system.It is synchronous Playback refers to while playing back to the video recording of multichannel video camera, checks convenient for comparison.Under normal conditions occupied by synchronized playback Code stream total bandwidth be synchronized playback all video cameras video recording code stream summation, such as the record to tetra- video cameras of A, B, C, D As synchronizing playback, it is assumed that the video recording code rate of four video cameras is all 2M, then what the synchronized playback of No. four video cameras occupied Total bitrate bandwidth is exactly 8M.For the application of the monitoring environment either monitoring mobile phone client poor for network condition, band Wide deficiency can bring a series of problems, such as data packetloss, image Caton flower screen, influence the normal use of synchronized playback business.And The synchronous effect of all video cameras video recording of synchronized playback is limited to system CPU performance, network transmission, playback client process not The factors such as synchronizing influences, and causes the playing back videos time irreversibility problem of each video camera.
Summary of the invention
For the problem that conventional synchronization playback code rate is big, high, synchronized playback poor synchronization, the present invention are required to network environment A kind of video recording synchronized playback method and device is provided, can effectively solve network bandwidth deficiency bring variety of problems, and can be with Significantly improve the playing back videos synchronism of each video camera.
According to a first aspect of the embodiments of the present invention, a kind of video recording synchronized playback method is provided, video monitoring system is applied to Back-end server in system, this method comprises:
The video recording synchronized playback information that client is sent is received, and is synchronized back according to video recording synchronized playback acquisition of information needs The Video data for each video camera put;
The video recording format of each video camera is obtained, which includes: resolution ratio, frame per second;
The corresponding decoding speed of each video camera is calculated according to the frame per second of the corresponding video recording of each video camera, and according to decoding speed The corresponding Video data of each video camera is extracted from the Video data of acquisition to be decoded, and obtains carrying temporal information and frame number Image data, described image data are put into the first caching, the temporal information unit be the second;
The frame per second maximum value in the corresponding video recording frame per second of each video camera is selected to calculate aggregate velocity, according to aggregate velocity from the The corresponding image data of each video camera is extracted in one caching, and the corresponding image data of each video camera of extraction is put into second and is delayed It deposits, if in the second caching when the corresponding image data of existing each video camera, first deleting and already present in the second caching respectively taking the photograph The corresponding image data of camera;
After extracting the corresponding image data of each video camera in the second caching, the resolution ratio of the corresponding video recording of each video camera is judged It is whether identical, if identical, each frame image data of extraction is directly subjected to synthesis and handles to obtain stitching image;If Not exactly the same, then each frame image data that first will acquire zooms in and out processing according to preset rules, so that each frame image data Size is identical, then each frame image data after scaling is carried out synthesis and handles to obtain stitching image;
Stitching image progress coded treatment is obtained into splicing Video data;
Send splicing Video data to corresponding client be used for each video camera of synchronized playback in need record a video Synchronized playback.
According to a second aspect of the embodiments of the present invention, a kind of video recording synchronous playback means are provided, video monitoring system is applied to Back-end server in system, the device include:
Message processing module, for receiving the video recording synchronized playback information of client transmission;
Video recording obtains module, the video recording of each video camera for needing synchronized playback according to video recording synchronized playback acquisition of information Data;
Format obtains module, and for obtaining the video recording format of each video camera, which includes: resolution ratio, frame per second;
Video recording decoder module, for calculating the corresponding decoding speed of each video camera according to the frame per second of the corresponding video recording of each video camera Degree, and the corresponding Video data of each video camera is extracted from the Video data of acquisition according to decoding speed and is decoded, it is taken Described image data are put into the first caching by the image data with temporal information and frame number, which is the second;
Image zooming-out module calculates synthesis speed for selecting the frame per second maximum value in the corresponding video recording frame per second of each video camera Degree extracts the corresponding image data of each video camera according to aggregate velocity from the first caching, and each video camera of extraction is corresponding Image data be put into the second caching, if in the second caching when the corresponding image data of existing each video camera, first deleting the The corresponding image data of already present each video camera in two cachings;
Video recording synthesis module, for judging each camera shooting after extracting the corresponding image data of each video camera in the second caching Whether the resolution ratio of the corresponding video recording of machine is identical, if identical, directly synthesizes each frame image data of extraction Processing obtains stitching image;If not exactly the same, each frame image data that first will acquire zooms in and out place according to preset rules Reason, so that each frame image data size is identical, then carries out synthesis for each frame image data after scaling and handles to obtain stitching image;
Video recording coding module, for stitching image progress coded treatment to be obtained splicing Video data;
Record a video sending module, for sends splicing Video data to corresponding client for synchronized playback in need Each video camera carries out video recording synchronized playback.
The present invention can carry out the code rate value of the synchronized playback video recording of multichannel video camera according to real network ambient conditions It a series of problems, such as any setting, effective solution network bandwidth deficiency bring data packetloss, image Caton flower screen, can be with Suitable for various network environments.The present invention handles to obtain splicing Video data by the way that synchronizing process is put in back-end server, then Splicing Video data is sent to corresponding client for synchronized playback of recording a video, and reduces network transmission, client decoding performance etc. The asynchronous problem of video recording, greatly improves playing back videos synchronism caused by factor, and the synchronization reached in " real " meaning is returned It puts.
Detailed description of the invention
Fig. 1 is flow chart of the embodiment of the present invention;
Fig. 2 is the stitching image schematic diagram of the embodiment of the present invention;
Fig. 3 is the device of that embodiment of the invention building-block of logic.
Specific embodiment
Technical solution in embodiment in order to enable those skilled in the art to better understand the present invention, and make of the invention real The above objects, features, and advantages for applying example can be more obvious and easy to understand, with reference to the accompanying drawing to technical side in the embodiment of the present invention Case is described in further detail.
Referring to Figure 1, Fig. 1 is a kind of flow diagram of synchronized playback method of recording a video provided in an embodiment of the present invention, should Method can be applied to video monitoring system, as being applied in the back-end server of video monitoring system, the video monitoring system It further include client and video camera.Above-mentioned back-end server can be NVR network video recorder, or support encoding and decoding The separate server of function;Above-mentioned client can be NVR associated client end, or support the independence of synchronized playback function Client.For ease of description, following executing subject in the above way is to be described for back-end server.As shown in Figure 1, This method may comprise steps of:
Step 101 receives the video recording synchronized playback information that client is sent, and according to video recording synchronized playback acquisition of information need Want the Video data of each video camera of synchronized playback.
Video recording synchronized playback information may include the video camera ID of institute's synchronized playback in need, record a video initial time and video recording End time.Back-end server obtains the Video data of each video camera according to video recording initial time and end time of recording a video.
In the embodiment of the present invention, user can select to need for each video camera of synchronized playback and setting on the client Want the video recording beginning and ending time of synchronized playback.Back-end server is each according to the video recording initial time of setting and the retrieval of video recording end time Video camera is stored in the Video data on storage equipment (back-end server of such as included hard disk, independent storage server), And the Video data for obtaining preset quantity in the corresponding search result of each video camera is put into caching, for example obtains each video camera every time (being " preceding " closest to video recording initial time, be " rear " closest to the video recording end time) 5 seconds first in corresponding search result Video data be respectively put into corresponding caching, specifically cache way and cache size can be arranged according to practical application, than If that 1 second Video data preceding in the corresponding search result of each video camera can also be put into the same caching, if back-end services When the spatial cache of device is sufficiently large, also whole video recordings in the corresponding search result of available each video camera are put into caching, this Invention is to this without limiting.
Step 102, the video recording format for obtaining each video camera, which includes: resolution ratio, frame per second.
Back-end server is managed collectively each video camera, it will usually the video recording format of pre-configured each video camera, including point The parameters such as resolution, frame per second, code rate, storage duration, therefore the record of each video camera can be obtained from the configuration file of back-end server As format.Back-end server can also correspond to one second or several seconds video recording in Video data with each video camera of pre decoding, each to obtain The corresponding video recording format of video camera, the invention does not limit this.
Step 103 calculates the corresponding decoding speed of each video camera according to the frame per second of the corresponding video recording of each video camera, and according to Decoding speed extracts the corresponding Video data of each video camera from the Video data of acquisition and is decoded, and obtains carrying having time letter Described image data are put into the first caching by the image data of breath and frame number, and the temporal information unit is the second.
In the embodiment of the present invention, back-end server calculates the solution of each video camera according to the frame per second of the corresponding video recording of each video camera Code speed, wherein decoding speed=1/ frame per second.For example the frame per second of the corresponding video recording of video camera A is 25fps (frames per Second, transmission frame number per second), then corresponding decoding speed is 40ms/f, i.e., at interval of 40ms from the Video data of acquisition The corresponding Video data of 1 frame video camera A is extracted to be decoded.Since the every frame of Video data itself carries temporal information and frame Number, then the image data decoded can also carry corresponding temporal information and frame number, and the chronomere is the second.For example it takes the photograph The video recording frame per second of camera A is 25fps, and by taking the decoding of the Video data of 2016-1-1 8:00:00 as an example, then video camera A is decoded Image data is to carry the image data of temporal information 2016-1-1 8:00:00 and frame number 1-25.By decoded image data It is put into the first caching, which is simultaneously not specific to some caching, and refers to the caching of storage decoded image data, this first Caching can be a caching, be also possible to multiple cachings, i.e., each decoded image data of video camera can be put into same Caching can also be respectively put into corresponding caching, and the present invention is without limiting.
Step 104, each video camera of selection correspond to the frame per second maximum value in video recording frame per second to calculate aggregate velocity, according to synthesis Speed extracts the corresponding image data of each video camera from the first caching, and the corresponding image data of each video camera of extraction is put Enter the second caching, if first deleting and having deposited in the second caching when the corresponding image data of existing each video camera in the second caching The corresponding image data of each video camera.
The frame per second of the corresponding video recording of each video camera is ranked up by size, selects frame per second maximum value to calculate aggregate velocity, Wherein aggregate velocity=1/ frame per second maximum value.Since the video recording frame per second of each video camera is less than or equal to frame per second maximum value, therefore respectively take the photograph The corresponding decoding speed of camera is slower than aggregate velocity or equivalent.Therefore when aggregate velocity is faster than the corresponding decoding speed of video camera, The corresponding image data of the video camera not necessarily can be got from the first caching every time, i.e., it is corresponding less than the video camera in the presence of taking Image data the case where.Therefore the image data frame number extracted from the first caching is likely less than the video camera for needing synchronized playback Number.Before the corresponding image data of each video camera of extraction is put into the second caching, first judge whether deposited in the second caching In the corresponding image data of each video camera, if existing, it is corresponding first to delete already present each video camera in the second caching Image data, then the corresponding image data of each video camera of extraction is put into the second caching;If it does not exist, then directly by extraction The corresponding image data of each video camera is put into the second caching.It is slow that the corresponding image data of each video camera that will be extracted is put into second There is the process of a Refresh Data when depositing, to guarantee that the image data for being subsequently used for synthesis processing is newest.
In the embodiment of the present invention, second caches and is not specific to some caching, and refers to what storage was obtained from the first caching The caching of each video camera correspondence image data, second caching can be a caching, be also possible to multiple cachings, i.e., from first The corresponding image data of each video camera obtained in caching can be put into the same caching, can also be respectively put into corresponding slow It deposits, the present invention is without limiting.
Step 105, after extracting the corresponding image data of each video camera in the second caching, judge the corresponding video recording of each video camera Resolution ratio it is whether identical, if identical, each frame image data of extraction directly carried out synthesis handle to be spelled Map interlinking picture;If not exactly the same, each frame image data that first will acquire zooms in and out processing according to preset rules, so that each frame Image data size is identical, then each frame image data after scaling is carried out synthesis and handles to obtain stitching image.
The corresponding video recording resolution ratio of each video camera for synchronized playback is not necessarily identical, i.e., each video camera is corresponding Each frame picture size is not necessarily identical.Therefore when the corresponding video recording resolution ratio of each video camera of synchronized playback is not exactly the same When, it needs that the corresponding each frame image of each video camera is first zoomed in and out processing by preset rules, so that each camera shooting after scaling The size of the corresponding each frame image of machine is identical.Preset rules are referred to the corresponding each frame image scaling of each video camera into identical ruler It is very little, for example can uniformly be scaled to D1 (720*576) size, can also uniformly be scaled to other sizes, the present invention herein not into Row limits.
To keep above-mentioned decoding, synthesis process more clear, illustrate in this measure one specific example.
Embodiment one, such as selection video camera A, B, C, D synchronize playback, and the video recording beginning and ending time set is 2016- 1-1 8:00-10:00, by taking the decoding of the Video data of 2016-1-1 8:00:00, synthesis as an example.Assuming that the video recording of video camera A point Resolution is 720P (1280*720 pixel), frame per second 25fps, and the video recording resolution ratio of video camera B is 720P (1280*720), frame per second For 20fps, the video recording resolution ratio of video camera C is 1080P (1920*1080), frame per second 25fps, the video recording resolution ratio of video camera D For CIF (352*288), frame per second 5fps.The corresponding decoding speed of each video camera is obtained according to the corresponding video recording frame per second of each video camera Degree, the decoding speed of video camera A, B, C, D are respectively 40ms/f, 50ms/f, 40ms/f, 200ms/f.The corresponding record of each video camera Frame per second maximum value is 25fps in image-to-frame ratio, then aggregate velocity is 40ms/f.
Back-end server extracts the corresponding Video data of each video camera by the corresponding decoding speed of each video camera, first when initial Each video camera is obtained to be decoded to obtain the corresponding 2016- of each video camera in the Video data of 2016-1-1 8:00:00 frame number 1 The image data of 1-1 8:00:00 frame number 1, and be put into the first caching.Back-end server is by aggregate velocity from the first caching The corresponding image data of each video camera is extracted, the picture number of the corresponding 2016-1-1 8:00:00 frame number 1 of each video camera is extracted According to.Since the video recording resolution ratio of each video camera is not exactly the same, 2016-1-1 8:00:00 frame corresponding to each video camera is needed Number 1 image data first carries out scaling processing, it is assumed that be uniformly scaled D1, i.e., the corresponding image data of video camera A, B from 720P is contracted to D1, and the corresponding image data of video camera C is contracted to D1 from 1080P, and the corresponding image data of video camera D is from CIF It is amplified to D1, the corresponding image data size of each video camera is D1 after scaling processing.By each frame picture number after scaling It handles to obtain the stitching image of 2016-1-1 8:00:00 frame number 1 according to synthesis is carried out.
When by 40ms, back-end server extract video camera A, C 2016-1-1 8:00:00 frame number 2 Video data into Row decoding obtains the image data of corresponding 2016-1-1 8:00:00 frame number 2, and is put into the first caching.Back-end server is pressed Aggregate velocity extracts the corresponding image data of each video camera from the first caching, only extracts video camera A, C at this time in 2016-1- The image data of 1 8:00:00 frame number 2.Video camera A, C in the second caching are first deleted in 2016-1-1 8:00:00 frame number 1 Image data places into the image data of video camera A, C in 2016-1-1 8:00:00 frame number 2 of extraction.Again from the second caching The middle corresponding image data of each video camera of extracting zooms in and out processing, by the video camera A after scaling in 2016-1-1 8:00:00 The image data of frame number 2, video camera B are in the image data of 2016-1-1 8:00:00 frame number 1, video camera C in 2016-1-1 8: The image data of 00:00 frame number 2, video camera D carry out synthesis in the image data of 2016-1-1 8:00:00 frame number 1 and handle to obtain The stitching image of 2016-1-1 8:00:00 frame number 2.
When using 10ms, back-end server extract video camera B 2016-1-1 8:00:00 frame number 2 Video data into Row decoding obtains the image data of corresponding 2016-1-1 8:00:00 frame number 2, and is put into the first caching.Using 30ms When, back-end server extraction video camera A, C are decoded to obtain corresponding in the Video data of 2016-1-1 8:00:00 frame number 3 The image data of 2016-1-1 8:00:00 frame number 3, and be put into the first caching.It is corresponding that each video camera is extracted from the first caching The second caching of image data replacement in already present image data, and place is zoomed in and out to the corresponding image data of each video camera Reason, then by the video camera A after scaling in the image data of 2016-1-1 8:00:00 frame number 3, video camera B in 2016-1-1 The image data of 8:00:00 frame number 2, video camera C exist in the image data of 2016-1-1 8:00:00 frame number 3, video camera D The image data of 2016-1-1 8:00:00 frame number 1 carries out synthesis and handles to obtain the spliced map of 2016-1-1 8:00:00 frame number 3 Picture.
And so on, obtain the stitching image of 2016-1-1 8:00:00 frame number 1-25.
As an alternative embodiment, back-end server is before synthesizing Video data, it is also an option that closing At mode, the corresponding image data of each video camera extracted from the second caching or each video camera Jing Guo scaling processing are corresponded to Image data, synthesis processing is carried out according to preset order according to the synthesis model of selection, obtains stitching image sequence.Synthesize mould Formula can be selected by back-end server according to the video camera number of synchronized playback, can also be set by user is customized on the client It sets.Above-mentioned preset order can be with are as follows: is arranged according to video camera ID, by left-to-right, first up and then down sequence, or root It is arranged according to video camera ID, first up and then down, by left-to-right sequence, the present invention is herein without limiting.
Preferably, back-end server selects synthesis model according to the video camera number of synchronized playback, when video camera number is small In or equal to mode N+1 maximum support video camera number and be greater than mode N maximum support video camera number when, synthesis model Selection mode N+1, square that the video camera number that wherein mode N maximum is supported is N, mode N is N row * N column mode, and N is positive whole Number.I.e. synthesis model includes 1 video camera of maximum support of mode one, is 1 row *, 1 column mode, 4 camera shootings of maximum support of mode two Machine is 2 row *, 2 column mode, 9 video cameras of maximum support of mode three, is 3 row *, 3 column mode, etc..
It is illustrated as an example with embodiment one, video camera A, B, C, D is selected to synchronize playback, i.e., selection is for same The video camera number of step playback is 4, therefore synthesis model selection mode two, i.e. 2 row *, 2 column mode, for example is carried out according to video camera ID Arrangement, is synthesized by left-to-right, first up and then down sequence, obtains stitching image as shown in Figure 2.
Optionally, back-end server selects synthesis model according to the video camera number of synchronized playback, and synthesis model can be with For i row * j column mode, wherein j can be predetermined fixed value, and i is adjusted according to the video camera number of synchronized playback, it is assumed that is synchronized back The video camera number put is m, and when m is less than or equal to j, synthesis model is 1 row * m column;When m be greater than j and not be j integral multiple when, Synthesis model is i row * j column, and wherein i=INT (m/j)+1, INT () is bracket function;When m be greater than j and be j integral multiple when, Synthesis model is i row * j column, wherein i=INT (m/j).For example j is 5, the video camera number m of synchronized playback is 9, then synthesizes mould Formula is 2*5.
Stitching image progress coded treatment is obtained splicing Video data by step 106.
Back-end server carries out coded treatment to stitching image sequence according to coding rule and obtains splicing Video data.Coding Rule can be back-end server and be preset according to client-class, such as pc client or the corresponding coding rule of PAD client Then one, cell phone client corresponds to coding rule two, is also possible to client synchronized playback is arranged according to actual application environment to encode Parameter.
Preferably, above-mentioned video recording synchronized playback information can also include synchronized playback coding parameter.User can be in client Synchronized playback coding parameter is arranged according to actual application environment on end, including but not limited to: resolution ratio, code rate, frame per second, GOP (Group Of Pictures, picture group) size, coded format.
By taking embodiment one as an example, handled synthesis is carried out by the corresponding image data of video camera A, B, C, D of scaling The stitching image resolution ratio arrived should be 1440*1152.Assuming that the synchronized playback coding parameter of setting are as follows: resolution ratio D1, code rate H.264 stitching image sequence, is then encoded to obtain H.264 lattice by 2Mbit/s, frame per second 25FPS, GOP size 25, coded format Formula, D1 resolution ratio, 2Mbit/s code rate, the splicing Video data of frame per second 25FPS, GOP25.
Step 107, send splicing Video data to corresponding client be used for synchronized playback in need each video camera Carry out video recording synchronized playback.
Client drops bandwidth processing by back-end server is synchronous in advance for what is received, i.e., be successively decoded, synthesize, The splicing Video data that coded treatment obtains, for playing, user can check on a broadcast window on the client and respectively take the photograph The video recording synchronized playback of camera.
Video recording synchronized playback method flow diagram as shown in Figure 1 can be seen that, the present invention is by by the synchronization of multichannel video camera Playback video recording is decoded, synthesizes, coded treatment, is unified for one complete splicing video recording, i.e., takes synchronizing process by rear end Business device is completed, and greatly improves the synchronism of playing back videos, and the present invention can be according to real network ambient conditions, to splicing The code rate value of video recording carries out any setting, effective solution network bandwidth deficiency bring data packetloss, image Caton flower screen A series of problems, such as, it can be adapted for various network environments.
In practical application, the storage plan of each video camera is not necessarily identical, that is, stores video recording on a storage device The time range that data are covered is not necessarily identical, i.e., selection for synchronized playback each video camera in there may be one or Multiple video cameras do not include whole Video datas that the video recording beginning and ending time section of setting is covered.
As an alternative embodiment, the video recording synchronized playback method further include:
Step 104 ', back-end server from first caching in extract the corresponding image data of each video camera after, first judgement mention Whether the corresponding temporal information of each frame image data taken is identical, if not exactly the same, each frame image data is corresponding Temporal information be ranked up by size, only the smallest image data of extracting time information is put into the second caching, by other images Data put back to the first caching;If identical, each frame image data of extraction is put into the second caching.
The corresponding image data of each video camera carries temporal information and frame number in first caching, and wherein temporal information unit is Second.The video recording frame per second of usual video camera is at least 1fps, i.e. the video recording of video camera at least 1 frame per second, therefore the present invention is by the time The intensive qualifications of information are in second grade.The time letter corresponding to the corresponding image data of each video camera extracted from the first caching When ceasing not identical, illustrate that some or certain multiple video cameras do not have corresponding video recording in certain time point.To keep splicing video recording Integrality, therefore to be closed on the basis of video recording covers most full video camera in the video recording beginning and ending time section that synchronized playback is set At splicing.It, will when the temporal information corresponding to the corresponding image data of each video camera extracted from the first caching is not identical The corresponding temporal information of each frame image data (be by size " small " closest to video recording initial time, at the end of recording a video Between be " big ") be ranked up, only the smallest image data of extracting time information is put into the second caching, other image datas are put Return the first caching.Follow-up processing flow is the same as method shown in step 104-107.
In the embodiment of the present invention, when certain video camera corresponding image data is extracted from the first caching in rear end, i.e., from first The corresponding image data of the video camera is deleted in caching.When first caching in storage have the corresponding image data of certain video camera not by When extraction, processing no longer is decoded to the subsequent Video data of the video camera, until the video camera is corresponding in the first caching Image data is extracted, that is, just subsequent to video camera when knowing image data corresponding there is no the video camera in the first caching Video data be decoded processing.
To keep process shown in above-mentioned steps 104 ' more clear, illustrate in this measure one specific example.
Embodiment two, such as selection video camera A, B, C, D synchronize playback, and the video recording beginning and ending time set is 2016- 1-1 8:00-10:00, it is assumed that the video recording resolution ratio and frame per second of each video camera are all the same, and frame per second is 25fps, it is assumed that currently The stitching image of 2016-1-1 8:30:00 is completed, i.e., has each video camera 2016-1-1 8:30:00 frame number 25 in the second caching Corresponding image data.Assuming that the corresponding image data point of each video camera that back-end server is extracted from the first caching next time Not Wei video camera A, C in the image data of 2016-1-1 8:30:01 frame number 1, video camera B in 2016-1-1 9:00:00 frame number 1 Image data, video camera D 2016-1-1 8:35:00 frame number 1 image data.This time extracted from the first caching Temporal information corresponding to the corresponding image data of each video camera is not identical, therefore only extracting time information the smallest video camera A, C It is put into the second caching in the image data of 2016-1-1 8:30:01 frame number 1, by video camera B in 2016-1-1 9:00:00 frame Number 1 image data, video camera D are put back in the first caching in the image data of 2016-1-1 8:35:00 frame number 1.Therefore press step Method shown in 104-105 this time exists video camera A, C in the image data of 2016-1-1 8:30:01 frame number 1, video camera B, D The image data of 2016-1-1 8:30:00 frame number 25 carries out synthesis processing, obtains the splicing of 2016-1-1 8:30:01 frame number 1 Image.And so on, therefore taken the photograph in 2016-1-1 8:30:01 to 2016-1-1 8:34:59 period corresponding stitching image Image on the position of camera D remains it in the image data of 2016-1-1 8:30:00 frame number 25, in 2016-1-1 8: Image in 30:01 to 2016-1-1 8:59:59 period corresponding stitching image on the position of video camera B remain its The image data of 2016-1-1 8:30:00 frame number 25.
As an alternative embodiment, the video recording synchronized playback method further include:
Step 105 ', back-end server by from the second caching the corresponding image data of each video camera extracted synthesize Before processing, also judge whether the image data frame number extracted is less than the number for needing each video camera of synchronized playback, if being less than, It further determines that the one or more video cameras for not extracting image data, by this in the stitching image of synthesis or multiple takes the photograph The image of camera corresponding position part is filled with solid-color image;If being not less than, each frame image data of extraction is synthesized Processing obtains stitching image.
When video cameras one or more in each video camera of the selection for synchronized playback do not include what synchronized playback was set When the Video data that video recording start time point is covered, i.e., this or multiple video camera correspond to the starting of the video recording in search result The video recording initial time of time and setting is inconsistent, and is greater than the video recording initial time of setting (closest to video recording initial time It is " big " closest to the video recording end time for " small ").In the video recording initial time and this or multiple video camera pair of setting Answer this or multiple video camera corresponding position in the stitching image sequence synthesized between the video recording initial time in search result Partial image can be filled with solid-color image, such as ater image.
To keep process shown in above-mentioned steps 105 ' more clear, now lifts a specific example and be illustrated.
Embodiment three, such as selection video camera A, B, C, D synchronize playback, and the video recording beginning and ending time set is 2016- 1-1 8:00:00-10:00:00, retrieval discovery video camera A, B, C include the 2016-1-1 8:00:00-10:00:00 period Video data, but video camera D only includes the Video data of 2016-1-1 8:30:00-10:00:00 period.Assuming that each camera shooting The video recording frame per second of machine is 25fps.Video camera A, B, C are first obtained in the video recording number of 2016-1-1 8:00:00 frame number 1 when initial It is decoded to obtain the corresponding image of each video camera respectively in the Video data of 2016-1-1 8:30:00 frame number 1 according to, video camera D Data, and be put into the first caching.Based on step 104 ', due to the video camera D correspondence image data extracted from the first caching Temporal information be greater than the temporal informations of other video camera correspondence image data, therefore be only extracted video camera A, B, C in 2016-1- The image data of 1 8:00:00 frame number 1 is put into the second caching.Due to being to synthesize for the first time, therefore there is only video cameras in the second caching A, the corresponding image data of video camera, i.e., the image data frame extracted from the second caching is not present in the corresponding image data of B, C Number (for 3) is less than the number (for 4) for needing each video camera of synchronized playback, therefore further determines that and do not extract taking the photograph for image data Camera is video camera D, and the image of video camera D corresponding position part in the stitching image of synthesis is filled with solid-color image.With this Analogize, the video recording initial time in the video recording time started 2016-1-1 8:00 search result corresponding with video camera D of setting In the stitching image sequence synthesized between 2016-1-1 8:30, the image of video camera D corresponding position part is filled out with solid-color image It fills, such as ater image.
Certainly first to be not based on step 104 when extracting ', for example, it is first when extracting by video camera A, B, C in 2016-1- The image data of 1 8:00:00 frame number 1, video camera D are extracted simultaneously in the image data of 2016-1-1 8:30:00 frame number 1 It is put into the second caching;It is based on step 104 again in subsequent extraction ', i.e., video camera A, B, C are only extracted in 2016-1-1 8:00: 00 frame number 2 to 2016-1-1 8:29:59 frame number 25 image data.In the video recording time started 2016-1-1 8:00 of setting: The stitching image sequence synthesized between video recording initial time 2016-1-1 8:30:00 in 00 search result corresponding with video camera D In, the image of video camera D corresponding position part may be that video camera D corresponds to video recording initial time 2016- in search result The corresponding image data of 1-1 8:30:00 frame number 1.The present invention is without limiting.
It can also be carried out during the client terminal playing splicing Video data as a kind of optional embodiment Including but not limited to dragging playback progress bar, pause play back, continue to play back, stop playback, replace the video camera played back, stop Only the playback controls such as playback business of part video camera act in synchronized playback.
Optionally, when client is during recording a video synchronized playback, back-end server receives the synchronization that client is sent and returns Put control information, synchronized playback control information includes but is not limited to: jump information, continues broadcast information, terminates pause information Information.
When synchronized playback control information be jump information when, according to the jump information carry video recording jump initial time and The video recording end time obtains the Video data of each video camera.For example selection video camera A, B, C, D synchronize playback, the record of setting As the beginning and ending time is 2016-1-1 8:00-10:00, it is assumed that the video time currently played back is 2016-1-1 8:45, this When user drag playback progress bar on the client to 2016-1-1 9:10, i.e., at the end of video recording jumps initial time and records a video Between be respectively 2016-1-1 9:10,2016-1-1 10:00.Back-end server according to the jump information, empty the cache in own The Video data obtained, retrieves and obtains each video camera and store on a storage device between 2016-1-1 9:10-10:00 Video data.Then the corresponding Video data of each video camera that will acquire successively is decoded, synthesizes, coded treatment is spliced Video data, and splicing Video data is sent to corresponding client for synchronized playback of recording a video.
When synchronized playback control information is pause information, pause obtains the Video data of each video camera, when receive after When continuous broadcast information, continue the Video data for obtaining each video camera.For example selection video camera A, B, C, D synchronize playback, if The fixed video recording beginning and ending time is 2016-1-1 8:00-10:00, it is assumed that the video time currently played back is 2016-1-1 8: 45, user clicks pause playback button on the client at this time, and back-end server obtains each video camera according to pause information pause Video data, and do not retransmit splicing Video data to client, i.e., in client stop display 2016-1-1 8:45 it is same Step playback picture;After user clicks continuation playback button on the client, back-end server just restores to continue to obtain respectively to take the photograph The Video data of camera, and restore to send Video data to client.
When synchronized playback control information is ending message, stop the Video data for obtaining each video camera, and empty slow The Video data for each video camera deposited.Such as selection video camera A, B, C, D synchronize playback, the video recording beginning and ending time set as 2016-1-1 8:00-10:00, it is assumed that the video time currently played back is 2016-1-1 8:45, and user is in client at this time It is clicked on end and stops playback button, back-end server stops obtaining the Video data of each video camera according to ending message, and clear The Video data of each video camera of sky caching, client terminate the synchronized playback business.
Optionally, when client is during recording a video synchronized playback, the video camera played back can also be replaced.
When client is during recording a video synchronized playback, wherein one or more in all synchronized playback video cameras are replaced When video camera, back-end server receives the video camera that client is sent and replaces information, and video camera replacement information includes that replacement is taken the photograph Camera ID, the synchronized playback sequence for being replaced video camera ID, the play time, video recording end time and update of currently recording a video;According to Video camera replaces information, obtains the Video data of replacement video camera and deletes the Video data for being replaced video camera cached, Then the corresponding Video data of each video camera that will acquire successively is decoded, synthesizes, coded treatment obtains splicing Video data, And splicing Video data is sent to corresponding client for synchronized playback of recording a video.
For example selection video camera A, B, C, D synchronize playback, the video recording beginning and ending time set is 2016-1-1 8:00- 10:00.Assuming that currently the video time that is playing back is 2016-1-1 8:45, at this time user on the client by video camera D more It is changed to video camera E, back-end server replaces information according to the video camera, retrieves and obtain video camera E in 2016-1-1 8:45- Video data between 10:00 deletes the Video data for having obtained the video camera D deposited in caching, then the camera shooting that will acquire The Video data of machine A, B, C, E are successively decoded, synthesize, coded treatment obtains splicing Video data, and send splicing video recording Data give corresponding client for synchronized playback of recording a video.
Optionally, when client is during recording a video synchronized playback, part video camera in synchronized playback can also be stopped Playback business.
When client is during recording a video synchronized playback, stop wherein one or more in all synchronized playback video cameras When the playback business of video camera, back-end server receives the part Stop message that client is sent, which stops letter Breath includes stopping playback business video camera ID;According to part Stop message, stop obtaining the video recording for stopping playback business video camera Data simultaneously delete the Video data for stopping playback business video camera cached, successively by the Video data of remaining each video camera Be decoded, synthesize, coded treatment obtains splicing Video data, and send splicing Video data to corresponding client for recording a video Synchronized playback.
For example selection video camera A, B, C, D synchronize playback.Assuming that user stops taking the photograph on the client in replayed section The playback business of camera B, back-end server stop the Video data and the deletion that obtain video camera B according to the part Stop message The Video data of the video camera B deposited in caching has been obtained, then the Video data of remaining video camera A, C, D have successively been carried out Decoding, synthesis, coded treatment obtain splicing Video data, and send splicing Video data to corresponding client for synchronization of recording a video Playback.
During the client terminal playing splicing Video data, it can carry out including but not limited to dragging playback progress Item, pause playback continue the playback controls movement such as to play back, stop playback;The video camera played back can be replaced;It can stop The playback business of part video camera in synchronized playback.While guaranteeing playing back videos synchronism, meet the various playback of user Operational requirements, property that the user experience is improved.
Embodiment can be seen that from the above, and the present invention can be according to real network ambient conditions, to multichannel video camera The code rate value of synchronized playback video recording carries out any setting, effective solution network bandwidth deficiency bring data packetloss, image A series of problems, such as Caton flower screen, it can be adapted for various network environments.The present invention is by being put in back-end services for synchronizing process Device handles to obtain splicing Video data, then splices Video data and be sent to corresponding client for synchronized playback of recording a video, and reduces The asynchronous problem of video recording, greatly improves playing back videos synchronism caused by the factors such as network transmission, client decoding performance, Reach the synchronized playback in " real " meaning.
Fig. 3 is referred to, for a kind of structural schematic diagram for synchronous playback means of recording a video provided in an embodiment of the present invention, wherein The video recording synchronous playback means can be applied to the video monitoring system in above method embodiment, supervise for example, being applied to video In the back-end server of control system, which further includes client and video camera, as shown in figure 3, the video recording is synchronous Playback reproducer may include:
Message processing module 11, for receiving the video recording synchronized playback information of client transmission;
Video recording obtains module 12, the record of each video camera for needing synchronized playback according to video recording synchronized playback acquisition of information As data;
Format obtains module 13, and for obtaining the video recording format of each video camera, which includes: resolution ratio, frame per second;
Video recording decoder module 14, for calculating the corresponding decoding of each video camera according to the frame per second of the corresponding video recording of each video camera Speed, and the corresponding Video data of each video camera is extracted from the Video data of acquisition according to decoding speed and is decoded, it obtains Described image data are put into the first caching by the image data for carrying temporal information and frame number, which is the second;
Image zooming-out module 15 calculates synthesis speed for selecting the frame per second maximum value in the corresponding video recording frame per second of each video camera Degree extracts the corresponding image data of each video camera according to aggregate velocity from the first caching, and each video camera of extraction is corresponding Image data be put into the second caching, if in the second caching when the corresponding image data of existing each video camera, first deleting the The corresponding image data of already present each video camera in two cachings;
Video recording synthesis module 16, for after extracting the corresponding image data of each video camera in the second caching, judgement respectively to be taken the photograph Whether the resolution ratio of the corresponding video recording of camera is identical, if identical, directly closes each frame image data of extraction Stitching image is obtained at processing;If not exactly the same, each frame image data that first will acquire is zoomed in and out according to preset rules Processing, so that each frame image data size is identical, then carries out synthesis for each frame image data after scaling and handles to obtain spliced map Picture;
Video recording coding module 17, for stitching image progress coded treatment to be obtained splicing Video data;
Video recording sending module 18, for sending splicing Video data to corresponding client for institute's synchronized playback in need Each video camera carry out video recording synchronized playback.
Optionally, the received video recording synchronized playback information of message processing module 11 includes same in the video recording synchronous playback means Walk playback of encoded parameter;Above-mentioned video recording coding module 17 is also used to compile stitching image according to synchronized playback coding parameter Code processing obtains splicing Video data.
Optionally, which can also include: mode selection module 19 (Fig. 3 is not identified), be used for root Synthesis model is selected according to the video camera number of synchronized playback, when video camera number is less than or equal to taking the photograph for mode N+1 maximum support Camera number and when being greater than the video camera number that mode N maximum is supported, synthesis model selection mode N+1, wherein mode N maximum branch The video camera number held is square of N, and mode N is N row * N column mode, and N is positive integer.Above-mentioned video recording synthesis module 16 is also used to The corresponding each frame image of each video camera is subjected to synthesis processing according to synthesis model.
Optionally, above-mentioned image zooming-out module 15 further includes that the first judgment sub-unit 151, first extracts the (figure of subelement 152 3 do not identify), in which:
First judgment sub-unit 151, for after extracting the corresponding image data of each video camera in the first caching, judgement to be mentioned Whether the corresponding temporal information of each frame image data taken is identical;
First extracts subelement 152, for when the corresponding temporal information of each frame image data extracted from the first caching When not exactly the same, the corresponding temporal information of each frame image data is ranked up by size, only extracting time information is the smallest Image data is put into the second caching, other image datas are put back to the first caching;When each frame image extracted from the first caching When the corresponding temporal information of data is identical, each frame image data of extraction is put into the second caching.
Optionally, above-mentioned video recording synthesis module 16 further includes that the second judgment sub-unit 161, second extracts the (figure of subelement 162 3 do not identify), in which:
Second judgment sub-unit 161, the corresponding image data of each video camera for will extract from the second caching carry out Before synthesis processing, judge whether the image data frame number extracted is less than the number for needing each video camera of synchronized playback;
Second extracts subelement 162, for needing to synchronize back when the image data frame number extracted from the second caching is less than When each video camera number put, the one or more video cameras for not extracting image data are further determined that, by the splicing of synthesis This in image or the image of multiple video camera corresponding position part are filled with solid-color image;When what is extracted from the second caching When image data frame number is not less than each video camera number for needing synchronized playback, each frame image data of extraction is carried out at synthesis Reason obtains stitching image.
The function of modules and the realization process of effect are specifically detailed in the above method and correspond to step in above-mentioned apparatus Realization process, details are not described herein.
For device embodiment, since it corresponds essentially to embodiment of the method, so related place is referring to method reality Apply the part explanation of example.The apparatus embodiments described above are merely exemplary, wherein described be used as separation unit The module of explanation may or may not be physically separated, and the component shown as module can be or can also be with It is not physical unit, it can it is in one place, or may be distributed over multiple network units.It can be according to actual The purpose for needing to select some or all of the modules therein to realize the present invention program.Those of ordinary skill in the art are not paying Out in the case where creative work, it can understand and implement.
As seen from the above-described embodiment, the present invention can return the synchronization of multichannel video camera according to real network ambient conditions The code rate value for putting video recording carries out any setting, effective solution network bandwidth deficiency bring data packetloss, image Caton flower A series of problems, such as screen, can be adapted for various network environments.The present invention is by being put in back-end server processing for synchronizing process Splicing Video data is obtained, then splices Video data and is sent to corresponding client for synchronized playback of recording a video, reduces network biography The asynchronous problem of video recording, greatly improves playing back videos synchronism, reaches caused by the factors such as defeated, client decoding performance Synchronized playback in " real " meaning.
Those skilled in the art after considering the specification and implementing the invention disclosed here, will readily occur to of the invention its Its embodiment.This application is intended to cover any variations, uses, or adaptations of the invention, these modifications, purposes or Person's adaptive change follows general principle of the invention and including the undocumented common knowledge in the art of the present invention Or conventional techniques.The description and examples are only to be considered as illustrative, and true scope and spirit of the invention are wanted by right It asks and points out.
It should be understood that the present invention is not limited to the precise structure already described above and shown in the accompanying drawings, and And various modifications and changes may be made without departing from the scope thereof.The scope of the present invention is limited only by the attached claims.

Claims (10)

1. a kind of video recording synchronized playback method, applied to the back-end server in video monitoring system, which is characterized in that this method Include:
The video recording synchronized playback information that client is sent is received, and is synchronized back according to video recording synchronized playback acquisition of information needs The Video data for each video camera put;
The video recording format of each video camera is obtained, the video recording format includes: resolution ratio, frame per second;
Calculate the corresponding decoding speed of each video camera according to the frame per second of the corresponding video recording of each video camera, and according to decoding speed from obtaining The corresponding Video data of each video camera is extracted in the Video data taken to be decoded, and obtains the figure for carrying temporal information and frame number As data, described image data are put into the first caching, the temporal information unit is the second;
The frame per second maximum value in the corresponding video recording frame per second of each video camera is selected to calculate aggregate velocity, it is slow from first according to aggregate velocity The corresponding image data of middle each video camera of extraction is deposited, and the corresponding image data of each video camera of extraction is put into the second caching, If first deleting already present each video camera in the second caching when the corresponding image data of existing each video camera in the second caching Corresponding image data;
After extracting the corresponding image data of each video camera in the second caching, whether the corresponding resolution ratio recorded a video of each video camera is judged It is identical, if identical, each frame image data of extraction is directly subjected to synthesis and handles to obtain stitching image;If endless Exactly the same, then each frame image data that first will acquire zooms in and out processing according to preset rules, so that each frame image data size It is identical, then each frame image data after scaling is subjected to synthesis and handles to obtain stitching image;
Stitching image progress coded treatment is obtained into splicing Video data;
Send splicing Video data to corresponding client be used for each video camera of synchronized playback in need carry out video recording synchronization Playback.
2. video recording synchronized playback method as described in claim 1, which is characterized in that the video recording synchronized playback information includes same Walk playback of encoded parameter;It is described that stitching image progress coded treatment is obtained into the process of splicing Video data, it specifically includes:
Stitching image is subjected to coded treatment according to the synchronized playback coding parameter and obtains splicing Video data.
3. video recording synchronized playback method as described in claim 1, which is characterized in that this method further include:
Synthesis model is selected according to the video camera number of synchronized playback, when video camera number is less than or equal to mode N+1 maximum branch The video camera number held and when being greater than the video camera number that mode N maximum is supported, selection mode N+1, will be each as synthesis model The corresponding each frame image of video camera carries out synthesis processing according to synthesis model, and the video camera number that wherein mode N maximum is supported is N Square, mode N be N row * N column mode, N is positive integer.
4. video recording synchronized playback method as described in claim 1, which is characterized in that this method further include:
After extracting the corresponding image data of each video camera in the first caching, when first judging that each frame image data extracted is corresponding Between information it is whether identical, if not exactly the same, the corresponding temporal information of each frame image data is ranked up by size, Only the smallest image data of extracting time information is put into the second caching, other image datas are put back to the first caching;If they are the same, then Each frame image data of extraction is put into the second caching.
5. video recording synchronized playback method as described in claim 1, which is characterized in that this method further include:
Before carrying out synthesis processing from the corresponding image data of each video camera extracted in the second caching, the image extracted is also judged Whether data frame number, which is less than, needs the number of each video camera of synchronized playback to further determine that if being less than and do not extract image One or more video cameras of data, by this in the stitching image of synthesis or the image of multiple video camera corresponding position part It is filled with solid-color image;If being not less than, each frame image data of extraction is subjected to synthesis and handles to obtain stitching image.
6. a kind of video recording synchronous playback means, applied to the back-end server in video monitoring system, which is characterized in that the device Include:
Message processing module, for receiving the video recording synchronized playback information of client transmission;
Video recording obtains module, the video recording of each video camera for needing synchronized playback according to the video recording synchronized playback acquisition of information Data;
Format obtains module, and for obtaining the video recording format of each video camera, the video recording format includes: resolution ratio, frame per second;
Video recording decoder module, for calculating the corresponding decoding speed of each video camera according to the frame per second of the corresponding video recording of each video camera, And the corresponding Video data of each video camera is extracted from the Video data of acquisition according to decoding speed and is decoded, it is carried Described image data are put into the first caching by the image data of temporal information and frame number, which is the second;
Image zooming-out module calculates aggregate velocity, root for selecting the frame per second maximum value in the corresponding video recording frame per second of each video camera The corresponding image data of each video camera is extracted from the first caching according to aggregate velocity, and by the corresponding image of each video camera of extraction Data are put into the second caching, if first deleting the second caching when the corresponding image data of existing each video camera in the second caching In the corresponding image data of already present each video camera;
Video recording synthesis module, for judging each video camera pair after extracting the corresponding image data of each video camera in the second caching Whether the resolution ratio that should be recorded a video is identical, if identical, each frame image data of extraction is directly carried out synthesis processing Obtain stitching image;If not exactly the same, each frame image data that first will acquire zooms in and out processing according to preset rules, makes It is identical to obtain each frame image data size, then each frame image data after scaling is subjected to synthesis and handles to obtain stitching image;
Video recording coding module, for stitching image progress coded treatment to be obtained splicing Video data;
Record a video sending module, for sends splicing Video data to corresponding client for synchronized playback in need respectively take the photograph Camera carries out video recording synchronized playback.
7. video recording synchronous playback means as claimed in claim 6, which is characterized in that the received video recording of message processing module Synchronized playback information includes synchronized playback coding parameter;The video recording coding module is also used to stitching image according to described same Step playback of encoded parameter carries out coded treatment and obtains splicing Video data.
8. video recording synchronous playback means as claimed in claim 6, which is characterized in that the device further include:
Mode selection module, for selecting synthesis model according to the video camera number of synchronized playback, be less than when video camera number or Equal to mode N+1 maximum support video camera number and be greater than mode N maximum support video camera number when, synthesis model selection Mode N+1, square that the video camera number that wherein mode N maximum is supported is N, mode N is N row * N column mode, and N is positive integer;
Video recording synthesis module, is also used to the corresponding each frame image of each video camera carrying out synthesis processing according to synthesis model.
9. video recording synchronous playback means as claimed in claim 6, which is characterized in that described image extraction module further includes first Judgment sub-unit, first extract subelement,
First judgment sub-unit, for judging to extract after extracting the corresponding image data of each video camera in the first caching The corresponding temporal information of each frame image data it is whether identical;
Described first extracts subelement, endless for working as the corresponding temporal information of each frame image data extracted from the first caching When exactly the same, the corresponding temporal information of each frame image data is ranked up by size, only the smallest image of extracting time information Data are put into the second caching, other image datas are put back to the first caching;When each frame image data extracted from the first caching When corresponding temporal information is identical, each frame image data of extraction is put into the second caching.
10. video recording synchronous playback means as claimed in claim 6, which is characterized in that the video recording synthesis module further includes the Two judgment sub-units, second extract subelement,
Second judgment sub-unit, for synthesizing the corresponding image data of each video camera extracted from the second caching Before processing, judge whether the image data frame number extracted is less than the number for needing each video camera of synchronized playback;
Described second extracts subelement, for needing synchronized playback when the image data frame number extracted from the second caching is less than When each video camera number, the one or more video cameras for not extracting image data are further determined that, by the stitching image of synthesis In the image of this or multiple video camera corresponding position part filled with solid-color image;When the image extracted from the second caching When data frame number is not less than each video camera number for needing synchronized playback, each frame image data of extraction is subjected to synthesis and is handled To stitching image.
CN201610061280.6A 2016-01-28 2016-01-28 A kind of video recording synchronized playback method and device Active CN107018442B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201610061280.6A CN107018442B (en) 2016-01-28 2016-01-28 A kind of video recording synchronized playback method and device

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201610061280.6A CN107018442B (en) 2016-01-28 2016-01-28 A kind of video recording synchronized playback method and device

Publications (2)

Publication Number Publication Date
CN107018442A CN107018442A (en) 2017-08-04
CN107018442B true CN107018442B (en) 2019-06-11

Family

ID=59439260

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201610061280.6A Active CN107018442B (en) 2016-01-28 2016-01-28 A kind of video recording synchronized playback method and device

Country Status (1)

Country Link
CN (1) CN107018442B (en)

Families Citing this family (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN108010058A (en) * 2017-11-29 2018-05-08 广东技术师范学院 A kind of method and system that vision tracking is carried out to destination object in video flowing
CN111385639B (en) 2018-12-28 2021-02-12 广州市百果园信息技术有限公司 Video special effect adding method, device, equipment and storage medium
CN111949344A (en) * 2019-05-14 2020-11-17 华为技术有限公司 Method for virtual machine to remotely access data of USB peripheral

Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN201781583U (en) * 2010-01-22 2011-03-30 深圳市同洲电子股份有限公司 Multichannel server video playback synchronous control system
CN103024352A (en) * 2012-12-07 2013-04-03 康佳集团股份有限公司 Video monitoring method and system based on code rate mutation
CN103686071A (en) * 2013-10-30 2014-03-26 北京中星微电子有限公司 Monitoring video playback method and system
CN103888729A (en) * 2014-03-19 2014-06-25 浙江宇视科技有限公司 Method and device for synchronizing camera information between video monitoring platforms
CN105262971A (en) * 2015-11-30 2016-01-20 浙江宇视科技有限公司 Replay method and device of video of fisheye camera

Patent Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN201781583U (en) * 2010-01-22 2011-03-30 深圳市同洲电子股份有限公司 Multichannel server video playback synchronous control system
CN103024352A (en) * 2012-12-07 2013-04-03 康佳集团股份有限公司 Video monitoring method and system based on code rate mutation
CN103686071A (en) * 2013-10-30 2014-03-26 北京中星微电子有限公司 Monitoring video playback method and system
CN103888729A (en) * 2014-03-19 2014-06-25 浙江宇视科技有限公司 Method and device for synchronizing camera information between video monitoring platforms
CN105262971A (en) * 2015-11-30 2016-01-20 浙江宇视科技有限公司 Replay method and device of video of fisheye camera

Also Published As

Publication number Publication date
CN107018442A (en) 2017-08-04

Similar Documents

Publication Publication Date Title
CN112291627B (en) Video editing method and device, mobile terminal and storage medium
CN107295284B (en) Method and device for generating, retrieving and playing video file consisting of audio and picture
CN106331645B (en) The method and system of VR panoramic video later stage compilation is realized using virtual lens
JP4877852B2 (en) Image encoding apparatus and image transmitting apparatus
KR101604250B1 (en) Method of Providing Service for Recommending Game Video
EP4084487A2 (en) A video broadcast system and a method of disseminating video content
US20150222815A1 (en) Aligning videos representing different viewpoints
CN105939481A (en) Interactive three-dimensional virtual reality video program recorded broadcast and live broadcast method
WO2014025319A1 (en) System and method for enabling user control of live video stream(s)
KR20150125947A (en) Method and apparatus for using a list driven selection process to improve video and media time based editing
CN104079833A (en) Method and device for shooting star orbit videos
CN112218154B (en) Video acquisition method and device, storage medium and electronic device
WO2007056048A1 (en) Multi-view video delivery
CN113067994B (en) Video recording method and electronic equipment
CN108282598A (en) A kind of software director system and method
US11570415B2 (en) Methods, systems, and media for generating a summarized video using frame rate modification
CN113747240B (en) Video processing method, apparatus and storage medium
CN103747259A (en) Video processing method and device
CN107018442B (en) A kind of video recording synchronized playback method and device
KR20150125948A (en) Method and apparatus for automatic video segmentation
CN104244101A (en) Method and device for commenting multimedia content
CN101808211B (en) Recording apparatus for recording moving picture and recording method
US8774605B2 (en) Display processing apparatus, control method therefor, and display processing system
CN113542896B (en) Video live broadcast method, equipment and medium of free view angle
US11622099B2 (en) Information-processing apparatus, method of processing information, and program

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant