CN102204248B - Video data processing method, video image displaying method and device thereof - Google Patents
Video data processing method, video image displaying method and device thereof Download PDFInfo
- Publication number
- CN102204248B CN102204248B CN201180000541.9A CN201180000541A CN102204248B CN 102204248 B CN102204248 B CN 102204248B CN 201180000541 A CN201180000541 A CN 201180000541A CN 102204248 B CN102204248 B CN 102204248B
- Authority
- CN
- China
- Prior art keywords
- video
- frame
- intellectual analysis
- original video
- labeling
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
Images
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N7/00—Television systems
- H04N7/18—Closed-circuit television [CCTV] systems, i.e. systems in which the video signal is not broadcast
Landscapes
- Engineering & Computer Science (AREA)
- Multimedia (AREA)
- Signal Processing (AREA)
- Two-Way Televisions, Distribution Of Moving Picture Or The Like (AREA)
- Image Analysis (AREA)
Abstract
The invention provides a video data processing method, a video image displaying method and a device thereof to guarantee the integrality of an original image and to improve the capacity of the system. The method includes the steps of obtaining an original video stream; generating an intelligent analyzing frame with a video identification which is concordant to that of the original video frame from the obtained original video stream according to unit of the original video frame; sending the intelligent analyzing to a video monitoring platform. Compared to the prior art, the video data processing method provided in the invention does not change the original video data, thereby guaranteeing the integrality of the original video and reserving watermarks of the original video. Thus, real first hand material can be provided for conditions that need original video. On the other hand, since the process of coding after decoding the video stream is avoided, the video data processing method provided in the invention improves the capacity of the system integrally.
Description
Technical field
The present invention relates to field of video processing, relate in particular to video data handling procedure, video image methods of exhibiting and device.
Background technology
Network video monitor and control system (Network Video System, NVS) be based on Digital Signal Processing, adopt networked mode to realize transmission, exchange, control, video recording storage and the on-demand playback of signal, and by setting up powerful central service platform, realize all coding/decoding apparatus in the system and video recording memory device are carried out unified management and central controlled system.
The NVS that prior art provides has an intelligent analysis module, and the key step that NVS handles video comprises: intelligent analysis module is obtained video flowing; Decoding video stream after intelligent analysis module will be encoded; Intelligent analysis module is carried out intellectual analysis to decoded video flowing, and these intellectual analysis comprise intrusion detection, mix ray examination and lost-and-found object detection etc.; Intelligent analysis module is synthetic with data and the initial data of intellectual analysis, for example, for intrusion detection, the intelligent analysis module result that the data of intellectual analysis and initial data is synthetic can be a track, the sign object enter detected zone the path of process; Intelligent analysis module is to synthetic image recompile; Video data behind the intelligent analysis module output encoder is transferred to video monitoring platform with this video data and is used for transmitting or storage.
The NVS that provides from above-mentioned prior art as can be known owing to exist the process of coding again after the decoding video stream behind the coding, system performance loss is excessive; On the other hand, intelligent analysis module is when synthetic with the data of intellectual analysis and initial data, do not take special measure, therefore, can't from synthetic image, recover initial data, this can become a bigger problem in the occasion that needs original image, especially, for the original image that watermark is arranged, after intellectual analysis is synthetic, because can there be the process of video clip and recompile, therefore can't keep original watermark.
Summary of the invention
The embodiment of the invention provides a kind of video data handling procedure, video image methods of exhibiting and device, with the integrality that guarantees original image and the performance that improves system.
The embodiment of the invention provides a kind of video data handling procedure, comprising: obtain original video stream; Original video frame is carried out intellectual analysis, generate intellectual analysis figure layer information, described intellectual analysis figure layer information comprises track and the wire frame that produces when described original video frame carried out intellectual analysis; Be described intellectual analysis figure layer information configuration video labeling, the video labeling of described configuration is consistent with the video labeling of described original video frame, and described video labeling comprises frame head and/or timestamp; Send the intellectual analysis frame to video monitoring platform, described intellectual analysis frame separates storage with the described original video stream that directly transfers to described video monitoring platform at described video monitoring platform with document form, and described intellectual analysis frame comprises the described intellectual analysis figure layer information that has disposed video labeling.
The embodiment of the invention provides a kind of video image methods of exhibiting, comprising: resolve the intellectual analysis frame that obtains and obtain the video labeling that described intellectual analysis frame comprises; From the original video stream of obtaining, mate the original video frame corresponding with described intellectual analysis frame according to described video labeling; The information layered demonstration of frame of video that the intellectual analysis figure layer information that described intellectual analysis frame is comprised and described original video frame comprise.
The embodiment of the invention provides a kind of video intelligent analytical equipment, comprising: the video flowing acquisition module is used for obtaining original video stream; Intellectual analysis figure layer information generating unit is used for original video frame is carried out intellectual analysis, generates intellectual analysis figure layer information, and described intellectual analysis figure layer information comprises track and the wire frame that produces when described original video frame carried out intellectual analysis; The sign dispensing unit is used to described intellectual analysis figure layer information configuration video labeling, and the video labeling of described configuration is consistent with the video labeling of described original video frame, and described video labeling comprises frame head and/or timestamp; Sending module, be used for sending the intellectual analysis frame to video monitoring platform, described intellectual analysis frame separates storage with the described original video stream that directly transfers to described video monitoring platform at described video monitoring platform with document form, and described intellectual analysis frame comprises the described intellectual analysis figure layer information that has disposed video labeling.
The embodiment of the invention provides a kind of video image exhibiting device, comprising: parsing module is used for resolving the intellectual analysis frame that obtains and obtains the video labeling that described intellectual analysis frame comprises; Matching module is used for according to original video stream coupling with the described intellectual analysis frame corresponding original video frame of described video labeling from obtaining; Display module is used for the information layered demonstration of frame of video that intellectual analysis figure layer information that described intellectual analysis frame is comprised and described original video frame comprise.
The embodiment of the invention provides a kind of video monitoring system, comprises video intelligent analytical equipment, video monitoring platform and client, and described client comprises the video image exhibiting device; Described video intelligent analytical equipment, be used for obtaining original video stream, be that unit generates the video labeling intellectual analysis frame consistent with the video labeling of described original video frame with the described original video stream of obtaining according to original video frame, send described intellectual analysis frame to described video monitoring platform, described intellectual analysis frame separates storage with the described original video stream that directly transfers to described video monitoring platform at described video monitoring platform with document form, and described video labeling comprises frame head and/or timestamp; Described video monitoring platform is used for receiving the described original video stream that directly transmits from the video monitoring system headend equipment, and described intellectual analysis frame is separated storage with document form with described original video stream; Described video image exhibiting device, be used for resolving the intellectual analysis frame that obtains from described video monitoring platform and obtain the video labeling that described intellectual analysis frame comprises, from the original video stream that described video monitoring platform obtains, mate the original video frame corresponding with described intellectual analysis frame according to described video labeling, the information layered demonstration of frame of video that the intellectual analysis figure layer information that described intellectual analysis frame is comprised and described original video frame comprise.
From the invention described above embodiment as can be known, because intelligent analysis module is that unit has generated the video labeling intellectual analysis frame consistent with the video labeling of this original video frame with the original video stream of obtaining according to original video frame, after these intellectual analysis frames were transferred to video monitoring platform, video monitoring platform separated storage with document form with original video stream with this intellectual analysis frame.Therefore, with prior art the data of intellectual analysis are compared with the synthetic video data that obtains synthesizing of initial data, the video data handling procedure that the embodiment of the invention provides does not change original video data, on the one hand, guaranteed the integrality of original video, also kept the watermark of original video, these all be need call original video occasion (for example, public security, investigation etc.) provide real first-hand data, on the other hand, because saved the process of encoding again to after the decoding video stream, therefore, the video data handling procedure that the embodiment of the invention provides has improved the performance of system on the whole.
Description of drawings
In order to be illustrated more clearly in the technical scheme of the embodiment of the invention, to do to introduce simply to the accompanying drawing of required use in prior art or the embodiment description below, apparently, accompanying drawing in describing below only is some embodiments of the present invention, for those skilled in the art, can also obtain other accompanying drawing as these accompanying drawings.
Fig. 1 is the video data handling procedure schematic flow sheet that the embodiment of the invention provides;
Fig. 2 is the intellectual analysis frame structure schematic diagram that the embodiment of the invention provides;
Fig. 3 is the intellectual analysis file structure schematic diagram that the embodiment of the invention provides;
Fig. 4 is the video image methods of exhibiting schematic flow sheet that the embodiment of the invention provides;
Fig. 5 is the video intelligent analytical equipment logical construction schematic diagram that the embodiment of the invention provides;
Fig. 6 is the video intelligent analytical equipment logical construction schematic diagram that another embodiment of the present invention provides;
Fig. 7 is the video intelligent analytical equipment logical construction schematic diagram that another embodiment of the present invention provides;
Fig. 8 is the video intelligent analytical equipment logical construction schematic diagram that another embodiment of the present invention provides;
Fig. 9 is the video image exhibiting device logical construction schematic diagram that the embodiment of the invention provides;
Figure 10 is the video image exhibiting device logical construction schematic diagram that another embodiment of the present invention provides;
Figure 11 is a kind of video monitoring system logical construction schematic diagram that the embodiment of the invention provides.
Embodiment
Below in conjunction with the accompanying drawing in the embodiment of the invention, the technical scheme in the embodiment of the invention is clearly and completely described, obviously, described embodiment only is the present invention's part embodiment, rather than whole embodiment.Based on the embodiment among the present invention, the every other embodiment that those skilled in the art obtain belongs to the scope of protection of the invention.
Seeing also accompanying drawing 1, is the video data handling procedure schematic flow sheet that the embodiment of the invention provides, and the executive agent of this method can be the intelligent analysis module in the video monitoring system, mainly comprises step:
S101 obtains original video stream.
So-called original video stream refers to that the headend equipment of video monitoring system is gathered video data through encoded video stream.In embodiments of the present invention, if the difference of intelligent analysis module present position, its mode of obtaining original video stream is slightly variant.For example, if intelligent analysis module and headend equipment, for example, network video server/DVR (DVS/DVR, Digital Video Server/Digital Video Recorder) integrate, intelligent analysis module is to obtain original video stream from headend equipment so; If intelligent analysis module is integrated in the video monitoring platform, headend equipment is transferred to video monitoring platform with original video stream through network so, and intelligent analysis module is obtained the original video stream that transfers to video monitoring platform; If intelligent analysis module is integrated in the NVS client, the NVS server is forwarded to the NVS client with the front end original video stream so, and intelligent analysis module is obtained the original video stream that transfers to the NVS client.
S102 is that unit generates the video labeling intellectual analysis frame consistent with the video labeling of described original video frame with the described original video stream of obtaining according to original video frame.
In embodiments of the present invention, video labeling can be frame head and/or the timestamp of a frame, and for example, original video frame has the video labeling that comprises frame head and/or timestamp.After intelligent analysis module is obtained original video stream, at first these original video stream are decoded, and decoded video flowing is carried out intellectual analysis, these intellectual analysis comprise intrusion detection, mix ray examination and lost-and-found object detection etc.The intellectual analysis data that original video frame is carried out producing behind the intellectual analysis are exactly the intellectual analysis frame, can use dot chart to describe, and also can use polar plot to describe.Owing to can be that unit calculates video flowing with the frame, in embodiments of the present invention, be that unit generates the video labeling intellectual analysis frame consistent with the video labeling of original video frame with the original video stream of obtaining according to original video frame.Particularly, can pass through described video labeling, be that unit is related with described original video frame with the intellectual analysis frame according to frame, and the effect of this association is, can find original video frame according to the video labeling of intellectual analysis frame.By described video labeling, being that unit is related with described original video frame with the intellectual analysis frame according to frame specifically can comprise:
S1021 carries out intellectual analysis to original video frame, generates intellectual analysis figure layer information;
These intellectual analysis figure layer information comprises track and the wire frame that produces when original video frame carried out intellectual analysis.For the method for some intellectual analysis, for example, intrusion detection, the track in the intellectual analysis figure layer information can be the sign object enter detected zone the path of process, and the wire frame in the intellectual analysis figure layer information can be thought the border of monitoring range.Intellectual analysis figure layer information also comprises the out of Memory such as Word message, wire frame and lines that produce when original video frame carried out intellectual analysis.Intellectual analysis figure layer can use dot chart to describe, and for example, bmp form, jpeg form and png form etc. also can use polar plot to describe, for example, and svg form and flash form etc.
S1022 is intellectual analysis figure layer information configuration video labeling, and the video labeling of described configuration is consistent with the video labeling of described original video frame.
For example, if having the frame head of a frame original video frame and timestamp to be respectively H1 and TS1, then can be frame head and the timestamp of intellectual analysis figure layer information configuration H1 and TS1.Because the intellectual analysis frame comprises the described intellectual analysis figure layer information that has disposed video labeling, therefore, frame head and the timestamp of the intellectual analysis frame of generation also are respectively H1 and TS1.
Further, can also add descriptor for intellectual analysis figure layer information.Descriptor is the explanation to each intellectual analysis frame, can be recording events, alarm event, and other descriptors etc., for example, events such as mobile detection or video-losing, the index that descriptor can be used to search for.
Accompanying drawing 2 has provided the intellectual analysis frame structure schematic diagram (shown in the real diagram) that the embodiment of the invention provides, obviously, the difference of intellectual analysis frame and original video frame (shown in the dashed line view) also is, the intellectual analysis frame does not comprise the video data behind the coding, therefore, the video data handling procedure that provides of the embodiment of the invention does not destroy the video data that original video frame comprises.
S103 sends the intellectual analysis frame to video monitoring platform.
Intelligent analysis module is that unit is sent to video monitoring platform with the intellectual analysis frame with the frame.At video monitoring platform, the intellectual analysis figure layer information of each camera, each section period (intellectual analysis figure layer information may comprise some frame intellectual analysis frames) will be stored as an intellectual analysis file, for example, be stored as an intellectual analysis file according to each camera lens intellectual analysis figure hourly layer information.As shown in Figure 3, it is the structural representation (shown in the real diagram) of the intellectual analysis file that is stored in video monitoring platform that provides of the embodiment of the invention, these intellectual analysis files comprise that facility information (for example, the ID of camera lens), the zero hour of one section video and the finish time thereof and intellectual analysis frame information, wherein, the intellectual analysis frame information is exactly the content shown in the intellectual analysis frame shown in accompanying drawing 2 solid lines, comprises frame head, timestamp, descriptor and the intellectual analysis figure layer information etc. of intellectual analysis frame.
Original video stream can directly transfer to video monitoring platform from headend equipment by network.Unlike the prior art be, in the embodiment of the invention, described intellectual analysis frame separates storage with the described original video stream that directly transfers to described video monitoring platform at described video monitoring platform with document form, namely, at video monitoring platform, these video files (shown in accompanying drawing 3 dashed line view) that comprise original video stream are two kinds different or two files with the intellectual analysis file, their each self-separation storages.For same section video, the zero hour of the facility information in the intellectual analysis file, this section video and the finish time thereof respectively with video file in the zero hour and finish time thereof of facility information, this section video corresponding identical.
From the invention described above embodiment as can be known, because intelligent analysis module is that unit has generated the video labeling intellectual analysis frame consistent with the video labeling of this original video frame with the original video stream of obtaining according to original video frame, after these intellectual analysis frames were transferred to video monitoring platform, video monitoring platform separated storage with document form with original video frame (with the storage of video file form) with this intellectual analysis frame.Therefore, with prior art the data of intellectual analysis are compared with the synthetic video data that obtains synthesizing of initial data, the video data handling procedure that the embodiment of the invention provides does not change original video data, on the one hand, guaranteed the integrality of original video, also kept the watermark of original video, these all be need call original video occasion (for example, public security, investigation etc.) provide real first-hand data, on the other hand, because saved the process of encoding again to after the decoding video stream, therefore, the video data handling procedure that the embodiment of the invention provides has improved the performance of system on the whole.
Seeing also accompanying drawing 4, is the video image methods of exhibiting schematic flow sheet that the embodiment of the invention provides, and the executive agent of this method can be client in the video monitoring system or the functional module in the client, mainly comprises step:
S401 resolves the intellectual analysis frame that obtains and obtains the video labeling that the intellectual analysis frame comprises.
In embodiments of the present invention, client is obtained the intellectual analysis frame by network from video monitoring platform.As described in aforementioned embodiment, the intellectual analysis frame constitutes by adding video labeling for intellectual analysis figure layer information, and these video labelings comprise frame head and timestamp etc.After client has been obtained the intellectual analysis frame, resolve the video labeling that the intellectual analysis frame just can wherein be comprised.
S402 mates the original video frame corresponding with the intellectual analysis frame according to video labeling from the original video stream of obtaining.
Because video monitoring platform has been stored original video stream, therefore, in embodiments of the present invention, client also can be obtained original video stream from video monitoring platform by network, then these original video stream is decoded as the YUV view data; On the other hand, client parses intellectual analysis figure layer data from the intellectual analysis frame, obtain frame head, timestamp information, descriptor and intellectual analysis figure layer information (comprising wire frame, track etc.), be intellectual analysis figure layer information decoding the YUV view data then, the YUV video view data of searching coupling according to frame head and timestamp information is namely mated the original video frame corresponding with the intellectual analysis frame that obtains according to video labeling from the original video stream of obtaining again.
S403, the information layered demonstration of frame of video that the intellectual analysis figure layer information that the intellectual analysis frame is comprised and original video frame comprise.
In embodiments of the present invention, intellectual analysis figure layer information can be presented at the upper strata of figure layer, frame of video information is presented at the lower floor of figure layer, namely can be by the video superimpose blender (for example, the VMR:Video Mixer Renderer of DirectShow) yuv data of original video frame and the yuv data of intellectual analysis figure layer are superposeed, make described intellectual analysis figure layer information decoding gained YUV view data be presented at the upper strata of figure layer, described original video stream decoding gained YUV view data is presented at the lower floor of figure layer.
In another embodiment of the present invention, can also receive the user to the descriptor of original video frame.For example, the user is when watching video, can add descriptor (text, connection etc.) at each frame original video frame data, descriptor will be recorded to " descriptor " field in the intellectual analysis frame information, and these descriptors can be used as the keyword of video frequency searching.
From the invention described above embodiment as can be known, owing to can from the original video stream of obtaining, mate the original video frame corresponding with the intellectual analysis frame according to video labeling, and, the information layered demonstration of frame of video that the intellectual analysis figure layer information that the intellectual analysis frame is comprised and original video frame comprise.Therefore, the video image methods of exhibiting that the embodiment of the invention provides can be showed intellectual analysis figure layer easily, also can show the analysis content that the user adds, can make video to represent form abundanter.
Seeing also accompanying drawing 5, is a kind of video intelligent analytical equipment logical construction schematic diagram that the embodiment of the invention provides.For convenience of explanation, only show the part relevant with the embodiment of the invention.The call control apparatus of accompanying drawing 5 examples can be the intelligent analysis module in the video monitoring system, can be integrated in headend equipment, video monitoring platform or client etc., it also can be the entity that is independent of these equipment, its functional module/unit that comprises can be software module/unit, hardware module/unit or the software and hardware module/unit that combines, comprise video flowing acquisition module 501, generation module 502 and transport module 503, wherein:
Video flowing acquisition module 501 is used for obtaining original video stream;
Need to prove, in the execution mode of above video intelligent analytical equipment, the division of each functional module only illustrates, can be as required in the practical application, for example the facility of the realization of the configuration requirement of corresponding hardware or software is considered, and the above-mentioned functions distribution is finished by different functional modules, the internal structure that is about to described video intelligent analytical equipment is divided into different functional modules, to finish all or part of function described above.And, in the practical application, corresponding functional module in the present embodiment can be to be realized by corresponding hardware, also can carry out corresponding software by corresponding hardware finishes, for example, aforesaid video flowing acquisition module can be to have the aforementioned hardware that obtains original video stream of execution, video flowing getter for example, thus also can be to carry out general processor or other hardware devices that the corresponding computer program is finished aforementioned functional; Aforesaid generation module for another example, can be that having execution aforementioned is the hardware that unit generates the video labeling intellectual analysis frame function consistent with the video labeling of described original video frame with the described original video stream of obtaining according to original video frame, as maker, thereby also can be to carry out general processor or other hardware devices that the corresponding computer program is finished aforementioned functional.
The generation module 502 of accompanying drawing 5 examples can comprise the related submodule 601 of frame, as shown in Figure 6 the video intelligent analytical equipment that provides of another embodiment of the present invention.The related submodule 601 of frame is used for by described video labeling, is that unit is related with described original video frame with the intellectual analysis frame according to frame.
The related submodule 601 of the frame of accompanying drawing 6 examples may further include intellectual analysis figure layer information generating unit 701 and sign dispensing unit 702, the video intelligent analytical equipment that provides of another embodiment of the present invention as shown in Figure 7, wherein:
Intellectual analysis figure layer information generating unit 701 is used for described original video frame is carried out intellectual analysis, generates intellectual analysis figure layer information, and described intellectual analysis figure layer information comprises track and the wire frame that produces when described original video frame carried out intellectual analysis;
Sign dispensing unit 702, be used to described intellectual analysis figure layer information configuration video labeling, the video labeling of described configuration is consistent with the video labeling of described original video frame, and described intellectual analysis frame comprises the described intellectual analysis figure layer information that has disposed video labeling.
The related submodule 601 of the frame of accompanying drawing 6 examples may further include descriptor adding device 801, as shown in Figure 8 the video intelligent analytical equipment that provides of another embodiment of the present invention.Descriptor adding device 801 is used to described intellectual analysis figure layer information to add descriptor, and described descriptor comprises recording events and alarm event.
Seeing also accompanying drawing 9, is a kind of video image exhibiting device logical construction schematic diagram that the embodiment of the invention provides.For convenience of explanation, only show the part relevant with the embodiment of the invention.The video image exhibiting device of accompanying drawing 9 examples can be client in the video monitoring system or certain functional module in the client, and it comprises parsing module 901, matching module 902 and display module 903, wherein:
Parsing module 901 is used for resolving the intellectual analysis frame that obtains and obtains the video labeling that described intellectual analysis frame comprises;
The video image exhibiting device of accompanying drawing 9 examples can also comprise receiver module 1001, as shown in Figure 10 the video image exhibiting device that provides of another embodiment of the present invention.Receiver module 1001 is used for receiving the user to the descriptor of original video frame.
Seeing also accompanying drawing 11, is a kind of video monitoring system logical construction schematic diagram that the embodiment of the invention provides.For convenience of explanation, only show the part relevant with the embodiment of the invention.The video monitoring system of accompanying drawing 11 examples comprises video monitoring platform 1102, accompanying drawing 5 to video intelligent analytical equipment 1101 and the client 1103 of accompanying drawing 8 arbitrary examples, and client 1103 comprises the video image exhibiting device of accompanying drawing 9 or accompanying drawing 10 examples, wherein:
Video intelligent analytical equipment 1101, be used for obtaining original video stream, be that unit generates the video labeling intellectual analysis frame consistent with the video labeling of described original video frame with the described original video stream of obtaining according to original video frame, send described intellectual analysis frame to described video monitoring platform 1102, described intellectual analysis frame separates storage with the described original video stream that directly transfers to described video monitoring platform 1102 at described video monitoring platform with document form, and described video labeling comprises frame head and/or timestamp;
The video image exhibiting device, be used for resolving the intellectual analysis frame that obtains from described video monitoring platform 1102 and obtain the video labeling that described intellectual analysis frame comprises, from the original video stream that described video monitoring platform 1102 obtains, mate the original video frame corresponding with described intellectual analysis frame according to described video labeling, the information layered demonstration of frame of video that the intellectual analysis figure layer information that described intellectual analysis frame is comprised and described original video frame comprise.
Need to prove, contents such as the information interaction between each module/unit of said apparatus, implementation, since with the inventive method embodiment based on same design, its technique effect that brings is identical with the inventive method embodiment, particular content can repeat no more referring to the narration among the inventive method embodiment herein.
One of ordinary skill in the art will appreciate that all or part of step in the whole bag of tricks of above-described embodiment is to instruct relevant hardware to finish by program, this program can be stored in the computer-readable recording medium, storage medium can comprise: read-only memory (ROM, Read Only Memory), random access memory (RAM, Random Access Memory), disk or CD etc.
More than video data handling procedure, video image methods of exhibiting and device that the embodiment of the invention is provided be described in detail, used specific case herein principle of the present invention and execution mode are set forth, the explanation of above embodiment just is used for helping to understand method of the present invention and core concept thereof; Simultaneously, for one of ordinary skill in the art, according to thought of the present invention, the part that all can change in specific embodiments and applications, in sum, this description should not be construed as limitation of the present invention.
Claims (11)
1. a video data handling procedure is characterized in that, described method comprises:
Obtain original video stream;
Original video frame is carried out intellectual analysis, generate intellectual analysis figure layer information, described intellectual analysis figure layer information comprises track and the wire frame that produces when described original video frame carried out intellectual analysis;
Be described intellectual analysis figure layer information configuration video labeling, the video labeling of described configuration is consistent with the video labeling of described original video frame, and described video labeling comprises frame head and/or timestamp;
Send the intellectual analysis frame to video monitoring platform, described intellectual analysis frame separates storage with the described original video stream that directly transfers to described video monitoring platform at described video monitoring platform with document form, and described intellectual analysis frame comprises the described intellectual analysis figure layer information that has disposed video labeling.
2. the method for claim 1 is characterized in that, describedly also comprises for described intellectual analysis figure layer information configuration video labeling the time:
Add descriptor for described intellectual analysis figure layer information, described descriptor comprises recording events and alarm event.
3. a video image methods of exhibiting is characterized in that, described method comprises:
The intellectual analysis frame that parsing is obtained obtains the video labeling that described intellectual analysis frame comprises;
From the original video stream of obtaining, mate the original video frame corresponding with described intellectual analysis frame according to described video labeling;
The information layered demonstration of frame of video that the intellectual analysis figure layer information that described intellectual analysis frame is comprised and described original video frame comprise.
4. method as claimed in claim 3 is characterized in that, information layered being shown as of frame of video that the described intellectual analysis figure layer information that described intellectual analysis frame is comprised and described original video frame comprise:
The intellectual analysis figure layer information decoding that described original video stream and described intellectual analysis frame are comprised is the YUV view data;
With described YUV view data stack, make described intellectual analysis figure layer information decoding gained YUV view data be presented at the upper strata of figure layer, described original video stream decoding gained YUV view data is presented at the lower floor of figure layer.
5. method as claimed in claim 4 is characterized in that, described method also comprises:
Receive the user to the descriptor of described original video frame.
6. a video intelligent analytical equipment is characterized in that, described device comprises:
The video flowing acquisition module is used for obtaining original video stream;
Intellectual analysis figure layer information generating unit is used for original video frame is carried out intellectual analysis, generates intellectual analysis figure layer information, and described intellectual analysis figure layer information comprises track and the wire frame that produces when described original video frame carried out intellectual analysis;
The sign dispensing unit is used to described intellectual analysis figure layer information configuration video labeling, and the video labeling of described configuration is consistent with the video labeling of described original video frame, and described video labeling comprises frame head and/or timestamp;
Sending module, be used for sending the intellectual analysis frame to video monitoring platform, described intellectual analysis frame separates storage with the described original video stream that directly transfers to described video monitoring platform at described video monitoring platform with document form, and described intellectual analysis frame comprises the described intellectual analysis figure layer information that has disposed video labeling.
7. device as claimed in claim 6 is characterized in that, described device also comprises:
The descriptor adding device is used to described intellectual analysis figure layer information to add descriptor, and described descriptor comprises recording events and alarm event.
8. a video image exhibiting device is characterized in that, described device comprises:
Parsing module is used for resolving the intellectual analysis frame that obtains and obtains the video labeling that described intellectual analysis frame comprises;
Matching module is used for according to original video stream coupling with the described intellectual analysis frame corresponding original video frame of described video labeling from obtaining;
Display module is used for the information layered demonstration of frame of video that intellectual analysis figure layer information that described intellectual analysis frame is comprised and described original video frame comprise.
9. device as claimed in claim 8 is characterized in that, described display module comprises:
Decoding unit, the intellectual analysis figure layer information decoding that is used for described original video stream and described intellectual analysis frame are comprised is the YUV view data;
Superpositing unit is used for making described intellectual analysis figure layer information decoding gained YUV view data be presented at the upper strata of figure layer described YUV view data stack, and described original video stream decoding gained YUV view data is presented at the lower floor of figure layer.
10. device as claimed in claim 9 is characterized in that, described device also comprises:
Receiver module is used for receiving the user to the descriptor of described original video frame.
11. a video monitoring system is characterized in that described system comprises video intelligent analytical equipment, video monitoring platform and client, described client comprises the video image exhibiting device;
Described video intelligent analytical equipment, be used for obtaining original video stream, be that unit generates the video labeling intellectual analysis frame consistent with the video labeling of described original video frame with the described original video stream of obtaining according to original video frame, send described intellectual analysis frame to described video monitoring platform, described intellectual analysis frame separates storage with the described original video stream that directly transfers to described video monitoring platform at described video monitoring platform with document form, and described video labeling comprises frame head and/or timestamp;
Described video monitoring platform is used for receiving the described original video stream that directly transmits from the video monitoring system headend equipment, and described intellectual analysis frame is separated storage with document form with described original video stream;
Described video image exhibiting device, be used for resolving the intellectual analysis frame that obtains from described video monitoring platform and obtain the video labeling that described intellectual analysis frame comprises, from the original video stream that described video monitoring platform obtains, mate the original video frame corresponding with described intellectual analysis frame according to described video labeling, the information layered demonstration of frame of video that the intellectual analysis figure layer information that described intellectual analysis frame is comprised and described original video frame comprise.
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| PCT/CN2011/074224 WO2011127859A2 (en) | 2011-05-18 | 2011-05-18 | Method for processing video data and method and apparatus for displaying video images |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN102204248A CN102204248A (en) | 2011-09-28 |
| CN102204248B true CN102204248B (en) | 2013-08-14 |
Family
ID=44662827
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201180000541.9A Active CN102204248B (en) | 2011-05-18 | 2011-05-18 | Video data processing method, video image displaying method and device thereof |
Country Status (2)
| Country | Link |
|---|---|
| CN (1) | CN102204248B (en) |
| WO (1) | WO2011127859A2 (en) |
Families Citing this family (10)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN103188474A (en) * | 2011-12-30 | 2013-07-03 | 中兴通讯股份有限公司 | Video intelligent analysis system and storing and playing method of surveillance video thereof |
| CN103685975B (en) * | 2012-09-05 | 2017-08-25 | 中兴通讯股份有限公司 | A kind of audio/video player system and method |
| CN104506756A (en) * | 2014-11-12 | 2015-04-08 | 南京南自信息技术有限公司 | High-definition intelligent video analysis video camera device for use in power industry |
| CN106469039B (en) * | 2016-09-28 | 2019-05-03 | 华为技术有限公司 | Image display method and system |
| CN107104961B (en) * | 2017-04-21 | 2019-12-10 | 中国电子科技集团公司第二十八研究所 | distributed real-time video monitoring processing system based on ZooKeeper |
| CN111064984B (en) * | 2018-10-16 | 2022-02-08 | 杭州海康威视数字技术股份有限公司 | Intelligent information superposition display method and device for video frame and hard disk video recorder |
| CN110881141B (en) * | 2019-11-19 | 2022-10-18 | 浙江大华技术股份有限公司 | Video display method and device, storage medium and electronic device |
| CN111050106B (en) * | 2019-12-23 | 2022-07-15 | 浙江大华技术股份有限公司 | Video playback method, device and computer storage medium |
| CN111506769B (en) * | 2020-04-21 | 2023-08-29 | 浙江大华技术股份有限公司 | Video file processing method and device, storage medium and electronic device |
| CN116016829A (en) * | 2022-12-28 | 2023-04-25 | 杭州海康慧影科技有限公司 | Image display method, device and system |
Citations (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN1761319A (en) * | 2004-10-12 | 2006-04-19 | 国际商业机器公司 | Video analysis, archiving and alerting methods and apparatus for a video surveillance system |
| CN101587483A (en) * | 2009-07-10 | 2009-11-25 | 张丛喆 | Information storage/retrival method of video files based on MPEG-7 in monitoring system |
| CN101742286A (en) * | 2008-11-11 | 2010-06-16 | 北京中星微电子有限公司 | Video coding and decoding methods and video coding and decoding devices |
Family Cites Families (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| JP4855287B2 (en) * | 2007-02-06 | 2012-01-18 | 株式会社日立国際電気 | Video recording device |
-
2011
- 2011-05-18 WO PCT/CN2011/074224 patent/WO2011127859A2/en active Application Filing
- 2011-05-18 CN CN201180000541.9A patent/CN102204248B/en active Active
Patent Citations (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN1761319A (en) * | 2004-10-12 | 2006-04-19 | 国际商业机器公司 | Video analysis, archiving and alerting methods and apparatus for a video surveillance system |
| CN101742286A (en) * | 2008-11-11 | 2010-06-16 | 北京中星微电子有限公司 | Video coding and decoding methods and video coding and decoding devices |
| CN101587483A (en) * | 2009-07-10 | 2009-11-25 | 张丛喆 | Information storage/retrival method of video files based on MPEG-7 in monitoring system |
Also Published As
| Publication number | Publication date |
|---|---|
| WO2011127859A3 (en) | 2012-04-19 |
| CN102204248A (en) | 2011-09-28 |
| WO2011127859A2 (en) | 2011-10-20 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN102204248B (en) | Video data processing method, video image displaying method and device thereof | |
| US10389784B2 (en) | Method and device for generating a description file, and corresponding streaming method | |
| US10171541B2 (en) | Methods, devices, and computer programs for improving coding of media presentation description data | |
| US10698864B2 (en) | Auxiliary manifest file to provide timed metadata | |
| KR100714098B1 (en) | System for electric tag broadcasting and method thereof | |
| US9667908B2 (en) | Image recording system | |
| JP2018524877A (en) | Method, device, and computer program capable of dynamically setting operation base point descriptor for acquiring media data and metadata from encapsulated bitstream | |
| JP2017515336A (en) | Method, device, and computer program for improving streaming of segmented timed media data | |
| JP7487742B2 (en) | Image processing device and method | |
| GB2509953A (en) | Displaying a Region of Interest in a Video Stream by Providing Links Between Encapsulated Video Streams | |
| CN107077543B (en) | Ownership identification, signaling and processing of content components in streaming media | |
| US11356749B2 (en) | Track format for carriage of event messages | |
| US20170105034A1 (en) | Communication apparatus, communication method, and program | |
| KR102110623B1 (en) | Transmission device, information processing method, program, reception device, and application linking system | |
| EP3952275A1 (en) | File generation device, file generation method, file reproduction device, file reproduction method, and program | |
| CN115766348A (en) | Multi-protocol video fusion gateway based on Internet of things | |
| WO2008127989A1 (en) | Method and system for video stream personalization | |
| KR101944601B1 (en) | Method for identifying objects across time periods and corresponding device | |
| Kumar et al. | Cloud‐based video streaming services: Trends, challenges, and opportunities | |
| WO2019138929A1 (en) | Information processing device and method | |
| KR101710452B1 (en) | Method and apparatus for transmitting/receiving service discovery information in a multimedia transmission system | |
| KR101995270B1 (en) | Method and apparatus for playing video data | |
| US10499089B2 (en) | System for providing cloud-based user interfaces and method therefor | |
| TW201939965A (en) | Information processing device and method | |
| US20230043591A1 (en) | Information processing apparatus and method |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| C10 | Entry into substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| C14 | Grant of patent or utility model | ||
| GR01 | Patent grant |