CN102547231A - Intelligent network video monitoring system based on browser and working method thereof - Google Patents

Intelligent network video monitoring system based on browser and working method thereof Download PDF

Info

Publication number
CN102547231A
CN102547231A CN2011103664956A CN201110366495A CN102547231A CN 102547231 A CN102547231 A CN 102547231A CN 2011103664956 A CN2011103664956 A CN 2011103664956A CN 201110366495 A CN201110366495 A CN 201110366495A CN 102547231 A CN102547231 A CN 102547231A
Authority
CN
China
Prior art keywords
unit
plug
browser
subelement
video
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Granted
Application number
CN2011103664956A
Other languages
Chinese (zh)
Other versions
CN102547231B (en
Inventor
吴飏
施志萍
石炎明
张小媛
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Hangzhou Hikvision Digital Technology Co Ltd
Original Assignee
Hangzhou Hikvision Digital Technology Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Hangzhou Hikvision Digital Technology Co Ltd filed Critical Hangzhou Hikvision Digital Technology Co Ltd
Priority to CN201110366495.6A priority Critical patent/CN102547231B/en
Publication of CN102547231A publication Critical patent/CN102547231A/en
Application granted granted Critical
Publication of CN102547231B publication Critical patent/CN102547231B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Landscapes

  • Two-Way Televisions, Distribution Of Moving Picture Or The Like (AREA)

Abstract

The invention relates to the field of security and discloses an intelligent network video monitoring system based on a browser and a working method thereof. In the intelligent network video monitoring system, a plugin form is embedded in a browser bracket through a XEmbed protocol, so that the playback drawing of a monitored video can span different versions and different browsers of a Linux. The interaction between plugins and the browsers and pages is realized through a NPAPI (Netscape Plugin Application Programming Interface) frame and the XEmbed protocol, the difference between different browsers and form manager environments is shielded, and the convenience is brought for the development, porting and maintenance of the plugins. A real-time transport protocol, a real-time streaming transport protocol and a design concept of structure transparence of the browsers and a server are used, so that a foundation is established for the fusion and standardization of a security monitoring industry. An X11 underlying protocol is directly called to realize the visualization of the plugins, and the platform dependency of the playback and interaction of the monitored video and a Linux system is minimized.

Description

Intelligent network video monitor system and method for work thereof based on browser
Technical field
The present invention relates to safety-security area, particularly technological based on the intelligent network video monitoring of browser.
Background technology
Be accompanied by the development of computer network, storage, chip technology; The video monitoring technology is constantly advanced towards intelligent, networked direction; Video monitoring system has got into intelligent network system (Intelligent Video Surveillance is called for short " the IVS ") epoch.Its adopts distribution mode to be erected on the network, does not receive the restriction of ground domain space, realizes the management, transmission, storage, warning, integrated etc. of video resource.Because the continuous enhancing of network access capacity, and thin-client visits advantage easily, and IVS is developed to B/S (Browser/Server) framework by C/S (Client/Server) again gradually.For the user of the video monitoring client terminal of B/S framework,, can realize visit to storage or watch-dog as long as can access network and have authority.This visit is transparent, in addition need not to pay close attention to mutual equipment specifically be digital hard disc video recorder DVR or network video machine NVR, network video server DVS also or web camera IPC.
The user is by browser, through the IP device on the page Control Network; Browser is again by plug-in unit, realizes operations such as video acquisition that the page is difficult to accomplish, broadcast, video recording, drafting.Writing with JavaScript scripts such as (JS) usually alternately of the browser and the page.JS is difficult to carry out the work such as stream, broadcast of getting of simultaneously efficient being had relatively high expectations, and then can reach through the plug-in unit that compiler languages such as C++ generate.The cross-platform characteristic of JS makes it in different operating system, and is consistent to the access mode of the page.But for plug-in unit, because: the platform dependence of (1) compiler, to carry out alternately between (2) need and operating system (OS) and browser, therefore different OS and the difference between browser cause the implementation framework of plug-in unit under varying environment and method to have nothing in common with each other.
Present developing plug technology is based on the browser in the Windows systems such as IE mostly.The characteristics that linux system is open, stable, cost is low, its popularity rises year by year, especially occupies critical role in field of video monitoring.Inventor of the present invention finds, in the prior art, mainly has following problem: the framework of (1) linux system browser plug-in technology and implementation method rarely have to be mentioned; (2) because the opening of Linux, its release is numerous, it is frequent to upgrade, and most basic forms manager (WM) also is divided into GNOME and KDE two big camps, and recent increasing browser manufacturer involves in, and brings difficulty all for the universality of developing plug; (3) the purpose inevitable requirement plug-in unit of video monitoring has visual and interaction capabilities in Linux.
Therefore, in linux system, the system framework and the method for intelligent network video monitoring universal card that can cross over different release versions, different browsers is required in a hurry.
Summary of the invention
The object of the present invention is to provide a kind of intelligent network video monitor system and method for work thereof, make the broadcast of monitor video can cross over different release versions and the different browsers of Linux based on browser.
For solving the problems of the technologies described above, execution mode of the present invention discloses a kind of intelligent network video monitor system based on browser, comprise,
Page interactive unit is used for page script alternately, and information is passed to the browser interactive unit, shields the most of difference between browser simultaneously;
The browser interactive unit is used for browser alternately, through the XEmbed agreement plug-in unit forms is embedded the browser bracket, and information is passed to visualization, shields other difference between browser simultaneously;
Visualization is used to realize the visual and plug-in unit forms event-driven mechanism of plug-in unit, and information is passed to the network flow unit, minimizes the difference between the Linux platform simultaneously;
The network flow unit is used to obtain and the Control Network video code flow, and information is passed to the broadcast drawing unit;
Play drawing unit, be used for the plug-in unit forms that generate in said visualization, the video code flow that said network flow unit is obtained is play and local graphic plotting, and finally realize the function of intelligent network video monitoring with the network flow unit.
Execution mode of the present invention also discloses a kind of method of work of the intelligent network video monitor system based on browser, may further comprise the steps:
Browser is according to the page info loading of plug-in, and requires to be plug-in unit establishment bracket according to page script;
Browser passes to plug-in unit through NPAPI with bracket;
Plug-in unit embeds the browser bracket with Main form pointer to be created, and keeps the relevant information in this bracket structure based on the XEmbed agreement;
All forms according to the bracket structural information, are created, shine upon and adjusted to plug-in unit based on the X11 underlying protocol;
Page script calls the corresponding interface of plug-in unit and realizes different responses according to the user's request that receives through NPAPI;
Plug-in unit is based on RTP and real time streaming transport protocol, and slave unit obtains and the control of video code stream;
Plug-in unit is realized Internet video broadcast and local drawing.
Embodiment of the present invention compared with prior art, the main distinction and effect thereof are:
Through the XEmbed agreement plug-in unit forms are embedded the browser bracket, make the broadcast of monitor video can cross over different release versions and the different browsers of Linux.
Through NPAPI framework and XEmbed agreement realize between plug-in unit and the browser and the page alternately, shielded the difference between different browsers, forms manager environment, for exploitation, transplanting and the maintenance of plug-in unit brought facility;
Use RTP and real time streaming transport protocol, and the design philosophy of browser and server architecture transparence, for the fusion and the standardization of safety monitoring industry are laid a good foundation.
Further, directly call the X11 underlying protocol and realize that plug-in unit is visual, make the broadcast of monitor video, the platform dependence minimum of mutual and linux system.
Description of drawings
Fig. 1 is the structural representation of a kind of intelligent network video monitor system based on browser in the first embodiment of the invention;
Fig. 2 is the plug-in unit five layer model sketch mapes corresponding to a kind of intelligent network video monitor system based on browser in the first embodiment of the invention;
Fig. 3 be corresponding to the card cage of a kind of intelligent network video monitor system based on browser in the first embodiment of the invention and with the corresponding relation sketch map of five layer models;
Fig. 4 is the schematic flow sheet of a kind of method of work of the intelligent network video monitor system based on browser in the second embodiment of the invention;
Fig. 5 is the schematic flow sheet of a kind of method of work of the intelligent network video monitor system based on browser in the third embodiment of the invention.
Embodiment
In following narration, many ins and outs have been proposed in order to make the reader understand the application better.But, persons of ordinary skill in the art may appreciate that even without these ins and outs with based on the many variations and the modification of following each execution mode, also can realize each claim of the application technical scheme required for protection.
For making the object of the invention, technical scheme and advantage clearer, will combine accompanying drawing that execution mode of the present invention is done to describe in detail further below.
First embodiment of the invention relates to a kind of intelligent network video monitor system based on browser.Fig. 1 is this structural representation based on the intelligent network video monitor system of browser.
Specifically, as shown in Figure 1, should mainly comprise based on the intelligent network video monitor system of browser:
Page interactive unit is used for page script alternately, and information is passed to the browser interactive unit, shields the most of difference between browser simultaneously.
Page interactive unit is utilized the mutual of realization of NPAPI agreement and page script.
NPAPI (Netscape Plugin Application Programming Interface) is initially the one group of C Plugin API that is formulated by Netscape company, supports NPRuntime to extend API to support Scriptability.
The browser interactive unit is used for browser alternately, through the XEmbed agreement plug-in unit forms is embedded the bracket that browser imports into, and information is passed to visualization, shields other difference between browser simultaneously.
The XEmbed agreement is meant to a certain application program and resets parent form to be embedded into the agreement based on X mechanism of Another Application program.
Specifically, this browser interactive unit comprises following subelement:
XEmbed transformant unit is used for the plug-in unit forms are embedded the browser bracket, and accomplishes corresponding form types conversion work.
The internal schedule subelement is used for being responsible for the scheduling and the readjustment of inner each module of plug-in unit.
Local configuration subelement is used for the User Defined configuration information is carried out the localization management.
Wherein, the User Defined configuration information comprises: the storing path of connection protocol, code stream type, broadcast window ratio mode, video file packing size, video recording and grabgraf file etc.
Whether the plug-in version control sub unit is used to the page script plug-in version information is provided, need upgrade to plug-in unit and judge.
The abnormality detection subelement, it is inner because the error message that network or memory abnormal cause externally provides the interface that obtains the plug-in unit improper value for page script to be used for internally collecting plug-in unit.
Plug-in unit instance management subelement is used for when browser is opened many Shipping Options Pages, managing the instance of a plurality of plug-in units, guarantees the correct plug-in unit instance of readjustment between each unit.
Visualization is used to realize the visual and plug-in unit forms event-driven mechanism of plug-in unit, and information is passed to the network flow unit, minimizes the difference between the Linux platform simultaneously.
Visualization utilizes the X11 underlying protocol to realize the visual and plug-in unit forms event-driven mechanism of plug-in unit.
Wherein, the X11 agreement is meant in a Unix and a type Unix operating system, and conventional tool bag and the agreement of setting up graphic user interface on the openVMS.
The X11 underlying protocol is as the visual basis of linux system, makes the broadcast of monitor video, the platform dependence minimum of mutual and linux system.
Specifically, this visualization comprises following subelement:
X11 manages subelement, is used to encapsulate the X11 physical layer interface; Realize mapping, the adjustment of plug-in unit inner window through the X11 underlying protocol; Receive the incident that the X service end is transmitted simultaneously, be distributed to correct forms; Called by all forms subelements.
The Main form subelement is used for being responsible for the space layout of all child forms: when initialization or user's gravity treatment preview screen are cut apart pattern, position, size and the disappearing etc. of all child forms are readjusted.In addition, the also responsible part of Main form subelement is mutual with the Linux file system, like choosing of remote upgrade configuration file, operations such as the derivation of device log.
The child form subelement is used for calling the network flow unit downwards, realizes the control such as preview, playback, video recording, grabgraf of play area subelement and to the operations such as parsing of URL (URL).
The play area subelement; Be used for the calculating of the geometric position of play mode such as responsible filling, 4:3,16:9; And the management of mouse event in the man-machine interactive operation such as draw in the zone, screen menu type regulative mode (On-Screen Display is called for short " OSD ") is provided with.
Full frame forms subelement is used to realize getting into or withdrawing from the sequence of operations of played in full screen state.
The network flow unit is used to obtain and the Control Network video code flow, realizes that the network video stream of RTP/RTSP agreement obtains and controls, and information is passed to the broadcast drawing unit.
Wherein, RTP (Real-time Transport Protocol) is meant RTP.
RTSP (Real Time Streaming Protocol) is meant real time streaming transport protocol.
Play drawing unit, be used for the plug-in unit forms that generate in visualization, the video code flow that the network flow unit is obtained is play and local graphic plotting, and finally realize the function of intelligent network video monitoring with the network flow unit.
Specifically, this broadcast drawing unit comprises: play subelement and draw subelement.
Play subelement, be used to realize the broadcast of video code flow,, realize the broadcast of video through open GL (Open Graphics Library is called for short " OpenGL ") or cross-platform multimedia kit (Simple Media Layer is called for short " SDL ").
Draw subelement; Be used for realizing the local graphic plotting of Network Video Surveillance; Realize mobile detection in the video monitoring, block drafting, the demonstration and mobile in play area of warning, privacy masked areas and displaying information on screen; And corresponding information passed to page script, and be sent to equipment.
Through the XEmbed agreement plug-in unit forms are embedded the browser bracket, make the broadcast of monitor video can cross over different release versions and the different browsers of Linux.
General than be easier to expect implementation be to utilize the realization of page script that the plug-in unit forms are directly embedded the browser bracket; But inventor of the present invention finds; Though this mode realizes simple; But in the version of many Linux or different browser, compatibility issue can occur, after repetition test, this problem solves through the XEmbed agreement.
Corresponding to the intelligent network video monitor system described in the embodiment of the present invention based on browser; The corresponding insert development model is divided into five layers; Specifically; As shown in Figure 2, be followed successively by from top to bottom: layer (V) is drawn in page alternation of bed (J), browser alternation of bed (B), visual layer (X), network fluid layer (N) and broadcast.
(1) the J layer is responsible for mutual between plug-in unit and the page script, reaches the general-purpose interface of crossing over different browsers by the NPAPI framework.
(2) the B layer is responsible for mutual between plug-in unit and the browser, through the XEmbed agreement plug-in unit forms is embedded the browser bracket, to realize crossing over different forms manager environment.
(3) the X layer be responsible for the visual of plug-in unit and and the user between mutual, accomplish the event-driven mechanism of the mapping of plug-in unit forms, adjustment, mouse and keyboard response etc. through the X11 underlying protocol.
What (4) the N layer was responsible for Internet video gets stream and Control work, mainly with the realization of RTP and RTSP agreement.
(5) the V layer is responsible for video playback and graphic plotting work, can realize through OpenGL or SDL.
Two-layer down is to video monitoring; Visual layer is to the demonstration of plug-in unit in browser, and the assurance platform dependence is minimum; Going up two-layer is to be provided with for browser-cross.
The general frame of said plug-in unit, module invokes relation and and five layer models between corresponding relation as shown in Figure 3.
Generally, can be divided into that the page is mutual, plug-in unit control, forms management, network flow control, play and draw five major parts.
Page interactive portion is realized by PD-010 page interactive module.
PD-010 page interactive module is called by JS through producing the scripting object, also can initiatively send incident to JS, externally as plug-in unit and the mutual interface of the page, internally calls and parameter for plug-in management module parses JS.
The plug-in unit control section comprises PD-020 plug-in unit control module and submodule thereof.
PD-020 plug-in unit control module embeds the browser bracket with plug-in unit; Be responsible for the scheduling of inner each module of plug-in unit simultaneously: as send the work such as readjustment of order, response to network flow control module to the response of JS call request, to Main form or full frame forms; Also realize some auxiliary functions of plug-in unit in addition: like local parameter configuration, plug-in version control, abnormality detection, and work such as plug-in unit instance management during many labels.
PD-020 is according to function, and inside can be divided into PD-021 XEmbed conversion, PD-022 internal schedule, the local configuration of PD-023, the control of PD-024 plug-in version, PD-025 abnormality detection, PD-026 plug-in unit instance management 6 sub-module again.
PD-021 XEmbed transformant module is responsible for the plug-in unit forms are embedded the browser bracket, and corresponding form types conversion work.
PD-022 internal schedule submodule, the scheduling and the readjustment of inner each module of responsible plug-in unit.
The local configuration of PD-023 submodule carries out localization to the User Defined configuration informations such as storing path of connection protocol, code stream type, broadcast window ratio mode, video file packing size, video recording and grabgraf file and manages.
Whether PD-024 plug-in version control submodule for JS provides plug-in version information, need upgrade to plug-in unit and to judge.
PD-025 abnormality detection submodule, it is inner because the error message that network or memory abnormal cause externally provides the interface that obtains the plug-in unit improper value for JS internally to collect plug-in unit.
PD-026 plug-in unit instance management submodule when browser is opened many Shipping Options Pages, is managed the instance of a plurality of plug-in units, guarantees the correct plug-in unit instance of readjustment between each module.
The forms administrative section is made up of PD-030 X11 management, PD-040 Main form, PD-050 child form, PD-060 play area, 6 modules of the full frame forms of PD-070.
PD-030 X11 administration module, encapsulation X11 physical layer interface; Realize mapping, the adjustment of plug-in unit inner window through the X11 underlying protocol; Receive the incident that the X service end is transmitted simultaneously, be distributed to correct forms; Called by all form modules.
PD-040 Main form module is responsible for the space layout of all child forms: when initialization or user's gravity treatment preview screen are cut apart pattern, position, size and the disappearing etc. of all child forms are readjusted.In addition, the also responsible part of Main form module is mutual with the Linux file system, like importing and exporting of remote upgrade configuration file, operations such as the derivation of device log.
PD-050 child form module is called the network flow control module downwards, realizes the control such as preview, playback, video recording, grabgraf of each play area and to the operations such as parsing of URL.
PD-060 play area module is responsible for the calculating of the geometric position of play mode such as filling, 4:3,16:9, and the processing of mouse event in the man-machine interactive operation such as draw in the zone, OSD is provided with.
The full frame form module of PD-070 realizes getting into or withdrawing from the sequence of operations of played in full screen state.
PD-080 network flow control module realizes that the network video stream of RTP/RTSP agreement obtains and controls.
Play to draw partly and form by PD-090 drafting module and PD-100 playing module.
The PD-090 drafting module; With interactive means,, realize mobile detection in the video monitoring, block zone and setting and the draftings of osd information in play area such as warning, privacy covering through OpenGL or Xlib; And corresponding information transferred to JS, and then be sent to equipment.
PD-100 playing module, nationality are realized the broadcast of video by OpenGL or SDL.
Need to prove; Each unit of mentioning in each system implementation mode of the present invention all is a logical block, and physically, a logical block can be a physical location; It also can be the part of a physical location; Can also realize that the physics realization mode of these logical blocks itself is not most important with the combination of a plurality of physical locations, the combination of the function that these logical blocks realized is the key that just solves technical problem proposed by the invention.In addition; For outstanding innovation part of the present invention; Above-mentioned each the system implementation mode of the present invention will not introduced with solving the not too close unit of technical problem relation proposed by the invention, and this does not show that there is not other unit in above-mentioned each system implementation mode.
Second embodiment of the invention relates to a kind of method of work of the intelligent network video monitor system based on browser.Fig. 4 is this schematic flow sheet based on the method for work of the intelligent network video monitor system of browser.
Specifically, this method of work based on the intelligent network video monitor system of browser mainly may further comprise the steps:
In step 401, the browser loading of plug-in is also created bracket.
Browser is according to the page info loading of plug-in, and requires to be plug-in unit establishment bracket according to page script.
After this get into step 402, browser passes to plug-in unit through NPAPI with bracket.
After this get into step 403, plug-in unit embeds bracket with XEmbed.
Plug-in unit embeds the browser bracket with Main form to be created, and keeps the relevant information in this bracket structure based on the XEmbed agreement.
After this get into step 404, plug-in unit is with X11 mapping adjustment forms.
All forms according to the bracket structural information, are created, shine upon and adjusted to plug-in unit based on the X11 underlying protocol.
After this get into step 405, page script calls plug-in unit through NPAPI.
Page script calls the corresponding interface of plug-in unit and realizes different responses according to the user's request that receives through NPAPI.
After this get into step 406, plug-in unit is got current control based on RTP/RTSP.
Plug-in unit is based on RTP and real time streaming transport protocol, and slave unit obtains and the control of video code stream.
After this get into step 407, video playback is drawn with local.Plug-in unit is realized video playback and local drawing.
After this process ends.
Through NPAPI framework and XEmbed agreement realize between plug-in unit and the browser and the page alternately, shielded the difference between different browsers and forms manager environment, for exploitation, transplanting and the maintenance of plug-in unit brought facility.
Use RTP and real time streaming transport protocol, and the design philosophy of browser and server architecture transparence, for the fusion and the standardization of safety monitoring industry are laid a good foundation.
This execution mode is and the corresponding method execution mode of first execution mode, this execution mode can with the enforcement of working in coordination of first execution mode.The correlation technique details of mentioning in first execution mode is still effective in this execution mode, in order to reduce repetition, repeats no more here.Correspondingly, the correlation technique details of mentioning in this execution mode also can be applicable in first execution mode.
Third embodiment of the invention relates to a kind of method of work of the intelligent network video monitor system based on browser.Fig. 5 is this schematic flow sheet based on the method for work of the intelligent network video monitor system of browser.
The 3rd execution mode improves on the basis of second execution mode, and main improvements are:
After plug-in unit is realized the step of video playback and local drawing, further comprising the steps of:
Plug-in unit is to page script active initiated event, the further processing of requests for page script.
, before the further processed steps of requests for page script, further comprising the steps of at plug-in unit to page script active initiated event:
The plug-in unit operation document system is accomplished file read-write, disk partition parameter retrieval work.
, call the corresponding interface of plug-in unit and realize comprising following substep in the step of different responses according to the user's request that receives at page script:
If user's request is request preview, playback, time-out, forwarding and slowing, single frames, drawing area or screen menu type regulative mode information operating, then gets into the plug-in unit slave unit and obtain the step with the control of video code stream.
Import and export equipment or local configuration, device log, download video recording, remote upgrade operation if user's request is request, then get into the plug-in unit operation document system, accomplish the step of file read-write, disk partition parameter retrieval work.
If user's request is request video recording, grabgraf operation, then need get into the plug-in unit slave unit simultaneously and obtain step and plug-in unit operation document system with the control of video code stream, accomplish the step of file read-write, disk partition parameter retrieval work, work in coordination with and finish the work.
If user's request is that request is reset the broadcast window pattern, obtained plug-in version, the improper value operation, then can calls the corresponding subelement in the browser interactive unit and the result directly returned.
Specifically, as shown in Figure 5, this method of work based on the intelligent network video monitor system of browser mainly may further comprise the steps:
In step 501, the user imports IP and authentication information.
The user imports remote equipment IP in browser, downloading page file in the slave unit, input authentication information in page login interface, logging device.This equipment can be digital hard disc video recorder DVR or network video machine NVR, also can be web camera IPC.
After this get into step 502, the browser loading of plug-in is also created bracket.
Browser is according to page info and mime type loading of plug-in, and requires to be plug-in unit establishment bracket according to JS.
After this get into step 503, browser passes to plug-in unit through NPAPI with bracket.
Browser is encapsulated as ad hoc structure according to NPAPI with bracket, passes to plug-in unit.
After this get into step 504, plug-in unit embeds bracket with XEmbed.
Plug-in unit embeds bracket with the Main form of creating, and keeps the relevant information in this bracket structure based on the XEmbed agreement.
After this get into step 505, plug-in unit is with X11 mapping adjustment forms.
All forms according to the bracket structural information, are created, shine upon and adjusted to plug-in unit based on the X11 underlying protocol, and the X11 incident Mask with each forms registration passes to the X service end simultaneously.
So far, browser loading of plug-in and plug-in unit initial work are accomplished.
After this get into step 506, page script calls plug-in unit through NPAPI.
After this get into step 507, the judges request type;
JS calls the corresponding interface of plug-in unit and realizes different responses according to the user's request that receives through NPAPI:
If operations such as request preview, playback, time-out, forwarding and slowing, single frames, drawing area or osd information then get into step 508;
If request imports and exports operations such as equipment or local configuration, device log, download video recording, remote upgrade, then get into step 511;
If operations such as request video recording, grabgraf then need get into step 508 and 510 collaborative finishing the work simultaneously;
If operations such as request is reset the broadcast window pattern, obtained plug-in version, improper values, then can call the corresponding subelement in the browser interactive unit and the result directly returned.
In step 508, plug-in unit is got current control based on the RTP/RTSP agreement.
Plug-in unit is based on RTP and RTSP agreement, and slave unit obtains and the control of video code stream.
After this get into step 509, video playback is drawn with local.
Plug-in unit is realized video playback through OpenGL or SDL.
Plug-in unit is realized local draw operation through OpenGL or Xlib with man-machine interaction mode based on the X11 event-driven mechanism, simultaneously drawing result is passed to the X service end with the X11 agreement, and is mapped to forms, gets back to step 505 once more.
After this get into step 510, plug-in unit sends incident through NPAPI to page script.
Again click in the preview window or the video process situation such as disk partition remaining space deficiency for user in the playing process when taking place, plug-in unit also can be through NPAPI to JS initiated event initiatively, the further processing of request JS.
After this process ends.
In step 511, operation document system.
Plug-in unit operation Linux file system is accomplished work such as file read-write, the retrieval of disk partition parameter.
After this get into step 510.
This execution mode is and the corresponding method execution mode of first execution mode, this execution mode can with the enforcement of working in coordination of first execution mode.The correlation technique details of mentioning in first execution mode is still effective in this execution mode, in order to reduce repetition, repeats no more here.Correspondingly, the correlation technique details of mentioning in this execution mode also can be applicable in first execution mode.
Each method execution mode of the present invention all can be realized with modes such as software, hardware, firmwares.No matter the present invention be with software, hardware, or the firmware mode realize; Instruction code can be stored in the memory of computer-accessible of any kind (for example permanent or revisable; Volatibility or non-volatile; Solid-state or non-solid-state, fixing perhaps removable medium or the like).Equally; Memory can for example be programmable logic array (Programmable Array Logic; Abbreviation " PAL "), random access memory (Random Access Memory; Abbreviation " RAM "), programmable read only memory (Programmable Read Only Memory is called for short " PROM "), read-only memory (Read-Only Memory is called for short " ROM "), Electrically Erasable Read Only Memory (Electrically Erasable Programmable ROM; Abbreviation " EEPROM "), disk, CD, digital versatile disc (Digital Versatile Disc is called for short " DVD ") or the like.
Though through reference some preferred implementation of the present invention; The present invention is illustrated and describes; But those of ordinary skill in the art should be understood that and can do various changes to it in form with on the details, and without departing from the spirit and scope of the present invention.

Claims (10)

1. the intelligent network video monitor system based on browser is characterized in that, comprise,
Page interactive unit is used for page script alternately, and information is passed to the browser interactive unit, shields the most of difference between browser simultaneously;
The browser interactive unit is used for browser alternately, through the XEmbed agreement plug-in unit forms is embedded the browser bracket, and information is passed to visualization, shields other difference between browser simultaneously;
Visualization is used to realize the visual and plug-in unit forms event-driven mechanism of plug-in unit, and information is passed to the network flow unit, minimizes the difference between the Linux platform simultaneously;
The network flow unit is used to obtain and the Control Network video code flow, and information is passed to the broadcast drawing unit;
Play drawing unit, be used for the plug-in unit forms that generate in said visualization, the video code flow that said network flow unit is obtained is play and local graphic plotting, and finally realize the function of intelligent network video monitoring with the network flow unit.
2. the intelligent network video monitor system based on browser according to claim 1 is characterized in that, said page interactive unit is utilized the mutual of realization of NPAPI agreement and page script;
Said visualization utilizes the X11 underlying protocol to realize the visual and plug-in unit forms event-driven mechanism of plug-in unit.
3. the intelligent network video monitor system based on browser according to claim 1 is characterized in that, said broadcast drawing unit comprises: play subelement and draw subelement;
Said broadcast subelement is used to realize the broadcast of video code flow;
Said drafting subelement; Be used for realizing the local graphic plotting of Network Video Surveillance; Realize mobile detection in the video monitoring, block drafting, the demonstration and mobile in play area of warning, privacy masked areas and displaying information on screen; And corresponding information passed to page script, give the digital hard disc video recorder or the web camera of far-end again by scripts pass.
4. the intelligent network video monitor system based on browser according to claim 1 is characterized in that, said browser interactive unit comprises following subelement:
XEmbed transformant unit is used for the plug-in unit forms are embedded the browser bracket, and accomplishes corresponding form types conversion work;
The internal schedule subelement is used for being responsible for the scheduling and the readjustment of inner each module of plug-in unit;
Local configuration subelement is used for the User Defined configuration information is carried out the localization management;
Whether the plug-in version control sub unit is used to the page script plug-in version information is provided, need upgrade to plug-in unit and judge;
The abnormality detection subelement, it is inner because the error message that network or memory abnormal cause externally provides the interface that obtains the plug-in unit improper value for page script to be used for internally collecting plug-in unit;
Plug-in unit instance management subelement is used for when browser is opened many Shipping Options Pages, managing the instance of a plurality of plug-in units, guarantees the correct plug-in unit instance of readjustment between each unit.
5. the intelligent network video monitor system based on browser according to claim 4 is characterized in that, in said local configuration subelement, the User Defined configuration information comprises:
The storing path of connection protocol, code stream type, broadcast window ratio mode, video file packing size, video recording and grabgraf file.
6. the intelligent network video monitor system based on browser according to claim 1 is characterized in that, said visualization comprises following subelement:
X11 manages subelement, is used to encapsulate the X11 physical layer interface; Realize mapping, the adjustment of plug-in unit inner window through the X11 underlying protocol;
The Main form subelement is used for being responsible for the space layout of all child forms; Responsible simultaneously part is mutual with the Linux file system;
The child form subelement is used for calling the network flow unit downwards, realizes to the control of play area subelement with to the parsing of URL;
The play area subelement is used for be responsible for filling and the calculating of the geometric position of different play mode, and the processing of mouse event in the man-machine interactive operation;
Full frame forms subelement is used to realize getting into or withdrawing from the sequence of operations of played in full screen state.
7. the method for work based on the intelligent network video monitor system of browser is characterized in that, may further comprise the steps:
Browser is according to the page info loading of plug-in, and requires to be plug-in unit establishment bracket according to page script;
Browser passes to plug-in unit through the NPAPI agreement with bracket;
Plug-in unit embeds the browser bracket with Main form to be created, and keeps the relevant information in this bracket structure based on the XEmbed agreement;
All forms according to the bracket structural information, are created, shine upon and adjusted to plug-in unit based on the X11 underlying protocol;
Page script calls the corresponding interface of plug-in unit and realizes different responses according to the user's request that receives through NPAPI;
Plug-in unit is based on RTP and real time streaming transport protocol, and slave unit obtains and the control of video code stream;
Plug-in unit is realized Internet video broadcast and local drawing.
8. the method for work of the intelligent network video monitor system based on browser according to claim 7 is characterized in that, and is after said plug-in unit is realized the step of video playback and drawing, further comprising the steps of:
Plug-in unit is to page script active initiated event, the further processing of requests for page script.
9. the method for work of the intelligent network video monitor system based on browser according to claim 8 is characterized in that, and is to page script initiated event initiatively, before the further processed steps of requests for page script, further comprising the steps of at said plug-in unit:
The plug-in unit operation document system is accomplished file read-write, disk partition parameter retrieval work.
10. the method for work of the intelligent network video monitor system based on browser according to claim 7; It is characterized in that;, call the corresponding interface of plug-in unit and realize comprising following substep in the step of different responses according to the user's request that receives at said page script:
If user's request is request preview, playback, time-out, forwarding and slowing, single frames, drawing area or screen menu type regulative mode information operating, then gets into said plug-in unit slave unit and obtain the step with the control of video code stream;
Import and export equipment or local configuration, device log, download video recording, remote upgrade operation if user's request is request, then get into said plug-in unit operation document system, accomplish the step of file read-write, disk partition parameter retrieval work;
If user's request is request video recording, grabgraf operation; Then need get into said plug-in unit slave unit simultaneously and obtain step and said plug-in unit operation document system with the control of video code stream; Accomplish the step of file read-write, disk partition parameter retrieval work, collaborative finishing the work;
If user's request is that request is reset the broadcast window pattern, obtained plug-in version, the improper value operation, then can calls the corresponding subelement in the browser interactive unit and the result directly returned.
CN201110366495.6A 2011-11-17 2011-11-17 Intelligent network video monitoring system based on browser and working method thereof Active CN102547231B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201110366495.6A CN102547231B (en) 2011-11-17 2011-11-17 Intelligent network video monitoring system based on browser and working method thereof

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201110366495.6A CN102547231B (en) 2011-11-17 2011-11-17 Intelligent network video monitoring system based on browser and working method thereof

Publications (2)

Publication Number Publication Date
CN102547231A true CN102547231A (en) 2012-07-04
CN102547231B CN102547231B (en) 2014-04-09

Family

ID=46353042

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201110366495.6A Active CN102547231B (en) 2011-11-17 2011-11-17 Intelligent network video monitoring system based on browser and working method thereof

Country Status (1)

Country Link
CN (1) CN102547231B (en)

Cited By (14)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN102970330A (en) * 2012-10-25 2013-03-13 浙江宇视科技有限公司 Browser interaction achievement method and device
CN103078902A (en) * 2012-12-21 2013-05-01 安科智慧城市技术(中国)有限公司 Data transmission method and device of embedded monitoring equipment
CN103327417A (en) * 2013-07-11 2013-09-25 亿览在线网络技术(北京)有限公司 Method and device for directly broadcasting real-time long-distance audio and video frequency
CN103985229A (en) * 2013-02-12 2014-08-13 霍尼韦尔国际公司 System and method of alarm and history video playback
CN104202566A (en) * 2014-08-27 2014-12-10 上海熙菱信息技术有限公司 Intelligent security and protection video integrating system and method
CN106681764A (en) * 2016-12-23 2017-05-17 昆明联诚科技股份有限公司 Windowless webpage player plug-in device
CN107677301A (en) * 2017-10-10 2018-02-09 四川国信慧通电气技术有限公司 Monitoring device detection method and device
CN108111904A (en) * 2016-11-24 2018-06-01 厦门脉视数字技术有限公司 A kind of audio/video player system and method based on Web
CN108665297A (en) * 2017-03-31 2018-10-16 北京京东尚科信息技术有限公司 Detection method, device, electronic equipment and the storage medium of abnormal access behavior
CN109582308A (en) * 2018-11-05 2019-04-05 中国资源卫星应用中心 A kind of interactive map component based on XEmbed is dynamically embedded into method and system
CN110769193A (en) * 2018-07-26 2020-02-07 视联动力信息技术股份有限公司 Monitoring playing method and device
CN110769192A (en) * 2018-07-26 2020-02-07 视联动力信息技术股份有限公司 Monitoring recording method and device
CN111757054A (en) * 2020-06-05 2020-10-09 国网江苏省电力有限公司南京供电分公司 Video monitoring management calling method
CN112631476A (en) * 2020-12-29 2021-04-09 杭州晨安科技股份有限公司 SDL library-based camera function menu display method

Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101094392A (en) * 2007-06-26 2007-12-26 南京联创网络科技有限公司 Method for video monitoring system to implement Topo map of network devices on web
US20080303902A1 (en) * 2007-06-09 2008-12-11 Sensomatic Electronics Corporation System and method for integrating video analytics and data analytics/mining
CN101790085A (en) * 2010-03-26 2010-07-28 南京邮电大学 Implementation method of family video monitoring system based on DaVinci technology
CN102118605A (en) * 2009-12-31 2011-07-06 上海威乾视频技术有限公司 Network video monitoring system and method

Patent Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20080303902A1 (en) * 2007-06-09 2008-12-11 Sensomatic Electronics Corporation System and method for integrating video analytics and data analytics/mining
CN101094392A (en) * 2007-06-26 2007-12-26 南京联创网络科技有限公司 Method for video monitoring system to implement Topo map of network devices on web
CN102118605A (en) * 2009-12-31 2011-07-06 上海威乾视频技术有限公司 Network video monitoring system and method
CN101790085A (en) * 2010-03-26 2010-07-28 南京邮电大学 Implementation method of family video monitoring system based on DaVinci technology

Cited By (19)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN102970330A (en) * 2012-10-25 2013-03-13 浙江宇视科技有限公司 Browser interaction achievement method and device
CN102970330B (en) * 2012-10-25 2016-07-13 浙江宇视科技有限公司 Mutual between a kind of browser realize method and apparatus
CN103078902A (en) * 2012-12-21 2013-05-01 安科智慧城市技术(中国)有限公司 Data transmission method and device of embedded monitoring equipment
CN103985229A (en) * 2013-02-12 2014-08-13 霍尼韦尔国际公司 System and method of alarm and history video playback
CN103327417A (en) * 2013-07-11 2013-09-25 亿览在线网络技术(北京)有限公司 Method and device for directly broadcasting real-time long-distance audio and video frequency
CN104202566A (en) * 2014-08-27 2014-12-10 上海熙菱信息技术有限公司 Intelligent security and protection video integrating system and method
CN108111904A (en) * 2016-11-24 2018-06-01 厦门脉视数字技术有限公司 A kind of audio/video player system and method based on Web
CN106681764A (en) * 2016-12-23 2017-05-17 昆明联诚科技股份有限公司 Windowless webpage player plug-in device
CN108665297A (en) * 2017-03-31 2018-10-16 北京京东尚科信息技术有限公司 Detection method, device, electronic equipment and the storage medium of abnormal access behavior
CN108665297B (en) * 2017-03-31 2021-01-26 北京京东尚科信息技术有限公司 Method and device for detecting abnormal access behavior, electronic equipment and storage medium
CN107677301A (en) * 2017-10-10 2018-02-09 四川国信慧通电气技术有限公司 Monitoring device detection method and device
CN110769193A (en) * 2018-07-26 2020-02-07 视联动力信息技术股份有限公司 Monitoring playing method and device
CN110769192A (en) * 2018-07-26 2020-02-07 视联动力信息技术股份有限公司 Monitoring recording method and device
CN110769193B (en) * 2018-07-26 2021-10-08 视联动力信息技术股份有限公司 Monitoring playing method and device
CN110769192B (en) * 2018-07-26 2021-11-19 视联动力信息技术股份有限公司 Monitoring recording method and device
CN109582308A (en) * 2018-11-05 2019-04-05 中国资源卫星应用中心 A kind of interactive map component based on XEmbed is dynamically embedded into method and system
CN109582308B (en) * 2018-11-05 2021-12-28 中国资源卫星应用中心 Interactive map component dynamic embedding method and system based on XEmbed
CN111757054A (en) * 2020-06-05 2020-10-09 国网江苏省电力有限公司南京供电分公司 Video monitoring management calling method
CN112631476A (en) * 2020-12-29 2021-04-09 杭州晨安科技股份有限公司 SDL library-based camera function menu display method

Also Published As

Publication number Publication date
CN102547231B (en) 2014-04-09

Similar Documents

Publication Publication Date Title
CN102547231B (en) Intelligent network video monitoring system based on browser and working method thereof
US11410531B2 (en) Automation system user interface with three-dimensional display
US10635433B2 (en) Cross application behavior customization
CN102282565B (en) The browser with double script engine for secret protection
CN101778264B (en) Video monitoring method and video monitoring system
EP2854348B1 (en) Interface display method and system of home gateway applicable to multiple display types
CN102855142B (en) A kind of client framework structure based on RIA and its implementation
CN103838558B (en) Website build a station system and method, access website method and webpage adaptation system
CN103064662A (en) Phone Gap cross-platform media expansion frame based on Android platform
WO2020143584A1 (en) Human-machine interface generation method, apparatus, storage medium and computer device
CN101365082A (en) Set-top box on screen display system implementing method based on peer-to-peer computing technique
US8959426B1 (en) Loading customer-supplied network page generation code
CN110213105A (en) It is a kind of cross-platform micro- using creation method
KR101480214B1 (en) Method and system for web screen streaming based on dom mutation event
CN104053035A (en) System and method for use in enhancing the display of multimedia content
US20140215307A1 (en) Generating web pages with integrated content
US10162979B2 (en) Discovering availability of digital media from multiple sources
CN106354489B (en) A kind of EPG engine and page parsing method
CN112487322B (en) Third party application Loading page loading method and display device
CN105260194B (en) A kind of chemical industrial park comprehensive monitoring system fast construction platform
KR101620564B1 (en) Method for Providing Supervisory Control Service Computer-Readable Recording Medium with Program therefore
Doulgeraki et al. Web-Based Management for Internet of Things Ecosystems
CN113568765B (en) Development method and system of client
KR101492687B1 (en) Method for providing n-screen service using virtual aggregation gateway
CN114710708B (en) Method and system for Web playing monitoring video for hosting C/S host program

Legal Events

Date Code Title Description
C06 Publication
PB01 Publication
C10 Entry into substantive examination
SE01 Entry into force of request for substantive examination
C14 Grant of patent or utility model
GR01 Patent grant