CN102055959B - Central monitoring system based on a plurality of monitoring cameras and central monitoring method - Google Patents
Central monitoring system based on a plurality of monitoring cameras and central monitoring method Download PDFInfo
- Publication number
- CN102055959B CN102055959B CN201010524898.4A CN201010524898A CN102055959B CN 102055959 B CN102055959 B CN 102055959B CN 201010524898 A CN201010524898 A CN 201010524898A CN 102055959 B CN102055959 B CN 102055959B
- Authority
- CN
- China
- Prior art keywords
- image
- camera
- supervision camera
- abnormality degree
- supervision
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
Landscapes
- Closed-Circuit Television Systems (AREA)
- Alarm Systems (AREA)
Abstract
The invention provides a central monitoring system based on a plurality of monitoring cameras and a central monitoring method. The central monitoring system conducts a central monitoring on the image from a plurality of monitoring cameras, which can reduce the monitoring burden on supervisors and reduce the occurring of missing abnormal events. Image processing is conducted based on respective image data of the plurality of monitoring cameras. Motion abnormity of a people can be calculated based on each camera, and display frame rate can be adjusted based on the abnormality. In this case, images from the monitoring cameras with large abnormity can be preferably seen; the monitoring burden on supervisors can be reduced; early discovery on abnormal events can be quickly realized and abnormal events can be quickly dealt with. The monitoring efficiency is improved through emphasizing and displaying the image of the monitoring camera adjacent to one monitoring camera where abnormality occurs or splicing among images.
Description
Technical field
The present invention relates to central monitoring system and the centralized watch method of being carried out wide area supervision by multiple supervision camera.
Background technology
When multiple supervision camera image being managed concentratedly in the caretaker room at center, multiple supervision camera image is arranged in a picture and monitors.Now, monitor multiple supervision camera image is very boring operation simultaneously for surveillant, when monitoring 25 supervision camera images at the same time, is just difficult to focus one's attention on after 20 minutes.And when monitoring the monitor area scene that background changes all the time as the passage of escalator, movement, multiple picture is all the time in change, and surveillant only watches these and just feels tired.When there occurs accident in such a case in multiple image, the possibility of this state of affairs of over sight (OS) uprises.
In the past, in order to the abnormal situation preventing over sight (OS) such, such as, as conventional art, when there occurs abnormal in supervision camera image, by changing size, the displaying time of display, and make easily visually to observe extremely to occur.
[patent documentation 1] Japanese Unexamined Patent Publication 10-187230 publication
[patent documentation 2] Japanese Laid-Open Patent Publication 62-86990 publication
Summary of the invention
(inventing the problem that will solve)
Proposed in the past and in the central monitoring system based on multiple supervision camera, abnormal situation to be detected and to be highlighted or to eject the function of display.Under the state that background is static, although visual burden is little, in the scene of the background dynamics changes such as the passage of escalator step, movement, the crowd of shopping mall, need the multiple pictures to moving all the time to monitor, visual burden becomes large.
In addition, the abnormal situation of the central monitoring system based on multiple supervision camera is being detected and is being highlighted or ejects in the function of display, when there occurs multiple abnormal situation at the same time, if do not know the degree of abnormal situation, then carry out being highlighted of abnormal situation according to order of occurrence, the danger of the discovery delay of the great state of affairs that existence occurs below.
In addition, when monitoring that the borderline region between camera there occurs abnormal situation, in multiple supervision camera image, there is abnormal situation continuously or intermittently with time delay.Therefore, when the supervision camera image that there occurs abnormal situation is configured at the position of separation on centralized watch picture, the mobile of viewpoint increases, and the vision burden of surveillant increases.
The object of the present invention is to provide a kind of central monitoring system, the image showing multiple supervision camera carries out centralized watch, can reduce the burden of observer, and reduces the possibility of the generation of over sight (OS) exception.
(scheme of dealing with problems)
One aspect of the present invention is, show the image of multiple supervision camera while carry out the surveillance of centralized watch, it is characterized in that, calculated the abnormality degree of the figure action in the image of multiple supervision camera by image procossing for each camera, this abnormality degree is higher, makes the display frame rate of the image from this supervision camera higher.
Specifically, carry out figure action parsing according to each supervision camera image, it is abnormal or normal for calculating figure action quantitatively, changes the display/playback speed monitoring camera image according to its abnormality degree.
Preferably, if according to the analysis result of this supervision camera image, abnormality degree is lower, then reduce display frame rate, such as, show selection image, if do not have personage in background, then stops display/reset.On the contrary, when being judged as abnormal due to figure action, according to usual speed (when resetting slow-motion image) display, to monitoring abnormal state, and carry out suitable disposal.
In addition, of the present invention preferred embodiment in, when there occurs abnormal situation in multiple supervision camera image, change the configuration of the multiple supervision camera images on monitor according to described abnormality degree.Such as by supervision camera image larger for abnormality degree being configured to the region of upper left all the time or being ejected into specific picture position, the sight line reducing surveillant moves, and reduces the burden of monitoring.
In addition, of the present invention other preferred embodiment in, when there is the abnormal situation of a figure action in multiple supervision camera image, these are adjacently monitored that camera images reconfigure the close position on monitoring image.And then, now to make the adjacent mode editor that the visual field of camera connects that monitors, make the image easily observing multiple supervision camera.
(invention effect)
According to a preferred embodiment of the invention, in the surveillance provided, show the image of multiple supervision camera, while carry out centralized watch, the burden of observer can be reduced, and reduce the possibility of the generation of over sight (OS) exception.
As preferred application examples of the present invention, in abnormal situation monitoring such as in escalator, the displays of the action of step during by making normal, the flowing of people etc. stop and being set to rest image display etc., frame per second is decreased to the limit, thus reduce the monitoring burden of surveillant.If exception detected, then make picture action, so for surveillant, as triggering, can immediately cognitive abnormal situation generation and which monitor camera image on there occurs exception.Therefore, significantly can reduce the probability of over sight (OS) abnormal situation, the reply of abnormal situation can be carried out rapidly.That is, can be changed according to the abnormality degree of the cognition through image procossing by display frame rate when making in-service monitoring, the burden of surveillant can be reduced.
In addition, by the abnormality degree according to figure action, change the configuration of the multiple supervision camera images on monitoring image, the sight line that can reduce surveillant moves, and reduces the burden of monitoring further.Thus, capable of being monitored supervision camera number of units can be increased once, improve and monitor that efficiency improves.
The personage's abnormality degree once calculated can also be used as the metadata of image retrieval.That is, by the scene F.F. that makes abnormality degree lower and the scene making abnormality degree higher slowly reset, abnormal situation can be resolved in detail.Thus, semi-automatically can select the scene needing to resolve in detail, such as, significantly can reduce the burden of taking out from a large amount of image data and searching the operation supporting relevant scene to crime.In this case, assuming that resolved by the visual confirmation of people, even if there is mistake in abnormality degree calculates, although be that abnormal situation abnormality degree is when becoming lower, by being confirmed by people, the over sight (OS) that the mistake in computation due to abnormality degree causes also can be reduced.That is, when off-line monitors, by making display speed can change according to remarkable action degree, the efficiency that off-line monitors can be improved.
Accompanying drawing explanation
Fig. 1 is the overall structure figure possessing the escalator central monitoring system of the baffle of band supervision camera as preferred embodiment of the present invention.
Fig. 2 possesses the structure chart that band monitors the escalator image monitoring arrangement of the baffle of camera.
Fig. 3 is the display frame illustration multiple supervision camera images of embodiments of the invention being carried out on a picture centralized monitor.
Fig. 4 is the control treatment flow chart for carrying out showing change to multiple supervision camera image according to the abnormality degree of figure action of embodiments of the invention.
Fig. 5 is adjusting frame per second according to the abnormality degree of figure action and showing the action specification figure of multiple supervision camera image of embodiments of the invention
Fig. 6 is one of figure multiple supervision camera image being carried out to the distortion shown when changing according to the abnormality degree of figure action that embodiments of the invention are described.
Fig. 7 illustrates that the abnormality degree according to figure action of embodiments of the invention carries out the figure bis-of the distortion shown when changing to multiple supervision camera image.
Fig. 8 illustrates being connected and one of function of display figure by multiple supervision camera image when there is abnormal situation of embodiments of the invention.
Fig. 9 illustrates being connected by multiple supervision camera image and the figure of the function two of display when there is abnormal situation of embodiments of the invention.
(symbol description)
101: band monitors the movable protection plate of camera; 102: the handrail of escalator; 103: band monitors the movable protection plate of camera; 104: band monitors the movable protection plate of camera; 105: analog coaxial cable or Ethernet cable; 106: centralized watch center; 107: hdd recorder; 108: image processing apparatus; 109: display monitor; 110: adjustment PC; 111: contact exports; 112: emergency warning lamp or loud speaker; 201: the step of escalator; 202: the handrail of escalator; 203: monitor camera; 204: loud speaker; 206: collision prevents baffle; 207: pattern recognition device portion; 208: image recording apparatus portion; 209: passenger; 210: ceiling; 301: monitoring image; 302,303: display modal alteration GUI; 304: monitor camera image; 601: eject and monitor camera image; 602: the supervision camera image that improve playback speed; 603: the supervision camera image reducing playback speed; 604: the supervision camera image that improve frame per second; 605: the supervision camera image reducing frame per second; 606: overlappingly the picture that broken line graph shows has been carried out to the time-shift of abnormality degree with camera images; 701,702,801: high abnormality degree monitors the high-brightness image of camera; 703,802: monitor the high-brightness image of the supervision camera that camera adjoins with high abnormality degree; 803,901: high abnormality degree monitors camera image; 804: monitor the image of the supervision camera that camera adjoins with high abnormality degree; 805,806: connecting line between image; 902: monitor the image of the reversion of the supervision camera that camera adjoins/be out of shape from high abnormality degree; 903: the ejection display of connection layout picture.
Embodiment
Below, embodiments of the present invention are described.
The figure possessing the central monitoring system monitoring camera that the escalator in office block or department store is installed is used to be described embodiments of the present invention.
Fig. 1 is the overall structure figure possessing the central monitoring system of the embodiments of the invention applied in the escalator of the baffle of band supervision camera installed in the narrow bight of escalator.In FIG, 101 is that band monitors the movable protection plate of camera, and 102 is handrails of escalator.In office block, department store, need to install in each floor to monitor camera (103,104).These monitor that camera is connected to hdd recorder 107 by coaxial cable or Ethernet (registered trade mark) cable 105.That analog camera or digital IP camera change and connect with coaxial cable or connect with Ethernet cable according to used supervision camera.Cable 105 both can be directly connected to hdd recorder 107, also can be connected to register 107 via router.In addition, when monitoring that camera uses digital IP camera, cable 105 can be replaced and use WLAN.Image processing apparatus 108 carries out image procossing to the image recorded by hdd recorder 107, and resolves the action of the personage in image.Such as, if the exception movement detection device based on time and space information using No. 2008-226102nd, Japanese Patent Application to record, then the state of affairs of falling of the personage in the dynamic background scene of step action all the time as escalator can be detected.Now, calculated the abnormality degree of figure action by image processing apparatus 108, the chart of the testing result of abnormal operation and the time variations of abnormality degree is presented in monitor 109.In monitor 109, show multiple supervision camera image simultaneously.Image processing apparatus 108 is made up of PC or embedding machine.The conservative PC that PC110 is parameter for changing image processing apparatus 108 or preserves from the Output rusults of image processing apparatus 108.Testing result from image processing apparatus 108 exports 111 by contact and is sent to the external mechanical such as emergency warning lamp, loud speaker 112, carries out the warning corresponding with the abnormality degree of figure action.Hdd recorder 107 to external mechanical 112 is all arranged in centralized watch center 106, and surveillant monitors the image of multiple supervision camera by a monitor 109.
Fig. 2 is the stereogram focusing on the escalator of the supervision camera constituting portion of the local of the movable protection plate employing band supervision camera that No. 2008-238260th, Japanese Patent Application is recorded.In fig. 2,201 is steps of escalator, and 202 is handrails of escalator.203 is cameras of image monitoring, monitors the state of taking of the passenger on step.204 is loud speakers that broadcast is noted reminding, when passenger be in abnormal take or danger is taken carry out attentions and remind, make the cognitive danger of passenger.205 is mounted apparatus of movable protection plate, and 206 is movable protection plates that the collision of passenger prevents, if having passenger's collision, the structure rocked.207 is pattern recognition devices, process, and detection is extremely taken or danger is taken to the image taken by supervision camera 203.208 is image recording apparatus, records a video for a long time or only records a video to image before and after abnormal situation for triggering signal with the abnormal situation detected by pattern recognition device 207.The triggering signal exported from pattern recognition device 207 is connected with controller of escalator (not shown), and escalator can be made when abnormal situation occurs to stop or slowly stopping.In addition, from pattern recognition device 207 export triggering signal by way of caution signal output to centralized watch center 106 (Fig. 1) via wired or wireless network 105, for improving the supervision efficiency of surveillant.In addition, can possess and to be directly stored in the metadata reservoir in the head region of motion pictures files or dynamic image data as metadata using such abnormality degree or based on the triggering signal of abnormality degree, warning signal.Adding according to different files as metadata by being embedded to like this in image data or to image data, may be used in order to accident checking off-line in the situation of later retrieval image.In addition, 209 is the passengers in abnormal taking, and 210 is ground or the ceilings on upper strata.
Next, use Fig. 3, the display in the lump of multiple supervision camera images of display in display monitor 109 is described.In figure 3,301 is monitor pictures.302,303 is the GUI (GraphicalUser Interface, graphical user interface) had the parameter button that the display form of multiple picture changes.304 is the images from multiple supervision cameras of decentralized configuration partly.
The hdd recorder 107 of Fig. 1 can show multichannel image/record a video simultaneously, and image processing apparatus 108 can carry out image procossing to these multichannel images simultaneously.The result that monitor 109 can show multichannel image and carry out image procossing to them simultaneously and obtain.
Although this figure be for multiple escalator all from same direction, the image of same angle views, so all supervision cameras of configuration are difficult.Therefore, in this embodiment, image processing apparatus 108 possesses correction unit, this correction unit, is looked like in roughly the same position with the image of the multiple supervision cameras making other objects possessing same shape in background monitoring that the image of camera corrects by image procossing, with the image of the supervision camera of roughly the same angle setting.This correction unit realizes by software or image processing circuit.
Fig. 4 is the control treatment flow chart for carrying out showing change to multiple supervision camera image according to the abnormality degree of figure action of embodiments of the invention.Use Fig. 4, the flow process remarkable action degree of the personage exported according to image processing apparatus 108 being changed to the display form of display monitor 109 is described.In step 401, image is inputted to image processing apparatus 108.In step 402, the abnormality degree of riding of passenger is calculated.Calculate the continuous sequence increment size of the time and space information calculating such as recorded according to No. 2008-226102nd, Japanese Patent Application.Continuous sequence increment refers to, evaluate the action in certain region normal/value of abnormalities, represent that the action in region is correlated with when this value is less, the complexity of action is less.Such as, the action of the escalator step of the state of passenger is not had.On the contrary, if the value of sequence increment is comparatively large continuously, then represent that the action in region is complicated, such as, the personage on escalator step falls or up runs, the value of sequence increment becomes large continuously.
Then, in step 403, judge whether the value of abnormality degree is greater than threshold value.If abnormality degree (continuously the value of sequence increment) is less than threshold value, then in step 404, do not change the display form of picture, if change display form in the frame above, then display form is reverted to former state, again turn back to the calculation procedure 402 of abnormality degree.If abnormality degree is greater than threshold value, then in step 405, the picture display form of monitor 109 is changed according to this abnormality degree.
In the variation of the display form of abnormal picture, there is multiple gimmick, use below Fig. 5-9 to be described these gimmicks.
After the display form changing abnormal picture, in a step 406, the adjacent state monitoring the connection show label of camera image is confirmed.If connect mark to become ON, then in step 407, the supervision camera image of more than at least 2 is connected and shows.Fig. 8-9 is used to be described in detail later.
After the connection of the change of abnormal show form and the adjacent supervision camera image of step 407 of having carried out step 405, in a step 408, the abnormality degree calculated in step 402 is kept in external recording medium as metadata.Its object is to, when video replay is off-line to image in hdd recorder 107, for the process of step 401 to 407, does not carry out image procossing and carry out image playback efficiently.Such as, when cutting out the scene that may be used for committing a crime and search and support from the image data of having recorded a video for a long time, the abnormality degree of the motion characteristic of personage is used to carry out image playback.That is, can be set to: for the scene that abnormality degree is less, because the action of personage is uncomplicated, and exception not occur, and improve playback speed and investigate in short time; On the contrary, for the scene that abnormality degree is larger, because figure action is complicated, and there occurs certain extremely, and postpone playback speed to investigate in minute detail.
Fig. 5 is the key diagram that the display speed (frame per second) in the central monitoring system of one embodiment of the present of invention changes.
According to the abnormality degree calculated from the eiconometer of supervision camera by image procossing, the speed (frame per second) of picture display can be changed.Wherein have two kinds of situations, a kind of is the situation of Real time displaying photographic image as shown in the left side of Fig. 5, another kind be starting from behind as shown in the right side of Fig. 5 reset off-line display the situation of image recorded.
First, when the Real time displaying shown in the left side of Fig. 5, when usual (when not occurring abnormal), as shown in the lower-left section of Fig. 5, the frame per second of the image shown by reduction.In this case, the state that image is only changed off and on is sufficient, in extreme situations, in image, there is not personage, under picture does not have vicissitudinous situation completely, frame per second can also be set to 0, namely stops display.
On the other hand, when there occurs abnormal, as shown in the upper left section of Fig. 5, according to the abnormality degree calculated by image procossing, display frame rate being improved continuously or makes display frame rate successively improve given pace amplitude.Now, show according to maximum 30fps, i.e. common frame per second.
Namely, showing the image of multiple supervision camera while carry out in the surveillance of centralized watch, possess: abnormality degree calculating part, calculated the abnormality degree of the figure action in the image of multiple supervision camera for each supervision camera by image procossing; And frame per second adjustment part, this abnormality degree is higher, makes the display frame rate of the image from this supervision camera higher.Abnormality degree calculating part and frame per second adjustment part are arranged in image processing apparatus 108, realize by software or image processing circuit.In addition, also abnormality degree calculating part can be arranged in pattern recognition device 207, be input to image processing apparatus 108 together with image.
Next, when the off-line display shown in the right side of Fig. 5, when usual, as shown in the bottom right section of Fig. 5, carry out " F.F. " and reset.In extreme situations, if do not have vicissitudinous situation completely in picture under, playback can also be made to jump to the next one and to there occurs abnormal frame.
In the scene that there occurs the exception shown in the upper right section of Fig. 5, according to the abnormality degree calculated by image procossing, make the speed of " slow-motion playback " reduce continuously or successively reduce certain speed amplitude.Now, common playback speed (etc. speed: 1.0 times) is reduced to.But, when this scene is observed in hope in more detail, playback speed (being less than 1.0 times) also can be reduced further.
Namely, the image of multiple supervision camera is being recorded a video, arrange the image of these multiple supervision cameras and reset while carry out in the surveillance of centralized watch simultaneously, possess: abnormality degree calculating part, calculated the abnormality degree of the figure action in the image of multiple supervision camera for each supervision camera by image procossing; And playback speed adjustment part, this abnormality degree is lower, makes the playback speed of the recording image obtained by this supervision camera higher.Abnormality degree calculating part and playback speed adjustment part are arranged in image processing apparatus 108, realize by software or image processing circuit.Obtain the method for abnormality degree as abnormality degree calculating part, also can utilize the metadata in the head region being directly stored into motion pictures files or dynamic image data.Or, also can possess metadata reservoir, this metadata reservoir in order to next playback time, and in the head region that abnormality degree is directly stored into motion pictures files as metadata or dynamic image data.For metadata reservoir, also can be realized by software or image processing circuit.
Next, the indication example of the concrete monitor picture of embodiments of the invention is described.
Fig. 6 is that the migration being adjusted, eject display and abnormality degree by frame per second shows the key diagram that picture is supported in the supervision carried out.In Fig. 6 (a), being kept at there occurs abnormal supervision camera image in storage buffer temporarily, making this supervision camera image eject display on monitoring image.This example represents and has exceeded the situation of threshold value to the abnormality degree obtained from monitoring the image of camera 7 carry out image procossing and made from monitoring that the image of camera 7 carries out ejecting the appearance of display 601 in picture central authorities.For the image of ejection display 601 now, if then according to the display of higher frame per second in in-service monitoring, when resetting supervision off-line, slow-motion is reset.Like this, the amplification display part having exceeded the image of the supervision camera of setting at central authorities' amplification display abnormality degree of display frame is arranged in image processing apparatus 108, realizes by software or image processing circuit.
The display form of Fig. 6 (b) is as illustrated in Fig. 3, to the example of the monitor picture that the image of all 16 supervision cameras shows in the lump.This example can be applied to online image monitoring or off-line video recording after playback monitor in any one, in Fig. 6 (b), the adjustment example of playback speed when being illustrated as offline playback, in Fig. 6 (c), the adjustment example of frame per second when being illustrated as in-service monitoring.
In Fig. 6 (b), when changing the offline playback speed of the moving image of each supervision camera image according to the size of the abnormality degree calculated in step 402 (Fig. 4), the value of continuous sequence increment gets the value between 0 to 1, so can be realized the function of expectation by following formula.
" correction playback speed "=" standard playback speed " × α × (1.0-" sort increment size continuously ")
Herein, α be greater than 1 positive constant.When the action of the personage in monitor area is normal or when there is not personage in monitor area, even if such as under the state of the step action of escalator, the value of sequence increment also gets lower value continuously.Therefore, if use above formula, even if then there is no the situation of passenger or having passenger but in the uncomplicated situation of action, improve the playback speed of display, such as, as illustrated by 602, with 2.0 times of speed playbacks from the recording image monitoring camera 11.Vicissitudinous scene is not had while reset, so the visual tired of surveillant when carrying out image investigation off-line reduces owing to skipping like this.
On the contrary, when the value of the increment that sorts continuously is larger, represents that the action of passenger is complicated, in this case, need to observe in detail.Therefore, such as, as shown in 603, slowly reset from the recording image monitoring camera 12 according to 0.2 speed, the scene of playback time can not be missed and abnormal situation can be observed in detail.Such display realizes by described frame per second adjustment part.
Fig. 6 (c) is the example of the monitoring image using sequence increment continuously to make display frame rate variable when online centralized watch.That is, when the value that the increment that makes to sort continuously is got between 0 to 1, display frame rate is set to and sequence increment size is added continuously to display frame rate i.e. 30 [fps] of standard and the value that obtains.If when continuous sequence increment value close to 1.0, display frame rate uprises, such as with 604 represent from camera 11 image shown in, close under the state of frame per second 30 [fps] of not losing scene, abnormal operation state can be observed.
On the contrary, when continuous sequence increment close to 0, display frame rate is reduced.Such as, as shown at 605 from camera 1 image shown in, the value of display frame rate close to 0, the visual fatigue of surveillant when can reduce the image of Continuous Observation normal condition.
In the adjustment of such display frame rate, other effects can also be expected.That is, the image that display frame rate is lower is definition according to continuous sequence increment and the less image of abnormality degree.On the other hand, if abnormality degree uprises, then display frame rate improves, and which monitors camera image visually to emphasize preferred view.Therefore, the over sight (OS) can learnt abnormal situation as early as possible, abnormal situation can be reduced can be expected.Such display realizes by described playback speed adjustment part.
In Fig. 6 (d), for the adjustment of the frame per second of supervision camera image as described above, curve, chart is overlapping with each supervision camera image and show itself time-shift of abnormality degree.Such as, as 606, overlappingly broken line graph display is carried out to the time-shift of abnormality degree with the image from camera 4.Thus, can visual indication be not the exception of the such moment of falling on escalator step, and the hybrid UV curing of flowing the abnormal such as people of long-time change to a certain degree.Like this, for each image of each supervision camera, the amplification display part shown with representing the curve chart of time-shift of abnormality degree or the image overlap of schematic diagram and each supervision camera is arranged in image processing apparatus 108, realizes by software or image processing circuit.
Next, use Fig. 7, the distortion of other modifications of display form of abnormal picture is described.Fig. 7 (a) illustrates and abnormal normal condition does not occur monitoring in camera image arbitrarily.Now, monitor that camera arrangement arranges from upper left towards bottom right according to arranging order.Fig. 7 (b) is the indication example of the brightness value changing image according to the size of figure action abnormality degree.Because described continuous sequence increment gets the value between 0 to 1, so the function of expectation can be realized by means of only being multiplied by the highest brightness value that can show on picture sequence increment size continuously.In Fig. 7 (b), as with 701 represent from camera 6,7 and 10 image as shown in, show the supervision camera image that abnormality degree is larger brightly.On the other hand, the supervision camera image of normal condition is dimmed.In the example in the figures, because the abnormality degree of camera 1-5 and 13-16 is minimum, so the darkest, the abnormality degree of camera 8,9,11 and 12 is intermediate degree, so more secretly show.That is, the brightness adjustment display part luminance level that the image of multiple supervision camera is divided into multiple grade shown according to abnormality degree is possessed.Brightness adjustment display part is arranged in image processing apparatus 108, realizes by software or image processing circuit.By this function, surveillant visually can grasp the preferential monitor observed, so with observe the situation of all supervision cameras according to identical weight compared with, can reduce owing to monitoring the fatigue caused.
In Fig. 7 (c), make to detect than other, the image of abnormal supervision camera monitors that the image of camera more secretly shows.Relatively bright to show for by which, can be suitable for selecting.Herein, except the image 702 of abnormal supervision camera being detected, be arranged on the supervision camera of the vicinity of this supervision camera or visual field is repeated or visual field is nearer supervision camera images 703 carries out gamma correction similarly, in this example embodiment, be seem darker indication example.That is, possess the image monitoring camera by the larger for abnormality degree the 1st and have and to monitor the 2nd of the image of the image association of camera the image monitoring camera with the 1st, with other monitor the image of camera distinguish show associate image display part.Association image display part is arranged in image processing apparatus 108, realizes by software or image processing circuit.
Its reason is, when occurred abnormal situation be occur in the borderline region that monitors between camera, abnormal situation occurs continuously or intermittently with time delay one side in multiple supervision camera image.On centralized watch picture when the position be separated is configured with the supervision camera image that there occurs abnormal situation, the mobile of viewpoint increases, and the vision burden of surveillant increases.
By the function of the present embodiment, except the supervision camera image that there occurs abnormal situation, can also visually grasp close to the place on the picture of this supervision camera or the visual field related supervision camera image of tool such as more closely, so the amount of movement of the sight line of surveillant reduces, result fatigue reduces.
Fig. 7 (d) illustrates the indication example Function Extension of Fig. 7 (b) being further reduced the amount of movement of sight line.In Fig. 7 (d), according to the size of abnormality degree, dynamically change the configuration monitoring camera image.In this indication example, due to supervision camera image larger for abnormality degree is configured in upper left, so surveillant intensively can monitor the supervision camera image weighting of upper left.Like this, the image for the multiple supervision cameras be arranged in a picture is arranged in image processing apparatus 108 according to the rearrangement display part that abnormality degree carries out resetting, and realizes by software or image processing circuit.
Above, be and the brightness that picture shows and monitor that function is supported in the supervision that the change of camera arrangement is relevant, even if but in this embodiment, if for each supervision camera, and with the adjustment of the display frame rate corresponding with abnormality degree or playback speed, then effect is larger.
Next, use Fig. 8 and Fig. 9, the connection Presentation Function of abnormality image is described.When the escalator in supervision office block, department store, supervision camera is set for each escalator.Under these circumstances, due to escalator action all the time, so the passenger on escalator step has fallen, with the movement of escalator step, monitor in camera at other state of affairs of falling also can observed and occur in certain supervision camera coverage.
Fig. 8 (a) is the display frame (wherein 702,703 respectively become 801,802) identical with Fig. 7 (c), for ease of the state of affairs that visual indication is such, except there occurs abnormal supervision camera image, be also highlighted the image of the supervision camera adjoined with this supervision camera.
In Fig. 8 (b), this function is further expanded, and when there occurs abnormal situation, adjacent supervision camera image 803 (corresponding to cameras 6) and 804 (corresponding to cameras 16) are each other connected with 806 with line 805, or in Fig. 9 (a), by video mosaicing, will adjoin monitor camera image each other 901 (corresponding to cameras 6) be directly connected with 902 (corresponding to cameras 16) and show.
Specifically, first, in Fig. 8 (a), be highlighted according to the result of abnormality degree calculation procedure 402 (Fig. 4) respectively and there occurs abnormal supervision camera image 801 (corresponding to camera 6) and its adjacent image 802 (corresponding to camera 16) monitoring camera.Next, as shown in Fig. 8 (b) or Fig. 9 (a), connect adjacent supervision camera image with line or carry out image mosaic.
In Fig. 8 (b), if in the mode making the moving direction of step consistent, connected by line display 805,806, visually can learn where personage moves between images wherefrom.Thus, the sight line of surveillant can be guided to move, can reduce and monitor fatigue together.
Namely, possess and link display part, this link display part on monitoring image with link line connect abnormality degree exceeded the supervision camera of setting image and with this supervision camera spatially adjacent other monitor camera or there is common visual field with this supervision camera other monitor the image of camera.Linking display part is arranged in image processing apparatus 108, realizes by software or image processing circuit.
In Fig. 9 (a), this function is further expanded.In Fig. 9 (a), as connected continuously in the mobile destination of step, relatively monitor the image 901 of camera 6, make the above-below direction of the image 902 of supervision camera 16 reverse and fit.Achieve like this and can carry out video mosaicing, the sight line between supervision camera be moved become minimum supervision supervision camera image.
Namely, possesses laminating display part, this laminating display part exceeded for abnormality degree the supervision camera of setting image and with this supervision camera spatially adjacent other monitor camera or there is common visual field with this supervision camera other monitor the image of camera, in the mode making image have connection each other, monitoring image make these monitor camera image laminating and show.Or possess continuous image display part, this continuous image display part carries out image procossing to described multiple image and shows, and looks like continuous print image to make it.Laminating display part or continuous image display part are arranged in image processing apparatus 108, realize by software or image processing circuit.
The extension process result of Fig. 8 (b) or Fig. 9 (a), as shown in Fig. 9 (b), monitoring image ejects and is shown as link image 903.
Be more than the link Presentation Function of the abnormality image from multiple supervision camera, even if but in this embodiment, if for the adjustment of each supervision camera dual-purpose display frame rate corresponding with abnormality degree or playback speed, then effect is larger.
That is, only otherwise conflicting, then also can the distortion of Combination application Fig. 5 ~ display illustrated in fig. 9.
Claims (5)
1., based on a central monitoring system for multiple supervision camera, the image showing multiple supervision camera carries out centralized watch, it is characterized in that, this central monitoring system comprises:
Abnormality degree calculating part, calculates the abnormality degree of the figure action in the image of multiple supervision camera by image procossing for each supervision camera;
Frame per second adjustment part, described abnormality degree is higher, makes the display frame rate of the image from this supervision camera higher; And
Link display part, on monitoring image with link line connect described abnormality degree exceeded the supervision camera of setting image and with this supervision camera spatially adjacent other monitor camera or there is common visual field with this supervision camera other monitor the image of camera.
2. the central monitoring system based on multiple supervision camera according to claim 1, it is characterized in that, this central monitoring system comprises amplification display part, and the image zoom that described abnormality degree has been exceeded the supervision camera of setting by this amplification display part is presented at the central authorities of display frame.
3. the central monitoring system based on multiple supervision camera according to claim 1 and 2, it is characterized in that, this central monitoring system comprises correction unit, this correction unit corrects the image of multiple supervision cameras of other objects in background with same shape by image procossing, look like be arranged on roughly the same position and the image of the supervision camera of roughly the same angle to make it.
4. the central monitoring system based on multiple supervision camera according to claim 1 and 2, it is characterized in that, this central monitoring system comprises brightness adjustment display part, and the luminance level that the image of multiple supervision camera is divided into multiple grade shows according to described abnormality degree by this brightness adjustment display part.
5. based on a centralized watch method for multiple supervision camera, to arrange and the image showing multiple supervision camera carries out centralized watch, it is characterized in that, this centralized watch method comprises:
Abnormality degree calculation procedure, calculates the abnormality degree of the figure action in the image of described multiple supervision camera by image procossing for each supervision camera;
Frame per second set-up procedure, described abnormality degree is higher, makes the display frame rate of the image from this supervision camera higher; And
Link step display, on monitoring image with link line connect described abnormality degree exceeded the supervision camera of setting image and with this supervision camera spatially adjacent other monitor camera or there is common visual field with this supervision camera other monitor the image of camera.
Applications Claiming Priority (2)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| JP2009-248340 | 2009-10-29 | ||
| JP2009248340A JP5155279B2 (en) | 2009-10-29 | 2009-10-29 | Centralized monitoring system and centralized monitoring method using multiple surveillance cameras |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN102055959A CN102055959A (en) | 2011-05-11 |
| CN102055959B true CN102055959B (en) | 2015-07-22 |
Family
ID=43959828
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201010524898.4A Active CN102055959B (en) | 2009-10-29 | 2010-10-29 | Central monitoring system based on a plurality of monitoring cameras and central monitoring method |
Country Status (2)
| Country | Link |
|---|---|
| JP (1) | JP5155279B2 (en) |
| CN (1) | CN102055959B (en) |
Cited By (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN106886164A (en) * | 2015-12-15 | 2017-06-23 | 三菱电机大楼技术服务株式会社 | Monitoring system emulator |
Families Citing this family (26)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| JP5762145B2 (en) * | 2011-06-02 | 2015-08-12 | キヤノン株式会社 | REPRODUCTION SYSTEM, ITS PROCESSING METHOD, AND PROGRAM |
| JP5556758B2 (en) * | 2011-07-22 | 2014-07-23 | 日本電気株式会社 | Information display device, information display method, and program |
| JP6369328B2 (en) * | 2012-04-05 | 2018-08-08 | 日本電気株式会社 | Analysis system |
| JP6466638B2 (en) * | 2013-12-18 | 2019-02-06 | Kddi株式会社 | Terminal, system, program, and method for thinning frames of a captured moving image according to a motion change amount |
| CN104735394B (en) * | 2013-12-19 | 2019-03-05 | 广州地铁集团有限公司 | A kind of VOD method and system for municipal rail train |
| CN104486581B (en) * | 2014-12-04 | 2018-02-06 | 广州中国科学院先进技术研究所 | A kind of more bionic eye monitor area picture Real time dynamic display method and system |
| CN104580974B (en) * | 2015-01-30 | 2018-12-21 | 成都华迈通信技术有限公司 | A kind of method of intelligent monitoring playing back videos |
| JP6569261B2 (en) * | 2015-03-23 | 2019-09-04 | カシオ計算機株式会社 | Operating device, operating method and program, operating system |
| TWI575956B (en) * | 2015-04-21 | 2017-03-21 | 神達電腦股份有限公司 | Video recording method by dynamically adjusting the picture frame rate and video recording device |
| JP6292363B2 (en) * | 2016-02-24 | 2018-03-14 | コニカミノルタ株式会社 | Terminal device, terminal device display method, and monitored person monitoring system |
| JP6631350B2 (en) * | 2016-03-22 | 2020-01-15 | 株式会社デンソー | Drive recorder |
| CN105898158B (en) * | 2016-04-27 | 2019-08-16 | 努比亚技术有限公司 | A kind of data processing method and electronic equipment |
| CN107662867B (en) | 2016-07-29 | 2021-03-30 | 奥的斯电梯公司 | Step roller monitoring and maintenance operator monitoring for passenger conveyors |
| JP6252921B1 (en) * | 2016-08-31 | 2017-12-27 | パナソニックＩｐマネジメント株式会社 | Surveillance camera system and playback method |
| KR101891278B1 (en) * | 2017-02-08 | 2018-08-24 | 이정무 | Multi image displaying method, Multi image managing server for the same, Multi image displaying system for the same, Computer program for the same and Recording medium storing computer program for the same |
| CN107085902A (en) * | 2017-04-26 | 2017-08-22 | 深圳先进技术研究院 | A kind of intelligent video multi-point monitoring method and system |
| JP7122729B2 (en) * | 2017-05-19 | 2022-08-22 | 株式会社ユピテル | Drive recorder, display device and program for drive recorder |
| KR102119215B1 (en) * | 2017-09-04 | 2020-06-04 | 이정무 | Image displaying method, Computer program and Recording medium storing computer program for the same |
| CN108134926A (en) * | 2018-02-14 | 2018-06-08 | 中科系整有限公司 | The monitoring system and method for object orientation |
| CN110203803A (en) * | 2019-06-06 | 2019-09-06 | 快意电梯股份有限公司 | Escalator safeguard method and device based on AI intelligent monitoring |
| DE102019116961A1 (en) | 2019-06-24 | 2020-12-24 | Grimme Landmaschinenfabrik Gmbh & Co. Kg | Method for observing work processes of an agricultural machine, digital video system and agricultural machine |
| CN112150667A (en) * | 2020-09-22 | 2020-12-29 | 杭州海康威视数字技术股份有限公司 | Information processing method and device and information recorder |
| CN114650390A (en) * | 2020-12-17 | 2022-06-21 | 深圳绿米联创科技有限公司 | Video playing method, event detection method, system and device and electronic equipment |
| CN112560723B (en) * | 2020-12-22 | 2023-10-17 | 中电海康集团有限公司 | Fall detection method and system based on morphological recognition and speed estimation |
| CN112507984B (en) * | 2021-02-03 | 2021-05-11 | 苏州澳昆智能机器人技术有限公司 | Conveying material abnormity identification method, device and system based on image identification |
| CN113395449B (en) * | 2021-06-16 | 2022-06-24 | 国网山东省电力公司武城县供电公司 | Abnormity monitoring system with self-adaptive resource adjustment |
Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN1118486A (en) * | 1994-07-25 | 1996-03-13 | 株式会社日立制作所 | Plant monitoring apparatus and monitoring method |
| CN1578461A (en) * | 2003-07-25 | 2005-02-09 | 株式会社日立制作所 | Information monitoring providing apparatus and information monitoring providing method |
| CN101025825A (en) * | 2006-02-17 | 2007-08-29 | 株式会社日立制作所 | Abnormal action detecting device |
| CN101434363A (en) * | 2007-11-15 | 2009-05-20 | 株式会社日立制作所 | Control apparatus of escalator |
Family Cites Families (10)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| JP3484531B2 (en) * | 1997-04-16 | 2004-01-06 | オムロン株式会社 | Image output control device, monitoring system, image output control method, and storage medium |
| JP2004165804A (en) * | 2002-11-11 | 2004-06-10 | Fuji Photo Film Co Ltd | Camera supervisory system |
| JP2004200989A (en) * | 2002-12-18 | 2004-07-15 | Fuji Photo Film Co Ltd | Imaging apparatus and supervisory system |
| JP4444603B2 (en) * | 2003-09-03 | 2010-03-31 | キヤノン株式会社 | Display device, system, image display system, image processing method, display method, and program |
| JP2006197226A (en) * | 2005-01-13 | 2006-07-27 | Kanshi Kakumei:Kk | Monitor camera system |
| JP4722537B2 (en) * | 2005-04-21 | 2011-07-13 | パナソニック株式会社 | Monitoring device |
| JP2007214831A (en) * | 2006-02-09 | 2007-08-23 | Hitachi Kokusai Electric Inc | Video processing system |
| WO2008069344A1 (en) * | 2006-12-05 | 2008-06-12 | Fujifilm Corporation | Output apparatus, output method and program |
| JP4349412B2 (en) * | 2006-12-12 | 2009-10-21 | ソニー株式会社 | Monitoring device and monitoring method |
| JP4975473B2 (en) * | 2007-02-15 | 2012-07-11 | 三菱電機株式会社 | Video surveillance device |
-
2009
- 2009-10-29 JP JP2009248340A patent/JP5155279B2/en active Active
-
2010
- 2010-10-29 CN CN201010524898.4A patent/CN102055959B/en active Active
Patent Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN1118486A (en) * | 1994-07-25 | 1996-03-13 | 株式会社日立制作所 | Plant monitoring apparatus and monitoring method |
| CN1578461A (en) * | 2003-07-25 | 2005-02-09 | 株式会社日立制作所 | Information monitoring providing apparatus and information monitoring providing method |
| CN101025825A (en) * | 2006-02-17 | 2007-08-29 | 株式会社日立制作所 | Abnormal action detecting device |
| CN101434363A (en) * | 2007-11-15 | 2009-05-20 | 株式会社日立制作所 | Control apparatus of escalator |
Cited By (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN106886164A (en) * | 2015-12-15 | 2017-06-23 | 三菱电机大楼技术服务株式会社 | Monitoring system emulator |
Also Published As
| Publication number | Publication date |
|---|---|
| JP2011097309A (en) | 2011-05-12 |
| CN102055959A (en) | 2011-05-11 |
| JP5155279B2 (en) | 2013-03-06 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN102055959B (en) | Central monitoring system based on a plurality of monitoring cameras and central monitoring method | |
| KR101218360B1 (en) | Security system and method of controlling thereof | |
| JP5104309B2 (en) | Surveillance camera system | |
| JPH11168713A (en) | Monitor controller and its operation method therefor | |
| JPH0416996B2 (en) | ||
| US20070159530A1 (en) | Method and apparatus for controlling output of a surveillance image | |
| US8787446B2 (en) | Method of transmitting data | |
| KR100940237B1 (en) | CCTV system capable of control monitoring and recording in relates with event occurrence and control method thererof | |
| JP2004056473A (en) | Monitoring controller | |
| JPH10164394A (en) | Information transmission method, information recording method and device for executing the method | |
| JP2009111677A (en) | Video imaging control system | |
| JPH11164289A (en) | Video multiplexer and video supervisory equipment | |
| JP5734238B2 (en) | Plant monitoring device | |
| JPH11203578A (en) | Multidisplay monitoring system | |
| KR20120050546A (en) | System for controlling remotely device using pan tilt zoom camera | |
| JP2002245572A6 (en) | Remote surveillance video security system | |
| JP2006129218A (en) | Monitoring system | |
| JP2009212716A (en) | Video display apparatus | |
| JP4607668B2 (en) | Surveillance video recording apparatus and surveillance video recording system | |
| JPS6172397A (en) | Monitor system | |
| JP4905761B2 (en) | Video display method | |
| JP2008172698A (en) | Surveillance camera system | |
| CN101110905A (en) | Camera vibration discerning device and method for digital video recorder | |
| JP5138877B2 (en) | Video signal replacement device and signal replacement method | |
| KR20060095218A (en) | The same time multi channel recording method of digital video recorder system |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| C10 | Entry into substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| C14 | Grant of patent or utility model | ||
| GR01 | Patent grant |