TWI480795B - Video monitoring and analyzing method - Google Patents

Description

Image monitoring and analysis method

The invention relates to an image monitoring and analysis method; in particular, to an image monitoring and analysis method capable of setting a patrol route, a customizable window and a settable tracking object.

With the development of technology, digital video recorders (DVR), network video recorders (NVR) and other surveillance video equipment have been widely used for personal or public environment security and property protection. . In this way, surveillance video equipment can be used as anti-blocking and anti-discrimination measures for illegal activities such as theft, illegal intrusion, damage to buildings, etc., and is constructed in stores, POS terminals, shops, parking lots, distribution centers, warehouses and/or private offices. Space and so on.

However, due to the limited display area of the monitor, if you want the image signals generated by multiple cameras to be displayed on the monitor screen simultaneously with the operation interface of the entire monitoring system, it is bound to have a crowding effect and it is difficult to balance all the needs. . Moreover, the control interface and monitoring interface of the conventional monitoring system are usually designed when the system is shipped from the factory. In order to meet the needs of various environments in the future, the screen layout usually needs to be comprehensive and full-featured, and it is easy to design if it is not designed properly. The congestion and complexity of the picture caused unnecessary trouble for the user. Therefore, how to improve the lack of this habit has become the main purpose of the development of this case.

The main object of the present invention is to provide an image monitoring and analysis method.

In order to achieve the above object, in accordance with an embodiment of the present invention, an image monitoring and analysis method of the present invention is used for a monitoring server, the method comprising the steps of: providing a manipulation interface and a monitoring interface, and displaying a main screen on the manipulation interface The main screen and the customized area enlarged screen are displayed on the monitoring interface, wherein the customized area enlarged screen is a part of the main screen.

According to an embodiment of the present invention, the method further includes: receiving a setting of the patrol path, wherein the patrol path is set on the main screen; and displaying a patrol screen on the monitoring interface, wherein the patrol picture is on the main screen according to the patrol path The picture obtained by the tour.

According to an embodiment of the present invention, the method further includes: receiving a location setting of the monitoring window, wherein the location of the monitoring window is set on the main screen; and displaying the customized area to enlarge the screen on the monitoring interface, wherein the customization is performed. The area enlargement screen is provided based on the position of the monitor window on the main screen.

According to an embodiment of the invention, the method further comprises: providing an image analysis function setting page, so that the customized area enlarged picture has an image analysis function and a video recording function.

According to an embodiment of the present invention, the method further includes: receiving a setting of the tracking object, wherein the tracking object is set on the main screen; and displaying the tracking image on the monitoring interface, wherein the tracking image is based on the tracking object on the main screen The location is provided.

According to an embodiment of the invention, the method further comprises: displaying a sub-picture In the manipulation interface, the sub-picture and the main picture are provided by different image capturing devices.

According to an embodiment of the invention, the manipulation interface and the monitoring interface are displayed on different display devices.

According to an embodiment of the invention, the manipulation interface and the monitoring interface are displayed on the same display device.

According to an embodiment of the invention, the main picture is a fisheye-expanded panoramic picture.

The above and other objects, features and advantages of the present invention will become more <

Hereinafter, please refer to FIG. 1 , which is a schematic diagram of a usage environment of an image monitoring and analysis method according to an embodiment of the present invention. As shown in FIG. 1 , the image monitoring and analysis method of the present invention can be applied to an image monitoring system, which is mainly composed of a plurality of image capturing devices 100a, 100b to 100n, and a first display device 10 and a second display device 20, The monitoring server 30 is configured to transmit a plurality of image signals captured by the plurality of image capturing devices 100a and 100b to 100n to the monitoring server 30 for processing, and then generate a plurality of image output signals and transmit the signals to the first A display device 10 and/or a second display device 20 are displayed.

According to an embodiment of the present invention, the image capturing device 100a, 100b, 100n may be a CCD type or CMOS type image sensing element, but the present invention Ming is not limited to this. The first display device 10 and the second display device 20 may be liquid crystal display (LCD) with touch function, but the invention is not limited thereto. The image monitoring and analysis method of the present invention can be implemented by being installed in the monitoring server 30 as an application (APP), but the invention is not limited thereto.

2A, 2B, and 2C are flowcharts of steps of an image monitoring and analysis method according to an embodiment of the present invention; and refer to FIG. 1 and FIG. 3 to FIG. 6 together with respect to the present invention. A specific embodiment.

First, step S21 is performed: providing a manipulation interface and a monitoring interface, displaying a main screen and at least one sub-screen on the manipulation interface, and displaying a main screen and at least one custom area enlargement screen on the monitoring interface.

Please refer to FIG. 3, which is a schematic diagram of a manipulation interface and a monitoring interface of an image monitoring and analysis method according to an embodiment of the present invention. According to an embodiment of the present invention, as shown in FIG. 3, a manipulation interface 11 and a monitoring interface 21 are provided on the first display device 10 and the second display device 20, respectively. The manipulation interface 11 includes three blocks for displaying the main screen 111, the sub-screens 112a to 112d, and the mode options 113a to 113c. The monitoring interface 21 includes three blocks, wherein the two blocks are used to display the main picture 211 and the customized area enlarged pictures 213a to 213d, respectively. It should be noted that since the main screen 111 and the sub-screens 112a to 112d, the patterns of the main screen 211 and the custom-area enlarged screens 213a to 213d are not the focus of the present invention, they are not displayed in the actual drawings in the drawings.

According to an embodiment of the present invention, the main screen 111 and the main screen 211 are captured by one of the image capturing devices 100a, 100b to 100n. After the signal is transmitted to the monitoring server 30 for processing, an image output signal is generated and transmitted to the first display device 10 and the second display device 20 for display. According to an embodiment of the present invention, the main screen 111 and the main screen 211 are displayed in a fisheye-expanded panoramic image, but the invention is not limited thereto.

According to an embodiment of the present invention, the sub-screens 112a-112d are similarly captured by one of the image capturing devices 100a, 100b to 100n to a plurality of devices, and then transmitted to the monitoring server 30 for processing to generate image output. The signal is transmitted to the first display device 10 for display. The sub-pictures 112a-112d are different from the main picture 111 and are provided by different image capturing devices, thereby providing a wider range of monitoring for the user. In this embodiment, the number of sub-pictures is four, but the invention is not limited thereto.

According to an embodiment of the present invention, the image monitoring and analysis method of the present invention can provide three monitoring modes for the user to select. As shown in FIG. 3, the manipulation interface 11 includes three mode options 113a to 113c, which respectively correspond to a cruise mode, a custom window mode, and a tracking mode, and the user can select or switch the monitoring mode to change the monitoring screen.

According to an embodiment of the present invention, as shown in FIG. 3, the positions of the sub-pictures 112a-112d in the manipulation interface 11 are located above the main screen 111, and the positions of the mode options 113a-113c in the manipulation interface 11 are located at the main position. The screen 111 is to the right, so the user can simultaneously view the above picture on a single manipulation interface 11. However, it should be noted that the location of the main screen, sub-pictures and mode options is not limited to this.

According to an embodiment of the present invention, the customized area enlarged pictures 213a to 213d are captured by the image capturing device that provides the main screens 111 and 211. Then, it is sent to the monitoring server 30 for processing, and is amplified to generate a video output signal and transmitted to the second display device 20 for display. Therefore, the customized area enlargement screens 213a to 213d are one of the main screens 111 and 211, and are processed and enlarged. In this embodiment, the number of enlarged areas of the customized area is four, but the invention is not limited thereto.

According to an embodiment of the present invention, as shown in FIG. 3, the position of the customized area enlarged screens 213a-213d in the monitoring interface 21 is located below the main screen 211, so that the user can simultaneously view on a single monitoring interface 21. The above picture. However, it should be noted that the position of the main screen and the customized area magnified screen is not limited to this.

Then, proceeding to step S22: receiving the setting of the patrol path, wherein the patrol path is set on the main screen.

Please refer to FIG. 4, which is a schematic diagram of an image monitoring and analysis method in a cruise mode according to an embodiment of the present invention. According to an embodiment of the present invention, when the user selects the mode option 113a (in the present embodiment, the cruise mode), the user can set a cruise path 114 on the main screen 111, and the monitor server 30 receives the setting. According to an embodiment of the present invention, the setting of the patrol path 114 can be used by the user, such as a mouse, a stylus (when the first display device 10 is a touch screen), and a finger (the first display device 10 is The setting is performed on the first display device 10 when the screen is touched, etc., but the present invention is not limited to the setting method. According to an embodiment of the present invention, the patrol path 114 may be a left and right moving path, an up and down moving path, or a freely unrestricted moving path. It should be noted that there is a way to set the patrol path 114 using various input devices, which should be the invention Those of ordinary skill in the art are familiar with the scope of the prior art and will not be described again in the specification.

Then, step S23 is performed: displaying a patrol screen on the monitoring interface, wherein the patrol screen is patrolled on the main screen according to the patrol path.

Referring to FIG. 4, after the setting of the patrol path 114 is completed, a patrol screen 212 is displayed on the monitoring interface 21, wherein the patrol screen 212 is an image capturing device that provides the main screens 111 and 211. After the image signal is taken, it is sent to the monitoring server 30 for processing, and the patrol path 114 set in step S22 is patrolled back and forth on the main screen 111 to generate a video output signal and transmitted to the second display device 20. Thereby, the user can control the dynamics on the cruise path 114. It should be noted that since the pattern of the patrol screen 212 is not the focus of the present invention, it is not shown in the actual pattern in the drawings. According to an embodiment of the present invention, as shown in FIG. 4, while displaying the cruise screen 212, the main screen 211 and the customized area enlarged screens 213a-213d are continuously displayed on the monitoring interface 21, so that the user can be single. The above screen is simultaneously viewed on the monitoring interface 21. According to an embodiment of the present invention, as shown in FIG. 4, the position of the customized area enlarged screens 213a-213d in the monitoring interface 21 is located below the main screen 211, and the position of the main screen 211 in the monitoring interface 21 is It is located to the left of the patrol screen 212, but it should be noted that the positions of the main screen, the customized area enlarged screen and the patrol screen are not limited thereto.

Then, step S24 is performed: receiving a position setting for at least one monitoring window, wherein the position of the at least one monitoring window is set on the main screen.

Next, please refer to FIG. 5A, which is a schematic diagram of an image monitoring and analysis method according to an embodiment of the present invention in a custom window mode. According to an embodiment of the present invention, as shown in FIG. 5A, when the user selects the mode option 113b (in the present embodiment, the custom window mode), the monitoring server 30 can provide at least one monitoring window on the main screen 111. The user can set the position of the monitoring windows 115a to 115d on the main screen 111, and the monitoring server 30 receives the setting.

According to an embodiment of the present invention, the position setting of the monitoring windows 115a-115d can be used by the user, such as a mouse, a keyboard, a stylus (when the first display device 10 is a touch screen), a finger ( The first display device 10 is set on the first display device 10 when the touch screen is touched, etc., but the present invention is not limited to the setting method. It should also be noted that the location of the monitoring windows 115a-115d for how to use various types of input devices should be familiar to those of ordinary skill in the art to which the invention pertains, and is a category of conventional technology, and is no longer in the specification. Narration.

Then, step S25 is performed: displaying at least one customized area enlarged screen on the monitoring interface, wherein at least one customized area enlarged picture is provided according to a position of the at least one monitoring window on the main screen.

Referring to FIG. 5A, in accordance with an embodiment of the present invention, after the location settings of the monitoring windows 115a-115d are completed, the monitoring server 30 displays the customized area enlarged screens 213a-213d on the monitoring interface 21, wherein the customized area is enlarged. The screens 213a to 213d are provided based on the positions of the monitoring windows 115a to 115d on the main screen 111. Therefore, at this time, the screen is enlarged in the custom area. The images displayed in 213a to 213d correspond to the images displayed on the main screen 111 at the positions of the monitoring windows 115a to 115d, and are displayed in an enlarged manner. Thereby, the user can have a clearer understanding of the dynamics of a particular location. According to an embodiment of the present invention, as shown in FIG. 5A, the number of the monitoring windows 115a-115d and the customized area enlarged screens 213a-213d is four, but the invention is not limited thereto.

Then, step S26 is performed: providing an image analysis function setting page, so that at least one customized area enlarged screen has an image analysis function and a video recording function.

According to an embodiment of the present invention, after the customized area enlarged screens 213a to 213d are displayed, the setting may be performed for each monitoring window so that each corresponding customized area enlarged picture has a different image analysis function. Referring to FIG. 5B, the image analysis function setting page 12 is provided by the monitoring server 30, and includes an image analysis function menu 121 for the user to set an image analysis function of the individual monitoring window. After the setting is completed, the corresponding custom area enlargement screen can perform different image analysis functions. In addition, after setting the respective image analysis functions for each custom area enlargement screen, the video function can be turned on for recording when certain conditions are met.

According to an embodiment of the present invention, the image analysis function comprises: (1) an electronic fence: a dangerous or specific location retrograde alarm or a warning across a safety line to prevent an accident from occurring. (2) Loss detection of objects (lost loss of valuables): It can detect the loss or theft of objects in the monitored area and issue a warning. (3) Object legacy detection (suspect of suspicious objects): intentional or unintentional detection of remnants, such as the leftover of passengers' luggage and suspicious objects in public places; can be used to clarify the beginning and end of the incident by reading the video screen. (4) Personnel: detecting moving objects in the monitoring area The embarrassment, stay, delay of stay, etc., to ensure the smooth passage of safe passages or to detect suspicious persons in specific places and prevent crimes. (5) Flow count: Calculate the number of in/out of personnel in a specific area. Can be applied such as the number of people entering and leaving, crowd control, and so on. (6) Fall detection: detecting the fall behavior of the person in the picture, not only in the unexpected situation, but also in the sudden illness such as stroke or epilepsy, the action must be discovered and rescued at the first time. (7) Hotspot analysis: The statistically frequent and frequent areas of the personnel in the image are used to assist the analysts or visitors in the flow and purchase behavior. (8) Face Detection: Detects the face area in the image and records it for subsequent comparison and identification. However, it should be noted that the image analysis function is not limited to this.

Then, step S27 is performed: receiving the setting of the tracking object, wherein the tracking object is set on the main screen.

Next, please refer to FIG. 6, which is a schematic diagram of an image monitoring and analysis method in a tracking mode according to an embodiment of the present invention. According to an embodiment of the present invention, as shown in FIG. 6, when the user selects the mode option 113c (in this embodiment, the tracking mode), the user can set the tracking object 116 on the main screen 111 by the monitoring server. 30 Receive this setting.

According to an embodiment of the present invention, the setting of the tracking object 116 can be used by the user, such as a mouse, a stylus (when the first display device 10 is a touch screen), and a finger (the first display device 10 is The setting is performed on the first display device 10 when the screen is touched, etc., but the present invention is not limited to the setting method. In accordance with an embodiment of the present invention, the tracking object 116 can be any identifiable individual object on the home screen 111, such as a particular person or a particular item. Another thing to note is how to use each The type input device setting tracking object 116 should be familiar to those of ordinary skill in the art, and is a matter of the prior art, and will not be described again in the specification.

Then, step S28 is performed: displaying the tracking screen on the monitoring interface, wherein the tracking image is provided according to the position of the tracking object on the main screen.

Referring to FIG. 6, in accordance with an embodiment of the present invention, after the tracking object 116 is set, the monitoring server 30 displays a tracking screen 214 on the monitoring interface 21, wherein the tracking screen 214 is an image providing the main screens 111, 211. The pickup device captures the image signal and transmits it to the monitoring server 30 for processing, which is provided based on the position of the tracking object 116 on the main screen 111. Thereby, the user can control the dynamics of the tracking object 116. It should also be noted that since the pattern of the tracking screen 214 is not the focus of the present invention, it is not shown in the actual pattern in the drawings.

According to an embodiment of the present invention, as shown in FIG. 6, while displaying the tracking screen 214, the main screen 211 and the customized area enlarged screens 213a to 213d are continuously displayed on the monitoring interface 21, so that the user can be single. The above screen is simultaneously viewed on the monitoring interface 21. According to an embodiment of the present invention, as shown in FIG. 6, the position of the customized area enlarged screens 213a to 213d in the monitoring interface 21 is located below the main screen 211, and the position of the main screen 211 in the monitoring interface 21 is It is located to the left of the tracking screen 214, but it should be noted that the positions of the main screen, the customized area enlarged screen and the tracking screen are not limited thereto.

It should be noted that, in the above embodiment, the manipulation interface 11 and the monitoring interface 21 are displayed on different display devices. But according to another embodiment of the present invention For example, if the display area of the display device is sufficient, the manipulation interface 11 and the monitoring interface 21 can also be displayed on the same display device.

It should be noted here that the image monitoring and analysis method of the present invention is not limited to the above-described sequence of steps, and the order of the above steps may be changed as long as the object of the present invention can be achieved.

To sum up, the present invention, regardless of its purpose, means and efficacy, shows its distinctive features of the prior art. You are requested to review the examination and express the patent as soon as possible. It should be noted that the various embodiments described above are merely illustrative for ease of explanation, and the scope of the invention is intended to be limited by the scope of the claims.

10‧‧‧First display device

11‧‧‧Control interface

111‧‧‧Home screen

112a, 112b, 112c, 112d‧‧‧ sprite

113a, 113b, 113c‧‧‧ mode options

114‧‧‧ Touring path

115a, 115b, 115c, 115d‧‧‧ monitor windows

116‧‧‧ Tracking objects

12‧‧‧Image Analysis Function Setting Page

121‧‧‧Image Analysis Function Menu

20‧‧‧Second display device

21‧‧‧Monitoring interface

211‧‧‧ main screen

212‧‧‧ Tour screen

213a, 213b, 213c, 213d‧‧‧ custom area enlargement screen

214‧‧‧ Tracking screen

30‧‧‧Monitoring server

100a, 100b, 100n‧‧‧ image capture device

1 is a schematic diagram of a usage environment of an image monitoring and analysis method according to an embodiment of the present invention.

2A, 2B and 2C are flow charts showing the steps of an image monitoring and analysis method according to an embodiment of the present invention.

3 is a schematic diagram of a manipulation interface and a monitoring interface of an image monitoring and analysis method according to an embodiment of the present invention.

4 is a schematic diagram of an image monitoring and analysis method in a cruise mode according to an embodiment of the present invention.

5A and FIG. 5B are schematic diagrams showing an image monitoring and analysis method in a custom window mode according to an embodiment of the present invention.

6 is a schematic diagram of an image monitoring and analysis method in a tracking mode according to an embodiment of the present invention.

10‧‧‧First display device

11‧‧‧Control interface

111‧‧‧Home screen

112a, 112b, 112c, 112d‧‧‧ sprite

113a, 113b, 113c‧‧‧ mode options

20‧‧‧Second display device

21‧‧‧Monitoring interface

211‧‧‧ main screen

213a, 213b, 213c, 213d‧‧‧ custom area enlargement screen

Claims (8)

An image monitoring and analysis method is used for a monitoring server. The method includes: providing a manipulation interface and a monitoring interface, displaying a main screen on the manipulation interface, displaying the main screen and the plurality of the main interface on the monitoring interface The customized area enlarges the picture, wherein the customized area enlarged picture is a part of the main picture; receiving a setting of a patrol path, wherein the patrol path is set on the main picture; and displaying a display on the monitoring interface The patrol screen, wherein the patrol screen is patrolled on the main screen according to the patrol path. The image monitoring and analysis method of claim 1, further comprising: receiving a location setting for at least one monitoring window, wherein the location of the at least one monitoring window is set on the main screen; and displaying the The at least one customized area enlarges the picture on the monitoring interface, wherein the at least one customized area enlarged picture is provided according to a position of the at least one monitoring window on the main picture. The image monitoring and analysis method of claim 2, further comprising: providing an image analysis function setting page, wherein the at least one customized area enlarged picture has an image analysis function and a video recording function. The image monitoring and analysis method described in claim 1 or 2 further includes: Receiving a setting of a tracking object, wherein the tracking object is set on the main screen; and displaying a tracking image on the monitoring interface, wherein the tracking image is provided according to a position of the tracking object on the main screen. The image monitoring and analysis method of claim 4, further comprising: displaying at least one sub-picture on the manipulation interface, wherein the at least one sub-picture and the main picture are provided by different image capturing devices . The image monitoring and analysis method of claim 4, wherein the manipulation interface and the monitoring interface are displayed on different display devices. The image monitoring and analysis method of claim 4, wherein the manipulation interface and the monitoring interface are displayed on the same display device. The image monitoring and analysis method according to claim 4, wherein the main picture is a fisheye-expanded panoramic picture.