KR20180001794A - The Apparatus For Mornitoring - Google Patents

Abstract

The present invention relates to a monitoring apparatus which enables a user to easily perform image panning or tilting by having a control area. According to an embodiment of the present invention, the monitoring apparatus to achieve the purpose comprises: a communication unit receiving image data acquired by a camera and a signal generated by a sensor; a storage unit storing information on the image data and information on the signal; a screen unit displaying the received image; and a control unit controlling operations of the communication unit, the storage unit, and the screen unit. The screen unit displays the control area allowing for panning or tilting the image around the displayed image, and displays a pointer indicating a location where the sensor is installed in the control area. When the sensor detects an event, the screen unit generates an alarm in the pointer corresponding to the sensor detecting the event and displays the image facing the sensor detecting the event.

Description

The Apparatus For Mornitoring < RTI ID = 0.0 >

More particularly, the present invention relates to a monitoring apparatus capable of easily panning or tilting an image by a simple operation and interlocking with a sensor for detecting the occurrence of an event to intuitively detect occurrence and its contents The present invention relates to a monitoring device capable of monitoring a plurality of objects.

In general, surveillance systems are widely used in various places including banks, department stores, and residential areas. Such a surveillance system can be used for crime prevention and security purposes, but recently it is also used to monitor indoor pet or child in real time. Most of the surveillance systems use a closed - circuit television (TV) that can be monitored by monitoring the images taken by the camera. CCTV) system.

However, in the case of a general front camera, the range of the angle of view is limited, and if the object to be monitored moves and deviates from the angle of view, it is easy to miss the object to be monitored. Therefore, image pan, tilt, zoom (Pan, Tilt, Zoom: PTZ) function is essential. In recent years, there has been an increasing interest in the development of a UI / UX for user convenience that can easily perform such pan, tilt, and zoom functions. Recently, there has been an increase in the angular range of panning or tilting of the camera, and many cameras have been developed which can capture a very wide angle of view image, such as a fisheye camera or a 360 ° camera.

However, in the related art, when an event occurs in the vicinity of the camera, the user must directly monitor the image through the image, so that the event occurrence and the event contents can be grasped. Therefore, even if an event occurs, the user can not intuitively know the fact.

In recent years, there has been introduced a technique of causing an alarm to be sounded in a monitoring device capable of monitoring a camera image when an event occurs. However, it was possible to know only the occurrence of the event, and the location of the event and the contents of the event could not be known in detail.

Conventionally, up, down, left, and right direction keys are provided to panning or tilting the image acquired by the camera, and the user operates the direction key to panning or tilting the image. With such a direction key, it took a long time to panning or tilting the wide angle at a time.

Korean Patent No. 1082845 Korean Laid-Open Publication No. 2014-0040958

SUMMARY OF THE INVENTION The present invention has been made in view of the above problems, and it is an object of the present invention to provide a monitoring device capable of easily panning or tilting an image by a simple operation and interlocking with a sensor for detecting the occurrence of an event, .

The problems of the present invention are not limited to the above-mentioned problems, and other problems not mentioned can be clearly understood by those skilled in the art from the following description.

According to an aspect of the present invention, there is provided a monitoring apparatus comprising: a communication unit for receiving image data acquired by a camera and a signal generated by a sensor; A storage unit for storing the image data and information about the signal; A screen for displaying the transmitted image; And a control unit for controlling operations of the communication unit, the storage unit, and the screen unit, wherein the screen unit displays a control area for panning or tilting the image around the displayed image, And a pointer indicating a position where the sensor is installed. When the sensor senses an event, an alarm is sounded on the pointer corresponding to the sensor that sensed the event, and the image .

Other specific details of the invention are included in the detailed description and drawings.

The embodiments of the present invention have at least the following effects.

A control area is provided in the monitoring device so that the user can easily panning or tilting the image.

In addition, when an event occurs, an alarm sounds so that the user can easily know the occurrence, and the user can easily monitor the image of the area where the event occurs.

In addition, when a plurality of images are simultaneously displayed, a thumbnail for automatically adjusting the number is generated, so that a plurality of images can be displayed irrespective of the number of images.

The effects according to the present invention are not limited by the contents exemplified above, and more various effects are included in the specification.

1 is a block diagram illustrating a configuration of a monitoring system according to an embodiment of the present invention.
Figure 2 is a perspective view of the monitoring device 1 of Figure 1;
FIG. 3 is a view showing a control area 113 according to an embodiment of the present invention displayed on the screen 11 of the monitoring device 1. Referring to FIG.
4 is a view showing a control area 113 according to another embodiment of the present invention displayed on the screen 11 of the monitoring device 1. As shown in FIG.
5 is a diagram illustrating a method of performing a drag operation on a main image 112 according to an exemplary embodiment of the present invention.
FIG. 6 is a view showing a main image 112 panned as a result of FIG. 5. FIG.
FIG. 7 is a diagram illustrating a method of performing a drag operation on a window 114 according to an exemplary embodiment of the present invention.
FIG. 8 is a view showing a main image 112 panned as a result of FIG. 7. FIG.
9 is a view showing an alarm sounding to the pointer 116 according to an embodiment of the present invention.
FIG. 10 is a view showing a state in which an image directed to the sensor 3 corresponding to the pointer 116 of FIG. 9 is displayed.
FIG. 11 is a diagram showing a plurality of pointers 116 when a plurality of sensors 3 according to an embodiment of the present invention are displayed.
FIG. 12 is a diagram showing an alarm sounding to the first pointer 116a among the plurality of pointers 116 shown in FIG.
FIG. 13 is a view showing a state in which the first pointer 116a of FIG. 12 is selected.
FIG. 14 is a view illustrating a display of an image directed to the first sensor corresponding to the first pointer 116a of FIG.
FIG. 15 is a diagram showing how alarms are simultaneously sounded on the first to third pointers 116a, 116b, and 116c among the plurality of pointers 116 of FIG.
16 to 18 show the first to third images 112a, 112b and 112c directed to the first to third sensors corresponding to the first to third pointers 116a, 116b and 116c in Fig. 15, FIG.
FIG. 19 is a view showing a state in which thumbnails 117 are generated and images directed to the positions where the sensors 3 corresponding to the first to third pointers 116a, 116b, and 116c of FIG. 15 are installed are simultaneously displayed.

BRIEF DESCRIPTION OF THE DRAWINGS The advantages and features of the present invention and the manner of achieving them will become apparent with reference to the embodiments described in detail below with reference to the accompanying drawings. The present invention may, however, be embodied in many different forms and should not be construed as limited to the embodiments set forth herein. Rather, these embodiments are provided so that this disclosure will be thorough and complete, and will fully convey the scope of the invention to those skilled in the art. To fully disclose the scope of the invention to those skilled in the art, and the invention is only defined by the scope of the claims. Like reference numerals refer to like elements throughout the specification.

Unless defined otherwise, all terms (including technical and scientific terms) used herein may be used in a sense commonly understood by one of ordinary skill in the art to which this invention belongs. Also, commonly used predefined terms are not ideally or excessively interpreted unless explicitly defined otherwise.

The terminology used herein is for the purpose of illustrating embodiments and is not intended to be limiting of the present invention. In the present specification, the singular form includes plural forms unless otherwise specified in the specification. The terms " comprises "and / or" comprising "used in the specification do not exclude the presence or addition of one or more other elements in addition to the stated element.

Hereinafter, preferred embodiments of the present invention will be described in detail with reference to the accompanying drawings.

FIG. 1 is a block diagram showing the configuration of a monitoring system according to an embodiment of the present invention, and FIG. 2 is a perspective view of the monitoring apparatus 1 of FIG.

According to the method using the monitoring system according to the embodiment of the present invention, the control area 113 is displayed on the screen part 11 of the monitoring device 1. [ The user can panning or tilting the main image 112 displayed on the screen unit 11 through the control area 113. [ At this time, a pointer 116 corresponding to the sensor 3 is displayed in the control area 113. [ When the sensor 3 senses the occurrence of an event, it sends an event detection signal, and the monitoring device 1 receives an event detection signal and sounds an alarm to the pointer 116 corresponding to the sensor 3. An alarm sounds at the pointer 116 displayed in the control area 113, so that the user can check whether an event has occurred or can easily monitor the event.

A monitoring system according to an embodiment of the present invention includes a camera 2 for capturing an image of a specific region to acquire an image, a sensor 3 for transmitting a signal when an event is detected, And a monitoring device (1) for receiving and displaying signals transmitted from the sensor (3). The camera (2) or the sensor (3) and the monitoring device (1) are connected to each other by wire or wireless, and can transmit and receive image data or signals.

The camera 2 according to an exemplary embodiment of the present invention is preferably a pan tilt camera capable of panning and tilting. In particular, the camera 2 can be panned at 360 °, It is preferable that the camera 2 is capable of photographing. Alternatively, the camera 2 may be a recently introduced 360 ° camera. The 360 ° camera is a camera 2 that does not physically panning or tilting the camera 2 itself but mounts a plurality of fisheye lenses and is capable of simultaneously taking pictures in all directions. In this case, the image acquired by the 360 [deg.] Camera is panned or tilted through the software installed in the monitoring device 1. [ The camera 2 according to the embodiment of the present invention is not limited thereto and various cameras 2 can be used as long as the camera 2 can shoot toward a plurality of areas.

The sensor 3 according to an embodiment of the present invention can detect an event. For example, there are a fire detection sensor for detecting a fire occurrence, a smoke detection sensor for detecting smoke generation, and a heat detection or infrared detection sensor for detecting the appearance of a person or an animal. The sensor 3 is not limited to this, and various kinds of sensors 3 can be used as long as any type of event can be detected.

The monitoring device 1 according to an embodiment of the present invention receives and displays an image acquired by the camera 2. Then, the signal transmitted from the sensor 3 is received and an alarm is sounded. The monitoring device 1 is preferably a device providing a touch function such as a smartphone, a tablet PC, a laptop, etc. However, the monitoring device 1 may be a device for inputting a user command through a mouse or the like have. Hereinafter, the monitoring apparatus 1 will be described as a device that provides a touch function. However, this is for the convenience of description and is not intended to limit the scope of rights.

The user can install and delete various applications in the monitoring device 1. [ Among these, a camera control application can be executed, and a signal for controlling panning or tilting of an image can be generated through an input method such as a touch or a mouse. If the image can be panned or tilted by the camera 2 itself performing physical panning or tilting, the control signal is transmitted to the camera 2. However, when the camera 2 is a 360 [deg.] Camera, the control signal pans or tilts the image through the software installed in the monitoring device 1. [

1, the monitoring apparatus 1 includes a main body 10, a screen portion 11 for displaying an image, a communication portion 12 for receiving an image from the camera 2, a storage portion (13), and a control unit (14) for controlling other components.

The display unit 11 displays the main image 112 transmitted from the camera 2. [ As described above, the screen unit 11 may display the control area 113 on one side of the main image 112. [ When the sensor 3 detects the occurrence of an event, a pointer 116 is displayed in the control area 113. The pointer 116 responds to the sensor 3 and sounds an alarm.

If the monitoring device 1 does not provide a touch function, an input section is provided separately. Typically, the most commonly used inputs are the mouse, keyboard, joystick, and remote control. However, if the monitoring apparatus 1 provides a touch function, the screen unit 11 may include a touch sensor 111. [ In this case, the user can directly input the touch signal through the screen unit 11. [ The touch sensor 111 may be integrally mounted together with the screen unit 11. The touch sensor 111 senses touches generated on the screen unit 11 to detect coordinates, And transmits the detected result to the control unit 14. [ Various methods such as an electrostatic capacity type, an electric resistance film type, an ultrasonic type, and an infrared type can be used depending on a manner in which the touch sensor 111 senses a touch. The touch may be performed using a finger, but is not limited thereto, and may be performed using a stylus pen equipped with a tip through which a minute current can flow. Even if the monitoring apparatus 1 provides a touch function, a separate touch pad may be provided as an input unit if the screen unit 11 does not include the touch sensor 111. [

The communication unit 12 transmits and receives signals and data to and from the camera 2 and the sensor 3 by wire or wireless. For example, the communication unit 12 modulates and frequency upconverts and transmits signals and data from the controller 14, and frequency downconverts and decodes signals and data received from the camera 2 and the sensor 3, And provides it to the control unit 14. The communication unit 12 can receive the image data from the camera 2 or can receive the signal from the sensor 3 and send the data or signal generated from the control unit 14 to the camera 2 or the sensor 3 ).

The storage unit 13 stores a program for processing and controlling the operations of the monitoring apparatus 1, various data generated during each program execution, image data transmitted through the camera 2, Signal and so on. The storage unit 13 may be embedded in the monitoring device 1, but in the case of the network camera 2 system, a separate device such as an NVR (Network Video Recorder) may be provided.

The control unit 14 controls the overall operation of the monitoring device 1. [ For example, the control unit 14 performs processing and control for signal and data communication between the communication unit 12 and the camera 2 or the sensor 3. When the image is transmitted through the communication unit 12, And so on. When the user's command is input, the controller 11 controls the display unit 11 to display the control area 113 or generate an alarm at the pointer 116, stores the image in the storage unit 13, . The controller 14 may be a central processing unit (CPU), a microcontroller unit (MCU), or a digital signal processor (DSP), but the present invention is not limited thereto. Can be used.

The control unit 14 includes a gesture detection unit 141 and a coordinate transformation unit 142. The gesture detection unit 141 detects a touch gesture from the touch sensor 111. [ The touch gesture includes all the touch operations generated from the touch sensor 111. [ If the monitoring apparatus 1 does not provide a touch function, it detects a user command inputted through an input unit such as a mouse. The gesture detection unit 141 manages the touch sensor 111 and includes an application program interface (API) that allows a user to easily use a touch gesture in an application. An API is an interface that controls the functions provided by an operating system or programming language for use in an application. The gesture detection unit 141 receives a user command for executing the camera control application through the API, and receives a user command for controlling the activated application.

The coordinate transforming unit 142 receives the coordinates of the user command input from the gesture detecting unit 141 and generates a panning or tilting value of the image based on the coordinates. If the user touches one point to perform dragging of the image, coordinates for one point are extracted. When the user performs a drag operation on the image, the coordinates on the drag path are extracted at regular intervals or intervals. The coordinate transforming unit 142 can grasp the direction and distance in which the dragging is performed through the extracted coordinates, and converts the direction into a value to be panned or tilted. By panning or tilting the image using the value and displaying it through the screen 11, the image can be panned or tilted according to the drag instruction of the user.

If the camera 2 is a 360-degree camera, a fisheye lens is used, so that an image acquired through the fisheye lens may cause distortion. Therefore, the control unit 14 may further include a distortion correction unit (not shown). Instead of providing a wide angle of view, the image produced using a fisheye lens will become distorted by the refraction as it goes to the edge region of the image away from the optical axis. Therefore, the subject near the center of the lens is extremely large and the subject around the subject is very small. Although it is possible to use such a distorted image as it is, there are many cases where it is necessary to correct distorted images in a specific field. The correction of a distorted original image formed by a fisheye lens is generally referred to as a 'distortion correction' or a 'dewarp', and such a dwarf is a fisheye lens according to a projection method used in a fisheye lens, Such as a focal distance or an optical center position of the light source, using appropriate parameters.

The original image is transmitted to the monitoring apparatus 1 and then corrected by the distortion correction unit in the above-described manner through software. In recent years, however, a chip for correcting the distortion of the original image has been installed inside the fisheye camera 2 A technology has been introduced. If the original image can be dwarfed by the camera 2 as described above, there is no need to install software for the dwarf in the monitoring device 1 that receives the image from the camera 2. [ Therefore, when transmitting an image from one camera 2 to a plurality of monitoring devices 1, it is possible to display a corrected image directly without dwarfing without installing software in all the monitoring devices 1.

3 is a view showing a control area 113 according to an embodiment of the present invention on the screen 11 of the monitoring device 1. FIG 4 is a diagram showing a screen 11 of the monitoring device 1, FIG. 3 is a view showing a control area 113 according to another embodiment of the present invention.

When the monitoring apparatus 1 according to an embodiment of the present invention is executed, the main image 112 is displayed on the screen unit 11, and at the same time, the control area 113 is displayed. The main image 112 is preferably a live view, which is a video captured by the camera 2 in real time. However, the present invention is not limited to this, and it may be a Playback which has already been captured in the past and stored in the storage unit 13 and then loaded and displayed. The control area 113 is preferably displayed on one side of the screen 11. In particular, as shown in FIGS. 3 and 4, it is more preferable that the control area 113 is displayed below the screen part 11, but it is not limited thereto and can be displayed at various positions.

The control area 113 corresponds to a panning or tilting enabled area of an image that can be captured and obtained by the camera 2. [ If the camera 2 is a pan / tilt camera, the control area 113 corresponds to an area where the camera 2 can directly panning or tilting. If the camera 2 is capable of 360 ° camera or a pan / tilt camera is capable of panning 360 °, the control area 113 corresponds to the omnidirectional area of the camera 2. On both sides of the control area 113, it is preferable that the minimum and maximum angles of the panning angle range are displayed as shown in Figs. 3 and 4.

On the other hand, in the control area 113, a window 114 indicating an area 115 corresponding to the main image 112 is displayed. The window 114 is formed in the shape of a single closed curve so as to surround the area 115 corresponding to the main image 112. The shape of the window 114 may be the same as that of the main image 112, and it is preferable that the shape of the window 114 has a rectangular shape as shown in FIGS.

A control area 113 according to an embodiment of the present invention is a panorama view that shows, as an image, the entire range that the camera 2 can shoot, as shown in Fig. Panorama View is an image obtained by taking a long image in one direction rather than a normal image, in order to capture many scenes in one image. If the camera 2 is a 360-degree camera, the angle of view is very wide, so it is possible to photograph the panoramic view in real time. Therefore, the panoramic view can be another live view that is different from the live view of the main video 112 displayed on the screen unit 11. [ In this case, the user can monitor the entire view angle in real time through the panorama live view as well as monitor the real time by limiting to a specific angle of view through the live view of the main image 112.

If the camera 2 is a pan / tilt camera, it is not easy to take a panoramic view in real time. Therefore, the panoramic view can be obtained by synthesizing a plurality of images obtained by panning or tilting the camera 2 in a long length. Then, the obtained panoramic view becomes a static photograph, not a live view. In this case, the user can only monitor in real time through the live view of the main image 112. However, a panoramic view as a static photograph can also easily allow the user to grasp an area where the user wants to panning or tilting the image.

If the camera 2 does not provide the panoramic view photographing function, the control area 113a according to the other embodiment of the present invention may be configured such that the entire range that the camera 2 can photograph is displayed on the scroll bar . Also in this case, if the user monitors the main image 112 and inputs a command to the control area 113a, it is possible to easily perform panning or tilting of the image.

In FIG. 3, the camera 2 is shown as being capable of both panning and tilting. However, only one of panning and tilting may be possible depending on the function of the camera 2. FIG. In Fig. 4, although the camera 2 is shown as being capable of only panning, both panning and tilting may be possible depending on the function of the camera 2. [ That is, the control area 113 according to the embodiment of the present invention can be changed into various forms depending on whether the panning or tilting function of the camera 2 is provided.

On the other hand, although not shown in the drawings, The user can change the magnification of the displayed main image 112 such as Zoom In or Zoom Out. When a user performs a pinch-out operation on the main image 112 using two fingers, the displayed image is zoomed in. When the user performs a pinch-in operation, It can be zoomed out. Here, the pinch is one of the touch gestures, and refers to sliding in the direction opposite to each other while maintaining the touch of the two fingers on the screen portion 11. [ In general, a pinch is used to adjust the magnification of the screen displayed on the screen unit 11. [ If the two fingers are slid in a direction approaching the distance, it is referred to as a pinch-in or a pinch-close, and at this time, the image is preferably reduced. On the other hand, if the two fingers are slid in the direction in which the distance between the two fingers is increased, it is referred to as a pinch-out or a pinch-open.

Alternatively, the main image 112 may be zoomed in when a tab is performed on the main image 112 on the screen unit 11. FIG. When the user performs a double tap operation, the main image 112 can be zoomed out. At this time, it is preferable that the main image 112 is zoomed in or zoomed out based on a point where the user performed a tab or a double tab.

Alternatively, if the user performs a double-tap on the main image 112 on the screen unit 11, the main image 112 may be zoomed in or out. In this case, when a double-tab is performed on a zoomed-in image, a zoom-out occurs. When a double-tab is performed on a zoomed-out image, It may be a zoom in. At this time, since the magnification is not changed stepwise, two magnifications, that is, a zoom-in magnification and a zoom-out magnification, are preset.

If the user can input a command via the mouse to the monitoring device 1, the mouse cursor over the main image 112 using the mouse and scrolls the mouse wheel upward or downward, The main image 112 may be zoomed in or zoomed out. Alternatively, a plurality of separate menus are provided, and when the user selects the zoom-in or zoom-out menu, the main image 112 may be zoomed in or zoomed out each time the mouse is clicked .

FIG. 5 is a diagram illustrating a method of performing a drag operation on the main image 112 according to an exemplary embodiment of the present invention. FIG. 6 is a view illustrating a state in which the main image 112 is panned Fig.

Drag refers to one of the touch gestures, in which a specific object is drawn from one point to another point in order to move a specific object on the screen.

In the screen section 11 of the monitoring apparatus 1, a main image 112 such as a live view or a playback is displayed. At this time, in order to perform dragging as shown in FIG. 5, the user touches the main image 112. Then, the main image 112 is dragged from one point to another point. Then, the main image 112 is displayed as panned or tilted as shown in FIG. At this time, in order to drag the main image 112, the user must keep the touch. At the same time, the window 114 indicating the area 115 corresponding to the main image 112 in the control area 113 also moves as shown in Fig. That is, when the main image 112 is displayed by being panned or tilted, the window 114 is moved in the control area 113 to indicate the area 115 corresponding to the panned or tilted main image 112 do.

If the main image 112 is panned or tilted to display a desired area, the held touch is released. If the desired area can not be panned or tilted with only one drag, the above process is repeated. If the user can input a command through the mouse to the monitoring apparatus 1, the main image 112 can be panned or tilted by dragging the main image 112 with the mouse.

FIG. 7 is a view showing a state in which a drag operation is performed on a window 114 according to an embodiment of the present invention. FIG. 8 is a view illustrating a state in which a main image 112 is panned Fig.

The user can panning or tilting the main image 112 by moving the window 114. [ The user touches the area 115 in the window 114 to perform a drag as shown in Fig. Then, the region 115 in the window 114 is dragged from one point to another point. Then, in the control area 113, the window 114 moves as shown in Fig. At this time, in order to drag the area 115 in the window 114, the user must keep the touch. At the same time, the main image 112 is also panned or tilted as shown in Fig. That is, when the window 114 is moved in the control area 113, the main image 112 is panned or tilted to the image corresponding to the area 115 in the moved window 114 and displayed.

If the main image 112 is panned or tilted to display a desired area, the held touch is released. If the desired area can not be panned or tilted with only one drag, the above process is repeated. If the user can input a command through the mouse to the monitoring apparatus 1, the main image 112 can be panned or tilted by dragging the area 115 within the window 114 with the mouse.

Further, although not shown in the drawing, the user may panning or tilting the main image 112 by performing a tab at an arbitrary position in the control area 113. The tab Tab is one of the touch gestures and means to release the touch immediately after briefly touching the screen 11.

9 is a view showing an alarm sounding to the pointer 116 according to an embodiment of the present invention.

A sensor 3 may be installed around the camera 2. In the control area 113 of the monitoring device 1, a pointer 116 is displayed at a position corresponding to the position where the sensor 3 is installed. It is preferable that a GPS is mounted on the sensor 3 so that the monitoring device 1 can grasp the position of the sensor 3 directly.

As described above, when the sensor 3 senses the occurrence of a specific event, it generates an event detection signal and transmits it to the monitoring device 1. When the communication unit 12 of the monitoring device 1 receives the event detection signal, an alarm sounds to the pointer 116 corresponding to the sensor 3 as shown in FIG. The alarm may be generated by lighting a specific color, for example, red light, on the pointer 116, or may be generated by repeating the light with a predetermined period. The alarm may include an alarm for the sound as well as an alarm for the light, or may cause the monitoring device 1 itself to vibrate. That is, the alarm can use various methods if the user can confirm whether the event has occurred or not.

Meanwhile, the pointer 116 may be always displayed irrespective of whether an event has occurred or may be displayed while an alarm is generated when an event occurs. The pointer 116 may have a transparent circle shape as shown in FIG. 9. However, if the user can easily grasp the position where the sensor 3 is installed and whether or not an alarm is generated, the pointer 116 may have various shapes and colors Lt; / RTI >

FIG. 10 is a view showing a state in which an image directed to the sensor 3 corresponding to the pointer 116 of FIG. 9 is displayed.

As described above, when the sensor 3 senses an event, the pointer 116 generates an alarm. At the same time, the main image 112 may be automatically panned or tilted so as to face the sensor 3 that senses the event, as shown in FIG.

If the camera 2 is a pan / tilt camera, since the camera 2 itself performs panning or tilting, the process of panning or tilting the image is displayed on the screen 11 as it is. However, if the camera 2 is a 360 [deg.] Camera, the camera 2 has already acquired images for all directions. And panning or tilting is performed through the software installed in the monitoring apparatus 1. [ Accordingly, an image directed to the sensor 3 can be displayed on the display unit 11, omitting the process of panning or tilting the image.

An alarm sounds at the pointer 116 displayed in the control area 113, so that the user can easily check whether an event has occurred. Further, the main image 112 is automatically panned or tilted toward the sensor 3 that senses the event, so that the user can easily monitor the contents of the generated event.

At the same time, the window 114 indicating the area 115 corresponding to the main image 112 in the control area 113 is also moved. That is, when the main image 112 is displayed by being panned or tilted, the window 114 is moved in the control area 113 to indicate the area 115 corresponding to the panned or tilted main image 112 do.

FIG. 11 is a diagram showing a plurality of pointers 116 when a plurality of sensors 3 according to an embodiment of the present invention are displayed.

A plurality of sensors 3 may be provided in the vicinity of the camera 2. In this case, in the control area 113 of the monitoring apparatus 1, a plurality of pointers 116 are displayed at respective positions corresponding to the positions where the plurality of sensors 3 are installed.

Since the sensor 3 and the pointer 116 correspond to each other, the number of the sensors 3 and the number of the pointers 116 are the same. Therefore, since four pointers 116a, 16b, 116c, and 116d are shown in the control area 113 in FIG. 11, four sensors 3 are installed in the periphery of the camera 2. However, in the embodiment of the present invention, the number of the sensors 3 and the number of the pointers 116 is not limited and may be variously formed.

FIG. 12 is a view showing a state in which an alarm is sounded in the first pointer 116a among the plurality of pointers 116 in FIG. 11, FIG. 13 is a diagram showing a state in which the first pointer 116a in FIG. 12 is selected And FIG. 14 is a view showing a state in which an image directed to the first sensor corresponding to the first pointer 116a of FIG. 12 is displayed.

 When the first sensor detects the occurrence of a specific event among the plurality of sensors 3, it sends an event detection signal to the monitoring device 1, and as shown in FIG. 12, the first pointer 116a.

In this case, the image may be automatically panned or tilted as described in the description of FIGS. 9 and 10. FIG. However, according to another embodiment of the present invention, the user may directly select the first pointer 116a as shown in FIG. The panning or tilting of the image may be performed automatically or may be performed by the user's choice, which may vary depending on the user's setting.

When the user selects the pointer 116, if the monitoring device 1 provides the touch function, the pointer 116 can be selected by performing a tab. If the user can input a command through the separate input unit such as a mouse to the monitoring apparatus 1, the pointer 116 may be clicked to select the pointer. That is, if the user can select the pointer 116, various methods can be performed without limitation.

When the first pointer 116a is alarmed, the main image 112 is panned or tilted toward the first sensor automatically or by user's selection as shown in FIG.

At the same time, the window 114 indicating the area 115 corresponding to the main image 112 in the control area 113 is also moved. That is, when the main image 112 is displayed by being panned or tilted, the window 114 is moved in the control area 113 to indicate the area 115 corresponding to the panned or tilted main image 112 do.

FIG. 15 is a diagram showing how alarms are simultaneously sounded on the first to third pointers 116a, 116b, and 116c among the plurality of pointers 116 of FIG.

The plurality of sensors 3 are installed independently of each other. Therefore, the plurality of sensors 3 may simultaneously detect occurrence of an event. When the first to third sensors detect the occurrence of a specific event among the plurality of sensors 3, they transmit an event detection signal to the monitoring device 1, respectively. As shown in FIG. 12, the first to third pointers 116a, 116b, and 116c corresponding to the first to third sensors are alarmed. Here, the first to third sensors generate the same event and can detect the event at the same time, but separate events may be separately generated to detect them separately.

16 to 18 show the first to third images 112a, 112b and 112c directed to the first to third sensors corresponding to the first to third pointers 116a, 116b and 116c in Fig. 15, FIG.

The first image 112a facing the position where the first sensor is installed, the second image 112b facing the position where the second sensor is installed, and the third image 112c facing the position where the third sensor is installed are different images. However, if the alarms are simultaneously output to the first to third pointers 116a, 116b, and 116c, there are a plurality of images to be panned or tilted in the main image 112. Therefore, a method of displaying a plurality of first to third images 112a, 112b, and 112c on one screen unit 11 is needed.

If the image is panned or tilted by the user's selection, only the image corresponding to the pointer 116 selected by the user is displayed. In contrast, if an image is automatically panned or tilted, a so-called sequence view may be displayed in order of the first to third images 112a, 112b and 112c according to an embodiment of the present invention . More specifically, when the first to third pointers 116a, 116b, and 116c are alarmed, the first image 112a is displayed as the main image 112 first. The second image 112b is displayed on the main image 112 after a predetermined time, and the third image 112c is displayed on the main image 112 after a predetermined time. That is, the first to third images 112a, 112b, and 112c are sequentially switched at regular intervals and displayed as the main image 112. As described above, the panning or tilting of the image may be performed automatically or may be performed by the user's choice, which may vary depending on the setting by the user.

The user may assign a priority to each of the plurality of sensors 3. For example, if the user designates the priority of the first to fourth sensors, the third sensor as the first rank, the first sensor as the second rank, the fourth sensor as the third rank, and the second sensor as the fourth rank Respectively. At this time, as shown in FIG. 15, when the first to third pointers 116a, 116b, and 116c are alarmed, the first to third sensors detect the event. The third image 112c directed to the third sensor having the highest priority among the first to third sensors is displayed as the main image 112 as shown in FIG. Then, after a predetermined time, the first image 112a facing the first sensor having the second highest priority is displayed as the main image 112 as shown in FIG. Then, after a predetermined time, the second image 112b directed to the second sensor having the third highest priority is displayed as the main image 112 as shown in FIG. Here, the fourth sensor has a higher priority than the second sensor, but the fourth image directed to the fourth sensor is not displayed because an event is not detected.

Although not shown in the drawings, the user may designate importance for each of the plurality of sensors 3. For example, the user designates importance of the first to fourth sensors as Level 2 as the first sensor, Level 5 as the second sensor, Level 4 as the third sensor, and Level 3 as the fourth sensor. At this time, if the first to third pointers 116a, 116b, and 116c are alarmed, the first to third sensors detect the event. First, the first image 112a is displayed as the main image 112. Since the first sensor has a level of 2, the second image 112b is displayed as the main image 112 after being displayed for about 2 seconds. Since the second sensor has a level of 5, after displaying for about 5 seconds, the third image 112c is displayed as the main image 112. [ Since the level of the third sensor is 4, after displaying for about 4 seconds, the first image 112a is displayed again and the above process is repeated. Here, although the importance of the fourth sensor is also designated, the fourth image directed to the fourth sensor is not displayed because no event is detected.

That is, the user may designate the priority order for each of the plurality of sensors 3, or designate importance. If the user designates a priority order for each of the plurality of sensors 3, each image directed to the position where the plurality of sensors 3 are installed is displayed in the order of priority specified by the user. If the user designates importance for each of the plurality of sensors 3, the time at which each image is displayed depends on the importance of each sensor 3 designated by the user.

As described above, every time the main image 112 is panned or tilted, a window 114 indicating an area 115 corresponding to the main image 112 in the control area 113 is also moved.

FIG. 19 is a view showing a state in which thumbnails 117 are generated and images directed to the positions where the sensors 3 corresponding to the first to third pointers 116a, 116b, and 116c of FIG. 15 are installed are simultaneously displayed.

As described above, if the camera 2 is a 360 ° camera, the camera 2 has already acquired images for all directions. And panning or tilting is performed through the software installed in the monitoring apparatus 1. [ Therefore, even if the plurality of sensors 3 simultaneously detect the occurrence of an event, it is not necessary that the plurality of images are necessarily displayed in order as described in the description of FIG. 16 to FIG. That is, a plurality of images may be simultaneously displayed on one screen portion 11.

Specifically, according to another embodiment of the present invention, the camera 2 is a 360-degree camera and has already acquired images for all directions. At this time, when the plurality of sensors 3 simultaneously detect the occurrence of an event, the monitoring device 1 generates a thumbnail 117 including the divided images so as to correspond to the number of the sensors 3 that sensed the occurrence of the event It is automatically generated. The monitoring device 1 displays a plurality of images directed to the sensors 3 that sensed the occurrence of the event, in each of the divided images.

For example, as shown in FIG. 15, when the first to third pointers 116a, 116b, and 116c are alarmed, the first to third sensors detect an event. In this case, the image to be displayed is a total of three images including the first to third images 112a, 112b and 112c. The monitoring apparatus 1 automatically generates a thumbnail 117 including three divided images so that three images can be simultaneously displayed, as shown in FIG. In each of the divided images, the first to third images 112a, 112b and 112c are displayed. If the image to be displayed is four images, a thumbnail 117 including four divided images is generated. If the image to be displayed is six images, a thumbnail 117 including six divided images is generated.

As described above, the user may assign a priority to each of the plurality of sensors 3. For example, if the user designates the priority of the first to fourth sensors, the third sensor as the first rank, the first sensor as the second rank, the fourth sensor as the third rank, and the second sensor as the fourth rank Respectively. At this time, as shown in FIG. 15, when the first to third pointers 116a, 116b, and 116c are alarmed, the first to third sensors detect the event. The third image 112c directed to the third sensor having the highest priority among the first to third sensors is divided into the first divided image 117a having the largest size among the plurality of divided images as shown in FIG. Lt; / RTI > Secondly, the first image 112a directed to the first sensor having a higher priority is arranged on the second divided image 117b and the second divided image 117c as shown in FIG. 19, (117b). Third, the second image 112b, which is directed to the second sensor having a higher priority, is arranged in the middle of the third and fourth divided images 117b and 117c, And displayed on the image 117c. Here, the fourth sensor has a higher priority than the second sensor, but the fourth image directed to the fourth sensor is not displayed because an event is not detected.

As the thumbnail 117 is generated, the number of divided images corresponding to the number of images to be displayed is automatically determined. Also, the size and arrangement of the divided images are automatically determined according to the number of divided images, as previously set. When the priorities of the respective images are designated, a divided image to be displayed for each of the images is determined. In the above example, the higher the priority of the plurality of images, the larger the size of the divided images is displayed. If the sizes of the divided images are the same, the higher the priority, the more the displayed images are displayed on the divided images. However, the present invention is not limited thereto, and can be variously set according to the size and arrangement desired by the user. Accordingly, the thumbnail 117 may have the number, size, and arrangement of various divided images, and a plurality of images corresponding to the plurality of sensors 3 may be displayed in the various divided images.

Meanwhile, a thumbnail 117 including a plurality of divided images is generated in the main image 112, and a plurality of images can be simultaneously displayed. At this time, a plurality of windows 114a, 114b, and 114c indicating areas 115a, 115b, and 115c corresponding to the plurality of images in the control area 113 are displayed.

The third image 112c displayed in the first divided image 117a corresponds to the area 115c surrounded by the third window 114c in the control area 113. [ The first image 112a displayed in the second divided image 117b corresponds to the area 115a surrounded by the first window 114a in the control area 113. [ The second image 112b displayed in the third divided image 117c corresponds to the area 115a surrounded by the second window 114b in the control area 113. [ However, a plurality of divided images are formed, and a plurality of windows are also formed, so that the user can not easily match the respective images and windows.

Therefore, it is preferable to match the colors of the windows surrounding the divided images with the windows surrounding the corresponding regions. That is, the border of the first divided image 117a and the third window 114c are the same in color, the border of the second divided image 117b and the color of the first window 114a are the same, It is preferable that the border of the divided image 117c and the second window 114b have the same color.

It will be understood by those skilled in the art that the present invention may be embodied in other specific forms without departing from the spirit or essential characteristics thereof. It is therefore to be understood that the above-described embodiments are illustrative in all aspects and not restrictive. The scope of the present invention is defined by the appended claims rather than the detailed description and all changes or modifications derived from the meaning and scope of the claims and their equivalents are to be construed as being included within the scope of the present invention do.

1: Monitoring device 2: Camera
3: Sensor 10: Body
11: Screen section 12: Communication section
13: storage unit 14: control unit
111: touch sensor 112: main image
113: control area 114: window
116: Pointer 117: Thumbnail
141: Gesture detection unit 142: Coordinate transformation unit

Claims (6)

A communication unit for receiving image data acquired by the camera and a signal generated by the sensor;
A storage unit for storing the image data and information about the signal;
A screen for displaying the transmitted image; And
And a control unit for controlling operations of the communication unit, the storage unit, and the screen unit,
The display unit includes:
A control area capable of panning or tilting the image is displayed around the displayed image,
A pointer indicating a position where the sensor is installed is displayed in the control area,
When the sensor detects an event, an alarm is sounded on the pointer corresponding to the sensor that sensed the event,
And displays the image directed to the sensor that sensed the event. The method according to claim 1,
When the pointer corresponding to the sensor that senses the event is selected,
The display unit includes:
And displays the image directed to the sensor corresponding to the selected pointer. The method according to claim 1,
The sensor includes:
A plurality of electrodes,
When the plurality of sensors simultaneously detect the occurrence of the event,
The display unit includes:
And sequentially displays each image directed to the plurality of sensors. The method of claim 3,
If a priority is assigned to each of the plurality of sensors,
The display unit includes:
And displays each image directed to the plurality of sensors in the designated priority order. The method of claim 3,
If importance is set for each of the plurality of sensors,
The display unit includes:
And the display time of each of the images is different according to the set importance. The method according to claim 1,
The camera comprises:
360 ° camera,
The sensor includes:
And is formed in plural,
When the plurality of sensors simultaneously detect the occurrence of the event,
The display unit includes:
Generating thumbnails including a number of divided images corresponding to the number of the plurality of sensors that have detected the occurrence of the event,
And displays each image directed to the plurality of sensors through the generated thumbnail.

Images