KR101838957B1 - Video surveillance system for integrated display of analog sensor data - Google Patents

Abstract

Disclosed is a video surveillance system to integrally display an image of analog sensor data, capable of displaying a graph type data trend at the same time when displaying an image on a monitor. According to the present invention, the system comprises: a data collection unit to receive analog and digital data from an analog sensor and an external measurement device, respectively; a camera module unit to collect video data; a data processing unit processing the video data and synthesizing the processed video data with the analog data and digital data to output synthesized data; and a camera unit including a communication unit to transmit the data synthesized by the data processing unit to a central control center; and the central control center receiving the analog data, the digital data, the video data, and the synthesized data through the communication unit to monitor the received data, and including viewer software to manage configuration of the data collection unit, camera module unit, and data processing unit to output the synthesized data.

Description

[0001] The present invention relates to a video surveillance system for integrated display of analog sensor data,

The present invention relates to a video surveillance system, and more particularly, to a video surveillance system in which analog data is displayed on an image by a conversion coefficient, a data display criterion, and an event display criterion set by viewer software of a central control center.

As a board that compresses and processes an image, the image data must be processed after compression because it is very large in size compared to other media data. In the compression method, the image is converted by wavelet transformation, M-JPEG, The image processing board is composed of DSP chip, memory, external storage device, MCU, TCP / IP chip, etc., and the DSP chip is used for processing signal processing professionally. It is a chip designed in structure. The external storage device is a storage memory that stores data of an external device, stores the data in a database (DATABASE), and can display the data in a graphical data trend. The MCU preprocesses the external input / output data and transfers it to the CPU so that data characters and trends can be displayed together with the image.

Recently, a video surveillance apparatus is required to display not only an image but also various data such as pressure, water level, and water quality on a video monitor in real time. As the use of multimedia increases, the images used in the Internet and digital devices also require high quality images. In addition, there is no image processing board that processes video display function and functions to control external devices such as buzzer, PLC, broadcasting device, etc., There is no image processing board that can store data of the device and display it as data trend.

KR 10-2004-0026082 KR 10-1296815

The present invention can be applied to an external input / output port, that is, a digital input (Digital Input), a digital output (Digital Output), and an analog input (Analogue Input: 4-20mA input) , A LAN (Local Area Network) port, an audio port, and the like, directly from a camera unit.

It is another object of the present invention to provide a video surveillance system in which data input to an external input / output port is directly DATABASEized into a memory of a camera unit and the data trend of a graph format is displayed together when the data is displayed on a monitor do.

It is another object of the present invention to provide a video surveillance system capable of setting conversion coefficients for measurement value conversion on sensors in the field, setting event detection standards for analog data and digital data event detection, .

According to another aspect of the present invention, there is provided an image processing apparatus including a data collecting unit for receiving analog data and digital data from an analog sensor and an external measuring apparatus, a camera module unit for collecting image data, And a communication unit for transmitting data synthesized by the data processing unit to a central management center; A central control center including viewer software for receiving and monitoring analog data, digital data, image data, and composite data through the communication unit and setting and managing data collection units, camera module units, and data processing units for composite data output; And a video surveillance system for video-integrated presentation of analog sensor data.

Here, the viewer software may include a conversion coefficient setting function for setting measurement value conversion of analog data.

In addition, the viewer software may include an event detection reference setting function for analog data event detection and digital event detection.

In addition, the viewer software may include an analog data to be combined with the image data, a digital data representation image creation function, an analog data event to be synthesized with the image data, and an image expression criterion setting function for generating the digital data event expression image.

In addition, the viewer software may include a graph display criterion setting function for generating a graph image of the analog data and the digital data to be combined with the image data.

In addition, the viewer software may include an analog data and a digital data representation image to be synthesized in the image data, and an image display criterion setting function for generating an analog data event to be combined with the image data and a digital data event expression image, And generating the analog data event and the digital data event display image according to the image display criterion by the image display criterion setting function.

Meanwhile, the data collection unit of the video surveillance system includes an ADC converter for converting a signal of the analog sensor into a digital signal; A GPIO port for interfacing with the viewer software to receive an electrical input or to control an external sensor as an output; An RS 485 port for receiving digital data from the external measurement device; An RS232 port for communication with the data processing unit and for communication with the viewer software; And an MCU connected to the ADC converter, GPIO port, RS485 port, and RS232 port to process data and to execute control commands of the viewer software.

Also, the data processing unit may include an RS232 port for receiving the analog data and the digital data or for transmitting a control command of the viewer software; CMOS and ISP for Image Processing; A memory for storing setting information of data storage and viewer software; An encoder including a compression function of image data; A GPU for synthesizing the analog data and the digital data with the image data; And a CPU connected to the RS232 port, the ISP, the memory, the encoder, and the GPU for performing synthesis of the analog data and the digital data and the image data according to the control command of the viewer software.

The present invention can be applied to an external input / output port, that is, a digital input, a digital output, an analog input (4-20 mA input), an RS-485 communication port, Port, and audio (audio) port of the camera to be processed directly by the camera unit, there is no need to negotiate different specifications for each NVR company.

In addition, a port for controlling data output (D / O (data out)), contact output, alarm, etc. for controlling an external measuring instrument, a data input (D / I (data in) 4-20mA input, etc.) is preprocessed by MCU and transferred to CPU, external input data received from various ports with RS-485 communication port, LAN (LAN) port, The administrator can easily grasp the data such as the water level, the pressure, and the temperature, thereby providing a method of efficiently controlling the external system.

And it can monitor the camera part with data trend from data to graph in graph format, so that the manager can easily and quickly detect danger or warning and has an advantage of easy control.

In addition, the present invention can set the conversion coefficient for the measurement value conversion for the sensors in the field, the event detection reference setting for analog data and digital data event detection, and the image display reference setting at a remote site, / RTI >

1 is a configuration diagram of a video surveillance system according to the present invention;
2 is a diagram illustrating a data processing process for integrating and displaying images of analog sensor data according to the present invention.
3 is a view illustrating a reference setting process for integrating and displaying images for analog sensor data according to the present invention.
4 is a view illustrating a user interface of viewer software for integrating and displaying images of analog sensor data according to the present invention;
FIG. 5 is a flowchart illustrating a data processing process for integrating and displaying an image of a change in analog sensor data according to an exemplary embodiment of the present invention.
FIG. 6 is a diagram illustrating a reference setting process for image integration and display for a change in the analog sensor data according to the present invention; FIG.
7 is a view illustrating a user interface of viewer software for image integration and display of a change of analog sensor data according to the present invention.

DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS Reference will now be made in detail to the preferred embodiments of the present invention, examples of which are illustrated in the accompanying drawings.

A video surveillance system (hereinafter referred to as a video surveillance system) for video-integrated presentation of analog sensor data according to the present invention includes a data collecting unit for receiving analog data and digital data from an analog sensor 1 and an external measuring device 20 A data processor 30 for synthesizing and outputting the image data, the analog data and the digital data, and a data processor 30 for synthesizing the analog data and the digital data, A camera unit 40 including a communication unit 37 for transmitting data to a central management center, and a controller 40 for receiving and monitoring analog data, digital data, image data, and composite data through the communication unit 37, The viewer software 51 for setting management of the data collecting unit 10, the camera module unit, and the data processing unit 30 is provided Bidoen includes a central control center (50).

The camera unit 40 may be installed near the site where the water level, the temperature, the water quality, the pressure sensor, and the like are installed, and the central control center 50 may be remotely located based on the site. Also, the camera unit 40 may be provided in a plurality of units to check the level, temperature, water quality, and pressure of different sites, and the sensors connected to each of the camera units 40 may be different.

The viewer software 51 includes a conversion coefficient setting function for setting measurement value conversion of analog data, an event detection reference setting function for analog data event detection and digital event detection, analog data to be combined with image data, An image display criterion setting function for generating an analog data event to be combined with the image data and a digital data event display image, and a graph display criterion setting function for generating a graph image of the analog data and digital data to be combined with the image data .

The viewer software 51 includes a function of generating analog data and a digital data representation image to be combined with the image data and an image data presentation criterion for generating an analog data event to be combined with the image data and a digital data event expression image, The generation of the graph image of the analog data and the digital data to be combined with the image data and the generation of the analog data event and the digital data event expression image according to the image display criterion by the image display criterion setting function can be synchronized.

The data collecting unit 10 includes an ADC converter 11 for converting a signal of an analog sensor into a digital signal, a GPIO port 12 for receiving an electrical input in conjunction with the viewer software 51 or controlling an external sensor as an output, An RS 485 port 13 for receiving digital data from the external measuring instrument 20 and an RS232 port 14 for communicating with the data processing unit 30 and the viewer software 51, And an MCU 15 connected to the converter 11, the GPIO port 12, the RS485 port 13 and the RS232 port 14 to process data and execute control commands of the viewer software 51. [

The data processing unit 30 includes an RS232 port 31 for receiving the analog data and the digital data or transmitting a control command of the viewer software 51, a CMOS 32 and an ISP 33 for image processing, A memory 34 for storing setting information of the data storage and viewer software 51, an encoder 36 including a function of compressing image data, a GPU 35 for synthesizing the analog data and the digital data, And the GPU 35 are connected to the RS232 port 31, the ISP 33, the memory 34, the encoder 36, and the GPU 35 to generate analog data and digital data and image data And a CPU 38 for performing synthesis of the image data.

Specifically, the camera unit 40 of FIG. 1 includes a port for controlling a data output, a contact output, and an alarm for controlling the sensors 1, 2, and 3 and the external measurement device 20, It has RS-485 communication port, LAN port and audio port to control data input, analog input (4-20mA input, etc.), PLC (Programmable Logic Controller) Of various protocols. In other words, it supports RS485 communication with external measuring instrument PLC, various protocols (LS Industrial Communication, MOD Bus, etc.) by LAN communication, and the display contents are only red, black, green (Text only flickers), the text is silent with the specified color, and the entire screen blinks with the specified color (the entire screen is flickered). Can be displayed separately.

The image compression design method by the camera unit 40 includes the steps of (a) compressing a signal received from the camera lens using the CMOS 32, the ISP 33, and the encoder 36, (b) (C) the MCU 15 preprocesses the analog / digital data received from the external input / output port and transfers the preprocessed analog / digital data to the CPU 38 so that the SD (34) connected to the CPU 38 (D) synthesizing data characters and trends on the image through the GPU 35 and the CPU 38 using such a database, and displaying them on the monitor of the central control center have.

Here, the ISP (Image Signal Processor) performs two functions in the camera moving picture shooting mode. One of the two functions is to convert the raw data (Mosaic Raw Data) sensed by the CMOS 32 into RGB data for display on a display device such as an LCD, and the other is to store the RGB data (Such as MPEG-4, H.264, H.265, etc.) after converting the data into YCbCr data that can be compressed for compression. The CPU 38 controls the ISP 33 via an I 2 C (Inter-Integrated Circuit) / SPI (Serial Peripheral Interface), and the ISP 33 controls the CMOS 32 according to an inputted command. The video signal output from the ISP 33 is transmitted through a parallel interface (I / F) or a mobile industry processor interface (MIPI) which is a high-speed serial interface. The ISP 33 also transmits video information processed by the video signal to the CPU 38 or the baseband chip through a parallel interface or MIPI.

ISP 33 may also be recently stacked with a memory (e.g., DRAM) in a chip for post processing. Post processing may include, for example, Still DIS, Motion DIS , A CPS, a face detection, a smile / blink detection, a digital zoom, a thumbnail and a jpeg corresponding to one Vsync, image rotation, and the like as a frame memory for such a process. Recently, a high-speed serial interface, MIPI, can be applied in order to enable a large-capacity image transmission in a certain time as the CMOS 32 is gradually increased to 8M / 12M / 13M / 16M pixels.

Encoder 36 is very popular among recent video codecs and may be the notable H.264. H.264 is the most common format for recording, compressing and distributing high-definition video, with very high data compression efficiency. The Video Coding Experts Group (VCEG) of the ITU-T and the Moving Picture Experts Group (MPEG) of the ISO / IEC have jointly formed the Joint Video Team (JVT) It is a result of progress. Therefore, H.264 of ITU-T and MPEG-4 Part 10 of ISO / IEC are the same name and technically perfect standard.

In addition, H.264 uses a profile @ level system and has about 28 profiles and about 17 levels available, and that type continues to expand. This phenomenon is expected to continue until HEVC, which is being developed as a next generation video codec, will be used as mainstream. The most popular ones are a low power profile such as mobile broadcasting, a baseline profile suitable for low resolution, a main profile made up of techniques for maximizing the compression rate, a high profile for higher quality video, There are four types of extended profiles to which environment-friendly technologies are added.

The viewer software 51 for controlling the camera unit 40 may input a digital value to an external device control contact and input data with an analog value. For example, when the value of the submerged bridge level 5m is inputted as an analog value on the set-up screen of the viewer software 51, this data is converted into a digital value by the ADC converter 11 in the camera section 40, Signal to display the text of the submergence bridge level 5m along with the image on the monitor of the central control center 50. [

Also, if the channel 1 is set to a high level of submerged bridge and an alarm should be given, if the digital value is input, the submergence level HIGH is flickered in red. In addition, the water level of the submerged bridge is categorized as "H" (high water level first warning), HH (second water level warning), L (low water level first warning) and LL (low water level second warning) In case of LL, it is possible to give flickering (flickering) and send a warning message to the mobile phone from the manager or the like. Also, flickering may flicker the entire screen or only flicker characters.

In addition, analog or digital data such as water level, temperature, and pressure processed together with the collected image of the monitoring area are stored in the database in the SD 34, and the database is displayed in a character or graph format data trend with the image, 50). The contents displayed on the screen include a database of various situations such as water level, temperature, pressure, etc., along with the image. When a character is displayed on the image, the character of the character, the unit of the phrase value, the position of the text on the screen, In the case of warning, the display may be flickering with the specified color, or the character may be flickering with the specified color and the entire screen blinking with the designated color of color or black and white. It is displayed as one, and the data phrase, unit, and color of the data can be displayed by the administrator when displaying the database of the various situations in the image by the data trend of the graph format. Also, if you move the bar of the trend displayed in the image at the desired time, the value of the trend of the moved bar is displayed. After checking the data, the data value located on the bar is automatically disappears. Flickering, or characters are displayed in any one of the following cases: the display is kept in the specified color, and the entire screen is flickering in a color or a black and white designated color.

A program method of setting a display method of displaying data characters and graph type data trends on the image is composed of general, data analog, data digital input, and digital output.

The address of the selected camera unit 40 is the network address of the selected camera unit 40 and the protocol of the camera unit 40 is LSIS, (Communication) can be selected from RS-232, RS485, LAN communication, and communication port (Comm. Port) can be selected. The IP address of the camera is the IP address of the camera, the history of the history of the camera is Live or the history to retrieve the previous data. The date can be selected for the previous data search, and the search date and time period can be selected for the period.

In the case of analog, Enable indicates the use of the display data, String indicates the data name, Measure indicates the data unit, X axis indicates coordinates of the X axis on which characters are displayed on the screen, and Y axis indicates characters on the screen The coordinates of the Y axis to be plotted, the size of the character, the color of the character, the display status of Text or Trend, and the minimum range of the data. The maximum range of the data is displayed as the maximum value of the data and the display time is expressed as the time at which the time domain X coordinate is set among the trend coordinates when the trend is displayed.

The X-axis is the coordinate of the X-axis on which characters are to be displayed on the screen. The Y-axis is the coordinate of the Y-axis on which characters are displayed on the screen The size of the character, the color of the character, the color of the character, the effect, the alarm method (fast blinking, slow blinking, blinking), and the display status Select Text or Trend, and display time is expressed by the time at which the time domain X coordinate is set in the trend coordinate when the trend is displayed.

The X axis is the coordinate of the X axis on which characters are to be displayed on the screen. The Y axis is the coordinate of the Y axis on which characters are displayed on the screen. (Size), size (color), color (color), effect (color) of the character, and alarm method (fast blinking, slow blinking, blinking) And a function of allowing a manager to arbitrarily set a program for selecting control of the control system from on / off (ON / OFF).

2 is a diagram illustrating a data processing process for integrating and displaying images of analog sensor data in a video surveillance system having such a configuration.

The analog and digital data are received through the data receiving unit 10 and the measurement value is converted (e.g., voltage → measurement unit) by the conversion coefficient set by the viewer software 51, (E.g., LS Industrial Protocol, Modbus protocol), detects analog and digital data events according to the analog and digital data event detection criteria set by the viewer software 51, Generates a data expression image and an event display image according to the image display criterion set by the control unit 51, synthesizes and compresses the image collected by the camera unit 40, the data display image and the event display image, (50).

FIG. 3 is a diagram illustrating a reference setting process for integrating and displaying images for analog sensor data. A user can set a conversion coefficient, a data expression criterion, and an event expression criterion using the viewer software 51. FIG. The set values are transmitted to the camera unit 40 through the web server, and the received setting values are used for receiving CGI setting information and transmitting a message to the data process, receiving setting data management process setting, storing setting data, Are processed in the camera unit 40 in order.

FIG. 4 is a view showing a user interface of viewer software for integrating and displaying images of analog sensor data according to the present invention, and provides real-time images, setting modes, and the like. In the setting mode, a conversion coefficient setting function for analog data measurement value conversion setting, an event detection reference setting function for analog data event detection and digital event detection, analog data and digital data expression image to be synthesized to image data, An image display criterion setting function for generating an analog data event to be synthesized and a digital data event display image, and a graph display criterion setting function for generating a graph image of the analog data and digital data to be synthesized in the image data.

In addition, analog or digital data such as water level, temperature, and pressure processed together with the collected image of the monitoring area are stored in the database in the SD 34, and the database is displayed in a character or graph format data trend with the image, 50). The contents displayed on the screen include a database of various situations such as water level, temperature, pressure, etc., along with the image. When a character is displayed on the image, the character of the character, the unit of the phrase value, the position of the text on the screen, In the case of warning, the display may be flickering with the specified color, or the character may be flickering with the specified color and the entire screen blinking with the designated color of color or black and white. It is displayed as one, and the data phrase, unit, and color of the data can be displayed by the administrator when displaying the database of the various situations in the image by the data trend of the graph format. Also, if you move the bar of the trend displayed in the image at the desired time, the value of the trend of the moved bar is displayed. After checking the data, the data value located on the bar is automatically disappears. Flickering, or characters are displayed in any one of the following cases: the display is kept in the specified color, and the entire screen is flickering in a color or a black and white designated color.

FIG. 5 is a diagram illustrating a data processing process for integrating and displaying an image of a change in the analog sensor data according to the present invention. The analog and digital data are received through the data receiving unit 10 and the measurement value is converted (e.g., voltage → measurement unit) by the conversion coefficient set by the viewer software 51, (Eg, LS Industrial Protocol, Modbus protocol), stores the data by time / sensor, establishes a sensor data change database, and displays the graphs set by the viewer software 51 A graph image is generated according to a criterion, and the synthesized image and the graph image collected by the camera unit 40 are compressed and transmitted to the central control center 50.

FIG. 6 is a diagram illustrating a reference setting process for integrating and displaying images according to the present invention. FIG. 7 is a flowchart illustrating a process of setting up and displaying images according to an exemplary embodiment of the present invention. The user interface of the viewer software is shown in detail. In the detailed process, the conversion standard setting, the data presentation standard setting, and the event display standard setting are replaced with the graph standard reference setting, the standard for the image integration and display of the analog sensor data Similar to the setup process. The graph display menu of the viewer software 51 can display a separate graph for each sensor or display values of all the sensors on one graph. In addition, the position, size, legend, title, and axis characters to be displayed on the screen for each sensor can be set. In addition, you can set the display condition of analog sensor input graph. At this time, you can set display status, X axis display range, Y axis display range, title size, axis character size, legend size, color and so on.

While the invention has been shown and described with reference to certain preferred embodiments thereof, it will be understood by those of ordinary skill in the art that various changes in form and details may be made therein without departing from the spirit and scope of the invention as defined by the appended claims. Will be possible.

Therefore, the scope of the present invention should not be limited to the described embodiments, but should be determined by equivalents to the appended claims, as well as the following claims.

10: Digital collecting section
20: External measuring instrument
30: Digital processor
40:
50: Central Control Center
51: Viewer Software

Claims (8)

A data collecting unit for receiving analog data and digital data from an analog sensor and an external measuring instrument, respectively,
A camera module unit for collecting image data,
A data processor for synthesizing and outputting the image data processed and processed, the analog data and the digital data,
A camera unit including a communication unit for transmitting data synthesized by the data processing unit to a central management center;
A central control center including viewer software for receiving and monitoring analog data, digital data, image data, and composite data through the communication unit and setting and managing data collection units, camera module units, and data processing units for composite data output; / RTI >
The viewer software of the central control center
A conversion coefficient setting function for setting measurement value conversion of analog data, an event detection reference setting function for analog data event detection and digital event detection, analog data to be combined with image data and digital data representation image generation, A graphical display criterion setting function for generating a graphical image of the analog data and the digital data to be combined with the image data; And generating a graph image of the analog data and the digital data and synchronizing the generation of the analog data event and the digital data event presentation image according to the image presentation criterion by the image presentation criterion setting function,
The data processing unit includes a function of converting raw data sensed by CMOS into RGB data for display on a display device, a function of converting the RGB data into compressible YCbCr data and then converting the data into a standard image compression format and,
The value set in the viewer software is transmitted to the camera unit via the web server. The received setting value is used for receiving CGI setting information and transmitting a message to a data process, setting data management process setting reception, setting data storage, sensor and image processing And the reference update is performed in the camera unit in that order .
delete delete delete delete delete The method according to claim 1,
The data collector includes an ADC converter for converting a signal of the analog sensor into a digital signal;
A GPIO port for interfacing with the viewer software to receive an electrical input or to control an external sensor as an output;
An RS 485 port for receiving digital data from the external measurement device;
An RS232 port for communication with the data processing unit and for communication with the viewer software; And
An MCU connected to the ADC converter, the GPIO port, the RS485 port, and the RS232 port to process data and execute control commands of the viewer software;
And displaying the analog sensor data on the display unit.
8. The method of claim 7,
The data processing unit
An RS232 port for receiving the analog data and the digital data or for transmitting control commands of the viewer software;
CMOS and ISP for Image Processing;
A memory for storing setting information of data storage and viewer software;
An encoder including a compression function of image data;
A GPU for synthesizing the analog data and the digital data with the image data;
A CPU connected to the RS232 port, the ISP, the memory, the encoder, and the GPU for performing synthesis of analog data, digital data, and image data according to a control command of the viewer software;
A video surveillance system for video integrated presentation of analog sensor data.

Images