KR101564095B1 - Sensor Network System Complex Sensor Module - Google Patents

Abstract

The present invention relates to a sensor network system using a composite sensor module that combines input image data and other sensing data via an image sensor and one or more additional sensors, and more particularly to an image sensor unit An additional sensor stage including at least one sensor for collecting environmental data of the environment and an image processing unit for receiving image data collected through the image sensor unit and performing image processing, And a sensor control chip unit for outputting combined environmental data through an additional sensor unit.
According to the sensor network system using the hybrid sensor module of the present invention as described above, the image data through the image sensor is received, and the image data and one or more additional sensing data are received based on the microcontroller unit It is possible to measure and collect surrounding information.

Description

A sensor network system using a complex sensor module {Sensor Network System Complex Sensor Module}

The present invention relates to a sensor network system using a complex sensor module, and more particularly to a sensor network system using a complex sensor module that combines input image data and other sensing data through an image sensor and one or more additional sensors will be.

In general, an image recognition technology using CCTV (Close Circuit Television) has been used as a conventional method for recognizing and locating objects. The image recognition technology builds and stores an image database in advance for each object, A method of recognizing a video object in comparison with an input image has been used.

The CCTV is a device for transmitting video using a cable television in a specific building or a specific facility and is used for various purposes such as industrial use, educational use, medical use, disaster prevention, and in-house image information delivery. It is widely used in various fields for the purpose of observing a place at a distance, observing a place where the human body can not be close to each other, observing a plurality of people simultaneously, or intensively monitoring it.

The video recognition system using the CCTV monitors the abnormality in the monitoring area using the CCTV. The CCTV is installed in a place to monitor the CCTV. The video signal captured by the CCTV is transmitted to a monitor installed in the central management room, The user can continuously monitor the screen displayed on the monitor device to monitor occurrence of an abnormal state such as theft or fire.

The conventional CCTV image recognition system has a function of allowing a manager to be placed in a central management room for monitoring and monitoring the images captured by the CCTV through a monitor, Whether or not an event occurs in the event of a fire alarm or the like, even if an administrator can not grasp it in real time, there is a problem in that it is not possible to appropriately deal with an event situation.

Korean Patent Publication No. 10-2008-0020018

SUMMARY OF THE INVENTION The present invention has been made to solve the above-mentioned problems, and it is an object of the present invention to provide an image processing apparatus and a method for processing the image data by inputting image data and one or more additional sensing data based on a micro- And to provide a sensor network system using the hybrid sensor module capable of collecting data.

According to an aspect of the present invention, there is provided a hybrid sensor module including: an image sensor unit for capturing images and collecting image data; An additional sensor stage including at least one sensor for collecting environmental data of the surrounding environment; A main input / output unit receiving the environment data, and an environment data input through the main input / output unit and the image data processed through the image processing unit, And a main control unit for operating the image sensor based on the environmental data or transmitting and controlling the image data to the sensor network.

The sensor control chip unit may be a semiconductor chip.

Wherein the image processing unit comprises: an image conversion unit for converting the image data collected through the image sensor unit into an image of a JPEG format; An image storage unit in which the converted JPEG format image is stored as a CIF or VGA format image; And an image control unit for converting the image of the JPEG format into the image of the JPEG format through the image conversion unit and storing the converted image of the JPEG format in the CIF or VGA format image storage unit.

The additional sensor unit may include at least one of a temperature and humidity sensor unit, an illuminance sensor unit, a human body sensor unit, a distance sensor unit, a smoke sensor unit, a pressure sensor unit, or a touch sensor unit.

In order to achieve the above object, a sensor network system using the hybrid sensor module according to the present invention includes an image sensor unit for receiving environmental data collected through an additional sensor unit including image data and one or more sensors A sensor node having a sensor control chip part for operating the image sensor based on the environmental data or controlling transmission of the image data to the sensor network by combining them; A monitoring unit for displaying image data and environmental data transmitted through the sensor node; And a management server for storing image data and environmental data transmitted through the sensor node and providing the monitoring unit with the request for the image data and environmental data through the monitoring unit.

The sensor node transmits image data and environmental data through wireless communication, and a data relay unit connecting wired communication and wireless communication may be connected to the sensor node.

An image sensor unit for capturing an image and collecting image data; An additional sensor stage including at least one sensor for collecting environmental data of the surrounding environment; An image processing unit for receiving the image data and performing image processing; a main input / output unit for receiving the environment data; and an image processing unit for combining the image data processed through the image processing unit and the environment data input through the main input / And a relay control chip unit provided with a main control unit.

The sensor control chip portion and the relay control chip portion may be semiconductor chips.

The data relay unit may include a display unit for visually displaying the image data or the environment data, and an input panel unit for receiving an operation command.

The sensor node may periodically transmit image data and environment data to a management server or request transmission of image data or environmental data from the data relay unit.

According to the sensor network system using the hybrid sensor module of the present invention as described above, the image data through the image sensor is received, and the image data and one or more additional sensing data are received based on the microcontroller unit It is possible to measure and collect surrounding information.

1 is a perspective view showing a sensor network system using a hybrid sensor module according to an embodiment of the present invention,
2 is a block diagram illustrating a sensor node according to an embodiment of the present invention,
3 is a block diagram showing a sensor control chip unit constituting a sensor node according to an embodiment of the present invention,
4 is a block diagram illustrating another example of a data relay unit constituting a sensor node according to an embodiment of the present invention.

DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS Hereinafter, preferred embodiments of the present invention will be described in detail with reference to the accompanying drawings in order to facilitate a person skilled in the art to easily carry out the present invention.

FIG. 1 is a perspective view illustrating a sensor network system using a hybrid sensor module according to an embodiment of the present invention. FIG. 2 is a block diagram illustrating a sensor node according to an embodiment of the present invention. FIG. 4 is a block diagram illustrating another example of a data relay unit constituting a sensor node according to an embodiment of the present invention. Referring to FIG.

1, a sensor network system using a hybrid sensor module according to an embodiment of the present invention includes a sensor node 100, a data relay unit 300, a management server 900, and a monitoring unit 700 .

2, the image sensor unit 130, the additional sensor unit 150, the sensor control chip unit 110, the sensor wired unit 170, And a sensor radio unit 190 are included.

The image sensor unit 130 captures images and collects image data.

The image sensor unit 130 is a CMOS image sensor.

The additional sensor stage 150 includes at least one sensor for collecting environmental data of the surrounding environment.

The additional sensor unit 150 includes a temperature and humidity sensor unit 151, an illuminance sensor unit 152, a human body sensor unit 153, a distance sensor unit 154, a smoke sensor unit 155, a pressure sensor unit 156, Or a touch sensor unit 157.

3, the sensor control chip unit 110 includes a main input / output unit 113 including a GPIO unit, a UART unit, an interrupt unit, a timer unit, and an ADC unit, An image processing unit 115, a main control unit 111 and a main storage unit 118.

The sensor control chip unit 110 is provided with an 8-bit main bus and the main input / output unit 113, the image processing unit 115, the main control unit 111, and the main storage unit 118 are connected to the main bus .

And receives the environment data from the main input / output unit 113.

The interrupt unit controls an external interrupt, and the timer unit controls a necessary time.

The GPIO unit includes eight input / output units for general use, and up to eight sensor data including image data can be received.

The sensor data may be input in 1-bit units, 4-bit units, or 8-bit units.

The UART unit inputs and outputs data to and from a UART (Universal Asynchronous Receiver / Transmitter) communication standard.

The ADC unit converts an analog signal into a digital signal of a 12-bit unit so as to be input.

The ADC unit is a 12-bit analog-to-digital converter.

The ADC unit is provided with a temperature and humidity sensor unit 151, an illuminance sensor unit 152, a human body sensor unit 153, a distance sensor unit 154, a smoke sensor unit 155, a pressure sensor unit 156, And an analog signal input by an analog signal such as a signal 157 is connected.

Since the signals of the various analog sensors are analog signals at the voltage level, they must be converted into digital signals for control through the main controller 111.

The image processing unit 115 includes an image conversion unit, an image storage unit, and an image control unit.

The image conversion unit compresses an image input through the image sensor unit 130 and converts the image into a JPEG (Joint Photography Experts Group) format image.

The image storage unit stores an image compressed in the JPEG format through the image conversion unit.

In addition, a plurality of images in the JPEG format are combined in the image storage unit and stored as moving images in a CIF (Common Intermediate Format) or VGA (Video Graphics Array) format.

The image control unit is for controlling an image input through the image sensor unit 130 and receives a control signal through the main control unit 111.

The image controller converts the image input through the image sensor unit 130 into an image of the JPEG format through the image converter, and converts the converted image of the JPEG format into a CIF or VGA format video , And stores the converted moving image in the image storage unit.

The image control unit provides a start point code (not shown) and an end point code (not shown) of the image stored in the image storage unit.

By compressing the video data to reduce the amount of data, transmission efficiency is increased on a limited network bandwidth.

The main control unit 111 is for controlling each configuration in the sensor control chip unit 110 and includes an interrupt unit, a GPIO unit, a timer unit, a UART unit, an ADC unit, an image processing unit 115, and a main storage unit 118 ), And controls the input / output to / from the outside.

The main controller 111 is an MCU (Micro Controller Unit) having an 8-bit processing speed.

The main controller 111 is compatible with Intel 8051 processor commands.

When the image is input through the image sensor unit 130, the main control unit 111 transmits a control signal to the image control unit so that the input image is converted into an image of the JPEG format through the image processing unit 115.

The main control unit 111 transmits control signals to the image control unit to convert a plurality of images in the JPEG format into a moving image in a CIF or VGA format, and stores the converted moving image in the image storage unit .

The main control unit 111 allows the image stored in the image storage unit to be stored in the main storage unit 118.

A real-time operating system (Real Time Operating System) is embedded in the main controller 111 to enable IP communication.

The real-time operating system may be NanoQPlus.

The main control unit 111 includes an operation unit for converting parallel data of 8 bits into serial data of 1 bit units and an internal storage unit for storing contents of various control signals.

The main control unit 111 combines the image data processed through the image processing unit and the environmental data input through the main input / output unit.

The sensor wired unit 170 is connected to the management server 900 through wired communication through the Internet network 500 and may be an Ethernet communication method or a serial communication method.

The sensor wireless unit 190 is connected to the management server 900 through wireless communication through the Internet 500 and may be configured as a Zigbee communication system or a WiFi system.

The sensor node 100 configured as described above receives the environmental data of the surrounding environment through the image sensor 130 and the additional sensor 150, and outputs the combined data.

The data relay unit 300 is a gateway for connecting wired communication and wireless communication. The data relay unit 300 includes a relay wireless unit 330 for wirelessly receiving image data and environment data transmitted from the sensor node 100, And a relay wire unit 350 for transmitting the video data and the environment data received by the relay wireless unit 330 to the management server 900 through the Internet network 500.

If the sensor wire 100 is connected to the Internet network 500, the sensor node 100 operates in a client mode, and the image data or environment data output through the sensor node 100 is transmitted to the Internet And is connected to the management server 900 through the sensor wired unit 170 to transmit the image data and the environment data.

In order to transmit image data or environmental data output through the sensor node 100 through the sensor wireless unit 190, the sensor wireless unit 190 may be connected to the data relay unit 300, (300) to the Internet network (500).

4, the data relay unit 300a includes an image sensor unit 320 for capturing an image and collecting image data, a temperature / humidity sensor unit 341 for collecting environmental data of the surrounding environment, An additional sensor unit 340 including a sensor unit 342, a human body sensor unit 343, a distance sensor unit 344, a smoke sensor unit 345, a pressure sensor unit 346, and a touch sensor unit 347, And an image processing unit 315a for receiving image data collected through the image sensor unit 320 and performing image processing.

The relay control unit 310a includes a relaying unit 310a that combines the image data processed through the image processing unit 315a and the environment data through the additional sensor unit 340 and outputs the combined data

Since the relay control unit 310a is provided with a semiconductor chip of the same type as the sensor control chip unit 110, a description thereof will be omitted.

The data relay unit 300a includes a relay wire unit 330a for wire communication, a relay wireless unit 350 for wireless communication, an image sensor unit 320 and an additional sensor unit 150, It can act as a sensor node, and at the same time can be used for gateway and development platform purposes.

The management server 900 is connected to the Internet network 500 and receives image data and environment data input through the sensor node 100 and stores the image data and the environment data in a separate database.

The monitoring unit 700 is connected to the management server 900 through the Internet 500 to request data of the video data or the environment data and receives video data or environment data from the management server 900, As shown in FIG.

The monitoring unit 700 may be a terminal such as a PC, a smart phone, or a smart pad.

As described above, when a sensor network is established, image data is input to the GPIO unit of the sensor control chip unit 110 in an 8-bit format through the image sensor unit 130 as a network camera function.

Subsequently, the image processing unit 115 receiving the control signal through the main control unit 111 converts the image data input through the image conversion unit into the JPEG format, and stores the converted JPEG image in the image storage unit.

Then, the image processor 115 receives the control signal from the main controller 111, converts the JPEG image into a CIF or VGA format, and stores the JPEG image in the image storage unit.

It is possible to convert the video format to CIF or VGA as well as JPEG according to the purpose of use, thereby giving convenience of use.

Since the image data converted into the JPEG image, CIF or VGA format is directly stored in the image storage unit, the cost required for the separate external memory device and its control can be reduced.

Then, when there is a request for an image stored from the outside, the main control unit 111 causes the image stored in the image storage unit to be temporarily stored in the main storage unit 118, and then delivers the image to the UART unit.

The internal 8-bit data is converted from 1-bit serial data to 1-bit serial data and transmitted to the management server 900 through the sensor radio unit 190 and the data relay unit 300, Lt; / RTI >

The image data stored in the main storage unit 118 may be transmitted to the management server 900 through the sensor wireless unit 190 and the data relay unit 300 or may be transmitted through the sensor wired unit 170, And is connected to the Internet network 500 and transmitted to the management server 900.

When the monitoring unit 700 requests image data from the management server 900, the image input through the image sensor unit 130 is transmitted through the network by wire communication or wireless communication, You can see the video.

The main control unit 111 processes the image data from the image sensor unit 130 to the image processing unit 115 and the main storage unit 118 to 8 bits, The structure of the memory 110 can be simplified, and the data flow can be made flexible.

The image sensor unit 130 and the additional sensor unit 150 may be connected to each other to receive the complex sensor input. The combination of the image sensor unit 130 and the additional sensor unit 150 may facilitate the function of the sensor network. Can be implemented.

When the sensor input of the additional sensor unit 150 is received in addition to the image sensor unit 130, the environmental data, which is the sensor input of the additional sensor unit 150, is input differently depending on the type of the digital output sensor or the analog output sensor.

The sensor node 100 periodically transmits the image data through the image sensor unit 130 and the environment data through the additional sensor node 150 to the management server 900 or the data relay unit 300, The sensor node 100 requests the transmission of the image data or the environment data through the wireless communication.

The signal of the digital output sensor is inputted through the input terminal of the GPIO part, and the signal of the analog output sensor is inputted through the ADC part.

The main control unit 111 of the sensor control chip unit 110 performs necessary information processing using sensing data input through the GPIO unit or the ADC unit and stores the inputted sensing data in the main storage unit 118.

The sensing data stored in the main storage unit 118 is used as necessary information on the sensor network through the UART unit, the wireless communication unit, and the like.

For example, the temperature sensor unit 151, the illuminance sensor unit 152, the human body sensor unit 153, the distance sensor unit 154, the smoke sensor unit 155, the pressure sensor unit 156, The image sensor unit 130 is activated when the sensor data is sensed through the sensor unit 157 or the like.

The main control unit 111 combines the image data processed through the image processing unit and the sensing data input through the main input / output unit so as to be output.

Accordingly, when sensed data such as a motion, a temperature change, or a sound is present at the location of the sensor node 100 according to the present invention, the image sensor unit 130 is activated, I can confirm the site.

The sensor node 100 according to the present invention can be installed in an individual parking space of the parking lot, so that the license plate of the parked vehicle can be recognized.

The vacant space of the individual parking space can be grasped and informed to the vehicle to be parked so that unnecessary movement and waiting time of the vehicle in the parking lot can be reduced.

By taking pictures of the vicinity of the parking lot, it is possible to immediately respond to an unusual situation such as a stolen vehicle parked, a contact accident in a parking lot, or a fire.

In addition, the sensor node 100 may be installed in a meter or the like so that the meter reading of the analog meter can be recognized through an image.

Since the sensor node 100 according to the present invention can be installed in an office, a warehouse, or the like, it is possible to recognize when there is a movement, a high temperature, a sound, or the like and to transmit a scene image through the image sensor unit 130, And the like.

Most of all, the sensor node 100 is provided with a wireless network through the sensor wireless unit 190, so that it is very easy to install because it does not need wiring, and the system can be installed in a wired manner such as a fire monitoring system or a dam monitoring system It is easy to install in places difficult to construct.

It can be photographed, stored, and recorded by attaching it to mobile devices such as model airplanes, cars, and port cranes that operate wirelessly, and it can be widely used for medical applications.

The sensor node 100 can be installed in the residence of the elderly person to detect the situation of the elderly such as motion, temperature, and illumination, so that the emergency can be prepared promptly.

While the present invention has been particularly shown and described with reference to exemplary embodiments thereof, it is clearly understood that the same is by way of illustration and example only and is not to be taken by way of illustration, It will be readily apparent that various substitutions, modifications, and alterations can be made herein.

110: sensor control chip unit 115: image processing unit
130: Image sensor part 150: Additional sensor part

Claims (10)

An image sensor unit for capturing an image and collecting image data;
An additional sensor stage including at least one sensor for collecting environmental data of the surrounding environment; And
A main input / output unit receiving the environment data, and an environment data input through the main input / output unit and the image data processed through the image processing unit, A main control unit for operating the image sensor based on the environmental data or transmitting and controlling the image data to the sensor network includes a sensor control chip unit provided in the form of a semiconductor chip,
A main input / output unit, an image processing unit, a main control unit and a main storage unit including a GPIO unit, a UART unit, an interrupt unit, a timer unit, and an ADC unit are connected to the main bus;
The image processing unit includes an image conversion unit for converting the image data collected through the image sensor unit into an image in the JPEG format, an image storage unit in which the converted JPEG format image is stored as a CIF or VGA format image, And an image controller for converting the converted JPEG format image into a CIF or VGA format image and storing the converted image in an image storage unit;
Wherein the main control unit is an MCU (Micro Controller Unit) having an 8-bit processing speed. delete delete The image sensor according to claim 1, wherein the additional sensor stage includes at least one of a temperature and humidity sensor, an illuminance sensor, a human body sensor, a distance sensor, a smoke sensor, a pressure sensor, or a touch sensor Sensor module. The image data collected through the image sensor unit and the environmental data collected through the additional sensor unit including at least one sensor are inputted and then combined to operate the image sensor based on the environmental data, A sensor node having a sensor control chip portion for controlling transmission to a network;
A monitoring unit for displaying image data and environmental data transmitted through the sensor node; And a management server for storing image data and environmental data transmitted through the sensor node and providing the monitoring unit with a request for the image data and environmental data through the monitoring unit;
Wherein the sensor node transmits image data and environmental data through wireless communication, and a data relay unit connecting the wired communication and the wireless communication is connected to the sensor node;
An image sensor unit for capturing an image and collecting image data; An additional sensor stage including at least one sensor for collecting environmental data of the surrounding environment; An image processing unit for receiving the image data and performing image processing; a main input / output unit for receiving the environment data; and an image processing unit for combining the image data processed through the image processing unit and the environment data input through the main input / And a relay control chip part having a main control part in the form of one semiconductor chip (Chip);
A main input / output unit, an image processing unit, a main control unit, and a main storage unit including a GPIO unit, a UART unit, an interrupt unit, a timer unit, and an ADC unit are connected to the main bus; The image processing unit includes an image conversion unit for converting the image data collected through the image sensor unit into an image in the JPEG format, an image storage unit in which the converted JPEG format image is stored as a CIF or VGA format image, And an image controller for converting the converted JPEG format image into a CIF or VGA format image and storing the converted image in an image storage unit; Wherein the main control unit is an MCU (Micro Controller Unit) having an 8-bit processing speed. delete delete delete The sensor network system according to claim 5, wherein the data relay unit includes a display unit for visually displaying the image data or the environment data, and an input panel unit for receiving an operation command. The sensor node according to claim 5, wherein the sensor node periodically transmits image data and environmental data to a management server or receives a request for transmission of image data or environmental data from the data relaying unit. system.

Images