KR20120123954A - Multi-conrol system using smart phone - Google Patents

Abstract

PURPOSE: A multi control system using a smart phone is provided to perform an image control function related to image monitoring. CONSTITUTION: A camera IP(Internet Protocol) address is designated to a plurality of network camera devices(100). The network camera devices convert a photographed original video into a compressed video. A smart phone(200) is connected with the network camera device through the network. The smart phone executes a video monitoring program for smart phone. The smart phone outputs the compressed video transmitted from the network camera devices in a user approval process. [Reference numerals] (AA) Tablet PC; (BB) Notebook; (CC) Network

Description

Multi-control system using smart phone {Multi-conrol system using smart phone}

The present invention relates to a multi-control system using a smart phone, and more particularly, to monitor a remote monitoring image captured by a network camera device at a remote location using an IP address of a network camera device using a smart phone. The present invention relates to a multi-control system using a smart phone that enables a user to freely perform video monitoring and other surveillance-related control functions anytime, anywhere during mobile and field activities.

Today's video surveillance systems are becoming increasingly important as the need to protect or monitor human or technical resources in a complex and rapidly changing modern society. In particular, the use of the video surveillance system is increasing rapidly for the surveillance of the visitors and securing evidence in corporations, government offices and banks.

The security performance of such a video surveillance system is represented by the automation of the system and the images obtained as a result of the system. The need for automation has arisen from the growing security and scrutiny of surveillance zones, as well as of the early security and surveillance systems that monitor all surveillance areas.

A typical video surveillance system consists of a large number of stationary cameras to monitor intruders. Such a structure of the video surveillance system is difficult to achieve the motion detection automation of the entire surveillance system because the detection of the motion target for each fixed camera is possible within the limited field of view of the limited number of fixed cameras.

On the other hand, digital video signal processing apparatus has been in the spotlight in the field of security surveillance by replacing the existing analog video cassette recorder (VCR) based on digital video compression technology. The digital video signal processing device is a device that digitizes a CCTV (Closed Caption Television) camera image, compresses it, and stores it in a storage medium, so that it is easy to manage and search recorded video, and to monitor a screen even from a remote location. (10-1 ~ 10-16N) has the advantage that it is possible to capture or record the video signal captured at the same time.

In addition, multi-channel video monitoring function can monitor multiple camera images by dividing them into one monitor, so that multiple locations can be monitored simultaneously.

Referring to Figure 1 will be described the function of each block of the remote video surveillance system using a digital video recorder according to the prior art.

The monitoring apparatus 10 outputs a plurality of video surveillance data by capturing an image in the surveillance zone through the plurality of remote monitoring cameras 10-1 to 10-16N, and the local monitoring terminal 20 monitors the monitoring apparatus 10. Receives the video signal is output from the digital video recorders 20-1 to 20-N are converted into a digital video signal respectively.

In addition, the display unit 60 is connected to the local monitoring terminal 20 through a communication network, and is photographed through a camera in the monitoring apparatus 10 connected to a predetermined digital video recorder, and transmitted to the local monitoring terminal 20 and stored therein. The video signal is received and converted into an analog video signal and output from the plurality of main monitors 31-1 to 3N-1 and the plurality of spot monitors 31-2 to 3N-2.

On the other hand, the remote control unit 40 is a control signal (CON) for selecting a digital video recorder connected to a predetermined camera according to an input input to obtain the image data required by the image monitor on the display unit 30 from the predetermined camera (CON). )

Here, all the plurality of cameras 10-1 to 10-16N in the monitoring device 10 are connected to the local monitoring terminal 20 by RS485 communication protocol, which is a serial communication when the computer communicates with the outside. It is a method of transmitting a signal in reverse phase to each other on two signal lines by utilizing a communication line such as a conventional telephone line.

In addition, each of the plurality of main monitors 31-1 to 3N-1 in the display unit 30 receives digital image signal data converted and stored by the plurality of digital video recorders 20-1 to 20 -N. After dividing into one screen or 4, 9, 16 screens, etc., multiple screens can be viewed simultaneously according to the selection of the video monitor. At this time, information such as the number, recording time, and recording state of the camera in the monitoring apparatus 10 that has transmitted the corresponding video surveillance signal is also displayed on each screen.

The plurality of spot monitors 31-2 to 3N-2 outputs video surveillance signals of the plurality of cameras 10-1 to 10-16N in the monitoring apparatus 10 and displays them on the entire screen. .

As described above, in the remote video surveillance system using the digital video recorder according to the related art, in the case where the monitor wants to output the video data acquired from the specific remote surveillance camera 10-17 through the main monitor, 64 in the monitoring apparatus 10. The cameras once capture video signals in all surveillance zones and output all surveillance data.

The local surveillance terminal 20 receives the surveillance data output from the surveillance apparatus 10 and converts the surveillance data into digital data through the four digital video recorders 20-1 to 20-4, respectively, and outputs the digital data.

If the video monitor wants to obtain surveillance data from the specific remote monitoring camera 10-17 through the main monitor in the display unit 60 in the predetermined surveillance space, the remote monitoring camera 10-17 through the remote control unit 40. The control signal CON for selecting the digital video recorder DVR2 connected to the output signal is output to the local monitoring terminal 20.

The local monitoring terminal 20 displays only the surveillance data output from the seventeenth camera 10-17 among the digital surveillance data converted through the digital video recorder DVR2 selected by the control of the control signal CON. It is automatically delivered to my main monitor 32-1.

However, the remote video surveillance system using the digital video recorder according to the prior art has a disadvantage in that the control speed of the camera is slowed down because the video monitor indirectly goes through the digital video recorder one more step in controlling the camera in the surveillance area. This is inadequate in the general CCTV video control system that requires the continuous control of a plurality of cameras.

In addition, although video surveillance systems such as closed circuit television (CCTV) and many security service providers are provided with various types of video surveillance services, they are costly and inexpensive for use by ordinary individuals or small businesses. In particular, it did not get a great response due to the rejection of invasion of privacy.

Accordingly, by using a mobile communication terminal capable of video telephony that most people possess or can easily acquire while using a remote surveillance camera that is being used in the past, the signal obtained by the remote surveillance camera can be converted into an appropriate signal. Therefore, there is a demand for development of a technology capable of delivering to at least one mobile communication terminal subscriber.

However, the video surveillance service using the existing mobile communication terminal or personal digital assistant (PDA) has a limitation in network communication and video display of digital CCTV, so that the network IP can be used without a separate PC by using a smart phone that is currently being distributed. There is an urgent need for a technology that can perform a video surveillance service using a remote address.

Accordingly, an object of the present invention is to select and view the remote monitoring images taken by one or more network camera devices at a remote location by camera, date, etc. using an IP address of the network camera device without a separate PC using a smartphone. It is to provide a multi-control system using a smart phone that allows the monitor to freely perform video monitoring and other surveillance related control functions anytime, anywhere, even during mobile and field activities.

In addition, an object of the present invention is to use the existing video surveillance system and network resources, the installation cost, cable cost, and maintenance cost is low, multi-use using a smart phone that can be used in general or small businesses, including large businesses To provide a control system.

In the multi-control system using a smart phone according to the present invention for achieving the above object of the present invention, a plurality of networks for converting the raw video taken by the camera to a compressed video by specifying an IP address for each camera to a network protocol A camera device; When the network is connected to the network camera device, a video monitoring program for a smartphone is executed and a compressed image transmitted from the network camera device is output through a user authentication procedure, and video surveillance, audio transmission, image control, external sensor detection, and Characterized in that consisting of a smart phone to perform a remote control function of the specified electronic device.

In this case, when the network camera device and the network are connected to the network, a compressed video transmitted from the network camera device is output through a user authentication procedure while a video monitoring program for a terminal is executed, and video surveillance, audio transmission, and image control are performed. The apparatus may further include a video communication terminal for performing external sensor detection and remote control of a designated electronic device.

Here, the video communication terminal or a smart phone is characterized in that for installing a control program to control a plurality of network camera devices at the same time.

The network camera apparatus may further include: a camera module for converting and outputting an image input from an image sensor into a digital image signal, and storing the compressed image after encoding the digital image signal transmitted from the camera module as a compressed image. It characterized in that it comprises a main board for transmitting to a smartphone or a video communication terminal of a remote place by a network protocol.

In this case, the camera module includes an image sensor that detects subject information and converts it into an electric video signal, an infrared LED for infrared illumination, a photodetector for detecting infrared rays emitted from a subject, and a camera driver device. And a digital signal processor that implements an image quality, color representation, and automatic white balance so that the digital image signal is closer to the original image through a programming value through the programming.

The main board may include a digital signal processor that executes a communication program, connects to a network, transmits a compressed image, and operates a camera module and various devices according to a user command transmitted from the outside, and controls the digital signal processor. Memory to store compressed video in a first-in, first-out manner, a network connection for connecting Wi-Fi and Ethernet, and at least one of a graphics board, a memory module, an interface board, and an expansion board. And an extension socket, and a sensor interface unit for an external sensor and a pan tilt signal input / output interface.

On the other hand, the digital signal processor is characterized in that for installing the codec for the two-way voice and video communication to allow the compressed video to be transmitted seamlessly.

The memory unit may include NAND, which is a flash memory, and DDR2 (Double Data Rate SDRAM), which is an SDRAM.

In addition, the video monitoring program for the smart phone checks the remaining battery level, when the remaining battery level is less than a predetermined threshold, the emergency power mode is executed to output a charging instruction pop-up message to the user, before the power off (off) It is characterized in that the video monitoring can be executed for a certain time by the emergency power.

The network camera device may include a microphone for inputting an external sound and a speaker for outputting a user voice or a warning sound.

According to the multi-control system using a smart phone as described above, using a smart phone to view the remote monitoring video taken from a remote location using a network IP address without a separate PC so that the monitor can be monitored at any time during mobile and field activities, It is possible to freely perform video monitoring and other surveillance-related control functions anywhere, and to increase reliability by preventing images from being completely cut off in the event of a network error.

In addition, the present invention does not require additional installation work by utilizing the existing video surveillance system and network resources, and because it uses a network cable in a building or at home, it does not need a separate cable work, and various video surveillance that is operating in the past It can be linked with the system, which makes installation, cable, and maintenance costs low, and can be used by small businesses such as large enterprises, general individuals, government offices, and stores.

In addition, the present invention can be expanded from one network camera device to thousands of network camera devices, so it can be manufactured compactly through modularization of compact products as well as excellent scalability regardless of the number of channels as the existing DVR. In addition, the prototype can be developed to separate the camera module and the main board so that it can be usefully expanded according to the purpose of use.

1 is a block diagram showing the configuration of a remote video surveillance system using a digital video recorder according to the prior art,
2 is an overall configuration diagram of a multi-control system using a smartphone according to an embodiment of the present invention,
3 is a diagram showing the module shape of the network camera device according to an embodiment of the present invention,
4 is a detailed configuration diagram of a network camera device according to an embodiment of the present invention.
5 is a diagram illustrating an example of an image monitoring screen of a smartphone according to an embodiment of the present invention.

While the invention is susceptible to various modifications and alternative forms, specific embodiments thereof are shown by way of example in the drawings and will herein be described in detail. It should be understood, however, that the invention is not intended to be limited to the particular embodiments, but includes all modifications, equivalents, and alternatives falling within the spirit and scope of the invention. Like reference numerals are used for like elements in describing each drawing.

Unless defined otherwise, all terms used herein, including technical or scientific terms, have the same meaning as commonly understood by one of ordinary skill in the art. Terms such as those defined in the commonly used dictionaries should be construed as having meanings consistent with the meanings in the context of the related art and shall not be construed in ideal or excessively formal meanings unless expressly defined in this application. Do not.

The present invention can be embodied as computer readable codes on a computer readable recording medium. The computer-readable recording medium includes all kinds of recording devices in which data that can be read by a computer system is stored. Examples of computer-readable recording media include ROM, RAM, CD-ROM, magnetic tape, floppy disk, optical data storage device, and the like, and are also implemented in the form of a carrier wave (for example, transmission over the Internet). It also includes. The computer readable recording medium can also be distributed over network coupled computer systems so that the computer readable code is stored and executed in a distributed fashion.

Hereinafter, preferred embodiments of the present invention will be described in detail with reference to the accompanying drawings.

2 to 4, the multi-control system using a smart phone according to an embodiment of the present invention, a plurality of IP addresses for each network camera is specified, and converts the raw image taken by each camera into a compressed image network When the network camera device 100 is transmitted through a protocol and the network camera device 100 is connected to the network, a video monitoring program for a smartphone is executed and a compressed image transmitted from the network camera device 100 is passed through a user authentication procedure. The mobile terminal 200 performs video surveillance, audio transmission, video control, external sensor detection, and remote control of a specified electronic device, and the network camera device 100 when connected to a network, and monitors video for a terminal. When the program is executed, the screen output of the compressed video, video surveillance, The video communication terminal 300 performs audio transmission, image control, external sensor detection, and remote control of a designated electronic device.

The network camera apparatus 100 is a network embedded camera having a network connection function. The network camera apparatus 100 transmits a file by using a file transfer protocol (FTP), and holds unique information, respectively, so that the smartphone 200 or the video communication terminal ( 300). In this case, the network camera apparatus 100 may include a wired / wireless internet protocol (IP) router as a gateway for connecting to a network.

On the other hand, the base station 250 of the mobile communication company provides a mobile communication network for relaying the communication between the smartphone 200 and the network camera device 100. Therefore, when the smartphone 200 accesses 3G, the smartphone 200 shows a compressed image through a user authentication procedure in a video monitoring program for the smartphone via the server of the mobile communication company and the base station 250.

The video communication terminal 300 is a multimedia communication device having a display function, a key input function, and a communication function, such as a PC, a notebook computer, a tablet PC, a PDA, an eBook terminal, and the like.

When the control program is installed in the video communication terminal 300 or the smart phone 200, the video communication terminal 300 or the smart phone 200 performs a control server function to operate a plurality of network camera devices 100. It can be controlled and controlled at the same time.

On the other hand, the network camera device 100 image-encodes the camera module 110 for converting the image input from the image sensor 111 into a digital video signal and the digital video signal transmitted from the camera module 110 After storing the compressed image as a network protocol, the main board 180 may transmit the compressed image to a remote smartphone 200 or a video communication terminal 300 through a network protocol, but is not limited thereto.

The camera module 110 detects subject information and converts it into an electrical image signal, an infrared LED 113 for infrared illumination, and a photo detector 112 for detecting infrared rays emitted from a subject. And a digital signal processor 120 that implements an image quality, color representation, and automatic white balance so that the digital image signal is closer to the original image through a programming value through programming of a camera driver device. .

In this case, the camera module 110 may apply both a CMOS image sensor and a CCD image sensor.

In addition, the main board 180 transmits a compressed image when the smart phone 200 or the video communication terminal 300 is connected using an internet communication program such as a web browser, and the camera according to a user command transmitted from the outside. The digital signal processor 120 for operating the module 110 and the general devices, the memory units 131 and 132 for storing the compressed image in a first-in, first-out manner under the control of the digital signal processor 120, and the Wi-Fi ) And network connections 141 and 142 for Ethernet connection, expansion socket 150 for electrically connecting at least one of a graphics board, a memory module, an interface board, and an expansion board, and an external sensor and pan tilt. The sensor interface unit 160 for a signal input and output interface is included.

At this time, the external interface that can be interfaced by the sensor interface unit 160, that is, a magnetic sensor or micro switch for detecting the opening and closing of doors and windows, infrared or ultrasonic sensors for detecting the human body, shock or vibration sensor for detecting damage It may also be any type of sensor that can detect gas, leakage, fire, etc. for the detection of hazards.

The main board 180 is designed in the form of a network embedded server, and the digital signal processor 120 may be separately installed and used by the camera module 110 and the main board 180. One digital signal processor 120 may be used for integration.

In addition, the network camera device 100 may be provided with a microphone 171 for inputting an external sound, a speaker 172 for outputting a user voice or warning sound, and other facilities for video monitoring and warning, and the like. When additional equipment is installed, the extension socket 150 and the digital signal processor 120 set and set the interface and the signal processing part for the additional equipment.

Meanwhile, the digital signal processor 120 applies the H.264 / MJPEG codec to enable bidirectional voice and video communication, and allows the compressed video to be transmitted without interruption.

Here, the H.264 codec is a new video compression standard developed by ITU-T and ISO / IEC, which can be applied to all areas of video applications (DVD, digital cinema, low bit rate wireless applications, etc.). Do. In particular, when the digital signal processor 120 applies the H.264 codec, even when image data loss occurs due to a network error, the image may not be completely disconnected but only a deterioration of image quality may be expected to improve performance in the event of a network error.

The memory units 131 and 132 include NAND 131 which is a flash memory and a Double Data Rate SDRAM (DDR2) 131 which is an SDRAM, but may be added by connecting another memory module to the expansion socket 150. have.

The image monitoring program for a smartphone may execute an image resolution viewer algorithm, an image search engine, and a user friendly graphical user interface (GUI) function.

That is, the image resolution viewer algorithm may support various image sizes according to various monitoring resolutions such as 320 × 240, 640 × 480, 800 × 600, and the image retrieval engine is a compressed image transmitted from the network camera device 100. Select by camera, by date, etc. to enable mobile playback and monitoring.

In addition, the video monitoring program for the smart phone in conjunction with the main controller, the battery check unit, the emergency power unit of the smart phone 200, and checks the remaining amount of the battery to execute the emergency power mode when the remaining amount of the battery is below a predetermined threshold value do.

When the above emergency power mode is executed, the user is asked to 'charge or replace the battery, the video monitoring program ends for 5 minutes.' It outputs a pop-up message for charging instructions, and the like, and executes only the video monitoring program for the smartphone for a predetermined time while waiting for all other programs running on the smartphone 200 before being turned off. Enable video monitoring.

Therefore, the user can safely end the current video monitoring task even when the battery of the smart phone is almost exhausted, and replace the video monitoring task with another PC or the video communication terminal 300, or promptly of the smart phone 200 You can continue to monitor video by charging or replacing the battery.

On the other hand, the camera module 110 and the main board 180 to develop a prototype to be separated as shown in Figure 3, so that it can be usefully expanded according to the purpose of use.

Hereinafter, the operation of the multi-control system using a smart phone according to an embodiment of the present invention will be described in more detail with reference to the drawings.

2 to 5, in the multi-control system using a smart phone according to an embodiment of the present invention, an embedded server program is forwarded to the main board 180 of the network camera device 100 so that the main board 180 may be forwarded. ) Acts as a server, and the image captured by the camera module 110 is compressed by image encoding in the main board 180 and stored in the memory units 131 and 132 in a first-in first-out manner.

When the smart phone 200 requests a network connection to the IP of the network camera device 100, the smart phone 200 connects to the Ethernet network connection unit 142 or the WiFi network connection unit 141 through a network protocol.

At this time, by performing the user authentication procedure in the image monitoring program installed in the smart phone 200, it shows a compressed image transmitted from the network camera device 100 to the user that the user authentication is completed normally.

In addition, as shown in Figures 4 and 5, the screen for the image monitoring, image manipulation, menu selection is output on the screen of the smart phone 200, the user desired image on the image manipulation or menu selection screen In addition to voice reception, video recording, surveillance video monitoring, text notification function, alarm sound or warning broadcast output function, voice dialogue function, video up / down / left / right movement, video zoom function, magnetic sensor, thermal sensor, infrared sensor , External sensor detection function such as smoke sensor, remote on / off function, electronic door lock open / close function.

On the other hand, when monitoring the image using the video communication terminal 300, such as a PC, the network camera device after inputting the IP address assigned to the network camera device 100 while the video communication terminal 300 is connected to the network ( Video monitoring program for the terminal is executed in 100) to execute video viewing function, video recording function, voice dialogue function, text notification function when motion detection is detected during monitoring video monitoring, alarm sound or warning broadcast output function, video up / down / left / right movement, video Zoom function, magnetic sensor, thermal sensor, infrared sensor, external sensor detection function such as smoke sensor, remote on / off function, electronic door lock can be opened / closed.

It will be understood by those skilled in the art that various changes in form and details may be made therein without departing from the spirit and scope of the invention as defined in the appended claims. It will be possible.

The present invention relates to a multi-control system using a smart phone, and more particularly, to monitor a remote monitoring image captured by a network camera device at a remote location using an IP address of a network camera device using a smart phone. The present invention relates to a multi-control system using a smart phone that enables a user to perform video monitoring and other control-related control functions at any time and anywhere, even during mobile and field activities.

100: network camera device 110: camera module
111: image sensor 112: photodetector
113: IR LED 120: Digital Signal Processor
131, 132: memory unit 141, 142: network connection unit
150: extension socket 160: sensor interface
171: microphone 172: speaker
180: motherboard 200: smartphone
300: video communication terminal

Claims (10)

A plurality of network camera apparatuses, each of which is assigned an IP address for each camera, converts a raw image captured by the camera into a compressed image and transmits the compressed image to a network protocol; And
When the network is connected to the network camera device, a video monitoring program for a smartphone is executed and a compressed image transmitted from the network camera device is output through a user authentication procedure, and video surveillance, audio transmission, image control, external sensor detection, and Multi-control system using a smartphone, characterized in that consisting of a smartphone to perform a remote control function of the specified electronic device. The method of claim 1,
When the network camera device is connected to the network, a video monitoring program for a terminal is executed and a compressed image transmitted from the network camera device is output through a user authentication procedure, and video surveillance, audio transmission, image control, external sensor detection, And a video communication terminal performing a remote control function of a designated electronic device. The method according to claim 1 or 2,
The video communication terminal or a smart phone is a multi-control system using a smart phone, characterized in that to control a plurality of network camera devices at the same time by installing a control program. The method according to claim 1 or 2,
The network camera device,
A camera module for converting and outputting an image input from an image sensor into a digital image signal, and
And a main board for encoding the digital video signal transmitted from the camera module and storing the compressed video as a compressed video, and then transmitting the compressed video to a remote smartphone or a video communication terminal through a network protocol. Multi control system using. 5. The method of claim 4,
The camera module
An image sensor that senses subject information and converts it into an electrical video signal;
Infrared LED for infrared illumination,
A photodetector for detecting infrared rays emitted from a subject,
Smart signal comprising a digital signal processor that implements the image quality and color representation, automatic white balance to the digital image signal closer to the original image through the programming value of the camera driver device Multi-control system using phone. 5. The method of claim 4,
The main board,
A digital signal processor which executes a communication program and connects to a network to transmit a compressed image, and operates a camera module and various devices according to a user command transmitted from the outside;
A memory unit for storing the compressed image on a first-in first-out basis under the control of the digital signal processor;
Network connections for Wi-Fi and Ethernet connections,
An expansion socket electrically connecting at least one of a graphics board, a memory module, an interface board, and an expansion board;
Multi-control system using a smartphone, characterized in that it comprises a sensor interface for the external sensor and the pan tilt signal input and output interface. The method according to claim 6,
The digital signal processor is a multi-control system using a smart phone, characterized in that to install the codec for the two-way voice and video communication to allow the compressed video to be transmitted seamlessly. The method according to claim 6,
The memory unit is a multi-control system using a smartphone, characterized in that consisting of a flash memory NAND and SDRAM DDR2 (Double Data Rate SDRAM). The method of claim 1,
The video monitoring program for the smart phone checks the remaining battery level and, when the remaining battery level is less than or equal to a predetermined threshold, executes the emergency power mode to output a charging instruction popup message to the user, and the emergency power source before the power is turned off. Multi-control system using a smartphone, characterized in that to run the video monitoring for a certain time. The method of claim 1,
The network camera device includes a microphone for inputting an external sound, and a speaker for outputting a user voice or a warning sound.

Images