KR101147193B1 - Monitoring system using smart phone - Google Patents

Abstract

Surveillance system using a smart phone according to the present invention includes a smart phone for transmitting the real-time monitoring data including the image data taken by the built-in camera over the wireless Internet network and a surveillance server for receiving and displaying and storing the monitoring data As a result, a smartphone that is not limited to a place can be used as an input means.

Description

Surveillance system using smartphone {MONITORING SYSTEM USING SMART PHONE}

BACKGROUND OF THE INVENTION 1. Field of the Invention The present invention relates to a surveillance system using a smartphone, and more particularly, to a surveillance system using a built-in camera of a smartphone as an input means and transmitting a photographed image through a wireless internet network.

The surveillance system is a system that monitors images captured by a camera installed at a predetermined place from a remote server.

A representative example of such a surveillance system is a CCTV system.

Closed Circuit Television (CCTV) systems use video cameras to send signals to a limited monitor at a specific location.

CCTV systems are called closed-circuit televisions (CCTVs) because they transmit signals directly, using cables and the like.

Principle is same as broadcast television, but there are various methods depending on application field or communication channel of television signal. Every second screen, scan player, etc. are not bound by broadcasting standard. In many cases, proprietary specifications are used. The sensitive wavelength of a camera is not only visible region but also an area | region, such as an ultraviolet-ray, an infrared ray, X-ray, and neutron beam.

Various uses include monitoring of dam intake, water level, automatic opening / closing of floodgates, combustion of thermal power plants and furnaces, and monitoring of smoke from chimneys and operation of cranes. Or monitoring work at high altitudes, waterway conditions from the bow, monitoring traffic conditions inside highway tunnels, identifying elevations in platforms or stations, and remote monitoring and aiding of radioactive material; It is often used when you want to grasp the situation from afar or when you can't access it because it is dangerous. Indispensable to the automation of the industry, the scene of surgery in the hospital can be seen outdoors.

The CCTV system is a combination of a simple TV camera and a receiver, and a cable transmission system is often used as a bilateral transmission path, and the camera's focus and the camera's direction are usually remotely operated near the receiver (display). Video cameras are often used because of their ease and safety. Cameras require wind resistance, high temperature resistance and radiation resistance depending on the stability and purpose of use for a long time. The display is good enough for broadcasting, and a transmission line is mostly a coaxial cable.

It is often used in commerce, education, research, police and defense. X-ray televisions and the like are used for medical use, and in this case, the intensity of the X-rays can be reduced by increasing the sensitivity of the fluorescent plate, the imaging tube, the camera, and the like, so there are fewer obstacles. It is also ideal for the safety of the patient or doctor because it can be repeated repeatedly if you take another shot.

In addition, there is an endoscope television, ultraviolet microscope television, etc., many people can observe or record at the same time, and for medical education, surgical surgery can be seen by many people outside the operating room. For educational purposes, it can be used as a demonstration of training or experimentation of a large number of people in a large auditorium, etc., as well as for expanding exhibitions and teaching guidance of details. Such educational television is abbreviated as ETV (education TV). It is also used for surveillance at department stores and at home.

Recently, thanks to the development of storage means, a system for storing captured images, from simple monitoring through an image tube, has been introduced. At this time, a VCR, a digital video recorder (DVR), and the like are used.

The present invention is to provide a surveillance system using a smart phone capable of real-time monitoring without being limited to a place by using the built-in camera of the smart phone as an input means and transmitting the captured image via a wireless Internet network.

In addition, to provide a smartphone and a surveillance server for the surveillance system constituting such a surveillance system.

Technical problems to be achieved by the present invention are not limited to the above-mentioned technical problems, and other technical problems not mentioned above are clearly understood by those skilled in the art from the following description. Could be.

Surveillance system of the present invention for achieving the above object is a smart phone for transmitting in real time the surveillance data including the image data taken by the built-in camera over the wireless Internet network and a surveillance server for receiving and displaying and storing the surveillance data It may include.

In this case, the wireless Internet network may use at least one of TCP / IP, UDP / IP, RTST, RTCP, RTP / UDP, RTP / TCP.

In addition, the surveillance system further comprises a CCTV (Closed Circuit Television) camera, the surveillance server is a communication channel for the smartphone receiving the surveillance data from the smartphone and a communication channel for the CCTV camera receiving the video data of the CCTV camera It may include.

The apparatus may further include a security poll provided with a display displaying at least the image data, wherein the monitoring server may transmit the monitoring data to the security poll. Here, the smart phone may further transmit location information, and the security pawl may be located within a set distance from the location information.

On the other hand, the smart phone for surveillance system of the present invention transmits the terminal identification information to the surveillance server through a camera, a surveillance data generation unit for generating surveillance data including the image data captured by the camera and a wireless Internet network It may include a surveillance data transmission unit for transmitting the surveillance data in real time.

In this case, the smart phone for the surveillance system may further include a microphone, and the surveillance data may further include voice data input to the microphone.

The apparatus may further include a GPS receiver for generating location information and a clock for generating time information, and the monitoring data transmitter may transmit the location information and the time information to the monitoring server according to a set period.

The apparatus may further include a terminal display and a data analyzer, wherein the surveillance data transmitter receives pre-stored surveillance data corresponding to the terminal identification information from the surveillance server, and the data analyzer extracts image data from the received surveillance data. The terminal display may be transferred to the terminal display, and the terminal display may display the transferred image data. The apparatus may further include a speaker, and the data analyzer extracts the voice data from the transmitted monitoring data and transmits the voice data to the speaker, and the speaker may display the transmitted voice data.

The smart phone for the surveillance system may further include a controller for displaying a surveillance mode icon on the terminal display by the user's selection. The control unit includes a camera operation icon for operating the camera when the monitoring mode icon is selected, a recorded video icon for receiving and playing pre-stored surveillance data from the monitoring server, and a monitoring server setting icon for establishing a connection with the monitoring server. The upper menu may be displayed on the terminal display.

When the camera operation icon is selected, the controller drives the camera, the surveillance data generation unit, and the surveillance data transmission unit, and displays a photographing display area for displaying image data photographed by the camera and for classifying the image data. A camera operation submenu including a flag setting menu area for setting a flag and a regression menu area for returning to the upper menu may be displayed on the terminal display.

In addition, when the recorded video icon is selected, the controller drives the surveillance data transmission unit and the data analysis unit, and selects a time corresponding to the surveillance data to be reproduced from the previously stored surveillance data, and transmits the surveillance data. A request menu area for requesting the unit to receive the corresponding data of the selected time from the pre-stored monitoring data, a recorded image display area in which the image data extracted from the data analyzer is reproduced among the received corresponding data, and controlling the reproduction The recorded video submenu including a playback menu region and a regression menu region for returning to the upper menu may be displayed on the terminal display.

The controller may further include an IP address input area for inputting an IP address of the monitoring server, a storage menu area for storing the input IP address, and a regression menu area for returning to the upper menu when the monitoring server setting icon is selected. The monitoring server setting sub-menu including; may be displayed on the terminal display.

On the other hand, the monitoring server of the present invention is a server communication unit for receiving the surveillance data including the image data taken by the built-in camera from the smartphone and the terminal identification information of the smartphone via a wireless Internet network, the video data from the surveillance data A server data analyzer extracting the data, a server video monitoring unit displaying the video data in a display area corresponding to the terminal identification information, and storing the video data separately from video data of another smartphone by using the terminal identification information Server storage may be included.

In this case, the server data analyzer extracts the voice data when the monitoring data includes the voice data, and the server storage unit stores the voice data together with the video data and corresponds to the display of the video data. The apparatus may further include a server voice monitor configured to display voice data.

The server communication unit may include a communication channel for a smartphone that receives the surveillance data from the smartphone and a communication channel for a CCTV camera that receives the video data of the CCTV camera. The server image monitoring unit may be assigned to the CCTV camera. The video data of the CCTV camera is displayed on the display area, and the server storage unit may further store the video data of the CCTV camera.

The apparatus may further include an external transmitter configured to transmit data extracted from the server data analyzer by at least one security polo having a display for displaying the image data.

In this case, the server communication unit may further receive location information of the smartphone, and the external transmission unit may transmit the extracted data only to a security pole within a set distance from the location information.

In addition, the server communication unit may further receive a location information and time information of the smart phone, and may further include a copper wire tracking unit for tracking the copper wire of the smart phone using the location information and the time information.

The server storage unit may further include a server data extractor configured to extract pre-stored surveillance data requested by the smartphone, and the server communication unit receives a request to transmit pre-stored surveillance data from the smartphone to the server data extraction unit. And the pre-stored monitoring data extracted by the server data extraction unit may be transmitted to the smartphone.

As described above, the surveillance system using the smart phone according to the present invention has an input means that is not limited to a place by allowing the smart phone and the surveillance server to communicate with each other via the wireless camera network as an input means. It does not go through a complicated relay server in the communication process, so real-time monitoring as in CCTV is possible.

In addition, by using the existing CCTV camera as an extra input means it is possible to parallel the existing CCTV. From another point of view, it may be in the form of adding a configuration using a smartphone as an input means to the existing CCTV.

In addition, by displaying the image taken by the smartphone or CCTV in the security pole equipped with a display it can be guided around the security pole various information represented by the image. In particular, when the image is to be displayed only in the security pole within a certain distance from the smartphone information represented by the image becomes more useful.

In addition, when the smartphone is used as an input means, the audio data acquired by the microphone built into the smartphone may be transmitted together with the image data, thereby monitoring the image and the audio together.

In addition, if the location information and time information is additionally transmitted through the GPS receiver and the watch embedded in the smartphone, the movement of the smartphone can be determined. When using a smartphone as an input means, there is an advantage that is not limited to a place, while it may be difficult to recognize which place the image was taken. This problem is solved by identifying a moving line.

In addition, the display embedded in the smart phone can be received from the surveillance server to check the image taken in some cases (including voice).

In addition, the user's convenience can be provided by providing a user interface that can operate the smart phone, which is an input means of the monitoring system, for its purpose.

1 is a schematic diagram showing a monitoring system using a smart phone according to the present invention.
Figure 2 is a block diagram showing a smart phone for monitoring system related to the present invention.
Figure 3 is a schematic diagram showing a display screen displaying a surveillance mode icon in a smartphone for surveillance system related to the present invention.
Figure 4 is a schematic diagram showing an example of the upper menu displayed when the monitoring mode icon is selected in the smart phone for monitoring system related to the present invention.
Figure 5 is a schematic diagram showing another example of the upper menu displayed when the monitoring mode icon is selected in the smart phone for monitoring system related to the present invention.
Figure 6 is a schematic diagram showing an example of the camera operation sub-menu displayed when the camera operation icon is selected from the upper menu displayed on the smart phone for surveillance system related to the present invention.
7 is a schematic diagram illustrating an example of a recorded video submenu displayed when a recorded video icon is selected from a higher menu displayed on a smart phone for surveillance system related to the present invention.
8 is a schematic diagram showing an example of a monitoring server setting sub-menu displayed when the monitoring server setting icon is selected in the upper menu displayed on the smartphone for monitoring system related to the present invention.
9 is a block diagram showing a monitoring server related to the present invention.
10 is a flowchart illustrating a method of driving a smart phone for surveillance system related to the present invention.
11 is a schematic diagram showing an example in which a surveillance system related to the present invention is operated.

Hereinafter, a monitoring system using a smart phone according to the present invention will be described in more detail with reference to the accompanying drawings.

1 is a schematic diagram showing a monitoring system using a smart phone according to the present invention.

Surveillance system using a smart phone shown in Figure 1 is a smart phone 110 for transmitting the surveillance data including the image data taken by the built-in camera via a wireless Internet network and a surveillance server for receiving and displaying the transmission data 130.

The smart phone 110 combines the advantages of a mobile phone and a personal digital assistant (PDA), integrating data communication functions such as schedule management, fax transmission and reception, and Internet access into a mobile phone function. . The biggest feature is that unlike existing mobile phones that are released as finished products and using only a given function, hundreds of different applications can be installed and added or deleted as desired. By embedding a camera in such a smartphone, it can function as an input means of a surveillance system.

The input means must deliver the input content to the processing means. In the present embodiment, the smart phone corresponding to the input means also needs to transfer the image data captured by the built-in camera to the monitoring server corresponding to the processing means. At this time, for example, the communication method may be one of TCP / IP, UDP / IP, RTST, RTCP, RTP / UDP, and RTP / TCP.

Among them, TCP / IP is composed of IP (Internet Protocol), a packet communication method, and Transmission Control Protocol (TCP), a transmission control protocol. IP does not guarantee the delivery of packets and the order in which packets are sent and received may be different. TCP is a protocol that runs over IP, guaranteeing the delivery of data and receiving it in the order in which it was sent. Since many application protocols based on IP such as HTTP, FTP, and SMTP operate over TCP, they are collectively called TCP / IP.

An IP address (internet protocol address) is used for TCP / IP communication. When communicating using the TCP / IP protocol, an IP address is given to at least the monitoring server as a unique address to distinguish between the sender and the receiver. By transmitting the captured image data by targeting the IP address assigned to the monitoring server as described above, data is transmitted from the input means to the processing means.

Of course, a wireless communication network including a base station, an exchange, and the like is required to connect a smartphone having the characteristics of the wireless terminal to the Internet. Although the communication speed between the smart phone and the monitoring server is limited by the wireless communication network, only the necessary configuration for the Internet connection is required among the complex wireless communication network configurations, so the transmission start speed and the transmission speed are faster than those using only the wireless communication network. The wireless Internet network described herein is a concept including both a wireless communication network and the Internet network may be, for example, Wi-Fi (WiFi).

Through the above configuration, it is possible to use a smartphone as an input means, but it is possible to input image data that is not limited to a place due to the characteristics of a portable smartphone.

Smartphones are typically equipped with a microphone, a voice input means, for voice calls. The smartphone may transmit the audio data input through the microphone together with the image data to the monitoring server during shooting, wherein the data including the image data and the audio data is called surveillance data. Of course, since the main feature of the surveillance system is to display and store the image data, the surveillance data basically includes the image data, and in some cases may further include audio data. Whether to include the voice data in the monitoring data can be selected by the smartphone user.

On the other hand, the monitoring data is transmitted in real time for the purpose of the monitoring system to monitor the current situation of a certain place, the smooth real-time transmission through the wireless Internet network.

The monitoring server 130 is provided with a receiving means for receiving the monitoring data transmitted from the smartphone corresponding to the input means. Such receiving means should be compatible with the wireless Internet network used in the smartphone. For example, in the case of using the TCP / IP method, the monitoring server is provided with an IP address to which the smartphone can be accessed through the Internet. Therefore, the smartphone can access the IP address and the surveillance server receives the surveillance data from the connected smartphone.

The surveillance server includes a display means such as a display and a storage means such as a DVR (Digital Video Recorder) for surveillance purposes.

The display means is a means for displaying the monitoring data transmitted from the smartphone to the monitor, and may include, for example, a visual display means such as a display such as an LCD or a cathode ray tube, and an acoustic display means such as a speaker. In this case, as in the general CCTV, it may not be provided with an acoustic display means. Even when the auditory display means is provided, the auditory display means operates only when the voice data is included in the monitoring data transmitted from the smartphone.

The storage means stores the surveillance data transmitted from the smartphone so that the surveillance data can be reconfirmed later. Such storage means include a VCR, DVR, NVR, and the like. VCR (Video Cassette Recorder) is a method of storing data using a video tape repeatedly recording on the same video tape has the disadvantage of poor image quality and short video replacement cycle. DVR (Digital Video Recorder) was developed to solve the disadvantages of VCR. It uses HDD or Digital Video Disc instead of video tape, so it is easy to play or search the stored screen. It is also convenient for editing and transferring images. If the image data generated by the camera is an analog signal, a means for converting the analog signal into a digital signal is required, and the conversion means may be installed in a smartphone. In general, a camera built into a smartphone is a digital method using an image chip, and thus does not require a separate conversion means. NVR (Network Video Recorder) is a kind of DVR that appeared with the development of the network and has its own IP address. In the case of the NVR, the surveillance data transmitted from the smartphone may be primarily stored in the NVR, and the surveillance data stored in the NVR may be displayed through the display means.

Looking at the above monitoring server is a state containing all means except CCTV camera 151 connected by a cable from CCTV. Therefore, a closed circuit television (CCTV) camera may be used as an additional input means. At this time, input from smartphone should be distinguished from input from CCTV camera. For this purpose, the monitoring server may include a communication channel for a smartphone receiving surveillance data from the smartphone 110 and a communication channel for a CCTV camera receiving image data of the CCTV camera 151.

On the other hand, the monitoring system can display the monitoring data through means other than the monitoring server. For example, when there is a security pawl 150 provided with a display 153 capable of displaying at least image data, the monitoring data may be displayed on the display of the security pawl. For this purpose, the monitoring server may transmit the monitoring data to the security poll. The security pole displays the image data included in the surveillance data on the display, and as a result, provides the information indicated by the image data to the passengers around the security pole.

In order for the content displayed on the display to function as useful information, the image data must be relevant to the passengers around the security pole. For example, if the video data indicates traffic jam due to a traffic accident in area A of Seoul, displaying video data on a security pole installed in Busan may be meaningless. In particular, when a phrase such as 'the situation in Seoul A' is not displayed as a caption of image data, it is inevitable to know where the situation is, so the image data at this time does not function as useful information. Of course, using the GPS receiver built in the smart phone, the surveillance server can provide the exact location of the location (shooting place) of the video data as a caption, but if the location is not a well-known landmark Passengers are not easy to recognize. In addition, even if a passenger recognizes a place that is an object of the image data, it is obvious that the image of a place that is not related to the current location of the passenger may not be of practical help.

Analyzing the above, it can be seen that it is preferable to display the image data only in the security pole located within a certain distance from the shooting place in order for the image data to be helpful to the passenger. For example, if image data of a traffic jam in Seoul's A area is displayed on a security pole near the A area, a pedestrian may recognize the A area. In other words, it functions as useful information for passengers near area A. In addition, passers near area A are likely to be aware of area A, so they do not need to display subtitles.

In this way, in order to display the image data only in the crime prevention pole located near the shooting location, the shooting location must be identified. The shooting location is the location of the smartphone. Therefore, the smartphone must additionally transmit location information to the monitoring server, and the monitoring server must transmit monitoring data only to a security pole located within a set distance from the received location information. At this time, the setting distance may be variously determined in consideration of the characteristics of the place (such as recognition), and is preferably within a radius of 1 km from the location information. If it exceeds 1km, it is difficult to function as useful information for distance.

On the other hand, when a speaker is installed in the security pole, the voice data included in the monitoring data may be additionally displayed.

Hereinafter, the smartphone 110 and the monitoring server 130 will be described in more detail.

2 is a block diagram illustrating a smartphone for monitoring system related to the present invention, which may be the smartphone 110 of FIG.

The smartphone for the surveillance system shown in FIG. 2 includes a camera 111, a surveillance data generator 113 for generating surveillance data including image data captured by the camera, and a terminal identification information to a surveillance server through a wireless Internet network. And a surveillance data transmitter 115 for transmitting the surveillance data in real time.

Camera 111 is embedded in the smartphone for the surveillance system should be able to generate a video corresponding to the real-time video.

The surveillance data generator 113 generates surveillance data including image data captured by the camera. The surveillance data may include audio data in addition to the image data, and a microphone 112 may be additionally installed to acquire the audio data. In this case, the microphone may be a microphone for a voice call or a microphone separately provided for the purpose of obtaining voice data.

The monitoring data generator may convert the monitoring data to be suitable for communication. For example, the video data and the audio data can be converted to enable real-time stream transmission.

The surveillance data transmission unit 115 transmits the surveillance data to the surveillance server in real time. At this time, the transmission uses a wireless Internet network, and the communication method may be, for example, a TCP / IP method. In the case of TCP / IP, monitoring data is transmitted to the IP address assigned to the monitoring server.

In addition, since the monitoring server needs to confirm which monitoring data is transmitted from which smartphone, the terminal identification information of the smartphone is also transmitted. The terminal identification information may be transmitted at the start of transmission of the monitoring data, and may not be further transmitted after the transmission of the monitoring data until the monitoring server requests it. The terminal identification information may include at least one of a unique number hardware assigned to the smartphone and a mobile communication number assigned to the smartphone.

According to the above configuration, the smart phone for monitoring system of the present embodiment can generate monitoring data of a place to be monitored, and also transmit the generated monitoring data to the monitoring server, thus functioning as an input means of the monitoring server. Considering the portability of the smart phone, the smart phone for the monitoring system of the present embodiment functions as an input means that is not limited to a place and can be used for various purposes. For example, it is possible to proactively photograph and provide traffic jams and crime scenes in areas where CCTV is not installed, and can be used for providing various road information, preventing crime, and securing evidence of crime.

Location information and time information may be required for the monitoring data to function as more useful information. This is because the function as useful information is halved if the monitoring data generated by the smartphone cannot be recognized at what place and at what time.

Therefore, the apparatus may further include a GPS receiver 116 for generating location information and a clock 117 for generating time information. The location information generated by the GPS receiver and the time information generated by the watch are transmitted to the monitoring server by the monitoring data transmitter. Location information and time information may be transmitted according to a period set as an element to be continuously transmitted to the monitoring server. Of course, it may be transmitted in real time, but by increasing the overall amount of data transmitted to the monitoring server may be a limiting factor in real-time transmission, the load of the smartphone in the process of identifying the location information and time information in real time Should be considered.

The period can be set on the monitoring server or set by the smartphone user within the range specified by the monitoring server. The range specified by the surveillance server can be changed to a range that can smoothly track the movement of the smartphone.

On the other hand, time information may also be generated via GPS, in which case the watch may be integrally formed with the GPS receiver. The time information may not be transmitted in consideration of the fact that the monitoring data is transmitted in real time and that a clock is installed in the monitoring server that receives the monitoring data. However, if a delay or the like occurs in the real-time transmission process, there may be a difference between a time for generating a predetermined image and a time for receiving the image from the monitoring server. In addition, even if the transmission is normally, the time of the smartphone location and the time of the monitoring server location may vary according to the time difference. Therefore, it is desirable to transmit the time-oriented information on the sending side (smartphone) together with the location information.

By transmitting the location information and time information together with the monitoring data in this way, the monitoring server can determine which place and at what time the transmitted monitoring data is generated.

Meanwhile, the smartphone user may want to check the surveillance data stored in the surveillance server.

To this end, the terminal display 119 and the data analyzer 118 may be further included.

In order to receive the surveillance data stored in the surveillance server (stored surveillance data), it is required to first transmit the previously stored surveillance data to the surveillance server. This request is performed in the surveillance data transmission unit. When the surveillance server receives the request and transmits the previously stored surveillance data, the surveillance data transmitter receives the surveillance data and delivers the surveillance data to the data analyzer.

The data analyzer 119 extracts image data from the received surveillance data and transmits the image data to the terminal display 118. By displaying the image data transmitted from the terminal display, the user confirms the previously stored monitoring data. If voice data is included in the pre-stored monitoring data, the speaker 114 should be provided. Of course, the data analyzer should also extract the voice data from the pre-stored monitoring data and deliver it to the speaker. In this case, the speaker may be a speaker used for a voice call, or may be a speaker separately provided to output only voice data included in pre-stored monitoring data.

On the other hand, even if the surveillance server receives a request from the smartphone, the surveillance data transmitted from the other user's smartphone and the video data transmitted from the CCTV camera should not be the pre-stored surveillance data.

To this end, the monitoring server requests the terminal identification information of the requesting smartphone or includes the terminal identification information in the request to distinguish the requesting smartphone from other smartphones or CCTV cameras. The server storage unit checks whether there is surveillance data previously transmitted by the divided smartphones (surveillance data pre-stored in correspondence with the terminal identification information), and extracts the stored surveillance data according to the verification result and transmits it as the stored surveillance data. do. Accordingly, the monitoring data transmission unit receives the previously stored monitoring data corresponding to the terminal identification information from the monitoring server. The monitoring server may transmit a guide message, for example, "there is no requested data" when there is no pre-stored monitoring data corresponding to the terminal identification information. The guide message is also received by the monitoring data transmitter, analyzed by the data analyzer, and displayed on the terminal display.

On the other hand, a user interface may be provided to use the smart phone for the monitoring system of the configuration described in the above embodiment.

A controller (not shown) for providing a user interface is provided, in which the controller can control each component described above.

3 is a schematic diagram showing a display screen displaying a surveillance mode icon in a smartphone for a surveillance system related to the present invention. The display at this time may be the terminal display 119 described above. Figure 4 is a schematic diagram showing an example of an upper menu displayed when the monitoring mode icon is selected in the smart phone for surveillance system related to the present invention, Figure 5 is a schematic diagram showing another example.

First, the controller displays a monitoring mode icon 310 on the terminal display screen to distinguish functions such as voice call and document creation from input means functions of the monitoring system. In this case, the monitoring mode icon may be part of a menu displayed according to the selection of the additional menu 390 in the smartphone.

When the monitoring mode icon 310 is selected by the user, the control unit may include a camera operation icon 330 for operating the camera, a recorded video icon 350 for receiving and playing pre-stored surveillance data from the monitoring server, and the monitoring server as shown in FIG. 4. The upper menu including the monitoring server setting icon 370 for establishing a connection with the terminal is displayed on the terminal display. At this time, the size and location of each icon can be changed in various ways, and as shown in FIG. 5, phrases such as 'camera operation', 'recorded video', and 'monitoring server setting' can be displayed separately from the icon. Of course, when the phrase and the icon is separated, the display should be made so that the user can recognize which phrase corresponds to each icon.

Meanwhile, a phrase such as 'monitoring mode' indicating that the monitoring mode is displayed may be displayed at a position not overlapping with each icon included in the upper menu. In FIGS. 4 and 5, the phrase 'monitoring mode' is displayed directly below the antenna information and the battery information of the smartphone displayed on the top of the screen.

The user interface when each of the camera operation icon, the recorded video icon, and the monitoring server setting icon displayed by selecting the monitoring mode icon is selected is as follows.

6 is a schematic diagram illustrating an example of a camera operation submenu displayed when a camera operation icon is selected from a higher menu displayed on a smart phone for surveillance system related to the present invention. FIG. 7 illustrates an example of a recorded video submenu displayed when a recorded video icon is selected in a higher menu, and FIG. 8 illustrates an example of a monitored server setting submenu displayed when a monitored server setting icon is selected in a higher menu.

When the camera operation icon 330 is selected in the upper menu of FIG. 4 or 5, the controller drives the camera 111, the surveillance data generator 113, and the surveillance data transmitter 115. That is, when the camera operation icon is selected, the surveillance data is generated and transmitted to the surveillance server. In this state, the camera operation submenu displayed on the terminal display 119 may include a shooting display area 331, a flag setting menu area 333, and a regression menu area 335 as shown in FIG. 6. Can be.

The shooting display area 331 is an area where image data shot by the camera is displayed, and its size and position may be changed in various ways. Surveillance data being transmitted may include voice data generated by the microphone, but the voice data may not be output through the speaker. This is because the user who is shooting through the smartphone is listening to the voice directly at the shooting site.

The flag setting menu area 333 sets a flag for classifying surveillance data that is already being transmitted. The flag is used to classify surveillance data at the surveillance server. Flags can be classified, for example, as an emergency situation representing an emergency situation encountered by a smartphone user, an illegal situation representing an illegal situation viewed from a third party's perspective, an accident situation such as a traffic accident, and other situations. If such a flag is provided, the surveillance server may classify and store / manage the surveillance data into four categories: emergency situation, illegal situation, accident situation, and other situations. Emergency, illegal and accident situations are urgent, so when a flag indicating such a situation is detected, the surveillance server can display detection data with flag detection by distinguishing it from surveillance / video data of other smartphones or CCTV cameras. . For example, the image data may be enlarged and displayed, a red border may be displayed, or a warning sound may be output.

If the flag is not selected, it may be classified into other situations.

In a smartphone, a plurality of flags can be generated / set in the same monitoring data. For example, you can select an emergency flag and then an illegal flag. In this case, the surveillance data may be classified by the first input flag, and the later input flag may be used for the section search during the reconfirmation / search of the surveillance data. If the monitoring server selects an illegal situation while reconfirming the emergency monitoring data, the monitoring server can move directly to the section where the illegal situation flag is located.

The flag may be embedded in a predetermined bit assigned to the surveillance data.

When the camera operation submenu is displayed, a phrase indicating the camera operation mode, for example, 'camera' may be displayed on a certain area of the display. In FIG. 6, 'camera' is displayed in the same row as that in which the 'monitoring mode' is displayed.

In the regression menu area 335, an icon for returning to the upper menu where the camera operation icon, the recorded video icon, and the surveillance server setting icon is displayed, for example, an 'end' icon is displayed.

When the recorded video icon 350 is selected in the upper menu of FIG. 4 or 5, the controller drives the surveillance data transmitter 115 and the data analyzer 118 to receive previously stored surveillance data from the surveillance server. The monitoring data transmitting unit 115 and the data analyzing unit are driven at the same time as the selection of the recording video icon, but is performed according to whether the recording video submenu displayed when the recording video icon is selected.

As shown in FIG. 7, the recorded video submenu includes a time selection menu area 351, a request menu area 353, a recorded video display area 355, a playback menu area 357, and a regression menu area 359. can do.

The time selection menu area 351 allows to select a time corresponding to the monitoring data to be reproduced from the previously stored monitoring data. As described above, the pre-stored surveillance data that can be received from the surveillance server in a predetermined smartphone is limited to the surveillance data previously transmitted by the smartphone. Even in such a situation, since there may be a plurality of pre-stored monitoring data satisfying the conditions that can be transmitted, the user should search for the desired data. Looking at the monitoring data transmitted from the smartphone to the monitoring server, since the user-written comment is not added separately, the search using the comment is difficult. Although flagged, this is for the monitoring server and is not intended to facilitate future searches by users. Therefore, instead of searching using the comment or the like, a menu for searching using time is provided in the time selection menu area. The time selection menu area consists of a detailed menu for selecting year, month, day and time. For example, you can enter 6:37 PM on August 4, 2008.

The request menu area 353 is an area for requesting the monitoring data transmission unit 115 to receive previously stored monitoring data of the time selected in the time selection menu area from the monitoring server. For example, as shown in FIG. 7, the request menu area may be a 'search' icon. When the request menu area is selected, the surveillance data transmitter 115 is driven, and the data analyzer 118 is also driven to extract video data and audio data from previously stored surveillance data transmitted from the surveillance server. In this case, the pre-stored monitoring data transmitted from the monitoring server may be corresponding data.

The corresponding data is for the convenience of the user. If you select the request menu area while entering the selected time in the time selection menu area, for example, August 4, 2008, 6:37 pm, the monitoring server extracts and transmits the stored monitoring data corresponding to the selected time. . However, it is virtually difficult to remember exactly when the user previously created / sent the surveillance data. Therefore, there may be no pre-stored monitoring data corresponding to the selected time. In such a situation, it may be harsh to require the user to enter the correct date and time. For this reason, if there is no pre-stored monitoring data corresponding to the selected time, the monitoring server may extract and transmit the pre-stored monitoring data closest to the selected time. The data thus transmitted is the corresponding data. That is, the corresponding data may be pre-stored monitoring data corresponding to the selected time as pre-stored monitoring data transmitted from the monitoring server when the request menu area is selected, or may be pre-stored monitoring data of a time closest to the selected time.

The recorded image display area 355 is an area in which the image data extracted by the data analyzer is reproduced among the received corresponding data. When the voice data is included in the corresponding data, the data analyzer may extract the voice data and deliver the voice data to the speaker.

The playback menu area 357 is an area where detailed menus for controlling playback of the recorded video display area are displayed. The detailed menu may include rewind (<<), reverse play (<), forward play (>), fast forward (>>), pause (II), stop (ㅁ), and the like.

The regression menu area 359 is an area where an icon for returning to the upper menu when a selection is displayed.

When the monitoring server setting icon 370 is selected in the upper menu of FIG. 4 or 5, the controller controls the IP address input area 371, the storage menu area 373, and the regression menu area 375 as shown in FIG. 8. You can display the monitoring server configuration submenu that includes.

The IP address input area 371 is an area for inputting the IP address of the surveillance server to which the surveillance data is to be connected for transmitting the surveillance data. By displaying a blinking cursor in the IP address input area, it can indicate that the IP address can be entered. Of course, the monitoring server and smartphone at this time should be the case using the Internet network using the IP address.

The storage menu area 373 is an area where an icon for storing the IP address input in the IP address input area is displayed. In FIG. 8, the 'save' icon corresponds to this.

The regression menu area 375 is an area where an icon for returning to a higher menu, for example, an 'end' icon is displayed.

The operation of the smart phone for monitoring system described above is summarized in FIG. 10.

10 is a flowchart illustrating a method of driving a smart phone for surveillance system related to the present invention.

First, determine whether the monitoring mode is selected (S510). The selection of the monitoring mode means that the monitoring mode icon is selected.

When the monitoring mode is selected, an upper menu including icons such as a camera operation, a recorded image, and a monitoring server setting is displayed (S520).

When the camera operation is selected in the upper menu (530), the camera is driven and the microphone is driven in some cases. In addition, the monitoring data generating unit and the monitoring data transmission unit are driven to connect with the monitoring server and to transmit the monitoring data. Along with the transmission of the monitoring data, the terminal identification information is also transmitted along with the location information and the time information in some cases (S540).

If the flag is selected (S550), the selected flag is generated and transmitted together with the surveillance data (which may be embedded in the surveillance data) so that the surveillance server can efficiently manage the surveillance data (S560).

When the recorded video is selected in the upper menu (S 570), a sub-menu related to the recorded video is displayed, selecting a desired time using the sub-menu, and instructing a request to the monitoring server (S 580), analyzing the surveillance data transmission unit and data. The additional driving is performed to receive the pre-stored monitoring data from the monitoring server (S590). The previously stored monitoring data thus received is displayed on the terminal display.

When the monitoring server setting is selected in the upper menu (S 600), a menu for inputting an IP address of the monitoring server is displayed. When the IP address is input and stored in the menu displayed as described above (S610), the monitoring server to be connected is determined when the camera operation or the recorded video is selected. If the upper menu does not select each icon within a certain time, it can automatically return to the previous menu. The same is true for each submenu.

An example of the smartphone corresponding to the input means in the monitoring system using the smartphone has been described above, and an example of the monitoring server corresponding to the processing means will be described below.

9 is a block diagram showing a monitoring server related to the present invention.

The monitoring server illustrated in FIG. 9 includes a server communication unit 131, a server data analysis unit 133, a server image monitoring unit 135, and a server storage unit 137.

The server communication unit 131 receives the surveillance data and the terminal identification information including the image data captured by the built-in camera from the smartphone through the wireless Internet network. The server communication unit opens a channel for supporting communication with the smartphone. The input means managed by the surveillance server may be a plurality of smartphones or additionally include a CCTV camera. The server communication unit may include a channel assignment module to support a plurality of smartphones using limited channels. When using a CCTV camera in addition to the smartphone as an input means, the server communication unit may include a communication channel for the smartphone receiving the surveillance data from the smartphone and a communication channel for the CCTV camera receiving the image data of the CCTV camera. At this time, the server image monitoring unit 135 should be able to display the image data of the CCTV camera in the display area allocated to the CCTV camera, the server storage unit should be able to store the image data of the CCTV camera.

The server data analyzer 133 extracts image data from the surveillance data transmitted from the smartphone. The surveillance data may further include voice data, which is also extracted from the server data analyzer. Since the extracted audio data is meaningful when played back with the extracted image data, the extracted audio data is stored together with the image data in the server storage unit. The server voice monitoring unit 139 such as a speaker for displaying the voice data may be further included to display the extracted voice data. At this time, the voice data displayed through the server voice monitoring unit should correspond to the display of the image data. This is to ensure that the video data and audio data generated at the time of the incident scene are reproduced through the server video monitoring unit and the server audio monitoring unit as they are.

The server image monitoring unit 135 displays image data extracted by the server data analyzer in a display area corresponding to the terminal identification information. For example, the server video monitoring unit includes a display such as an LCD and a CRT and an image control unit for controlling the display. The display area may be a plurality of screens for displaying image data transmitted from an input means such as a smartphone / CCTV camera. To display a plurality of display areas, a plurality of displays may be configured or one display screen may be divided into a plurality of areas. Of course, you can mix the two. The server video monitoring unit may also allocate a display area for the CCTV camera when the CCTV camera is additionally provided as an input means.

The server storage unit 137 stores image data separately from image data of another smartphone by using terminal identification information. If the flag data is included in the image data, the image data may be reclassified and stored according to the flag information in a state of being separated through the terminal identification information. The server storage unit may be, for example, at least one of a VCR, a DVR, and an NVR. In addition to the video data of the smartphone, the server storage unit may also store audio data included in the surveillance data, and may store video data of a CCTV camera. If the video data of the CCTV camera is in analog format, it may be advantageous to store it in a VCR.

On the other hand, an external transmitter 138 for transmitting the data (image data, audio data) extracted from the server data analysis unit to the security poll may be added. The security pole should be equipped with a display capable of displaying at least image data, and in addition, if a speaker is provided, audio data can also be displayed.

At this time, the external transmission unit may transmit the data extracted by the server data analysis unit only to the security poll within a set distance from the place where the monitoring data is generated. The reason for this is that the monitoring data displayed in the security pole is useful information to nearby passengers. To do this, the location information of the smartphone located at the place where the surveillance data is generated should be transmitted through the server communication unit. If the smartphone does not transmit the location information in advance, the smartphone may be requested to transmit the location information.

When a smartphone is an input means, it is necessary to know the generation place and generation time of monitoring data. To this end, the server communication unit 131 may periodically receive the location information and time information of the smartphone. The copper wire of the smart phone may be tracked by using the received location information and time information. The copper line tracking unit 136 is additionally provided for this purpose. The moving line tracking unit may display the moving line on the electronic map by combining location information and time information transmitted for each period. The electronic map and the moving line may be displayed on the server video monitoring unit.

Meanwhile, the smart phone may request to transmit previously stored monitoring data stored in the server storage unit 137. Such a request is received through the server communication unit and delivered to the server data extraction unit 134 which is additionally provided. The server data extracting unit extracts previously stored monitoring data requested by the smartphone from the server storage unit.

The server communication unit transmits the extracted previously stored monitoring data to the smartphone.

An example of the surveillance system operation described above is shown in FIG. 11.

11 is a schematic diagram showing an example in which the monitoring system related to the present invention is operated.

For example, when an assault accident occurs, when surveillance data is transmitted from a smartphone (including a CCTV camera) photographing the assault site, it is treated as an emergency by the observer who confirms it on the surveillance server. If the 'emergency' flag is sent from the smartphone, it can be automatically handled as an emergency. In case of emergency, the video of surveillance data corresponding to the accident scene image is automatically popped up. As a result, watchers can gain real-time insight into site conditions and respond appropriately. In addition, suspect confirmation and suspect information can also be easily obtained.

If necessary, transmit security polo surveillance data near the smartphone (near the accident site). In this case, a passenger who can confirm the monitoring data displayed on the crime prevention pole can report the suspect, and as a result, the assault offender can be easily arrested. In addition, since the image of the accident scene can be confirmed, a pedestrian can take appropriate measures such as avoidance and pursuit. In addition, the surveillance server edits the image of the assault offender and provides it to a crime prevention pole or a police station to facilitate the arrangement of the suspect.

On the other hand, those skilled in the art will appreciate that the present invention can be implemented in other specific forms without changing the technical spirit or essential features. Therefore, the above-described embodiments are to be understood as illustrative in all respects and not as restrictive. The scope of the present invention is shown by the following claims rather than the detailed description, and all changes or modifications derived from the meaning and scope of the claims and their equivalents should be construed as being included in the scope of the present invention. do.

For example, the user interface of a smartphone for a surveillance system can change variously the shape, size, arrangement position, etc. of an icon.

Applicable to surveillance systems requiring dynamic input means.

It is particularly useful for surveillance systems that need to monitor various locations.

In addition, it can be implemented without additional equipment to the existing CCTV.

110 Smartphone 111 Camera
112 ... Mike 113 ... Monitoring data generator
114 Speakers 115 Monitoring data transmission
116 GPS receiver 117 Clock
Data analysis section 119 Terminal display
130 Monitoring server 131 Server communication unit
133 Server data analysis section 134 Server data extraction section
135 ... server video monitoring unit
137 Server storage section 138 External transmission section
139 ... Voice monitor 150 ... Security pole
151 ... CCTV camera 153 ... display

Claims (21)

A smart phone for transmitting surveillance data including image data captured by an internal camera and its location information in real time through a wireless internet network;
A surveillance server for receiving, displaying and storing the surveillance data; And
A security pawl having a display for displaying at least said image data, said image providing said image displayed on said display to nearby passengers;
And the monitoring server transmits the surveillance data to the crime prevention polo located within a set distance from the location information transmitted by the smartphone.
The method of claim 1,
The wireless Internet network is a monitoring system, characterized in that using at least one of TCP / IP, UDP / IP, RTST, RTCP, RTP / UDP, RTP / TCP.
The method of claim 1,
Further includes a CCTV (Closed Circuit Television) camera,
The monitoring server,
A communication channel for a smartphone receiving the surveillance data from the smartphone; And
Surveillance system using a smartphone, characterized in that it comprises a communication channel for CCTV camera receiving the video data of the CCTV camera.
delete delete The method of claim 1,
In the smartphone,
camera;
A surveillance data generator configured to generate surveillance data including image data captured by the camera; And
A monitoring data transmission unit for transmitting terminal identification information to a monitoring server through a wireless Internet network and simultaneously transmitting the monitoring data;
Surveillance system using a smartphone comprising a.
The method according to claim 6,
The smartphone further includes a microphone,
The monitoring data is a surveillance system using a smartphone, characterized in that further comprises the voice data input to the microphone.
The method according to claim 6,
In the smartphone,
A GPS receiver for generating location information; And
A clock for generating time information;
The monitoring data transmission unit using the smart phone, characterized in that for transmitting the location information and the time information to the monitoring server according to a set period.
9. The method according to any one of claims 6 to 8,
Terminal display; And
Further comprising a data analysis unit,
The monitoring data transmission unit receives the pre-stored monitoring data corresponding to the terminal identification information from the monitoring server,
The data analyzer extracts the image data from the received surveillance data and delivers the image data to the terminal display.
The terminal display is a surveillance system using a smartphone, characterized in that for displaying the transmitted image data.
The method of claim 9,
In the smartphone,
Further includes a speaker,
The data analyzer extracts the voice data from the received monitoring data and delivers it to the speaker,
The speaker is a surveillance system using a smartphone, characterized in that for displaying the transmitted voice data.
11. The method of claim 10,
In the smartphone,
Further comprising a control unit for displaying a monitoring mode icon on the terminal display by the user's selection,
When the monitoring mode icon is selected, the controller
A camera operation icon for operating the camera;
A recorded video icon which receives and reproduces previously stored surveillance data from the surveillance server; And
Surveillance server setting icon for establishing a connection to the surveillance server; Surveillance system using a smartphone, characterized in that for displaying the upper menu on the terminal display.
The method of claim 11,
The controller drives the camera, the surveillance data generator, and the surveillance data transmitter when the camera operation icon is selected.
A shooting display area displaying image data shot by the camera;
A flag setting menu area for setting a flag for classifying the image data; And
A regression menu area for returning to the upper menu; displaying a camera operation lower menu on the terminal display.
The method of claim 11,
The controller drives the surveillance data transmitter and the data analyzer when the recorded video icon is selected,
A time selection menu area for selecting a time corresponding to the monitoring data to be reproduced from the previously stored monitoring data;
A request menu region for requesting the surveillance data transmission unit to receive corresponding data of the selected time from the previously stored surveillance data;
A recorded image display area in which the image data extracted by the data analyzer of the received corresponding data is reproduced;
A playback menu area for controlling the playback; And
A regression menu area for returning to the upper menu; displaying a recorded video lower menu on the terminal display.
The method of claim 11,
The controller, if the monitoring server setting icon is selected,
An IP address input area for inputting an IP address of the monitoring server;
A storage menu area for storing the input IP address; And
And a regression menu area for returning to the upper menu. The monitoring system using a smartphone, wherein the monitoring server setting lower menu is displayed on the terminal display.
The method of claim 1,
The monitoring server,
A server communication unit for receiving surveillance data including image data captured by a built-in camera from a smartphone and terminal identification information of the smartphone through a wireless Internet network;
A server data analyzer extracting the image data from the surveillance data;
A server image monitoring unit displaying the image data in a display area corresponding to the terminal identification information; And
A server storage unit for storing the image data separately from the image data of another smartphone using the terminal identification information;
Surveillance system using a smartphone comprising a.
The method of claim 15,
The server data analysis unit further extracts the voice data when the monitoring data includes voice data.
The server storage unit stores the audio data with the image data,
And a server voice monitoring unit for displaying the voice data in correspondence with the display of the image data.
The method according to claim 15 or 16,
The server communication unit is a smartphone communication channel for receiving the monitoring data from the smartphone; And
Includes; Communication channel for the CCTV camera to receive the image data of the CCTV camera,
The server video monitoring unit displays the video data of the CCTV camera in the display area assigned to the CCTV camera,
The server storage unit surveillance system using a smartphone, characterized in that for further storing the image data of the CCTV camera.
The method according to claim 15 or 16,
The monitoring server,
Security polo equipped with a display for displaying at least the image data Surveillance system using a smartphone, characterized in that it further comprises an external transmission unit for transmitting the data extracted from the server data analysis unit.
The method of claim 18,
The server communication unit further receives the location information of the smartphone,
The external transmission unit is a monitoring system using a smartphone, characterized in that for transmitting the extracted data only to the security pole within a set distance from the location information.
The method according to claim 15 or 16,
The server communication unit further receives the location information and time information of the smartphone,
Surveillance system using a smartphone characterized in that it further comprises a copper wire tracking unit for tracking the copper wire of the smart phone by using the location information and the time information.
The method according to claim 15 or 16,
The server storage unit further comprises a server data extraction unit for extracting the pre-stored monitoring data requested by the smartphone,
The server communication unit receives a request to transmit the pre-stored surveillance data from the smartphone to the server data extraction unit and transmits the pre-stored surveillance data extracted from the server data extraction unit to the smartphone Surveillance system.

Images