KR20120013864A

KR20120013864A - System and method for smart safety service using mobile phone, user profile, and service server

Info

Publication number: KR20120013864A
Application number: KR1020100081129A
Authority: KR
Inventors: 오종택
Original assignee: 오종택
Priority date: 2010-08-05
Filing date: 2010-08-22
Publication date: 2012-02-15

Abstract

PURPOSE: A smart relaxing service system and method thereof using a portable terminal, user profile, and a service server are provided to take follow-up action by transmitting an abnormal signal to a server. CONSTITUTION: A controller(12) of a portable terminal(11) controls a mobile communication unit in order to connect the mobile communication unit to an internet access unit(53) of a server(51) through the Internet. A microphone collects sound information of a user according to a control command of the user. A user recognition apparatus(31) collects video information of the user by operating a camera according to a controller(32).

Description

System and method for smart safety service using mobile phone, user profile and service server {System and method for smart safety service using mobile phone, user profile, and service server}

The present invention is to provide a smart assured service using a smart phone and a user profile, a smart assured service server in order to manage the safety state of the user, more specifically, the name, address, schedule, visit, User profiles such as movement route and emergency contact information are stored in advance, and when the user lives daily, the user can use a location measuring device such as a GPS receiver built in a mobile phone or a short range wireless communication method such as a wireless LAN installed around the living space. Recognizes location information and compares it to profile information stored in the mobile phone and informs the smart security service server through the mobile communication or wireless LAN communication of the mobile phone and sends the video data of the surveillance camera installed near the user to the server. Collect situation information such as sending to In addition, the server relates to a method and system for inferring an emergency situation by analyzing information such as a user's profile, past life patterns or surrounding conditions, and taking follow-up actions according to the result.

[Document 1] matches not only the ID signal of the wireless recognition tag but also the image signal photographed by using an image collecting device such as a camera to recognize the object to be recognized to further improve the accuracy of the object and store only the necessary information. It is an object to provide a device capable of doing so. In addition, the main configuration of the apparatus according to the cited invention, the wireless recognition means for recognizing the ID of the radio recognition tag, the image acquisition apparatus for capturing the image, the image server for capturing and storing the image taken from the camera, in the radio recognition means A read control unit which reads an ID of a wireless identification tag and sends a trigger signal to the image collecting device, a data server for matching and storing the ID of the wireless identification tag with an image stored in the image server, and monitoring a matching signal stored from the data server And a control unit for controlling.

[Document 2] aims to provide an apparatus and method for recognizing behavior patterns capable of collecting image information regardless of a specific place. According to the present invention, an information collecting unit including a camera capable of capturing a video, an emergency signal generating unit, a normal behavior pattern storing unit storing normal behavior pattern information data, and received from the information collecting unit

An image information analysis unit for analyzing the image information signal to be included, and includes an information processing unit for transmitting and receiving wirelessly with the information collecting unit, The image information analysis unit is the up, down, left, right, rotation, Analyzes behavior patterns based on forward and backward movements, and the information collector may be worn on a part of the body.

Various methods using mobile phones or surveillance cameras have been attempted to prevent crimes such as kidnapping or kidnapping and user safety. However, as fragmentary technologies are used, they do not have a practical effect.

[Document 1] Domestic Patent Registration No. 10-0382664, Object Recognition and Measurement Device Using Image and Wireless Recognition [Document 2] Domestic Patent Registration No. 10-0961476, Behavior Pattern Recognition Apparatus and Method

The above-mentioned cited documents are for accurately recognizing an object using a wireless communication method and an image camera, or for recognizing a behavior pattern of a user. The following points are different from the present invention.

Citation [1] provides a function of acquiring image information by controlling an image camera and then storing it in an image server after detecting that an object to be recognized is accessed by using RFID. The purpose and configuration are very different from the Smart Assurance Service, which must recognize the safety status of an unspecified user and take appropriate action based on the information.

In [Reference 2], a small camera is attached to the user's body, and the image information collected through the process is continuously processed. From this information, the user's behavior pattern information is estimated. The transmission to a third party puts a heavy burden on continuous image information processing, and the difference in purpose and composition from a smart security service is very large.

The present invention has been proposed to solve the above problems, the user's name, address, schedule, visit, movement route, emergency contact information, and the like stored in advance in the user's mobile phone, if the user's daily life, Recognizes the user's location information by using a location meter such as a built-in GPS receiver or a short-range wireless communication method such as a wireless LAN installed around the living space, and compares the user profile information stored in the mobile phone with Notify the smart assured service server through mobile communication or wireless LAN communication, collect the surrounding situation information by transmitting the video data of the surveillance cameras installed around the user to the server, and the server, such as the user's life patterns and surrounding conditions Analyze the information to infer an emergency Depending on the results it is an object to which to follow up.

For example, a user's name, home address, work address, visit address, travel route, day's schedule, and emergency contact information are entered in advance in a mobile phone that the user always carries. You can enter the schedule by using the mobile phone's schedule management function or by accessing the smart reliable service server via the Internet. The server and the mobile phone are always connected by short-range wireless communication such as mobile communication or wireless LAN, and the user profile information stored in the mobile phone and the server is always synchronized. When you carry your mobile phone and move outdoors, your mobile phone has a built-in GPS receiver so that your phone always knows where you are. Also, the location of your nearest AP, nearby camera location or IP address, Since the wireless LAN profile information including the security guard of the current location or the contact of the police in charge, etc. is broadcasted, the location of the user can be determined even indoors.

If the mobile phone compares the stored profile information with the current user's location, it determines that it is abnormal and transmits the abnormal signal to the smart assured service server through mobile communication or wireless LAN. Or, when the mobile phone receives the place information to be watched by the smart assured service server to the mobile phone by the mobile communication method or the short-range wireless communication method, the mobile phone stores the information and determines that it is abnormal when the user enters the area with the mobile phone. And send an abnormal signal to the server.

The abnormal signal transmitted by the mobile phone to the server includes information such as the user's name, current location, and movement route.If the wireless LAN profile information is received from a nearby WLAN, the location of the nearest camera, IP address, Includes additional information such as security guards and police officer contact details. The server that receives the data is connected to the surveillance camera around the user to acquire and store the video information about the user, and the user's profile, life pattern and history information, schedule, movement route, period of stay in an abnormal place, time of occurrence of abnormality, It analyzes the place of occurrence of abnormality, video information, etc. to infer the emergency situation. In case of emergency, immediately notify emergency contact and security guards near the user and police.

In addition, after receiving the abnormal signal, the server operates the microphone or camera built in the mobile phone to collect sound and image information around the user, can be used to infer whether or not an emergency situation.

In addition, the server may store all the IDs of the owners of the mobile phones in the vicinity of the user through the mobile communication network for a certain period of time when receiving the abnormal signal, and store all the IDs of the owners of the mobile phones near the WLAN AP in the vicinity of the user for a certain period of time. It may be. In addition, the camera installed at any point is recognized, but the owner of the mobile phone that is not recognized by the WLAN AP installed in the same place is regarded as a person who needs attention, and stores the video information in the server and continuously tracks it by means of video recognition. If any abnormal behavior is detected, immediately notify the guard or police.

In addition, the user recognition device may optionally include a position measuring device such as a GPS receiver to recognize the location of the user recognition device by itself, and broadcast this information as a part of the WLAN profile to a mobile phone nearby via the wireless LAN communication unit, or through the Internet connection unit. By sending its location and IP address to the smart assured service server, the smart assured service server can know the location of the user recognition device.

On the other hand, when the service server does not communicate with the user's mobile phone, it infers the emergency situation by comprehensively considering the user's final location environment, time, movement route, schedule, etc. Raise the attention level.

When installing a wireless LAN AP at the entrance of the apartment, the door can be opened or passed only when the apartment residents carry a mobile phone. That is, by communicating with the wireless LAN AP installed in the entrance and mutual authentication, it is confirmed that the apartment residents and control the door connected to the AP. In addition, when a camera and a wireless LAN AP are installed at the entrance of an apartment complex or a parking lot, a person who is not a resident can pass through and detect the inspection. In other words, when the camera is recognized by a person, but does not have a mobile phone or the authentication information stored in the mobile phone does not match, the server may detect this and generate an alarm signal.

Other objects and advantages of the present invention can be understood by the following description, and will be more clearly understood by the embodiments of the present invention. Also, it will be readily appreciated that the objects and advantages of the present invention may be realized by the means and combinations thereof indicated in the claims.

The system of the present invention for achieving the above object, in the smart security service system using a mobile phone and a user profile, a service server, under the control of the control unit, built-in a mobile communication function and a position measuring device and the user's name or address, schedule, prediction A mobile phone that stores a user profile such as a movement path and sends an abnormal signal to an authenticated smart security service server when the current location is not intended; And if the abnormal signal is received from the mobile phone through the mutual authentication process, or if the estimated path and current location inferred by analyzing the user's moving path of the usual, the current location information and the user's profile stored in the server Or it may be inferred whether the user's emergency situation using the history information, information around the user, and in case of an emergency, characterized in that it comprises a smart security service server that notifies the emergency contact and police registered in advance.

In addition, in the smart assured service system using a mobile phone, a user profile, and a service server, a built-in camera or a short-range wireless communication unit under the control of the control unit communicates with the user's mobile phone through an authentication function and searches for a user profile stored in the mobile phone. It further includes a user recognition device that confirms the user's identity, informs the current location of the mobile phone, or transmits the video information collected by the built-in camera to the authorized smart security service server when an abnormal signal is generated from the mobile phone. Characterized in that.

On the other hand, the method of the present invention, in the smart assured service method using a mobile phone and a user profile, a service server, under the control of the control unit of the mobile phone built in a mobile communication function and a position measuring device of the user's name or address, schedule, expected movement route Storing a user profile, etc., and transmitting an abnormal signal to an authenticated smart security service server when the current location is not intended; And if the abnormal signal is received from the mobile phone through the mutual authentication process, or if the estimated path and current location inferred by analyzing the user's moving path of the usual, the current location information and the user's profile stored in the server Or inferring whether the user is in an emergency state using history information, information around the user, and in case of an emergency, notifying the emergency contact information and the police registered in advance.

In addition, in the smart assured service method using a mobile phone, a user profile, and a service server, a camera or a short-range wireless communication unit is built in under the control of a control unit of a user recognition device to communicate with the user's mobile phone through an authentication function and stored in the mobile phone. Search the user profile to check the identity of the user, notify the user of the current location of the mobile phone, or send an image signal collected by the built-in camera to the authorized smart security service server in case of abnormal signal from the mobile phone Characterized in that it further comprises the step.

As described above, the present invention is based on mobile phone, GPS, and the user's estimated moving path information stored in the mobile phone. Therefore, when the mobile phone differs from its own location and the estimated location, the mobile device transmits an abnormal signal to the server, so that subsequent actions are performed. It does not require the cost of infrastructure construction, which is a very practical way. The server does not always monitor all users, which reduces the cost of building a server.

In addition, when a web camera infrastructure with a built-in camera is built in the WLAN AP, the mobile phone and the web camera infrastructure have a synergistic effect, thereby enabling the effective implementation of smart security services.

1 is a smart security service conceptual diagram according to the present invention.
2 is an example of a smart security service system block diagram using a mobile phone and a user profile, a service server according to the spirit of the present invention.

1 is a conceptual view of smart security service according to the present invention, when the user is carried away with a mobile phone is abducted or kidnapped, so that it is out of the schedule of daily life, so that it is monitored through a camera around the service server to inform the service server The police will be notified of the location of the police. Or recognize the criminal's mobile phone around the user to identify and arrest him. If the culprit does not carry a cell phone, the culprit is recognized by the camera, but the cell phone is not recognized, so it is judged as a person of interest and closely observed through the camera or the police. In addition, if the user's smartphone is not connected to the server, observe the rating carefully as time goes by. Reasoning engine technology is very important in determining the emergency situation such as kidnapping or kidnapping based on various information obtained from smart security service server.

2 is an example of a smart security service system block diagram using a mobile phone, a user profile, and a service server according to the spirit of the present invention. The mobile phone 11, the user recognition device 31, and the smart security service server 51 are detailed. The structure is described. The mobile phone 11 includes a control unit 12, a mobile communication unit 13, a wireless LAN communication unit 14, a GPS receiver 15, a microphone 16, and an authentication unit 17, and a user recognition device 31. The control unit 32, the camera 33, the GPS receiver 34, the wireless LAN communication unit 35, the Internet connection unit 36, and the authentication unit 37 is built in, the smart security service server 51 There is a control unit 52, an internet connection unit 53, an emergency situation inference unit 54, and an authentication unit 55.

First, under the control of the control unit 12 of the mobile phone 11, the mobile communication unit 13 communicates with the mobile communication base station and is ultimately connected to the Internet connection unit 53 of the server 51 through the Internet. The WLAN communication unit 14 is connected to the WLAN communication unit 35 of the user recognition device 31. At this time, the authentication unit 17 and the authentication unit 55 mutually authenticate, and the authentication unit 17 and the authentication unit 55 mutually authenticate. The GPS receiver 15 is for the mobile phone to recognize its position. The microphone 16 is for collecting sound information around the user according to a control command of the server.

Under the control of the control unit 32 in the user recognition device 31, the camera 33 operates to collect image information around the user. In the case of the GPS receiver 34, user recognition is an optional feature. Automatically recognize the location of the device by itself to broadcast the location information to the surrounding mobile phone via the wireless LAN communication unit 35 or transmits the location information of the user recognition device to the smart security service server through the Internet connection 36.

Under the control of the control unit 52 of the smart security service server 51, the location and schedule of the user received from the mobile phone, history information, movement trajectory, sound information and image information around the user received from the user recognition device, collected from the Internet There is an emergency inference unit 54 that infers an emergency situation such as kidnapping or abduction based on information around a user's location.

The method of the present invention as described above may be implemented as a program and stored in a computer-readable recording medium (CD-ROM, RAM, ROM, floppy disk, hard disk, magneto-optical disk, etc.). Since this process can be easily implemented by those skilled in the art will not be described in more detail.

The present invention described above is capable of various substitutions, modifications, and changes without departing from the technical spirit of the present invention for those skilled in the art to which the present invention pertains. It is not limited by the drawings.

Claims

In the smart assured service system using a mobile phone, a user profile, and a service server, a mobile communication function and a position measuring device are embedded under the control of a control unit, and a user profile such as a user's name or address, a schedule, an expected movement route, etc. is stored. If the location is not scheduled mobile phone also sends an abnormal signal to the certified smart security service server; And
When the abnormal signal is received from the mobile phone through the mutual authentication process or the estimated route estimated from the usual user's moving path is different from the current location, the current location information and the user's profile stored in the server or Smart security service server that infers the user's emergency situation using history information and information around the user and informs the emergency contact and police registered in advance in case of emergency
Cell phone and user profile, including a smart assured service system using the service server.

The method of claim 1,
The smart security service system
In the smart security service system using a mobile phone, a user profile, and a service server, a camera or a short-range wireless communication unit is built under the control of a controller to communicate with the user's mobile phone through an authentication function, and to retrieve a user profile stored in the mobile phone. User identification device that checks the identity of the user, informs the current location to the mobile phone, or transmits the video information collected by the built-in camera to the authorized smart security service server when an abnormal signal is generated from the mobile phone.
Mobile phone and user profile, characterized in that it further comprises a smart assured service system using a service server

The method of claim 1,
The mobile phone,
The mobile phone and the user profile, the service server, characterized in that further performing the transmission of the surrounding sound or video information collected by using the microphone or camera built in the user's mobile phone to the service server under the control of the service server Smart security service system using.

The method of claim 1,
The smart security service server,
Smart reassurance service system using mobile phone, user profile, and service server, characterized by analyzing the user's usual movement pattern to predict the expected movement route and share this information with the mobile phone.

The method of claim 1,
The smart security service server,
Smart relief service system using a mobile phone, a user profile, and a service server, characterized in that when the abnormal signal occurs to the user's mobile phone transmits a message asking for an emergency and receives a response.

The method of claim 2,
The user recognition device,
Smart security service system using a mobile phone, a user profile, and a service server, characterized in that the mobile phone is carried by any person around the area as a near field communication, and further stores information about the owner for a certain period of time.

The method of claim 2,
The user recognition device,
When recognizing video information of a random person in the vicinity but the mobile phone signal is not recognized, the smart assured service using a mobile phone, a user profile, and a service server, characterized in that further performing transmitting an abnormal signal to the smart assured service server system.

In the smart assured service method using a mobile phone and user profile, service server,
Built-in mobile communication function and location meter under the control of the control unit of the mobile phone, and stores the user's profile such as user's name or address, schedule, expected movement route, etc. Sending an abnormal signal; And
When the abnormal signal is received from the mobile phone through the mutual authentication process or the estimated route estimated from the usual user's moving path is different from the current location, the current location information and the user's profile stored in the server or Inferring whether the user is in an emergency using history information and information around the user, and in case of an emergency, notifying the registered emergency contacts and the police in advance.
Mobile and user profile, including, smart assured service method using the service server.

The method of claim 8,
Smart assured service method using the mobile phone and user profile, service server,
Under the control of the control unit of the user recognition device, the camera or the short-range wireless communication unit is built in to communicate with the user's mobile phone through the authentication function. The user profile stored in the mobile phone is searched to confirm the user's identity or the user's current location. Notifying the mobile phone, or in the abnormal situation in the mobile phone to transmit the image information collected by the camera to the authorized smart security service server
Smart relief service method using a mobile phone and user profile, the service server further comprising.