GB2487228A

GB2487228A - Audiovisual personal security monitoring system

Info

Publication number: GB2487228A
Application number: GB201100634A
Authority: GB
Inventors: Paul Bonnet
Original assignee: VIAPP Ltd
Current assignee: VIAPP Ltd
Priority date: 2011-01-14
Filing date: 2011-01-14
Publication date: 2012-07-18
Also published as: GB201100634D0

Abstract

An audiovisual monitoring system is provided for enhancing personal security. The system comprises a mobile communication device carried by a user, and a remote help station. The mobile device and the remote station are arranged to allow 2-way live audio communication. The mobile device is operatively associated with a camera, and is programmed to record and transmit live video images and GPS coordinates for viewing by the remote station. The mobile device is partially activated into a standby state in a first activation step, and further activated to a live state by a second activation step. In the live state, a contact signal, live audio, and live video images are transmitted from the mobile device to the remote station. The first activation step may be carried out after the mobile device has been switched on. The mobile device may be a mobile phone. The first activation step may be loading a mobile phone application on the mobile phone. The second activation step may be achieved by voice activation, input of a key code or activation of an alarm device such as a panic button which may be wirelessly connected to the mobile device.

Description

AN AUDIOVISUAL MONITORING SYSTEM

This invention relates to an audiovisual monitoring system and in particular to the use of a down loadable mobile phone application on a mobile communication device, to provide a means for a person who feels threatened and vulnerable quickly and effectively to instantly alert a security service centre of their perceived threat.

Background of the Invention

Currently, there are several ways in which a member of the public can alert family and friends, the Police and other security organizations when feeling threatened and vulnerable and in need of assistance. For example, a person may dial an emergency number and report the situation that they are in. However, unless there is an actual and immediate threat, it is unlikely that the person will receive a great deal of assistance. If there is merely a perceived threat, rather than an immediately apparent threat, it is highly unlikely that the person will receive any assistance from an official emergency service, which will typically be fully occupied in addressing incidents that have already take place.

There are also lone worker alerting products such as electronic identity cards which can be activated when workers need help. With such products, activation results in a signal being sent to a monitoring control room which can provide verbal support and take appropriate actions. This provides a limited level of assurance, but requires the person to describe the situation and provide personal information, while at the same time deal with the stress and anxiety of the threat.

There is currently a very strong need for a personal monitoring system which a person can make use of when they sense or perceive a threat, or there is potential danger and which allows the user's movements to be followed before a dangerous situation materialises.

Summary of the Invention

The invention provides an audiovisual monitoring system for enhancing personal safety and security which comprises: (i) a mobile communication device for carrying by a user; and (ii) a remote help station; wherein the mobile communication device and the remote help station are both equipped to enable live audio communication therebetween, and at least the mobile communication device is operatively associated with a camera and is programmed to record and transmit live video images and GPS coordinates to the remote help station; and wherein the remote help station is equipped to view live video images and GPS coordinates received from the mobile communication device the mobile communication device being programmed such that it can be partially activated into a standby state in a first activation step, and can be further activated to a live state by a second activation step; wherein the second activation step comprises recognition of a predefined alarm signal provided by the user, and wherein, in the live state, a contact signal and live audio and live video images are transmitted from the mobile communication device to the remote help station.

The audiovisual monitoring system of the invention provides a means for a user to rapidly contact the remote help station in the event that the user perceives that she or he is in a dangerous or potentially dangerous situation or feels threatened. An operative at the remote help station can then follow the movements of the user and, by means of the video, see the circumstances surrounding the user from the user's perspective whilst maintaining two way audio contact. In the event that a potential threat develops into a more serious threat, the operative at the remote help station can summon assistance, for example by alerting the police and directing them to the user's location.

The mobile communication device is operatively associated with a camera. Thus, for example, it may contain an integral camera. Alternatively, or additionally, one or more separate cameras may be provided which are operatively linked to the mobile communication device. For example, there may be a communication cable connecting the (or each) camera and mobile communication device.

Alternatively, there may be a wireless connection (e.g. a Bluetooth" connection) between the (or each) camera and mobile communication device.

Where a separate camera is provided, it may be provided with means for attaching it to the user or their clothing. For example, a clip may be provided to enable the camera to be attached to a coat or jacket lapel. An advantage of this arrangement is that the operative at the remote help station has essentially the same view as the user.

In an alternative, the user may be provided with two separate cameras, one facing forward (e.g. attached to a lapel) and one facing to the rear. In this way, the operative at the remote help station can observe whether the user is being followed.

In a further alternative, the user is provided with one separate camera (which is worn so that it is rearwardly facing) and the mobile communication device has an integral camera which can be employed by the user to provide video images of the region in front of him or her.

The mobile communication device is preferably a mobile phone. When it is a mobile phone, it contains a program or app" which is launched by the first activation step and which controls the transmission of the contact signal and the live audio and video images to the remote help station after the second activation step. The app is separate from the operating system of the mobile phone. It is also separate from any basic programs within the phone which control the normal functioning of the phone although it may interact with such basic programs in order to link to the remote help station.

In one embodiment, the first activation step is carried out after the mobile phone has been switched on and made ready for receiving and making telephone calls. In other words, the first activation step is not the mere act of switching on the phone and inputting of any password or ID information necessary to enable the phone to operate in its normal way. The first activation step is a quite distinct step from the phone's start up procedure. The first activation step is the launch of the app.

In another embodiment, the app is a program which is separate from the operating systems and basic programs (as defined above) within the phone, but is launched automatically during the switching on and start up of the phone.

In a further embodiment, the first activation step is linked to a clock within the mobile communication device and may be programmed to take place at pre-set times. In this way, for example, the user may set the mobile communication device so that it comes on automatically at a time when, for example, the user is leaving work, or is likely to pass through an area which may be judged as threatening.

Although a mobile phone represents a preferred mobile communication device, the present invention may be performed using other mobile communication devices.

For example, the mobile communication device may be a dedicated device that can only make contact with the remote help station or a small number of preselected destinations. In such a device, switching on the device and (where required) entering any password or ID codes may constitute the first activation step which places the device in the standby state.

Upon activation (via the second activation step) to the live state, the mobile communication device transmits a contact signal and live audio and video images to the remote help station.

The contact signal encodes information concerning the identity of the user and preferably also their location. In one embodiment, it may simply be the mobile phone number of the user. The contact signal may be a separate signal which precedes the live audio and live video images or it can be superimposed on the signals carrying live audio and live video images.

Once the remote help station has received the contact signal, it interrogates a database of users (subscribers) and the database is prompted to display the user's personal details and optionally other information at the remote help station.

The interrogation of the database may take place manually, by a human operative, or it may take place automatically.

The user's personal details typically include the user's name and home address, and optionally an emergency contact name or the name of a next of kin, and further optionally relevant medical details.

Upon receipt of the contact signal from the mobile communication device, and interrogation of the database, a human operative at the remote help centre is typically presented with one or more screens displaying the user's personal details, live video images of the user and a map showing the location of the user. A two -way audio link is established between the user and the human operative.

Preferably, the remote help station is provided with a video camera and is equipped to transmit live video images (e.g. of the human operative) to the mobile communication device, thereby providing two way live audio and video communication between the mobile communication device and the remote help station.

The second activation step may be achieved in a number of ways but should be capable of being completed quickly in order to address a sudden perceived threat.

In one embodiment, the second activation step is achieved by voice activation and the predefined alarm signal comprises one or more predefined alarm words or phrases spoken by the user.

In another embodiment, the second activation step is achieved by inputting a key code not exceeding three characters into the mobile communication device.

In a further embodiment, the second activation step is achieved by activating an alarm device operatively linked to the mobile communication device. Preferably, the alarm device is wirelessly connected (e.g. by "Bluetooth") to the mobile communication device.

The alarm device may take several different forms and may be voice activated or manually activated, or a combination thereof. Thus, when the alarm device is voice activated, it may be programmed to respond to one or more pre-set key alarm words or phrases.

Where the alarm device is manually activated, it may, for example, take the form of a panic button or switch that the user presses, clicks or squeezes to set off the second activation step.

In a further aspect of the invention, there is provided a mobile communication device programmed to form part of an audiovisual monitoring system as hereinbefore defined.

In another aspect, the invention provides a data carrier containing a computer program which can be used to programme a mobile communication device so that it forms part of an audiovisual monitoring system as hereinbefore defined.

In a further aspect, the invention provides a method of enhancing the safety and personal security of a user (i.e. person), which method comprises the downloading onto a mobile communication device by the said user (person) of a program which transforms the mobile communication device so that it forms part of an audiovisual monitoring system as herein before defined.

In another aspect, the invention provides a method of enhancing the safety and personal security of a user, i.e. a person, which method comprises making available to the person a program which can be installed on a mobile communication device so as transform the mobile communication device so that it forms part of an audiovisual monitoring system as herein before defined, setting up on a database personal details of the user and, in response to a contact signal received from the user's mobile communication device, monitoring the user's location and circumstances by means of the audio and video images.

It will be apparent from the foregoing that the invention provides an automatic alerting system providing an effective personal security solution.

Particular and preferred features of the audiovisual monitoring system are set out below.

Figure 1 illustrates the type of information that may be displayed on a computer screen at the remote help station following full activation of the mobile communication device to the live state.

The system may make use of inter a/ia any of the following features: (a) The service is available to anyone with a mobile phone subscription (b) The user (person) can instantly activate the system. This can be done with the use of voice recognition, with a pin code, or with a Bluetooth widget.

(c) The system allows the remote help station (control room) operator to monitor the person's situation with live video as well as audio, while at the same time allowing the person to see and hear the control room operator.

(d) The control room operator is automatically provided with personal details (e.g. name, address, medical details etc), which are provided by the user at registration.

(e) The video teed from the mobile device includes embedded GPS coordinates of the threatened person.

Installation The program (app) that controls the mobile communication device so that it forms pad of the system of the invention can be downloaded from a website and installed on various brands of mobile phone/device.

This mobile phone or other mobile communication device should have the following capabilities: An inbuilt camera capable of shooting video Software that supports the streaming of incoming and outgoing video images.

Software that supports the capture and storage of audio and video to onboard memory Bluetooth (Only needed when not using voice recognition and not entering a pin code) The user must register himself or herself with the with the remote help station before the service becomes active. Registration is carried via a secure website and during registration the user provides personal information which is then integrated into the remote help station software for operating the service Once registered, the application can be launched.

Activation of the system The system can be activated or deactivated at any time.

Activation of the system is possible using the following methods: Use voice recognition to recognize keywords (e.g. pre-recorded key words) Provide a pin code Click on a button on a Bluetooth widget (e.g. one that is strapped to the wrist).

The system will instantly respond to an activation request, whether the keyboard is locked or not.

The system's management feature allows the user to click on an Icon and select two or three key words. The key words can be changed at any time after the application has been registered.

In addition, the programmed mobile communications device can include an inbuilt timer so that the first activation step takes place automatically at different times of any day where the owner has a routine of movement / travel When system is activated the phone's camera is turned on, and begins to capture video. The video content is cached on the phone. At the same time the phone immediately initiates a connection to the security control room.

Once the connection is made, system prompts the streaming software to send the video stream towards the control room.

There shall be no significant latency between the phone sending the video stream and the control room receiving it, once connection is made.

The system will extract GPS coordinates from the phone (similar to the Geotag implementation) and include them as a watermark on the video images.

The control room will receive the connection, and return a video stream from the operator console. The video may be displayed on the mobile phone screen.

There shall be no significant latency between the control room sending the video stream and the mobile phone receiving it, once the connection is made.

The system will have the ability to store/record the video. This will be captured in the phone's memory, subject to there being sufficient memory available.

Security Service Centre Control Room The remote help station (control room) is in a secure location. The number of staff and consoles that must be available in the control room will vary for different times of the day. It is necessary that at any time, there are always members of staff and consoles able to respond to a new connection/activation.

The control room has a fully automated connection-management system to handle incoming connections/activations. Each connection/activation is rooted to a fully trained operator.

When a connection/activation is received from an enabled mobile communication device, the live video and audio will be monitored via an individual visual display screen, with all personal information.

The operator is then able to see and hear the calling user.

A microphone and video camera attached to the console enables an audio and video feed to be sent to the user's system-enabled phone.

In addition to receiving audio and video data, the console also receives geographical data (GPS) from the user's phone. This is displayed an integrated map GUI on the console. Personal data belonging to the user of the activated system is extracted from the locally stored user data record and is also displayed on the console. The user, at time of registration, will provide a number to contact in case of emergency, and any special medical conditions that should be considered.

In this case the operator has to take appropriate actions and call the emergency services. All data (audio, video, geographical) pertaining to the connection/activation is stored on a local disk server. The disk server will be a mirrored disk configuration, providing real-time back up.

A typical display provided at the remote help centre once the user has fully activated the mobile communication device is shown in Figure 1.

(i) Network Resources The data throughput and timing requirements will be met if the mobile phone/device is connected to an Edge, 3G or Wi-Fi mobile network and the control room console is connected to the Packet Data Network via DSL or cable broadband.

(ii) Managing Personal Information After the appropriate software has been installed on a phone, the owner (*user) is required to register their personal details with the security control room. This is done via a secure (HTTPS) live and interactive web portal. The web portal typically includes the following fields: Name, address, phone number, name of person to contact in emergency, phone number of person to contact in emergency, blood group, medical conditions, next of kin and any other additional information the user might like to provide. The user can also upload temporary travel information such as visiting name, visiting address, visiting phone number and duration of visit.

Personal information can be uploaded at any time once the user is registered.

The information is stored in a personal data record, on a secure disk in the control room. This will be in line with the Data Protection Act 1998 and European Directive 1995.

Claims

CLAIMS1. An audiovisual monitoring system for enhancing personal security which comprises: (i) a mobile communication device for carrying by a user; and (ii) a remote help station; wherein the mobile communication device and the remote help station are both equipped to enable live audio communication therebetween, and at least the mobile communication device is operatively associated with a camera and is programmed to record and transmit live video images and GPS coordinates to the remote help station; and wherein the remote help station is equipped to view live video images and GPS coordinates received from the mobile communication device the mobile communication device being programmed such that it can be partially activated into a standby state in a first activation step, and can be further activated to a live state by a second activation step; wherein the second activation step comprises recognition of a predefined alarm signal provided by the user, and wherein, in the live state, a contact signal and live audio and live video images are transmitted from the mobile communication device to the remote help station.
2. An audiovisual monitoring system according to claim 1 wherein the mobile communication device is a mobile phone; and the first activation step is carried out after the mobile phone has been switched on and made ready for receiving and making telephone calls.
3. An audiovisual monitoring system according to claim 1 or claim 2 wherein the remote help station is provided with a video camera and is equipped to transmit live video images to the mobile communication device, thereby providing two way live audio and video communication between the mobile communication device and the remote help station.
4. An audiovisual monitoring system according to any one of the preceding claims wherein the remote help station is linked to a database of users, such that, following receipt of the contact signal from the mobile communication device, the database is prompted to display the user's personal details and optionally other information at the remote help station.
5. An audiovisual monitoring system according to claim 4 wherein the user's personal details include the user's name and home address, and optionally an emergency contact name or the name of a next of kin, and further optionally relevant medical details.
6. An audiovisual monitoring system according to claim 4 or claim 5 wherein, upon receipt of the contact signal from the mobile communication device, a human operative at the remote help centre is presented with one or more screens displaying the user's personal details, live video images of the user and a map showing the location of the user, and a two-way audio link is established between the user and the human operative.
7. An audiovisual monitoring system according to any one of the preceding claims wherein the second activation step is achieved by voice activation and the predefined alarm signal comprises one or more predefined alarm words or phrases spoken by the user.
8. An audiovisual monitoring system according to any one of claims I to 6 wherein the second activation step is achieved by inputting a key code not exceeding three characters into the mobile communication device.
9. An audiovisual monitoring system according to any one of claims I to 6 wherein the second activation step is achieved by activating an alarm device operatively linked to the mobile communication device.
10. An audiovisual monitoring system according to claim 9 wherein the alarm device is wirelessly connected (e.g. by "Bluethooth") to the mobile communication device.
II. An audiovisual monitoring system according to claim 10 wherein the alarm device is a panic button which is pressed by the user to initiate the second activation step.