FR3080943A1 - METHOD FOR ASSISTING A PERSON EQUIPPED WITH A CELLULAR TELEPHONE - Google Patents

Abstract

The invention relates to a method for assisting a person equipped with a cellular telephone equipped with a client communication module with a server, for the occasional realization of emergency interventions. Said method comprises: - initial steps of recording in a memory of said telephone a plurality of video or photo sequences, and - steps of establishing a communication via a cellular transmission network between said cellular telephone and a remote server, and information exchange between said cellular phone and said remote server comprising: - the transmission by the cellular phone of at least one unique identifier of said cellular phone - the establishment of a voice communication between said cellular telephone and an operator of said remote server - sending by said server messages including commands notifications, corresponding to one of said videos or prerecorded photographs. Said cellular phone proceeds, upon receipt of said message, to the recognition by said client module of said data for controlling on the screen of said cell phone the display of the prerecorded video sequence corresponding to the data from said server.

Description

PROCESS FOR ASSISTING A PERSON

EQUIPPED WITH A CELLULAR TELEPHONE

Field of the invention

The present invention relates to the field of telecommunications systems intended for the management and assistance of first aid gestures.

First aid represents 1 ¹ set of assistance techniques brought to the victims of an accident, a disaster, a health problem or a social problem compromising in the short term their state of health. These techniques make it possible to provide effective responses to a vital danger and have the objective of minimizing the consequences while ensuring the survival of people by providing them with first aid. First aid is the initial link up the rescue chain until it is taken care of by specialized emergency services.

The organization of first aid relies on professional and trained actors (firefighters, doctors, ...), trained first aiders or first-aid rescuers but also people occasionally confronted with an emergency situation, who then access a platform management system, operated either by a private company for the first aid of its employees, or by a public operator, accessible by a widely distributed number, for example "112" in Europe.

In this case, an operator provides assistance to the occasional rescuer to collect information on the victim, on his location to manage the intervention of other actors close to the victim, and to provide advice on what to do. .

This advice can be communicated by voice, and sometimes also in the form of instructional videos making it possible to communicate very effectively the emergency gestures to be accomplished by the first-aid rescuer.

Even for people who followed first aid courses, the American Red Cross has determined that it often remember not ^one of what must be done in emergency situations. The retention rate of first aid skills decreases after six weeks and disappears in six months.

State of the art

The US patent application US20030208357A1 proposes a solution consisting of a first aid kit with instruction cards for a wide variety of different types of first aid situations. Instruction cards include audio or video instructions, or both time coordinates, that tell the user, step by step, how to deal with a particular first aid situation. The audio and / or video teaching card can accompany, or be packaged with, a first aid kit in a kit which contains the supplies necessary to deal with the first aid situation described by the instruction card.

This solution is not satisfactory because it can only concern people equipped with such a first aid kit, and moreover available at the time of the advent of an emergency situation. In too many cases, the witness of a victim requiring first aid is taken by surprise and is not equipped with such a kit.

European patent EP3005753 describes another example of a solution taking advantage of the proliferation of mobile devices to allow laymen to initiate an effective and timely emergency response in the event of an emergency, such as a medical emergency, by example a heart problem. As part of a company's overall response plan and program, mobile applications are made available to people witnessing an emergency event to enable them to simply initiate notification to trained personnel, in their structure for example, in a timely manner in relation to the type of emergency specific to their structure. More specifically, embodiments of the invention use mobile applications to alert trained first aid personnel and enable them to respond to the emergency event.

This solution does not, however, allow a completely novice user to access relevant emergency gestures in an emergency.

Also known is the European patent EP1980093 describing a solution for storing ¹ first aid and emergency response information in a cell phone or personal assistant (PDA) or other portable electronic device such as a cell phone, a reader mp3. Information is stored on a phone, and the user accesses it by selecting a menu item from the cell phone. The information can preferably be viewed by subject, symptom or other subject. Information can be selected by keystroke, touch screen, voice activation menu or similar methods. All or part of the information may be available conditionally to the user, by providing high-risk or highly technical procedures (for example, tracheostomy) as only after accomplishing a preliminary step, or if a network is not available or by another rule or condition. Since the information is stored directly in the telephone, the information can be retrieved, whether a signal is available or not, and so as to be usable in real time by the user.

This solution is also not completely satisfactory because the user intervening in an emergency situation is subjected to a strong stress which often prevents him from navigating in a relevant way in complex menus, and does not always have sufficient knowledge to select the relevant information.

Chinese patent CN101632310A describes a similar solution. It relates to a method and apparatus for storing and displaying emergency data and other reference documents on a cell phone, electronic telephone, media player or other electronic device. Emergency information, first aid procedures, spiritual advice and reference information are integrated or stored on an electronic device, for later retrieval. Storage on the electronic device before the time of need ensures that the information will be available whether or not a communication signal is available to the user.

U.S. Patent US9020106 describes another example of a device configured to identify an emergency call from a user device, determine that the user device should be connected to a video call, and obtain first video call information associated with the device. user, the video call information comprising information allowing the video call to be established. The device is configured to receive emergency information associated with the emergency call, and to identify an emergency guidance device to which the user device is to be connected via the video call.

The device is configured to obtain second video call information associated with the emergency guidance device, the video call information including information for establishing the video call and providing information for connecting the user device and the emergency guidance device via video call, based on first video call information and second video call information.

Another solution is described in international application WO2011162927 describing an emergency notification system for a mobile device. The system includes a mobile device application that is adapted to be stored in memory on the mobile device. The application, when activated during an emergency, determines the global positioning system (GPS) coordinates of the mobile device, records digital images over a period of time, sends a preconfigured message from the mobile device to at minus a recipient, preferably an emergency responder, and sends GPS coordinates and digital images. Coordinates and images can be sent to a remote server for storage and the emergency service provider may have

access to them. The coordinates and the pictures are periodically put at day and sent while that the program is activated. Requirement of patent EP2645283 relates to a process

usable in a portable terminal, which allows a first aid guide to be displayed even in a locked screen state, whereby instructions for an emergency illness are provided. A first aid icon can be displayed in the locked screen state, the selection of the icon being detected as a request to display a first aid guide. If a predefined disease has been stored in the portable terminal in association with the user of the portable terminal, the first aid guide corresponds to the predefined disease. An emergency contact and treatment instructions for the illness can be found in the first aid guide.

Disadvantages of the prior art

The solutions of the prior art providing for the recording of videos presenting the first aid managements on a telephone are not entirely satisfactory because the user confronted with an emergency situation is generally particularly stressed and worried about the situation of the victim. . The use of relatively elaborate and complex functions to find the relevant video content is ill-suited to such a user, not always mastering the terminologies which allow him to view the relevant content.

In addition, the witness of an emergency situation may be in an area of low radio coverage, which does not allow him to download video content. Solutions involving the transmission of video streams during the emergency response are not appropriate since the bit rate may prove to be insufficient for proper operation, particularly in mountainous, coastal or maritime areas.

Furthermore, the solutions of the prior art provide that the interaction with the informative content is mainly under the control of the user of the terminal. However, the latter is generally found, at the time of actual use, in a situation of stress or mental overload, which does not allow him to pay sufficient attention to piloting the functional interface.

Solution provided by the invention

The invention relates to a platform and an application for cellular telephones intended to facilitate the management of first aid by trained or untrained persons, by means of an application installed on a cellular telephone and communicating by a low-speed link. with a platform, to allow an operator to control the viewing of training videos and photos, and the untrained person to make the first gestures from the tutorials viewed on their phone.

The technical characteristics concern:

Preloading videos on the phone to avoid the need for high-speed links during the intervention, potentially in an area with poor network coverage.

The functionality of local first aiders by the use of network information transmitted by the cell phone of the untrained person intervening in emergency.

to pass the sound of the video into the operator's microphone in order to overcome the problems of video playback during a telephone call which cause the video to be muted.

To this end, the invention relates, in its most general sense, to a method of assisting a person equipped with a cell phone equipped with a client module for communication with a server, for the occasional carrying out of emergency interventions. characterized in that it comprises:

- initial steps of recording in a memory of said telephone a plurality of video or photo sequences.

steps of establishing a communication via a cellular transmission network between said cellular telephone and a remote server, and of exchanging information between said cellular telephone and said remote server comprising:

- the transmission by the cell phone of at least one unique identifier of said cell phone

- establishing voice communication between said cell phone and an operator of said remote server

- the sending by said server of messages including order notifications, corresponding to one of said pre-recorded videos or photographs and in that said cellular telephone proceeds, upon receipt of said message, to the recognition by said client module of said data for controlling on the screen of said cellular telephone the display of the prerecorded video sequence corresponding to the data originating from said server.

Preferably, the method comprises steps of selecting using said message server a video or photograph present on the connected cellular terminal and of controlling the transmission to said cellular terminal of an activation message of said video or selected photograph.

Advantageously, said cellular telephone furthermore, after said viewing command, transmits to the server an acknowledgment message comprising an indication of acceptance or non-acceptance of processing by the processing operator identified in absence of the video sequence considered.

According to an advantageous variant, in the event of interruption of execution of the processing of an object of a message, and at the end of the execution of the processing of a message, it comprises a step of transmission, either of a error message, or an end of care message.

According to another variant, the information transmitted by said cellular telephone to said server also includes geolocation information from said cellular telephone.

Advantageously, the method includes steps for balancing the sound level of the video sequence viewed and the sound level of the call by integrating the sound of the server video into the operator's microphone via a mixer.

The invention also relates to an assistance server for persons equipped with a cellular telephone making it possible to receive order notifications via web sockets, in the occasional carrying out of emergency interventions comprising means of communication via a telephone network. cell, characterized in that it comprises:

at least one memory for recording video and photo sequences and means for downloading said sequences into the memory of cell phones,

- means for establishing voice communication with a cell phone,

- a web sockets command editor allowing remote control of said application for playback corresponding to one of said prerecorded videos.

The invention also relates to a method for controlling the functionality of a cellular telephone capable of receiving an order notification via web sockets and operators for processing multimedia messages, characterized in that it comprises an initial step of accessing a web-service server for downloading a plurality of video sequences and recording them in a memory of said telephone, and user assistance steps consisting in controlling the viewing of one of said video or photo sequences as a function processing data included in the exchanges via web-sockets, and to order the automatic transmission of an acknowledgment message containing an indication of acceptance or non-acceptance of processing.

Advantageously, the method further comprises means for detecting connected objects from the analysis of the Bluetooth signals.

Detailed description of a nonlimiting example of embodiment of the invention

The present invention will be presented in more detail in the following, referring to a nonlimiting example illustrated by the appended drawings where:

- Figure 1 shows a schematic view of a solution according to the invention

- Figure 2 shows the block diagram of the user application

- Figure 3 shows a view of the user interface

- Figure 4 shows the block diagram of the server.

Context of the invention

Today, it is estimated that less than 20% of the French population is trained in first aid. This figure has a direct impact on the extra-hospital survival rate for cardiac arrest, which is around 5% compared to 38% in other countries.

Worse still, in 70% of cardiac arrest cases a witness is present, but only 18% of these witnesses will undertake a cardiac massage. The invention aims to provide a solution to support and guide witnesses, whatever the situation they face in order to significantly improve all of these figures. In addition, in certain areas, the response time for emergency services cannot be reduced. The goal is to optimize the resources present (witnesses) while waiting for the emergency services. More concretely, the objectives are:

Simplify the call for help (prerecorded number, SMS call for the disabled),

Simplify the taking of calls for emergency services: geolocation of the caller, caller information sheet, access to the smartphone camera ...

Optimizing the treatment of patients in distress: guidance, call for first-aid workers nearby, whether the caller is trained in emergency procedures or not

Inform and train the public (notifications and offers from our partners),

Allow the acquisition of suitable means (tourniquet, dressings ...) via our partners,

Accompany, guide and support companies in reducing professional risks.

The solution object of the present invention relates to different categories of users:

the general public from 10 to 90 years old, via the general public mobile application, trained in emergency procedures or not. Depending on the case, this public may be in an emergency situation or, conversely, in search of information (training, purchase of equipment, etc.), medium and large companies having at heart to reduce and improve the management of professional risks via the company application. It can be a use in the event of an alert following a work accident, or the use of the application (or platform) to search for information, training, etc.

emergency services (SAMU / Fireman) via the back office for handling calls and triggering videos remotely.

General principle

The first aid assistance solution according to the invention implements a public or private operator having a server controlled via a web browser (1) associated with a telecommunications gateway (2) making it possible to broadcast and receive messages via a cellular telephone network.

It is associated with a multimedia server (3) in which video sequences are recorded, such as brief tutorials illustrating emergency gestures in a didactic manner. Each video sequence is associated with an identifier.

The system further comprises an application downloadable on cellular telephones (4) allowing a large number of volunteers, even untrained, to install the application on their personal telephone by downloading it.

The system also involves professional rescuers (5) registered on the server (2). For these professional rescuers (5), the server (2) periodically retrieves the geolocation data to allow contact with a victim or an occasional rescuer according to the geolocation data transmitted by the cell phone (4) of the latter.

User application block diagram

Figures 2 and 3 illustrate the block diagram of the mobile application. The user sees:

an alert button (10) indicating the emergency number 112 (depending on the country). The button (10) occupies a large part of the screen. Its activation triggers a call to the pre-registered number of the server or to a pre-registered emergency number (18, or 112).

a "MENU" (11) is present in the lower part of the screen.

During the very first connection, the user is asked to activate his location data, to receive notifications, to fill in the elements of his profile and the access agreement to the camera on his phone.

The application allows via the menu (11) to record a personal profile, and to access accessory functions such as training, ordering first aid equipment by an online order form sent to the server (2) or d '' establish contact with a server operator (2) via a contact form.

Once the alert zone is activated, the telephone (4) performs several simultaneous actions:

it offers a call to the number pre-recorded by the application.

it communicates in known manner the geolocation information to the server. The geolocation of the call allows the server operator (2) to see the position of the occasional rescuer equipped with the telephone (4) on a map in real time in order to be able to correct any errors or a lack of precision.

A video of the actions to be taken is triggered remotely by the rescue teams.

When the user spear 1'appel 1'application must remain open to to limit to the maximum the actions of the user. In case of exit of 1'application , the operator sends a notification on the phone of the caller allowing nsaids i have a return simple and

quick in the app.

video playback and content management is controlled by the server via the web sockets protocol so as not to alter communication with the rescuer.

The call function must not in any case reduce the sound of the video. Both must be fully audible at all times.

For this purpose, the sound of the server's video is directly integrated into the operator's microphone via a mixer. The application also controls the automatic display of emergency messages, for example specific content automatically: in the event of cardiac arrest immediately start a cardiac massage ”.

the application also ensures network detection (4G, 3G, 2G, LTE, WIFI ...) as well as the automatic search for the presence of connected objects (heart rate monitor, blood pressure monitor, pulse oximeter, ...). This functionality is ensured by activating the Bluetooth function.

The server also uses the geolocation information of the telephone (4) and the geolocation data of the telephones (5) of experienced rescuers registered to warn a nearby user with a diploma, in the event of incapacity for intervention by the witness (decision operator).

Notifications and alerts

Reading and accessing notifications should be easy on the app. In addition, if the profile is not completely filled, for example the medical parts, an automatic alert is launched at regular intervals in order to explain the advantage of filling the entire profile.

When a video is triggered by the emergency services, the server (2) initiates a command via the web sockets protocol, to select a video recorded on the phone (4) and control its activation for display on the screen of the user's telephone (4), without the user having to do anything.

If necessary, the operator of the server (2) can control the activation of the camera of the witness to an accident who called with the application to view the scene of the accident, take photos or a burst of photos depending on the type of network present. This implies acceptance of the rescuer.

The user :

sees on his screen what he is filming can have no action on his Smartphone

Communication between server and phones

The application installed on users' telephones (4) allows two-way communication with the server via a web sockets protocol. The web sockets protocol thus allows real-time communication on the state of the two parties (type of network, geolocation for example). It also allows notifications and commands to be sent to the phones in order to trigger various actions.

This protocol allows two-way communication between the client and the server. Clearly, the server can send data directly to the client without the client making a request and vice versa.

The client sends a Handshake to the server to notify him of his desire to open a WebSocket connection with him.

This Handshake is an HTTP request of UPGRADE type. If the server accepts it, a connection is then opened between them. This connection is persistent and based on the TCP protocol. It authorizes the transmission of bidirectional messages (client to server and vice versa) and remains open until a member decides to close it.

The web sockets protocol therefore allows interaction between said application and said server in near real time, but also to control all of the remote actions provided for in the application (taking a photo or video, remote triggering, geolocation in real time , etc).

The synchronization of video and photo files is done via a web service system making it easier to update and change the media used. This synchronization is automatic.

A description of the language of the web sockets protocol is available at the following address:

https://openclassrooms.com/courses/des-applications-ultrarapides-avec-node-js/socket-io-passez-au-temps-reel

Variant of implementation

The SMIL language makes it possible to code the content of messages in tags consisting of a directive in the form of keywords framed by signs less than (<) and greater than (>) formatting a text to indicate the display characteristics of a document.

The tag of a file is indicative of the type of file while the extension of a file determines its format. For example, a tag marked "<video />" defines video type data which can be recorded with the following extensions: .mp4; .rm;

. avi; .asf, etc.

The tags <audio />, <img />, <animation />, <a/> respectively define audio files, for example of extension .mp3 or .mid, image files of extension .gif, .png or .jpg; animation type files with extension .swf or .svg and hyperlink files with extension .html.

The server (2) determines the appropriate video based on the information transmitted by the user via his telephone (4). This selection can be manual or controlled by an artificial intelligence engine analyzing the words transmitted by the user, or by a voice server.

The MMS client module of the telephone (4) analyzes the message transmitted by the server (2) and identifies the tag as well as the file extension of an object contained in the received message, will command the module for launching the reading of one of the videos saved in the phone memory (4) and its display by the display module ("player" in English).

The launch module also sends information to the server (2) to confirm its ability to process the launch of the selected video, or on the contrary the impossibility of carrying out this launch, for example because the selected video sequence is not present on the telephone (4).

The MMS client module of the telephone (4) is also associated with a launch module of the telephone camera (4), for automatically controlling its activation and the sending of a video stream to the server (2) when the type of network detected allows this and has a sufficient speed and signal level.

Description of server functionality

The server (2) controls one or more display screens intended for operators making it possible to supervise incoming calls.

On the interface appears the list of calls launched via an application executed by a telephone (4).

Depending on the status of the call, it has a color code (red for completed calls, orange for calls in progress and green for calls that are not taken into account.

The server, after operator request, orders the visualization of an individual intervention sheet allowing, in a single interface, to see all the elements concerning the requester.

In particular, it allows operators to see the following:

NAME and First name of the caller and the telephone number according to the identifier detected in the received signal, for example the IMSI identifier of the SIM card or the IMEI or MEID number of the mobile phone (4)

Date and time of call

GPS points and their translations (address)

The representation on a map of this data.

The identification of the telephone (4) allows the server to search the database for the applicant's personal file if it has been filled in (history, treatment, allergy, etc.).

Furthermore, when the telephone application (4) has recognized a connected object, it transmits the information and the server reads the connected object instantaneously such as a blood pressure monitor, pulse oximeter, heart rate monitor.

The server (2) also controls the video and image library in the event of assistance with emergency gestures and can transmit a missing sequence to the telephone (4) when the transmission conditions allow it.

The operator also has a "camera access" button.

This part of the back office is considered to be the telephone's remote control. It must allow operators to control the applicant's telephone (4) in a simple and intuitive manner.

When the operator triggers a video or the phone's camera (4), he has simultaneous playback on his screen. Video playback is accompanied by keys such as:

play / pause activate sound / deactivate.

DEGRADED MODE;

A degraded mode allows operators to send a video link via SMS allowing the witness to an accident to be guided while he does not have the application.

When the operator activates the "DEGRADE MODE" button, he enters the caller's telephone number. Once entered, he chooses the video adapted to the emergency situation.

He confirms his choice of video which sends the link via SMS. Reading is then done on an HTML 5 player.

Implementation in a private company

The implementation in the form of a platform and a private server (2), intended for the users of a company provides, in addition to its functions of emergency communications management, the management of professional risks, with functions additional such as:

- sending SMS or notifications to one or more pre-registered employees to inform them of a work accident and its location (with a link to access the map)

- personalization of Profiles according to specific risks or specific responsibilities

- training, by providing a multimedia library of tutorials. This training library provides access to all of the specific video content, classified by category (example: fire, evacuation, OHS, etc.). By hovering over the videos, the user can know which ones have already been viewed.

Claims (8)

1 - Method for assisting a person equipped with a cell phone equipped with a client module for communication with a server, for the occasional carrying out of emergency interventions characterized in that it comprises: initial steps of recording a plurality of video or photo sequences in a memory of said telephone, and steps of establishing a communication via a cellular transmission network between said cellular telephone and a remote server, and of exchanging information between said cellular telephone and said remote server comprising: - the transmission by the cell phone of at least one unique identifier of said cell phone - establishing voice communication between said cell phone and an operator of said remote server - the sending by said server of messages including order notifications, corresponding to one of said pre-recorded videos or photographs and in that said cellular telephone proceeds, upon receipt of said message, to the recognition by said client module of said data for controlling on the screen of said cellular telephone the display of the prerecorded video sequence corresponding to the data originating from said server. 2 - Assistance method according to claim 1 characterized in that it comprises steps of selection using said message server of a video or photograph present on the connected cellular terminal and controlling the transmission to said cellular terminal an activation message for said selected video or photograph. 3 - Assistance method according to claim 1 characterized in that said cell phone further proceeds, after said viewing command, to the transmission to the server of an acknowledgment message comprising an indication of acceptance or non-acceptance of processing by the identified processing operator in the event of the absence of the video sequence considered. 4 - Assistance method according to any one of the preceding claims, characterized in that, in the event of interruption of execution of the processing of a message object, and at the end of the execution of the processing of a message, it includes a step of transmitting either an error message or a message indicating the end of care. 5 - Assistance method according to any one of the preceding claims, characterized in that the information transmitted by said cellular telephone to said server also includes geolocation information of said cellular telephone. 6 - Assistance method according to any one of the preceding claims, characterized in that it includes steps for balancing the sound level of the video sequence viewed and the sound level of the call by integrating the sound of the server video in the operator's microphone via a mixer. 7 - Assistance server for people equipped with a cell phone, in the occasional realization of emergency communications interventions by a network implementing the process which it comprises: comprising telephony conforming to cellular means, for claiming characterized in that at Recording sequences of video sequences in at least one memory for and means for downloading said memory from cell phones, - Means for establishing voice communication with a cell phone, an editor associated with means for the transmission of messages including data from said web socket editor corresponding to one of said prerecorded videos. 8 - Method for controlling the functionalities of a cellular telephone capable of receiving a message containing at least one object of a given type and comprising operators for processing multimedia messages, for implementing the method according to claim 1, characterized in that it comprises an initial step of accessing a server for downloading a plurality of video sequences and recording in a memory of said telephone, and steps of user assistance consisting in controlling the display of one of said video sequences according to treatment data included in a control communication, and controlling the automatic transmission of a message of ^one acknowledgment including an indication of ^one acceptance or non-acceptance of treatment.