DE102017116683A1 - System and method for the automatic documentation of events - Google Patents

Abstract

The invention relates to a system for the automatic documentation of events, comprising a portable recording device (11) for recording events, with a Nahkommunikationsschnittstelle (110) for data communication, and a portable communication terminal (10) with a wireless communication interface (100) for wireless data communication in one A radio communication network (2) and having a local communication interface (101) for data communication with the local communication interface (101) of the portable recording device (11), the portable communication terminal (10) being adapted to provide, via its local communication interface (110), a data stream comprising records of events from the recording device (11), a selection means (107) for selecting a part of the received recordings based on a predetermined decision criterion and is adapted to the selected part of the A to send recordings via the radio communication interface (100) to a documentation server (12). The invention further relates to a method.

Description

The invention relates to a system for the automatic documentation of events according to claim 1 and to claim 11 and a method for the automatic documentation of events according to claim 12.

Nowadays it is common to have a portable communication device, e.g. a mobile phone to carry with you. This makes it possible to call in dangerous situations, for example, the police, an ambulance or the fire department, which can contribute significantly to safety. However, there is the problem that initiating communication at the moment of the dangerous situation is often not possible. Furthermore, dangerous situations are often only recognized when it is already too late. In many cases, however, dangerous situations could still be averted if they are already recognized in the beginning and responded in a timely manner. This is especially true for vulnerable people who may not anticipate certain hazardous situations.

In the event that a dangerous situation can no longer be averted, there is often a subsequent need to be able to reconstruct the course of the dangerous situation, e.g. to prevent a similar dangerous situation from recurring. This is often possible only on the basis of inaccurate memories based on descriptions and / or automatically recorded surveillance camera recordings, on the basis of which the events including the dangerous situation can be at least partially documented. As a concrete example, a reconstruction of the course of the dangerous situation on the basis of the documentation of the events may be helpful in order to prove an unnoticed theft in hindsight. If the surveillance camera or possible witnesses are not aware of the theft at the crucial moment, the documentation of the incident is incomplete and may not be sufficient.

It is an object to provide an improved system and method for automatically documenting events.

The object is achieved by a system for the automatic documentation of events with the features of claim 1.

Thereafter, the system comprises a portable recording device and a portable communication terminal. The portable recording device is configured to record events and includes a local area communication interface for data communication. The portable communication terminal comprises a radio communication interface, which is designed for wireless data communication in a radio communication network, and also a Nahkommunikationsschnittstelle. The near-communication interfaces of the portable recording device and the portable communication terminal are adapted to wirelessly communicate with each other by data communication among themselves, at least from the portable recording device to the portable communication terminal. It is provided that the portable communication terminal is further adapted to receive via its Nahkommunikationsschnittstelle a data stream comprising records of events from the recording device. The portable communication terminal comprises a selection means configured to select a part of the recordings received from the portable recording device on the basis of a predetermined or predeterminable decision criterion. The portable communication terminal is arranged to send only the selected part of the recordings via the radio communication interface to an external (e.g., remote) documentation server, while the remaining recordings can be discarded or deleted.

This is based on the idea of carrying a recording device and e.g. over a longer period, e.g. to activate over several events. If a dangerous situation occurs during this period, the recording device also records the danger situation and its forerunner recordings. The decision criterion is in particular designed so that it records records that show an above-average probability of an imminent or current danger situation. In this way, documentation of events can be provided (for example essentially without delay), with the help of which the emerging danger situation can be averted or help can be organized in good time. In retrospect, the sequence of the dangerous situation can be reconstructed, whereby only a comparatively small amount of data has to be examined by the selection.

The portable communication terminal is e.g. a mobile phone, a smartphone or the like.

The radio communication network is in particular a public mobile radio network. The radio communication network can be, for example, a GSM network, a GPRS network, a UMTS network and / or an LTE network. The radio communication interface is designed for communication with the radio communication network. For example, the radio communication interface according to the GSM standard, the GPRS standard, the UMTS standard and / or the LTE standard is formed. Alternatively or additionally, the radio communication network is a WLAN (eg according to an IEEE 802.11 standard) and the radio communication interface is designed according to the WLAN. The radio communication network enables mobile data transmission, in particular via the Internet.

The local communication interface is different from the radio communication interface. For example, the near-end communication interface enables data communication in a near-end area, e.g. in the range of less than 50 meters. In particular, the near-end communication interface may be implemented according to a WPAN (e.g., according to an IEEE 802.15.1 to 802.15.7 standard), preferably according to the Bluetooth standard or the Bluetooth LE standard. The near-communication interfaces of the portable communication terminal and the portable recording device enable data transmission between the portable communication terminal and the portable recording device.

The data transmission between the portable communication terminal and the portable recording device is preferably by means of a data stream, e.g. a video stream.

The documentation server forms part of the system according to a further education. The documentation server preferably includes a data store for storing the records of events sent by the portable communication terminal. By storing the records of the events not merely on the portable communication terminal but in the memory of the documentation server, these are e.g. accessible to service personnel who can view the selected records. In addition, the recordings thus stored are still available even if the portable communication terminal has e.g. was destroyed or stolen, especially in the dangerous situation, which are then documented within the records. In this way, the security of a user can be significantly increased. After a predetermined duration, e.g. of one day or one week (for example, depending on the user's setting), the recordings stored on the Documentation Server can be deleted again.

The portable recording device may comprise a camera for recording events in the form of camera images and / or videos. Alternatively or additionally, the portable recording device comprises a microphone for recording events in the form of sound recordings. These are particularly meaningful forms of recordings of events.

The portable communication terminal comprises in one embodiment of the system a face recognition means. The face recognition means is arranged to recognize whether a human face is reproduced in a camera image and / or a video from the received recordings. The at least one predetermined decision criterion may include recognizing a human face by means of the face recognition means. The decision criterion may also include the recognition of a human face with an aggressive facial expression and / or the recognition of a particular human face. In this way, dangerous situations associated with other people can be detected particularly reliably.

The at least one predetermined decision criterion may include the expiration of a predetermined period of time since a previous transmission of records via the radio communication interface to the documentation server. This allows a periodic sending of records, for example with between 1 and 15 Records per second. In this way, an optimal ratio between as complete documentation as possible and the lowest possible volume of data to be transmitted can be achieved.

The portable communication terminal and / or the portable recording device may comprise one or more sensors, in particular one or more position and / or acceleration sensors, in particular for detecting a change in a spatial position and / or a change in an acceleration. The at least one predetermined decision criterion may comprise exceeding the change in the spatial position and / or the acceleration of a predetermined threshold value. In this way, it is possible to reliably document dangerous situations that accompany a rapid change in position.

The portable communication terminal and / or the portable recording device may include at least one user operable input means. The at least one predetermined decision criterion may comprise a determination that the at least one input means has been actuated or that the at least one input means has not been actuated for a predetermined period of time. For example, that is Input means an emergency button. Pressing the emergency button triggers the transmission of recordings and / or an emergency signal to the documentation server. In particular, a current recording (eg a current camera image together with a current sound recording) can be transmitted, in particular continuously (eg in the form of a live video). Alternatively or additionally, at least one input means in the form of a security key is provided, which is to be actuated at regular intervals in order to confirm that there is no dangerous situation. If the security key is not pressed for an extended period of time, eg 1, 5 or 30 minutes, records will be selected in response and sent to the documentation server. According to a preferred alternative, an input means in the form of an on-off switch is provided. A first actuation of the on-off switch activates the system, a second actuation deactivates the system again. The at least one predetermined decision criterion may include a determination that a time since the first operation and before a second operation is longer than a predetermined period of time. As a result, emergency situations can be detected in a simple manner.

The portable communication terminal may be configured to generate an emergency signal based on the predetermined decision criterion and to send it via the radio communication interface to the documentation server. As a result, a particularly rapid arrival of security personnel can be achieved.

Optionally, the documentation server is adapted to issue an emergency signal based on a predetermined decision criterion, e.g. if a danger situation is detected or anticipated by the documentation server when analyzing the recordings. The emergency signal may be output to the portable communication terminal and / or security personnel.

The portable recording device may be incorporated into an article that is portable on the body of a user, in particular in the form of a garment, a piece of jewelry or a piece of luggage, alternatively in the form of a cuddly toy or a toy. As a result, the portable recording apparatus can be carried particularly comfortably. It is advantageous if the portable recording device is provided with a clearly visible warning, which can contribute to deterrence and avert potential dangerous situations.

The object is also achieved by a system for automatically documenting events according to claim 11.

Such a system comprises a portable recording apparatus for recording events having a local area communication interface for data communication, a portable communication terminal having a wireless communication interface for wireless data communication in a wireless communication network, and a local communication interface for data communication with the portable communication device's local communication interface, and a documentation server comprising a Data store for storing recordings of events. In this case, the portable recording device is designed to generate a data stream comprising records of events and to send them to the portable communication terminal. The portable communication terminal is configured to receive, via its local communication interface, the data stream comprising records of events from the portable recording device and to send at least a portion of the recordings to the documentation server via the radio communication interface. In this case, the documentation server comprises a selection means for selecting a part of the received recordings on the basis of a predetermined decision criterion and is optionally designed to store the selected part of the recordings in the data memory.

This system is largely the same as the previous system. The difference is that the events are selected here by the documentation server. Even so, the course of the dangerous situation can be reconstructed retrospectively, whereby only a comparatively small amount of data has to be examined by the selection.

The object is also achieved by a method for the automatic documentation of events with the features of claim 12.

• - Aufzeichnen von Ereignissen mittels der tragbaren Aufzeichnungsvorrichtung;
• - Übermitteln der Aufzeichnungen von Ereignissen von der tragbaren Aufzeichnungsvorrichtung an das tragbare Kommunikationsendgerät über die Nahkommunikationsschnittstellen der tragbaren Aufzeichnungsvorrichtung und des tragbaren Kommunikationsendgeräts; und
• - Senden zumindest eines Teils der Aufzeichnungen über die Funkkommunikationsschnittstelle an einen Dokumentationsserver.

The method employs a system according to any aspect described herein and includes the following steps:

• - recording events by means of the portable recording device;
• Transmitting the records of events from the portable recording device to the portable communication terminal via the near-communication interfaces of the portable recording device and the portable communication terminal; and
• - Sending at least a portion of the records via the radio communication interface to a documentation server.

• 1 eine schematische Darstellung eines Systems zur automatischen Dokumentation von Ereignissen;
• 2 eine schematische Darstellung mit weiteren Details des Systems gemäß 1; und
• 3 eine schematische Darstellung einer Kommunikation im System gemäß 1 und 2.

In connection with the embodiments illustrated in the figures, the invention will be explained. Show

• 1 a schematic representation of a system for automatic documentation of events;
• 2 a schematic representation with further details of the system according to 1 ; and
• 3 a schematic representation of a communication in the system according to 1 and 2 ,

1 shows a system 1 for automatically documenting events comprising a portable communication terminal 10 in the form of a smartphone, a portable recording device 11 and a documentation server 12 ,

The portable recording device 11 and the portable communication terminal 10 are owned by a user B who can carry her. The portable recording device 11 is striking, for example, with clearly visible warning colors and / or in the form of a conspicuous poison frog. In this way, persons can be confident in the use of the portable recording device 11 to be made aware. The portable recording device 11 is present for easy handling in a piece of jewelry in the form of a chain 13 integrated, alternatively in a garment. The system 1 Of course, it can also be more than a portable recording device 11 in particular two or three portable recording devices 11 include.

The portable communication terminal 10 is with the portable recording device 11 by means of a near-communication data connection NK connected, for example in the form of a Bluetooth connection.

The portable recording device 11 includes (or the portable recording devices 11 each include) a camera 111 and optionally a microphone 112 (in 2 shown). By means of the camera 111 takes the portable recording device 11 Photos and / or videos on (optionally including Tom using the microphone 112 ) to record events in the field of view of the camera 111 , Especially in a usual file format. The records of the events are transmitted by the portable recording device 11 via the near-communication data connection NK to the portable communication terminal 10 , The portable communication terminal 10 receives the records of the events and optionally stores them in a volatile or non-volatile memory. The portable recording device 11 transmits the records of events, for example in the form of a data stream, ie in particular in the form of a continuous flow of data sets, the end of which at least for the portable recording device 11 not necessarily be foreseen in advance. For example, each record is a record of one event or multiple records of events. Alternatively, however, it could also be provided that the portable communication terminal 10 the transmission of recordings of events from the portable recording device 11 request, especially at periodic intervals.

Averaged over a typical service life (eg, 10 minutes, 1 hour, or 5 hours), the portable communication terminal receives 10 from the portable recording device 11 Record events with a first data transfer rate.

The portable communication terminal 10 is with the documentation server 12 via a mobile data connection MK connected. The maximum data transfer rate of the mobile data connection MK is often less than the first data transfer rate. In many cases, it is also desirable to have the total volume of over the cellular data connection MK transmitted data does not exceed a given maximum volume.

The portable communication terminal 10 only transmits part of the records of events that it received from the portable recording device 11 received to the documentation server 12 , Averaged over the typical useful life, the portable communication terminal transmits 10 thus records of events at a second data transfer rate that is less than the first data transfer rate.

The part of the records of events that the portable communication terminal 10 to the documentation server 12 transmitted receives the portable communication terminal 10 by selection from that of the portable recording device 11 received records. The selection is based on a predetermined decision criterion or on the basis of several predetermined decision criteria. If a particular record of one or more events (for example in the form of a video) meets the decision criterion or the decision criteria, it is sent to the documentation server 12 sent. If the record does not satisfy the decision criterion or decision criteria, the portable communication terminal discards 10 the record.

The portable communication terminal 10 thus, guides only part of the portable recording device 11 receive records to the documentation server 12 further.

The documentation server 12 stores the received records of events in a data store 120 , Service employees can use the data store 120 to view stored records. At the documentation server 12 For example, it is a server computer.

2 shows more details of the system 1 , According to 2 includes the portable recording device 11 next to the camera 111 the already described microphone 112 , The camera 111 and the microphone 112 are with a processor 114 operatively connected. The processor 114 receives the from the camera 111 and / or the microphone 112 recorded records of events and presents them at least partially (partially or completely) to a Nahkommunikationsschnittstelle 110 ready. The near-communication interface 110 builds a near-communication data connection NK with a near-communication interface 101 of the portable communication terminal 10 records and sends the provided records of events to the local communication interface 101 of the portable communication terminal 10 ,

The near-communication interface 101 of the portable communication terminal 10 places the received records of events to a program (app) of the portable communication terminal 10 ready, in particular, on a controller or processor 105 of the portable communication terminal 10 (in particular in the form of a smartphone) is executed. The controller or processor, hereinafter referred to as the processor 105 denotes the provided records of events at least partially (partially or completely) to a radio communication interface 100 ready. The radio communication interface 100 builds a cellular data connection MK (alternatively, for example, a WLAN data connection) to a transceiver 20 a mobile communication network 2 on. In the mobile communication network 2 These are, for example, a GSM network, a GPRS network, a UMTS network and / or an LTE network, alternatively a WLAN network.

The transceiver 20 puts the received records of events to the documentation server 12 ready. This is preferably done via the Internet. The documentation server 12 stores the received records of events in its data store 120 , In this way, the records of the events are automatically documented.

Not all of the portable recording device 11 recorded records of events can or should be stored in the data store 120 of the documentation server 12 get saved. For example, a provided transmission bandwidth will not suffice to transmit all recordings of events. In particular, a selection or filtering of the recorded records of events may be made to include only those records in the data store 120 save with an increased probability of a dangerous situation.

For selection or filtering, one or more decision criteria are applied. This can be done in the portable recording device 11 , in the portable communication terminal 10 and / or in the documentation server 12 respectively.

The portable recording device 11 includes a selection agent 115 , which in the present example as program code from the processor 114 is performed. The selection agent 115 applies at least one predetermined decision criterion to the recorded records and places only those records to the near-end communication interface 110 ready for which the predetermined decision criterion is met. The portable recording device 11 includes a sensor 113 , in the form of an acceleration sensor. The sensor 113 Detects whether the portable recording device undergoes a strong acceleration, such as caused by a fall and an impact. The predetermined decision criterion is, for example, that by the sensor 113 detected acceleration exceeds a predetermined threshold. The processor 114 can be set up, only those records of events for transmission to the Nahkommunikationsschnittstelle 110 provide in a certain time window before and / or after the fulfillment of the predetermined Decision criteria were recorded (eg 1 second, 10 seconds or 1 minute).

Alternatively or additionally, the portable communication terminal also includes 10 a sensor 103 which can be made as the sensor 113 portable recording device 11 , The sensor 103 of the portable communication terminal 10 is to the processor 105 of the portable communication terminal 10 connected. The processor 105 can be a selection agent 107 which applies a predetermined decision criterion, so that only those records of events for transmission to the radio communication interface 100 be detected in a certain time window before and / or after the fulfillment of the predetermined decision criterion have been detected (eg 1 second, 10 seconds or 1 minute).

A particularly simple decision criterion, which is the selection agent 107 of the portable communication terminal 10 For example, the expiration of a predetermined period of time since the previous transmission of one or more records to the documentation server 12 has passed. The predetermined period of time is, for example, one second, one tenth of a second or one fifteenth of a second.

Alternatively or additionally, a decision criterion is provided which is based on an analysis of an image content of the records of the events. For this purpose, for example, an artificial neural network can be used and / or an AI (artificial intelligence) unit. If a particular pattern is recognized in the records of events, the decision criterion is met. By way of example, the portable communication terminal comprises 10 according to 2 a facial recognition device 102 , The facial recognition agent 102 analyzes the records of events that the portable communication terminal 10 from the portable recording device 11 receives. Recognizes the facial recognition 102 a face, especially a human face, the decision criterion is fulfilled. Alternatively or additionally, it may be provided that the decision criterion is met only when a particular human face and / or a human face that indicates a certain emotion is detected.

The portable communication terminal 10 is further configured, an emergency signal via the radio communication interface 100 to the documentation server 12 if at least one particular decision criterion is met. This may, for example, the operation of an input means 104 be in the form of an emergency button and / or not done operation of the input means 104 in the form of a security key or a shutdown key for a predetermined period of time. The input device 104 preferably comprises a record button, the operation of which the reception of the records by the portable communication terminal 10 and / or their transmission to the documentation server 12 activated. Pressing the switch-off button can reactivate this.

Also the documentation server 12 can be selection agent 121 include, for example, a processor 122 be executed. The selection agents 121 For example, apply the same decision criteria as the selection means 107 of the portable communication terminal 10 ,

With the system 1 Consequently, it is possible to automatically record events based on records and to use the records as needed at a later date. For example, the records may serve as mementos, alternatively or additionally as evidence after the occurrence of a hazardous situation.

Based on 3 In the following, the procedure is the occurrence of a dangerous situation for the user B explained. Receives the documentation server 12 an emergency signal from the portable communication terminal 10 , will automatically make a call or telephone conversation between a service representative S or an artificial language processing system and the portable communication terminal 10 the user B built up. Here the user can B be asked if he is in an emergency. Furthermore, the user can B an information on a display 106 (see in particular 2 ) of the portable communication terminal 10 be displayed, for example, one of the service employee S transmitted information. Alternatively or additionally, a sighting or analysis of the data memory is automatically performed 120 stored records of events performed. The inspection or analysis is carried out by a service employee S or by an analysis system comprising, for example, at least one neural network and / or one AI unit. If an emergency or dangerous situation is detected, an emergency service automatically becomes available R (eg the police) instructed to become the user B to go.

Optional is a maximum storage duration of the recordings in the data memory 120 after which the recordings are automatically deleted.

LIST OF REFERENCE NUMBERS

1

system

10

portable communication terminal

100

Radio communication interface

101

Nahkommunikationsschnittstelle

102

Face detection means

103

sensor

104

input means

105

processor

106

display

107

selection means

11

portable recording device

110

Nahkommunikationsschnittstelle

111

camera

112

microphone

113

sensor

114

processor

115

selection means

12

documentation server

120

data storage

121

selection means

122

processor

13

Chain (portable object)

2

Mobile communication network

20

Transceiver

B

user

NK

Augmentative communication data link

MK

Wireless data connection

R

ambulance service

S

service staff

Claims (12)

A system for automatically documenting events, comprising: - A portable recording device (11) for recording events, with a Nahkommunikationsschnittstelle (110) for data communication, and - A portable communication terminal (10) with a wireless communication interface (100) for wireless data communication in a radio communication network (2) and with a Nahkommunikationsschnittstelle (101) for data communication with the Nahkommunikationsschnittstelle (101) of the portable recording device (11), wherein the portable communication terminal (10 ) is adapted to receive via its local communication interface (110) a data stream comprising recordings of events from the recording device (11), selection means (107) for selecting a part of the received recordings on the basis of a predetermined decision criterion and adapted to select the one selected To send part of the records via the radio communication interface (100) to a documentation server (12). System after Claim 1 , further comprising the documentation server (12), wherein the documentation server (12) comprises a data memory (120) for storing the recordings of events sent by the portable communication terminal (10). System after Claim 1 or 2 , characterized in that the portable recording device (11) comprises a camera (111) for recording events in the form of camera images and / or videos and / or a microphone (112) for recording events in the form of sound recordings. System after Claim 3 characterized in that the portable communication terminal (10) comprises face recognition means (102) arranged to detect whether a human face is reproduced in a camera image and / or video from the received recordings, the at least one predetermined one Decision criterion comprises the recognition of a human face by means of the face recognition means (102). System according to one of the preceding claims, characterized in that the at least one predetermined decision criterion comprises the expiry of a predetermined period of time since a previous transmission of recordings via the radio communication interface (100) to the documentation server (12). System according to one of the preceding claims, characterized in that the portable communication terminal (10) and / or the portable recording device (11) comprises a sensor (103, 113) for detecting a change in a spatial position and / or an acceleration change, wherein the at least one predetermined decision criterion comprises exceeding the change in the spatial position and / or the acceleration of a predetermined threshold value. System according to one of the preceding claims, characterized in that the portable communication terminal (10) and / or the portable recording device (11) comprises at least one operable input means (104), wherein the at least one predetermined decision criterion comprises a determination that the at least one input means (104) has been actuated or that the at least one input means (104) has not been actuated for a predetermined period of time. System according to one of the preceding claims, characterized in that the portable communication terminal (10) is adapted to send an emergency signal via the radio communication interface (100) to the documentation server (12) based on the predetermined decision criterion. System according to one of the preceding claims, characterized in that the documentation server (12) is designed based on the predetermined decision criterion to issue an emergency signal, in particular to the portable communication terminal (10). A system according to any one of the preceding claims, characterized in that the portable recording device (11) is integrated in an object which can be worn on the body of a user (B), in particular in the form of a garment, a piece of jewelery or a piece of luggage. System for automatically documenting events, in particular according to one of the preceding claims, comprising: - A portable recording device (11) for recording events, with a Nahkommunikationsschnittstelle (110) for data communication, - A portable communication terminal (10) with a wireless communication interface (100) for wireless data communication in a radio communication network (2) and with a Nahkommunikationsschnittstelle (101) for data communication with the Nahkommunikationsschnittstelle (101) of the portable recording device (11), and - a documentation server (12) comprising a data memory (120) for storing recordings of events, the portable communication terminal (10) being adapted to provide via its local communication interface (110) a data stream comprising recordings of events from the recording device (11) and to send at least a portion of the recordings to the documentation server (12) via the radio communication interface (100), and wherein the documentation server (12) comprises selection means (107) for selecting a portion of the received recordings based on a predetermined decision criterion and in particular thereto is designed to store the selected part of the records in the data memory (120). A method for automatically documenting events, comprising a system (1) according to one of the preceding claims, comprising the following steps: - recording events by means of the portable recording device (11); Transmitting the records of events from the portable recording device (11) to the portable communication terminal (10) via the near-communication interfaces (101, 110) of the portable recording device (11) and the portable communication terminal (10); and - Sending at least a portion of the records via the radio communication interface (100) to a documentation server (12).

Images