CN111276137A

CN111276137A - Method, electronic device and computer readable medium for protecting passengers

Info

Publication number: CN111276137A
Application number: CN201811476107.8A
Authority: CN
Inventors: 俞帅帅
Original assignee: Beijing Didi Infinity Technology and Development Co Ltd
Current assignee: Beijing Didi Infinity Technology and Development Co Ltd
Priority date: 2018-12-04
Filing date: 2018-12-04
Publication date: 2020-06-12

Abstract

Embodiments of the present disclosure provide a method of protecting an occupant. In the method, an electronic device receives a speech signal of a conversation between a passenger and a driver of a vehicle during the passenger's ride in the vehicle. Further, the electronic device detects a speech in the voice signal indicating that the passenger is in a dangerous state. Still further, in response to detecting the utterance in the speech signal, the electronic device takes a protective action for the occupant. The embodiment of the disclosure can improve the safety of passengers taking vehicles.

Description

Method, electronic device and computer readable medium for protecting passengers

Technical Field

Embodiments of the present disclosure relate generally to the field of transportation travel and, more particularly, to a method, electronic device, and computer-readable medium for protecting passengers.

Background

With the popularization of mobile internet and smart devices, vehicles (such as taxies, special cars, windmills and the like) are reserved for travel by using car reservation application software installed on terminal devices (such as mobile phones) and become popular travel modes due to the characteristics of convenience, rapidness and the like. However, during the travel of the passenger in the vehicle, there may be situations where personal and property safety is compromised, such as personal injury to the passenger by the vehicle driver. For this reason, the conventional taxi appointment platform provides a trip sharing function to passengers. Through the function, the passenger can manually share the travel information of the passenger vehicle to the preset contact person, so that the preset contact person can take action to guarantee the personal and property safety of the passenger when the passenger is in danger. For example, the predetermined contact may provide the passenger's travel information to the police.

However, the above-described functions often make it difficult to provide timely protection for passengers when a safety event occurs. For example, when a passenger is in danger, the passenger is likely to be stressed or in a coma, so that the passenger has no ability to timely and accurately share the travel information to own contacts, and related personnel cannot timely take effective protection measures (alarming or travel supervision) according to the travel information of the passenger, so that the good opportunity of protecting or rescuing the passenger is delayed. In addition, the traditional car booking platform has the problems that the shared travel information is limited and single, only a notification function is provided for potential safety hazards, a blocking function is not provided, and the like.

Disclosure of Invention

Embodiments of the present disclosure relate to a method, an electronic device, and a computer-readable medium for protecting an occupant.

In a first aspect of the disclosure, a method of protecting an occupant is provided. The method comprises the following steps: during the passenger's ride in the vehicle, a speech signal of a conversation between the passenger and a driver of the vehicle is received. The method further comprises the following steps: utterances are detected in the speech signals indicating that the passenger is in a dangerous condition. The method further comprises the following steps: responsive to detecting the utterance in the speech signal, a protective action is taken for the occupant.

In a second aspect of the present disclosure, a method of protecting an occupant is provided. The method comprises the following steps: a departure location and a destination location of a passenger in a vehicle and a current location of the vehicle are obtained. The method further comprises the following steps: whether the vehicle deviates from the destination location is determined based on the departure location, the destination location, and the current location. The method further comprises the following steps: responsive to determining that the vehicle deviates from the destination location, protective action is taken for the occupant.

In a third aspect of the disclosure, an electronic device is provided. The electronic device includes at least one processor and at least one memory storing computer program instructions. The at least one memory and the computer program instructions are configured to, with the at least one processor, cause the electronic device to: during the passenger's ride in the vehicle, a speech signal of a conversation between the passenger and a driver of the vehicle is received. The at least one memory and the computer program instructions are further configured to, with the at least one processor, cause the electronic device to: utterances are detected in the speech signals indicating that the passenger is in a dangerous condition. The at least one memory and the computer program instructions are further configured to, with the at least one processor, cause the electronic device to: responsive to detecting the utterance in the speech signal, a protective action is taken for the occupant.

In a fourth aspect of the present disclosure, an electronic device is provided. The electronic device includes at least one processor and at least one memory storing computer program instructions. The at least one memory and the computer program instructions are configured to, with the at least one processor, cause the electronic device to: a departure location and a destination location of a passenger in a vehicle and a current location of the vehicle are obtained. The at least one memory and the computer program instructions are further configured to, with the at least one processor, cause the electronic device to: whether the vehicle deviates from the destination location is determined based on the departure location, the destination location, and the current location. The at least one memory and the computer program instructions are further configured to, with the at least one processor, cause the electronic device to: responsive to determining that the vehicle deviates from the destination location, protective action is taken for the occupant.

In a fifth aspect of the disclosure, a computer-readable medium is provided. The computer readable medium includes machine executable instructions. The machine executable instructions, when executed, cause a machine to perform the steps of the method according to the first aspect.

In a sixth aspect of the disclosure, a computer-readable medium is provided. The computer readable medium includes machine executable instructions. The machine executable instructions, when executed, cause the machine to perform the steps of the method according to the second aspect.

It should be understood that the statements herein reciting aspects are not intended to limit the critical or essential features of the embodiments of the present disclosure, nor are they intended to limit the scope of the present disclosure. Other features of the present disclosure will become apparent from the following description.

Drawings

The above and other objects, features and advantages of the embodiments of the present disclosure will become readily apparent from the following detailed description read in conjunction with the accompanying drawings. Several embodiments of the present disclosure are illustrated by way of example, and not by way of limitation, in the figures of the accompanying drawings and in which:

FIG. 1 illustrates a schematic diagram of an example environment in which embodiments of the present disclosure may be implemented.

Fig. 2 shows a flow chart of a method of protecting an occupant according to an embodiment of the present disclosure.

Fig. 3 shows a schematic diagram of a terminal device interface for providing travel information to a secure contact according to an embodiment of the disclosure.

Fig. 4 shows a schematic diagram of a terminal device interface for providing trip record information to a secure contact according to an embodiment of the present disclosure.

Fig. 5 shows another schematic diagram of a terminal device interface for providing trip record information to a secure contact according to an embodiment of the present disclosure.

Fig. 6 shows a flow chart of a method of protecting an occupant according to another embodiment of the present disclosure.

FIG. 7 shows a schematic diagram of vehicle travel route monitoring according to an embodiment of the present disclosure.

FIG. 8 shows a schematic block diagram of a device that may be used to implement embodiments of the present disclosure.

Throughout the drawings, the same or similar reference numerals are used to designate the same or similar components.

Detailed Description

The principles and spirit of the present disclosure will be described with reference to a number of exemplary embodiments shown in the drawings. It is understood that these specific embodiments are described merely to enable those skilled in the art to better understand and implement the present disclosure, and are not intended to limit the scope of the present disclosure in any way.

As mentioned above, conventional car reservation platforms do not in many cases guarantee that passengers can notify the relevant persons in time when personal and property safety is threatened, so that effective protective measures (alarm or trip supervision) can be taken, thereby taking away the opportunity to protect or rescue passengers. In addition, the traditional car booking platform has the problems that the shared travel information is limited and single, only a notification function is provided for potential safety hazards, a blocking function is not provided, and the like. In view of the above, embodiments of the present disclosure provide a method, an electronic device, and a computer-readable medium for protecting a passenger to solve the above problems and other potential problems in the conventional solutions, thereby improving safety of the passenger in a vehicle. Some embodiments of the disclosure are described in detail below with reference to the accompanying drawings.

FIG. 1 illustrates a schematic diagram of an example environment 100 in which embodiments of the present disclosure may be implemented. As shown in fig. 1, an example environment 100 includes a vehicle 110, and the vehicle 110 may be traveling on a road or may be parked, as embodiments of the present disclosure are not limited in this respect. In the following description, an embodiment of the present disclosure will be described with a vehicle 110 as an example of a vehicle. As used herein, a vehicle may be any type of vehicle capable of carrying people and/or things and being moved, including but not limited to cars, trucks, buses, electric vehicles, motorcycles, and the like. It should be understood that the use of vehicle 110 to describe embodiments of the present disclosure is for exemplary purposes only and is not intended to limit the scope of the present disclosure. Embodiments of the present disclosure are equally applicable to other vehicles than vehicles, such as boats, trains, planes, and the like.

As shown, a driver 130 and a passenger 140 of vehicle 110 are on vehicle 110, with their respective associated

terminal devices

135 and 140. It should be understood that the particular number of vehicles 110, drivers 130, passengers 140,

terminal devices

135 and 145 in fig. 1 is shown for purposes of example only and is not intended to limit the scope of the present disclosure. In other embodiments, any suitable number of drivers, passengers, and terminal devices may be present in vehicle 110, and embodiments of the disclosure are not limited in this respect.

The

terminal devices

135 and 140 may be any device having wired or wireless communication capabilities, including but not limited to, a cell phone, a computer, a personal digital assistant, a game console, a wearable device, an in-vehicle communication device, a virtual reality device, or a reality augmentation device, etc. For example, the

terminal devices

135 and 140 may provide, for example, microphones for capturing speech from the driver 130 and the passenger 140. Furthermore, the

terminal devices

135 and 140 may also be equipped with positioning means to determine their own position, which positioning means may for example be based on any of the following techniques: global Positioning System (GPS) technology, global navigation satellite system (GLONASS) technology, beidou navigation system technology, Galileo positioning system (Galileo) technology, quasi-zenith satellite system (QAZZ) technology, base station positioning technology, Wi-Fi positioning technology, and the like.

As further shown,

terminal devices

135 and 140 can be communicatively coupled with electronic device 120 via network 150 to send data or requests to electronic device 120 or receive data or requests from electronic device 120. In some embodiments, the network 150 that enables communication between the electronic device 120 and the

terminal devices

135 and 145 may include a wired network, a wireless network, or a combination of wired and wireless networks. For example, network 150 may include, but is not limited to, the Internet, a wide area network, a metropolitan area network, a local area network, a Virtual Private Network (VPN) network, a wireless communication network, and so forth.

In some embodiments, the electronic device 120 may include, for example, but is not limited to, any physical computer, virtual machine, or large computing device provided by various service providers, and the like. In the example environment 100 shown in FIG. 1, the electronic device 120 may be, for example, a server providing different functionality. For example, the

terminal devices

135 and 145 may have application software for the car-booking platform installed thereon, and the electronic device 120 may include a server providing a car-booking application service for the

terminal devices

135 and 145.

Although only one electronic device is shown in fig. 1, it should be understood that this is for purposes of example only and is not intended to limit the scope of the present disclosure. In some embodiments, the electronic device 120 may be separately implemented as a plurality of electronic devices. In other embodiments, the example environment 100 may also include a different number and/or functionality of electronic devices.

Taking a car-booking service scenario as an example, the electronic device 120 may be, for example, an electronic device for managing all vehicles (including the vehicle 110) joined in a car-booking platform (also referred to as "network entry"). For example, information for each networked vehicle may be pre-registered with the electronic device 120, including, but not limited to, identification information for the vehicle (e.g., license plate number, vehicle make, color, model, etc.), driver information for the vehicle (e.g., driver's name, gender, age, phone number, photograph, etc.), and similar other information.

Taking example environment 100 as an example, when vehicle 110 is used to service passenger 140, electronic device 120 may associate vehicle 110, terminal device 135 of driver 130, and terminal device 145 of passenger 140. During actual service, the terminal device 135 of the driver 130 and/or the terminal device 145 of the passenger 140 may determine their own location using their positioning means and upload information about the location (e.g., longitude and latitude) to the electronic device 120 via a client application installed in the

terminal devices

135 and 145, such as a driver-side application or a passenger-side application, to enable the electronic device 120 to determine the real-time location of the vehicle 110 during service.

In some embodiments, during the ride of passenger 140 on vehicle 110, electronic device 120 may obtain information related to the travel of passenger 140 on vehicle 110 through terminal device 135 of driver 130, terminal device 145 of passenger 140, or other devices on vehicle 110. Further, the electronic device 120 may determine whether the passenger 140 is in a dangerous state during the ride of the vehicle 110 by processing this information regarding the trip of the passenger 140. If the electronic device 120 determines that the passenger 140 is in a dangerous state, the electronic device 120 may take protective action against the passenger 140 to ensure ride safety of the passenger 140.

The various components and respective functions included in the example environment 100 are described above for exemplary purposes only. It is to be understood that embodiments of the present disclosure may also be implemented in other environments having different components and/or respective functions. Some embodiments of the present disclosure will be described in further detail below in conjunction with an example environment 100 as shown in fig. 1.

Fig. 2 shows a flow diagram of a method 200 of protecting an occupant according to an embodiment of the present disclosure. In some embodiments, the method 200 may be implemented by the electronic device 120 of fig. 1, for example, may be implemented by a processor or processing unit of the electronic device 120. In other embodiments, all or part of method 200 may also be implemented by an electronic device separate from electronic device 120, or may be implemented by other elements in example environment 100, such as terminal device 135 of driver 130 or terminal device 145 of passenger 140. For ease of discussion, the method 200 will be described in conjunction with FIG. 1, with the electronic device 120 performing the method 200 as an example.

At 210, the electronic device 120 receives speech signals of a conversation between the passenger 140 and the driver 130 during the passenger 140 riding in the vehicle 110. For example, the electronic device 120 may enable a recording function of the terminal device 135 of the driver 130 or the terminal device 145 of the passenger 140 and receive the voice signal from the

terminal device

135 or 145. As another example, the electronic device 120 may receive the voice signal from an audio capture device (not shown) in the vehicle 110. In other embodiments, electronic device 120 may receive voice signals from any one or more of terminal device 135, terminal device 145, audio capture device, and other similar devices. In this way, the electronic device 120 may obtain the voice signal in time, even in real time.

It will be appreciated that in some embodiments, the reception of the voice signal by the electronic device 120 may also be accomplished via the forwarding of an intermediary device. For example, the terminal device 135 of the driver 130 may transmit the collected voice signal to a network device (e.g., a base station) serving the terminal device 135, and then the network device forwards the voice signal to the electronic device 120.

At 220, the electronic device 120 detects an utterance in the received voice signal indicating that the passenger 140 is in a dangerous state. As mentioned above, the personal and property safety of passenger 140 may be compromised by driver 130 during travel in ride vehicle 110. In such a case, typically the speech signal of the conversation between the driver 130 and the passenger 140 will include utterances related to endangering the personal safety of the passenger 140. Such utterances may be issued by the driver 130, for example, to threaten the passenger 140. The utterance may also be uttered by the passenger 140, for example, to ask the driver 130. Thus, the utterance may indicate that the passenger 140 is in a dangerous state. For example, such utterances may include, but are not limited to, words, phrases, sentences, and/or the like having different degrees of violent meaning.

To better recognize such utterances in the speech signal, particularly utterances related to the meaning of an infringement, violence, or crime, in some embodiments, the electronic device 120 may convert the speech signal into text and then detect a target word associated with such utterances in the converted text. As an example, the voice signal received by the electronic device 120 may be "you are beautiful enough to not add a WeChat friend". What do I'm girl friends, what you have on request can be brought up? "for the speech signal, the electronic device 120 may convert it into text and extract a plurality of target words therefrom: growing, beautiful, us, plus, WeChat friends, girls friends, asking, drawing, etc. On this basis, the electronic device 120 may detect that the utterances "beautiful plus friend" and "do me girl friend" indicating that the passenger 140 is in a dangerous state are present in the voice signal, for example, by comparing with a pre-stored set of utterances. It will be understood that the target words listed herein are merely examples, and are not intended to limit the scope of the present disclosure in any way. In other embodiments, there may be different segmentation results for the same speech signal, which may depend on the lexicon or dictionary used.

In addition to recognizing utterances indicating that the occupant 140 is in a dangerous state, the electronic device 120 may also risk classify and rank different utterances for risk to determine the type and extent of risk to which the occupant 140 is exposed, thereby providing more information in the subsequent provision of protective measures to the occupant 140. Table 1 below shows example correspondences between "words", "hazard classifications", and "hazard classes". It will be appreciated that the entries in table 1 may be updated as appropriate, such as adding entries, deleting entries, modifying entries, and so forth. Further, it should also be understood that the specific entries in table 1 are set forth by way of example only and are not intended to limit the scope of the present disclosure in any way. In other embodiments, the correspondence in table 1 may include any other suitable number of "utterances," "danger classifications," "danger levels," etc., as well as other columns.

TABLE 1

Continuing with the above example, after the electronic device 120 detects the utterances "beautiful plus friends" and "do me girls friends" in the voice signal, it may be further determined from table 1 above that the two utterances have a danger rating of 4, and that the danger is classified as "language disturbance (wade)", thereby providing more information for subsequent protective measures provided to the passenger 140. In table 1, a lower number is used to indicate a higher risk level, e.g., a risk level of 2 is higher than a risk level of 3. However, it will be understood that in other embodiments, larger numbers may be used instead to refer to higher hazard levels.

At 230, if the electronic device 120 detects an utterance in the voice signal indicating that the passenger 140 is in a dangerous state, the electronic device 120 takes protective action with respect to the passenger 140. In embodiments of the present disclosure, the electronic device 120 may provide protection to the passenger 140 in a variety of ways. As one example, the electronic device 120 may provide the travel information of the passenger 140 to the security contacts of the passenger 140. As used herein, a security contact may refer generally to any person or organization capable of providing security protection to passenger 140, including but not limited to emergency contacts preset by passenger 140, police stations, security teams of car-booking platforms, and the like. Additionally, the trip information provided to the safety contacts may include identification information of the vehicle 110 and driver 130 information, etc., so that the safety contacts may provide protection or assistance to the passenger 140 based on the trip information.

Fig. 3 shows a schematic diagram of a terminal device interface 300 for providing travel information to a secure contact according to an embodiment of the disclosure. As shown in fig. 3, after electronic device 120 detects an utterance in the voice signal of passenger 140 talking to driver 130 indicating that passenger 140 is in a dangerous state (e.g., "beauty plus friends"), electronic device 120 may cause terminal device 145 of passenger 140 to invoke the text message sending function to send the travel information of passenger 140 to the security contacts of passenger 140. For example, as shown in edit box 310, the tour information may be "I'm using taxi appointment software, license plate number [ xxxx ], owner [ xxx ], voice content [ xxxx ], click on the viewable tour dynamic http:// ab. cd/ef 12345678". After the editing is completed, the electronic device 120 may cause the terminal device 145 to automatically issue the travel information without requiring the passenger 140 to trigger the transmission. Additionally or alternatively, electronic device 120 may send the travel information of passenger 140 directly over network 150 to the security contacts of passenger 140.

It will be understood that the particular content of the trip information shown in fig. 3 is merely exemplary, and is not intended to limit the scope of the present disclosure in any way. In other embodiments, the trip information may include any information that assists in providing protection to the passenger 140. Further, it will be understood that providing the travel information of the passenger 140 to the security contacts by way of short messages is merely exemplary and is not intended to limit the scope of the present disclosure in any way. In other embodiments, the itinerary information may be provided to the secure contacts by any suitable means, including, but not limited to, sending through various social software, placing a call to the secure contacts, and so forth.

In some embodiments, as described above, the electronic device 120 may determine a hazard level and hazard classification corresponding to an utterance indicating that the passenger 140 is in a hazardous state through table 1 above. On this basis, when providing the travel information to the security contacts, the electronic device 120 may provide the textual representation of the utterance, the risk level, and the risk classification, etc. to the security contacts of the passenger 140 at the same time, so as to provide the security contacts of the passenger 140 with more information about the risks encountered by the passenger 140, which facilitates the security contacts to perform protective measures for the passenger 140 in a more targeted manner. Additionally or alternatively, the electronic device 120 may also provide one or more of the textual representation, the risk level, and the risk classification described above to the security contact separately from the travel information.

As an example, if the electronic device 120 detects "robbing my things" in the voice signal, as can be seen from table 1 above, the danger classification corresponding to the utterance is "robbing property", and the danger level is "2". As such, the electronic device 120 may provide the following information to the security contacts of the passenger 140: "the passenger 140 is encountering a danger, the danger level is 2, the danger type is to robbe property, and the voice content is to robbe my thing", so that the safety contact of the passenger 140 can perform the protection measures for the passenger 140 more specifically. In some embodiments, if the electronic device 120 detects multiple utterances belonging to the same hazard classification, only one message may be sent to the security contact. Multiple messages may be sent if multiple utterances are detected that relate to multiple hazard classifications.

In the manner described above, the electronic device 120 may parse key content associated with the safety of the passenger 140 according to the driver's voice recording and determine the level and classification of the danger encountered by the passenger 140, so as to automatically send the travel information and the recording key content with higher danger degree of the passenger 140 to the safety contact of the passenger 140. Therefore, the safety contact can judge the severity of the situation according to the recording content, and further measures can be effectively taken.

The problem that the traditional taxi booking platform only shares the journey types (such as express trains, special trains, taxis and the like), license plate numbers, car owners (passengers) names and journey dynamic sharing with friends of the passengers is solved. For example, because the information shared by the journey is limited, the specific core information and important urgent content in the journey process cannot be timely and accurately shared to friends, and the friends cannot well take effective measures (alarm or journey supervision) in time according to the journey information. And the problems of poor stroke sharing effect and incapability of timely sharing are solved. For example, after receiving the travel sharing information, the friends of the passengers cannot determine the urgency of the travel according to the travel sharing information. When the car appointment platform analyzes the core content according to the driver and passenger voices and judges that the danger level is high, the car appointment platform cannot automatically and timely share the core content with emergency contacts, and the emergency is delayed.

It will be noted that by providing the travel information of the passenger 140 to the security contacts, the electronic device 120 can notify the corresponding personnel of the dangerous state of the passenger 140 in time, but the electronic device 120 does not provide active measures in the process to prevent the driver 130 from invading the passenger 140. Thus, in some embodiments, if an utterance is detected in the voice signal that indicates that the passenger 140 is in a dangerous state, the electronic device 120 may also send a warning message to the terminal device 135 of the driver 130 in an attempt to prevent further misbehavior of the passenger 140 by the driver 130. In some embodiments, such a warning message may be preset with a transmission condition. For example, when the hazard level of the utterance detected by the electronic device 120 reaches a threshold level, the electronic device 120 may issue a warning message to the terminal device 135 of the driver 130, thereby acting to frighten the driver 130, effectively discouraging misbehavior of the driver 130, greatly reducing the occurrence probability of the safety risk of the passenger 140.

As an example, the warning message may be issued in a manner that is disguised as customer service. For example, "Master X, you good, I am customer service. You are old users who support us for a long time, and I understand very much the mood at that moment. If you have something happened happily, welcome you to call for consultation at any time, we can solve you as much as possible, thank you! "

As another example, the warning message may be issued in a manner that disguises a psychological tutor, which may be applicable, for example, to situations where a driver's voice suicide or self-disability is found in the trip recording. For example, "Master X, you good, I am customer service. You are old users who support us for a long time, i understand the mood at this moment very well, and ten million don't worry about your family because of the carelessness of one time. If you have something happened happily, welcome you to call for consultation at any time, we can solve you as much as possible, thank you! "

As a further example, the warning message may also be issued in a manner of pretending to be an incoming call, i.e. the electronic device 120 may cause the terminal device 145 of the passenger 140 or the terminal device 135 of the driver 130 to issue a warning tone of an incoming call to interrupt the behavior of the driver 130 to the passenger 140.

In this way, embodiments of the present disclosure solve the problem of a full-range recording post-verification in the conventional scheme without any handling behavior at that time, that is, the conventional trip recording is biased towards post-trip verification, the in-trip system does not have an effective role, and for the intruding behavior occurring in the trip, there is no effective scheme to dissuade. If during a trip the appointment platform detects a problem in the riding voice that involves a higher risk level, without dissuading and preventing it, then more serious consequences may result.

It was introduced above by way of example that the protective action of the electronic device 120 against the passenger 140 may comprise providing the passenger's 140 trip information to a safety contact, sending a warning message to the terminal device 135 of the driver 130, etc. In other embodiments, electronic device 120 may also take any other suitable protective action for occupant 140, such as alerting, notifying vehicles in the vicinity of vehicle 110, etc., embodiments of the present disclosure are not limited in this respect.

As noted above, conventional taxi appointment platforms also have the problem of limited and singular shared trip information. Because the information shared by the journey is limited, the specific information in the journey process is not shared to the friends of the passenger, and therefore the friends of the passenger cannot take effective measures (alarming or journey supervision) well according to the journey information. To address this issue, in some embodiments of the present disclosure, passenger 140 may make a request via terminal device 145 to provide information related to the voice signal to his or her security contacts. In such a case, the electronic device 120 may provide information related to the voice signal to the security contacts of the passenger 140 in response to the request by the passenger 140. In this way, the security contacts of the passenger 140 can take effective measures depending on the actual situation. For example, the passenger 140 may issue a request to the electronic device 120 to provide a full-range recording to the security contact so that full details of the range may be presented to the security contact, which may determine to effectively take action accordingly.

Fig. 4 shows a schematic diagram of a terminal device interface 400 for providing trip record information to a secure contact according to an embodiment of the present disclosure. As shown in fig. 4, the passenger 140 may share the trip information of the ride vehicle 110 to a security contact, or other friend, etc. by clicking on a "trip share" icon 410 in the interface 400 on the end device 145 during or after the ride vehicle 110. After passenger 140 clicks on "trip share" icon 410, terminal device 145 displays the operation interface shown in fig. 5.

Fig. 5 shows another schematic diagram of a terminal device interface 500 for providing trip record information to a secure contact according to an embodiment of the present disclosure. As shown in fig. 5, the information to be shared with the security contact may include, for example, basic information of the trip, such as a type of the trip (e.g., express, special, taxi, etc.), a license plate number, a car owner (passenger) name, a trip dynamic, and the like. Additionally or alternatively, passenger 140 may also select to share "record to text" or "record file" via operating area 510. In the embodiment shown in FIG. 5, "recorded to textual content" may be set as a default selection, while "recorded file" may be set as a default non-selection. This is because the file size of the text content is typically much smaller than the size of the sound recording file. It will be appreciated that in other embodiments, the "sound file" may also be set as a default selection by the passenger 140 or other setup personnel. In other embodiments, both "recorded text-to-text content" and "recorded files" may be shared to friends at the same time.

The passenger 140 may then select in what manner to provide the travel information and the travel recording information to the security contacts or other buddies by clicking on the "note" icon 520, the "app 1" icon 530, the "app 2" icon 540, and the "app 3" icon 540. For example, after passenger 140 selects "note" icon 520, terminal device 145 may display an interface 300 similar to that depicted in fig. 3. However, unlike the previously described electronic device 120 that causes the terminal device 145 to automatically issue the travel information, because the sharing process is actively initiated by the passenger 140, the terminal 145 will send a short message including the travel information based on the trigger of the passenger 140.

In addition, it will be noted that the short message will include an address or link to "record-to-text" or "record file". When the secure contact receives and opens the short message, the secure contact may access the "recorded text-to-text" or "recorded file" stored on the electronic device 120 or other server by clicking on the address or link. Additionally or alternatively, the electronic device 120 may also send the "recording to text" or "recording file" directly to the terminal device of the secure contact.

In the method 200 described above in connection with fig. 2, the electronic device 120 uses speech signals of the conversation of the driver 130 and the passenger 140 to detect whether the passenger is in a dangerous state. In other embodiments, the electronic device 120 may also determine whether the passenger 140 is in a dangerous state by any other suitable means. An example of another way of detecting whether the passenger 140 is in a dangerous state is described below in conjunction with fig. 6.

Fig. 6 shows a flow diagram of a method 600 of protecting an occupant according to another embodiment of the present disclosure. Unlike method 200, in method 600, electronic device 120 uses the origin and destination locations of passenger 140 and the current location of vehicle 110 to determine whether passenger 140 is at risk.

In some embodiments, the method 600 may be implemented by the electronic device 120 of fig. 1, for example, may be implemented by a processor or processing unit of the electronic device 120. In other embodiments, all or part of method 600 may also be implemented by an electronic device separate from electronic device 120, or may be implemented by other elements in example environment 100, such as terminal device 135 of driver 130 or terminal device 145 of passenger 140. For ease of discussion, the method 600 will be described in conjunction with fig. 1, taking the example of the electronic device 120 performing the method 600.

At 610, the electronic device 120 obtains the departure and destination locations of the passenger 140 in the vehicle 110 and the current location of the vehicle 110. In some embodiments, electronic device 120 may determine the departure location and destination location of passenger 140 based on the appointment information issued by passenger 140 through terminal device 145. For example, the passenger 140 will fill out his/her departure location and destination location when he/she makes a car-appointment request through the terminal device 145. In other embodiments, the electronic device 120 may also obtain the departure location and the destination location of the passenger 140 from the terminal device 135 of the driver 130, because the driver 130 accepts the car appointment request of the passenger 140 through the terminal device 135, the terminal device 135 will also store the departure location and the destination location of the passenger 140.

In some embodiments, electronic device 120 may determine the current location of vehicle 110 through a terminal device 135 of driver 130 of vehicle 110, a terminal device 145 of passenger 140, or a locating device (not shown) in vehicle 110. In other embodiments, electronic device 120 may also obtain the current location of vehicle 110 through any one or more of these devices. In this way, electronic device 120 may more accurately and timely obtain the current location of vehicle 110. It will be appreciated that electronic device 120 may also determine the current location of vehicle 110 in any other suitable manner, such as by obtaining the current location of vehicle 110 from traffic network information or road network information, and so forth.

At 620, the electronic device 120 determines whether the vehicle 110 is off of the destination location based on the departure location and the destination location of the passenger 140 and the current location of the vehicle 110. It will be appreciated that, depending on the departure and destination locations of the passenger 140, the electronic device 120 may at least roughly determine an approximate travel route for the vehicle 110. In conjunction with the current location of vehicle 110, electronic device 120 may determine whether the current travel route of vehicle 110 deviates from the destination location of passenger 140. Several ways of determining the deviation of the vehicle 110 from the destination location are described in detail below in conjunction with fig. 7.

FIG. 7 shows a schematic diagram of vehicle travel route monitoring 700, according to an embodiment of the present disclosure. To better illustrate the process of determining that vehicle 110 is off-destination, several parameters related to the travel route and the target route of vehicle 110 will first be defined. As shown in FIG. 7, A (x)_a,y_a) Representing a starting position (or called starting point of the starting place), where x_aDenotes the starting point longitude, y_aRepresenting the starting point latitude; b (x)_b,y_b) Indicates destination end point, x_bIndicates end point longitude, y_bRepresenting the terminal latitude; c (x)_c,y_c) Points representing current driving, x_cIndicating the current point of travel longitude, y_cRepresenting the current driving point latitude; d (x)_d,y_d) Represents the projected point of the current driving point on the connecting line of the starting point and the end point (namely the CD is perpendicular to the AB), x_dRepresenting the projection point longitude, y_dRepresenting the projected point latitude; and theta represents an included angle between a connecting line of the starting point and the current driving point and a connecting line of the starting point and the terminal point. The AD is a link distance between the current driving point and the starting point of the departure place, that is, a projection distance of the real-time driving route of the vehicle on the target route, and may be referred to as an "effective driving distance".

According to the geometric theorem, the above calculation formula of each parameter can be obtained:

cosθ＝(AB²+AC²-BC²)/(2*AB*AC)，cosθ²+sinθ²＝1，CD＝AC*sinθ，AD＝AC*cosθ。

as shown in fig. 7, when the deviation angle θ is larger, it can be said that the traveling route of the vehicle 110 deviates from the correct destination to a larger extent. Thus, in some embodiments, the electronic device 120 may determine whether the angle of deviation θ of a first direction (a → C) pointing from the departure location a to the current location C of the vehicle 110 relative to a second direction (a → B) pointing from the departure location a to the destination location B is greater than a threshold angle for more than a first threshold length of time.

If the deviation angle θ is greater than the threshold angle for more than a first threshold length of time, the electronic device 120 may determine that the vehicle 110 is deviating from the destination location B. For example, the threshold angle may be set between 0-180 degrees. It will be understood that the specific numerical values herein are merely examples and are not intended to limit the scope of the disclosure in any way. In other embodiments, the threshold angle and the first threshold duration may be chosen appropriately according to specific technical environment and design requirements.

As shown in fig. 7, the greater the CD distance, the greater the degree to which the vehicle 110 deviates from the rough travel route. Thus, in some embodiments, the electronic device 120 may determine whether the current position C of the vehicle 110 deviates by a distance L from the second direction (a → B) that is greater than a threshold distance for more than a second threshold length of time.

If the departure distance L is greater than the threshold distance for more than a second threshold length of time, the electronic device 120 may determine that the vehicle 110 departs from the destination location B. For example, the threshold distance may be set between 0-infinity, where ∞ is infinity. It will be understood that the specific numerical values herein are merely examples and are not intended to limit the scope of the disclosure in any way. In other embodiments, the threshold distance and the second threshold duration may be chosen appropriately according to specific technical environment and design requirements.

Further, as shown in fig. 7, the effective traveling speed of the vehicle 110 in the second direction (a → B) may also reflect whether the vehicle 110 deviates from the destination position B. Thus, in some embodiments, the electronic device 120 may determine whether the speed of the vehicle 110 in the second direction (a → B) is less than the threshold speed for more than a third threshold length of time. If it is determined that the speed is less than the threshold speed for more than the third threshold duration, then the electronic device 120 may determine that the vehicle 110 is off of the destination location B. It will be appreciated that the threshold rate and the third threshold duration may be chosen reasonably according to specific technical circumstances and design requirements. An algorithm for calculating the effective travel speed is provided below.

To calculate the effective travel rate, the effective travel distance is first defined and calculated: AD ═ AC × cos θ. If AD>0, indicates that the travel path and the target path of vehicle 110 are less than 90 degrees, indicating travel in substantially the same direction as the target direction. If AD is 0, it indicates that the traveling route of the vehicle 110 is perpendicular to the target route by 90 degrees or that the vehicle 110 is in a stopped state. If AD<0, indicates that the travel path and the target path of the vehicle 110 are greater than 90 degrees, indicating that the vehicle is traveling in a direction substantially opposite the target direction. During vehicle travel, the effective speed may be defined and calculated as: v ═ d (AD)/dt, where v denotes the effective speed, AD denotes the effective distance traveled, t denotes time, and v denotes the derivative of distance AD with respect to time. Therefore, the temperature of the molten metal is controlled,

where the distances are all functions associated with time t.

At 630, if the electronic device 120 determines that the vehicle 110 is off of the destination location, the electronic device 120 takes protective action for the passenger 140. The protection actions for the passenger 140 have been described in detail above in the description of the method 200, and are not described in detail here. For example, in some embodiments, the electronic device 120 may provide the travel information of the passenger 140 to the security contacts of the passenger 140. In some embodiments, if the electronic device 120 detects that the vehicle 110 is off the destination location, only one message may be sent to the safety contacts of the passenger 120. In some embodiments, the trip information may include at least one of identification information of the vehicle 110 and driver 130 information. In some embodiments, in addition to providing the travel information of the passenger 140 to the security contacts, the electronic device 120 may also send a warning message to the terminal device 135 of the driver 130 of the vehicle 110.

Fig. 8 schematically illustrates a block diagram of a device 800 that may be used to implement embodiments of the present disclosure. As shown in fig. 8, device 800 includes a Central Processing Unit (CPU)801 that may perform various appropriate actions and processes in accordance with computer program instructions stored in a read-only memory device (ROM)802 or loaded from a storage unit 808 into a random access memory device (RAM) 803. In the RAM 803, various programs and data required for the operation of the device 800 can also be stored. The CPU 801, ROM 802, and RAM 803 are connected to each other via a bus 804. An input/output (I/O) interface 805 is also connected to bus 804.

A number of components in the device 800 are connected to the I/O interface 805, including: an input unit 806, such as a keyboard, a mouse, or the like; an output unit 807 such as various types of displays, speakers, and the like; a storage unit 808, such as a magnetic disk, optical disk, or the like; and a communication unit 809 such as a network card, modem, wireless communication transceiver, etc. The communication unit 809 allows the device 800 to exchange information/data with other devices via a computer network such as the internet and/or various telecommunication networks.

The various processes and processes described above, such as

method

200 or 600, may be performed by processing unit 801. For example, in some embodiments, the

method

200 or 600 may be implemented as a computer software program tangibly embodied in a machine-readable medium, such as the storage unit 808. In some embodiments, part or all of the computer program can be loaded and/or installed onto device 800 via ROM 802 and/or communications unit 809. When the computer program is loaded into the RAM 803 and executed by the CPU 801, one or more steps of the method 200 or the method 600 described above may be performed.

As used herein, the terms "comprises," comprising, "and the like are to be construed as open-ended inclusions, i.e.," including, but not limited to. The term "based on" should be understood as "based at least in part on". The term "one embodiment" or "the embodiment" should be understood as "at least one embodiment". The terms "first," "second," and the like may refer to different or the same object. Other explicit and implicit definitions may also be included herein.

As used herein, the term "determining" encompasses a wide variety of actions. For example, "determining" can include calculating, computing, processing, deriving, investigating, looking up (e.g., looking up in a table, a database or another data structure), ascertaining and the like. Further, "determining" can include receiving (e.g., receiving information), accessing (e.g., accessing data in a memory), and the like. Further, "determining" may include resolving, selecting, choosing, establishing, and the like.

It should be noted that the embodiments of the present disclosure can be realized by hardware, software, or a combination of software and hardware. The hardware portion may be implemented using dedicated logic; the software portions may be stored in a memory and executed by a suitable instruction execution system, such as a microprocessor or specially designed hardware. Those skilled in the art will appreciate that the apparatus and methods described above may be implemented using computer executable instructions and/or embodied in processor control code, such code being provided, for example, in programmable memory or on a data carrier such as an optical or electronic signal carrier.

Further, while the operations of the methods of the present disclosure are depicted in the drawings in a particular order, this does not require or imply that these operations must be performed in this particular order, or that all of the illustrated operations must be performed, to achieve desirable results. Rather, the steps depicted in the flowcharts may change the order of execution. Additionally or alternatively, certain steps may be omitted, multiple steps combined into one step execution, and/or one step broken down into multiple step executions. It should also be noted that the features and functions of two or more devices according to the present disclosure may be embodied in one device. Conversely, the features and functions of one apparatus described above may be further divided into embodiments by a plurality of apparatuses.

While the present disclosure has been described with reference to several particular embodiments, it is to be understood that the disclosure is not limited to the particular embodiments disclosed. The disclosure is intended to cover various modifications and equivalent arrangements included within the spirit and scope of the appended claims.

Claims

1. A method of protecting an occupant, comprising:

receiving a speech signal of a conversation between a passenger and a vehicle driver during the passenger's ride in a vehicle;

detecting, in the speech signal, an utterance indicating that the passenger is in a dangerous state; and

in response to detecting the utterance in the speech signal, taking a protective action for the occupant.

2. The method of claim 1, wherein receiving the speech signal comprises:

receiving the voice signal from at least one of a terminal device of the driver, a terminal device of the passenger, and an audio capture device in the vehicle.

3. The method of claim 1, wherein detecting the utterance comprises:

converting the voice signal into text; and

detecting a target word associated with the utterance in the text.

4. The method of claim 1, further comprising:

determining a risk level and a risk classification corresponding to the utterance; and

providing at least one of a textual representation, a risk level, and a risk classification of the utterance to a security contact of the passenger.

5. The method of claim 1, wherein taking protective action comprises:

providing the passenger's travel information to the passenger's security contacts.

6. The method of claim 5, wherein the trip information includes at least one of identification information and driver information of the vehicle.

7. The method of claim 1, further comprising:

providing information related to the voice signal to the passenger's secure contacts in response to a request by the passenger through his terminal device.

8. The method of claim 1, further comprising:

in response to detecting the utterance in the voice signal, a warning message is sent to a terminal device of the driver.

9. A method of protecting an occupant, comprising:

obtaining a departure position and a destination position of a passenger riding a vehicle and a current position of the vehicle;

determining whether the vehicle deviates from the destination location based on the departure location, the destination location, and the current location; and

in response to determining that the vehicle deviates from the destination location, taking protective action for the passenger.

10. The method of claim 9, wherein obtaining the current location comprises:

determining the current location by at least one of a terminal device of the vehicle driver, a terminal device of the passenger, and a positioning device in the vehicle.

11. The method of claim 9, wherein determining whether the vehicle deviates from the destination location comprises:

determining whether a deviation angle of a first direction pointing from the departure location to the current location relative to a second direction pointing from the departure location to the destination location is greater than a threshold angle for more than a first threshold length of time; and

determining that the vehicle deviates from the destination location in response to the angle of deviation being greater than the threshold angle for more than the first threshold length of time.

12. The method of claim 9, wherein determining whether the vehicle deviates from the destination location comprises:

determining whether a deviation distance of the current location from a second direction pointing from the departure location to the destination location is greater than a threshold distance for more than a second threshold length of time; and

determining that the vehicle deviates from the destination location in response to determining that the deviation distance is greater than the threshold distance for more than the second threshold length of time.

13. The method of claim 9, wherein determining whether the vehicle deviates from the destination location comprises:

determining whether a speed of the vehicle in a second direction from the departure location toward the destination location is less than a threshold speed for more than a third threshold length of time; and

determining that the vehicle deviates from the destination location in response to determining that the speed is less than the threshold speed for more than the third threshold length of time.

14. The method of claim 9, wherein taking protective action comprises:

15. The method of claim 14, wherein the trip information includes at least one of identification information and driver information of the vehicle.

16. The method of claim 9, further comprising:

in response to determining that the vehicle deviates from the destination location, sending a warning message to a terminal device of the vehicle driver.

17. An electronic device, comprising:

at least one processor; and

at least one memory storing computer program instructions, the at least one memory and the computer program instructions configured to, with the at least one processor, cause the electronic device to:

18. The electronic device of claim 17, wherein the at least one memory and the computer program instructions are further configured to, with the at least one processor, cause the electronic device to:

19. The electronic device of claim 17, wherein the at least one memory and the computer program instructions are further configured to, with the at least one processor, cause the electronic device to:

converting the voice signal into text; and

detecting a target word associated with the utterance in the text.

20. The electronic device of claim 17, wherein the at least one memory and the computer program instructions are further configured to, with the at least one processor, cause the electronic device to:

21. The electronic device of claim 17, wherein the at least one memory and the computer program instructions are further configured to, with the at least one processor, cause the electronic device to:

taking protective action for the passenger by providing the passenger's travel information to the passenger's security contacts.

22. The electronic device of claim 21, wherein the trip information includes at least one of identification information and driver information of the vehicle.

23. The electronic device of claim 17, wherein the at least one memory and the computer program instructions are further configured to, with the at least one processor, cause the electronic device to:

24. The electronic device of claim 17, wherein the at least one memory and the computer program instructions are further configured to, with the at least one processor, cause the electronic device to:

25. An electronic device, comprising:

at least one processor; and

26. The electronic device of claim 25, wherein the at least one memory and the computer program instructions are further configured to, with the at least one processor, cause the electronic device to:

27. The electronic device of claim 25, wherein the at least one memory and the computer program instructions are further configured to, with the at least one processor, cause the electronic device to:

28. The electronic device of claim 25, wherein the at least one memory and the computer program instructions are further configured to, with the at least one processor, cause the electronic device to:

29. The electronic device of claim 25, wherein the at least one memory and the computer program instructions are further configured to, with the at least one processor, cause the electronic device to:

30. The electronic device of claim 25, wherein the at least one memory and the computer program instructions are further configured to, with the at least one processor, cause the electronic device to:

31. The electronic device of claim 30, wherein the trip information includes at least one of identification information and driver information of the vehicle.

32. The electronic device of claim 25, wherein the at least one memory and the computer program instructions are further configured to, with the at least one processor, cause the electronic device to:

33. A computer readable medium comprising machine executable instructions which, when executed, cause a machine to perform the steps of the method of any one of claims 1 to 8.

34. A computer readable medium comprising machine executable instructions which, when executed, cause a machine to perform the steps of the method of any one of claims 9 to 16.