CN108289149B

CN108289149B - Falling consciousness recognition method and related product

Info

Publication number: CN108289149B
Application number: CN201810054009.9A
Authority: CN
Inventors: 张海平
Original assignee: Guangdong Oppo Mobile Telecommunications Corp Ltd
Current assignee: Guangdong Oppo Mobile Telecommunications Corp Ltd
Priority date: 2018-01-19
Filing date: 2018-01-19
Publication date: 2020-05-26
Anticipated expiration: 2038-01-19
Also published as: CN108289149A

Abstract

The embodiment of the application discloses a fall consciousness recognition method and a related product, which are applied to electronic equipment, wherein the electronic equipment comprises a processor, a timer connected with the processor, a fall detection sensor and a sound playing module, and the method comprises the following steps: when the electronic equipment enters a weightlessness state, recording the falling starting moment, acquiring the falling height of the electronic equipment, and determining the expected duration of the electronic equipment in a free-falling state according to the falling height; when the electronic equipment is in contact with the ground, recording the landing time, and determining the falling duration according to the landing time and the falling starting time; when the absolute value of the difference value between the falling time length and the expected time length is greater than a first preset threshold value, playing sound prompt information; and when the time interval between the picking-up moment when the electronic equipment is picked up and the landing moment is detected to be greater than a second preset threshold value, determining that the electronic equipment is intentionally dropped. The embodiment of the application can automatically identify whether the falling is intentional or unintentional.

Description

Falling consciousness recognition method and related product

Technical Field

The application relates to the technical field of electronic equipment, in particular to a fall consciousness recognition method and a related product.

Background

With the widespread use of electronic devices (such as mobile phones, tablet computers, etc.), the electronic devices have more and more applications and more powerful functions, and the electronic devices are developed towards diversification and personalization, and become indispensable electronic products in the life of users.

At present, for example, a mobile phone is used, various insurance (such as screen insurance) is more and more popular, when accepting insurance, the damaged position of the mobile phone is judged, whether a user intentionally breaks or unintentionally breaks is judged, and the identification efficiency is low visually, so that the problem of how to improve the efficiency of identifying whether the user is intentionally or unintentionally is urgently solved.

Disclosure of Invention

The embodiment of the application provides a falling consciousness identification method and a related product, and the efficiency of identifying intentional or unintentional falling can be improved.

In a first aspect, embodiments of the present application provide an electronic device, which includes a processor, and a timer, a drop detection sensor, and a sound playing module connected to the processor, wherein,

the timer is used for recording the falling starting time when the electronic equipment enters a weightlessness state;

the falling detection sensor is used for acquiring the falling height of the electronic equipment;

the processor is used for determining the expected duration of the electronic equipment in a free-fall state according to the falling height;

the timer is further configured to: when the electronic equipment is in contact with the ground, recording the landing time, and determining the falling duration according to the landing time and the falling starting time;

the sound playing module is used for playing sound prompt information when the absolute value of the difference value between the falling time length and the expected time length is greater than a first preset threshold value;

the processor is further configured to determine that the electronic device is intentionally dropped when a time interval between the picking-up time when the electronic device is picked up and the landing time is greater than a second preset threshold.

In a second aspect, the present application provides a fall awareness identification method, which is applied to an electronic device, where the electronic device includes a processor, and a timer, a fall detection sensor, and a sound playing module connected to the processor, where the method includes:

the timer records the falling starting time when the electronic equipment enters a weightlessness state;

the falling detection sensor acquires the falling height of the electronic equipment;

the processor determines the expected duration of the electronic equipment in a free-fall state according to the falling height;

when the electronic equipment is in contact with the ground, the timer records the landing time, and determines the falling duration according to the landing time and the falling starting time;

the sound playing module plays sound prompt information when the absolute value of the difference value between the falling time length and the expected time length is greater than a first preset threshold value;

and when the processor detects that the time interval between the picking-up moment when the electronic equipment is picked up and the landing moment is greater than a second preset threshold value, determining that the electronic equipment is intentionally dropped.

In a third aspect, an embodiment of the present application provides a fall awareness identification method, where the method includes:

when the electronic equipment enters a weightlessness state, recording a falling starting moment, acquiring a falling height of the electronic equipment, and determining the predicted duration of the electronic equipment in a free-falling state according to the falling height;

when the electronic equipment is in contact with the ground, recording the landing time, and determining the falling duration according to the landing time and the falling starting time;

when the absolute value of the difference value between the falling time length and the expected time length is greater than a first preset threshold value, playing sound prompt information;

and when detecting that the time interval between the picking-up moment when the electronic equipment is picked up and the landing moment is greater than a second preset threshold value, determining that the electronic equipment is intentionally dropped.

In a fourth aspect, an embodiment of the present application provides a fall consciousness recognition apparatus, including:

the device comprises a first determining unit, a second determining unit and a control unit, wherein the first determining unit is used for recording the falling starting moment when the electronic equipment enters the weightlessness state, acquiring the falling height of the electronic equipment, and determining the expected duration of the electronic equipment in the free falling state according to the falling height;

the second determining unit is used for recording the landing time when the electronic equipment is in contact with the ground, and determining the falling duration according to the landing time and the falling starting time;

the playing unit is used for playing sound prompt information when the absolute value of the difference value between the falling time length and the expected time length is greater than a first preset threshold value;

and the third determining unit is used for determining that the electronic equipment is intentionally dropped when the time interval between the picking-up moment when the electronic equipment is picked up and the landing moment is greater than a second preset threshold value.

In a fifth aspect, an embodiment of the present application provides an electronic device, including: a processor and a memory; and one or more programs stored in the memory and configured to be executed by the processor, the programs including instructions for some or all of the steps as described in the third aspect.

In a sixth aspect, the present application provides a computer-readable storage medium, where the computer-readable storage medium is used to store a computer program, where the computer program is used to make a computer execute some or all of the steps described in the third aspect of the present application.

In a seventh aspect, this application provides a computer program product, wherein the computer program product comprises a non-transitory computer readable storage medium storing a computer program, the computer program being operable to cause a computer to perform some or all of the steps as described in the third aspect of this application. The computer program product may be a software installation package.

The embodiment of the application has the following beneficial effects:

it can be seen that, according to the fall consciousness recognition method and the related product described in the embodiments of the present application, when the electronic device enters a weightless state, the fall start time is recorded, the fall height of the electronic device is obtained, the expected duration of the electronic device in a free fall state is determined according to the fall height, when the electronic device contacts the ground, the fall time is recorded, the fall duration is determined according to the fall time and the fall start time, when an absolute value of a difference between the fall duration and the expected duration is greater than a first preset threshold, a sound prompt message is played, when a time interval between a picked-up time when the electronic device is picked up and the fall time is detected to be greater than a second preset threshold, it is determined that the electronic device is intentionally fallen, when the fall duration is longer, the user is reminded, if the user does not pick up the electronic device for a long time, it is highly probable that, in this way, it is possible to automatically recognize whether an intentional drop or an unintentional drop is present.

Drawings

In order to more clearly illustrate the embodiments of the present application or the technical solutions in the prior art, the drawings used in the description of the embodiments or the prior art will be briefly described below, it is obvious that the drawings in the following description are only some embodiments of the present application, and for those skilled in the art, other drawings can be obtained according to the drawings without creative efforts.

Fig. 1A is a schematic structural diagram of an example electronic device provided in an embodiment of the present application;

fig. 1B is a schematic flow chart of a fall awareness identification method disclosed in an embodiment of the present application;

fig. 2 is a schematic flow chart of another fall awareness identification method disclosed in the embodiments of the present application;

fig. 3 is another schematic structural diagram of an electronic device according to an embodiment of the present disclosure;

fig. 4A is a schematic structural diagram of a fall awareness identification apparatus according to an embodiment of the present application;

fig. 4B is a schematic structural diagram of the fall awareness identification apparatus depicted in fig. 4A according to an embodiment of the present application;

fig. 4C is a schematic structural diagram of the fall awareness identification apparatus depicted in fig. 4A according to an embodiment of the present application;

fig. 4D is a schematic structural diagram of a second obtaining unit of the fall awareness identification apparatus depicted in fig. 4C according to the embodiment of the present application;

fig. 4E is a schematic structural diagram of a first matching module of the second obtaining unit described in fig. 4D according to an embodiment of the present disclosure;

fig. 5 is a schematic structural diagram of another electronic device disclosed in the embodiment of the present application.

Detailed Description

In order to make the technical solutions of the present application better understood, the technical solutions in the embodiments of the present application will be clearly and completely described below with reference to the drawings in the embodiments of the present application, and it is obvious that the described embodiments are only a part of the embodiments of the present application, and not all of the embodiments. All other embodiments, which can be derived by a person skilled in the art from the embodiments given herein without making any creative effort, shall fall within the protection scope of the present application.

The terms "first," "second," and the like in the description and claims of the present application and in the above-described drawings are used for distinguishing between different objects and not for describing a particular order. Furthermore, the terms "include" and "have," as well as any variations thereof, are intended to cover non-exclusive inclusions. For example, a process, method, system, article, or apparatus that comprises a list of steps or elements is not limited to only those steps or elements listed, but may alternatively include other steps or elements not listed, or inherent to such process, method, article, or apparatus.

Reference herein to "an embodiment" means that a particular feature, structure, or characteristic described in connection with the embodiment can be included in at least one embodiment of the application. The appearances of the phrase in various places in the specification are not necessarily all referring to the same embodiment, nor are separate or alternative embodiments mutually exclusive of other embodiments. It is explicitly and implicitly understood by one skilled in the art that the embodiments described herein can be combined with other embodiments.

The electronic devices involved in the embodiments of the present application may include various handheld devices, vehicle-mounted devices, wearable devices, computing devices or other processing devices connected to a wireless modem with wireless communication functions, as well as various forms of User Equipment (UE), Mobile Stations (MS), terminal equipment (terminal), and so on. For convenience of description, the above-mentioned devices are collectively referred to as electronic devices. Of course, the electronic device in the embodiment of the present application may be configured with some peripheral accessories, for example, a screen protection film, a protective sleeve, and the like. The electronic device in the embodiment of the present application may include at least a processor, and a timer, a fall detection sensor, and a sound playing module connected to the processor, where the fall detection sensor may include at least one of: acceleration sensor, range finding sensor, wind speed and direction sensor, camera etc. above-mentioned camera can be at least one of following: infrared camera, visible light camera still can be two cameras, and the position according to the camera setting still can be: front camera, rear camera, side camera, etc. The timer can be used for realizing a timing function, and the sound playing module can be a loudspeaker or a motor for realizing sound emission. The processor may integrate the Sensor Hub module, or the electronic device may include the Sensor Hub module, and the following embodiments of the present application may be implemented by controlling the Sensor Hub module through the processor.

Optionally, in this embodiment of the present application, the fall data may include at least one of the following data: fall time, fall position, fall angle, running state of the electronic device when falling, posture of the user holding the electronic device when falling, fall speed, ground material and the like. The fall time may be recorded by a system clock of the electronic device. The falling position can be obtained by positioning the electronic equipment, and certainly, the environment can also be shot by the camera to obtain an environment image, and the environment image is taken as the falling position. The falling angle, the falling speed and the ground material can be detected by the falling detection sensor. The operational state of the electronic device when dropped may include at least one of: off/on state, which application is running in the foreground, CPU load of the electronic device, power of the electronic device, etc. The posture of the user holding the electronic device when falling may be a posture of holding the electronic device before falling, for example, a body of the electronic device may be provided with a pressure sensor, and thus, the posture of the user holding the electronic device may be detected.

Alternatively, the fall data may be fall data for a period of time or at a certain moment. The electronic device in the embodiment of the application can record falling data of the electronic device in a moving state, and in the embodiment of the application, the moving state can include a falling state and a non-falling state.

For example, the fall data may be used to determine a motion state of the electronic device, for example, when the user runs, the electronic device may also be in a weightless state, so that it is necessary to eliminate the situation, that is, to determine whether the electronic device is actually in a fall state, and the gravitational acceleration in the fall state will remain unchanged. The motion state of the electronic equipment can be a falling state and a non-falling state.

The following describes embodiments of the present application in detail.

Referring to fig. 1A, fig. 1A is a schematic structural diagram of an electronic device 100 according to an embodiment of the present invention, where the electronic device 100 includes: the processor 110, the timer 120, the fall detection sensor 130, and the sound playing module 140 are electrically connected to the processor 110, and the timer 120, the fall detection sensor 130, and the sound playing module 140 are electrically connected to the processor 110.

The timer 120 is configured to record a fall starting time when the electronic device enters a weightless state;

the falling detection sensor 130 is configured to obtain a falling height of the electronic device;

the processor 110 is configured to determine an expected duration of the electronic device in a free-fall state according to the fall height;

the timer 120 is further configured to: when the electronic equipment is in contact with the ground, recording the landing time, and determining the falling duration according to the landing time and the falling starting time;

the sound playing module 140 is configured to play a sound prompt message when an absolute value of a difference between the falling duration and the expected duration is greater than a first preset threshold;

the processor 110 is further configured to determine that the electronic device is intentionally dropped when a time interval between the picking-up time when the electronic device is picked up and the landing time is greater than a second preset threshold.

It can be seen that, in the electronic device described in the embodiment of the present application, when the electronic device enters a weightless state, the fall starting time is recorded, and obtaining the falling height of the electronic equipment, determining the expected duration of the electronic equipment in the free falling state according to the falling height, when the electronic equipment is contacted with the ground, the landing time is recorded, the falling duration is determined according to the landing time and the falling starting time, when the absolute value of the difference value between the falling time length and the expected time length is greater than a first preset threshold value, playing sound prompt information, detecting that the time interval between the picking-up time and the landing time of the electronic equipment is greater than a second preset threshold value, determining that the electronic equipment is intentionally fallen, the user can be reminded when the falling time is longer, if the user does not pick up the electronic equipment for a long time, it is highly likely that the user intentionally drops the electronic device and thus whether the electronic device is intentionally dropped or unintentionally dropped can be automatically recognized.

In one possible example, the fall detection sensor 130 is further configured to:

upon detecting that a user is aware of the electronic device, determining a target distance between the electronic device and the user;

the processor is further specifically configured to:

acquiring the average walking speed of the user;

and determining the walking time length according to the target distance and the average walking speed, and determining the walking time length as the second preset threshold value.

In one possible example, the processor 110 is further configured to:

acquiring a user expression;

and when the user expression is a preset expression, determining that the electronic equipment is intentionally dropped.

In one possible example, in the aspect of obtaining the user expression, the processor 110 is specifically configured to:

acquiring a face image of a user;

and matching the user face image with a face expression image corresponding to the preset expression, and determining the user expression as the preset expression when the user face image is successfully matched with the face expression image.

In a possible example, in the aspect of matching the facial image of the user with the facial expression image corresponding to the preset expression, the processor 110 is specifically configured to:

acquiring a first target area of the facial expression image, wherein the first target area is used for representing an expression;

carrying out image segmentation on the user face image according to the first target area to obtain a second target area, wherein the second target area corresponds to the first target area;

and matching the first target area with the second target area.

The electronic device may further include a memory, the processor is a control center of the electronic device, various interfaces and lines are used to connect various parts of the whole electronic device, and various functions of the electronic device and data processing are performed by running or executing software programs and/or modules stored in the memory and calling data stored in the memory, so as to perform overall monitoring on the electronic device. Optionally, the processor may integrate an application processor and a modem processor, wherein the application processor mainly handles operating systems, user interfaces, application programs, and the like, and the modem processor mainly handles wireless communications. It will be appreciated that the modem processor described above may not be integrated into the processor.

The electronic device described with reference to fig. 1A may be configured to perform a fall awareness identification method as follows:

the timer 120 records the fall starting time when the electronic device enters a weightless state;

the fall detection sensor 130 acquires a fall height of the electronic device;

the processor 110 determines the expected duration of the electronic device in the free-fall state according to the fall height;

when the electronic device is in contact with the ground, the timer 120 records the landing time, and determines the falling duration according to the landing time and the falling starting time;

the sound playing module 140 plays a sound prompt message when the absolute value of the difference between the falling time length and the expected time length is greater than a first preset threshold;

when the processor 110 detects that a time interval between the picking-up time when the electronic device is picked up and the landing time is greater than a second preset threshold, it is determined that the electronic device is intentionally dropped.

Referring to fig. 1B, an embodiment of a fall awareness identification method according to an embodiment of the present application is schematically illustrated in a flowchart of an electronic device described in fig. 1A. The fall consciousness recognition method is applied to electronic equipment, the electronic equipment comprises a processor, and a timer, a fall detection sensor and a sound playing module which are connected with the processor, and the fall consciousness recognition method can comprise the following steps:

101. when the electronic equipment enters a weightlessness state, recording the falling starting moment, acquiring the falling height of the electronic equipment, and determining the expected duration of the electronic equipment in a free-falling state according to the falling height.

When the electronic device enters a weightlessness state, the electronic device may fall intentionally or unintentionally, the fall starting time may be recorded, in addition, the fall height may be detected by a fall detection sensor (distance measurement sensor), and the expected time length corresponding to the falling of the electronic device in a free-fall state may be calculated according to a free-fall formula.

102. When the electronic equipment is in contact with the ground, the landing time is recorded, and the falling duration is determined according to the landing time and the falling starting time.

When the electronic equipment is in contact with the ground, the landing time can be recorded, and the falling starting time is subtracted from the landing time to obtain the falling duration.

103. And when the absolute value of the difference value between the falling time length and the expected time length is greater than a first preset threshold value, playing sound prompt information.

The first preset threshold may be set by the user or default by the system. The absolute value of the difference between the fall duration and the preset duration can be determined. In addition, the first preset threshold may also correspond to a falling height, and different falling heights may correspond to different first preset thresholds, specifically, a corresponding relationship between the heights and the thresholds may be preset, and then, after the falling height is determined, the first preset threshold corresponding to the falling height is determined according to the corresponding relationship. After all, the different falling heights determine the free falling time of the electronic equipment. When the absolute value of the difference value between the falling time length and the preset time length is greater than the first preset threshold value, the fact that the user intentionally falls the electronic equipment is reflected to a certain extent, however, the situation that the user carelessly falls away when playing a mobile phone or a bus shakes and the mobile phone falls when sitting on the bus is not excluded. Thus, audible prompts can be played to further determine whether the fall was intended or unintended. If the user falls unintentionally, the user will pick up quickly after hearing the sound, and if the user falls intentionally, the user will pick up slowly.

For example, taking a mobile phone as an example, if a user intentionally falls the mobile phone, a downward force is applied to the mobile phone, and at this time, the mobile phone can quickly fall to the ground, and the time for the mobile phone to fall to the ground is shorter than the time for the mobile phone to fall to the free body unintentionally.

For another example, if the user throws the mobile phone, the mobile phone may form a parabola in the air, in which case the highest point of the parabola is higher than the height when the mobile phone is thrown, in which case the duration of the falling of the mobile phone is longer than the time of the free falling of the mobile phone.

104. And when detecting that the time interval between the picking-up moment when the electronic equipment is picked up and the landing moment is greater than a second preset threshold value, determining that the electronic equipment is intentionally dropped.

The second preset threshold may be defaulted by the system. When the time interval between the picking-up time when the electronic equipment is picked up and the landing time is greater than a second preset threshold value, the electronic equipment is judged to be fallen intentionally, otherwise, when the time interval between the picking-up time when the electronic equipment is picked up and the landing time is less than or equal to the second preset threshold value, the electronic equipment is judged to be fallen unintentionally.

Optionally, before the step 104, the following steps may be further included:

a1, when the user is detected to notice the electronic device, determining a target distance between the electronic device and the user;

a2, acquiring the average walking speed of the user;

a3, determining the walking time length according to the target distance and the average walking speed, and determining the walking time length as the second preset threshold value.

In specific implementation, whether the user notices the electronic equipment or not can be detected through the camera, or whether the user notices the electronic equipment or not can be detected through the microphone, or whether the user notices the electronic equipment or not can be detected through the wearable equipment bound with the electronic equipment, after the user notices the electronic equipment, the target distance between the electronic equipment and the user can be detected through the distance measuring sensor, further, the average walking speed of the user is obtained through motion software in the electronic equipment, further, the walking duration can be obtained through the target distance and the average walking speed, and the walking duration is set to be a second preset threshold.

It can be seen that the fall consciousness recognition method described in the embodiment of the present application records a fall start time and obtains a fall height of an electronic device when the electronic device enters a weightless state, determines a predicted time length of the electronic device in a free fall state according to the fall height, records a fall time when the electronic device contacts the ground, determines the fall time length according to the fall time length and the fall start time length, plays a sound prompt message when an absolute value of a difference between the fall time length and the predicted time length is greater than a first preset threshold value, detects that a time interval between a pickup time when the electronic device is picked up and the fall time length is greater than a second preset threshold value, determines that the electronic device is intentionally fallen, can remind a user when the fall time length is longer, and if the user does not pick up the electronic device for a long time, the user is likely to intentionally fall the electronic device, and thus, an intentional or unintentional fall can be automatically identified.

In accordance with the above, please refer to fig. 2, which is a flowchart illustrating an embodiment of a fall awareness identification method according to an embodiment of the present application. The fall awareness identification method described in this embodiment may include the following steps:

201. when the electronic equipment enters a weightlessness state, recording the falling starting moment, acquiring the falling height of the electronic equipment, and determining the expected duration of the electronic equipment in a free-falling state according to the falling height.

202. When the electronic equipment is in contact with the ground, the landing time is recorded, and the falling duration is determined according to the landing time and the falling starting time.

203. And when the absolute value of the difference value between the falling time length and the expected time length is greater than a first preset threshold value, playing sound prompt information.

The detailed description of the steps 201-203 can refer to the corresponding steps of the fall awareness identification method described in fig. 1B, and will not be described herein again.

204. And when detecting that the time interval between the picked-up moment of the electronic equipment and the landing moment is greater than a second preset threshold value, acquiring the expression of the user.

The user expression can be acquired through the camera, and the user expression can be one of the following expressions: happy, depressed, crying, surprised, etc. The expression of the user reflects the consciousness of the user to a certain extent, for example, happy, and shows that the electronic equipment is not concerned about falling, and the electronic equipment is likely to fall intentionally. Crying may indicate that the user is hearty and has a high probability of falling unintentionally.

Optionally, in the step 204, obtaining the expression of the user may include the following steps:

41. acquiring a face image of a user;

42. and matching the user face image with a face expression image corresponding to the preset expression, and determining the user expression as the preset expression when the user face image is successfully matched with the face expression image.

The method comprises the steps of acquiring a face image of a user through a camera, matching the face image of the user with a face expression image corresponding to a preset expression, indicating that the user expression is the preset expression when the face image of the user is successfully matched with the face expression image, and indicating that the user expression is not the preset expression when the face image of the user is unsuccessfully matched with the face expression image.

Optionally, in the step 42, matching the facial image of the user with the facial expression image corresponding to the preset expression may include the following steps:

421. acquiring a first target area of the facial expression image, wherein the first target area is used for representing an expression;

422. carrying out image segmentation on the user face image according to the first target area to obtain a second target area, wherein the second target area corresponds to the first target area;

423. and matching the first target area with the second target area.

The expression also belongs to a face image, and compared with the expression-free image, a certain difference exists between the expression image and the expression-free image, and the difference is intensively represented in an expression representation area, for example, there is no dimple when Zhang Sansan is non-expressive, and the dimple is present when laughing, and then the dimple is used for representing the expression. Therefore, image segmentation can be performed on the facial expression image to obtain a first target area, the first target area is used for representing expressions, in addition, image segmentation can be performed on the facial image of the user according to the first target area to obtain a second target area, of course, the second target area corresponds to the first target area, namely, the relative position between the second target area and the facial image of the user is consistent with the relative position between the first target area and the facial expression image, and finally, the first target area is matched with the second target area.

205. And when the user expression is a preset expression, determining that the electronic equipment is intentionally dropped.

When the user expression is not the preset expression, the electronic equipment is determined to be dropped intentionally. The preset expression can be set by the system in a default mode, or the user can set the expression by himself, for example, when the electronic equipment is started, the user can be reminded to enter different expressions.

It can be seen that the fall consciousness recognition method described in the embodiments of the present application records a fall start time and obtains a fall height of an electronic device when the electronic device enters a weightless state, determines a predicted time length of the electronic device in a free fall state according to the fall height, records a fall time when the electronic device contacts the ground, determines a fall time length according to the fall time length and the fall start time length, plays a sound prompt message when an absolute value of a difference between the fall time length and the predicted time length is greater than a first preset threshold value, detects a time interval between a pickup time when the electronic device is picked up and the fall time length is greater than a second preset threshold value, obtains a user expression, determines that the electronic device is intentionally fallen when the user expression is a preset expression, can remind the user when the fall time length is longer, if the user does not pick up the electronic device for a long time, the electronic equipment is likely to be intentionally dropped by the user, in addition, the user expression can be acquired, and if the user expression is a preset expression, the electronic equipment is determined to be intentionally dropped, so that whether the electronic equipment is intentionally dropped or unintentionally dropped can be automatically and accurately identified.

In accordance with the above, please refer to fig. 3, in which fig. 3 is an electronic device according to an embodiment of the present application, including: the system comprises a processor and a memory, and also comprises a timer, a falling detection sensor and a sound playing module which are connected with the processor; and one or more programs stored in the memory and configured to be executed by the processor, the programs including instructions for performing the steps of:

Optionally, the program may further include instructions for executing the other method steps, which are not described herein again.

In accordance with the above, the following is a device for implementing the fall awareness identification method, specifically as follows:

referring to fig. 4A, fig. 4A is a schematic structural diagram of a fall awareness identification apparatus according to the present embodiment. This fall consciousness recognition device is applied to electronic equipment, electronic equipment include the treater, and with the time-recorder that the treater is connected, fall and detect sensor and sound play module, this fall consciousness recognition device can include: a first determining unit 401, a second determining unit 402, a playing unit 403, and a third determining unit 404, wherein,

the first determining unit 401 is configured to record a fall starting time when the electronic device enters a weightlessness state, acquire a fall height of the electronic device, and determine a predicted duration of the electronic device in a free-fall state according to the fall height;

a second determining unit 402, configured to record a landing time when the electronic device is in contact with the ground, and determine a falling duration according to the landing time and a falling start time;

a playing unit 403, configured to play a sound prompt message when an absolute value of a difference between the falling duration and the expected duration is greater than a first preset threshold;

a third determining unit 404, configured to determine that the electronic device is intentionally dropped when a time interval between the picking-up time when the electronic device is picked up and the landing time is greater than a second preset threshold.

Optionally, as shown in fig. 4B, fig. 4B is a further modified structure of the fall awareness identification apparatus described in fig. 4A of the present application, which may further include, compared with fig. 4A: the detecting unit 405 and the first obtaining unit 406 are specifically as follows:

a detecting unit 405, configured to determine a target distance between the electronic device and a user when it is detected that the user notices the electronic device;

a first obtaining unit 406, configured to obtain an average walking speed of the user;

the third determining unit 404 is further specifically configured to:

Alternatively, as shown in fig. 4C, fig. 4C is a further modified structure of the fall awareness identification apparatus described in fig. 4A of the embodiment of the present application, which, compared with fig. 4A, may further include: the second obtaining unit 407 is specifically as follows:

a second obtaining unit 407, configured to obtain a user expression, where the third obtaining unit 404 determines that the electronic device is intentionally dropped when the user expression is a preset expression.

Optionally, as shown in fig. 4D, fig. 4D is a detailed structure of the second obtaining unit 407 of the fall awareness identification apparatus described in fig. 4C of the embodiment of the present application, where the second obtaining unit 407 may include: the first obtaining module 4071 and the first matching module 4072 are specifically as follows:

a first obtaining module 4071, configured to obtain a face image of a user;

a first matching module 4072, configured to match the user face image with a face expression image corresponding to the preset expression, and when the user face image is successfully matched with the face expression image, determine that the user expression is the preset expression.

Optionally, as shown in fig. 4E, fig. 4E is a specific refinement structure of the first matching module 4072 described in fig. 4D in this embodiment of the present application, where the first matching module 4072 may include: the second obtaining module 501, the dividing module 502 and the second matching module 503 are specifically as follows:

a second obtaining module 501, configured to obtain a first target area of the facial expression image, where the first target area is used to represent an expression;

a segmentation module 502, configured to perform image segmentation on the user face image according to the first target region to obtain a second target region, where the second target region corresponds to the first target region;

a second matching module 503, configured to match the first target area with the second target area.

It can be seen that, the fall consciousness recognition apparatus described in the embodiment of the present application records the fall starting time and obtains the fall height of the electronic device when the electronic device enters the weightlessness status, determines the expected duration of the electronic device in the free fall status according to the fall height, records the fall time when the electronic device contacts the ground, determines the fall duration according to the fall time and the fall starting time, plays the audio prompt message when the absolute value of the difference between the fall duration and the expected duration is greater than the first preset threshold, detects that the duration interval between the pick-up time and the fall time when the electronic device is picked up is greater than the second preset threshold, determines that the electronic device is intentionally fallen, can remind the user when the fall duration is longer, and if the user does not pick up the electronic device for a long time, the user is likely to intentionally fall the electronic device, and thus, an intentional or unintentional fall can be automatically identified.

It can be understood that the functions of the program modules of the fall awareness identification apparatus according to this embodiment may be specifically implemented according to the method in the foregoing method embodiment, and the specific implementation process may refer to the related description of the foregoing method embodiment, which is not described herein again.

As shown in fig. 5, for convenience of description, only the portions related to the embodiments of the present application are shown, and details of the specific technology are not disclosed, please refer to the method portion of the embodiments of the present application. The electronic device may be any terminal device including a mobile phone, a tablet computer, a PDA (personal digital assistant), a POS (point of sales), a vehicle-mounted computer, etc., taking the electronic device as the mobile phone as an example:

fig. 5 is a block diagram illustrating a partial structure of a mobile phone related to an electronic device provided in an embodiment of the present application. Referring to fig. 5, the handset includes: radio Frequency (RF) circuit 910, memory 920, input unit 930, sensor 950, audio circuit 960, wireless fidelity (Wi-Fi) module 970, processor 980, power supply 990, and driving device 1000. Those skilled in the art will appreciate that the handset configuration shown in fig. 5 is not intended to be limiting and may include more or fewer components than those shown, or some components may be combined, or a different arrangement of components.

The following describes each component of the mobile phone in detail with reference to fig. 5:

the input unit 930 may be used to receive input numeric or character information and generate key signal inputs related to user settings and function control of the cellular phone. Specifically, the input unit 930 may include a display screen 933, and a biometric recognition apparatus 931 and other input devices 932. Biometric device 931 may be at least one of: a face recognition device, a fingerprint recognition device, an iris recognition device, a vein recognition device, a brain wave recognition device, and the like. The input unit 930 may also include other input devices 932. In particular, other input devices 932 may include, but are not limited to, one or more of physical keys, function keys (e.g., volume control keys, switch keys, etc.), a trackball, a mouse, a joystick, and the like.

Wherein, the processor 980 is configured to perform the following steps:

The processor 980 is a control center of the mobile phone, connects various parts of the entire mobile phone using various interfaces and lines, and performs various functions of the mobile phone and processes data by operating or executing software programs and/or modules or blocks stored in the memory 920 and calling data stored in the memory 920, thereby integrally monitoring the mobile phone. Optionally, the processor 980 may include one or more processing units, which may be artificial intelligence chips, quantum chips; preferably, the processor 980 may integrate an application processor (e.g., CPU, or GPU) that primarily handles operating systems, user interfaces, application programs, etc. and a modem processor that primarily handles wireless communications. It will be appreciated that the modem processor described above may not be integrated into the processor 980. The processor 980 may be integrated with the Sensor Hub module, or the electronic device may include the Sensor Hub module, and the Sensor Hub module may be controlled by the processor 980 to implement the embodiments of the present application described below.

Further, the memory 920 may include high speed random access memory, and may also include non-volatile memory, such as at least one magnetic disk storage device, flash memory device, or other volatile solid state storage device.

RF circuitry 910 may be used for the reception and transmission of information. In general, the RF circuit 910 includes, but is not limited to, an antenna, at least one amplifier, a transceiver, a coupler, a Low Noise Amplifier (LNA), a duplexer, and the like. In addition, the RF circuit 910 may also communicate with networks and other devices via wireless communication. The wireless communication may use any communication standard or protocol, including but not limited to global system for mobile communications (GSM), General Packet Radio Service (GPRS), Code Division Multiple Access (CDMA), Wideband Code Division Multiple Access (WCDMA), Long Term Evolution (LTE), email, Short Message Service (SMS), etc.

The handset may also include at least one sensor 950, and the sensor 950 may be a drop detection sensor such as: light sensors, motion sensors, and other sensors, etc. Specifically, the light sensor may include an environment sensor and a proximity sensor, wherein the environment sensor may adjust brightness of the touch display screen according to brightness of ambient light, and the proximity sensor may turn off the touch display screen and/or the backlight when the mobile phone moves to the ear. As one of the motion sensors, the accelerometer sensor can detect the magnitude of acceleration in each direction (generally, three axes), can detect the magnitude and direction of gravity when stationary, and can be used for applications of recognizing the posture of a mobile phone (such as horizontal and vertical screen switching, related games, magnetometer posture calibration), vibration recognition related functions (such as pedometer and tapping), and the like; as for other sensors such as a gyroscope, a barometer, a hygrometer, a thermometer, and an infrared sensor, which can be configured on the mobile phone, further description is omitted here.

Audio circuitry 960, speaker 961, microphone 962 may provide an audio interface between a user and a cell phone. The audio circuit 960 may transmit the electrical signal converted from the received audio data to the speaker 961, and the audio signal is converted by the speaker 961 to be played; on the other hand, the microphone 962 converts the collected sound signal into an electrical signal, converts the electrical signal into audio data after being received by the audio circuit 960, and then processes the audio data by the audio data playing processor 980, and then sends the audio data to, for example, another mobile phone through the RF circuit 910, or plays the audio data to the memory 920 for further processing.

Wi-Fi belongs to short-distance wireless transmission technology, and a mobile phone can help a user to receive and send e-mails, browse webpages, access streaming media and the like through a Wi-Fi module 970, and provides wireless broadband internet access for the user. Although fig. 5 shows the Wi-Fi module 970, it is understood that it does not belong to the essential constitution of the cellular phone and can be omitted entirely as needed within the scope not changing the essence of the invention.

The handset also includes a power supply 990 (e.g., a battery) for supplying power to the various components, which may preferably be logically connected to the processor 980 via a power management system, thereby providing management of charging, discharging, and power consumption via the power management system.

Although not shown, the mobile phone may further include a camera, a bluetooth module, etc., which are not described herein.

In the foregoing embodiments shown in fig. 1B or fig. 2, the method flows of the steps may be implemented based on the structure of the mobile phone.

In the embodiments shown in fig. 3 and fig. 4A to fig. 4E, the functions of the units may be implemented based on the structure of the mobile phone.

Embodiments of the present application also provide a computer storage medium, wherein the computer storage medium stores a computer program for electronic data exchange, and the computer program enables a computer to execute part or all of the steps of any one of the fall awareness identification methods as described in the above method embodiments.

Embodiments of the present application also provide a computer program product comprising a non-transitory computer readable storage medium storing a computer program operable to cause a computer to perform some or all of the steps of any one of the fall awareness identification methods as set forth in the above method embodiments.

It should be noted that, for simplicity of description, the above-mentioned method embodiments are described as a series of acts or combination of acts, but those skilled in the art will recognize that the present application is not limited by the order of acts described, as some steps may occur in other orders or concurrently depending on the application. Further, those skilled in the art should also appreciate that the embodiments described in the specification are preferred embodiments and that the acts and modules referred to are not necessarily required in this application.

In the foregoing embodiments, the descriptions of the respective embodiments have respective emphasis, and for parts that are not described in detail in a certain embodiment, reference may be made to related descriptions of other embodiments.

In the embodiments provided in the present application, it should be understood that the disclosed apparatus may be implemented in other manners. For example, the above-described embodiments of the apparatus are merely illustrative, and for example, the division of the units is only one type of division of logical functions, and there may be other divisions when actually implementing, for example, a plurality of units or components may be combined or may be integrated into another system, or some features may be omitted, or not implemented. In addition, the shown or discussed mutual coupling or direct coupling or communication connection may be an indirect coupling or communication connection of some interfaces, devices or units, and may be an electric or other form.

The units described as separate parts may or may not be physically separate, and parts displayed as units may or may not be physical units, may be located in one place, or may be distributed on a plurality of network units. Some or all of the units can be selected according to actual needs to achieve the purpose of the solution of the embodiment.

In addition, functional units in the embodiments of the present application may be integrated into one processing unit, or each unit may exist alone physically, or two or more units are integrated into one unit. The integrated unit may be implemented in the form of hardware, or may be implemented in the form of a software program module.

The integrated units, if implemented in the form of software program modules and sold or used as stand-alone products, may be stored in a computer readable memory. Based on such understanding, the technical solution of the present application may be substantially implemented or a part of or all or part of the technical solution contributing to the prior art may be embodied in the form of a software product stored in a memory, and including several instructions for causing a computer device (which may be a personal computer, a server, or a network device) to execute all or part of the steps of the method described in the embodiments of the present application. And the aforementioned memory comprises: various media capable of storing program codes, such as a usb disk, a read-only memory (ROM), a Random Access Memory (RAM), a removable hard disk, a magnetic or optical disk, and the like.

Those skilled in the art will appreciate that all or part of the steps in the methods of the above embodiments may be implemented by associated hardware instructed by a program, which may be stored in a computer-readable memory, which may include: flash disk, ROM, RAM, magnetic or optical disk, and the like.

The foregoing detailed description of the embodiments of the present application has been presented to illustrate the principles and implementations of the present application, and the above description of the embodiments is only provided to help understand the method and the core concept of the present application; meanwhile, for a person skilled in the art, according to the idea of the present application, there may be variations in the specific embodiments and the application scope, and in summary, the content of the present specification should not be construed as a limitation to the present application.

Claims

1. An electronic device, comprising a processor, and a timer, a fall detection sensor, and a sound playing module connected to the processor, wherein,

2. The electronic device of claim 1, wherein the fall detection sensor is further configured to:

the processor is further specifically configured to:

acquiring the average walking speed of the user;

3. An electronic device, comprising a processor, and a timer, a fall detection sensor, and a sound playing module connected to the processor, wherein,

the processor is further configured to: when the time interval between the picking-up moment when the electronic equipment is picked up and the landing moment is detected to be larger than a second preset threshold value, obtaining the expression of a user; and when the user expression is a preset expression, determining that the electronic equipment is intentionally dropped.

4. The electronic device of claim 3, wherein in obtaining the user expression, the processor is specifically configured to:

acquiring a face image of a user;

5. The electronic device of claim 4, wherein in the aspect of matching the facial image of the user with the facial expression image corresponding to the preset expression, the processor is specifically configured to:

and matching the first target area with the second target area.

6. A fall awareness identification method applied to an electronic device including a processor, and a timer, a fall detection sensor, and a sound playing module connected to the processor, wherein the method includes:

7. A fall awareness identification method, the method comprising:

8. The method of claim 7, further comprising:

acquiring the average walking speed of the user;

9. A fall awareness identification method, the method comprising:

when the time interval between the picking-up moment when the electronic equipment is picked up and the landing moment is detected to be larger than a second preset threshold value, obtaining the expression of a user;

10. The method of claim 9, wherein the obtaining the user expression comprises:

acquiring a face image of a user;

11. The method of claim 10, wherein the matching the facial image of the user with the facial expression image corresponding to the preset expression comprises:

and matching the first target area with the second target area.

12. A fall consciousness recognition apparatus, comprising:

13. An electronic device, comprising: a processor and a memory; and one or more programs stored in the memory and configured to be executed by the processor, the programs comprising instructions for the method of any of claims 7-11.

14. A computer-readable storage medium for storing a computer program, wherein the computer program causes a computer to perform the method according to any one of claims 7-11.