CN110077396B - Control method and control device of movable equipment and electronic equipment - Google Patents

Control method and control device of movable equipment and electronic equipment Download PDF

Info

Publication number
CN110077396B
CN110077396B CN201910356239.5A CN201910356239A CN110077396B CN 110077396 B CN110077396 B CN 110077396B CN 201910356239 A CN201910356239 A CN 201910356239A CN 110077396 B CN110077396 B CN 110077396B
Authority
CN
China
Prior art keywords
information
user
determining
state
mobile device
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
CN201910356239.5A
Other languages
Chinese (zh)
Other versions
CN110077396A (en
Inventor
田振华
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Beijing Horizon Robotics Technology Research and Development Co Ltd
Original Assignee
Beijing Horizon Robotics Technology Research and Development Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Beijing Horizon Robotics Technology Research and Development Co Ltd filed Critical Beijing Horizon Robotics Technology Research and Development Co Ltd
Priority to CN201910356239.5A priority Critical patent/CN110077396B/en
Publication of CN110077396A publication Critical patent/CN110077396A/en
Application granted granted Critical
Publication of CN110077396B publication Critical patent/CN110077396B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Classifications

    • BPERFORMING OPERATIONS; TRANSPORTING
    • B60VEHICLES IN GENERAL
    • B60WCONJOINT CONTROL OF VEHICLE SUB-UNITS OF DIFFERENT TYPE OR DIFFERENT FUNCTION; CONTROL SYSTEMS SPECIALLY ADAPTED FOR HYBRID VEHICLES; ROAD VEHICLE DRIVE CONTROL SYSTEMS FOR PURPOSES NOT RELATED TO THE CONTROL OF A PARTICULAR SUB-UNIT
    • B60W30/00Purposes of road vehicle drive control systems not related to the control of a particular sub-unit, e.g. of systems using conjoint control of vehicle sub-units
    • B60W30/08Active safety systems predicting or avoiding probable or impending collision or attempting to minimise its consequences
    • B60W30/09Taking automatic action to avoid collision, e.g. braking and steering
    • BPERFORMING OPERATIONS; TRANSPORTING
    • B60VEHICLES IN GENERAL
    • B60WCONJOINT CONTROL OF VEHICLE SUB-UNITS OF DIFFERENT TYPE OR DIFFERENT FUNCTION; CONTROL SYSTEMS SPECIALLY ADAPTED FOR HYBRID VEHICLES; ROAD VEHICLE DRIVE CONTROL SYSTEMS FOR PURPOSES NOT RELATED TO THE CONTROL OF A PARTICULAR SUB-UNIT
    • B60W40/00Estimation or calculation of non-directly measurable driving parameters for road vehicle drive control systems not related to the control of a particular sub unit, e.g. by using mathematical models
    • B60W40/08Estimation or calculation of non-directly measurable driving parameters for road vehicle drive control systems not related to the control of a particular sub unit, e.g. by using mathematical models related to drivers or passengers

Landscapes

  • Engineering & Computer Science (AREA)
  • Automation & Control Theory (AREA)
  • Transportation (AREA)
  • Mechanical Engineering (AREA)
  • Physics & Mathematics (AREA)
  • Mathematical Physics (AREA)
  • Telephone Function (AREA)
  • Alarm Systems (AREA)
  • Measuring And Recording Apparatus For Diagnosis (AREA)

Abstract

A control method and a control device for a mobile device and an electronic device are disclosed. The control method of the movable equipment comprises the following steps: determining temperature information within a driving space; when the temperature information meets the preset condition, determining seat information in the driving space; determining physiological information of a user corresponding to the seat information; the operating state of the mobile device is controlled based on the seat information and the physiological information. The working state of the movable equipment can be controlled based on the actual physiological state of the user, so that compared with the existing control method of the movable equipment, the working state of the movable equipment can be controlled more reasonably based on the actual physiological state of the user, the safety of the user is further effectively guaranteed, and traffic accidents are further avoided.

Description

Control method and control device of movable equipment and electronic equipment
Technical Field
The invention relates to the technical field of signal processing, in particular to a control method and a control device of movable equipment and electronic equipment.
Background
With the rapid development of intelligent technology, the safety of mobile devices with driving functions, such as automobiles, is receiving more and more attention. However, when the user has bad physical conditions such as heartbeat and respiration acceleration during driving, if the user takes countermeasures in time, the health of the user can be damaged, and even traffic accidents can happen. Especially in summer when the temperature is high, even coma or suffocation death of the user can be directly caused.
Disclosure of Invention
The present application is proposed to solve the above-mentioned technical problems. The embodiment of the application provides a control method and a control device of a movable device and an electronic device.
In one aspect, an embodiment of the present application provides a method for controlling a mobile device, where the method for controlling the mobile device includes: determining temperature information within a driving space; when the temperature information meets the preset condition, determining seat information in the driving space; determining physiological information of a user corresponding to the seat information; the operating state of the mobile device is controlled based on the seat information and the physiological information.
In another aspect, an embodiment of the present application provides a control apparatus for a mobile device, including: the temperature information determining module is used for determining temperature information in the driving space; the seat information determining module is used for determining the seat information in the driving space when the temperature information meets the preset condition; a physiological information determination module for determining physiological information of the user corresponding to the seat information; and the control module is used for controlling the working state of the movable equipment based on the seat information and the physiological information.
In another aspect, the present embodiment provides a computer-readable storage medium, which stores a computer program for executing the control method of the removable device mentioned in the above embodiment.
In another aspect, an embodiment of the present application provides an electronic device, including: a processor and a memory for storing processor executable instructions, wherein the processor is used for executing the control method of the removable device mentioned in the above embodiments.
According to the control method of the mobile device, the temperature information in the driving space is determined, the seat information in the driving space is determined when the temperature information meets the preset condition, then the physiological information of the user corresponding to the seat information is determined, and finally the working state of the mobile device is controlled based on the seat information and the physiological information, so that the purpose of controlling the working state of the mobile device based on the seat information in the driving space and the physiological information of the user corresponding to the seat information is achieved. The control method of the mobile device provided by the embodiment of the application can control the working state of the mobile device according to the physiological information of the user, namely, the control method of the mobile device can control the working state of the mobile device based on the actual physiological state of the user, so that compared with the existing control method of the mobile device, the control method of the mobile device provided by the embodiment of the application can more reasonably control the working state of the mobile device based on the actual physiological state of the user, further effectively guarantee the safety of the user, and further avoid traffic accidents.
Drawings
The above and other objects, features and advantages of the present application will become more apparent by describing in more detail embodiments of the present application with reference to the attached drawings. The accompanying drawings are included to provide a further understanding of the embodiments of the application and are incorporated in and constitute a part of this specification, illustrate embodiments of the application and together with the description serve to explain the principles of the application. In the drawings, like reference numbers generally represent like parts or steps.
Fig. 1 is a scene diagram to which the present application is applied.
Fig. 2 is a flowchart illustrating a control method for a mobile device according to an exemplary embodiment of the present application.
Fig. 3 is a flowchart illustrating a method for controlling a mobile device according to another exemplary embodiment of the present application.
Fig. 4 is a flowchart illustrating a process for determining physiological information of a user corresponding to seat information according to another exemplary embodiment of the present application.
Fig. 5 is a schematic flow chart of determining physiological information of a user corresponding to seat information according to still another exemplary embodiment of the present application.
Fig. 6 is a schematic flow chart diagram for controlling an operational state of a mobile device based on seat information and physiological information according to yet another exemplary embodiment of the present application.
Fig. 7 is a schematic flow chart illustrating a process for controlling a mobile device to a first operating state according to still another exemplary embodiment of the present application.
Fig. 8 is a schematic flow chart illustrating a process for controlling a mobile device to a first operating state according to still another exemplary embodiment of the present application.
FIG. 9 is a schematic flow chart diagram for controlling an operational state of a mobile device based on seat information and physiological information, as provided by yet another exemplary embodiment of the present application.
Fig. 10 is a schematic flow chart illustrating a process for controlling a mobile device to a second operating state according to still another exemplary embodiment of the present application.
Fig. 11 is a schematic structural diagram of a control apparatus of a mobile device according to an exemplary embodiment of the present application.
Fig. 12 is a schematic structural diagram of a control apparatus of a mobile device according to another exemplary embodiment of the present application.
Fig. 13 is a schematic structural diagram of a physiological information determination module of a control device of a mobile device according to another exemplary embodiment of the present application.
Fig. 14 is a schematic structural diagram of a physiological information determination module of a control device of a mobile device according to still another exemplary embodiment of the present application.
Fig. 15 is a schematic structural diagram of a control module of a control apparatus of a mobile device according to still another exemplary embodiment of the present application.
Fig. 16 is a schematic structural diagram of a first operating state control unit of a control apparatus of a movable device according to still another exemplary embodiment of the present application.
Fig. 17 is a schematic structural diagram of a first operating state control unit of a control apparatus of a movable device according to still another exemplary embodiment of the present application.
Fig. 18 is a schematic structural diagram of a control module of a control device of a movable apparatus according to still another exemplary embodiment of the present application.
Fig. 19 is a schematic structural diagram of a second operating state control unit of a control apparatus of a movable device according to still another exemplary embodiment of the present application.
Fig. 20 is a schematic diagram of an actual application of the control device of the movable apparatus according to an exemplary embodiment of the present application.
Fig. 21 is a schematic structural diagram of an electronic device according to an exemplary embodiment of the present application.
Detailed Description
Hereinafter, example embodiments according to the present application will be described in detail with reference to the accompanying drawings. It should be understood that the described embodiments are only some embodiments of the present application and not all embodiments of the present application, and that the present application is not limited by the example embodiments described herein.
Summary of the application
As is well known, for mobile devices with a driving function, such as automobiles, the safety performance is an important index related to the life safety of users.
However, the existing mobile equipment with the driving function does not have the functions of early warning and alarming for emergency situations, and can not take corresponding countermeasures in time based on the emergency situations, so that property loss and even casualties are easily caused. For example, in summer with high temperature, when abnormal physiological states such as heartbeat and respiration acceleration occur during driving, if a user does not take timely countermeasures, the health of the user may be damaged, and even a traffic accident may occur.
In view of the above technical problems, a basic concept of the present application is to provide a control method, a control device, and an electronic device for a mobile device, in which the control method determines temperature information in a driving space, determines seat information in the driving space when the temperature information meets a preset condition, then determines physiological information of a user corresponding to the seat information, and finally controls an operating state of the mobile device based on the seat information in the driving space and the physiological information of the user corresponding to the seat information, thereby achieving a purpose of controlling the operating state of the mobile device based on the seat information in the driving space and the physiological information of the user corresponding to the seat information. The control method of the mobile device provided by the embodiment of the application can control the working state of the mobile device according to the physiological information of the user, namely, the control method of the mobile device can control the working state of the mobile device based on the actual physiological state of the user, so that compared with the existing control method of the mobile device, the control method of the mobile device provided by the embodiment of the application can more reasonably control the working state of the mobile device based on the actual physiological state of the user, further effectively guarantee the safety of the user, and further avoid traffic accidents.
Having described the general principles of the present application, various non-limiting embodiments of the present application will now be described with reference to the accompanying drawings.
Exemplary System
Fig. 1 is a scene diagram to which the present application is applied. As shown in fig. 1, a scenario to which the present application is applied is a control scenario of a mobile device, where the control scenario includes a server 1 and a mobile device 2, and the server 1 is configured to determine temperature information in a driving space of the mobile device 2 and control an operating state of the mobile device 2 in combination with the temperature information and a specific situation in the driving space.
Specifically, the server 1 is configured to determine temperature information in the driving space, determine seat information in the driving space when the temperature information meets a preset condition, then determine physiological information of the user corresponding to the seat information, and finally control the operating state of the mobile device 2 based on the seat information and the physiological information. With this scenario, the amount of computation of the mobile device 2 can be reduced.
It should be noted that the present application is also applicable to another scenario. Specifically, the mobile device 2 is included in the control scenario of the mobile device. Specifically, the movable device 2 is configured to determine temperature information in the driving space, determine seat information in the driving space when the temperature information meets a preset condition, then determine physiological information of the user corresponding to the seat information, and finally control the operating state of the movable device 2 based on the seat information and the physiological information. By this scenario, it is ensured that the operating state of the movable apparatus 2 can be controlled in real time.
Exemplary method
Fig. 2 is a flowchart illustrating a control method for a mobile device according to an exemplary embodiment of the present application. As shown in fig. 2, a method for controlling a mobile device according to an embodiment of the present application includes the following steps.
Step 10, determining temperature information in the driving space.
In step 10, temperature information within the driving space may be determined based on a temperature sensor or the like within the driving space.
And step 20, determining the seat information in the driving space when the temperature information meets the preset condition.
In step 20, the preset condition corresponding to the temperature information may be set according to the actual situation, so as to sufficiently improve the adaptability and the application universality of the control method of the mobile device mentioned in the embodiment of the present application. For example, the preset condition is that the temperature data included in the temperature information falls within a temperature range of 25 ℃ to 40 ℃.
The seat information includes, but is not limited to, information on whether a corresponding user is present for a seat in the driving space, and whether the seat of the corresponding user is a driving seat. That is, the seating information may be information that facilitates a subsequent step of determining physiological information of the user corresponding to the seating information and/or a step of controlling an operational state of the mobile device.
In step 30, physiological information of the user corresponding to the seat information is determined.
In step 30, the physiological information includes, but is not limited to, information that can reflect the physiological state of the user, such as respiration information, heartbeat information, pulse information, and facial information.
And step 40, controlling the working state of the movable equipment based on the seat information and the physiological information.
In step 40, the operating state of the movable apparatus may include at least one of an operating state of a lighting system, an operating state of an audible alarm system, and an operating state of a window system.
In the practical application process, the temperature information in the driving space is determined firstly, when the temperature information meets the preset condition, the seat information in the driving space is determined, then the physiological information of the user corresponding to the seat information is determined, and finally the working state of the movable equipment is controlled based on the seat information and the physiological information.
According to the control method of the mobile device, the temperature information in the driving space is determined, the seat information in the driving space is determined when the temperature information meets the preset condition, then the physiological information of the user corresponding to the seat information is determined, and finally the working state of the mobile device is controlled based on the seat information and the physiological information, so that the purpose of controlling the working state of the mobile device based on the seat information in the driving space and the physiological information of the user corresponding to the seat information is achieved. The control method of the mobile device provided by the embodiment of the application can control the working state of the mobile device according to the physiological information of the user, namely, the control method of the mobile device can control the working state of the mobile device based on the actual physiological state of the user, so that compared with the existing control method of the mobile device, the control method of the mobile device provided by the embodiment of the application can more reasonably control the working state of the mobile device based on the actual physiological state of the user, further effectively guarantee the safety of the user, and further avoid traffic accidents.
In addition, according to the embodiment of the application, the seat information and the physiological information of the user are determined only when the temperature information meets the preset condition, and the working state of the movable equipment is controlled based on the seat information and the physiological information, so that invalid control under the conditions that the temperature in the driving space is normal and the physiological state of the user is normal is effectively avoided, the control accuracy is improved, and the probability of error control is reduced.
Fig. 3 is a flowchart illustrating a method for controlling a mobile device according to another exemplary embodiment of the present application. The embodiment shown in fig. 3 of the present application is extended based on the embodiment shown in fig. 2 of the present application, and the differences between the embodiment shown in fig. 3 and the embodiment shown in fig. 2 are emphasized below, and the descriptions of the same parts are omitted.
As shown in fig. 3, in the control method of the mobile device according to the embodiment of the present application, the step of determining seat information in the driving space when the temperature information meets the preset condition includes the following steps.
When the temperature information is greater than the first temperature threshold, seat information within the driving space is determined based on the pressure sensor, step 21.
In step 21, the specific value of the first temperature threshold may be set according to the actual situation, so as to sufficiently improve the adaptability and the application universality of the control method for the mobile device provided in the embodiment of the present application. For example, the first temperature threshold is set to 30 ℃, 35 ℃, or the like.
In practical application, the temperature information in the driving space is firstly determined, when the temperature information is larger than a first temperature threshold value, the seat information in the driving space is determined based on the pressure sensor, then the physiological information of the user corresponding to the seat information is determined, and finally the working state of the movable device is controlled based on the seat information and the physiological information.
According to the control method of the movable equipment, the seat information in the driving space is determined based on the pressure sensor by limiting the mode that when the temperature information is larger than the first temperature threshold value, the purpose of dealing with the emergency caused by the discomfort of the body of the user at high temperature is achieved, and the safety of the user in the high-temperature environment is effectively guaranteed. In addition, compared with the embodiment shown in fig. 2, the embodiment of the application can substantially reduce or even avoid the casualties and property loss caused by mistake in a high-temperature environment.
In one embodiment of the present application, the first temperature threshold is set at 35 ℃. In practical applications, when the temperature in the driving space exceeds 35 ℃ (i.e., the first temperature threshold), the seat information in the driving space is determined based on the pressure sensor, the physiological information of the user corresponding to the seat information is determined, and the operating state of the mobile device is controlled according to the seat information and the physiological information. It should be understood that when the temperature in the driving space exceeds 35 ℃, situations such as unconsciousness or even coma easily occur to a user in the driving space, and at this time, the control method of the mobile device provided by the embodiment of the application can actively control the working state of the mobile device based on the temperature situation in the driving space and the actual situation of the user, thereby achieving the purpose of effectively ensuring the safety of the user in a high-temperature environment.
In another embodiment of the present application, the determining seat information in the driving space when the temperature information meets a preset condition includes: seat information within the driving space is determined based on the pressure sensor when the temperature information is greater than the temperature of the current environment and the temperature difference from the current environment is greater than a second temperature threshold. That is, in the present embodiment, the seat information in the driving space is determined based on the pressure sensor only when the temperature in the driving space is greater than the temperature of the current environment and the temperature difference from the temperature of the current environment in which the movable device is located is greater than the second temperature threshold. Since there may be a case where the user intentionally stays in the driving space of the movable device when the temperature in the driving space is less than the temperature of the current environment or the temperature in the driving space is similar to the temperature of the current environment, the embodiment of the present application can improve the accuracy of the control.
Fig. 4 is a flowchart illustrating a process for determining physiological information of a user corresponding to seat information according to another exemplary embodiment of the present application. The embodiment shown in fig. 4 of the present application is extended on the basis of the embodiment shown in fig. 2 of the present application, and the differences between the embodiment shown in fig. 4 and the embodiment shown in fig. 2 are emphasized below, and the descriptions of the same parts are omitted.
As shown in fig. 4, in the control method of the mobile device provided in the embodiment of the present application, the step of determining the physiological information of the user corresponding to the seat information includes the following steps.
The location of the user is determined based on the seating information, step 31.
And step 32, transmitting the millimeter wave signal to the preset range of the position where the user is located.
In step 32, the preset range of the position where the user is located may be set according to the actual situation, so as to sufficiently improve the adaptability and the application universality of the control method of the mobile device provided in the embodiment of the present application. For example, the preset range of the position where the user is located is a circular preset range with the position where the user is located as a circle center and a radius of 1 m.
And step 33, determining the breathing and heartbeat information of the user based on the millimeter wave signals.
In step 33, the breathing and heartbeat frequency of the user may be determined by monitoring the height and time differences of the thorax and alar undulations of the user using the millimeter wave signals.
In the practical application process, firstly, temperature information in the driving space is determined, when the temperature information meets preset conditions, seat information in the driving space is determined, then, the position of a user is determined based on the seat information, the millimeter wave radar is started to emit millimeter wave signals to the preset range of the position of the user, respiration and heartbeat information (namely physiological information of the user) of the user is determined based on the millimeter wave signals, and finally, the working state of the movable equipment is controlled based on the seat information and the respiration and heartbeat information of the user.
According to the control method of the mobile device, the position of the user is determined based on the seat information, the millimeter wave signal is transmitted to the preset range of the position of the user, and then the breathing and heartbeat information of the user is determined based on the millimeter wave signal, so that the breathing and heartbeat information of the user can be monitored based on the millimeter wave signal. Because the millimeter wave signal has very high detection precision, the accuracy of the monitored respiration and heartbeat information of the user can be fully ensured. And because the millimeter wave signal has non-contact and non-interference properties and can penetrate through a non-metal material, when a user to be monitored is shielded, the millimeter wave signal can still monitor the breath and heartbeat information of the shielded user, so that the monitoring stability can be ensured, and the probability of missed monitoring is reduced. In addition, in this application embodiment, because only when temperature information accords with the preset condition, just confirm the seat information in the space of riding, and then launch the millimeter wave signal, consequently, compare with continuously launching the millimeter wave signal and monitoring, this application embodiment can greatly save the consumption of millimeter wave signal to can avoid lasting millimeter wave signal to produce harmful effects to the user's person.
In an embodiment of the present application, the specific calculation method of the breathing and heartbeat frequency is as follows: monitoring the fluctuating height difference of the thoracic cavity and the nasal ala of the user based on the millimeter wave signals so as to determine the respiration of the user based on the monitored height difference, counting the respiration times within a preset time period (such as 60 seconds), and further calculating the respiration frequency of the user; and because the corresponding proportional relation exists between the heartbeat frequency and the respiratory frequency, the heartbeat frequency of the user can be determined based on the determined respiratory frequency. It should be noted that the respiratory and heartbeat frequency calculation method provided in the embodiments of the present application can sufficiently ensure the calculation speed and real-time performance.
In another embodiment of the present application, the frequency of the heartbeat is determined based on the difference in height and the difference in time of the undulations within a preset range of the chest opening of the chest cavity. Since the fluctuation of the chest is caused by the pulsation of the heart and the respiration of the lungs, the heart rate can also be determined by monitoring the fluctuation height difference and time difference within the preset range of the chest opening of the chest with the millimeter wave signal. It should be noted that the calculation method of the heartbeat frequency provided in the embodiment of the present application can sufficiently ensure the accuracy of the calculation.
In addition, it should be noted that the specific calculation method for determining the breathing and heartbeat frequency based on the millimeter wave signal may be set according to the actual situation, including but not limited to the calculation methods mentioned in the above embodiments of the present application.
In another embodiment of the present application, before the step of transmitting the millimeter wave signal to the preset range of the location where the user is located, the method further includes: determining a millimeter wave signal, and performing spread spectrum processing on the millimeter wave signal; transmitting the millimeter wave signal subjected to spread spectrum processing to a preset range of the position of a user; and after the step of transmitting the millimeter wave signal to the preset range of the position where the user is located, the method further comprises the following steps: and carrying out despreading processing on the received millimeter wave signals. That is to say, the embodiment of the present application realizes spread spectrum processing of millimeter wave signals. Because the signal frequency band of the millimeter wave signal after the spread spectrum processing is widened, the data processing capacity is increased (namely, the data processing capacity is increased), and in addition, the electromagnetic interference resistance of the millimeter wave signal after the spread spectrum processing is improved, the accuracy of the monitored respiration and heartbeat information of the user can be further improved.
Fig. 5 is a schematic flow chart of determining physiological information of a user corresponding to seat information according to still another exemplary embodiment of the present application. The embodiment shown in fig. 5 of the present application is extended on the basis of the embodiment shown in fig. 2 of the present application, and the differences between the embodiment shown in fig. 5 and the embodiment shown in fig. 2 are emphasized below, and the descriptions of the same parts are omitted.
As shown in fig. 5, in the control method of the mobile device provided in the embodiment of the present application, the step of determining the physiological information of the user corresponding to the seat information includes the following steps.
The location of the user is determined based on the seating information, step 31.
Step 34, the face information of the user is determined based on the camera and the position of the user.
In step 34, the face information of the user is face information including face color change information of the user and the like that can represent the physiological state of the user.
In the practical application process, the temperature information in the driving space is determined firstly, when the temperature information meets the preset condition, the seat information in the driving space is determined, then the position of the user is determined based on the seat information, the face information of the user is determined based on the camera device and the position of the user, and finally the working state of the movable equipment is controlled based on the seat information and the physiological information.
According to the control method of the mobile equipment, the position of the user is determined based on the seat information, and the face information of the user is determined based on the camera device and the position of the user, so that the aim of determining the face information of the user based on the camera device and controlling the working state of the mobile equipment based on the seat information and the face information of the user is achieved. Compared with the embodiment shown in fig. 4, the embodiment of the application can more quickly realize the purpose of controlling the working state of the movable device based on the seat information and the physiological information because the face information of the user can more intuitively and quickly represent the physiological state of the user.
In an embodiment of the application, the image pickup device is used for respectively shooting face information images of different time nodes of the same user, and whether the user is in a normal physiological state or not is determined by comparing the color change of the face of the user in the face information images of the different time nodes. For example, when the face color of the next time node turns red, yellow, or white compared to the face color of the previous time node, it is determined that the user is in an abnormal physiological state. The color change threshold value can be preset in the comparison process of the face information images of different time nodes, so that whether the face information images turn red, yellow or white can be judged better, and the setting of the color change threshold value is not limited specifically.
In another embodiment of the present application, a user identity is first identified by using a facial information image captured by a camera device, and the identified user identity is compared with corresponding pre-stored facial information of the user, so as to obtain a color difference value, and whether the user is in a normal physiological state is determined based on the color difference value. The pre-stored user face information may be a face information image pre-stored by the user, or may also be a face information image photographed when the user enters the mobile device for the first time, which is not uniformly limited in the embodiment of the present application. Compared with the embodiment of comparing the face information images of different time nodes, the embodiment of the application can prevent the user from being in an abnormal physiological state for a long time and being not detected correctly, for example, in the acquired face information images of two time nodes, the user is in the abnormal physiological state, and at this time, the user cannot be determined to be in the abnormal physiological state according to the face color change in the face information image. That is to say, this application embodiment can improve the rate of accuracy of monitoring.
Fig. 6 is a schematic flow chart diagram for controlling an operational state of a mobile device based on seat information and physiological information according to yet another exemplary embodiment of the present application. The embodiment shown in fig. 6 of the present application is extended based on the embodiment shown in fig. 2 of the present application, and the differences between the embodiment shown in fig. 6 and the embodiment shown in fig. 2 are emphasized below, and the descriptions of the same parts are omitted.
As shown in fig. 6, in the control method of the mobile device provided in the embodiment of the present application, the step of controlling the operating state of the mobile device based on the seat information and the physiological information includes the following steps.
And 41, when the user is determined to be in the first position preset range based on the seat information, determining that the user is a driver.
In step 41, the first position preset range is a preset range of driving positions. That is, when it is determined that the user is in the preset range of the driving position based on the seat information, it is determined that the user is the driver.
And 42, when the user is determined to be the driver and the physiological information of the user is in a first preset state, controlling the movable equipment to be in a first working state.
In step 42, the physiological information of the user may be the breathing and heartbeat information of the user, the facial information of the user, or a combination of the breathing and heartbeat information and the facial information of the user, so as to sufficiently improve the adaptability and the application universality of the embodiment of the present application.
In addition, in step 42, the specific state condition of the first preset state may be set according to information such as the identity of the user, the specific type of the physiological information, and the specific state condition of the first working state, and similarly, the specific state condition of the first working state may be set according to information such as the identity of the user and the specific state condition of the first preset state, which is not limited in this embodiment of the application.
For example, when the user identity is a driver, the physiological information is respiration and heartbeat information, and the first preset state is a state in which the respiration and heartbeat information exceeds a normal numerical range, the first working state may be an emergency braking state of the mobile device, where the emergency braking state refers to a state in which the mobile device in a driving state is emergently braked to a stationary state, or a state in which the mobile device in a stationary state cannot be started, that is, cannot enter the driving state.
In the practical application process, the temperature information in the driving space is determined firstly, when the temperature information meets the preset condition, the seat information in the driving space is determined, then the physiological information of the user corresponding to the seat information is determined, when the user is determined to be in the first position preset range based on the seat information, the user is determined to be the driver, and when the user is determined to be the driver and the physiological information of the user is determined to be in the first preset state, the movable equipment is controlled to be in the first working state.
According to the control method of the mobile device, the identity of the user is determined by using the seat information, and when the user is determined to be a driver and the physiological information of the user is in the first preset state, the mobile device is controlled to the first working state, so that the purpose of controlling the working state of the mobile device based on the identity of the user and the physiological information of the user is achieved. Because the working state of the mobile device can be controlled based on the identity of the user, compared with the embodiment shown in fig. 2, the working state determining method and the mobile device can further improve the accuracy of the determined working state.
Fig. 7 is a schematic flow chart illustrating a process for controlling a mobile device to a first operating state according to still another exemplary embodiment of the present application. The embodiment shown in fig. 7 of the present application is extended based on the embodiment shown in fig. 6 of the present application, and the differences between the embodiment shown in fig. 7 and the embodiment shown in fig. 6 are emphasized below, and the descriptions of the same parts are omitted.
As shown in fig. 7, in the control method of the mobile device according to the embodiment of the present application, when it is determined that the user is a driver and the physiological information of the user is in the first preset state, the step of controlling the mobile device to the first working state includes the following steps.
And step 421, when the user is determined to be the driver and the physiological information of the user is in the first preset state, controlling the braking system of the movable equipment to be in the first braking state.
Similarly, in step 421, the physiological information of the user may be the breathing and heartbeat information of the user, the facial information of the user, or a combination of the breathing and heartbeat information of the user and the facial information, so as to sufficiently improve the adaptability and the application range of the embodiment of the present application.
Step 422, the lighting system of the mobile device is controlled to a first illumination state.
In step 422, the first illumination state includes, but is not limited to, a fast flashing state, a fast changing high and low light state, and the like.
In the practical application process, the temperature information in the driving space is determined firstly, when the temperature information meets the preset condition, the seat information in the driving space is determined, then the physiological information of the user corresponding to the seat information is determined, when the user is determined to be in the first position preset range based on the seat information, the user is determined to be the driver, when the user is determined to be the driver and the physiological information of the user is in the first preset state, the brake system of the movable equipment is controlled to be in the first brake state, and the lighting system of the movable equipment is controlled to be in the first illumination state.
According to the control method of the movable equipment, the identity of the user is determined by utilizing the seat information, and when the user is determined to be a driver and the physiological information of the user is in the first preset state, the brake system of the movable equipment is controlled to be in the first brake state and the lighting system of the movable equipment is controlled to be in the first lighting state, so that the purpose of controlling the brake system and the lighting system of the movable equipment based on the identity of the driver of the user and the physiological information of the user is achieved. Because braking system can play emergency braking's effect, and lighting system can play the effect of reminding, consequently, this application embodiment has avoided when the driver is in unusual physiological state, but mobile device still keeps the running state or can be by the dangerous condition of start-up, and then has fully ensured user's safety, has avoided the emergence of traffic accident.
Fig. 8 is a schematic flow chart illustrating a process for controlling a mobile device to a first operating state according to still another exemplary embodiment of the present application. The embodiment shown in fig. 8 of the present application is extended based on the embodiment shown in fig. 7 of the present application, and the differences between the embodiment shown in fig. 8 and the embodiment shown in fig. 7 are emphasized below, and the descriptions of the same parts are omitted.
As shown in fig. 8, in the control method of the mobile device provided in the embodiment of the present application, after the step of controlling the lighting system of the mobile device to the first illumination state, the following steps are further included.
Step 423, controlling the audible alarm system of the mobile device to a first alarm state.
In the practical application process, firstly, temperature information in the driving space is determined, when the temperature information meets preset conditions, seat information in the driving space is determined, then, physiological information of a user corresponding to the seat information is determined, when the user is determined to be in a first position preset range based on the seat information, the user is determined to be a driver, when the user is determined to be the driver and the physiological information of the user is in a first preset state, a braking system of the movable equipment is controlled to be in a first braking state, an illuminating system of the movable equipment is controlled to be in a first illuminating state, and a sound alarm system of the movable equipment is controlled to be in a first alarm state.
According to the control method of the mobile equipment, the purpose of further reminding is achieved by controlling the sound alarm system of the mobile equipment to be in the first alarm state. Compared with the embodiment shown in fig. 7, the embodiment of the application can remind the user in the driving space and even the pedestrians outside the driving space to stop or avoid dangerous accidents in time from sound, so that the safety of the user is further guaranteed.
It should be noted that the starting sequence of the braking system, the lighting system and the audible alarm system of the mobile device can be set according to the actual situation, and is not limited to the sequence mentioned in the above embodiments of the present application.
In an embodiment of the present application, after the step of controlling the lighting system of the movable device to the first illumination state, the method further includes controlling the window system of the movable device to the first open state. Because the opening of door window system can be favorable to the air flow in the space of riding, consequently, this application embodiment can provide the external condition that more is favorable to it to be clear-headed for the driver that is in abnormal physiology state, especially when the driver appears the oxygen deficiency because of the high temperature in the space of riding, breathe heartbeat acceleration etc. physiology state, this application embodiment can provide the advantage for guaranteeing user's life safety to reduce and even avoid the emergence of casualties condition.
FIG. 9 is a schematic flow chart diagram for controlling an operational state of a mobile device based on seat information and physiological information, as provided by yet another exemplary embodiment of the present application. The embodiment shown in fig. 9 of the present application is extended based on the embodiment shown in fig. 2 of the present application, and the differences between the embodiment shown in fig. 9 and the embodiment shown in fig. 2 are emphasized below, and the descriptions of the same parts are omitted.
As shown in fig. 9, in the control method of the mobile device according to the embodiment of the present application, the step of controlling the operating state of the mobile device based on the seat information and the physiological information includes the following steps.
And 43, determining that the user is the passenger when the user is determined to be in the second preset position range based on the seat information.
In step 43, the second preset position range is a preset range of passenger positions. That is, when it is determined that the user is in the preset range of the passenger position based on the seat information, it is determined that the user is the occupant.
And step 44, when the user is determined to be the passenger and the physiological information of the user is in a second preset state, controlling the movable equipment to be in a second working state.
In step 44, the physiological information of the user may be the breathing and heartbeat information of the user, the facial information of the user, or a combination of the breathing and heartbeat information of the user and the facial information, so as to sufficiently improve the adaptability and the application universality of the embodiment of the present application.
In step 44, the specific state condition of the second preset state may be set according to information such as the identity of the user, the specific type of the physiological information, and the specific state condition of the second working state, and similarly, the specific state condition of the second working state may be set according to information such as the identity of the user and the specific state condition of the second preset state, which is not limited in this embodiment of the application.
For example, when the identity of the user is the occupant, the physiological information is facial information, and the second preset state is that the color of the facial information turns red or yellow or white, the second working state may be an emergency ventilation state of the movable device, where the ventilation state refers to that the movable device in a driving state opens the window for emergency to enhance air flow, or the movable device in a stationary state opens the window and the door for emergency to further enhance air flow and facilitate the occupant to get off the vehicle.
In the practical application process, the temperature information in the driving space is determined firstly, when the temperature information meets the preset condition, the seat information in the driving space is determined, then the physiological information of the user corresponding to the seat information is determined, when the user is determined to be in the second position preset range based on the seat information, the user is determined to be the passenger, and when the user is determined to be the passenger and the physiological information of the user is in the second preset state, the movable equipment is controlled to be in the second working state.
According to the control method of the movable equipment, the identity of the user is determined by utilizing the seat information, and when the user is determined to be a passenger and the physiological information of the user is in the second preset state, the movable equipment is controlled to the second working state, so that the purpose of controlling the working state of the movable equipment based on the identity of the user and the physiological information of the user is achieved. Since the embodiment of the present application can control the operating state of the movable device based on the identity of the occupant of the user, the embodiment of the present application can further improve the accuracy of the determined operating state compared to the embodiment shown in fig. 2.
It should be noted that the embodiment shown in fig. 9 can be combined with the embodiment shown in fig. 6 to achieve the purpose of respectively adopting different control schemes based on the identity of the user (driver or passenger), and detailed description of specific implementation processes of the embodiment of the present application is omitted.
Fig. 10 is a schematic flow chart illustrating a process for controlling a mobile device to a second operating state according to still another exemplary embodiment of the present application. The embodiment shown in fig. 10 of the present application is extended based on the embodiment shown in fig. 9 of the present application, and the differences between the embodiment shown in fig. 10 and the embodiment shown in fig. 9 are emphasized below, and the descriptions of the same parts are omitted.
As shown in fig. 10, in the control method of the movable equipment provided in the embodiment of the present application, when it is determined that the user is a passenger and the physiological information of the user is in the second preset state, the step of controlling the movable equipment to the second working state includes the following steps.
And step 441, controlling the sound alarm system of the movable equipment to a second alarm state when the user is determined to be the passenger and the physiological information of the user is in a second preset state.
Similarly, in step 441, the physiological information of the user may be the breathing and heartbeat information of the user, the facial information of the user, or a combination of the breathing and heartbeat information of the user and the facial information, so as to sufficiently improve the adaptability and the application range of the embodiment of the present application.
At step 442, the window system of the movable apparatus is controlled to a second open state.
In step 442, the second open state includes, but is not limited to, a fully open window state, a partially open window state, and the like.
In the practical application process, the temperature information in the driving space is determined firstly, when the temperature information meets the preset condition, the seat information in the driving space is determined, then the physiological information of the user corresponding to the seat information is determined, when the user is determined to be in the second position preset range based on the seat information, the user is determined to be the passenger, when the user is determined to be the passenger and the physiological information of the user is in the second preset state, the sound alarm system of the movable equipment is controlled to be in the second alarm state, and the window system of the movable equipment is controlled to be in the second opening state.
According to the control method of the movable equipment, the identity of the user is determined by utilizing the seat information, and when the user is determined to be a passenger and the physiological information of the user is in the second preset state, the sound alarm system of the movable equipment is controlled to be in the second alarm state, and the window system of the movable equipment is controlled to be in the second opening state, so that the purpose of controlling the sound alarm system and the window system of the movable equipment based on the identity of the passenger of the user and the physiological information of the user is achieved. Because this application embodiment can be based on the operating condition of user's the audible alarm system of the person's of taking identity control mobile device and door window system, consequently, when the person of taking in the space appears the emergency such as uncomfortable, this application embodiment can in time send alarm information in order to remind the driver or even outside personnel in time to take counter-measure to can in time open the door window so that the person of taking obtains more oxygen and reduces the temperature in the space of taking.
Exemplary devices
Fig. 11 is a schematic structural diagram of a control apparatus of a mobile device according to an exemplary embodiment of the present application. As shown in fig. 11, a control apparatus for a mobile device according to an embodiment of the present application includes:
a temperature information determination module 100 for determining temperature information within the driving space;
the seat information determining module 200 is used for determining the seat information in the driving space when the temperature information meets the preset condition;
a physiological information determination module 300 for determining physiological information of the user corresponding to the seat information;
and a control module 400 for controlling the operating state of the mobile device based on the seat information and the physiological information.
Fig. 12 is a schematic structural diagram of a control apparatus of a mobile device according to another exemplary embodiment of the present application. The embodiment shown in fig. 12 of the present application is extended based on the embodiment shown in fig. 11 of the present application, and the differences between the embodiment shown in fig. 12 and the embodiment shown in fig. 11 are emphasized below, and the descriptions of the same parts are omitted.
As shown in fig. 12, in the control apparatus of a movable device provided in an embodiment of the present application, a seat information determination module 200 includes:
a seat information determining unit 210 for determining seat information in the driving space based on the pressure sensor when the temperature information is greater than the first temperature threshold.
Fig. 13 is a schematic structural diagram of a physiological information determination module of a control device of a mobile device according to another exemplary embodiment of the present application. The embodiment shown in fig. 13 of the present application is extended based on the embodiment shown in fig. 11 of the present application, and the differences between the embodiment shown in fig. 13 and the embodiment shown in fig. 11 are emphasized below, and the descriptions of the same parts are omitted.
As shown in fig. 13, in the control apparatus of the mobile device provided in the embodiment of the present application, the physiological information determination module 300 includes:
a position determination unit 310 for determining a position where the user is located based on the seat information;
a millimeter wave transmitting unit 320, configured to transmit a millimeter wave signal to a preset range of a location where a user is located;
a breath and heartbeat information determining unit 330, configured to determine breath and heartbeat information of the user based on the millimeter wave signal.
Fig. 14 is a schematic structural diagram of a physiological information determination module of a control device of a mobile device according to still another exemplary embodiment of the present application. The embodiment shown in fig. 14 is extended from the embodiment shown in fig. 11 of the present application, and the differences between the embodiment shown in fig. 14 and the embodiment shown in fig. 11 are emphasized below, and the descriptions of the same parts are omitted.
As shown in fig. 14, in the control apparatus of the mobile device provided in the embodiment of the present application, the physiological information determination module 300 includes:
a position determination unit 310 for determining a position where the user is located based on the seat information;
a face information determination unit 340 for determining face information of the user based on the image pickup apparatus and the position where the user is located.
Fig. 15 is a schematic structural diagram of a control module of a control apparatus of a mobile device according to still another exemplary embodiment of the present application. The embodiment shown in fig. 15 of the present application is extended based on the embodiment shown in fig. 11 of the present application, and the differences between the embodiment shown in fig. 15 and the embodiment shown in fig. 11 are emphasized below, and the descriptions of the same parts are omitted.
As shown in fig. 15, in the control apparatus of the movable device provided in the embodiment of the present application, the control module 400 includes:
a first identity determination unit 410 for determining that the user is a driver when it is determined that the user is in a first position preset range based on the seat information;
the first operating state control unit 420 is configured to control the mobile device to a first operating state when it is determined that the user is a driver and the physiological information of the user is in a first preset state.
Fig. 16 is a schematic structural diagram of a first operating state control unit of a control apparatus of a movable device according to still another exemplary embodiment of the present application. The embodiment shown in fig. 16 is extended from the embodiment shown in fig. 15 of the present application, and the differences between the embodiment shown in fig. 16 and the embodiment shown in fig. 15 are emphasized below, and the descriptions of the same parts are omitted.
As shown in fig. 16, in the control apparatus of a movable device provided in the embodiment of the present application, the first operating state control unit 420 includes:
the first braking state control subunit 4210 is configured to, when it is determined that the user is a driver and the physiological information of the user is in a first preset state, control a braking system of the mobile device to a first braking state;
the first illumination state control subunit 4220 is configured to control the illumination system of the movable apparatus to a first illumination state.
Fig. 17 is a schematic structural diagram of a first operating state control unit of a control apparatus of a movable device according to still another exemplary embodiment of the present application. The embodiment shown in fig. 17 is extended from the embodiment shown in fig. 16 of the present application, and the differences between the embodiment shown in fig. 17 and the embodiment shown in fig. 16 are emphasized below, and the descriptions of the same parts are omitted.
As shown in fig. 17, in the control apparatus of a movable device provided in the embodiment of the present application, the first operating state control unit 420 further includes:
and a first alarm state control subunit 4230, configured to control the audible alarm system of the mobile device to a first alarm state.
Fig. 18 is a schematic structural diagram of a control module of a control device of a movable apparatus according to still another exemplary embodiment of the present application. The embodiment shown in fig. 18 of the present application is extended based on the embodiment shown in fig. 11 of the present application, and the differences between the embodiment shown in fig. 18 and the embodiment shown in fig. 11 are emphasized below, and the descriptions of the same parts are omitted.
As shown in fig. 18, in the control apparatus of the movable device provided in the embodiment of the present application, the control module 400 includes:
a second identity determination unit 430 for determining that the user is an occupant when it is determined that the user is in the second position preset range based on the seat information;
the second working state control unit 440 is configured to control the movable device to the second working state when it is determined that the user is the occupant and the physiological information of the user is in the second preset state.
Fig. 19 is a schematic structural diagram of a second operating state control unit of a control apparatus of a movable device according to still another exemplary embodiment of the present application. The embodiment shown in fig. 19 of the present application is extended based on the embodiment shown in fig. 18 of the present application, and the differences between the embodiment shown in fig. 19 and the embodiment shown in fig. 18 will be emphasized below, and the descriptions of the same parts will not be repeated.
As shown in fig. 19, in the control apparatus of a movable device provided in the embodiment of the present application, the second operating state control unit 440 includes:
a second alarm state determination subunit 4410, configured to control the acoustic alarm system of the mobile device to a second alarm state when it is determined that the user is a seated person and the physiological information of the user is in a second preset state;
the second open state control subunit 4420 is configured to control the window system of the movable apparatus to a second open state.
It should be understood that the temperature information determination module 100, the seat information determination module 200, the physiological information determination module 300, and the control module 400 in the control apparatus of the movable equipment provided in fig. 11 to 19, and the seat information determination unit 210 included in the seat information determination module 200, and the position determination unit 310, the millimeter wave transmission unit 320, the respiration and heartbeat information determination unit 330, and the face information determination unit 340 included in the physiological information determination module 300, and the first identity determination unit 410, the first operation state control unit 420, the second identity determination unit 430, and the second operation state control unit 440 included in the control module 400, and the first brake state control subunit 4210, the first irradiation state control subunit 4220, and the first alarm state control subunit 4230 included in the first operation state control unit 420, and the second alarm state determination subunit 4410 and the second on state control subunit 4410 included in the second operation state control unit 440 are provided in fig. 11 to 19, and the seat information determination unit 210 included in the seat information determination module 200, and the face information determination unit 340 are included The operation and function of the sub-unit 4420 can refer to the control method of the mobile device provided in fig. 2 to 10, and are not described herein again to avoid redundancy.
Fig. 20 is a schematic diagram of an actual application of the control device of the movable apparatus according to an exemplary embodiment of the present application. As shown in fig. 20, the control device of the movable apparatus provided in the embodiment of the present application includes a controller 51, a temperature sensor 52, a pressure sensor 53, and a millimeter wave radar 54; the movable equipment includes a braking system 61, a lighting system 62, an audible alarm system 63 and a window system 64.
In the control device of the movable equipment provided by the embodiment of the application, the controller 51 is respectively in communication connection with the temperature sensor 52, the pressure sensor 53 and the millimeter wave radar 54, and the controller 51 is also respectively in communication connection with the brake system 61, the lighting system 62, the sound alarm system 63 and the window system 64 in the movable equipment. The controller 51 is used for receiving temperature information of the temperature sensor 52 and pressure information of the pressure sensor 53, and controlling the working state of the millimeter wave radar 54 and the working states of a brake system 61, a lighting system 62, an acoustic alarm system 63 and a window system 64 of the movable equipment based on the temperature information and the pressure information; the temperature sensor 52 is used to monitor temperature information within the drive space of the mobile device; pressure sensor 53 is used to monitor seating information within the mobile device's driving space; the millimeter wave radar 54 is configured to transmit millimeter wave signals to a predetermined range of a position where the user is located, so as to monitor respiration and heartbeat information (i.e., physiological information) of the user.
In the movable device corresponding to the control device of the movable device provided in the embodiment of the present application, the operating states and operating modes of the braking system 61, the lighting system 62, the audible alarm system 63, and the window system 64 may refer to the control method of the movable device mentioned in the above embodiment, and details of the embodiment of the present application are not repeated.
In practical application, the controller 51 is configured to receive temperature information of the temperature sensor 52, perform judgment based on the received temperature information, determine seat information in the driving space based on the pressure information of the pressure sensor 53 when the received temperature information meets a preset condition, control the millimeter wave radar 54 to emit a millimeter wave signal based on the seat information to determine respiration and heartbeat information (i.e., physiological information) of the user corresponding to the seat information, and finally select and control an operating state of any one or more of the braking system 61, the lighting system 62, the audible alarm system 63 and the window system 64 in the mobile device based on the seat information and the respiration and heartbeat information of the user.
The control device of the movable equipment provided by the embodiment of the application utilizes the matching linkage among the controller, the temperature sensor, the pressure sensor and the millimeter wave radar, realizes the purpose of controlling the brake system, the lighting system, the sound alarm system and the vehicle window system of the movable equipment, and further realizes the purpose of controlling the working state of the movable equipment based on the seat information in the driving space and the physiological information of the user corresponding to the seat information. Therefore, the embodiment of the application effectively guarantees the safety of the user and effectively avoids traffic accidents.
In an embodiment of the present application, the millimeter wave radar 54 is fabricated based on a micro-assembly process. Compare with the paster technology among the prior art, this application embodiment can improve the integration and the lightweight of millimeter wave radar, promptly, can greatly reduce the volume of millimeter wave radar, consequently, can greatly reduce or even avoid the adverse effect of millimeter wave radar to the outward appearance of mobile device.
In an embodiment of the present application, the temperature sensor 52 is mounted to the top metal plate of the movable apparatus. Because the temperature of the top metal plate can quickly approach the temperature of the current environment, the temperature sensor 52 mounted on the top metal plate can quickly sense the temperature variation trend in the driving space, and further provides a precondition for realizing the quick control of the control device of the movable equipment to the working state of the movable equipment.
In an embodiment of the present application, the millimeter wave radar 54 is mounted to the front windshield of the mobile device to facilitate full-range monitoring of all seats in the driving space by the millimeter wave radar 54.
In an embodiment of the present application, a frequency spreading module is installed at a signal transmitting end of the millimeter wave radar 54, and a frequency despreading module is installed at a signal receiving end, so as to implement frequency spreading processing on a millimeter wave signal transmitted by the millimeter wave radar 54, thereby further improving accuracy of monitored respiration and heartbeat information of a user.
In one embodiment of the present application, the pressure sensor 53 may also be replaced with an infrared sensor, i.e., an infrared sensor is utilized to monitor seating information within the passenger space of the mobile device.
Exemplary electronic device
Next, an electronic apparatus according to an embodiment of the present application is described with reference to fig. 21. FIG. 21 illustrates a block diagram of an electronic device in accordance with an embodiment of the present application.
As shown in fig. 21, the electronic device 70 includes one or more processors 701 and a memory 702.
The processor 701 may be a Central Processing Unit (CPU) or other form of processing unit having data processing capabilities and/or instruction execution capabilities, and may control other components in the electronic device 70 to perform desired functions.
Memory 702 may include one or more computer program products that may include various forms of computer-readable storage media, such as volatile memory and/or non-volatile memory. The volatile memory may include, for example, Random Access Memory (RAM), cache memory (cache), and/or the like. The non-volatile memory may include, for example, Read Only Memory (ROM), hard disk, flash memory, etc. One or more computer program instructions may be stored on the computer-readable storage medium and executed by the processor 701 to implement the control methods of the removable device of the various embodiments of the present application described above and/or other desired functions. Various contents such as temperature information may also be stored in the computer-readable storage medium.
In one example, the electronic device 70 may further include: an input device 703 and an output device 704, which are interconnected by a bus system and/or other form of connection mechanism (not shown).
The input device 703 may include, for example, a keyboard, a mouse, and the like.
The output device 704 may output various information including the determined control information and the like to the outside. The output means 704 may comprise, for example, a display, a communication network, a remote output device connected thereto, and the like.
Of course, for the sake of simplicity, only some of the components related to the present application in the electronic device 70 are shown in fig. 21, and components such as a bus, an input/output interface, and the like are omitted. In addition, the electronic device 70 may include any other suitable components, depending on the particular application.
Exemplary computer program product and computer-readable storage Medium
In addition to the above-described methods and devices, embodiments of the present application may also be a computer program product comprising computer program instructions which, when executed by a processor, cause the processor to perform the steps in the method of controlling a removable device according to various embodiments of the present application described in the above-mentioned "exemplary methods" section of this specification.
The computer program product may be written with program code for performing the operations of embodiments of the present application in any combination of one or more programming languages, including an object oriented programming language such as Java, C + + or the like and conventional procedural programming languages, such as the "C" programming language or similar programming languages. The program code may execute entirely on the user's computing device, partly on the user's device, as a stand-alone software package, partly on the user's computing device and partly on a remote computing device, or entirely on the remote computing device or server.
Furthermore, embodiments of the present application may also be a computer-readable storage medium having stored thereon computer program instructions that, when executed by a processor, cause the processor to perform steps in a method of controlling a removable device according to various embodiments of the present application described in the "exemplary methods" section above of this specification.
The computer-readable storage medium may take any combination of one or more readable media. The readable medium may be a readable signal medium or a readable storage medium. A readable storage medium may include, for example, but not limited to, an electronic, magnetic, optical, electromagnetic, infrared, or semiconductor system, apparatus, or device, or a combination of any of the foregoing. More specific examples (a non-exhaustive list) of the readable storage medium include: an electrical connection having one or more wires, a portable disk, a hard disk, a Random Access Memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), an optical fiber, a portable compact disc read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination of the foregoing.
The foregoing describes the general principles of the present application in conjunction with specific embodiments, however, it is noted that the advantages, effects, etc. mentioned in the present application are merely examples and are not limiting, and they should not be considered essential to the various embodiments of the present application. Furthermore, the foregoing disclosure of specific details is for the purpose of illustration and description and is not intended to be limiting, since the foregoing disclosure is not intended to be exhaustive or to limit the disclosure to the precise details disclosed.
The block diagrams of devices, apparatuses, systems referred to in this application are only given as illustrative examples and are not intended to require or imply that the connections, arrangements, configurations, etc. must be made in the manner shown in the block diagrams. These devices, apparatuses, devices, systems may be connected, arranged, configured in any manner, as will be appreciated by those skilled in the art. Words such as "including," "comprising," "having," and the like are open-ended words that mean "including, but not limited to," and are used interchangeably therewith. The words "or" and "as used herein mean, and are used interchangeably with, the word" and/or, "unless the context clearly dictates otherwise. The word "such as" is used herein to mean, and is used interchangeably with, the phrase "such as but not limited to".
It should also be noted that in the devices, apparatuses, and methods of the present application, the components or steps may be decomposed and/or recombined. These decompositions and/or recombinations are to be considered as equivalents of the present application.
The previous description of the disclosed aspects is provided to enable any person skilled in the art to make or use the present application. Various modifications to these aspects will be readily apparent to those skilled in the art, and the generic principles defined herein may be applied to other aspects without departing from the scope of the application. Thus, the present application is not intended to be limited to the aspects shown herein but is to be accorded the widest scope consistent with the principles and novel features disclosed herein.
The foregoing description has been presented for purposes of illustration and description. Furthermore, the description is not intended to limit embodiments of the application to the form disclosed herein. While a number of example aspects and embodiments have been discussed above, those of skill in the art will recognize certain variations, modifications, alterations, additions and sub-combinations thereof.

Claims (10)

1. A control method of a movable apparatus, comprising:
determining temperature information within a driving space;
when the temperature information meets a preset condition, determining seat information in the driving space;
determining physiological information of a user corresponding to the seat information, wherein the determining physiological information of the user corresponding to the seat information comprises: determining a location where the user is located based on the seating information; transmitting millimeter wave signals to a preset range of the position where the user is located; determining respiration and heartbeat information of the user based on the millimeter wave signals;
wherein the determining breathing and heartbeat information of the user based on the millimeter wave signal comprises: determining the breathing and heartbeat frequency of the user by monitoring the height difference and the time difference of the fluctuation of the thoracic cavity and the nasal wings of the user by utilizing the millimeter wave signals;
the determining physiological information of a user corresponding to the seat information further comprises: determining a location where the user is located based on the seating information; determining face information of the user based on a camera device and the position of the user, wherein the face information is used for representing the physiological state of the user and comprises face color change information of the user;
controlling an operating state of the mobile device based on the seat information, the respiration and heartbeat information of the user, and the face information.
2. The method of claim 1, wherein the determining seat information within the driving space when the temperature information meets a preset condition comprises:
determining seat information within the driving space based on a pressure sensor when the temperature information is greater than a first temperature threshold.
3. The method of claim 1, wherein said controlling an operational state of the mobile device based on the seating information and the physiological information comprises:
determining that the user is a driver when it is determined that the user is in a first position preset range based on the seat information;
and when the user is determined to be a driver and the physiological information of the user is in a first preset state, controlling the movable equipment to be in a first working state.
4. The method of claim 3, wherein said controlling the mobile device to a first operational state comprises:
controlling a braking system of the movable equipment to a first braking state;
controlling a lighting system of the movable device to a first illumination state.
5. The method of claim 4, wherein said controlling the mobile device to a first operational state further comprises:
and controlling the sound alarm system of the movable equipment to a first alarm state.
6. The method of claim 1, the controlling an operational state of the mobile device based on the seating information and the physiological information, comprising:
determining that the user is an occupant when it is determined that the user is in a second position preset range based on the seat information;
and when the user is determined to be the passenger and the physiological information of the user is in a second preset state, controlling the movable equipment to be in a second working state.
7. The method of claim 6, wherein said controlling the mobile device to a second operational state comprises:
controlling an audible alarm system of the mobile device to a second alarm state;
controlling a window system of the movable apparatus to a second open state.
8. A control apparatus of a movable device, comprising:
the temperature information determining module is used for determining temperature information in the driving space;
the seat information determining module is used for determining the seat information in the driving space when the temperature information meets the preset condition;
a physiological information determination module for determining physiological information of a user corresponding to the seat information, wherein the physiological information determination module includes: a position determination unit for determining a position where the user is located based on the seat information; the millimeter wave transmitting unit is used for transmitting millimeter wave signals to a preset range of the position where the user is located; a breath and heartbeat information determining unit, configured to determine breath and heartbeat information of the user based on the millimeter wave signal, where determining the breath and heartbeat information of the user based on the millimeter wave signal includes: determining the breathing and heartbeat frequency of the user by monitoring the height difference and the time difference of the fluctuation of the thoracic cavity and the nasal wings of the user by utilizing the millimeter wave signals;
the physiological information determination module further comprises: a position determination unit for determining a position where the user is located based on the seat information; the face information determining unit is used for determining face information of a user based on a camera device and the position of the user, wherein the face information is used for representing the physiological state of the user and comprises face color change information of the user;
and the control module is used for controlling the working state of the movable equipment based on the seat information, the breathing and heartbeat information of the user and the face information.
9. A computer-readable storage medium storing a computer program for executing the control method of the removable device according to any one of claims 1 to 7.
10. An electronic device, the electronic device comprising:
a processor;
a memory for storing the processor-executable instructions;
the processor is configured to execute the control method of the mobile device according to any one of claims 1 to 7.
CN201910356239.5A 2019-04-29 2019-04-29 Control method and control device of movable equipment and electronic equipment Active CN110077396B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201910356239.5A CN110077396B (en) 2019-04-29 2019-04-29 Control method and control device of movable equipment and electronic equipment

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201910356239.5A CN110077396B (en) 2019-04-29 2019-04-29 Control method and control device of movable equipment and electronic equipment

Publications (2)

Publication Number Publication Date
CN110077396A CN110077396A (en) 2019-08-02
CN110077396B true CN110077396B (en) 2021-09-24

Family

ID=67417760

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201910356239.5A Active CN110077396B (en) 2019-04-29 2019-04-29 Control method and control device of movable equipment and electronic equipment

Country Status (1)

Country Link
CN (1) CN110077396B (en)

Family Cites Families (10)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20120150387A1 (en) * 2010-12-10 2012-06-14 Tk Holdings Inc. System for monitoring a vehicle driver
DE102011109564B4 (en) * 2011-08-05 2024-05-02 Mercedes-Benz Group AG Method and device for monitoring at least one vehicle occupant and method for operating at least one assistance device
FR2998159B1 (en) * 2012-11-22 2016-01-01 Peugeot Citroen Automobiles Sa METHOD AND SYSTEM FOR MANAGING THE STRESS OF A MOTOR VEHICLE DRIVER
CN103978977B (en) * 2014-04-28 2016-09-07 中国科学院深圳先进技术研究院 Vehicle monitoring system based on human body communication and method
US9688271B2 (en) * 2015-03-11 2017-06-27 Elwha Llc Occupant based vehicle control
US9919712B1 (en) * 2015-08-10 2018-03-20 Rockwell Collins, Inc. Crew biometrics and aircraft data analysis with real-time and proactive actions
KR20170020036A (en) * 2015-08-13 2017-02-22 현대자동차주식회사 System applied to secret mode about biometric information of driver and Method for operating thereof
CN107212861A (en) * 2016-03-21 2017-09-29 罗伯特·博世有限公司 Physiological characteristic detecting system and method applied to vehicle
CN107878323A (en) * 2017-11-21 2018-04-06 武汉理工大学 A kind of warning system and method prevented in child leaving car
CN108784669A (en) * 2018-06-08 2018-11-13 张洪平 A kind of contactless heartbeat and disordered breathing monitor system and method

Also Published As

Publication number Publication date
CN110077396A (en) 2019-08-02

Similar Documents

Publication Publication Date Title
JP6110396B2 (en) Sleepiness estimation device, sleepiness estimation method, computer-readable non-transitory recording medium
JP2018026109A (en) Personalized medical emergency autopilot system based on portable medical device data
RU2017134405A (en) EMERGENCY EMERGENCY USING AUTONOMOUS CONTROL
TWI579804B (en) Driver sudden heart disease judgment system
JP6449734B2 (en) Computer storage media
US20100007480A1 (en) On-board warning apparatus and warning method
CN105144199A (en) Imaging device based occupant monitoring system supporting multiple functions
CN111114483B (en) In-vehicle environment monitoring and protecting system
CN112829767B (en) Automatic driving control system and method based on monitoring of misoperation of driver
US11495033B2 (en) Method and apparatus for controlling unmanned vehicle, electronic device and storage medium
TWI545041B (en) Monitoring and warning system for vehicles
EP3787938B1 (en) Method and apparatus for monitoring status of persons in a vehicle
JP2011123653A (en) Test device for driver's arousal level
KR20160036968A (en) Integrated assessment apparatus and method of drivers' drowsiness, inattention and workload
CN112937437A (en) Vehicle grading alarm method and alarm system
KR20160112213A (en) Audio navigation device, vehicle having the same, user device, and method for controlling vehicle
CN110077396B (en) Control method and control device of movable equipment and electronic equipment
CN111361567B (en) Method and equipment for emergency treatment in vehicle driving
US20170144670A1 (en) Vehicle safety method and vehicle safety system
JP2005108033A (en) Driver condition determination device and method
WO2018235356A1 (en) Vehicle operation assistance device, vehicle operation assistance method, and program
CN103569084B (en) Drive arrangement for detecting and method thereof
KR20220064659A (en) Vehicle and method for controlling thereof
CN112141117A (en) Vehicle-mounted life detection method and system
CN114684151A (en) Vehicle control method and device based on wearable device and vehicle

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant