WO2017133589A1 - 终端用户安全监护方法及装置 - Google Patents

终端用户安全监护方法及装置 Download PDF

Info

Publication number
WO2017133589A1
WO2017133589A1 PCT/CN2017/072457 CN2017072457W WO2017133589A1 WO 2017133589 A1 WO2017133589 A1 WO 2017133589A1 CN 2017072457 W CN2017072457 W CN 2017072457W WO 2017133589 A1 WO2017133589 A1 WO 2017133589A1
Authority
WO
WIPO (PCT)
Prior art keywords
terminal
module
application
foreground
motion data
Prior art date
Application number
PCT/CN2017/072457
Other languages
English (en)
French (fr)
Inventor
刘嵩
Original Assignee
中兴通讯股份有限公司
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 中兴通讯股份有限公司 filed Critical 中兴通讯股份有限公司
Publication of WO2017133589A1 publication Critical patent/WO2017133589A1/zh

Links

Images

Classifications

    • G—PHYSICS
    • G08—SIGNALLING
    • G08B—SIGNALLING OR CALLING SYSTEMS; ORDER TELEGRAPHS; ALARM SYSTEMS
    • G08B21/00—Alarms responsive to a single specified undesired or abnormal condition and not otherwise provided for
    • G08B21/02—Alarms for ensuring the safety of persons
    • G—PHYSICS
    • G08—SIGNALLING
    • G08B—SIGNALLING OR CALLING SYSTEMS; ORDER TELEGRAPHS; ALARM SYSTEMS
    • G08B21/00—Alarms responsive to a single specified undesired or abnormal condition and not otherwise provided for
    • G08B21/02—Alarms for ensuring the safety of persons
    • G08B21/04—Alarms for ensuring the safety of persons responsive to non-activity, e.g. of elderly persons
    • G08B21/0438—Sensor means for detecting
    • G08B21/0469—Presence detectors to detect unsafe condition, e.g. infrared sensor, microphone

Definitions

  • the present disclosure relates to the field of intelligent terminals, for example, to an end user security monitoring method and apparatus.
  • the present disclosure provides an end user security monitoring method and apparatus, which reduces the phenomenon that an end user may use a terminal to ignore environmental changes in an unsafe environment and may cause a personal safety accident.
  • the present disclosure provides an end user security monitoring method, including:
  • the terminal user is alerted by the terminal.
  • determining whether the terminal is in the monitoring motion mode according to the motion data of the terminal includes:
  • the motion data collection module of the terminal collects the collection period in the collection period according to the current acquisition frequency.
  • the motion data of the terminal
  • the method further includes:
  • analyzing whether the terminal is in the monitoring motion mode according to the motion data includes:
  • n of the current continuous determination result is greater than or equal to the preset number of times threshold N. If n is greater than or equal to N, the terminal is determined to be in the monitoring motion mode; if n is less than N, the analysis continues. Motion data during the subsequent acquisition cycle;
  • the acquisition frequency is lowered according to a preset frequency adjustment rule.
  • the method further includes: when detecting that the terminal changes from a bright screen to a blackout, stopping the collection of the motion data, determining the type of the foreground application of the terminal, and determining the type of the foreground application of the terminal Security reminder.
  • determining whether the application currently running in the foreground of the terminal belongs to a preset supervisory application includes:
  • the application that is currently running in the foreground of the terminal belongs to a preset supervisory application, and the M2 is greater than or Equal to the M1.
  • the method further includes:
  • a method is performed to analyze whether there is a face in the image, and if present, a security reminder is provided to the terminal user through the terminal.
  • the method further includes: when there is no human face in the image, polling a process currently running in the foreground of the terminal, when consecutive K1 times or cumulative K2 polling
  • the terminal user performs a security reminder to the terminal user, where the K1 is greater than the M1, the K2 is greater than the M2, and the K2 is Greater than the K1.
  • the security reminder to the end user by the terminal includes at least one of the following manners:
  • the monitoring motion mode is a walking mode.
  • the supervisory application is a social entertainment application.
  • an end user security monitoring device including:
  • the motion mode determining module is configured to determine, according to the motion data of the terminal, whether the terminal is in a monitoring motion mode that needs to perform safety monitoring;
  • the application type determining module is configured to determine, when the terminal is in the monitoring motion mode, whether the application currently running in the foreground of the terminal belongs to a preset supervisory application;
  • the alarm module is configured to perform a security reminder to the terminal user through the terminal when the application type determining module determines that the currently running application belongs to a preset supervisory application.
  • the motion mode determining module includes:
  • a detecting submodule configured to detect that the terminal is bright
  • An acquisition control sub-module configured to control the motion data collection module of the terminal to collect motion data of the terminal in an acquisition period according to a current acquisition frequency
  • the motion data analysis sub-module is configured to analyze whether the terminal is in the monitoring motion mode according to the motion data.
  • the application type determining module includes:
  • Polling the sub-module configured to poll the process currently running in the foreground of the terminal according to a preset polling frequency
  • the judging sub-module is configured to determine that the application currently running in the foreground of the terminal belongs to a preset supervisory application when the process of the foreground running of the terminal belongs to the process of the supervised application in a continuous M1 or cumulative M2 polling process.
  • the M2 is greater than or equal to the M1.
  • the device further includes: an image acquisition control module, configured to: after determining whether the application currently running in the foreground of the terminal belongs to a preset supervisory application, and using the terminal to the terminal user Before performing the security reminder, controlling the image acquisition module of the terminal to collect the image of the terminal user on the front side of the terminal;
  • the image analysis module is configured to analyze whether there is a human face in the image, and if yes, notify the alarm module to perform a security reminder to the terminal user.
  • the apparatus further includes a requisition module configured to poll the process currently running in the foreground of the terminal when there is no human face in the image, when consecutive K1 times or
  • the alarm module is notified to the terminal user to perform a security reminder; wherein the K1 is greater than the M1, the K2 Greater than the M2, and the K2 is greater than the K1.
  • the present disclosure also provides a non-transitory computer readable storage medium storing computer executable instructions arranged to perform the above method.
  • the present disclosure also provides a terminal, including:
  • At least one processor At least one processor
  • the memory stores instructions executable by the at least one processor, the instructions being executed by the at least one processor to cause the at least one processor to perform the method described above.
  • the terminal user security monitoring method and device can determine, according to the motion data of the terminal, whether the terminal is in a monitoring motion mode that needs to perform security monitoring, that is, whether the current user terminal is potentially secure. Hidden dangers, for example, in walking mode; when judging that the terminal is in the monitoring exercise mode, it is determined whether the application currently running in the foreground of the terminal belongs to a preset regulatory application (such as a game, video, e-book, webpage or social software, etc.), if the terminal is in the foreground The currently running application belongs to the preset supervisory application, indicating that the end user may be focusing at the moment. In the terminal, the terminal user is reminded by the terminal to prevent the end user from ignoring the external environment due to distraction, which may lead to personal safety accidents, ensure the personal safety of the end user, and improve the user experience.
  • a preset regulatory application such as a game, video, e-book, webpage or social software, etc.
  • FIG. 1 is a schematic flowchart of a terminal user security monitoring method according to Embodiment 1 of the present disclosure
  • FIG. 2 is a schematic flowchart of determining whether a terminal is in a monitoring motion mode according to Embodiment 1 of the present disclosure
  • FIG. 3 is a schematic flowchart of determining whether an application currently running in the foreground belongs to a preset supervisory application process according to Embodiment 1 of the present disclosure
  • FIG. 5 is a schematic structural diagram 1 of an end user security monitoring apparatus according to Embodiment 2 of the present disclosure.
  • FIG. 6 is a second schematic structural diagram of an end user security monitoring apparatus according to Embodiment 2 of the present disclosure.
  • FIG. 7 is a schematic structural diagram 3 of an end user security monitoring apparatus according to Embodiment 2 of the present disclosure.
  • FIG. 8 is a schematic diagram of a working process of a motion mode determining module according to Embodiment 3 of the present disclosure.
  • FIG. 9 is a schematic diagram of a working process of an application type determining module according to Embodiment 3 of the present disclosure.
  • FIG. 10 is a schematic structural diagram of a monitoring system according to Embodiment 3 of the present disclosure.
  • FIG. 11 is a schematic structural diagram of hardware of a terminal according to Embodiment 5 of the present disclosure.
  • the present disclosure may determine, according to the motion data of the terminal, whether the terminal is in a monitoring motion mode that needs to perform safety monitoring, for example, in a walking mode; and when determining that the terminal is in the monitoring motion mode, determine whether the application currently running in the foreground of the terminal belongs to The preset supervisory application (such as games, videos, etc.), if yes, at this time, the terminal is used to provide security reminders to the end users to ensure the personal safety of the end users and enhance the user experience.
  • the preset supervisory application such as games, videos, etc.
  • FIG. 1 is a method for security monitoring of an end user provided by this embodiment.
  • step 110 it is determined according to the motion data of the terminal whether the terminal is in need of security monitoring.
  • the monitoring exercise mode if yes, proceeds to step 120; if not, step 110 is performed.
  • step 120 it is determined whether the application currently running in the foreground of the terminal belongs to the preset supervisory application, and if yes, go to step 130; if not, go to step 120.
  • step 130 the terminal user is prompted for security by the terminal.
  • the terminal is generally carried by the user and moves with the user, so the motion mode of the terminal can reflect the motion mode of the terminal user.
  • the monitoring exercise mode in this embodiment can be flexibly set by the manufacturer or the end user according to the user's needs.
  • the monitoring motion mode may be set to a walking mode, and the current motion mode of the terminal may be matched according to the motion data of the terminal to match the walking mode.
  • determining whether the terminal is in the monitoring motion mode according to the motion data of the terminal is shown in FIG. 2 .
  • the terminal is detected to be bright.
  • the bright state of the terminal indicates that the current attention of the terminal user may be concentrated on the terminal, and detecting the bright screen of the terminal may improve the accuracy of the control.
  • the embodiment may further determine whether the duration of the bright screen of the terminal is greater than a preset brightness time threshold after detecting that the terminal is bright. 2 seconds or 3 seconds, etc., when it is judged that the duration of the bright screen of the terminal is greater than the preset brightness time threshold, the subsequent steps can be performed, and the terminal user only lights up the screen viewing time and the like, thereby improving the accuracy of the control. Sex.
  • step 220 the motion data collection module of the terminal collects the motion data of the terminal in the collection period according to the current acquisition frequency.
  • step 230 it is analyzed whether the terminal is in the monitoring motion mode based on the obtained motion data.
  • the motion data acquisition module used in the above step 220 can implement a function module for terminal motion data acquisition.
  • the motion data acquisition module can be a terminal gravity sensing sensor, or a terminal three-axis acceleration sensor, a motion coprocessor, and an application.
  • a sensor that performs motion data acquisition in the terminal can be implemented in combination with two or more of the above sensors.
  • a time stamp may be added in each collected motion data.
  • the collection period can be controlled by the acquisition start command and the acquisition stop command.
  • the collection of the motion data can be completed by using the motion data acquisition module of the terminal itself. Therefore, in order to ensure the normal operation of the control process, after the terminal is started, it is possible to detect whether the motion data collection module of the terminal is running normally, and save the detection result. When the data is used, it can be known from the detection result whether there is an available motion data acquisition module and which motion data acquisition module is used. If the motion data acquisition module of the terminal in the detection result cannot be normally operated, the user may be promptly reminded to perform repair settings.
  • the process of analyzing whether the terminal is in the monitoring motion mode according to the motion data may include:
  • n the current number n of the continuous judgment result is greater than or equal to the preset number threshold N. If n is greater than or equal to N, the terminal is determined to be in the monitoring motion mode; if n is less than N, the motion in the subsequent acquisition period is analyzed. Data;
  • the frequency adjustment rule in this embodiment may be flexibly set by the manufacturer or the user according to the application scenario.
  • the initial setting can be set to 20 times in 1 second.
  • the acquisition frequency can be adjusted to 1 second and 18 times.
  • the frequency will be collected every 1 second. Reduce it 2 times until it is reduced to the lowest 1 second 10 times.
  • the acquisition frequency can be immediately restored to the initial 1 second 20 times.
  • the following is an example of the motion data collected by the gravity sensing sensor.
  • the characteristics of the walking state of different people in different environments are not completely the same.
  • the data acquired by the gravity sensing sensor may include the acceleration components a X , a Y , a Z of the mobile phone in the three directions of coordinates X, Y, and Z , according to Calculate the acceleration at this moment, and remove the noise by fast Fourier transform, you can get the change of acceleration over a period of time, extract the characteristics of the acceleration during this period, and compare it with the characteristics of the motion state (such as walking). It can be judged whether the current motion mode of the terminal belongs to a preset motion state.
  • the feature values of walking movements of different people at different speeds in different environments may be extracted in advance, and the feature library for matching comparison is enriched.
  • a method for analyzing data of a gravity sensing sensor may be employed, and a method for analyzing data of the gravity sensing sensor and matching the walking state by software may be used.
  • the value of the number n of the current continuous determination result may be greater than or equal to 2, and the value range of n may be flexibly set according to application scenarios such as different terminal users or different terminals.
  • n is greater than or equal to 2
  • the acquisition frequency can be reduced. Reducing the frequency of motion data collection can save resources.
  • the monitoring motion mode (such as the walking mode) is not the normal state of the terminal, and the terminal is in such a motion mode time is relatively short, so reducing the acquisition frequency here can reduce the power consumption of the terminal itself.
  • the rule for reducing the acquisition frequency can also be flexibly set according to requirements.
  • determining whether the application currently running in the foreground of the terminal belongs to a preset supervisory application may be implemented by using a polling mechanism, as shown in FIG. 3 .
  • step 310 the currently running process of the terminal foreground is polled according to the preset polling frequency.
  • step 320 when the process of the terminal running in the terminal M1 or the cumulative M2 polling belongs to the process of the supervisory application, it is determined that the application currently running in the foreground of the terminal belongs to the preset supervisory application.
  • the number of times M2 is greater than or equal to M1, and M1 and M2 can be flexibly set by the manufacturer or the user according to requirements.
  • M1 is set to 2 or 3 times
  • M2 is set to 4 times or 5 times.
  • the polling frequency can be adjusted according to certain rules to reduce the number of polling and reduce resource consumption.
  • the rule may adopt the above-mentioned collection frequency adjustment rule, or may be flexibly set by the user himself.
  • step 320 when the process of the terminal running in the terminal M1 or the cumulative M2 polling belongs to the process of the supervisory application, the security reminder to the terminal user can be implemented.
  • the terminal user in order to improve the accuracy of the control, it is also determined whether the terminal user currently focuses on the terminal, and a determination manner is shown in FIG. 4 .
  • step 410 the terminal user image on the front side of the terminal is collected by the image acquisition module of the terminal.
  • the image acquisition module may be a camera of the terminal, and may be a front camera of the terminal, or a rear camera that can rotate the front image of the collection terminal.
  • the front side of the terminal refers to a side of the terminal having a display screen. If the terminal has a display on both sides, it is the side of the currently used display.
  • step 420 it is analyzed whether there is a face in the image, and if present, the terminal user can be determined.
  • the current attention is placed on the terminal, and the terminal user can be alerted by the terminal.
  • the face detection method based on the Haar classifier method in OpenCV (Open Source Computer Vision) can be used to detect the face in the image.
  • OpenCV Open Source Computer Vision
  • the face detection algorithm provided in OpenCV can be easily used. Realize the detection of faces in the image.
  • the process currently running in the foreground of the terminal may be polled.
  • K1 or cumulative K2 polling the process is presumed to be the terminal.
  • the user may have been using the supervised application in the foreground of the terminal, and the terminal user may be alerted by the terminal.
  • K1 is larger than the corresponding M1
  • K2 is greater than the corresponding M2
  • K2 is set to be greater than or equal to K1.
  • K1 is set to 10 or 20 times
  • K2 is set to 30 times.
  • the supervised application in this embodiment may be an application that does not have to run an application and distracts the user's attention.
  • the end user can define the application type on the terminal according to his own needs, and add an application that is considered to be supervised.
  • the operator or the vendor or the software provider may also divide the corresponding application into a supervisory application according to some rules.
  • the supervisory application may be a social entertainment application, and the application belonging to the type may include but is not limited to multiple games and videos. , e-books and social software (QQ, WeChat or Weibo) and more.
  • the method for performing security reminding to the terminal user by the terminal may include any one or a combination of the following manners:
  • the reminder voice is played through the terminal.
  • the voice content can be: You are currently walking, please pay attention to walking safety, it is recommended not to use the terminal at present;
  • the terminal display interface is occluded, so that the terminal user cannot see the content in the display interface, thereby alerting the terminal user to pay attention;
  • the reminder floating window is displayed on the terminal display interface, and the floating window can prompt the user to pay attention to security in the form of text or animation, and can provide an interactive interface (such as a button) for interacting with the user, and the user sends a confirmation command through the interactive interface.
  • the floating window can be closed;
  • Custom reminders can also be provided to allow users to set their own security reminders to enhance the user experience.
  • the collection of the motion data performed during the monitoring process, the judgment of the foreground application, the collection of the image data, and the reminder to the terminal user may all be performed while the terminal remains bright. If the terminal is turned from a bright screen to a blank screen, it indicates that the terminal user does not currently use the terminal, and the terminal user's attention is generally not on the terminal. At this time, the collection of motion data, the judgment of the terminal foreground application type, and the security of the terminal user can be stopped. Remind, and clear the data collected before and the results of the analysis to improve the intelligence of management and reduce the resource consumption of the terminal.
  • Embodiment 2 is a diagrammatic representation of Embodiment 1:
  • the embodiment provides a terminal user security monitoring device.
  • the embodiment includes a motion mode determining module 1, an application type determining module 2, and an alarm module 3.
  • the motion mode judging module 1 is configured to judge whether the terminal is in a monitoring motion mode requiring safety monitoring according to the motion data of the terminal.
  • the motion mode judging module 1 in this embodiment can be used as a background monitoring process, and can be started with the startup of the terminal.
  • the application type judging module 2 is configured to determine whether the application currently running in the foreground of the terminal belongs to a preset supervisory application when determining that the terminal is in the monitoring motion mode.
  • the application type judging module 2 in this embodiment can be used as an active monitoring process, and can be in a sleep state after the terminal is started and initialized, and the notification of the motion mode judging module 1 is activated from the sleep state.
  • the alarm module 3 is configured to perform a security reminder to the terminal user through the terminal when the application type determining module 2 determines that the currently running application belongs to the preset supervisory application.
  • the motion mode determining module 1 in this embodiment includes: a detecting submodule 11, an acquiring control submodule 12, and a motion data analyzing submodule 13.
  • the detection sub-module 11 is arranged to detect that the terminal is bright.
  • the bright state of the terminal indicates that the current attention of the terminal user may be concentrated on the terminal, and detecting the bright screen of the terminal may improve the accuracy of the control.
  • the embodiment may further determine whether the duration of the bright screen of the terminal is greater than a preset brightness time threshold after detecting that the terminal is bright. 2 seconds or 3 seconds, etc.), in judging that the duration of the bright screen of the terminal is greater than the preset brightness time threshold The subsequent steps can be carried out to exclude the end user from simply lighting the screen viewing time, thereby improving the accuracy of the control.
  • the acquisition control sub-module 12 is configured to control the motion data acquisition module of the terminal to collect the motion data of the terminal in the collection period according to the current acquisition frequency.
  • the motion data collection module in this embodiment may be a function module for realizing terminal motion data collection, for example, may be implemented by a gravity sensing sensor of the terminal, or may be implemented by using a terminal three-axis acceleration sensor, a motion coprocessor, and an application to the terminal. Sensor for motion data acquisition.
  • the collection of motion data and subsequent determinations can be implemented in combination with two or more of the above sensors.
  • the motion data analysis sub-module 13 is arranged to analyze whether the terminal is in the monitoring motion mode based on the motion data.
  • a time stamp may be added in each collected motion data.
  • the collection period can be controlled by the acquisition start command and the acquisition stop command.
  • the motion data collection module can be completed by using the motion data collection module of the terminal itself. Therefore, in order to ensure the normal execution of the control process, after the terminal is started, the acquisition control sub-module 12 realizes whether the motion data collection module of the terminal is normal. Run the test and save the test results. When the data is used, it can be known from the detection result whether there is an available motion data acquisition module and which motion data acquisition module is used. If the motion data acquisition module of the terminal in the detection result cannot be normally operated, the user may be promptly reminded to perform repair settings.
  • the process of the motion data analysis sub-module 13 analyzing whether the terminal is in the monitoring motion mode according to the motion data may include:
  • n is greater than or equal to the preset number of times threshold N. If n is greater than or equal to N, the terminal is determined to be in the monitoring motion mode; if n is less than N, the analysis is performed within the subsequent collection period. Motion data;
  • the frequency adjustment rule in this embodiment may be flexibly set by the manufacturer or the user according to the application scenario.
  • the initial setting can be set to 15 times in 1 second.
  • the The set frequency is adjusted to 14 times in 1 second. According to this rule, if the result is not matched every time, the acquisition frequency is reduced by 1 time every 1 second until it is reduced to the lowest 1 second 10 times. When the judgment result is a match, the acquisition frequency can be immediately restored to the initial 1 second 15 times.
  • the following is an example of the motion data collected by the gravity sensing sensor.
  • the motion data analysis sub-module 13 performs feature extraction on the extracted time-stamped sample motion data.
  • the characteristics of the walking state of different people in different environments are not completely the same.
  • the data acquired by the gravity sensing sensor may include the acceleration components a X , a Y , a Z of the mobile phone in the three directions of coordinates X, Y, and Z , according to Calculate the acceleration at that moment, and remove the noise of the acceleration at that moment by the fast Fourier transform, and obtain the change of the acceleration over a period of time, extract the characteristics of the acceleration during this period, and the motion state (such as walking) The characteristics are compared to determine whether the current motion mode of the terminal belongs to a preset motion state.
  • the feature values of walking movements of different people at different speeds in different environments may be extracted in advance, and the feature library for matching comparison is enriched.
  • a method for analyzing data of a gravity sensing sensor may be employed, and a method for analyzing data of the gravity sensing sensor and matching the walking state by software may be used.
  • the value of the number n of the current continuous determination result may be greater than or equal to 2, and the value range of n may be flexibly set according to application scenarios such as different terminal users or different terminals.
  • n is greater than or equal to 2
  • the acquisition frequency may be decreased according to the preset frequency increment. Reducing the frequency of motion data collection can save resources.
  • the monitoring motion mode (such as the walking mode) is not the normal state of the terminal, and the terminal is in such a motion mode time is relatively short, so increasing the acquisition frequency here can reduce the power consumption of the terminal itself.
  • the application type judging module 2 in this embodiment may include a polling submodule 21 and a judging submodule 22.
  • the polling sub-module 21 is set to perform a round of the currently running process of the terminal foreground according to the preset polling frequency. Inquiry.
  • the judging sub-module 22 is configured to determine that the application currently running in the foreground of the terminal belongs to a preset supervisory application when the process of the foreground running of the terminal belongs to the process of the supervised application in a continuous M1 or cumulative M2 polling process. .
  • the number of times M2 is greater than or equal to M1, and M1 and M2 can be flexibly set by the manufacturer or the user according to requirements. For example, if M1 is set to 2 or 3 times, M2 is set to 4 or 5 times.
  • the polling frequency can be adjusted according to certain rules to reduce the number of polling and reduce resource consumption.
  • the rule may adopt the above-mentioned collection frequency adjustment rule, or may be flexibly set by the user himself.
  • the judging sub-module 22 can realize the security reminder to the end user when the process of the terminal running in the terminal M1 or the cumulative M2 polling to the terminal belongs to the process of the supervisory application. In this embodiment, in order to improve the accuracy of the control, it is also determined whether the terminal user currently focuses on the terminal.
  • the terminal user security monitoring apparatus in this embodiment may further include: an image acquisition control module 4 and an image analysis module 5.
  • the image acquisition control module 4 is configured to: after determining whether the application currently running in the foreground of the terminal belongs to the preset supervisory application, before the terminal performs the security reminder to the terminal user, the image acquisition module of the control terminal collects the image of the middle terminal user on the front side of the terminal.
  • the image acquisition module used in this embodiment may be a camera of the terminal, and may be a front camera of the terminal, or a rear camera that can rotate the front image of the terminal.
  • the front side of the terminal refers to a side of the terminal having a display screen. If the terminal has a display on both sides, it is the side of the currently used display.
  • the image analysis module 5 is configured to analyze whether there is a face in the image, and if present, notify the alarm module 3 to perform a security reminder to the terminal user.
  • the end user security monitoring device in this embodiment further includes Ask module 6.
  • the reconciliation module 6 is configured to poll the process currently running in the foreground of the terminal when there is no human face in the image, and the process running in the foreground of the terminal is consecutive K1 or cumulative K2 polling belongs to the supervision.
  • K1 is greater than the corresponding M1
  • K2 is greater than the corresponding M2. For example, set K1 to 20 times and K2 to 40 times.
  • the supervised application in this embodiment may be an application that does not have to run an application and distracts the user's attention.
  • the end user can define the application type on the terminal according to his own needs, and add an application that is considered to be supervised.
  • the operator or the vendor or the software provider may also divide the corresponding application into a supervisory application according to some rules.
  • the supervisory application may be a social entertainment application, and the application belonging to the type may include but is not limited to multiple games and videos. , e-books and social software (QQ, WeChat or Weibo) and more.
  • the manner in which the alarm module 3 performs security reminding to the terminal user through the terminal may include any one or a combination of the following manners:
  • the reminder voice is played through the terminal.
  • the voice content can be: You are currently walking, please pay attention to walking safety, it is recommended not to use the terminal at present;
  • the terminal display interface is occluded, so that the terminal user cannot see the content in the display interface, thereby alerting the terminal user to pay attention;
  • the reminder floating window is displayed on the terminal display interface, and the floating window can prompt the user to pay attention to security in the form of text or animation, and can provide an interactive interface (such as a button) for interacting with the user, and the user sends a confirmation command through the interactive interface.
  • the floating window can be closed;
  • the above methods can be set in the terminal for the user to select and combine.
  • a custom reminder is also available to allow users to set their own security reminders to enhance the user experience.
  • the collection of the motion data performed during the monitoring process, the judgment of the foreground application, the collection of the image data, and the reminder to the terminal user may all be performed while the terminal remains bright. If the terminal is turned from a bright screen to a blank screen, it indicates that the terminal user does not currently use the terminal, and the attention of the terminal user is generally not at the terminal. At this time, the motion data collection can be stopped by the screen-out control module, and the terminal foreground application type is judged and The security reminder for the end user, and clear the previously collected data and the analysis result, improve the intelligence of management, and reduce the resource consumption of the terminal.
  • Embodiment 3 is a diagrammatic representation of Embodiment 3
  • the terminal is a mobile phone
  • the monitoring motion mode is a walking mode
  • the supervisory application is a social entertainment software as an example, and the disclosure is described.
  • the motion mode determining module starts to work, and sends a self-test command to the motion data collecting module.
  • the motion data acquisition module receives the self-test command to detect the gravity sensing sensor of the mobile device. The detection of the gravity sensing sensor ensures that the sensor can work normally, and the motion data acquisition module feeds back the detection result to the background monitoring process.
  • the motion mode judging module receives the device detection result of the motion data collection module. If the device is abnormal, the mobile phone user cannot detect whether the mobile phone user is in a walking state, the motion mode judging module can exit, the system is closed, and the user can be reminded to repair. When the device detection result is normal, the motion mode determination module monitors the mobile phone screen lighting event and the screen extinguishing event.
  • step 830 the phone screen lighting event is monitored.
  • the motion mode determination module monitors that the mobile phone screen is lit, the time of lighting is recorded. If there is no occurrence of the mobile phone screen extinguishing event within 5 seconds, then in step 840, the acquisition control sub-module of the motion mode determination module is The motion data acquisition module sends an acquisition command.
  • the 5 second delay can be adjusted in the system design. The delay can filter out the situation where the mobile phone screen is turned off and the mobile phone screen is turned off in a short time. For example, the mobile phone user can see the time on the screen, and then the screen is displayed. operating.
  • the motion data collection module can collect the data of the gravity sensing sensor at the acquisition frequency of 20 times per second during the collection period, and time stamp each data while collecting. And store the record.
  • the acquisition control sub-module of the motion mode judging module delays 5 seconds after the transmission of the acquisition command (the acquisition period is 5 seconds), sends a stop command to the motion data acquisition module, and also sends an analysis command to the motion data analysis sub-module.
  • a delay of 5 seconds allows the motion data acquisition module to collect data for a certain amount of time for analysis.
  • the motion data acquisition module After the motion data acquisition module receives the stop command, the data collection of the gravity sensing sensor is stopped. After the motion data analysis sub-module receives the analysis command sent after the motion data acquisition module, the data stored and recorded in the motion data acquisition module can be extracted. The motion data acquisition module has stopped collecting and will not generate new data. The motion data analysis sub-module performs feature extraction on the extracted time-stamped sample data. The characteristics of the walking state of different people in different environments are not completely the same.
  • the data acquired by the gravity sensing sensor includes the acceleration components a X , a Y , a Z of the mobile phone in the three directions of coordinates X, Y, and Z , respectively.
  • a method for analyzing data of a gravity sensing sensor may be employed, and a method for analyzing data of the gravity sensing sensor and matching the walking state by software may be used.
  • the motion data analysis sub-module feeds back the analysis result to the motion mode judgment module.
  • the motion mode judging module performs subsequent operations according to the result, and records the number of consecutive occurrences of the same result. If the result of the feedback is in a walking state, the collection command may be sent to the motion data collection module for data collection. If the feedback result does not meet the walking state, the acquisition command is sent after a certain delay, but each time the acquisition command is sent, the delay is delayed. After 5 seconds, the stop command is sent to the motion data acquisition module. The motion data acquisition cycle is 5 seconds to ensure that enough data can be collected for analysis. An analysis command is sent to the motion data analysis module to analyze the motion data collected during the acquisition period (5 seconds).
  • the motion mode determining module sends a wake-up command to the application type judging module. . If the current feedback result is not in a walking state, the mobile phone user may be in a non-moving state, or in a moving state but not in a walking state, and the acquisition frequency of the gravity sensor data may be appropriately reduced.
  • the method of reducing the acquisition frequency can also be implemented by extending the trigger period for triggering the collection of the gravity sensing sensor data, and stepping the triggering period to reduce the load caused by the data acquisition and analysis.
  • the acquisition and analysis of motion data once.
  • the number of times of motion data acquisition can be reduced step by step by the above control of the trigger period.
  • the acquisition frequency in the above collection period can also be reduced.
  • the acquisition period is fixed to 5 seconds, that is, after every trigger period, 5 seconds of motion data acquisition is performed.
  • the acquisition frequency is set to 1 second and 20 times in the acquisition period (5 seconds).
  • the acquisition frequency is reduced by 2 times, that is, if the continuous feedback is 3 times, the non-walking state, the subsequent collection period ( The acquisition frequency within 5 seconds is reduced to 14 times 1 second. If the subsequent feedback is still non-walking, you can continue to reduce the acquisition frequency until the acquisition frequency reaches the set minimum value of 1 second 10 times. During this period, once the feedback is in the walking state, the acquisition frequency is restored to the initial value of 1 second 20 times.
  • the above acquisition frequency and its adjustment rules can be flexibly set according to the application scenario.
  • step 880 when the motion mode judging module listens to the screen of the mobile phone screen, there is a switch of the screen of the mobile phone from the screen to the screen state. At this time, the system can think that the line of sight of the user of the mobile phone is not in the state of the screen. The phone is attracted. Even if it is in a walking state, there is no phenomenon that personal safety occurs due to the line of sight staying on the screen of the mobile phone. Therefore, in step 890 and step 8100, the acquisition control sub-module of the motion mode determination module sends a stop command to the motion data acquisition module. And the motion data analysis sub-module, step 8110 is executed to send a sleep command to the application type judging module.
  • the motion data acquisition module and the motion data analysis submodule When the motion data acquisition module and the motion data analysis submodule receive the stop command, if the acquisition module and the motion data analysis submodule are in the working state, they will immediately stop working and clear their own data, if the acquisition module and the motion data analysis submodule If it is in a stopped state, you can not make an action on the stop command.
  • FIG. 9 is a schematic diagram of the workflow of the application type judging module. After the mobile phone is started, step 910 is executed, and the application type judging module starts working. After the application type judging module is started, step 920 is executed to send a detection command to the image acquisition module through the image acquisition control module.
  • the image acquisition module After receiving the detection command, the image acquisition module detects whether the front camera of the mobile phone can work normally, and feeds the detection result to the application type judgment module.
  • the application type judgment module After receiving the device detection result fed back by the image acquisition module, the application type judgment module records the result and actively enters a sleep state.
  • step 930 When the step 930 is executed, that is, after the application type judging module receives the wake-up command sent by the motion mode judging module, the application type judging module enters the working state, and step 940 is executed to poll the current type of the foreground work process of the mobile phone at a certain time interval. . If the process belongs to social entertainment software, the number of query hits is increased by one, and the number of consecutive query hits is increased by one. If the process is not part of the social entertainment class, the number of consecutive query hits is set to zero. The application type judging module may actively adjust the polling time according to the type of the current foreground work process that is queried, if the process does not belong to the social entertainment category.
  • the polling time interval can be adjusted to 3 seconds to speed up the judgment of user behavior.
  • the main purpose of social entertainment software is social or entertainment. Such software requires users to interact with or focus more on the screen of the mobile phone during use, so the user's attention is focused on walking. The interaction with the software makes it impossible to notice changes in the surrounding environment, which in turn poses a potential personal danger.
  • the social entertainment software may include game software, video playing software, WeChat, Weibo, mobile QQ and e-book software in the mobile phone.
  • step 950 is executed to send an acquisition command to the image acquisition module, so that the system senses Social entertainment software has been working as a front-end mobile phone for some time. Face detection can be performed to determine whether the user's line of sight is attracted by social entertainment software.
  • the application type judging module is started, the detection command is sent to the image collection module, and the detection result of the device is recorded. If the device detects an abnormality, the collection command may not be sent to the image acquisition module.
  • the image acquisition module may start the front camera of the mobile phone to collect an image, store the image as a bmp format, and feed back the collection result to the application type judgment module.
  • step 960 is executed to send an analysis command to the image analysis module. If the feedback result is an acquisition failure, the application type judging module can start the mobile phone. Polling of the current foreground worker process type.
  • the image analysis module may analyze the image collected by the image acquisition module through the front camera of the mobile phone. Through analysis, it is possible to detect whether an image conforming to the face feature can be found in the image, and determine whether the user of the mobile phone stays on the screen of the mobile phone at the time when the front camera collects the image.
  • the application type judging module receives the analysis result fed back by the image analysis module. If the human face can be detected, the user of the mobile phone satisfies the following state, that is, the mobile phone screen is lit, the mobile phone user is in a walking state, and the mobile phone is currently in the foreground.
  • the work process is a social entertainment software, the mobile phone user's line of sight stays on the mobile phone screen, and the application type judgment module determines that the current behavior of the mobile phone user is at risk of personal safety.
  • a blocking message is sent to the alarm module.
  • the process application type judgment module may be actively monitored for polling detection.
  • the application type judging module When the application type judging module performs polling, the number of hits of the social entertainment software query recorded by itself may be checked. If the number of times is greater than a certain value, for example, more than 20 times, the application type judging module may send an alarm message to the alarm module.
  • the method of querying the number of hits can improve the fault tolerance rate detected by the system. Because the face detection in the image has certain requirements on the quality of the image itself, the imaging effect of the image captured by the front camera of the mobile phone has a great relationship with the illumination intensity of the current scene, so the captured image does not necessarily detect the face. At the same time, an image acquisition is performed at one moment.
  • step 970 is executed to send an alarm message to the alarm module.
  • an image acquisition module and an image analysis module are used. These two modules are optional modules in the mobile phone behavior monitoring and guarding system, so when there is no image acquisition and image analysis module in the instance, the application type judgment module is on the flow.
  • the processing can determine whether to send an alarm message to the alarm module by checking whether the number of hits of the social entertainment software query recorded by the self-recording exceeds the set value at each polling, so that the mobile phone behavior monitoring system does not depend on the image acquisition module and Image analysis module.
  • the application type judging module receives the hibernation command, and performs step 990, step 9100, and step 9110, stops the polling of the current foreground work process type of the mobile phone, sends a stop command to the image acquisition module, and sends a stop command.
  • the application type judgment module enters a sleep state.
  • the image acquisition module receives the stop command, such as controlling the front camera of the mobile phone to perform image acquisition, then stops the operation and clears the stored image.
  • the image analysis module receives the stop command, and if the face detection of the image is performed, the operation is stopped.
  • Step 1000 is a flow chart of interaction between a motion mode determination module, an application type determination module, and an alarm module.
  • Step 1000 represents all processing performed by the motion mode determination module.
  • the motion mode judging module may send a wake-up command to the application type judging module after obtaining the motion data analysis module feedback for the current two walking states.
  • the motion mode judging module may send a sleep command to the application type judging module after monitoring the cell phone blanking event.
  • Step 1001 represents all processing performed by the application type judging module.
  • the application type judging module may be in a dormant state at this time. Stop sleeping and enter the working state. If it is already working, it will not do anything to wake up the command.
  • the application type determining module stops the operation of the application type determining module itself and the image capturing module and the image analyzing module managed by the application, and clears the data retained by itself and enters the sleep state.
  • the application type judging module may send a blocking command to the alarm module, and the application type judging module stops the query and clears the number of query hits and the number of consecutive hits.
  • the application type judging module finds that the number of hits of the social entertainment software query exceeds the limit during the polling, and may send an alarm command to the alarm module, and the application type judging module stops the query and clears the number of hits and the number of consecutive hits.
  • Step 1002 represents alarm processing performed by the alarm module.
  • the alarm module can use the opaque alarm picture to cover the top screen of the mobile phone for 7 seconds, and send a floating window message after 7 seconds to remind the mobile phone user not to use the social entertainment class when walking. Software, and the mobile phone user can interact with this floating window message, such as clicking the confirmation button of the message window.
  • the alarm module uses the opaque alarm picture to cover the top screen of the mobile phone for 7 seconds, cancels the picture occlusion after 7 seconds, and sends the processed message to the application type judgment module.
  • the alarm module After receiving the alarm command of the application type judgment module, the alarm module sends a floating window message to remind the mobile phone user not to use the social entertainment software while walking, and the mobile phone user can interact with the floating window message, for example, After clicking the confirmation button of the message window, the alarm module can send the processed message to the application type judging module after receiving the return event of the floating window message.
  • the application type judging module can automatically enter the sleep state.
  • An advantage of the present disclosure is that the entire monitoring process is completely transparent to the user as long as the user is not using the social entertainment software in a walking state.
  • the use of the monitoring daemon system does not require mobile phone networking, ie if the mobile phone is in a bad signal or there is no cell phone signal, the system can work normally.
  • modules or steps of the present disclosure may be implemented by a general-purpose computing device, which may be centralized on a single computing device or distributed over a network of multiple computing devices, optionally they may be executable by a computing device
  • the program code is implemented, and can be stored in a storage medium (Read-only Memory (ROM), Random-Access Memory (RAM), disk, optical disk) by a computing device.
  • ROM Read-only Memory
  • RAM Random-Access Memory
  • disk optical disk
  • the steps shown or described are performed sequentially, or they are separately fabricated into a plurality of integrated circuit modules, or a plurality of the modules or steps are fabricated as a single integrated circuit module.
  • Embodiments of the present disclosure also provide a non-transitory computer readable storage medium storing computer executable instructions arranged to perform any of the methods described above.
  • the embodiment of the present disclosure further provides a hardware structure diagram of a terminal.
  • the terminal includes:
  • At least one processor 1101, one processor 1101 is exemplified in FIG. 11; and a memory 1102 may further include a communication interface 1103 and a bus 1104.
  • the processor 1101, the communication interface 1103, and the memory 1102 can complete communication with each other through the bus 1104.
  • Communication interface 1103 can be used for information transmission.
  • the processor 1101 can call logic instructions in the memory 1102 to perform the above method.
  • logic instructions in the memory 1102 described above may be implemented in the form of a software functional unit and sold or used as a stand-alone product, and may be stored in a computer readable storage medium.
  • the memory 1102 is a computer readable storage medium and can be used to store software programs, computer executable programs, program instructions or modules corresponding to the methods in the embodiments of the present disclosure.
  • the processor 1101 performs functional applications and data processing by running software programs, instructions or modules stored in the memory 1102.
  • the memory 1102 may include a storage program area and a storage data area, wherein the storage program area may store an operating system, an application required for at least one function; the storage data area may store data created according to usage of the terminal, and the like. Further, the memory 1102 may include a high speed random access memory, and may also include a nonvolatile memory.
  • the technical solution of the present disclosure may be embodied in the form of a software product stored in a storage medium, including one or more instructions for causing a computer device (which may be a personal computer, a server, a network device, etc.) Performing all or part of the steps of the method of the embodiments of the present disclosure.
  • the foregoing storage medium may be a non-transitory storage medium, including: a U disk, a mobile hard disk, a ROM, a RAM, a magnetic disk, or an optical disk, and the like, and may be a temporary storage medium.
  • the terminal user security monitoring method and device provided by the disclosure avoids the end user being dispersed Attention and neglect of external environmental changes, which may lead to personal safety accidents, ensure the personal safety of end users and enhance the user experience.

Abstract

一种终端用户安全装置监控方法及装置，根据终端的运动数据判断终端是否处于需要进行安全监护的监护运动模式（110）；当终端处于监护运动模式时，判断终端前台当前运行的应用是否属于预设的监管型应用（120）；如果当前运行的应用属于监管型应用，通过终端对终端用户进行安全提醒（130）。

Description

终端用户安全监护方法及装置 技术领域
本公开涉及智能终端领域，例如涉及一种终端用户安全监护方法及装置。
背景技术
随着科技的发展，智能手机等智能移动终端已经取代传统个人计算机(Personal Computer，PC)进入了人们娱乐、生活的方方面面，手机的可移动性这一优势，促使人们更频繁的使用手机，因此也诞生了低头族这个新名词，即在街道上行走时，人们还是一直低头使用手机刷微博和微信、看视频、看电子书或者打游戏等。人们把注意力完全集中在手机上，无法留意到周围环境的改变，因此可能带来人身安全上的隐患，比如经常能看到边走路边看手机的人掉到坑里或者被车撞到等新闻。因此如何对终端用户在不安全的环境下使用终端存在的安全隐患进行及时提醒，以避免出现人身安全事故是亟需解决的问题。
发明内容
本公开提供一种终端用户安全监护方法及装置，减少终端用户在不安全环境下使用终端忽略环境变化而可能导致人身安全事故发生的现象。
本公开提供一种终端用户安全监护方法，包括：
根据终端的运动数据判断所述终端是否处于需要进行安全监护的监护运动模式；
如所述终端处于所述监护运动模式，判断所述终端前台当前运行的应用是否属于预设的监管型应用；以及
如所述当前运行的应用属于预设的监管型应用，通过所述终端对终端用户进行安全提醒。
在本公开的一种实施例中，根据终端的运动数据判断所述终端是否处于所述监护运动模式包括：
检测到所述终端亮屏；
通过所述终端的运动数据采集模块按当前的采集频率在采集周期内采集所 述终端的运动数据；以及
根据所述运动数据分析所述终端是否处于所述监护运动模式。
在本公开的一种实施例中，检测到所述终端亮屏后，通过所述终端的运动数据采集模块采集所述运动数据之前，所述方法还包括：
判断所述终端亮屏的持续时间是否大于预设的亮屏时间阈值。
在本公开的一种实施例中，根据所述运动数据分析所述终端是否处于所述监护运动模式包括：
根据当前采集周期内的运动数据分析所述终端当前的运动模式是否与所述监护运动模式匹配；
如匹配，判断当前连续判断结果为是的次数n是否大于或等于预设次数阈值N，如n大于或等于N，则判定所述终端处于所述监护运动模式；如n小于N，则继续分析后面采集周期内的运动数据；以及
如不匹配，按预设频率调整规则降低所述采集频率。
在本公开的一种实施例中，所述方法还包括：当检测到所述终端由亮屏变为熄屏时，停止所述运动数据的采集、终端前台应用类型的判断以及对终端用户的安全提醒。
在本公开的一种实施例中，判断所述终端前台当前运行的应用是否属于预设的监管型应用包括：
按预设轮询频率对所述终端前台当前运行的进程进行轮询；以及
当连续M1次或累计M2次轮询到所述终端前台运行的进程属于所述监管型应用的进程时，判定所述终端前台当前运行的应用属于预设的监管型应用，所述M2大于或等于所述M1。
在本公开的一种实施例中，判断所述终端前台当前运行的应用是否属于预设的监管型应用后，通过所述终端对终端用户进行安全提醒之前，所述方法还包括：
通过所述终端的图像采集模块采集终端正面的终端用户图像；以及
分析所述图像中是否存在人脸，如存在，通过所述终端对终端用户进行安全提醒。
在本公开的一种实施例中，所述方法还包括，所述图像中不存在人脸时，对所述终端前台当前运行的进程进行轮询，当连续K1次或累计K2次轮询到所述终端前台运行的进程属于所述监管型应用的进程时，通过所述终端对终端用户进行安全提醒，其中，所述K1大于所述M1，所述K2大于所述M2，且所述K2大于所述K1。
在本公开的一种实施例中，通过所述终端对终端用户进行安全提醒包括以下方式中的至少一种：
通过所述终端播放提醒语音；
将所述终端显示界面进行遮挡；
在所述终端显示界面上显示提醒悬浮窗口；以及
暂停或关闭所述终端前台当前运行的应用。
在本公开的一种实施例中，所述监护运动模式为步行模式。
在本公开的一种实施例中，所述监管型应用为社交娱乐类应用。
为了解决上述问题，本公开还提供了一种终端用户安全监护装置，包括：
运动模式判断模块，设置为根据终端的运动数据判断所述终端是否处于需要进行安全监护的监护运动模式；
应用类型判断模块，设置为在所述终端处于所述监护运动模式时，判断所述终端前台当前运行的应用是否属于预设的监管型应用；以及
告警模块，设置为在所述应用类型判断模块判断所述当前运行的应用属于预设的监管型应用时，通过所述终端对终端用户进行安全提醒。
在本公开的一种实施例中，所述运动模式判断模块包括：
检测子模块，设置为检测到所述终端亮屏；
采集控制子模块，设置为控制所述终端的运动数据采集模块按当前的采集频率在采集周期内采集所述终端的运动数据；以及
运动数据分析子模块，设置为根据所述运动数据分析所述终端是否处于所述监护运动模式。
在本公开的一种实施例中，所述应用类型判断模块包括：
轮询子模块，设置为按预设轮询频率对所述终端前台当前运行的进程进行轮询；以及
判断子模块，设置为当连续M1次或累计M2次轮询到所述终端前台运行的进程属于所述监管型应用的进程时，判定所述终端前台当前运行的应用属于预设的监管型应用，所述M2大于或等于所述M1。
在本公开的一种实施例中，所述装置还包括：图像采集控制模块，设置为在判断所述终端前台当前运行的应用是否属于预设的监管型应用后，通过所述终端对终端用户进行安全提醒之前，控制所述终端的图像采集模块采集终端正面的终端用户图像；以及
图像分析模块，设置为分析所述图像中是否存在人脸，如存在，通知所述告警模块对所述终端用户进行安全提醒。
在本公开的一种实施例中，所述装置还包括补询模块，设置为在所述图像中不存在人脸时，对所述终端前台当前运行的进程进行轮询，当连续K1次或累计K2次轮询到所述终端前台运行的进程属于所述监管型应用的进程时，通知所述告警模块对所述终端用户进行安全提醒；其中，所述K1大于所述M1，所述K2大于所述M2，且所述K2大于所述K1。本公开还提供了一种非暂态计算机可读存储介质，存储有计算机可执行指令，所述计算机可执行指令设置为执行上述方法。
本公开还提供了一种终端，包括：
至少一个处理器；以及
与所述至少一个处理器通信连接的存储器；其中，
所述存储器存储有可被所述至少一个处理器执行的指令，所述指令被所述至少一个处理器执行，以使所述至少一个处理器执行上述方法。
本公开提供的终端用户安全监护方法及装置，在终端使用过程中，可以根据终端的运动数据判断终端是否处于需要进行安全监护的监护运动模式，也即判断用户当前使用终端是否会存在潜在的安全隐患，例如处于步行模式；当判断终端处于监护运动模式时，判断终端前台当前运行的应用是否属于预设的监管型应用(例如游戏、视频、电子书、网页或者社交软件等)，如果终端前台当前运行的应用属于预设的监管型应用，则表明终端用户当前可能在将注意力集 中在终端上，此时通过终端对终端用户进行安全提醒，以避免终端用户因分散注意力而忽略外部环境变化，可能导致人身安全事故发生的现象，确保终端用户的人身安全，提升用户体验。
附图说明
图1为本公开实施例一提供的终端用户安全监护方法流程示意图；
图2为本公开实施例一提供的判断终端是否处于监护运动模式流程示意图；
图3为本公开实施例一提供的判断前台当前运行的应用是否属于预设的监管型应用流程示意图；
图4为本公开实施例一提供的图像采集分析过程流程示意图；
图5为本公开实施例二提供的终端用户安全监护装置结构示意图一；
图6为本公开实施例二提供的终端用户安全监护装置结构示意图二；
图7为本公开实施例二提供的终端用户安全监护装置结构示意图三；
图8为本公开实施例三提供的运动模式判断模块工作过程示意图；
图9为本公开实施例三提供的应用类型判断模块工作过程示意图；
图10为本公开实施例三提供的监控系统结构示意图；以及
图11为本公开实施例五提供的终端的硬件结构示意图。
具体实施方式
在不冲突的情况下，以下实施例以及实施例中的特征可以相互任意组合。
本公开在终端使用过程中，可以根据终端的运动数据判断终端是否处于需要进行安全监护的监护运动模式，例如处于步行模式；当判断终端处于监护运动模式时，判断终端前台当前运行的应用是否属于预设的监管型应用(例如游戏、视频等)，如果是，此时通过终端对终端用户进行安全提醒，确保终端用户的人身安全，提升用户体验。下面通过具体实施方式结合附图对本公开作详细说明。
图1为本实施例提供的终端用户安全监护方法。
在步骤110中，根据终端的运动数据判断终端是否处于需要进行安全监护 的监护运动模式，如是，转至步骤120；如不是，执行步骤110。
在步骤120中，判断终端前台当前运行的应用是否属于预设的监管型应用，如是，转至步骤130；如不是，执行步骤120。
在步骤130中，通过终端对终端用户进行安全提醒。
终端一般是用户随身携带且随用户运动，因此终端所处的运动模式能够体现终端用户所处的运动模式。而本实施例中的监护运动模式可根据用户需求由制造商或终端用户灵活设定。本实施例中可以设置该监护运动模式为步行模式，可以根据终端的运动数据分析终端当前的运动模式是否与步行模式匹配。
本实施例中，根据终端的运动数据判断终端是否处于监护运动模式请参见图2所示。
在步骤210中，检测到终端亮屏。终端处于亮屏状态可以表明终端用户当前的注意力可能集中于终端，检测终端亮屏可以提升控制的准确性。为了避免终端用户点亮终端屏幕后在短时间内就立即关闭的情况，本实施例还可在检测到终端亮屏后，判断终端亮屏的持续时间是否大于预设的亮屏时间阈值(例如2秒或3秒等)，在判断终端亮屏的持续时间大于预设的亮屏时间阈值时可以进行后续的步骤，将终端用户只是点亮屏幕查看时间等情况排除在外，提升了控制的准确性。
在步骤220中，通过终端的运动数据采集模块按当前的采集频率在采集周期内采集所述终端的运动数据。
在步骤230中，根据得到的运动数据分析终端是否处于所述监护运动模式。
上述步骤220中所采用的运动数据采集模块可以实现终端运动数据采集的功能模块，例如运动数据采集模块可以是终端的重力感应传感器，也可以是终端的三轴加速传感器、运动协处理器以及应用到终端中进行运动数据采集的传感器。可以结合上述两个或两个以上的传感器实现运动数据的采集及后续的判断。
为了便于准确的统计和区分，本实施例中在每一次采集到的运动数据中可以增加时间戳。本实施例中采集周期可以通过采集开始命令和采集停止命令进行控制。
本实施例中，运动数据的采集可以利用终端自身的运动数据采集模块完成， 因此为了保证控制过程的正常进行，可在终端启动后，实现对终端的运动数据采集模块是否正常运行进行检测，并将检测结果进行保存。在使用数据时，可从该检测结果中得知是否存在可用的运动数据采集模块以及采用哪个运动数据采集模块。若检测结果中终端的运动数据采集模块都不能正常运行时，可及时提醒用户进行修复设置等。
本实施例中，根据运动数据分析终端是否处于监护运动模式的过程可以包括：
根据当前采集周期内的运动数据分析终端当前的运动模式是否与监护运动模式匹配；
如匹配，判断当前连续判断结果为是的次数n是否大于或等于预设次数阈值N，如n大于等于N，则判定终端处于监护运动模式；如n小于N，则分析后面采集周期内的运动数据；以及
如不匹配，按预设频率调整规则降低采集频率。
本实施例中的频率调整规则可以根据应用场景由厂家或用户自己灵活设定。例如初始可以设置为1秒中采集20次，当判断结果为不匹配时，则可将采集频率调整为1秒18次，按此规则每判断一次结果为不匹配，就将采集频率每1秒降低2次，直到降低为最低的1秒10次。在判断结果为匹配时，可将采集频率立即恢复为初始的1秒20次。
下面以重力感应传感器采集到的运动数据为例进行说明。
对提取出的带有时间戳的采样运动数据进行特征提取。不同人在不同环境下的步行状态的特征并不完全相同，根据重力感应传感器获取的数据可以包括手机在坐标X、Y、Z三轴方向上的加速度分量aX、aY、aZ，根据
Figure PCTCN2017072457-appb-000001
计算出该时刻的加速度，并通过快速傅里叶变换去除掉噪声，可以得到一段时间内加速度的变化，对这段时间内加速度的特征进行提取，与运动状态(例如步行)的特征进行比对，可判断终端当前的运动模式是否属于预设的运动状态。为了提高比对结果的准确性，可以预先提取不同人在不同环境下以不同速度进行步行运动的特征值，丰富用于匹配比对的特征库。在具体实施例中，可以采用对重力感应传感器数据分析的方法，能通过软件实现对重力感应传感器数据分析并匹配步行状态的方法均可使用。
本实施例中当前连续判断结果为是的次数n的取值可以大于或等于2，而n的取值范围可以根据不同终端用户或者不同终端等应用场景灵活设定。本实施例中n大于或等于2，在连续多次判定终端当前的运动模式与监护运动模式相匹配时，判定终端当前处于监护运动模式，例如步行模式，可以提升判断的准确率，避免发生误判从而生误告警，提升了用户的体验。
本实施例中当根据当前采集周期内的运动数据分析发现终端的运动模式与监护运动模式不匹配时，可以降低采集频率。降低运动数据采集的频率，可以节省资源的消耗。监护运动模式(例如步行模式)并不是终端的使用常态，终端处于这种运动模式时间会比较短，因此此处降低采集频率可以降低终端自身功耗。本实施例中，降低采集频率的规则也可以根据需求灵活设定。
本实施例中，判断终端前台当前运行的应用是否属于预设的监管型应用可以采用轮询的机制实现，请参见图3所示。
在步骤310中，按预设轮询频率对终端前台当前运行的进程进行轮询。
在步骤320中，当连续M1次或累计M2次轮询到终端前台运行的进程属于监管型应用的进程时，判定终端前台当前运行的应用属于预设的监管型应用。
本实施例中，M2大于或等于M1，M1和M2的次数可由厂商或用户根据需求灵活设定。例如设定M1为2次或3次，M2设定为4次或5次等。在轮询过程中，当轮询结果为终端前台运行的进程不属于监管型应用的进程时，可以按照一定的规则对轮询频率进行调整，以降低轮询次数，降低资源消耗。该规则可以采用上述采集频率调整规则，也可以由用户自己灵活设定。
本实施例中，在上述步骤320中连续M1次或累计M2次轮询到终端前台运行的进程属于监管型应用的进程时，可实现对终端用户的安全提醒。本实施例为了提升控制的准确性，还可确定终端用户当前是否将注意力集中在终端上，其中一种确定方式请参见图4。
在步骤410中，通过终端的图像采集模块采集终端正面的终端用户图像。
该图像采集模块可以是终端的摄像头，且可以是终端的前置摄像头，或可旋转采集终端正面图像的后置摄像头。本实施例中终端正面是指终端具有显示屏的一面。如果终端为双面都设有显示屏时，则为当前使用的显示屏的一面。
在步骤420中，分析图像中是否存在人脸，如存在，则可以确定终端用户 当前的注意力放在终端上，可以通过终端对终端用户进行安全提醒。
人脸识别中，检测在该图像中是否可以找到符合人脸特征的图像，判断在采集图像的时刻，终端用户是否将视线停留在终端屏幕上。在对人脸检测时，可以采用软件OpenCV(Open Source Computer Vision)中基于Haar分类器方法的人脸检测方法实现对图像中人脸的检测，通过OpenCV中提供的人脸检测算法，可以轻松的实现对图像中人脸的检测。
上述步骤420中，当分析结果为图像中不存在人脸时，此时可能是用户未将注意力集中于终端，但也有可能仅仅是在采集图像这一时刻用户未将注意力集中于终端，可以采用继续采集图像进行分析的方式判定用户是否将注意力集中于终端。也可以在上述轮询基础上，对终端前台当前运行的进程进行轮询，当连续K1次或累计K2次轮询到终端前台运行的进程属于所述监管型应用的进程时，此时推定终端用户可能当前一直在终端前台使用该监管型应用，可以通过终端对终端用户进行安全提醒。此处的K1大于上述对应的M1，K2大于上述对应的M2，且设定K2大于或等于K1。例如K1设置为10次或20次，以及K2设置为30次。
本实施例中的监管型应用可以是非必须要运行应用且会分散用户注意力的应用，终端用户可以根据自己需求对终端上的应用类型进行定义，将认为是需要进行监管的应用添加进来。运营商或厂商或软件提供方也可以根据一些规则将相应的应用划分为监管型应用，例如该监管型应用可以为社交娱乐类应用，属于该类型的应用可以包含但不限于多种游戏、视频、电子书以及社交软件(QQ、微信或者微博)等等。
本实施例中，通过终端对终端用户进行安全提醒的方式可以包含以下方式中的任意一种或多种的组合：
通过终端播放提醒语音，例如语音内容可为：您当前处于行走状态，请注意行走安全，建议当前不要使用终端；
将终端显示界面进行遮挡，这样终端用户就不能看到显示界面内的内容，从而提醒终端用户注意；
在终端显示界面上显示提醒悬浮窗口，该悬浮窗口可以文字或动画等形式提醒用户注意安全，并可提供与用户进行交互的交互接口(例如按钮)，用户通过该交互接口下发确认指令是，该悬浮窗口即可关闭；以及
暂停或关闭终端前台当前运行的应用，以此提醒用户注意行走安全。
对于以上方式都可以设置在终端中供用户选择和组合。也可提供自定义提醒方式让用户自己设定安全提醒的方式，提升用户体验。
如上分析，本实施例中，监护过程中进行的运动数据的采集、前台应用程序的判断、图像数据的采集以及对终端用户的提醒可以都在终端保持亮屏过程中进行。如果终端由亮屏转为熄屏了，则表明终端用户当前未使用终端，终端用户注意力一般不在终端上，此时可停止运动数据的采集、终端前台应用类型的判断以及对终端用户的安全提醒，并对之前采集的数据以及分析的结果清零，提升管理的智能性，减少终端的资源消耗。
实施例二：
本实施例提供了一种终端用户安全监护装置，请参见图5所示，包括：运动模式判断模块1、应用类型判断模块2和告警模块3。
运动模式判断模块1设置为根据终端的运动数据判断终端是否处于需要进行安全监护的监护运动模式。本实施例中的运动模式判断模块1可作为后台监控进程，可随终端的启动而启动。
应用类型判断模块2设置为在判断终端处于所述监护运动模式时，判断终端前台当前运行的应用是否属于预设的监管型应用。
本实施例中的应用类型判断模块2可作为主动监控进程，在终端启动以及初始化完成后可处于休眠状态，根据运动模式判断模块1的通知从休眠状态激活。
告警模块3设置为在应用类型判断模块2判断当前运行的应用属于预设的监管型应用时，通过终端对终端用户进行安全提醒。
可选的，本实施例中的运动模式判断模块1包括：检测子模块11、采集控制子模块12和运动数据分析子模块13。
检测子模块11设置为检测到所述终端亮屏。终端处于亮屏状态可以表明终端用户当前的注意力可能集中于终端，检测终端亮屏可以提升控制的准确性。为了避免终端用户点亮终端屏幕后在短时间内就立即关闭的情况，本实施例还可在检测到终端亮屏后，判断终端亮屏的持续时间是否大于预设的亮屏时间阈值(例如2秒或3秒等)，在判断终端亮屏的持续时间大于预设的亮屏时间阈值 时可以进行后续的步骤，将终端用户只是点亮屏幕查看时间等情况排除在外，提升了控制的准确性。
采集控制子模块12设置为控制终端的运动数据采集模块按当前的采集频率在采集周期内采集终端的运动数据。本实施例中的运动数据采集模块可以是实现终端运动数据采集的功能模块，例如可以是终端的重力感应传感器实现，也可以采用终端的三轴加速传感器、运动协处理器以及应用到终端中进行运动数据采集的传感器。可以结合上述两个或两个以上的传感器实现运动数据的采集及后续的判断。
运动数据分析子模块13设置为根据运动数据分析终端是否处于监护运动模式。
为了便于准确的统计和区分，本实施例中在每一次采集到的运动数据中可以增加时间戳。本实施例中采集周期可以通过采集开始命令和采集停止命令进行控制。
本实施例中，运动数据的采集可以利用终端自身的运动数据采集模块完成，因此为了保证控制过程的正常进行，可在终端启动后，采集控制子模块12实现对终端的运动数据采集模块是否正常运行进行检测，并将检测结果进行保存。在使用数据时，可从该检测结果中得知是否存在可用的运动数据采集模块以及采用哪个运动数据采集模块。若检测结果中终端的运动数据采集模块都不能正常运行时，可及时提醒用户进行修复设置等。
运动数据分析子模块13根据运动数据分析终端是否处于监护运动模式的过程可以包括：
根据当前采集周期内的运动数据分析终端当前的运动模式是否与监护运动模式匹配；
如匹配，判断当前连续判断结果为是的次数n是否大于或等于预设次数阈值N，如n大于或等于N，则判定终端处于监护运动模式；如n小于N，则分析后面采集周期内的运动数据；以及
如不匹配，按预设频率调整规则降低采集频率。
本实施例中的频率调整规则可以根据应用场景由厂家或用户自己灵活设定。例如初始可以设置为1秒中采集15次，当判断结果为不匹配时，则可将采 集频率调整为1秒14次，按此规则每判断一次结果为不匹配，就将采集频率每1秒降低1次，直到降低为最低的1秒10次。在判断结果为匹配时，可将采集频率立即恢复为初始的1秒15次。
下面以重力感应传感器采集到的运动数据为例进行说明。
运动数据分析子模块13对提取出的带有时间戳的采样运动数据进行特征提取。不同人在不同环境下的步行状态的特征并不完全相同，根据重力感应传感器获取的数据可以包括手机在坐标X、Y、Z三轴方向上的加速度分量aX、aY、aZ，根据
Figure PCTCN2017072457-appb-000002
计算出该时刻的加速度，并通过快速傅里叶变换去除掉该时刻的加速度的噪声，可以得到一段时间内加速度的变化，对这段时间内加速度的特征进行提取，与运动状态(例如步行)的特征进行比对，可判断终端当前的运动模式是否属于预设的运动状态。为了提高比对结果的准确性，可以预先提取不同人在不同环境下以不同速度进行步行运动的特征值，丰富用于匹配比对的特征库。在具体实施例中，可以采用对重力感应传感器数据分析的方法，能通过软件实现对重力感应传感器数据分析并匹配步行状态的方法均可使用。
本实施例中当前连续判断结果为是的次数n的取值可以大于或等于2，而n的取值范围可以根据不同终端用户或者不同终端等应用场景灵活设定。本实施例中n大于或等于2，在连续多次判定终端当前的运动模式与监护运动模式相匹配时，判定终端当前处于监护运动模式，例如步行模式，可以提升判断的准确率，避免发生误判从而产生误告警，提升了用户的体验。
本实施例中当根据当前采集周期内的运动数据分析发现终端的运动模式与监护运动模式不匹配时，可以按预设频率增量降低采集频率。降低运动数据采集的频率，可以节省资源的消耗。监护运动模式(例如步行模式)并不是终端的使用常态，终端处于这种运动模式时间会比较短，因此此处增大采集频率可以降低终端自身功耗。
本实施例中的应用类型判断模块2可以包括：轮询子模块21和判断子模块22。
轮询子模块21设置为按预设轮询频率对终端前台当前运行的进程进行轮 询。
判断子模块22设置为当连续M1次或累计M2次轮询到所述终端前台运行的进程属于所述监管型应用的进程时，判定所述终端前台当前运行的应用属于预设的监管型应用。
本实施例中，M2大于或等于M1，M1和M2的次数可由厂商或用户根据需求灵活设定。例如设定M1为2次或3次，设定M2为4次或5次。在轮询过程中，当轮询结果为终端前台运行的进程不属于监管型应用的进程时，可以按照一定的规则对轮询频率进行调整，以降低轮询次数，降低资源消耗。该规则可以采用上述采集频率调整规则，也可以由用户自己灵活设定。
判断子模块22在连续M1次或累计M2次轮询到终端前台运行的进程属于监管型应用的进程时，可实现对终端用户的安全提醒。本实施例为了提升控制的准确性，还可确定终端用户当前是否将注意力集中在终端上。请参见图6，本实施例中的终端用户安全监护装置还可以包括：图像采集控制模块4和图像分析模块5。
图像采集控制模块4设置为在判断终端前台当前运行的应用是否属于预设的监管型应用后，通过终端对终端用户进行安全提醒之前，控制终端的图像采集模块采集终端正面的中终端用户图像。
本实施例中所采用的图像采集模块可以是终端的摄像头，且可以是终端的前置摄像头，或可旋转采集终端正面图像的后置摄像头。本实施例中终端正面是指终端具有显示屏的一面。如果终端为双面都设有显示屏时，则为当前使用的显示屏的一面。
图像分析模块5设置为分析所述图像中是否存在人脸，如存在，通知告警模块3对所述终端用户进行安全提醒。
人脸识别中，检测在该图像中是否可以找到符合人脸特征的图像，判断在采集图像的时刻，终端用户是否将视线停留在终端屏幕上。
当图像分析模块5分析结果为图像中不存在人脸时，此时可能是用户未将注意力集中于终端，但也有可能仅仅是在采集图像这一时刻用户未将注意力集中于终端，可以采用继续采集图像进行分析的方式判定用户是否将注意力集中于终端。此时请参见图7所示，本实施例中的终端用户安全监护装置还包括补 询模块6。补询模块6设置为在所述图像中不存在人脸时，对所述终端前台当前运行的进程进行轮询，当连续K1次或累计K2次轮询到终端前台运行的进程属于所述监管型应用的进程时，此时推定终端用户可能当前一直在终端前台使用该监管型应用，可以通过终端对终端用户进行安全提醒。K1大于上述对应的M1，K2大于上述对应的M2。例如设定K1为20次，以及K2为40次。
本实施例中的监管型应用可以是非必须要运行应用且会分散用户注意力的应用，终端用户可以根据自己需求对终端上的应用类型进行定义，将认为是需要进行监管的应用添加进来。运营商或厂商或软件提供方也可以根据一些规则将相应的应用划分为监管型应用，例如该监管型应用可以为社交娱乐类应用，属于该类型的应用可以包含但不限于多种游戏、视频、电子书以及社交软件(QQ、微信或微博)等等。
本实施例中，告警模块3通过终端对终端用户进行安全提醒的方式可以包含以下方式中的任意一种或多种的组合：
通过终端播放提醒语音，例如语音内容可为：您当前处于行走状态，请注意行走安全，建议当前不要使用终端；
将终端显示界面进行遮挡，这样终端用户就不能看到显示界面内的内容，从而提醒终端用户注意；
在终端显示界面上显示提醒悬浮窗口，该悬浮窗口可以文字或动画等形式提醒用户注意安全，并可提供与用户进行交互的交互接口(例如按钮)，用户通过该交互接口下发确认指令是，该悬浮窗口即可关闭；以及
暂停或关闭终端前台当前运行的应用，以此提醒用户注意行走安全。
对于以上方式都可以设置在终端中供用户选择和组合。也可提供自定义提醒方式让用户自己设定安全提醒的方式，可提升用户体验。
如上分析，本实施例中，监护过程中进行的运动数据的采集、前台应用程序的判断、图像数据的采集以及对终端用户的提醒可以都在终端保持亮屏过程中进行。如果终端由亮屏转为熄屏了，则表明终端用户当前未使用终端，终端用户注意力一般不在终端上，此时可通过熄屏控制模块停止运动数据的采集、终端前台应用类型的判断以及对终端用户的安全提醒，并对之前采集的数据以及分析的结果清零，提升管理的智能性，减少终端的资源消耗。
实施例三：
本实施例以终端为手机，监护运动模式为步行模式，监管型应用为社交娱乐类的软件为例，对本公开进行说明。
请参见图8，在手机启动后，在步骤810中，运动模式判断模块开始工作，向运动数据采集模块发送自检命令。在步骤820中，运动数据采集模块接收到自检命令，对手机设备的重力感应传感器进行检测。对重力感应传感器进行检测可以确保该传感器是能够正常工作的，运动数据采集模块将检测结果反馈给后台监控进程。
运动模式判断模块接收运动数据采集模块的设备检测结果，如果设备异常，则无法检测手机用户是否处于步行状态，运动模式判断模块可以退出，系统关闭，也可以提醒用户修复。当设备检测结果是正常时，运动模式判断模块监听手机屏幕点亮事件和屏幕熄灭事件。
在步骤830中，监听手机屏幕点亮事件。运动模式判断模块监听到手机屏幕点亮后，对点亮的时间进行记录，如果在5秒钟内没有手机屏幕熄灭事件的发生，则在步骤840中，运动模式判断模块的采集控制子模块向运动数据采集模块发送采集命令。5秒钟时延在系统设计中是可以调整的，时延可以过滤掉手机屏幕点亮后在较短时间内熄灭手机屏幕的情况，例如手机用户亮屏看时间，随后又息屏的这种操作。
运动数据采集模块接收到后台监控进程发送的采集指令后，可以在采集周期内以每秒20次的采集频率的对重力感应传感器的数据进行采集，在采集的同时对每笔数据加上时间戳并存储记录。
运动模式判断模块的采集控制子模块在发送采集命令后，延迟5秒钟(此时采集周期为5秒)，发送停止命令给运动数据采集模块，同时也发送分析命令给运动数据分析子模块。延迟5秒钟可以让运动数据采集模块能够采集一定时间量的数据，以便进行分析。
运动数据采集模块接收到停止命令后即停止对重力感应传感器的数据采集，步骤805运动数据分析子模块接收到后发送的分析命令后，可以将运动数据采集模块中存储记录的数据提取出来，此时运动数据采集模块已经停止采集，不会产生新的数据。运动数据分析子模块对提取出的带有时间戳的采样数据进行特征提取。不同人在不同环境下的步行状态的特征并不完全相同，根据重力 感应传感器获取的数据分别包括手机在坐标X、Y、Z三轴方向上的加速度分量aX、aY、aZ，根据
Figure PCTCN2017072457-appb-000003
计算出该时刻的加速度，并通过快速傅里叶变换去除掉噪声，可以得到一段时间内加速度的变化，对这段时间内加速度的特征进行提取，与步行状态的特征进行比对，可判断终端当前的运动模式是否属于步行状态。为了提高比对结果的准确性，可以预先尽可能多的提取不同人在不同环境下以不同速度进行步行运动的特征值，丰富用于匹配比对的特征库。在具体实施例中，可以采用对重力感应传感器数据分析的方法，能通过软件实现对重力感应传感器数据分析并匹配步行状态的方法均可使用。运动数据分析子模块将分析结果反馈给运动模式判断模块。
步骤860中，运动模式判断模块在接收到运动数据分析子模块的反馈结果后，根据结果进行后续的操作，并对连续出现相同结果的次数进行记录。如果反馈的结果符合步行状态，则可以发送采集命令给运动数据采集模块进行数据采集，如果反馈的结果不符合步行状态，则延迟一定时间后发送采集命令，但是每次发送采集命令后，都会延迟5秒钟后发送停止命令给运动数据采集模块，此时的运动数据采集周期则为5秒，以确保可以采集到足够的数据用以分析。发送分析命令给运动数据分析模块，以对采集周期(5秒)内采集的运动数据进行分析。
当运动模式判断模块记录的反馈结果中，出现连续两次都是步行状态，则可以认为当前手机用户处于持续的步行状态中，在步骤870中，运动模式判断模块发送唤醒命令给应用类型判断模块。如果当前的反馈结果不符合步行状态，则手机用户可能处于非运动状态，或者处于运动状态但是非步行状态，可以适当降低重力传感器数据的采集频率。降低该采集频率的方式也可以通过延长触发对重力感应传感器数据的进行采集的触发周期实现，对触发周期呈现阶梯化处理，从而降低数据采集分析带来的负载。例如，在接收到不符合步行状态的结果后，运动模式判断模块不会第一时间发送数据采集命令给运动数据采集模块，而是等待一段时间，该时间即为触发周期，本实例设计触发周期＝5×连续反馈非步行状态的累积次数。即，如果连续反馈3次均为非步行状态，则这个触发周期是15秒，每隔15秒下发一次运动数据采集命令，最大等待时间不可超过55秒，可以确保至少在1分钟内，进行过一次运动数据的采集和分析。通过以上触发周期的控制可以阶梯式的减少对运动数据采集的次数。当然，本实施 例中，还可降低上述采集周期内的采集频率，例如采集周期固定为5秒，也即每到一触发周期后，都会进行5秒的运动数据采集。初始时设定采集周期(5秒)内采集频率为1秒20次，每判断一次为非步行状态时，采集频率降低2次，即如果连续反馈3次均为非步行状态，后续采集周期(5秒)内的采集频率降低为1秒14次，如果后续反馈仍为非步行状态，可以继续降低采集频率，直到采集频率达到设定的最小值1秒10次。在此期间一旦反馈为步行状态时，则采集频率恢复为初始值1秒20次。以上采集频率及其调整规则都可以根据应用场景灵活设定。
在步骤880中，当运动模式判断模块监听到手机屏幕息屏事件时，即存在手机屏幕由亮屏到息屏状态的切换，此时系统可以认为在息屏状态下手机用户的视线不会被手机所吸引。即使处于步行状态下，也不会出现因视线停留在手机屏幕上而导致出现人身安全的现象，因此执行步骤890和步骤8100，运动模式判断模块的采集控制子模块发送停止命令给运动数据采集模块和运动数据分析子模块，执行步骤8110发送休眠命令给应用类型判断模块。运动数据采集模块和运动数据分析子模块在接收到停止命令时，如果采集模块和运动数据分析子模块处于工作状态，则会立即停止工作，并清空自身数据，如果采集模块和运动数据分析子模块处于停止状态，则可以不对停止命令做出动作。
图9是应用类型判断模块的工作流程示意图，在手机启动后，执行步骤910，应用类型判断模块开始工作。在应用类型判断模块启动后，执行步骤920，通过图像采集控制模块发送检测命令给图像采集模块。
图像采集模块接收到检测命令后，会检测手机的前置摄像头是否可以正常工作，并将检测结果反馈给应用类型判断模块。
应用类型判断模块接收到图像采集模块反馈的设备检测结果后对该结果进行记录，主动进入休眠状态。
当步骤930被执行时，即应用类型判断模块接收到运动模式判断模块发送的唤醒命令后，应用类型判断模块进入工作状态，执行步骤940，以一定的时间间隔轮询手机当前前台工作进程的类型。如果该进程属于社交娱乐类的软件，则将查询命中次数加1，连续查询命中次数加1。如果该进程不属于社交娱乐类的软件，则将连续查询命中次数置为0。应用类型判断模块可以根据查询到的当前前台工作进程的类型会主动的调整轮询时间，如果该进程不属于社交娱乐类 软件，可以将轮询时间的间隔调整为10秒，降低单位时间的轮询次数，减轻系统负载。如果查询到的当前进程属于社交娱乐类软件，可以将轮询时间的间隔调整为3秒，加速对用户行为的判断。社交娱乐类软件的主要用途是社交或娱乐，此类软件在使用过程中需要用户通过手机屏幕与之进行较多的交互或注意力的集中，因此在步行时会导致使用者的注意力集中在与软件的交互上而无法注意到周围环境的改变，进而存在潜在的人身危险。在本实例中社交娱乐类软件可以包括手机中的游戏软件，视频播放软件，微信，微博，手机QQ以及电子书软件。
当应用类型判断模块发现记录的连续查询命中次数达到3次时，停止对手机前台工作进程的轮询检测，清空连续查询命中次数，执行步骤950，发送采集命令给图像采集模块，使系统感知到社交娱乐类软件作为手机前台工作进程已经一段时间了，可以进行人脸检测，判断手机用户的视线是否被社交娱乐类软件吸引。在应用类型判断模块启动时，发送检测命令给图像采集模块，并记录了对设备的检测结果，如果设备检测异常，则可以不发送采集命令给图像采集模块。
图像采集模块接收到应用类型判断模块发送的采集命令后，可以启动手机的前置摄像头来采集一幅图像，并将图像存储为bmp格式，反馈采集结果给应用类型判断模块。
应用类型判断模块接收到图像采集模块反馈的结果后，如果反馈结果是采集成功，则执行步骤960，发送分析命令给图像分析模块，如果反馈结果是采集失败，则应用类型判断模块可以启动对手机当前前台工作进程类型的轮询。
图像分析模块接收到应用类型判断模块发送的分析命令后，可以对图像采集模块通过手机前置摄像头采集到的图像进行分析。通过分析，可以检测在该图像中是否可以找到符合人脸特征的图像，判断在前置摄像头采集图像的时刻，手机的使用者是否将视线停留在手机屏幕上。
应用类型判断模块接收图像分析模块反馈的分析结果，如果可以检测出人脸，则此时手机的使用者满足了如下状态，即手机屏幕处于点亮状态，手机使用者处于步行状态，手机当前前台工作进程为社交娱乐类软件，手机使用者的视线停留在手机屏幕上，应用类型判断模块判断手机使用者当前的行为存在人身安全的风险，执行步骤970，发送阻止消息给告警模块。
如果图像分析模块反馈的结果是无法检测到人脸，可以主动监控进程应用类型判断模块进行轮询检测。
在应用类型判断模块进行轮询时，可以检查自身记录的社交娱乐类软件查询命中次数，如果该次数大于一定数值，例如大于20次，应用类型判断模块可以发送告警消息给告警模块。查询命中次数的方法可以提高系统检测的容错率。因为在图像中进行人脸检测对图像自身质量有一定的要求，手机前置摄像头采集图像的成像效果与当前场景的光照强度有较大关系，所以采集的图像不一定检测到人脸。同时，在一个时刻进行的一次图像采集，在该时刻可能手机的使用者并没有将视线停留在手机屏幕上，但是不能排除手机使用者在步行状态下使用社交娱乐软件的可能，因此当主动监控进程进行轮询时，可以检测查询命中次数大于一个设定数值时，执行步骤970，发送告警消息到告警模块。
在本实例中使用了图像采集模块和图像分析模块，这两个模块在手机行为监控守护系统中是可选模块，所以当实例中没有图像采集和图像分析模块时，应用类型判断模块在流程上的处理可以通过在每次轮询时，检查自身记录的社交娱乐类软件查询命中次数是否超过设定值，来判断是否发送告警消息到告警模块的，使得手机行为监控系统不依赖图像采集模块和图像分析模块。
当步骤980被执行时，即应用类型判断模块接收到休眠命令，执行步骤990、步骤9100和步骤9110，停止对手机当前前台工作进程类型的轮询，发送停止命令给图像采集模块，发送停止命令给图像分析模块，应用类型判断模块进入休眠状态。图像采集模块接收到停止命令，如控制手机前置摄像头进行图像采集，则停止该操作，并清空存储的图像。图像分析模块接收到停止命令，如果在进行对图像的人脸检测，则停止该操作。当步骤980被执行后，应用类型判断模块及其控制的全部模块均会停止工作。
图10是运动模式判断模块、应用类型判断模块以及告警模块之间交互的流程图。步骤1000表示运动模式判断模块所进行的全部处理过程。运动模式判断模块在连续两次获得运动数据分析模块反馈当前处于步行状态后，可以向应用类型判断模块发送唤醒命令。运动模式判断模块在监控到手机熄屏事件后，可以向应用类型判断模块发送休眠命令。
步骤1001表示应用类型判断模块所进行的全部处理过程。应用类型判断模块接收到运动模式判断模块发送的唤醒命令后，如果此时处于休眠状态，可以 停止休眠，进入工作状态，如果此时已经处于工作状态，则对唤醒命令不做任何动作。应用类型判断模块接收到运动模式判断模块发送的休眠命令后，则停止应用类型判断模块自身以及其管理的图像采集模块和图像分析模块的操作，并清空自身保留的数据，进入休眠状态。
应用类型判断模块在接收到图像分析模块反馈的检测出人脸的结果后，可以向告警模块发送阻止命令，应用类型判断模块停止查询并清除查询命中次数和连续命中次数。应用类型判断模块在轮询时发现社交娱乐类软件查询命中次数超过限定，可以向告警模块发送告警命令，应用类型判断模块停止查询并清除查询命中次数和连续命中次数。
步骤1002表示告警模块进行的告警处理。告警模块接收到应用类型判断模块的阻止命令后，可以使用不透明的告警图片覆盖手机顶层屏幕7秒钟，7秒钟之后发送一个悬浮窗消息，提醒手机使用者不要在步行的时候使用社交娱乐类软件，并且手机使用者可以与这个悬浮窗消息进行互动，比如点击消息窗的确认键。告警模块在接收到悬浮窗消息的返回事件后，使用不透明的告警图片覆盖手机顶层屏幕7秒钟，7秒钟之后取消图片遮挡，发送处理完毕的消息给应用类型判断模块。
告警模块在接收到应用类型判断模块的告警命令后，会发送一个悬浮窗消息，提醒手机使用者不要在步行的时候使用社交娱乐类软件，并且手机使用者可以与这个悬浮窗消息进行互动，比如点击消息窗的确认键，告警模块在接收到悬浮窗消息的返回事件后，可以发送处理完毕的消息给应用类型判断模块。
应用类型判断模块在接收到告警模块处理完毕的消息后，可以自动进入到休眠状态。
本公开的优点是，只要使用者不在步行状态下使用社交娱乐类软件，整个的监控过程对使用者就是完全透明的。监控守护系统的使用无需手机联网，即如果手机在信号不好或没有手机信号的地方，本系统都可以正常工作。
上述本公开的模块或步骤可以用通用的计算装置来实现，它们可以集中在单个的计算装置上，或者分布在多个计算装置所组成的网络上，可选地，它们可以用计算装置可执行的程序代码来实现，可以将它们存储在存储介质(只读存储器(Read-only Memory，ROM)、随机存储存储器(Random-Access Memory，RAM)、磁碟、光盘)中由计算装置来执行。在一些情况下，可以以不同于此处 的顺序执行所示出或描述的步骤，或者将它们分别制作成多个集成电路模块，或者将它们中的多个模块或步骤制作成单个集成电路模块来实现。
本公开实施例还提供了一种非暂态计算机可读存储介质，存储有计算机可执行指令，所述计算机可执行指令设置为执行上述任一方法。
本公开实施例还提供了一种终端的硬件结构示意图。参见图11，该终端包括：
至少一个处理器(processor)1101，图11中以一个处理器1101为例；和存储器(memory)1102，还可以包括通信接口(Communications Interface)1103和总线1104。其中，处理器1101、通信接口1103、存储器1102可以通过总线1104完成相互间的通信。通信接口1103可以用于信息传输。处理器1101可以调用存储器1102中的逻辑指令，以执行上述方法。
此外，上述的存储器1102中的逻辑指令可以通过软件功能单元的形式实现并作为独立的产品销售或使用时，可以存储在一个计算机可读取存储介质中。
存储器1102作为一种计算机可读存储介质，可用于存储软件程序、计算机可执行程序，如本公开实施例中方法对应的程序指令或模块。处理器1101通过运行存储在存储器1102中的软件程序、指令或模块，从而执行功能应用以及数据处理。
存储器1102可包括存储程序区和存储数据区，其中，存储程序区可存储操作系统、至少一个功能所需的应用程序；存储数据区可存储根据终端的使用所创建的数据等。此外，存储器1102可以包括高速随机存取存储器，还可以包括非易失性存储器。
本公开的技术方案可以以软件产品的形式体现出来，该计算机软件产品存储在一个存储介质中，包括一个或多个指令用以使得一台计算机设备(可以是个人计算机，服务器，或者网络设备等)执行本公开实施例所述方法的全部或部分步骤。而前述的存储介质可以是非暂态存储介质，包括：U盘、移动硬盘、ROM、RAM、磁碟或者光盘等多种可以存储程序代码的介质，也可以是暂态存储介质。
工业实用性
本公开提供的一种终端用户安全监护方法及装置，避免了终端用户因分散 注意力而忽略外部环境变化，进而可能导致人身安全事故发生的现象，确保终端用户的人身安全，提升用户体验。

Claims (17)

  1. 一种终端用户安全监护方法，包括：
    根据终端的运动数据判断所述终端是否处于需要进行安全监护的监护运动模式；
    如所述终端处于所述监护运动模式，判断所述终端前台当前运行的应用是否属于预设的监管型应用；以及
    如所述当前运行的应用属于预设的监管型应用，通过所述终端对终端用户进行安全提醒。
  2. 如权利要求1所述的方法，其中，根据终端的运动数据判断所述终端是否处于所述监护运动模式包括：
    检测到所述终端亮屏；
    通过所述终端的运动数据采集模块按当前的采集频率在采集周期内采集所述终端的运动数据；以及
    根据所述运动数据分析所述终端是否处于所述监护运动模式。
  3. 如权利要求2所述的方法，检测到所述终端亮屏后，通过所述终端的运动数据采集模块采集所述运动数据之前，所述方法还包括：
    判断所述终端亮屏的持续时间是否大于预设的亮屏时间阈值。
  4. 如权利要求2所述的方法，其中，根据所述运动数据分析所述终端是否处于所述监护运动模式包括：
    根据当前采集周期内的运动数据分析所述终端当前的运动模式是否与所述监护运动模式匹配；
    如匹配，判断当前连续判断结果为是的次数n是否大于或等于预设次数阈值N，如n大于或等于N，则判定所述终端处于所述监护运动模式；如n小于N，则分析后面采集周期内的运动数据；以及
    如不匹配，按预设频率调整规则降低所述采集频率。
  5. 如权利要求2所述的方法，所述方法还包括：当检测到所述终端由亮屏变为熄屏时，停止所述运动数据的采集、终端前台应用类型的判断以及对终端用户的安全提醒。
  6. 如权利要求1-5任一项所述的方法，其中，判断所述终端前台当前运行的应用是否属于预设的监管型应用包括：
    按预设轮询频率对所述终端前台当前运行的进程进行轮询；以及
    当连续M1次或累计M2次轮询到所述终端前台运行的进程属于所述监管型应用的进程时，判定所述终端前台当前运行的应用属于预设的监管型应用，所述M2大于或等于M1。
  7. 如权利要求6所述的方法，判断所述终端前台当前运行的应用是否属于预设的监管型应用后，通过所述终端对终端用户进行安全提醒之前，所述方法还包括：
    通过所述终端的图像采集模块采集终端正面的终端用户图像；以及
    分析所述图像中是否存在人脸，如存在，通过所述终端对终端用户进行安全提醒。
  8. 如权利要求7所述的方法，所述方法还包括，所述图像中不存在人脸时，对所述终端前台当前运行的进程进行轮询，当连续K1次或累计K2次轮询到所述终端前台运行的进程属于所述监管型应用的进程时，通过所述终端对终端用户进行安全提醒，其中，所述K1大于所述M1，所述K2大于所述M2，且所述K2大于所述K1。
  9. 如权利要求1-5任一项所述的方法，其中，通过所述终端对终端用户进行安全提醒包括以下方式中的至少一种：
    通过所述终端播放提醒语音；
    将所述终端显示界面进行遮挡；
    在所述终端显示界面上显示提醒悬浮窗口；以及
    暂停或关闭所述终端前台当前运行的应用。
  10. 如权利要求1-5任一项所述的方法，其中，所述监护运动模式为步行模式。
  11. 如权利要求1-5任一项所述的方法，其中，所述监管型应用为社交娱乐类应用。
  12. 一种终端用户安全监护装置，包括：
    运动模式判断模块，设置为根据终端的运动数据判断所述终端是否处于需要进行安全监护的监护运动模式；
    应用类型判断模块，设置为在所述终端处于所述监护运动模式时，判断所述终端前台当前运行的应用是否属于预设的监管型应用；以及
    告警模块，设置为在所述应用类型判断模块判断所述当前运行的应用属于预设的监管型应用时，通过所述终端对终端用户进行安全提醒。
  13. 如权利要求11所述的装置，其中，所述运动模式判断模块包括：
    检测子模块，设置为检测到所述终端亮屏；
    采集控制子模块，设置为控制所述终端的运动数据采集模块按当前的采集频率在采集周期内采集所述终端的运动数据；以及
    运动数据分析子模块，设置为根据所述运动数据分析所述终端是否处于所述监护运动模式。
  14. 如权利要求12或13所述的装置，其，所述应用类型判断模块包括：
    轮询子模块，设置为按预设轮询频率对所述终端前台当前运行的进程进行 轮询；以及
    判断子模块，设置为当连续M1次或累计M2次轮询到所述终端前台运行的进程属于所述监管型应用的进程时，判定所述终端前台当前运行的应用属于预设的监管型应用，所述M2大于或等于所述M1。
  15. 如权利要求14所述的装置，所述装置还包括：
    图像采集控制模块，设置为在判断所述终端前台当前运行的应用是否属于预设的监管型应用后，通过所述终端对终端用户进行安全提醒之前，控制所述终端的图像采集模块采集终端正面的终端用户图像；以及
    图像分析模块，设置为分析所述图像中是否存在人脸，如存在，通知所述告警模块对所述终端用户进行安全提醒。
  16. 如权利要求15所述的装置，所述装置还包括补询模块，设置为在所述图像中不存在人脸时，对所述终端前台当前运行的进程进行轮询，当连续K1次或累计K2次轮询到所述终端前台运行的进程属于所述监管型应用的进程时，通知所述告警模块对所述终端用户进行安全提醒；其中，所述K1大于所述M1，所述K2大于所述M2，且所述K2大于所述K1。
  17. 一种非暂态计算机可读存储介质，存储有计算机可执行指令，所述计算机可执行指令设置为执行权利要求1-11中任一项的方法。
PCT/CN2017/072457 2016-02-05 2017-01-24 终端用户安全监护方法及装置 WO2017133589A1 (zh)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
CN201610082448.1 2016-02-05
CN201610082448.1A CN107045766A (zh) 2016-02-05 2016-02-05 终端用户安全监护方法及装置

Publications (1)

Publication Number Publication Date
WO2017133589A1 true WO2017133589A1 (zh) 2017-08-10

Family

ID=59500549

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/CN2017/072457 WO2017133589A1 (zh) 2016-02-05 2017-01-24 终端用户安全监护方法及装置

Country Status (2)

Country Link
CN (1) CN107045766A (zh)
WO (1) WO2017133589A1 (zh)

Cited By (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN111402617A (zh) * 2020-03-12 2020-07-10 Oppo广东移动通信有限公司 站点信息确定方法、装置、终端及存储介质
CN112822448A (zh) * 2021-01-07 2021-05-18 西安万像电子科技有限公司 终端监控方法和系统、计算机可读存储介质及处理器
CN113164044A (zh) * 2018-12-29 2021-07-23 深圳迈瑞生物医疗电子股份有限公司 病人状态监测系统及方法
CN114629992A (zh) * 2022-03-17 2022-06-14 Oppo广东移动通信有限公司 设备提示方法、装置、电子设备和计算机可读存储介质
CN115442476A (zh) * 2022-09-20 2022-12-06 维沃移动通信有限公司 电子设备的控制方法、装置、电子设备及可读存储介质
CN116501551A (zh) * 2023-06-21 2023-07-28 山东远桥信息科技有限公司 一种数据告警产生及恢复处理方法

Families Citing this family (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN109001741A (zh) * 2018-05-24 2018-12-14 深圳市沃特沃德股份有限公司 智能终端遇障碍物的报警方法及系统
CN108769412A (zh) * 2018-05-30 2018-11-06 深圳大米智联网络有限公司 一种避免走路浏览智能终端的方法
CN108845923A (zh) * 2018-06-22 2018-11-20 江苏乐知音网络营销有限公司 一种在线监测系统
CN109448828A (zh) * 2018-10-17 2019-03-08 上海京颐奂享物联网有限公司 一种医护操作的执行方法、装置及医疗终端

Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN1540286A (zh) * 2003-04-25 2004-10-27 王舜清 多功能实时交通安全管理装置及方法
CN103247144A (zh) * 2012-02-07 2013-08-14 宇龙计算机通信科技(深圳)有限公司 交通安全提醒方法及移动终端
CN103685760A (zh) * 2013-12-24 2014-03-26 深圳市金立通信设备有限公司 一种安全提示方法及移动终端
CN103873689A (zh) * 2014-03-12 2014-06-18 深圳市中兴移动通信有限公司 一种安全提醒的方法及装置
CN104679640A (zh) * 2013-12-02 2015-06-03 鸿富锦精密工业（深圳）有限公司 用于移动终端中的安全预警方法及系统
US20150222740A1 (en) * 2012-06-22 2015-08-06 Salutica Allied Solutions SDN.BHD. Wireless alerting system for personal area asset supervision

Family Cites Families (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2011153314A1 (en) * 2010-06-03 2011-12-08 Western Michigan University Research Foundation Portable computer readable medium system and method thereof
CN103092605A (zh) * 2012-12-21 2013-05-08 广东欧珀移动通信有限公司 一种控制移动终端使用的方法及装置
CN104915278A (zh) * 2014-03-14 2015-09-16 小米科技有限责任公司 应用的控制方法及装置
CN104202466B (zh) * 2014-08-19 2019-04-02 厦门美图移动科技有限公司 一种行进中使用手机进行安全提示的方法
CN104333654B (zh) * 2014-10-14 2018-01-23 京东方科技集团股份有限公司 危险提醒方法及装置以及便携式电子设备
CN104469020B (zh) * 2014-12-29 2018-05-22 北京智产科技咨询有限公司 一种移动终端及其控制方法

Patent Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN1540286A (zh) * 2003-04-25 2004-10-27 王舜清 多功能实时交通安全管理装置及方法
CN103247144A (zh) * 2012-02-07 2013-08-14 宇龙计算机通信科技(深圳)有限公司 交通安全提醒方法及移动终端
US20150222740A1 (en) * 2012-06-22 2015-08-06 Salutica Allied Solutions SDN.BHD. Wireless alerting system for personal area asset supervision
CN104679640A (zh) * 2013-12-02 2015-06-03 鸿富锦精密工业（深圳）有限公司 用于移动终端中的安全预警方法及系统
CN103685760A (zh) * 2013-12-24 2014-03-26 深圳市金立通信设备有限公司 一种安全提示方法及移动终端
CN103873689A (zh) * 2014-03-12 2014-06-18 深圳市中兴移动通信有限公司 一种安全提醒的方法及装置

Cited By (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN113164044A (zh) * 2018-12-29 2021-07-23 深圳迈瑞生物医疗电子股份有限公司 病人状态监测系统及方法
CN111402617A (zh) * 2020-03-12 2020-07-10 Oppo广东移动通信有限公司 站点信息确定方法、装置、终端及存储介质
CN112822448A (zh) * 2021-01-07 2021-05-18 西安万像电子科技有限公司 终端监控方法和系统、计算机可读存储介质及处理器
CN114629992A (zh) * 2022-03-17 2022-06-14 Oppo广东移动通信有限公司 设备提示方法、装置、电子设备和计算机可读存储介质
CN115442476A (zh) * 2022-09-20 2022-12-06 维沃移动通信有限公司 电子设备的控制方法、装置、电子设备及可读存储介质
CN116501551A (zh) * 2023-06-21 2023-07-28 山东远桥信息科技有限公司 一种数据告警产生及恢复处理方法
CN116501551B (zh) * 2023-06-21 2023-09-15 山东远桥信息科技有限公司 一种数据告警产生及恢复处理方法

Also Published As

Publication number Publication date
CN107045766A (zh) 2017-08-15

Similar Documents

Publication Publication Date Title
WO2017133589A1 (zh) 终端用户安全监护方法及装置
CN109976506B (zh) 一种电子设备的唤醒方法、存储介质及机器人
JP6407246B2 (ja) 検出された視線に基づくデバイスインタラクションのためのシステムおよび方法
CN110554815B (zh) 图标唤醒方法、电子设备和存储介质
US20140075230A1 (en) Waking An Electronic Device
WO2017024836A1 (zh) 终端保护视力的处理方法及装置
KR20220125716A (ko) 이벤트 검출 방법, 장치, 전자 기기, 저장 매체 및 프로그램 제품
US20210208678A1 (en) Prompt method and apparatus for eye-protection mode, electronic device and storage medium
TW201743166A (zh) 護眼系統及方法
WO2017206433A1 (zh) 电视控制方法及系统
US9874933B1 (en) Device shutdown routine optimization
TW201633215A (zh) 護眼系統及方法
CN106814838B (zh) 终端自动休眠的方法和装置
WO2017101226A1 (zh) 一种判断用户视力疲劳的方法及装置
CN106325514B (zh) 一种手持智能终端的防掉落方法、装置及其电子设备
TW202006676A (zh) 電腦系統及其資源分配方法
WO2022183663A1 (zh) 事件检测方法、装置、电子设备、存储介质及程序产品
CN109543563B (zh) 安全提示方法、装置、存储介质及电子设备
CN108810527B (zh) 散射器异常检测方法、装置及电子设备
CN104050785A (zh) 基于虚拟化边界与人脸识别技术的安全警戒方法
CN113361469A (zh) 一种覆盖状态识别方法、装置、设备及存储介质
US11800975B2 (en) Eye fatigue prediction based on calculated blood vessel density score
US8694445B1 (en) Triggering attract mode for devices using viewability conditions and detected proximity of human to device
CN113259592A (zh) 拍摄方法、装置、电子设备及存储介质
CN113256238B (zh) 提醒方法、装置和电子设备

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 17746909

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 17746909

Country of ref document: EP

Kind code of ref document: A1