CN113709308A - Usage monitoring method and device for electronic equipment - Google Patents
Usage monitoring method and device for electronic equipment Download PDFInfo
- Publication number
- CN113709308A CN113709308A CN202111017824.6A CN202111017824A CN113709308A CN 113709308 A CN113709308 A CN 113709308A CN 202111017824 A CN202111017824 A CN 202111017824A CN 113709308 A CN113709308 A CN 113709308A
- Authority
- CN
- China
- Prior art keywords
- user
- information
- monitoring data
- state
- electronic device
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
- 238000012544 monitoring process Methods 0.000 title claims abstract description 117
- 238000000034 method Methods 0.000 title claims abstract description 53
- 230000036541 health Effects 0.000 claims abstract description 56
- 230000004438 eyesight Effects 0.000 claims abstract description 38
- 230000008569 process Effects 0.000 claims abstract description 18
- 230000009471 action Effects 0.000 claims description 13
- 238000012545 processing Methods 0.000 claims description 13
- 230000001815 facial effect Effects 0.000 claims description 7
- 241001282135 Poromitra oscitans Species 0.000 claims description 3
- 206010048232 Yawning Diseases 0.000 claims description 3
- 238000004891 communication Methods 0.000 abstract description 3
- 238000001514 detection method Methods 0.000 description 12
- 230000006870 function Effects 0.000 description 8
- 230000003862 health status Effects 0.000 description 6
- 238000012806 monitoring device Methods 0.000 description 5
- 238000010586 diagram Methods 0.000 description 4
- 230000000694 effects Effects 0.000 description 3
- 230000007613 environmental effect Effects 0.000 description 2
- 230000003287 optical effect Effects 0.000 description 2
- 230000002411 adverse Effects 0.000 description 1
- 238000011161 development Methods 0.000 description 1
- 238000007599 discharging Methods 0.000 description 1
- 230000004399 eye closure Effects 0.000 description 1
- 210000003128 head Anatomy 0.000 description 1
- 230000000977 initiatory effect Effects 0.000 description 1
- 239000004973 liquid crystal related substance Substances 0.000 description 1
Images
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04M—TELEPHONIC COMMUNICATION
- H04M1/00—Substation equipment, e.g. for use by subscribers
- H04M1/72—Mobile telephones; Cordless telephones, i.e. devices for establishing wireless links to base stations without route selection
- H04M1/724—User interfaces specially adapted for cordless or mobile telephones
- H04M1/72448—User interfaces specially adapted for cordless or mobile telephones with means for adapting the functionality of the device according to specific conditions
- H04M1/72454—User interfaces specially adapted for cordless or mobile telephones with means for adapting the functionality of the device according to specific conditions according to context-related or environment-related conditions
Landscapes
- Engineering & Computer Science (AREA)
- Environmental & Geological Engineering (AREA)
- Human Computer Interaction (AREA)
- Computer Networks & Wireless Communication (AREA)
- Signal Processing (AREA)
- User Interface Of Digital Computer (AREA)
Abstract
The application discloses a method and a device for monitoring use of electronic equipment, which belong to the technical field of communication and comprise the following steps: acquiring monitoring data in the process of using the first electronic equipment by a first user; obtaining health state information of a first user according to the monitoring data, wherein the health state information comprises at least one of concentration degree information, fatigue degree information and eyesight protection degree information of the first user; and generating notification information under the condition that the health state information represents that the first user is in an unhealthy state, and sending the notification information to second electronic equipment.
Description
Technical Field
The application belongs to the technical field of communication, and particularly relates to a method and a device for monitoring use of electronic equipment.
Background
With the continuous development and popularization of intelligent devices and network education, the fact that a user takes lessons in a remote mode through electronic devices becomes the current normal state that the user receives education, and therefore children use the electronic devices for a longer time.
The long-time use of the electronic equipment can have adverse effects on the health of children, and parents can limit the content data read by the children by controlling the time of the children using the electronic equipment, but because the children lack self-control power, unhealthy use situations such as vague feeling, fatigue reading, incorrect sitting posture, too close distance to an equipment screen and the like can exist when the electronic equipment is used, and the parents cannot supervise the children constantly. Therefore, a method for monitoring the health of a child using an electronic device is needed.
Content of application
The embodiment of the application aims to provide a method and a device for monitoring the use of electronic equipment, which can solve the problem of monitoring the health condition of children when using the electronic equipment.
In order to solve the technical problem, the present application is implemented as follows:
in a first aspect, an embodiment of the present application provides a usage monitoring method for an electronic device, where the method includes: acquiring monitoring data in the process of using the first electronic equipment by a first user; according to the monitoring data, health state information of a first user when the first user uses the first electronic device is obtained, wherein the health state information comprises at least one of concentration degree information, fatigue degree information and eyesight protection degree information of the first user; and generating notification information under the condition that the health state information represents that the first user is in an unhealthy state, and sending the notification information to second electronic equipment.
In a second aspect, an embodiment of the present application provides a usage monitoring apparatus for an electronic device, where the apparatus includes: the data acquisition module is used for acquiring monitoring data in the process of using the first electronic equipment by a first user; the data processing module is used for acquiring health state information of a first user when the first user uses the first electronic device according to the monitoring data, wherein the health state information comprises at least one of concentration degree information, fatigue degree information and eyesight protection degree information of the first user; and the reminding module is used for generating notification information and sending the notification information to the second electronic equipment under the condition that the health state information represents that the first user is in the state of using the electronic equipment unhealthy.
In a third aspect, an embodiment of the present application provides an electronic device, which includes a processor, a memory, and a program or instructions stored on the memory and executable on the processor, and when executed by the processor, the program or instructions implement the steps of the method according to the first aspect.
In a fourth aspect, embodiments of the present application provide a readable storage medium, on which a program or instructions are stored, which when executed by a processor implement the steps of the method according to the first aspect.
In the embodiment of the application, health state information of a first user is obtained according to monitoring data of the first user in a process of using a first electronic device, whether the first user is in an unhealthy state is judged according to at least one of concentration degree information, fatigue degree information and eyesight protection degree information in the health state information, notification information is generated under the condition that the health state information represents that the first user is in the unhealthy state, and the notification information is sent to a second electronic device, so that the second user generates reminding information according to the notification information to remind the first user to keep the state of using the electronic device healthily.
Drawings
Fig. 1 is a flowchart illustrating steps of a usage monitoring method for an electronic device according to an embodiment;
FIG. 2 is a selection interface for selecting the application software to initiate a health monitoring option provided by the present embodiment;
FIG. 3 is an interface for initiating the eyesight protection monitoring state provided by the embodiment;
FIG. 4 is a statistical chart of the overall concentration of each application software provided in the present embodiment;
fig. 5 is a display interface of the notification information provided by the embodiment on the second electronic device;
fig. 6 is a display interface of the reminder information provided by the embodiment on the first electronic device;
FIG. 7 is a schematic structural diagram of a usage monitoring device of an electronic device according to an embodiment;
fig. 8 is a schematic structural diagram of an electronic device provided in this embodiment;
fig. 9 is a schematic diagram of a hardware structure of another electronic device provided in this embodiment.
Detailed Description
The technical solutions in the embodiments of the present application will be clearly and completely described below with reference to the drawings in the embodiments of the present application, and it is obvious that the described embodiments are some, but not all, embodiments of the present application. All other embodiments, which can be derived by a person skilled in the art from the embodiments given herein without making any creative effort, shall fall within the protection scope of the present application.
The terms first, second and the like in the description and in the claims of the present application are used for distinguishing between similar elements and not necessarily for describing a particular sequential or chronological order. It is to be understood that the data so used is interchangeable under appropriate circumstances such that the embodiments of the application are capable of operation in sequences other than those illustrated or described herein. In addition, "and/or" in the specification and claims means at least one of connected objects, a character "/" generally means that a preceding and succeeding related objects are in an "or" relationship.
The following describes in detail a usage monitoring method and apparatus for an electronic device according to an embodiment of the present application with reference to the accompanying drawings.
Referring to fig. 1, fig. 1 shows a flowchart of a usage monitoring method of an electronic device according to the present embodiment. The method can be applied to electronic equipment, and the electronic equipment can be a mobile phone, a tablet computer, a notebook computer and the like. As shown in FIG. 1, the method may include steps S1100-S1300, described in detail below.
S1100, acquiring monitoring data in the process of using the first electronic device by the first user.
In this embodiment, the first user may be a child, the first electronic device refers to an electronic device used by the child to access a lesson or play a game, the detection data may be video data acquired by the first electronic device when the child uses the first electronic device, and the video data may reflect a state and surrounding environment information of the child when using the first electronic device.
In this embodiment, in order to enable a parent to know the state of the child using the electronic device, before the detection data is acquired, an association relationship between the second electronic device and the first electronic device may be established in an account binding manner, where the second electronic device is a terminal used by the parent. For example, a parent user logs in a parent account on the second electronic device, logs in a child account on the first electronic device, and binds the parent account with the child account.
It can be understood that there are many kinds of application software installed on the first electronic device, and a parent can perform customized monitoring on the specified application software. Referring to fig. 2, fig. 2 is a selection interface for selecting an application to initiate a health monitoring option, wherein the health monitoring option may include concentration detection and fatigue detection, and the concentration detection and fatigue detection functions may be selectively turned on or off by touching on and off virtual keys for concentration detection and fatigue detection. And all the application programs in the first electronic device can be acquired and displayed in a list mode, and a user can add the application programs to a queue for starting health monitoring in a customized mode.
In one possible example, the health monitoring is performed when the application program that selects to start the health monitoring function is in a foreground operating state, and the health monitoring is stopped when the application program that selects to start the health monitoring function is hidden in a background.
S1200, according to the monitoring data, health state information of the first user when the first user uses the first electronic device is obtained.
In this embodiment, the health status information includes at least one of concentration information, fatigue information, and eyesight protection information of the first user, where the concentration information is used to represent that the first user is in a concentration state or a non-concentration state during using the first electronic device, the fatigue information is used to represent that the first user is in a fatigue state or a non-fatigue state during using the first electronic device, and the eyesight protection information is used to represent that the first user is in a eyesight protection state or eyesight influence state during using the first electronic device. Wherein the non-attentive state representation, the fatigue state, and the vision-affecting state all represent that the first user is in a non-healthy state.
In this embodiment, when the monitoring data includes eye image monitoring data of the first user, obtaining health status information of the first user using the electronic device according to the monitoring data includes: according to the eye image monitoring data, obtaining an eye gazing focus of a first user; and acquiring a preset observation region, and determining that the concentration degree information of the first user is in a non-concentration state under the condition that the deviation value of the eye watching focus and the preset observation region is greater than a preset deviation threshold value and the deviation duration time is greater than a preset deviation time.
The eye image monitoring data may be obtained by extracting an eye image of the first user from the monitoring data, and the preset observation region is a preset range based on a display interface of the first electronic device, and specifically, the preset observation region may be a displayable region of a screen of the first electronic device, or an entire screen of the first electronic device. The preset offset threshold may be 5cm and the preset offset duration may be 10 seconds. For example, when the eye gazing focus of the first user is located in an area, which is within a display screen of the first electronic device, at an edge of the display screen, and outside the display screen, and is deviated from the display screen by a distance of less than or equal to 5cm, it is characterized that the first user is in a concentration state, and when an offset value between the eye gazing focus and a preset observation area is greater than 5cm, and a duration of the offset is greater than 5cm, it is determined that the concentration degree information of the first user is in a non-concentration state.
In this embodiment, when the monitoring data includes eye image monitoring data of the first user, the concentration degree of the first user may be obtained by determining whether the first user is in an eye-closing state. That is, obtaining the health status information of the first user according to the monitoring data further includes: according to the eye image monitoring data, obtaining the eye closing duration of the first user; and under the condition that the eye closing duration of the first user is greater than or equal to the preset eye closing duration, determining that the concentration degree information of the first user is in a non-concentration state.
The preset eye-closing time period may be 1 second, when the eye-closing time period of the first user is greater than 1 second, the first user may be considered to be in the non-concentration state, when the eye-closing time period is less than 1 second, the first user may be characterized as a normal blink, and in addition, special cases such as the first user rubbing eyes, one eye being open and one eye being closed may be labeled as a normal state, and not labeled as a non-concentration state.
In this embodiment, it can be determined that the user is in the non-attentive state when the deviation value between the eye gazing focus and the preset observation area is greater than the preset deviation threshold value or the eye closing time length is greater than or equal to the preset eye closing time length.
In this embodiment, in a case that the monitoring data includes facial image monitoring data of the first user, obtaining health status information of the first user according to the monitoring data, further includes: determining whether an image frame representing that a first user makes a first preset action exists or not according to the face image monitoring data; and under the condition that the image frames represent that the first user makes a first preset action, determining the fatigue degree information of the first user as a fatigue state.
The first preset action may be an action of eye closure or yawning or the like indicating that the first user is prone to fatigue. That is, in the case that it is detected that the first user has a fatigue condition such as eye microscissing or yawning, it is determined that the first user is in a fatigue state.
In this embodiment, considering that the posture and the environmental factors of the first user when using the first electronic device also affect the health condition of the first user, in this embodiment, the posture information of the first user is obtained according to the image monitoring data when the monitoring data includes the image monitoring data and the environmental brightness data of the first user; and when the posture information and the environment brightness data of the first user meet preset conditions, determining the eyesight protection degree information of the first user as the eyesight influence state.
The posture information of the first user comprises posture information representing that the first user is in an undesirable sitting posture state, a walking state, a shaking state and the like when the first user uses the first electronic device.
The preset condition may be that the first user is in a lying posture, a walking state, a shaking state and other posture states which affect eyesight, and the ambient brightness is less than the screen brightness of the first electronic device.
That is to say, when the image monitoring data of the first user indicates that the first user is in a posture state affecting eyesight, such as a lying posture, a walking state, a shaking state, and the like, or the ambient brightness data indicates that the ambient brightness is less than the screen brightness of the first electronic device, the eyesight protection degree information of the first user is determined to be the eyesight affecting state.
In a possible embodiment, the image monitoring data of the first user may further include distance data of the first user from the first electronic device, which is used to determine a distance between the eyes of the first user and the display screen of the first electronic device, and determine the eyesight protection information of the first user as the eyesight affecting state if the distance between the eyes of the first user and the display screen of the first electronic device exceeds a healthy distance.
In a possible embodiment, the health degree information of the first user may also be obtained through the self-operation data of the first electronic device, for example, the operation duration of the first electronic device, the media playing volume of the first electronic device, and the like, and when the operation duration of the first electronic device is greater than the preset operation duration, the eyesight protection degree information of the first user is determined to be the eyesight-affecting state.
Referring to fig. 3, fig. 3 shows a starting interface for starting the eyesight protection monitoring state, where the interface includes monitoring items related to eyesight protection degree information, and by starting each detection item, it is possible to perform acquisition of each item of detection information when the first user uses the first electronic device, and perform each item of reminder when the detection information indicates that the first user is in an unhealthy state.
In a possible example, the statistical chart may also be generated according to the overall concentration degree of the first user when the first electronic device is used to run each application software, for example, as shown in fig. 4, the concentration duration of the first user for each application is counted, the concentration duration of the first user when the application a is run is 1 hour and 40 minutes, and the concentration duration of the first user when the application B is run is 1 hour.
And S1300, generating notification information and sending the notification information to the second electronic equipment under the condition that the health state information represents that the first user is in the unhealthy state.
The notification information may include notification content such as "child is in a non-attentive state", "child is in a tired state", "child is looking away at the device, etc. The display interface at the second terminal after the notification information is sent to the second electronic device is shown in fig. 5. Referring to fig. 5, a floating window may be generated according to the notification information, and the floating window is configured to generate a reminding message according to the notification information, and the reminding message is sent to the first electronic device to remind the first user of maintaining the health status of using the first electronic device.
In this embodiment, both the notification information and the reminder information may be presented in the form of text notification information and/or 3D animation. For example, referring to fig. 5, the second electronic device receives notification information sent by the first electronic device, generates a first interface containing text notification information and/or 3D animation reminding information according to the content of the notification information, and displays the first interface through the second electronic device. Referring to fig. 6, the first electronic device receives the reminder information, generates a second interface containing text notification information and/or 3D animation reminder information according to the content of the reminder information, and displays the second interface through the first electronic device.
In one possible example, when the first electronic device is in a focused state, i.e. healthy use of the first electronic device, the 3D animation of the desktop display of the second electronic device is: the 3D cartoon child sits at the table and looks at the device.
When the distance between the eyes of the child and the screen is less than 26cm and lasts for 10s, the first electronic device sends notification information to the second electronic device, and the desktop 3D animation of the second electronic device shows that: the 3D card is held to the equipment by a child's head, and the eyes are too close to the screen.
When a child is looking at the first electronic device askew, the first electronic device sends notification information to the second electronic device, and at this time, the desktop component of the parent's device appears as: the 3D cartoon child lies prone on a table or holds a face and looks at the screen askew.
When the child holds the device in hand and plays the device for 10s, the first electronic device sends notification information to the second electronic device, and at this time, the 3D animation of the desktop component of the parent's device appears as: the 3D cartoon child holds the mobile phone and walks and looks at the equipment at the same time.
Correspondingly, after receiving the reminder information of the first electronic device, the first electronic device may generate a second interface as shown in fig. 6.
According to the embodiment, health state information of a first user is obtained according to monitoring data of the first user in the process of using a first electronic device, whether the first user is in an unhealthy state is judged according to at least one of concentration degree information, fatigue degree information and eyesight protection degree information in the health state information, notification information is generated under the condition that the health state information represents that the first user is in the unhealthy state, and the notification information is sent to a second electronic device, so that the second user generates reminding information according to the notification information to remind the first user to keep the state of using the electronic device healthily.
It should be noted that, in the usage monitoring method for an electronic device provided in the embodiment of the present application, the execution main body may be a usage monitoring apparatus for the electronic device, or a control module in the usage monitoring apparatus for the electronic device, which is used for executing the usage monitoring method for loading the electronic device. In the embodiment of the present application, a usage monitoring method for loading an electronic device performed by a usage monitoring device of the electronic device is taken as an example, and the usage monitoring method of the electronic device provided in the embodiment of the present application is described.
Referring to fig. 7, the present embodiment provides a usage monitoring apparatus 700 for an electronic device, the apparatus including:
a data obtaining module 701, configured to obtain monitoring data during a process of using a first electronic device by a first user;
a data processing module 702, configured to obtain health state information of a first user according to the monitoring data, where the health state information includes at least one of concentration information, fatigue information, and eyesight protection information of the first user;
the reminding module 703 is configured to generate notification information and send the notification information to a second electronic device when the health status information indicates that the first user is in a state of using the electronic device unhealthy.
In one example, the reminder module is to: and receiving reminding information generated by a second electronic equipment user according to the notification information, generating a second interface containing text notification information and/or 3D animation reminding information according to the content of the reminding information, and displaying the second interface through the first electronic equipment.
In one example, the data processing module is configured to, in a case that the monitoring data includes eye image monitoring data of a first user, obtain an eye gazing focus of the first user according to the eye image monitoring data; acquiring a preset observation region, wherein the preset observation region is a preset range based on the display interface of the first electronic equipment; and under the condition that the deviation value of the eye watching focus and the preset observation area is greater than a preset deviation threshold value and the deviation duration is greater than a preset deviation duration, determining that the concentration degree information of the first user is in a non-concentration state, wherein the non-concentration state represents that the first user is in a non-health state.
In one example, the data processing module is configured to, when the monitoring data includes eye image monitoring data of a first user, obtain an eye closing duration of the first user according to the eye image monitoring data; and under the condition that the eye closing duration of the first user is greater than the preset eye closing duration, determining that the concentration degree information of the first user is in a non-concentration state.
In one example, the data processing module is configured to, in a case that the monitoring data includes facial image monitoring data of a first user, determine whether there is an image frame representing that the first user makes a first preset action according to the facial image monitoring data; determining fatigue information of the first user as a fatigue state in a case where the image frame characterizes the first user to make a first action, the fatigue state characterizing the first user in an unhealthy state.
In one example, the data processing module is configured to, in a case that the monitoring data includes image monitoring data of a first user and ambient brightness data, obtain posture information of the first user according to the image monitoring data; and when the posture information of the first user and the environment brightness data meet preset conditions, determining that the eyesight protection degree information of the first user is an eyesight influencing state, wherein the eyesight influencing state represents that the first user is in an unhealthy state.
According to the embodiment, health state information of a first user is obtained according to monitoring data of the first user in the process of using a first electronic device, whether the first user is in an unhealthy state is judged according to at least one of concentration degree information, fatigue degree information and eyesight protection degree information in the health state information, notification information is generated under the condition that the health state information represents that the first user is in the unhealthy state, and the notification information is sent to a second electronic device, so that the second user generates reminding information according to the notification information to remind the first user to keep the state of using the electronic device healthily.
The usage monitoring device of the electronic device in the embodiment of the present application may be a device, or may be a component, an integrated circuit, or a chip in a terminal. The device can be mobile electronic equipment or non-mobile electronic equipment. By way of example, the mobile electronic device may be a mobile phone, a tablet computer, a notebook computer, a palm top computer, a vehicle-mounted electronic device, a wearable device, an ultra-mobile personal computer (UMPC), a netbook or a Personal Digital Assistant (PDA), and the like, and the non-mobile electronic device may be a server, a Network Attached Storage (NAS), a Personal Computer (PC), a Television (TV), a teller machine or a self-service machine, and the like, and the embodiments of the present application are not particularly limited.
The usage monitoring device of the electronic device in the embodiment of the present application may be a device having an operating system. The operating system may be an Android operating system (Android), an iOS operating system, or other possible operating systems, which is not specifically limited in the embodiments of the present application.
The usage monitoring device for the electronic device provided in the embodiment of the present application can implement each process implemented in the method embodiment of the present embodiment, and is not described here again to avoid repetition.
Optionally, referring to fig. 8, an electronic device 800 is further provided in this embodiment of the present application, and includes a processor 801, a memory 802, and a program or an instruction stored in the memory 802 and executable on the processor 801, where the program or the instruction is executed by the processor 801 to implement each process of the embodiment of the usage monitoring method for an electronic device, and can achieve the same technical effect, and in order to avoid repetition, details are not repeated here.
It should be noted that the electronic devices in the embodiments of the present application include the mobile electronic devices and the non-mobile electronic devices described above.
Fig. 9 is a schematic diagram of a hardware structure of an electronic device implementing an embodiment of the present application.
The electronic device 1000 includes, but is not limited to: a radio frequency unit 1001, a network module 1002, an audio output unit 1003, an input unit 1004, a sensor 1005, a display unit 1006, a user input unit 1007, an interface unit 1008, a memory 1009, and a processor 1010.
Those skilled in the art will appreciate that the electronic device 1000 may further comprise a power source (e.g., a battery) for supplying power to various components, and the power source may be logically connected to the processor 1010 through a power management system, so as to implement functions of managing charging, discharging, and power consumption through the power management system. The electronic device structure shown in fig. 9 does not constitute a limitation of the electronic device, and the electronic device may include more or less components than those shown, or combine some components, or arrange different components, and thus, the description is not repeated here.
The processor 1010 is configured to obtain monitoring data during a process of using the first electronic device by a first user; obtaining health state information of a first user according to the monitoring data, wherein the health state information comprises at least one of concentration degree information, fatigue degree information and eyesight protection degree information of the first user; and generating notification information under the condition that the health state information represents that the first user is in an unhealthy state, and sending the notification information to second electronic equipment.
The processor 1010 is further configured to receive a prompting message generated by a user of a second electronic device according to the notification message, generate a second interface containing text notification messages and/or 3D animation prompting messages according to the content of the prompting message, and display the second interface through the first electronic device.
A processor 1010 further configured to monitor data including obtaining an eye gaze focus of the first user from eye image monitoring data; acquiring a preset observation region, wherein the preset observation region is a preset range based on the display interface of the first electronic equipment; and under the condition that the deviation value of the eye watching focus and the preset observation area is greater than a preset deviation threshold value and the deviation duration is greater than a preset deviation duration, determining that the concentration degree information of the first user is in a non-concentration state, wherein the non-concentration state represents that the first user is in a non-health state.
The processor 1010 is further configured to obtain an eye closing duration of the first user according to the eye image monitoring data; and under the condition that the eye closing duration of the first user is greater than or equal to the preset eye closing duration, determining that the concentration degree information of the first user is in a non-concentration state.
A processor 1010, further configured to determine whether there is an image frame representing that the first user performs a first preset action according to the facial image monitoring data; under the condition that the image frame represents that the first user makes a first preset action, determining that the fatigue degree information of the first user is a fatigue state, wherein the fatigue state represents that the first user is in an unhealthy state.
The processor 1010 is further configured to obtain posture information of the first user according to the image monitoring data; and when the posture information of the first user and the environment brightness data meet preset conditions, determining that the eyesight protection degree information of the first user is an eyesight influencing state, wherein the eyesight influencing state represents that the first user is in an unhealthy state.
It should be understood that in the embodiment of the present application, the input Unit 1004 may include a Graphics Processing Unit (GPU) 10041 and a microphone 10042, and the Graphics Processing Unit 10041 processes image data of still pictures or videos obtained by an image capturing device (such as a camera) in a video capturing mode or an image capturing mode. The display unit 1006 may include a display panel 10061, and the display panel 10061 may be configured in the form of a liquid crystal display, an organic light emitting diode, or the like. The user input unit 1007 includes a touch panel 10071 and other input devices 10072. The touch panel 10071 is also referred to as a touch screen. The touch panel 10071 may include two parts, a touch detection device and a touch controller. Other input devices 10072 may include, but are not limited to, a physical keyboard, function keys (e.g., volume control keys, switch keys, etc.), a trackball, a mouse, and a joystick, which are not described in detail herein. The memory 1009 may be used to store software programs as well as various data, including but not limited to application programs and operating systems. Processor 1010 may integrate an application processor that handles primarily operating systems, user interfaces, applications, etc. and a modem processor that handles primarily wireless communications. It will be appreciated that the modem processor described above may not be integrated into processor 1010.
The embodiment of the present application further provides a readable storage medium, where a program or an instruction is stored on the readable storage medium, and when the program or the instruction is executed by a processor, the program or the instruction implements each process of the embodiment of the usage monitoring method for an electronic device, and can achieve the same technical effect, and in order to avoid repetition, details are not repeated here.
The processor is the processor in the electronic device described in the above embodiment. The readable storage medium includes a computer readable storage medium, such as a Read-Only Memory (ROM), a Random Access Memory (RAM), a magnetic disk or an optical disk, and so on.
It should be noted that, in this document, the terms "comprises," "comprising," or any other variation thereof, are intended to cover a non-exclusive inclusion, such that a process, method, article, or apparatus that comprises a list of elements does not include only those elements but may include other elements not expressly listed or inherent to such process, method, article, or apparatus. Without further limitation, an element defined by the phrase "comprising an … …" does not exclude the presence of other like elements in a process, method, article, or apparatus that comprises the element. Further, it should be noted that the scope of the methods and apparatus of the embodiments of the present application is not limited to performing the functions in the order illustrated or discussed, but may include performing the functions in a substantially simultaneous manner or in a reverse order based on the functions involved, e.g., the methods described may be performed in an order different than that described, and various steps may be added, omitted, or combined. In addition, features described with reference to certain examples may be combined in other examples.
Through the above description of the embodiments, those skilled in the art will clearly understand that the method of the above embodiments can be implemented by software plus a necessary general hardware platform, and certainly can also be implemented by hardware, but in many cases, the former is a better implementation manner. Based on such understanding, the technical solutions of the present application may be embodied in the form of a software product, which is stored in a storage medium (such as ROM/RAM, magnetic disk, optical disk) and includes instructions for enabling a terminal (such as a mobile phone, a computer, a server, an air conditioner, or a network device) to execute the method according to the embodiments of the present application.
While the present embodiments have been described with reference to the accompanying drawings, it is to be understood that the invention is not limited to the precise embodiments described above, which are meant to be illustrative and not restrictive, and that various changes may be made therein by those skilled in the art without departing from the spirit and scope of the invention as defined by the appended claims.
Claims (12)
1. A usage monitoring method for an electronic device, comprising:
acquiring monitoring data in the process of using the first electronic equipment by a first user;
according to the monitoring data, health state information of a first user when the first user uses the first electronic device is obtained, wherein the health state information comprises at least one of concentration degree information, fatigue degree information and eyesight protection degree information of the first user;
and generating notification information under the condition that the health state information represents that the first user is in an unhealthy state, and sending the notification information to second electronic equipment.
2. The method of claim 1, further comprising:
receiving reminding information sent by second electronic equipment, and generating a second interface containing text notification information and/or 3D animation reminding information according to the content of the reminding information;
and displaying the second interface.
3. The method of claim 1, wherein the monitoring data comprises eye image monitoring data of the first user;
according to the monitoring data, obtaining health state information of the first user when the first user uses the first electronic device, wherein the health state information comprises:
according to the eye image monitoring data, obtaining eye gazing focus information of the first user; and the number of the first and second groups,
acquiring a preset observation region, wherein the preset observation region is a preset range based on the display interface of the first electronic equipment;
and under the condition that the deviation value of the eye watching focus and the preset observation area is greater than a preset deviation threshold value and the deviation duration is greater than a preset deviation duration, determining that the concentration degree information of the first user is in a non-concentration state, wherein the non-concentration state represents that the first user is in a non-health state.
4. The method of claim 1, wherein the monitoring data comprises eye image monitoring data of the first user;
according to the monitoring data, obtaining health state information of the first user when the first user uses the first electronic device, wherein the health state information comprises:
obtaining the eye closing duration of the first user according to the eye image monitoring data;
and under the condition that the eye closing duration of the first user is greater than or equal to the preset eye closing duration, determining that the concentration degree information of the first user is in a non-concentration state.
5. The method of claim 1, wherein the monitoring data comprises facial image monitoring data of the first user;
according to the monitoring data, obtaining health state information of the first user when the first user uses the first electronic device, wherein the health state information comprises:
determining whether an image frame representing that the first user makes a first preset action exists according to the face image monitoring data, wherein the first preset action comprises eye micro-closure or yawning;
under the condition that the image frame represents that the first user makes a first preset action, determining that the fatigue degree information of the first user is a fatigue state, wherein the fatigue state represents that the first user is in an unhealthy state.
6. The method of claim 1, wherein the monitoring data comprises image monitoring data and ambient brightness data of the first user;
according to the monitoring data, obtaining health state information of the first user when the first user uses the first electronic device, wherein the health state information comprises:
acquiring attitude information of the first user according to the image monitoring data;
and when the posture information of the first user and the environment brightness data meet preset conditions, determining that the eyesight protection degree information of the first user is an eyesight influencing state, wherein the eyesight influencing state represents that the first user is in an unhealthy state.
7. A usage monitoring apparatus of an electronic device, the apparatus comprising:
the data acquisition module is used for acquiring monitoring data in the process of using the first electronic equipment by a first user;
the data processing module is used for acquiring health state information of a first user when the first user uses the first electronic device according to the monitoring data, wherein the health state information comprises at least one of concentration degree information, fatigue degree information and eyesight protection degree information of the first user;
and the reminding module is used for generating notification information and sending the notification information to the second electronic equipment under the condition that the health state information represents that the first user is in the state of using the electronic equipment unhealthy.
8. The apparatus of claim 7,
the reminding module is also used for: and receiving reminding information generated by a second electronic equipment user according to the notification information, generating a second interface containing text notification information and/or 3D animation reminding information according to the content of the reminding information, and displaying the second interface.
9. The apparatus of claim 7,
the data processing module is used for acquiring an eye gazing focus of a first user according to eye image monitoring data under the condition that the monitoring data comprise the eye image monitoring data of the first user; and the number of the first and second groups,
acquiring a preset observation region, wherein the preset observation region is a preset range based on the display interface of the first electronic equipment;
and under the condition that the deviation value of the eye watching focus and the preset observation area is greater than a preset deviation threshold value and the deviation duration is greater than a preset deviation duration, determining that the concentration degree information of the first user is in a non-concentration state, wherein the non-concentration state represents that the first user is in a non-health state.
10. The apparatus of claim 7,
the data processing module is used for obtaining the eye closing duration of a first user according to the eye image monitoring data under the condition that the monitoring data comprise eye image monitoring data of the first user;
and under the condition that the eye closing duration of the first user is greater than or equal to the preset eye closing duration, determining that the concentration degree information of the first user is in a non-concentration state.
11. The apparatus of claim 7,
the data processing module is used for determining whether an image frame representing that the first user makes a first preset action exists or not according to the facial image monitoring data under the condition that the monitoring data comprise facial image monitoring data of the first user;
under the condition that the image frame represents that the first user makes a first preset action, determining that the fatigue degree information of the first user is a fatigue state, wherein the fatigue state represents that the first user is in an unhealthy state.
12. The apparatus of claim 7,
the data processing module is used for acquiring the posture information of the first user according to the image monitoring data under the condition that the monitoring data comprise the image monitoring data and the environment brightness data of the first user;
and when the posture information of the first user and the environment brightness data meet preset conditions, determining that the eyesight protection degree information of the first user is an eyesight influencing state, wherein the eyesight influencing state represents that the first user is in an unhealthy state.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202111017824.6A CN113709308A (en) | 2021-08-31 | 2021-08-31 | Usage monitoring method and device for electronic equipment |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202111017824.6A CN113709308A (en) | 2021-08-31 | 2021-08-31 | Usage monitoring method and device for electronic equipment |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN113709308A true CN113709308A (en) | 2021-11-26 |
Family
ID=78658461
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202111017824.6A Pending CN113709308A (en) | 2021-08-31 | 2021-08-31 | Usage monitoring method and device for electronic equipment |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN113709308A (en) |
Citations (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN106445092A (en) * | 2015-08-13 | 2017-02-22 | 中兴通讯股份有限公司 | Vision protection processing method and apparatus for terminal |
| CN108670260A (en) * | 2018-03-09 | 2018-10-19 | 广东小天才科技有限公司 | A kind of human fatigue detection method and mobile terminal based on mobile terminal |
| CN109496309A (en) * | 2018-08-07 | 2019-03-19 | 深圳市汇顶科技股份有限公司 | Detection method, device and the equipment of fatigue state |
| CN111357006A (en) * | 2017-11-15 | 2020-06-30 | 华为技术有限公司 | Fatigue prompting method and terminal |
| CN112163470A (en) * | 2020-09-11 | 2021-01-01 | 高新兴科技集团股份有限公司 | Fatigue state identification method, system and storage medium based on deep learning |
| CN112987922A (en) * | 2021-02-23 | 2021-06-18 | 百度在线网络技术（北京）有限公司 | Device control method and device for protecting eyes and electronic device |
-
2021
- 2021-08-31 CN CN202111017824.6A patent/CN113709308A/en active Pending
Patent Citations (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN106445092A (en) * | 2015-08-13 | 2017-02-22 | 中兴通讯股份有限公司 | Vision protection processing method and apparatus for terminal |
| CN111357006A (en) * | 2017-11-15 | 2020-06-30 | 华为技术有限公司 | Fatigue prompting method and terminal |
| CN108670260A (en) * | 2018-03-09 | 2018-10-19 | 广东小天才科技有限公司 | A kind of human fatigue detection method and mobile terminal based on mobile terminal |
| CN109496309A (en) * | 2018-08-07 | 2019-03-19 | 深圳市汇顶科技股份有限公司 | Detection method, device and the equipment of fatigue state |
| CN112163470A (en) * | 2020-09-11 | 2021-01-01 | 高新兴科技集团股份有限公司 | Fatigue state identification method, system and storage medium based on deep learning |
| CN112987922A (en) * | 2021-02-23 | 2021-06-18 | 百度在线网络技术（北京）有限公司 | Device control method and device for protecting eyes and electronic device |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US10659405B1 (en) | Avatar integration with multiple applications | |
| KR20090090362A (en) | System and method for utilizing idle mode on an electronic device | |
| EP4351149A1 (en) | Display control method and apparatus, and device and storage medium | |
| KR20170013623A (en) | Apparatus and method for controlling a display | |
| CN106648380A (en) | Method and system for displaying prompt information and readable storage medium | |
| WO2022247744A1 (en) | Icon display method and apparatus, and electronic device | |
| CN112783594A (en) | Message display method and device and electronic equipment | |
| CN114008578A (en) | Method and apparatus for managing operations on data presented on a display | |
| CN112286347A (en) | Eyesight protection method, device, storage medium and terminal | |
| CN111651106A (en) | Unread message prompting method, unread message prompting device, unread message prompting equipment and readable storage medium | |
| CN113709306B (en) | Session processing method and device and electronic equipment | |
| CN113556603B (en) | Method and device for adjusting video playing effect and electronic equipment | |
| US20180189994A1 (en) | Method and apparatus using augmented reality with physical objects to change user states | |
| CN112788178B (en) | Message display method and device | |
| CN113783995A (en) | Display control method, display control device, electronic apparatus, and medium | |
| CN111669660B (en) | Bullet screen information processing method and device and electronic equipment | |
| CN112035877A (en) | Information hiding method and device, electronic equipment and readable storage medium | |
| CN113709308A (en) | Usage monitoring method and device for electronic equipment | |
| US9407864B2 (en) | Data processing method and electronic device | |
| CN115543137A (en) | Video playing method and device | |
| CN111679776B (en) | Advertisement playing control method and device, electronic device and storage medium | |
| CN113553156A (en) | Information prompting method and device, computer equipment and computer storage medium | |
| CN113849721A (en) | Buffer processing method and device | |
| CN113703592A (en) | Secure input method and device | |
| CN106909857B (en) | Information output display method and device and user equipment |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| RJ01 | Rejection of invention patent application after publication |
Application publication date: 20211126 |
|
| RJ01 | Rejection of invention patent application after publication |