CN111275942A - Operation process monitoring method - Google Patents

Operation process monitoring method Download PDF

Info

Publication number
CN111275942A
CN111275942A CN202010084486.7A CN202010084486A CN111275942A CN 111275942 A CN111275942 A CN 111275942A CN 202010084486 A CN202010084486 A CN 202010084486A CN 111275942 A CN111275942 A CN 111275942A
Authority
CN
China
Prior art keywords
module
data
user
image data
data processing
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
CN202010084486.7A
Other languages
Chinese (zh)
Inventor
崔荣华
潘宝珠
仲崇贵
李红兵
赵永林
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Nantong University
Original Assignee
Nantong University
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Nantong University filed Critical Nantong University
Priority to CN202010084486.7A priority Critical patent/CN111275942A/en
Publication of CN111275942A publication Critical patent/CN111275942A/en
Pending legal-status Critical Current

Links

Images

Classifications

    • GPHYSICS
    • G08SIGNALLING
    • G08BSIGNALLING OR CALLING SYSTEMS; ORDER TELEGRAPHS; ALARM SYSTEMS
    • G08B21/00Alarms responsive to a single specified undesired or abnormal condition and not otherwise provided for
    • G08B21/18Status alarms
    • G08B21/24Reminder alarms, e.g. anti-loss alarms
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06VIMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V20/00Scenes; Scene-specific elements
    • G06V20/40Scenes; Scene-specific elements in video content
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06VIMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V20/00Scenes; Scene-specific elements
    • G06V20/50Context or environment of the image
    • G06V20/52Surveillance or monitoring of activities, e.g. for recognising suspicious objects
    • GPHYSICS
    • G08SIGNALLING
    • G08BSIGNALLING OR CALLING SYSTEMS; ORDER TELEGRAPHS; ALARM SYSTEMS
    • G08B25/00Alarm systems in which the location of the alarm condition is signalled to a central station, e.g. fire or police telegraphic systems
    • G08B25/01Alarm systems in which the location of the alarm condition is signalled to a central station, e.g. fire or police telegraphic systems characterised by the transmission medium
    • G08B25/08Alarm systems in which the location of the alarm condition is signalled to a central station, e.g. fire or police telegraphic systems characterised by the transmission medium using communication transmission lines

Landscapes

  • Physics & Mathematics (AREA)
  • Engineering & Computer Science (AREA)
  • General Physics & Mathematics (AREA)
  • Multimedia (AREA)
  • Theoretical Computer Science (AREA)
  • Business, Economics & Management (AREA)
  • Emergency Management (AREA)
  • Two-Way Televisions, Distribution Of Moving Picture Or The Like (AREA)
  • Alarm Systems (AREA)

Abstract

The invention provides an operation process supervision method, which comprises the following steps: s10, the domestic data processing module obtains the image data position data when the user uses the image data position data through a camera and a distance sensor arranged on the display module; s20, the domestic data processing module sends the image data and the position data to a remote data processing module; s30, the remote data processing module compares the image data with a preset value to judge whether the sitting posture of the user is correct; and S40, the remote data processing module compares the image data with the existing expression database to judge whether the user needs to be reminded to rest or intervene by others. The operation process monitoring method provided by the invention can monitor the operation state of the user in real time, and the guardian is required to intervene when an abnormality occurs in the operation process, thereby saving a large amount of time for the guardian.

Description

Operation process monitoring method
Technical Field
The invention relates to the technical field of electronic information, in particular to an operation process supervision method.
Background
With the gradual rise of living conditions of people and the increase of families of solitary children, the number of families for four to six adults to breed one child is gradually increased. The interest in education of children has also increased year by year. At present, the study of children is not a single thing of children, and becomes the first thing of all families.
At present, the study of children is mainly supervised by parents, especially the study of children with small school age, and the study habits and study attitudes are not developed, so the study of children is supervised by parents in the whole course. The supervision of the family operation of the children does not take up the time of parents, and meanwhile, the parents have haggard central force and even sudden death in the process of supervising the family operation of the children. The relationship between parents and children is further worsened, and some parents even leave the child to take the baby for the full time of work for the education of children, so that the influence on some families with good conditions is small, and the survival pressure of the families is further increased for the families with common conditions.
Disclosure of Invention
In order to solve the above problems, the present invention provides an operation process monitoring method, which can monitor the operation state of a user in real time, and only needs the intervention of a guardian when an abnormality occurs in the operation process, thereby saving a lot of time for the guardian.
In order to achieve the above purpose, the invention adopts a technical scheme that:
an operation process supervision method comprises the following steps: s10, the household data processing module obtains image data and position data of a user during use through a camera and a distance sensor arranged on the display module; s20, the domestic data processing module sends the image data and the position data to a remote data processing module; s30, the remote data processing module compares the image data with a preset value to judge whether the sitting posture of the user is correct; and S40, the remote data processing module compares the image data with the existing expression database to judge whether the user needs to be reminded to rest or intervene by others.
Further, the method also comprises the following steps: s50, the remote data processing module compares the image data with the existing identity database to obtain the duration of each state of the user.
Further, the display module is a touchable display screen; the home data processing module includes: the data acquisition module is connected with the display module and is used for acquiring the sound and image information obtained by the display module; the control module is connected with the data acquisition module and the display module and can realize data transmission with the remote data processing module through a wireless network; the first storage module is connected with the control module; the remote data processing module includes: a data receiving feedback module; the position judgment module is connected with the data receiving feedback module; the expression judging module is connected with the data receiving feedback module; the identity data analysis module is connected with the data receiving feedback module; and the second storage module is connected with the identity data analysis module.
Further, in step S10, the data acquisition module acquires image data and position data through a camera and a distance sensor and sends the image data and the position data to the control module; in step S20, the control module sends the image and the position data to the data receiving and feedback module; in step S30, the data receiving and feedback module compares the image data with a preset value in the second storage module to determine whether the sitting posture of the user is correct; in step S40, the data receiving and feedback module sends the image data to the expression judgment module, and the expression judgment module compares the image data with the expression database stored in the second storage module to judge whether the user needs to be reminded to rest or intervene by others.
Further, in step S50, the data receiving feedback module sends the image data to the identity data analysis module, and the identity data analysis module compares the image data with an identity database stored in the second storage module to obtain the duration of each state of the user.
Further, in step S30, when the data receiving and feedback module finds that the sitting posture of the user is incorrect, the data receiving and feedback module feeds back information to the display module through the control module so as to remind the user to adjust the sitting posture to meet the sitting posture requirement.
Further, in the step S40, when the data receiving feedback module finds that the user is in a passive state for a long time, the data is fed back to the guardian mobile phone to remind the guardian to process the data; the guardian sends an instruction to the control module for interference through the data receiving feedback module; the instruction information comprises video or audio information; and the video or audio information is displayed or played through the display module.
Compared with the prior art, the technical scheme of the invention has the following advantages:
(1) the operation process monitoring method provided by the invention can monitor the operation state of the user in real time, and the guardian is required to intervene when an abnormality occurs in the operation process, thereby saving a great deal of time and energy of the guardian. In the system, the guardian plays the roles of relaxing the mood of the child and occasionally supervising the operation of the child, thereby avoiding the direct blame for the child and the upgrading of family contradiction. Is beneficial to building a good family atmosphere.
(2) The operation process monitoring method provided by the invention can check the operation process of a user at any time, remind the user of an error operation posture and prevent the problems of spinal deformation, myopia and the like caused by the error operation posture.
(3) The operation process monitoring method provided by the invention can collect the operation process data of the user through the identity data analysis module and store the operation process data in the second storage module. The work process data may provide researchers with data addressing the efficiency of the user's work.
Drawings
The technical solution and the advantages of the present invention will be apparent from the following detailed description of the embodiments of the present invention with reference to the accompanying drawings.
FIG. 1 is a flow chart of a method for using an operating process monitoring system according to an embodiment of the present invention;
FIG. 2 is a diagram illustrating an exemplary application of a display module according to an embodiment of the present invention;
fig. 3 is a diagram illustrating an operation process monitoring system according to an embodiment of the present invention.
Reference numerals in the figures
The system comprises a display module 1, a camera 11, a distance sensor 12, a display screen 13, a household data processing module 2, a data acquisition module 21, a control module 22, a first storage module 23, a remote data processing module 3, a data receiving and feedback module 31, a position judgment module 32, an expression judgment module 33, an identity data analysis module 34 and a second storage module 35.
Detailed Description
The technical solutions in the embodiments of the present invention will be clearly and completely described below with reference to the drawings in the embodiments of the present invention, and it is obvious that the described embodiments are only a part of the embodiments of the present invention, and not all of the embodiments. All other embodiments, which can be derived by a person skilled in the art from the embodiments given herein without making any creative effort, shall fall within the protection scope of the present invention.
As shown in fig. 1, the present invention further provides an operation process monitoring method, which includes the following steps: s10 the domestic data processing module obtains the image data and position data when the user uses through the camera and the distance sensor arranged on the display module. S20, the domestic data processing module sends the image data and the position data to a remote data processing module. S30, the remote data processing module compares the image data with a preset value to judge whether the sitting posture of the user is correct. S40, the remote data processing module compares the image data with the existing expression database to judge whether the user needs to be reminded to rest or intervene by others. S50, the remote data processing module compares the image data with the existing identity database to obtain the duration of each state of the user.
As shown in fig. 2 to 3, the display module 1 is touchable, and the display 13 has a camera 11, a distance sensor 12, a microphone, and a speaker built therein. The display screen is arranged on the desk through the base. The camera 11 is disposed on the upper portion of the display screen 13 and is used for acquiring image data of a user. The distance sensor 12 is disposed at a lower portion of the display screen 13, and is configured to obtain position data of a user.
The household data processing module 2 is electrically connected with the display module 1 and is used for collecting and processing the operation state data of a user. The home data processing module 2 includes a data acquisition module 21, a control module 22, and a first storage module 23. The data acquisition module 21 is electrically connected to the display module 1, and is configured to acquire image data obtained by the display module 1. The control module 22 is connected to the data acquisition module 21 and the display module 1, and is configured to control the data acquisition module 21 to acquire the image data and the position data through the display module 1, and control the display module 1 to play prompt information. The control module 22 can realize data transmission with the remote data processing module 3 through a wireless network. The first storage module 23 is connected to the control module 22 and is used for prestoring prompt data such as video, audio and the like. The control module 22 calls the prompt data in the first storage module 23 to be displayed on the display module 1.
The remote data processing module 3 is connected with the household data processing module 2 through a wireless network and is used for analyzing and processing the operation state data of the user and feeding back the analysis result to the household data processing module 2 and the guardian. The remote data processing module 3 includes a data receiving feedback module 31, a position determination module 32, an expression determination module 33, an identity data analysis module 34, and a second storage module 35. The data receiving feedback module 31 is configured to receive the image data output by the control module 22, and distribute the image data to other modules for processing. The position judgment module 32 is connected to the data receiving feedback module 31. Used for judging whether the sitting posture of the user is correct or not. The expression judging module 33 is connected with the data receiving feedback module 31. And is used for identifying the expression of the user and comparing the expression with the expression information prestored in the second storage module 35 to obtain the mental state data of the user. The identity data analysis module 34 is connected to the data receiving feedback module 31. And is configured to identify the identity information of the user, and send the identity information data and the user usage status parameter to the second storage module 35.
In step S10, when the user uses the operation process monitoring system to operate, the data acquisition module 21 obtains image data and position data through a camera and a distance sensor and sends the image data and position data to the control module 22.
In step S20, the control module 22 sends the image data and the position data to the data receiving and feedback module 31.
In step S30, the data receiving and feedback module 31 sends the image data and the position data to the position determining module 32, and determines whether the sitting posture of the user is correct. The position judging module 32 compares the upper, lower, left, right, front and rear positions of the human face in the picture with the preset sitting posture data in the second storage module 35, judges whether the sitting posture of the user is correct, and transmits the data to the data receiving and feedback module 31 for processing. When the data receiving feedback module 31 finds that the sitting posture of the user is incorrect, the control module 22 calls the prompting information pre-stored in the first memory 23, and the control module 22 sends the prompting information to the display module 1 to prompt the user. Until the user's posture is correct.
In the step S40, the data receiving and feedback module 31 sends the image data to the expression judgment module 33, and the expression judgment module 33 compares the image data with the expression database stored in the second storage module 35 to judge whether the user needs to be reminded to rest or intervene by others. When the data receiving feedback module 31 finds that the user is in a passive state for a long time, it indicates that the user may not be suitable to continue to be in a learning or working state. The data receiving and feedback module 31 feeds back data to the mobile phone of the guardian to remind the guardian to process the data. The guardian sends an instruction to the control module 22 for intervention through the data receiving feedback module 31. After receiving the instruction, the control module 22 calls the prompt information in the first storage module 23 to perform interference. The prompt message includes video or audio information stored in the first storage module 23. The video or audio information is displayed or played through the display module 1. The guardian can also request the control module 21 to establish a video with the display 13 through the data receiving feedback module 31, so as to perform video communication with the user.
In step S50, the data receiving and feedback module 31 sends the image data to the identity data analysis module 34, and the identity data analysis module 34 compares the image data with the identity database stored in the second storage module 35 to obtain the duration of each state of the user. The identity data analysis module 34 compares the facial image analysis with the existing identity database to obtain the information of the user such as age, identity, family background, etc., and stores the information together with the useful information of the user such as duration of various states, expression changes, etc. Through a large amount of individual data stored in the second storage module 35, researchers can analyze the corresponding relationship between users with different home backgrounds and the efficient learning duration; analyzing the corresponding relation between users of different ages and the high-efficiency working or learning duration; and analyzing the corresponding relation between different working properties and the high-efficiency working or learning duration. The data receiving and feedback module 31 can take classification intervention measures for users with different family backgrounds, different ages and different working properties according to the analysis result, play different music, make different sounds, or play different videos, and the like, so that the users can have better middle rest, are less tired, are beneficial to eyesight protection, and improve the working efficiency.
The above description is only an exemplary embodiment of the present invention, and not intended to limit the scope of the present invention, and all equivalent structures or equivalent processes that are transformed by the content of the present specification and the attached drawings, or directly or indirectly applied to other related technical fields, are included in the scope of the present invention.

Claims (7)

1. An operation process supervision method is characterized by comprising the following steps:
s10, the household data processing module obtains image data and position data of a user during use through a camera and a distance sensor arranged on the display module;
s20, the domestic data processing module sends the image data and the position data to a remote data processing module;
s30, the remote data processing module compares the image data with a preset value to judge whether the sitting posture of the user is correct; and
s40, the remote data processing module compares the image data with the existing expression database to judge whether the user needs to be reminded to rest or intervene by others.
2. The work process supervision method according to claim 1, characterized by further comprising the steps of:
s50, the remote data processing module compares the image data with the existing identity database to obtain the duration of each state of the user.
3. The work process supervision method according to claim 2,
the display module is a touchable display screen;
the home data processing module includes: the data acquisition module is connected with the display module and is used for acquiring the sound and image information obtained by the display module; the control module is connected with the data acquisition module and the display module and can realize data transmission with the remote data processing module through a wireless network; the first storage module is connected with the control module;
the remote data processing module includes: a data receiving feedback module; the position judgment module is connected with the data receiving feedback module; the expression judging module is connected with the data receiving feedback module; the identity data analysis module is connected with the data receiving feedback module; and the second storage module is connected with the identity data analysis module.
4. The work process supervision method according to claim 3,
in the step S10, the data acquisition module acquires image data and position data through a camera and a distance sensor and sends the image data and the position data to the control module;
in step S20, the control module sends the image and the position data to the data receiving and feedback module;
in step S30, the data receiving and feedback module compares the image data with a preset value in the second storage module to determine whether the sitting posture of the user is correct;
in step S40, the data receiving and feedback module sends the image data to the expression judgment module, and the expression judgment module compares the image data with the expression database stored in the second storage module to judge whether the user needs to be reminded to rest or intervene by others.
5. The work process supervision method according to claim 3,
in step S50, the data receiving and feedback module sends the image data to the identity data analysis module, and the identity data analysis module compares the image data with the identity database stored in the second storage module to obtain the duration of each state of the user.
6. The method for supervising a work process of claim 4, wherein in step S30, when the data receiving and feedback module finds that the sitting posture of the user is incorrect, the data receiving and feedback module feeds back information to the display module through the control module so as to remind the user to adjust the sitting posture to meet the requirement.
7. The method as claimed in claim 4, wherein the step S40 is performed when the data receiving feedback module finds that the user is in a passive state for a long time, the data is fed back to the guardian' S mobile phone to remind the guardian to process the data; the guardian sends an instruction to the control module for interference through the data receiving feedback module; the instruction information comprises video or audio information; and the video or audio information is displayed or played through the display module.
CN202010084486.7A 2020-02-10 2020-02-10 Operation process monitoring method Pending CN111275942A (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN202010084486.7A CN111275942A (en) 2020-02-10 2020-02-10 Operation process monitoring method

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN202010084486.7A CN111275942A (en) 2020-02-10 2020-02-10 Operation process monitoring method

Publications (1)

Publication Number Publication Date
CN111275942A true CN111275942A (en) 2020-06-12

Family

ID=71002116

Family Applications (1)

Application Number Title Priority Date Filing Date
CN202010084486.7A Pending CN111275942A (en) 2020-02-10 2020-02-10 Operation process monitoring method

Country Status (1)

Country Link
CN (1) CN111275942A (en)

Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN204695520U (en) * 2015-05-18 2015-10-07 深圳市奇胜隆实业有限公司 A kind of student desk lamp
WO2017021760A1 (en) * 2015-08-06 2017-02-09 Institucion Universitaria Salazar Y Herrera Smart teaching system for a classroom
CN208225254U (en) * 2018-02-11 2018-12-11 上海复旦通讯股份有限公司 A kind of warning device for the monitoring of children's mood
CN109819402A (en) * 2019-01-08 2019-05-28 李超豪 For supervising the method and its system that improve study habit
CN110033400A (en) * 2019-03-26 2019-07-19 深圳先进技术研究院 A kind of classroom monitoring analysis system
CN110211437A (en) * 2019-06-14 2019-09-06 斯坦福启天联合(广州)研究院有限公司 A kind of multi-screen information interaction control system based on classroom instruction

Patent Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN204695520U (en) * 2015-05-18 2015-10-07 深圳市奇胜隆实业有限公司 A kind of student desk lamp
WO2017021760A1 (en) * 2015-08-06 2017-02-09 Institucion Universitaria Salazar Y Herrera Smart teaching system for a classroom
CN208225254U (en) * 2018-02-11 2018-12-11 上海复旦通讯股份有限公司 A kind of warning device for the monitoring of children's mood
CN109819402A (en) * 2019-01-08 2019-05-28 李超豪 For supervising the method and its system that improve study habit
CN110033400A (en) * 2019-03-26 2019-07-19 深圳先进技术研究院 A kind of classroom monitoring analysis system
CN110211437A (en) * 2019-06-14 2019-09-06 斯坦福启天联合(广州)研究院有限公司 A kind of multi-screen information interaction control system based on classroom instruction

Similar Documents

Publication Publication Date Title
US20210118278A1 (en) Thoughtful elderly monitoring in a smart home environment
CN109920544B (en) Real-time self-adaptive intelligent building system based on somatosensory information
CN109326081A (en) Old man family nurse early warning system and health Evaluation method based on Internet of Things
CN106792177A (en) A kind of TV control method and system
CN210039226U (en) Teaching classroom control system
CN106693143A (en) Sleeping-aiding method and device
WO2022252673A1 (en) Control method and apparatus for household appliance for adjusting fatigue degree, and household appliance
CN111707375B (en) Electronic class card with intelligent temperature measurement attendance and abnormal behavior detection functions
CN109819402A (en) For supervising the method and its system that improve study habit
CN106295158B (en) A kind of automatic aided management system of infant, management method and equipment
CN112147911A (en) Equipment control method and device
CN109949935A (en) A kind of personalized terminal service campus health platform based on artificial intelligence
CN108375909A (en) A kind of parameters analysis method, device, equipment and computer readable storage medium
CN111931608A (en) Operation management method and system based on student posture and student face recognition
CN110687804B (en) Household appliance control method, household appliance control device, storage medium, household appliance control system and terminal
CN111310629A (en) Operation process monitoring system
WO2022227531A1 (en) Intelligent control method and apparatus for air conditioner, electronic device, and storage medium
US20190193280A1 (en) Method for personalized social robot interaction
CN111275942A (en) Operation process monitoring method
CN212569810U (en) Myopia prevention monitoring system based on vision
CN112700353A (en) Smart classroom system, student health data management method, server, and medium
CN111290303B (en) Intelligent control system for adjusting use state of seat
CN204859299U (en) Display device
CN113411722A (en) Intelligent background music system
CN206980051U (en) A kind of regional gambling system based on wearable smart machine

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
RJ01 Rejection of invention patent application after publication

Application publication date: 20200612

RJ01 Rejection of invention patent application after publication