CN111079513A - Posture reminding method and device, mobile terminal and storage medium - Google Patents
Posture reminding method and device, mobile terminal and storage medium Download PDFInfo
- Publication number
- CN111079513A CN111079513A CN201911031302.4A CN201911031302A CN111079513A CN 111079513 A CN111079513 A CN 111079513A CN 201911031302 A CN201911031302 A CN 201911031302A CN 111079513 A CN111079513 A CN 111079513A
- Authority
- CN
- China
- Prior art keywords
- user
- head
- shoulder
- reminding
- neck
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06V40/00—Recognition of biometric, human-related or animal-related patterns in image or video data
- G06V40/10—Human or animal bodies, e.g. vehicle occupants or pedestrians; Body parts, e.g. hands
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06V10/00—Arrangements for image or video recognition or understanding
- G06V10/40—Extraction of image or video features
- G06V10/44—Local feature extraction by analysis of parts of the pattern, e.g. by detecting edges, contours, loops, corners, strokes or intersections; Connectivity analysis, e.g. of connected components
-
- G—PHYSICS
- G08—SIGNALLING
- G08B—SIGNALLING OR CALLING SYSTEMS; ORDER TELEGRAPHS; ALARM SYSTEMS
- G08B21/00—Alarms responsive to a single specified undesired or abnormal condition and not otherwise provided for
- G08B21/18—Status alarms
- G08B21/24—Reminder alarms, e.g. anti-loss alarms
Landscapes
- Engineering & Computer Science (AREA)
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- Multimedia (AREA)
- Theoretical Computer Science (AREA)
- Human Computer Interaction (AREA)
- Computer Vision & Pattern Recognition (AREA)
- Business, Economics & Management (AREA)
- Emergency Management (AREA)
- Telephone Function (AREA)
Abstract
The embodiment of the invention discloses a posture reminding method, a posture reminding device, a mobile terminal and a storage medium, wherein the method comprises the following steps: acquiring a user image when a user uses the mobile terminal; judging the posture according to the head, neck and shoulder information in the user image; and if the judgment result is that the current head, neck and shoulder postures meet the reminding condition, executing reminding operation. According to the embodiment of the invention, the head, shoulder and neck information in the user image is used for reminding the user of the bad head, shoulder and neck postures, so that the user can keep the correct head, shoulder and neck posture when using the mobile terminal in a sitting posture or a standing posture, and the excessive pressure of the cervical vertebra is avoided.
Description
Technical Field
The embodiment of the invention relates to a terminal technology, in particular to a posture reminding method, a posture reminding device, a mobile terminal and a storage medium.
Background
With the development of the internet, the popularization of mobile terminals brings great convenience to people, for example, learning, games, video interaction and the like can be achieved by using the mobile terminals.
When the user uses the mobile terminal to realize the convenient function, the user is easy to indulge in the function, and the user can unconsciously use the mobile terminal in bad postures, particularly head, neck and shoulder postures such as head bending, head lowering, back bending, head leaning left and right and the like, so that the shoulder and neck pressure is too high, and the health is influenced. For example, when a user lowers his head to play a mobile phone, the pressure on the cervical vertebrae is as high as 60 pounds, which has been a cause of cervical spondylosis in the past.
In view of the above problems, no effective solution has been proposed.
Disclosure of Invention
The embodiment of the invention provides a posture reminding method, a posture reminding device, a mobile terminal and a storage medium, which are used for at least solving the problem that in the prior art, a user uses the mobile terminal in a bad head, neck and shoulder posture to cause overlarge cervical vertebra pressure, and can timely detect the bad posture of the user and remind the user.
In a first aspect, an embodiment of the present invention provides a posture reminding method, including:
acquiring a user image when a user uses the mobile terminal;
judging the posture according to the head, neck and shoulder information in the user image;
and if the judgment result is that the current head, neck and shoulder postures meet the reminding condition, executing reminding operation.
Optionally, acquiring a user image when the user uses the mobile terminal includes:
when a user uses the mobile terminal, detecting that a posture reminding function is in an open state;
and acquiring the user image through a front camera of the mobile terminal.
Optionally, the posture judgment is performed according to the head, neck and shoulder information in the user image, and the posture judgment includes:
judging the posture according to the head, neck and shoulder contour information in the user image to obtain a first result;
judging the posture according to the head pitching information in the user image to obtain a second result;
correspondingly, if the judgment result is that the current head, neck and shoulder postures meet the reminding condition, executing the reminding operation, including:
and if any one of the first result and the second result is that the current head, neck and shoulder posture meets the reminding condition, executing the reminding operation.
Optionally, the posture is determined according to the head, neck and shoulder contour information in the user image, and a first result is obtained, including:
extracting a head-neck-shoulder contour edge line in the user image;
comparing the head, neck and shoulder contour edge line with a reference contour edge line in a prestored image;
if the comparison result does not meet the preset condition, determining that the current head, neck and shoulder posture meets the reminding condition;
the preset conditions are that the shapes are the same and are at a preset scaling ratio.
Optionally, the determining the posture according to the head pitch information in the user image to obtain a second result includes:
determining a reference point and a user shoulder reference line in the user image through image recognition;
calculating a distance from the reference point to the shoulder reference line;
judging whether the distance from the reference point to the shoulder reference line is smaller than a preset threshold value or not;
if yes, determining that the user is in a head-lowering posture, and meeting a reminding condition.
Optionally, before determining whether the distance from the reference point to the shoulder reference line is smaller than a preset threshold, the method further includes: and acquiring the corresponding preset threshold according to the distance between the user and the mobile terminal.
Optionally, before acquiring the user image when the user uses the mobile terminal, the method further includes: acquiring the angle of a plane where a screen of the mobile terminal is located relative to the ground; and if the angle is within a preset angle range, acquiring the user image.
Optionally, before acquiring the user image when the user uses the mobile terminal, the method further includes: responding to a posture reminding setting instruction, outputting prompt information to prompt the user to enter posture reference information according to the prompt information; storing the attitude reference information.
Optionally, the executing of the reminding operation includes: outputting the reminding information according to at least one of the following modes: interface display, voice broadcast and light change.
Optionally, after the reminding information is output, the method further includes: and when the detected duration that the user is in the head, neck and shoulder postures meeting the reminding condition reaches the preset duration, controlling the mobile terminal to turn off the screen.
In a second aspect, an embodiment of the present invention further provides a posture reminding device, including:
the acquisition module is used for acquiring a user image when a user uses the mobile terminal;
the judging module is used for judging the posture according to the head, neck and shoulder information in the user image;
and the reminding module is used for executing reminding operation under the condition that the judgment result is that the current head, neck and shoulder postures meet the reminding condition.
In a third aspect, an embodiment of the present invention further provides a mobile terminal, including:
one or more processors;
a memory for storing one or more programs;
the image acquisition device is used for acquiring a user image;
when executed by the one or more processors, cause the one or more processors to implement a method according to any embodiment of the invention.
In a fourth aspect, the embodiments of the present invention further provide a computer-readable storage medium, on which a computer program is stored, and the computer program, when executed by a processor, implements the method according to any of the embodiments of the present invention.
According to the technical scheme of the embodiment of the invention, the head portrait of the user when the user uses the mobile terminal is collected, whether the current head, neck and shoulder postures of the user meet the reminding condition is judged according to the head, neck and shoulder information in the user image, if yes, the reminding operation is executed, and the bad head, neck and shoulder postures of the user are reminded through the head, shoulder and neck information in the user image, so that the user can keep the correct head, shoulder and neck posture when using the mobile terminal in a sitting posture or a standing posture, and the excessive pressure of the cervical vertebra is avoided.
Drawings
Fig. 1 is a flowchart of a posture reminding method according to an embodiment of the present invention;
FIG. 2 is a diagram of a pre-stored reference image according to an embodiment of the present invention;
fig. 3A to 3C are schematic diagrams of head, neck and shoulder postures of a user according to a second embodiment of the present invention;
FIG. 4 is a flowchart of a posture reminding method according to a second embodiment of the present invention;
fig. 5 is a block diagram of a posture reminding device according to a third embodiment of the present invention;
fig. 6 is a schematic structural diagram of a mobile terminal according to a fourth embodiment of the present invention.
Detailed Description
The present invention will be described in further detail with reference to the accompanying drawings and examples. It is to be understood that the specific embodiments described herein are merely illustrative of the invention and are not limiting of the invention. It should be further noted that, for the convenience of description, only some of the structures related to the present invention are shown in the drawings, not all of the structures.
Example one
The present embodiment provides a posture reminding method, which is applicable to detecting and reminding a poor head, neck and shoulder posture of a user when using a mobile terminal, and the method can be executed by a posture reminding device, and the device can be implemented by software and/or hardware, and can be generally integrated in a mobile terminal. Fig. 1 is a flowchart of a posture reminding method according to an embodiment of the present invention, and as shown in fig. 1, the method specifically includes:
s101, collecting a user image when the user uses the mobile terminal.
The mobile terminal may be a mobile phone, a tablet computer, a notebook computer, or the like having a shooting function and a processing function. In the process that the user uses the mobile terminal, the mobile terminal can acquire the user image through the shooting function of the mobile terminal and serve as a judgment basis for the user posture.
And S102, judging the posture according to the head, neck and shoulder information in the user image.
Wherein the head, neck and shoulder information is extracted from the user image, the head, neck and shoulder information relating to the user. The head, neck and shoulder information extracted from the current user image can reflect the current posture of the user, particularly the head, neck and shoulder postures such as front, head deviation, head lowering, head tilting and the like, so that posture judgment can be realized according to the head, neck and shoulder information.
And S103, if the judgment result is that the current head, neck and shoulder postures meet the reminding condition, executing reminding operation.
If the current head, neck and shoulder postures are bad postures, such as head lowering, head raising, head tilting or head left-right deviation, the reminding condition is met, the reminding operation can be executed, and the user is informed that the postures are incorrect.
According to the posture reminding method, the head portrait of the user when the user uses the mobile terminal is collected, whether the current head, neck and shoulder posture of the user meets the reminding condition or not is judged according to the head, neck and shoulder information in the user image, if yes, reminding operation is executed, and reminding of bad head, neck and shoulder posture of the user is achieved through the head, shoulder and neck information in the user image, so that the user can keep correct head, shoulder and neck posture when the user uses the mobile terminal in a sitting posture or a standing posture, and excessive cervical vertebra pressure is avoided.
In an optional implementation mode, a switch of the posture reminding function can be arranged in the mobile terminal, and when the switch is turned on, the posture reminding function is turned on, so that a user can decide whether to carry out posture reminding according to the requirement of the user, and the trouble on the user is avoided. Specifically, S101 includes: when a user uses the mobile terminal, detecting that the gesture reminding function is in an open state; and acquiring a user image through a front camera of the mobile terminal.
In an embodiment of the present invention, the head, neck, and shoulder information may include: head, neck and shoulder profile information and head pitch information. The head, neck and shoulder contour information refers to the head, neck and shoulder contour, such as shape, size and the like, presented in the user image. The head pitch information is information representing that the user lowers or raises his head in the user image.
Specifically, S102 may include: judging the posture according to the head, neck and shoulder contour information in the user image to obtain a first result; and judging the posture according to the head pitching information in the user image to obtain a second result. Accordingly, S103 includes: and if any one of the first result and the second result is that the current head, neck and shoulder postures meet the reminding condition, executing the reminding operation. And if the first result and the second result both indicate that the current head, neck and shoulder posture does not meet the reminding condition, the user is considered to be in the correct head, neck and shoulder posture.
Whether the user accords with a pre-recorded front profile relative to the mobile terminal or not can be judged according to the head, neck and shoulder profile information, if the user is in a posture of head bending, head leaning left and right, head lowering or head raising, the profile is not in line, and a reminding condition is met. Whether the user lowers the head or raises the head can be accurately judged according to the head pitching information, and if the user is in the head lowering posture, the reminding condition is met. Certainly, the head-up posture can be set according to the requirement, and the reminding condition is also met. It should be noted that, the posture determination is performed according to the head, neck and shoulder contour information in the user image, and the posture determination is performed according to the head pitch information in the user image, and the execution sequence of the two steps is not limited, and may be executed sequentially or simultaneously.
Therefore, by combining the head, neck and shoulder profile information and the head pitching information, whether the current head, neck and shoulder posture of the user needs to be reminded or not can be accurately determined, the mistaken reminding is reduced as much as possible, and the influence on the user experience when the mobile terminal is used is avoided.
In an optional embodiment, performing a posture judgment according to head, neck and shoulder contour information in an image of a user to obtain a first result includes: extracting a head-neck-shoulder contour edge line in the user image; comparing the head, neck and shoulder contour edge line with a reference contour edge line in a prestored image; and if the comparison result does not meet the preset condition, determining that the current head, neck and shoulder postures meet the reminding condition. The preset condition is that the shapes are the same and are at a preset scaling ratio.
The head, neck and shoulder contour edge lines in the user image can be identified by utilizing an image identification technology. The head, neck and shoulder contour edge line can embody different postures of the user. Fig. 2 is a schematic diagram of a pre-stored reference image, which is an image captured by a user facing the mobile terminal in a prompted standard posture (with the mobile terminal facing the front and the cervical vertebrae standing upright with the spine, refer to fig. 3A), wherein the contour is a reference contour edge line. If the user leans on his head, the head contour differs from that shown in fig. 2, if the user leans on his head, the head width and the ear contour differ from those shown in fig. 2, and if the user lowers his head, the head and neck contour also changes.
Considering that the user does not necessarily have the same distance from the mobile terminal to the mobile terminal when taking an image as when entering the reference image, the distance is different for the same pose resulting in different sizes of contours in the taken image, and therefore the preset scaling is set. For example, the head neck shoulder contour edge line and the reference contour edge line are completely coincident, i.e., the same shape and the ratio 1: 1. and if the shapes of the head-neck-shoulder contour edge line and the reference contour edge line are different, the reminding condition is considered to be met. If the shapes are the same but the preset scaling is not met, for example, the head-neck-shoulder contour edge line is much larger than the reference contour edge line, which indicates that the user is too close to the mobile terminal, and the reminding condition is considered to be met.
According to the optional embodiment, the user posture is judged based on the head, neck and shoulder contour information according to the contour edge line in the user image, whether the head, neck and shoulder posture of the user meets the reminding condition or not is determined, and the judgment basis is simple and reliable.
In an alternative embodiment, the determining the posture according to the head pitch information in the user image, and obtaining the second result, includes: determining a reference point in the user image and a user shoulder reference line through image recognition; calculating the distance from the reference point to the shoulder reference line; judging whether the distance from the reference point to the shoulder reference line is smaller than a preset threshold value or not; if yes, determining that the user is in a head-lowering posture, and meeting the reminding condition.
Wherein the reference point may be a site that is easy to identify, such as a chin, a nose tip, or a center point of a forehead, etc. The shoulder reference line refers to a connecting line between two points on the shoulder, such as a straight line formed by clavicle convex points of two shoulders. Generally, the shoulder reference line and the straight line of the head and neck should be almost vertical, if not, the shoulder may be inclined or tilted, and the head, neck and shoulder posture can be considered to satisfy the reminding condition. The preset threshold is set according to a standard distance from the reference point to the shoulder reference line in the pre-calculated reference image, for example, the value of the preset threshold is the standard distance, and may be slightly smaller than the standard distance. It will be appreciated that if the user lowers his head, the distance from the reference point in the image to the shoulder reference line will be shortened, and if the user lifts his head, the distance from the reference point in the image to the shoulder reference line will be increased. Because the head-lowering posture can lead to cervical vertebra overvoltage, the head-lowering posture is set to meet the reminding condition in the embodiment, and the head-raising posture can be set according to actual requirements to meet the reminding condition.
According to the embodiment, the user posture is judged based on the head pitching information according to the distance from the reference point in the user image to the shoulder reference line, whether the user posture meets the reminding condition or not is determined, and the judgment basis is simple and reliable.
Optionally, before determining whether the distance from the reference point to the shoulder reference line is smaller than a preset threshold, the method further includes: and acquiring a corresponding preset threshold according to the distance between the user and the mobile terminal.
Here, considering that the distance between the user and the mobile terminal is different when the user takes an image, and the interval between the same two parts in the user image taken is also different for the same gesture, the present embodiment presets the correspondence between the distance between the user and the mobile terminal and the preset threshold value, so that the gesture determination is more accurate and reliable. The distance between the user and the mobile terminal can be obtained in the existing mode, for example, the distance is measured by adopting a binocular camera.
Considering that the user may use the mobile terminal in other postures (e.g. lying) than sitting or standing, which may be harmful to the eyes, in an alternative embodiment, before capturing the image of the user when the user uses the mobile terminal, the method further comprises: acquiring an angle of a plane where a screen of the mobile terminal is located relative to the ground; and if the angle is within the preset angle range, acquiring the user image. If the angle is not within the preset angle range, the reminding operation can be executed, the reminding of the postures except sitting postures and standing postures is realized, and the reminding operation can also not be executed.
The angle of the plane where the screen of the mobile terminal is located relative to the ground can be obtained through the gravity sensing function of the mobile terminal. The preset angle range is a range which ensures that the screen of the mobile terminal is basically vertical to the ground, and a certain deviation is allowed on the basis of 90 degrees, such as a deviation of plus or minus 30 degrees. If the angle is not within the preset angle range, it indicates that the user may not use the mobile terminal in a conventional correct posture, e.g., in a lying posture, etc.
The gesture reminding method and the gesture reminding device set the triggering condition of the gesture reminding operation, namely, when the angle of the plane where the screen of the mobile terminal is located relative to the ground accords with a certain angle range, subsequent gesture judgment and reminding are triggered according to the head, neck and shoulder information, and unnecessary consumption of mobile terminal resources can be avoided to a certain extent.
In order to determine whether the gesture satisfies the reminding condition, a reference standard may be set through the mobile terminal, and specifically, before acquiring the user image when the user uses the mobile terminal, the method further includes: responding to the posture reminding setting instruction, outputting prompt information to prompt a user to input posture reference information according to the prompt information; the attitude reference information is stored.
The gesture reminding setting instruction may be an instruction sent by a user through an operation on the mobile terminal, for example, a relevant setting of the gesture reminding function is performed at a setting entry. The prompting message may include relevant steps and requirements for entering the reference image. The attitude reference information includes a reference image, a distance that the user is accustomed to keeping when using the mobile terminal, and the like.
In order to realize effective reminding of the posture, reminding information can be output in a mode of at least one of the following modes: interface display, voice broadcast and light change. The text, the image and/or the animation can be displayed in an interface display mode. This embodiment is convenient for the user to look over and is reminded, also can increase the interest simultaneously.
Further, after the reminding information is output, the method may further include: and when the detected duration that the user is in the head, neck and shoulder postures meeting the reminding condition reaches the preset duration, controlling the mobile terminal to turn off the screen. After the reminding information is output, if the user is monitored to be in the bad posture for a long time, the screen is forcibly turned off, and the influence of the long-time bad posture of the user on the body health is prevented.
In addition, the mobile terminal may be used by multiple users, corresponding gesture reference information may be respectively entered and stored for each user, and in the process of using the mobile terminal by the user, the identity of the user may be determined through authentication, so as to obtain the reference information corresponding to the user to perform gesture judgment.
Example two
On the basis of the above embodiments, the present embodiment describes a posture reminding method with reference to specific examples.
As shown in fig. 3A, when the user uses the mobile terminal in this posture, the user can take the correct head, neck and shoulder postures without causing excessive cervical pressure. As shown in fig. 3B and 3C, when the user lowers his head to use the mobile terminal, the pressure on the cervical vertebrae at the dark spots is large, which affects the health.
Referring to fig. 4, in a process that a user uses the mobile terminal, if it is detected that the posture prompting function is turned on, acquiring a user image, and performing posture judgment according to head, neck and shoulder information in the user image, specifically, determining whether a current head, neck and shoulder posture meets a prompting condition according to head, neck and shoulder contour information and head pitching information in the user image, respectively, if not, determining that the posture is correct, and not performing prompting; and if any judgment result is that the reminding condition is met, outputting reminding information. And if the mobile terminal is in the posture meeting the reminding condition for a long time, controlling the mobile terminal to turn off the screen. For example, after the user is reminded, the user still keeps the current bad posture for more than one minute, and the screen is controlled to be turned off.
EXAMPLE III
Based on the same concept, the present embodiment provides a posture reminding device, which can be used for implementing the posture reminding methods described in the above embodiments. Fig. 5 is a block diagram of a posture reminding device according to a third embodiment of the present invention, and as shown in fig. 5, the posture reminding device includes:
an acquisition module 51, configured to acquire a user image when a user uses the mobile terminal;
the judging module 52 is configured to perform posture judgment according to the head, neck and shoulder information in the user image;
and the reminding module 53 is configured to execute a reminding operation when the judgment result is that the current head, neck and shoulder posture meets the reminding condition.
Optionally, the collecting module 51 includes:
the detection unit is used for detecting that the gesture reminding function is in an open state when a user uses the mobile terminal;
and the acquisition unit is used for acquiring the user image through a front camera of the mobile terminal.
Optionally, the determining module 52 includes:
the first judgment unit is used for judging the posture according to the head, neck and shoulder contour information in the user image to obtain a first result;
the second judgment unit is used for judging the posture according to the head pitching information in the user image to obtain a second result;
correspondingly, the reminding module 53 is specifically configured to: and if any one of the first result and the second result is that the current head, neck and shoulder postures meet the reminding condition, executing the reminding operation.
Optionally, the first determining unit includes:
the extraction subunit is used for extracting the head-neck-shoulder contour edge line in the user image;
the comparison subunit is used for comparing the head, neck and shoulder contour edge line with a reference contour edge line in a prestored image;
and the first determining subunit is used for determining that the current head, neck and shoulder postures meet the reminding condition under the condition that the comparison result does not meet the preset condition, wherein the preset condition is that the shapes are the same and the preset scaling is achieved.
Optionally, the second judging unit includes:
a second determining subunit for determining a reference point in the user image and a user shoulder reference line by image recognition;
a calculating subunit, configured to calculate a distance from the reference point to a shoulder reference line;
the judging subunit is used for judging whether the distance from the reference point to the shoulder reference line is smaller than a preset threshold value; if yes, determining that the user is in a head-lowering posture, and meeting the reminding condition.
Optionally, the second determining unit further includes: and the obtaining subunit is used for obtaining the corresponding preset threshold according to the distance between the user and the mobile terminal.
Optionally, the apparatus further comprises:
the acquisition module is used for acquiring the angle of a plane where a screen of the mobile terminal is located relative to the ground before acquiring a user image when the user uses the mobile terminal;
correspondingly, the capturing module 51 is further configured to capture the user image when the angle is within the preset angle range. The reminding module 53 may also be configured to perform a reminding operation when the angle is not within the preset angle range.
Optionally, the apparatus further comprises:
the output module is used for responding to the gesture reminding setting instruction and outputting prompt information to prompt a user to input gesture reference information according to the prompt information before acquiring a user image when the user uses the mobile terminal;
and the storage module is used for storing the attitude reference information.
Optionally, the reminding module 53 includes: the output unit is used for outputting the reminding information according to at least one of the following modes: interface display, voice broadcast and light change.
Optionally, the reminding module 53 further includes: a control unit: and after the reminding information is output, the duration that the user is in the head, neck and shoulder postures meeting the reminding condition reaches the preset duration, and the mobile terminal is controlled to be turned off.
The device provided by the embodiment of the invention can execute the method provided by any embodiment of the invention, and has the corresponding functional modules and beneficial effects of the execution method. For technical details not described in detail in this embodiment, reference may be made to the method provided in any embodiment of the present invention.
Example four
The embodiment provides a mobile terminal, including: one or more processors; a memory for storing one or more programs; the image acquisition device is used for acquiring a user image; when executed by one or more processors, cause the one or more processors to implement a gesture reminding method according to any embodiment of the present invention.
Fig. 6 is a schematic structural diagram of a mobile terminal according to a fourth embodiment of the present invention. FIG. 6 illustrates a block diagram of an exemplary mobile terminal suitable for use in implementing embodiments of the present invention. The mobile terminal shown in fig. 6 is only an example, and should not bring any limitation to the functions and the scope of use of the embodiments of the present invention.
As shown in fig. 6, the mobile terminal includes a processor 61, a memory 62, an input device 63, an output device 64, and an image acquisition device 65; the number of the processors 61 in the mobile terminal may be one or more, and one processor 61 is taken as an example in fig. 6; the processor 61, the memory 62, the input device 63, the output device 64 and the image capturing device 65 in the mobile terminal may be connected by a bus or other means, and the bus connection is taken as an example in fig. 6.
The memory 62 is a computer-readable storage medium, and can be used for storing software programs, computer-executable programs, and modules, such as program instructions/modules corresponding to the gesture reminding method in the embodiment of the present invention (for example, the judgment module 52 and the reminding module 53 in the gesture reminding device). The processor 61 executes various functional applications and data processing of the mobile terminal by running software programs, instructions and modules stored in the memory 62, that is, implements the gesture reminding method described above.
The memory 62 may mainly include a storage program area and a storage data area, wherein the storage program area may store an operating system, an application program required for at least one function; the storage data area may store data created according to the use of the terminal, and the like. Further, the memory 62 may include high speed random access memory, and may also include non-volatile memory, such as at least one magnetic disk storage device, flash memory device, or other non-volatile solid state storage device. In some examples, the memory 62 may further include memory located remotely from the processor 61, which may be connected to the mobile terminal over a network. Examples of such networks include, but are not limited to, the internet, intranets, local area networks, mobile communication networks, and combinations thereof.
The input device 63 may be used to receive input numeric or character information and generate key signal inputs related to user settings and function control of the mobile terminal.
The output device 64 may include a display screen, lights, speakers, etc.
The image capturing device 65 is used to capture a user image.
EXAMPLE five
The present embodiment provides a computer-readable storage medium on which a computer program is stored, which when executed by a processor implements a gesture reminding method according to any embodiment of the present invention.
Computer storage media for embodiments of the invention may employ any combination of one or more computer-readable media. The computer readable medium may be a computer readable signal medium or a computer readable storage medium. A computer readable storage medium may be, for example, but not limited to, an electronic, magnetic, optical, electromagnetic, infrared, or semiconductor system, apparatus, or device, or any combination of the foregoing. More specific examples (a non-exhaustive list) of the computer readable storage medium would include the following: an electrical connection having one or more wires, a portable computer diskette, a hard disk, a Random Access Memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), an optical fiber, a portable compact disc read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination of the foregoing. In the context of this document, a computer readable storage medium may be any tangible medium that can contain, or store a program for use by or in connection with an instruction execution system, apparatus, or device.
A computer readable signal medium may include a propagated data signal with computer readable program code embodied therein, for example, in baseband or as part of a carrier wave. Such a propagated data signal may take many forms, including, but not limited to, electro-magnetic, optical, or any suitable combination thereof. A computer readable signal medium may also be any computer readable medium that is not a computer readable storage medium and that can communicate, propagate, or transport a program for use by or in connection with an instruction execution system, apparatus, or device.
Program code embodied on a computer readable medium may be transmitted using any appropriate medium, including but not limited to wireless, wireline, optical fiber cable, RF, etc., or any suitable combination of the foregoing.
Computer program code for carrying out operations for aspects of the present invention may be written in any combination of one or more programming languages, including an object oriented programming language such as Java, Smalltalk, C + + or the like and conventional procedural programming languages, such as the "C" programming language or similar programming languages. The program code may execute entirely on the user's computer, partly on the user's computer, as a stand-alone software package, partly on the user's computer and partly on a remote computer or entirely on the remote computer or server. In the case of a remote computer, the remote computer may be connected to the user's computer through any type of network, including a Local Area Network (LAN) or a Wide Area Network (WAN), or the connection may be made to an external computer (for example, through the Internet using an Internet service provider).
It is to be noted that the foregoing is only illustrative of the preferred embodiments of the present invention and the technical principles employed. It will be understood by those skilled in the art that the present invention is not limited to the particular embodiments described herein, but is capable of various obvious changes, rearrangements and substitutions as will now become apparent to those skilled in the art without departing from the scope of the invention. Therefore, although the present invention has been described in greater detail by the above embodiments, the present invention is not limited to the above embodiments, and may include other equivalent embodiments without departing from the spirit of the present invention, and the scope of the present invention is determined by the scope of the appended claims.
Claims (13)
1. A posture reminding method is characterized by comprising the following steps:
acquiring a user image when a user uses the mobile terminal;
judging the posture according to the head, neck and shoulder information in the user image;
and if the judgment result is that the current head, neck and shoulder postures meet the reminding condition, executing reminding operation.
2. The method of claim 1, wherein capturing the user image of the user using the mobile terminal comprises:
when a user uses the mobile terminal, detecting that a posture reminding function is in an open state;
and acquiring the user image through a front camera of the mobile terminal.
3. The method according to claim 1, wherein performing a pose determination according to head, neck and shoulder information in the user image comprises:
judging the posture according to the head, neck and shoulder contour information in the user image to obtain a first result;
judging the posture according to the head pitching information in the user image to obtain a second result;
correspondingly, if the judgment result is that the current head, neck and shoulder postures meet the reminding condition, executing the reminding operation, including:
and if any one of the first result and the second result is that the current head, neck and shoulder posture meets the reminding condition, executing the reminding operation.
4. The method according to claim 3, wherein performing a pose determination according to the head, neck and shoulder contour information in the user image to obtain a first result comprises:
extracting a head-neck-shoulder contour edge line in the user image;
comparing the head, neck and shoulder contour edge line with a reference contour edge line in a prestored image;
if the comparison result does not meet the preset condition, determining that the current head, neck and shoulder posture meets the reminding condition;
the preset conditions are that the shapes are the same and are at a preset scaling ratio.
5. The method of claim 3, wherein determining the pose from the head pitch information in the user image, and obtaining a second result comprises:
determining a reference point and a shoulder reference line in the user image through image recognition;
calculating a distance from the reference point to the shoulder reference line;
judging whether the distance from the reference point to the shoulder reference line is smaller than a preset threshold value or not;
if yes, determining that the user is in a head-lowering posture, and meeting a reminding condition.
6. The method of claim 5, further comprising, before determining whether the distance from the reference point to the shoulder reference line is less than a preset threshold:
and acquiring the corresponding preset threshold according to the distance between the user and the mobile terminal.
7. The method according to any one of claims 1 to 6, wherein before acquiring the user image when the user uses the mobile terminal, further comprising:
acquiring the angle of a plane where a screen of the mobile terminal is located relative to the ground;
and if the angle is within a preset angle range, acquiring the user image.
8. The method according to any one of claims 1 to 6, wherein before acquiring the user image when the user uses the mobile terminal, further comprising:
responding to a posture reminding setting instruction, outputting prompt information to prompt the user to enter posture reference information according to the prompt information;
storing the attitude reference information.
9. The method of any one of claims 1 to 6, wherein performing a reminder operation comprises:
outputting the reminding information according to at least one of the following modes: interface display, voice broadcast and light change.
10. The method of claim 9, after outputting the reminder information, further comprising:
and when the detected duration that the user is in the head, neck and shoulder postures meeting the reminding condition reaches the preset duration, controlling the mobile terminal to turn off the screen.
11. An attitude alert device, comprising:
the acquisition module is used for acquiring a user image when a user uses the mobile terminal;
the judging module is used for judging the posture according to the head, neck and shoulder information in the user image;
and the reminding module is used for executing reminding operation under the condition that the judgment result is that the current head, neck and shoulder postures meet the reminding condition.
12. A mobile terminal, comprising:
one or more processors;
a memory for storing one or more programs;
the image acquisition device is used for acquiring a user image;
when executed by the one or more processors, cause the one or more processors to implement the method of any one of claims 1-10.
13. A computer-readable storage medium, on which a computer program is stored which, when being executed by a processor, carries out the method according to any one of claims 1 to 10.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201911031302.4A CN111079513B (en) | 2019-10-28 | 2019-10-28 | Posture reminding method and device, mobile terminal and storage medium |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201911031302.4A CN111079513B (en) | 2019-10-28 | 2019-10-28 | Posture reminding method and device, mobile terminal and storage medium |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN111079513A true CN111079513A (en) | 2020-04-28 |
| CN111079513B CN111079513B (en) | 2022-01-18 |
Family
ID=70310535
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201911031302.4A Active CN111079513B (en) | 2019-10-28 | 2019-10-28 | Posture reminding method and device, mobile terminal and storage medium |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN111079513B (en) |
Cited By (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN111985371A (en) * | 2020-08-10 | 2020-11-24 | 珠海格力电器股份有限公司 | Sitting posture detection method, sitting posture detection equipment and desk |
| CN112822448A (en) * | 2021-01-07 | 2021-05-18 | 西安万像电子科技有限公司 | Terminal monitoring method and system, computer readable storage medium and processor |
| CN113031773A (en) * | 2021-03-24 | 2021-06-25 | Oppo广东移动通信有限公司 | Prompting method, electronic device and computer readable storage medium |
| CN113283350A (en) * | 2021-05-28 | 2021-08-20 | 青岛海尔科技有限公司 | Operation event prompting method and device, storage medium and electronic device |
| CN114356079A (en) * | 2021-12-16 | 2022-04-15 | 歌尔光学科技有限公司 | Wearable device control method and device, wearable device and medium |
| JP7174817B1 (en) | 2021-07-30 | 2022-11-17 | 功憲 末次 | Improper Use Control System and Improper Use Control Program |
| WO2023138406A1 (en) * | 2022-01-21 | 2023-07-27 | 华为技术有限公司 | Image-based posture determination method, and electronic device |
Citations (10)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN102298692A (en) * | 2010-06-24 | 2011-12-28 | 北京中星微电子有限公司 | Method and device for detecting body postures |
| CN104239860A (en) * | 2014-09-10 | 2014-12-24 | 广东小天才科技有限公司 | Detecting and reminding method and device for sitting posture in using process of intelligent terminal |
| CN104916093A (en) * | 2015-06-05 | 2015-09-16 | 重庆智韬信息技术中心 | Method for realizing intelligent correction prompting of students' sitting postures |
| US20160140826A1 (en) * | 2014-11-19 | 2016-05-19 | Medical Wearable Solutions Ltd. | Wearable posture regulation system and method to regulate posture |
| CN106488031A (en) * | 2016-11-02 | 2017-03-08 | 宇龙计算机通信科技(深圳)有限公司 | A kind of use based reminding method of terminal and terminal |
| CN107993262A (en) * | 2017-10-25 | 2018-05-04 | 深圳市金立通信设备有限公司 | Terminal device uses posture reminding method, terminal and computer-readable recording medium |
| CN108419128A (en) * | 2018-03-12 | 2018-08-17 | 深圳市赛亿科技开发有限公司 | The method and device of personage's pose adjustment |
| CN108989653A (en) * | 2017-05-31 | 2018-12-11 | 上海大学 | The fatigue driving early-warning device of vehicular adaptive environment light and head pose |
| CN109164918A (en) * | 2018-09-05 | 2019-01-08 | 广州维纳斯家居股份有限公司 | Intelligent sitting posture tracking and method of adjustment, device, intelligent elevated table and storage medium |
| CN109685025A (en) * | 2018-12-27 | 2019-04-26 | 中科院合肥技术创新工程院 | Shoulder feature and sitting posture Activity recognition method |
-
2019
- 2019-10-28 CN CN201911031302.4A patent/CN111079513B/en active Active
Patent Citations (10)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN102298692A (en) * | 2010-06-24 | 2011-12-28 | 北京中星微电子有限公司 | Method and device for detecting body postures |
| CN104239860A (en) * | 2014-09-10 | 2014-12-24 | 广东小天才科技有限公司 | Detecting and reminding method and device for sitting posture in using process of intelligent terminal |
| US20160140826A1 (en) * | 2014-11-19 | 2016-05-19 | Medical Wearable Solutions Ltd. | Wearable posture regulation system and method to regulate posture |
| CN104916093A (en) * | 2015-06-05 | 2015-09-16 | 重庆智韬信息技术中心 | Method for realizing intelligent correction prompting of students' sitting postures |
| CN106488031A (en) * | 2016-11-02 | 2017-03-08 | 宇龙计算机通信科技(深圳)有限公司 | A kind of use based reminding method of terminal and terminal |
| CN108989653A (en) * | 2017-05-31 | 2018-12-11 | 上海大学 | The fatigue driving early-warning device of vehicular adaptive environment light and head pose |
| CN107993262A (en) * | 2017-10-25 | 2018-05-04 | 深圳市金立通信设备有限公司 | Terminal device uses posture reminding method, terminal and computer-readable recording medium |
| CN108419128A (en) * | 2018-03-12 | 2018-08-17 | 深圳市赛亿科技开发有限公司 | The method and device of personage's pose adjustment |
| CN109164918A (en) * | 2018-09-05 | 2019-01-08 | 广州维纳斯家居股份有限公司 | Intelligent sitting posture tracking and method of adjustment, device, intelligent elevated table and storage medium |
| CN109685025A (en) * | 2018-12-27 | 2019-04-26 | 中科院合肥技术创新工程院 | Shoulder feature and sitting posture Activity recognition method |
Cited By (9)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN111985371A (en) * | 2020-08-10 | 2020-11-24 | 珠海格力电器股份有限公司 | Sitting posture detection method, sitting posture detection equipment and desk |
| CN112822448A (en) * | 2021-01-07 | 2021-05-18 | 西安万像电子科技有限公司 | Terminal monitoring method and system, computer readable storage medium and processor |
| CN113031773A (en) * | 2021-03-24 | 2021-06-25 | Oppo广东移动通信有限公司 | Prompting method, electronic device and computer readable storage medium |
| CN113283350A (en) * | 2021-05-28 | 2021-08-20 | 青岛海尔科技有限公司 | Operation event prompting method and device, storage medium and electronic device |
| JP7174817B1 (en) | 2021-07-30 | 2022-11-17 | 功憲 末次 | Improper Use Control System and Improper Use Control Program |
| JP2023020123A (en) * | 2021-07-30 | 2023-02-09 | 功憲 末次 | Inappropriate use control system and inappropriate use control program |
| US11886317B2 (en) | 2021-07-30 | 2024-01-30 | Katsunori SUETSUGU | Inappropriate use control system and inappropriate use control program |
| CN114356079A (en) * | 2021-12-16 | 2022-04-15 | 歌尔光学科技有限公司 | Wearable device control method and device, wearable device and medium |
| WO2023138406A1 (en) * | 2022-01-21 | 2023-07-27 | 华为技术有限公司 | Image-based posture determination method, and electronic device |
Also Published As
| Publication number | Publication date |
|---|---|
| CN111079513B (en) | 2022-01-18 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN111079513B (en) | Posture reminding method and device, mobile terminal and storage medium | |
| CN104239860B (en) | A kind of sitting posture detection and based reminding method and device using during intelligent terminal | |
| CN105426723A (en) | Voiceprint identification, face identification and synchronous in-vivo detection-based identity authentication method and system | |
| WO2017059700A1 (en) | Identity authentication method and apparatus | |
| WO2020024416A1 (en) | Anti-peep method and apparatus for smart terminal, computer device and storage medium | |
| CN111543934A (en) | Vision detection method and device, electronic product and storage medium | |
| CN104899490A (en) | Terminal positioning method and user terminal | |
| CN108090340B (en) | Face recognition processing method, face recognition processing device and intelligent terminal | |
| CN109670444B (en) | Attitude detection model generation method, attitude detection device, attitude detection equipment and attitude detection medium | |
| CN106020454B (en) | A kind of intelligent terminal touch screen operating method and system based on eye control technology | |
| CN103513768A (en) | Control method and device based on posture changes of mobile terminal and mobile terminal | |
| CN111131702A (en) | Method and device for acquiring image, storage medium and electronic equipment | |
| CN113903317B (en) | Screen brightness adjusting method and device of electronic equipment and electronic equipment | |
| CN108650408B (en) | Screen unlocking method and mobile terminal | |
| CN106774889B (en) | Gesture recognition method and device of wearable device | |
| CN106648042B (en) | Identification control method and device | |
| CN106911861A (en) | A kind of information displaying method and device based on iris recognition | |
| WO2017152592A1 (en) | Mobile terminal application operation method and mobile terminal | |
| CN109871169A (en) | The interface UI method of adjustment, device, terminal and storage medium | |
| CN114299587A (en) | Eye state determination method and apparatus, electronic device, and storage medium | |
| JP5694471B2 (en) | Eye search method, eye state detection device and eye search device using the method | |
| CN111768785A (en) | Control method of smart watch and smart watch | |
| CN110705483A (en) | Driving reminding method, device, terminal and storage medium | |
| CN116088992A (en) | Click control method and system based on image recognition and voice recognition | |
| CN111401242B (en) | Credential detection method, apparatus, electronic device and storage medium |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |