CN110648509A - Method, device and system for generating prompt message - Google Patents

Method, device and system for generating prompt message Download PDF

Info

Publication number
CN110648509A
CN110648509A CN201910914021.7A CN201910914021A CN110648509A CN 110648509 A CN110648509 A CN 110648509A CN 201910914021 A CN201910914021 A CN 201910914021A CN 110648509 A CN110648509 A CN 110648509A
Authority
CN
China
Prior art keywords
target object
area
preset
information
preset area
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Granted
Application number
CN201910914021.7A
Other languages
Chinese (zh)
Other versions
CN110648509B (en
Inventor
刘光有
唐楚强
杨泽
吴斌
朱云青
柳烨
杨会敏
占淑琴
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Gree Electric Appliances Inc of Zhuhai
Original Assignee
Gree Electric Appliances Inc of Zhuhai
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Gree Electric Appliances Inc of Zhuhai filed Critical Gree Electric Appliances Inc of Zhuhai
Priority to CN201910914021.7A priority Critical patent/CN110648509B/en
Publication of CN110648509A publication Critical patent/CN110648509A/en
Application granted granted Critical
Publication of CN110648509B publication Critical patent/CN110648509B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Classifications

    • GPHYSICS
    • G08SIGNALLING
    • G08BSIGNALLING OR CALLING SYSTEMS; ORDER TELEGRAPHS; ALARM SYSTEMS
    • G08B21/00Alarms responsive to a single specified undesired or abnormal condition and not otherwise provided for
    • G08B21/18Status alarms
    • G08B21/24Reminder alarms, e.g. anti-loss alarms
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T7/00Image analysis
    • G06T7/70Determining position or orientation of objects or cameras
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04LTRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L12/00Data switching networks
    • H04L12/28Data switching networks characterised by path configuration, e.g. LAN [Local Area Networks] or WAN [Wide Area Networks]
    • H04L12/2803Home automation networks
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00Indexing scheme for image analysis or image enhancement
    • G06T2207/30Subject of image; Context of image processing
    • G06T2207/30196Human being; Person
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00Indexing scheme for image analysis or image enhancement
    • G06T2207/30Subject of image; Context of image processing
    • G06T2207/30232Surveillance

Abstract

The invention discloses a method, a device and a system for generating prompt information. Wherein, the method comprises the following steps: acquiring position information of a target object; determining whether the target object is in a preset area or not according to the position information; and under the condition that the target object is detected to be in the preset area, determining whether to generate prompt information according to the time length of the target object in the preset area. The invention solves the technical problem that sedentariness reminding cannot be carried out in the prior art.

Description

Method, device and system for generating prompt message
Technical Field
The invention relates to the field of smart home, in particular to a method, a device and a system for generating prompt information.
Background
With the improvement of the life quality of people, people pay more attention to the learning and education of children, especially in China, the tasks from learning from childhood to high school are more, and students need to continuously perform homework and study at home. However, for a child in a developmental stage, the bone development is easy to be imperfect and the eyes are also easy to be affected due to long-time sitting, so that the learning time of the child at home needs to be known through a scientific method, and the child needs to be reminded in time to avoid the combination of labor and ease.
In addition to learning of children, office workers working before computers for a long time are more and more common, and people can suffer certain injuries to bodies of adults due to long-time sitting, for example, the people can suffer from insufficient blood supply to the brain due to long-time sitting, so that the oxygen supply to the brain and the nutrient substances are reduced, muscle soreness, stiff neck, headache and dizziness of the whole body can be caused, lumbar vertebra diseases and cervical vertebra diseases of people are aggravated, and diseases such as obesity can be caused.
However, in the prior art, the reminding is usually performed by setting time through a mobile terminal (e.g. a mobile phone), for example, the reminding is performed every 1 hour, but the method cannot determine whether the user needs to perform the sedentary reminding, for example, the user does not sit for 1 hour, but the mobile terminal still performs the sedentary reminding.
In view of the above problems, no effective solution has been proposed.
Disclosure of Invention
The embodiment of the invention provides a method, a device and a system for generating prompt information, which aim to at least solve the technical problem that sedentariness reminding cannot be performed in the prior art.
According to an aspect of the embodiments of the present invention, there is provided a method for generating a prompt message, including: acquiring position information of a target object; determining whether the target object is in a preset area or not according to the position information; and under the condition that the target object is detected to be in the preset area, determining whether to generate prompt information according to the time length of the target object in the preset area.
Further, the method for generating the prompt message further comprises: before determining whether the target object is in the preset area according to the position information, receiving a marking instruction which is sent by the mobile terminal and used for marking the preset area; acquiring a scene image in the area where the household appliance is located according to the labeling instruction; and sending the scene image to the mobile terminal, and receiving target area information of a preset area, which is obtained by labeling the scene image and is fed back by the mobile terminal.
Further, the method for generating the prompt message further comprises: after target area information of a preset area, which is obtained by labeling a scene image and fed back by a mobile terminal, is received, whether the area information is stored in the preset storage area or not is detected; under the condition that the preset storage area is detected not to store the area information, storing the target area information into the preset storage area; and under the condition that the preset storage area is detected to store the area information, updating the area information into the target area information.
Further, the method for generating the prompt message further comprises: determining the coincidence proportion of the target object and the preset area according to the position information; and under the condition that the coincidence proportion reaches the preset proportion, determining that the target object is in the preset area.
Further, the method for generating the prompt message further comprises: and generating prompt information under the condition that the first duration of the target object continuously located in the preset area is detected to be longer than the first preset duration.
Further, the method for generating the prompt message further comprises: within the first duration, under the condition that the coincidence proportion of the target object is detected to be smaller than the preset proportion, acquiring second duration with the coincidence proportion of the target object smaller than the preset proportion; and under the condition that the second duration is less than the first preset duration, determining that the target object is continuously located in the preset area within the first duration.
Further, the method for generating the prompt message further comprises: under the condition that a first duration that the target object is continuously located in the preset area is detected to be longer than a first preset duration, detecting the posture of the target object in the first duration; and generating prompt information when the gesture of the target object is detected to belong to the same gesture type within the first duration.
According to another aspect of the embodiments of the present invention, there is also provided a method for generating a prompt message, including: acquiring position information of a target object; determining the position relation between the position information and a preset area; and determining whether to generate prompt information according to the position relationship and the duration of the position relationship.
According to another aspect of the embodiments of the present invention, there is also provided an apparatus for generating a prompt message, including: the acquisition module is used for acquiring the position information of the target object; the determining module is used for determining whether the target object is in the preset area according to the position information; and the generating module is used for determining whether to generate the prompt message according to the time length of the target object in the preset area under the condition that the target object is detected to be in the preset area.
According to another aspect of the embodiments of the present invention, there is also provided a system for generating a prompt message, including: the acquisition device is used for acquiring image information; and the recognition device is used for analyzing the image information, determining the position information of the target object and determining whether the target object is in the preset area according to the position information, wherein under the condition that the target object is detected to be in the preset area, whether prompt information is generated or not is determined according to the duration of the target object in the preset area.
Further, the acquisition device is a camera, and the horizontal angle of the camera is more than 120 degrees.
Furthermore, the acquisition device is installed on the household appliance, and an infrared light supplement device is arranged in an area related to the position of the acquisition device on the household appliance.
Further, the identification means comprise at least an image plate.
According to another aspect of the embodiments of the present invention, there is also provided a storage medium, where the storage medium includes a stored program, and when the program runs, the apparatus where the storage medium is located is controlled to execute the above method for generating the prompt message.
According to another aspect of the embodiments of the present invention, there is also provided a processor, configured to execute a program, where the program executes the above method for generating a hint information.
In the embodiment of the invention, a method of performing sedentary reminding aiming at the position information of the target object and the staying time length in the preset area is adopted, after the position information of the target object is obtained, whether the target object is in the preset area is determined according to the position information, if the target object is in the preset area, the time length of the target object in the preset area is further detected, and whether prompt information of sedentary reminding is generated is determined according to the time length.
It is easy to notice that, in the above-mentioned process, remind the target object through detecting whether the target object is in the predetermined area for a long time, compare in prior art and only carry out the mode that the sedentariness was reminded through setting for time, the scheme that this application provided can confirm accurately whether to carry out the sedentariness and remind, improved the accuracy that the sedentariness was reminded promptly.
Therefore, the scheme provided by the application achieves the purpose of sedentariness reminding of the target object, so that the technical effect of improving the precision of sedentariness reminding is achieved, and the technical problem that sedentariness reminding cannot be carried out in the prior art is solved.
Drawings
The accompanying drawings, which are included to provide a further understanding of the invention and are incorporated in and constitute a part of this application, illustrate embodiment(s) of the invention and together with the description serve to explain the invention without limiting the invention. In the drawings:
FIG. 1 is a flow diagram of a method of generating a reminder message according to an embodiment of the present invention;
FIG. 2 is a flow diagram of an alternative method of generating a reminder message, according to an embodiment of the present invention;
FIG. 3 is a flow diagram of a method of generating a reminder message according to an embodiment of the invention; and
fig. 4 is a schematic diagram of an apparatus for generating a prompt message according to an embodiment of the present invention.
Detailed Description
In order to make the technical solutions of the present invention better understood, the technical solutions in the embodiments of the present invention will be clearly and completely described below with reference to the drawings in the embodiments of the present invention, and it is obvious that the described embodiments are only a part of the embodiments of the present invention, and not all of the embodiments. All other embodiments, which can be derived by a person skilled in the art from the embodiments given herein without making any creative effort, shall fall within the protection scope of the present invention.
It should be noted that the terms "first," "second," and the like in the description and claims of the present invention and in the drawings described above are used for distinguishing between similar elements and not necessarily for describing a particular sequential or chronological order. It is to be understood that the data so used is interchangeable under appropriate circumstances such that the embodiments of the invention described herein are capable of operation in sequences other than those illustrated or described herein. Furthermore, the terms "comprises," "comprising," and "having," and any variations thereof, are intended to cover a non-exclusive inclusion, such that a process, method, system, article, or apparatus that comprises a list of steps or elements is not necessarily limited to those steps or elements expressly listed, but may include other steps or elements not expressly listed or inherent to such process, method, article, or apparatus.
Example 1
According to an embodiment of the present invention, an embodiment of a method for generating a prompt message is provided, where an execution subject of the embodiment may be an electrical device, where the electrical device may be a household electrical device (e.g., an air conditioner, a fan, an electric heater, etc.), and the electrical device may also be a commercial electrical device, for example, an air conditioner, a fan, etc. applied in a classroom or an office area. In the present embodiment, a home appliance air conditioner is explained as an execution subject.
Further, it should also be noted that the steps illustrated in the flowcharts of the figures may be performed in a computer system such as a set of computer-executable instructions and that, although a logical order is illustrated in the flowcharts, in some cases, the steps illustrated or described may be performed in an order different than here.
Fig. 1 is a flowchart of a method for generating a prompt message according to an embodiment of the present invention, as shown in fig. 1, the method includes the following steps:
step S102, position information of the target object is acquired.
In step S102, the air conditioner has a collecting device that can collect position information of a target object within an area controlled by the air conditioner.
In an alternative embodiment, the air conditioner has a collecting device and a recognition device, wherein the collecting device can collect image information of an area controlled by the air conditioner, and the recognition device analyzes the image information to determine the position information of the target object. Wherein, collection system can be the camera, and the horizontal angle of camera is greater than 120, and the camera is installed downwards and downward sloping in the air conditioner to realize the movable region of maximum angle shooting target object. In addition, an infrared light supplementing device is arranged on the periphery of the camera, and the infrared light supplementing device can be an infrared LED light supplementing device and is used for supplementing light in night vision or dark scenes. The recognition device at least comprises an image board, wherein the image board is intelligent hardware and is integrated with software.
And step S104, determining whether the target object is in the preset area or not according to the position information.
In step S104, the preset area is an area where the target object performs learning and office work, for example, in a home scene, the preset area may be an area where children learn (for example, an area where a desk is located); in an office scene, the preset area may be an area of a desk. In addition, the preset area may be determined by a user in a manner of area marking, wherein the preset area may be stored in a preset storage area of the air conditioner.
In an alternative embodiment, after obtaining the position information of the target object, the air conditioner identification device detects whether the position information of the target object is located in a preset area, or the coincidence ratio of the position information of the target object and the preset area reaches a predetermined ratio, and if the position information of the target object is located in the preset area, or the coincidence ratio of the position information of the target object and the preset area reaches the predetermined ratio, determines that the target object is located in the preset area.
And step S106, under the condition that the target object is detected to be in the preset area, determining whether to generate prompt information according to the time length of the target object in the preset area.
In step S106, after determining that the target object is located in the preset area, further detecting a duration of the target object in the preset area, and if the duration is too long, the air conditioner generates a prompt message to remind the target object that the sitting time is too long and the activity is needed. The air conditioner can remind the target object in a voice reminding mode, for example, the air conditioner reminds a child that the learning time exceeds 1 hour and a rest is needed in the voice reminding mode. In addition, the air conditioner can remind the target object in a music playing mode.
In addition, the air conditioner can be connected with equipment used by the target object for working or learning, when the time length of the target object in the preset area exceeds the preset time length, the air conditioner controls the equipment used by the target object for working or learning to generate prompt information, for example, after the working time length of an office worker in front of a computer exceeds 1 hour, the air conditioner sends a control instruction to the computer, and after the computer receives the control instruction, the computer desktop displays the prompt information to remind that the working time length of the target object exceeds 1 hour and a rest is needed.
In an alternative embodiment, fig. 2 is a flowchart illustrating an alternative method for generating a prompt message, where fig. 2 illustrates a family learning scenario. Specifically, the air conditioner receives an opening instruction input by a user, and starts the sedentary reminding mode. After the air conditioner enters the sedentary reminding mode, the activity position of the target object in the area controlled by the air conditioner is detected in real time, whether the activity position of the target object is in a learning area (namely a preset area) or not is detected, and the time length in the learning area reaches 1 hour. If the activity position of the target object is in the learning area and the time length in the learning area exceeds 1 hour, the air conditioner generates prompt information to remind the target object to avoid the damage to the body of the target object due to sedentary sitting.
Based on the schemes defined in steps S102 to S106, it can be known that, after the position information of the target object is obtained, whether the target object is in the preset area is determined according to the position information in a manner of performing sedentariness reminding according to the position information of the target object and the stay time in the preset area, and if the target object is in the preset area, the time length of the target object in the preset area is further detected, and whether the prompt information of sedentariness reminding is generated is determined according to the time length.
It is easy to notice that, in the above-mentioned process, remind the target object through detecting whether the target object is in the predetermined area for a long time, compare in prior art and only carry out the mode that the sedentariness was reminded through setting for time, the scheme that this application provided can confirm accurately whether to carry out the sedentariness and remind, improved the accuracy that the sedentariness was reminded promptly.
Therefore, the scheme provided by the application achieves the purpose of sedentariness reminding of the target object, so that the technical effect of improving the precision of sedentariness reminding is achieved, and the technical problem that sedentariness reminding cannot be carried out in the prior art is solved.
In an optional embodiment, before determining whether the target object is in the preset region according to the position information, the preset region needs to be determined first, wherein a user may label the region in a labeling manner to obtain the preset region. Specifically, the air conditioner firstly receives a labeling instruction which is sent by the mobile terminal and used for labeling a preset area, then collects a scene image in the area where the household appliance is located according to the labeling instruction, sends the scene image to the mobile terminal, and receives target area information of the preset area, which is obtained by labeling the scene image and is fed back by the mobile terminal.
As can be seen from the above, the user can mark the preset area through the mobile terminal (e.g., a mobile phone). If the user needs to label the preset area, the user may start a related application on the mobile terminal, where the application can communicate with a home appliance (in this embodiment, an air conditioner). After the application is started, the user enables the mobile terminal to send a marking instruction for configuring the preset area to the air conditioner by operating the mobile terminal. At this time, the recognition device (e.g., image board) of the air conditioner can receive the annotation instruction and control the acquisition device (e.g., camera) to start up so as to acquire the scene image in the area controlled by the air conditioner. Then, the acquisition device sends the acquired scene image to the mobile terminal, and a user can observe the scene image acquired by the acquisition device through the mobile terminal and label the scene image through the mobile terminal. Optionally, the user may use a coordinate frame formed by four points to label in an interactive interface of the mobile terminal, for example, the user may overlay the coordinate frame on a desk on the scene image in the interactive interface, and an area where the desk is located is a preset area.
Further, after the user marks the preset area, the mobile terminal can obtain target area information corresponding to the preset area, and transmits the target area information to the recognition device of the air conditioner, and the recognition device can store the target area information.
It should be noted that the target area information may include coordinate information of the preset area, and may also include feature information of the preset area, for example, a table and a chair exist in the preset area. The recognition device can determine the position of the preset area through the characteristics in the image acquired by the acquisition device under the condition that the target area information comprises the characteristic information of the preset area.
In addition, it should be noted that, the user may determine whether to control the air conditioner to start the sedentary reminder mode through the mobile terminal. Specifically, the air conditioner receives a mode instruction sent by the mobile terminal, analyzes the mode instruction, determines a target mode to be executed by the air conditioner according to an analysis result, and controls the air conditioner to enter the target mode. In addition, if the user starts the sedentary reminding mode of the air conditioner through the mobile terminal for the first time, the mobile terminal can remind and guide the user to mark a preset area; if the air conditioner is configured with the preset area (namely, the air conditioner does not start the sedentary reminding mode for the first time), an operation control for changing the preset area is arranged in the display interface of the mobile terminal, and a user can update the preset area by operating the operation control.
In an optional embodiment, after receiving target area information of a preset area obtained by labeling a scene image fed back by the mobile terminal, the air conditioner further detects whether the preset storage area stores area information. Under the condition that the preset storage area is detected not to store the area information, storing the target area information into the preset storage area; and under the condition that the preset storage area is detected to store the area information, updating the area information into the target area information.
It should be noted that when it is detected that the area information is stored in the preset storage area, the air conditioner covers the existing area information in the preset storage area with the new area information, so as to update the preset area. In addition, the preset area can be updated by the preset area user, and therefore the scheme provided by the application can achieve the purpose of flexibly determining the preset area.
In addition, it should be noted that the identification device of the air conditioner may detect whether the preset area is updated every preset time, where the preset time may be 1 min. After detecting that the preset area is updated, determining whether the target object is in the preset area by using the latest preset area.
In an alternative embodiment, after obtaining the location information of the target object, the air conditioner further determines whether the target object is in the preset area according to the location information. Specifically, the air conditioner determines the coincidence proportion of the target object and the preset area according to the position information, wherein the target object is determined to be in the preset area under the condition that the coincidence proportion reaches the preset proportion.
Optionally, the air conditioner may determine whether the target object is in the preset area by determining a coincidence ratio of the human-shaped frame of the target object to the preset area. For example, when the air conditioner detects that the coincidence ratio of the human-shaped frame of the target object and the preset region reaches 80% (i.e., the preset ratio), it is determined that the target object is in the preset region.
The human-shaped frame is the smallest rectangular frame that can contain the target object in the image. After the collecting device of the air conditioner collects the scene images, the collected scene images are identified and analyzed through the image module of the embedded hardware, and statistics is carried out according to the change of continuous multi-frame scene images so as to judge the position of the target object. The position of the target object is output in a rectangular human-shaped frame form, and the coordinates of the target object in the scene image (namely the coordinates of the human-shaped frame) are identified.
Further, after the target object is determined to be in the preset area, the air conditioner determines whether to generate the prompt message according to the duration of the target object in the preset area. And generating prompt information under the condition that the first duration of the target object continuously located in the preset area is detected to be longer than the first preset duration. For example, if the target object is detected to be within the preset area continuously for 1 hour, the prompt message is generated.
It should be noted that, in the first duration, when it is detected that the coincidence proportion of the target object is smaller than the preset proportion, a second duration, in which the coincidence proportion of the target object is smaller than the preset proportion, is obtained, and when the second duration is smaller than the first preset duration, it is determined that the target object is continuously located in the preset area in the first duration. For example, if the air conditioner detects that the target object overlaps with the preset region by less than 80% (i.e., the preset ratio) for not more than 1 minute (i.e., the second duration) in 1 hour (i.e., the first duration), it is still determined that the target object is within the preset region for the entire 1 hour.
Further, in order to improve the detection accuracy of the sedentary reminder, under the condition that a first duration that the target object is continuously located in the preset area is longer than a first preset duration, the air conditioner continuously detects the posture of the target object in the first duration, wherein when the posture of the target object is detected to belong to the same posture type in the first duration, prompt information is generated. For example, in a scene of a write operation, the air conditioner detects that a child (i.e., a target object) is at a desk (i.e., in a preset area) within 1 hour, the air conditioner further detects whether the posture of the child at the desk is the posture of the write operation, and if so, the air conditioner performs a sedentary reminder; if the child is detected to write 10 minutes of work beside the desk, then lie prone on the desk again to sleep for half an hour, then stand for 10 minutes again, optimally learn for 10 minutes, then the air conditioner does not perform the sedentary reminding.
According to the scheme, the preset area is marked, the scene image collected by the collecting device is analyzed, the behavior condition of the target object is detected in real time, whether the sedentariness reminding is carried out or not is determined according to the position relation between the target object and the preset area, the time length of the target object in the preset area and the behavior state of the target object, and the precision of the sedentariness reminding is improved. In addition, the method provided by the application can be combined with the household appliance, so that the functions of the household appliance are increased, and the function selling points of the household appliance are improved.
Example 2
There is also provided, in accordance with an embodiment of the present invention, an embodiment of a method for generating a reminder message, it being noted that the steps illustrated in the flowchart of the drawings may be performed in a computer system such as a set of computer-executable instructions and that, although a logical order is illustrated in the flowchart, in some cases the steps illustrated or described may be performed in an order different than here.
Fig. 3 is a flowchart of a method for generating a prompt message according to an embodiment of the present invention, and as shown in fig. 3, the method includes the following steps:
in step S302, position information of the target object is acquired.
In step S302, the air conditioner has a collecting device that can collect position information of a target object within an area controlled by the air conditioner.
In an alternative embodiment, the air conditioner has a collecting device and a recognition device, wherein the collecting device can collect image information of an area controlled by the air conditioner, and the recognition device analyzes the image information to determine the position information of the target object. Wherein, collection system can be the camera, and the horizontal angle of camera is greater than 120, and the camera is installed downwards and downward sloping in the air conditioner to realize the movable region of maximum angle shooting target object. In addition, an infrared light supplementing device is arranged on the periphery of the camera, and the infrared light supplementing device can be an infrared LED light supplementing device and is used for supplementing light in night vision or dark scenes. The recognition device at least comprises an image board, wherein the image board is intelligent hardware and is integrated with software.
Step S304, determining the position relation between the position information and the preset area.
In step S304, the positional relationship between the position information of the target object and the preset area includes the following three types: the target object is located in the preset area, the target object is partially overlapped with the preset area, and the target object is separated from the preset area. The preset area is an area where the target object performs learning and working, for example, in a home scene, the preset area may be an area where children learn (for example, an area where a desk is located); in an office scene, the preset area may be an area of a desk. In addition, the preset area may be determined by a user in a manner of area marking, wherein the preset area may be stored in a preset storage area of the air conditioner.
In an alternative embodiment, after obtaining the position information of the target object, the air conditioner identification device detects whether the position information of the target object is located in a preset area, or the coincidence ratio of the position information of the target object and the preset area reaches a predetermined ratio, and if the position information of the target object is located in the preset area, or the coincidence ratio of the position information of the target object and the preset area reaches the predetermined ratio, determines that the target object is located in the preset area.
And step S306, determining whether to generate the prompt information according to the position relationship and the duration of the position relationship.
In an optional embodiment, when the position relationship is that the target object is located in the preset area, the air conditioner detects the time length of the target object in the preset area, and if the time length is too long, the air conditioner generates a prompt message to remind the target object that the sitting time is too long and the activity is needed. The air conditioner can remind the target object in a voice reminding mode, for example, the air conditioner reminds a child that the learning time exceeds 1 hour and a rest is needed in the voice reminding mode. In addition, the air conditioner can remind the target object in a music playing mode.
In another optional embodiment, when the position relationship is that the target object is partially overlapped with the preset area, the air conditioner first obtains a coincidence ratio of the target object and the preset area, and detects whether the coincidence ratio of the target object and the preset area has not changed within a preset time period, if so, the prompt information is generated, for example, the coincidence ratio of the target object and the preset area is 90%, and the air conditioner generates the prompt information if the coincidence ratio lasts for 1 hour.
An optional embodiment is also provided, when the position relationship is that the target object is separated from the preset region, the air conditioner acquires a relative position between the target object and the preset region, detects whether the relative position between the target object and the preset region has not changed within a preset time period, and if so, generates a prompt message.
Based on the schemes defined in steps S302 to S306, it can be known that, after the position information of the target object is obtained by using a manner of performing sedentary reminder according to the position information of the target object and the staying time in the preset area, the position relationship between the position information and the preset area is determined, and whether to generate the prompt information of sedentary reminder is determined according to the position relationship and the duration of the position relationship.
It is easy to notice that, in the above-mentioned process, remind the target object through detecting whether the target object is in the predetermined area for a long time, compare in prior art and only carry out the mode that the sedentariness was reminded through setting for time, the scheme that this application provided can confirm accurately whether to carry out the sedentariness and remind, improved the accuracy that the sedentariness was reminded promptly.
Therefore, the scheme provided by the application achieves the purpose of sedentariness reminding of the target object, so that the technical effect of improving the precision of sedentariness reminding is achieved, and the technical problem that sedentariness reminding cannot be carried out in the prior art is solved.
In an optional embodiment, before determining the position relationship between the position information and the preset region, the preset region needs to be determined first, where a user may label the region in a labeling manner to obtain the preset region. Specifically, the air conditioner firstly receives a labeling instruction which is sent by the mobile terminal and used for labeling a preset area, then collects a scene image in the area where the household appliance is located according to the labeling instruction, sends the scene image to the mobile terminal, and receives target area information of the preset area, which is obtained by labeling the scene image and is fed back by the mobile terminal.
Further, after the user marks the preset area, the mobile terminal can obtain target area information corresponding to the preset area, and transmits the target area information to the recognition device of the air conditioner, and the recognition device can store the target area information.
It should be noted that, the user may determine whether to control the air conditioner to start the sedentary reminder mode through the mobile terminal. Specifically, the air conditioner receives a mode instruction sent by the mobile terminal, analyzes the mode instruction, determines a target mode to be executed by the air conditioner according to an analysis result, and controls the air conditioner to enter the target mode. In addition, if the user starts the sedentary reminding mode of the air conditioner through the mobile terminal for the first time, the mobile terminal can remind and guide the user to mark a preset area; if the air conditioner is configured with the preset area (namely, the air conditioner does not start the sedentary reminding mode for the first time), an operation control for changing the preset area is arranged in the display interface of the mobile terminal, and a user can update the preset area by operating the operation control.
In an optional embodiment, after receiving target area information of a preset area obtained by labeling a scene image fed back by the mobile terminal, the air conditioner further detects whether the preset storage area stores area information. Under the condition that the preset storage area is detected not to store the area information, storing the target area information into the preset storage area; and under the condition that the preset storage area is detected to store the area information, updating the area information into the target area information.
Further, after the position relation between the position information and the preset area is determined, the air conditioner determines whether to generate the prompt information according to the position relation and the duration of the position relation. And if the duration of the position relationship is longer than a first preset duration (for example, 1 hour), generating the prompt message. In order to improve the detection accuracy of the sedentary reminder, after the position relation between the target object and the preset area is determined, the air conditioner continues to detect the posture of the target object within the first duration, wherein when the posture of the target object is detected to belong to the same posture type within the first duration, prompt information is generated.
According to the scheme, the preset area is marked, the scene image collected by the collecting device is analyzed, the behavior condition of the target object is detected in real time, whether the sedentary reminding is performed or not is determined according to the position relation between the target object and the preset area, the duration of the position relation and the behavior state of the target object, and the sedentary reminding accuracy is improved. In addition, the method provided by the application can be combined with the household appliance, so that the functions of the household appliance are increased, and the function selling points of the household appliance are improved.
Example 3
According to an embodiment of the present invention, an embodiment of an apparatus for generating a hint information is further provided, where fig. 4 is a schematic diagram of an apparatus for generating a hint information according to an embodiment of the present invention, and as shown in fig. 4, the apparatus includes: an acquisition module 401, a determination module 403 and a generation module 405.
The acquiring module 401 is configured to acquire position information of a target object; a determining module 403, configured to determine whether the target object is in a preset area according to the position information; the generating module 405 is configured to determine whether to generate the prompt message according to a duration of the target object in the preset area when the target object is detected to be in the preset area.
It should be noted here that the acquiring module 401, the determining module 403, and the generating module 405 correspond to steps S102 to S106 of the above embodiment, and the three modules are the same as the examples and application scenarios realized by the corresponding steps, but are not limited to the disclosure of the above embodiment.
In an optional embodiment, the apparatus for generating the prompt message further includes: the device comprises a first receiving module, an acquisition module and a second receiving module. The first receiving module is used for receiving a marking instruction which is sent by the mobile terminal and used for marking the preset area before determining whether the target object is in the preset area according to the position information; the acquisition module is used for acquiring a scene image in the area where the household appliance is located according to the marking instruction; and the second receiving module is used for sending the scene image to the mobile terminal and receiving target area information of the preset area, which is obtained by labeling the scene image and is fed back by the mobile terminal.
In an optional embodiment, the apparatus for generating the prompt message further includes: the device comprises a first detection module, a storage module and an updating module. The first detection module is used for detecting whether the preset storage area stores area information or not after receiving target area information of the preset area, which is obtained by labeling the scene image and fed back by the mobile terminal; the storage module is used for storing the target area information into the preset storage area under the condition that the preset storage area is detected not to store the area information; and the updating module is used for updating the area information into the target area information under the condition that the preset storage area is detected to store the area information.
In an alternative embodiment, the determining module includes: the device comprises a first determination module and a second determination module. The first determining module is used for determining the coincidence proportion of the target object and the preset area according to the position information; and the second determining module is used for determining that the target object is in the preset area under the condition that the superposition proportion reaches the preset proportion.
In an alternative embodiment, the generating module comprises: a first generation module. The first generation module is used for generating prompt information when detecting that a first duration of the target object continuously located in the preset area is longer than a first preset duration.
In an optional embodiment, the apparatus for generating the prompt message further includes: the device comprises a first obtaining module and a third determining module. The first obtaining module is used for obtaining a second duration within the first duration when the coincidence proportion of the target object is smaller than the preset proportion; and the third determining module is used for determining that the target object is continuously located in the preset area within the first duration under the condition that the second duration is less than the first preset duration.
In an optional embodiment, the apparatus for generating the prompt message further includes: a second detection module and a second generation module. The second detection module is used for detecting the posture of the target object within a first duration when the first duration that the target object is continuously located within the preset area is detected to be longer than the first preset duration; and the second generation module is used for generating prompt information when detecting that the gesture of the target object belongs to the same gesture type within the first duration.
Example 4
According to an embodiment of the present invention, there is further provided an embodiment of a system for generating a prompt message, where the system may perform the method for generating a prompt message in embodiment 1, and the system includes: collection system and recognition device.
The acquisition device is used for acquiring image information; and the recognition device is used for analyzing the image information, determining the position information of the target object and determining whether the target object is in the preset area according to the position information, wherein under the condition that the target object is detected to be in the preset area, whether prompt information is generated or not is determined according to the duration of the target object in the preset area.
Optionally, the collecting device may be a camera, the horizontal angle of the camera is greater than 120 °, and the camera is installed in the air conditioner and is inclined downward to realize shooting the moving area of the target object at the maximum angle. In addition, an infrared light supplementing device is arranged on the periphery of the camera, and the infrared light supplementing device can be an infrared LED light supplementing device and is used for supplementing light in night vision or dark scenes. The recognition device at least comprises an image board, wherein the image board is intelligent hardware and is integrated with software.
In an alternative embodiment, fig. 2 is a flowchart illustrating an alternative method for generating a prompt message, where fig. 2 illustrates a family learning scenario. Specifically, the air conditioner receives an opening instruction input by a user, and starts the sedentary reminding mode. After the air conditioner enters the sedentary reminding mode, the activity position of the target object in the area controlled by the air conditioner is detected in real time, whether the activity position of the target object is in a learning area (namely a preset area) or not is detected, and the time length in the learning area reaches 1 hour. If the activity position of the target object is in the learning area and the time length in the learning area exceeds 1 hour, the air conditioner generates prompt information to remind the target object to avoid the damage to the body of the target object due to sedentary sitting.
According to the method, after the position information of the target object is obtained, whether the target object is in the preset area is determined according to the position information in a mode of performing sedentariness reminding aiming at the position information of the target object and the stay time in the preset area, if the target object is in the preset area, the time of the target object in the preset area is further detected, and whether prompt information of sedentariness reminding is generated is determined according to the time.
It is easy to notice that, in the above-mentioned process, remind the target object through detecting whether the target object is in the predetermined area for a long time, compare in prior art and only carry out the mode that the sedentariness was reminded through setting for time, the scheme that this application provided can confirm accurately whether to carry out the sedentariness and remind, improved the accuracy that the sedentariness was reminded promptly.
Therefore, the scheme provided by the application achieves the purpose of sedentariness reminding of the target object, so that the technical effect of improving the precision of sedentariness reminding is achieved, and the technical problem that sedentariness reminding cannot be carried out in the prior art is solved.
It should be noted that the system for generating prompt information provided in this embodiment may execute the method for generating prompt information in embodiment 1, and relevant contents are already described in embodiment 1 and are not described herein again.
Example 5
According to another aspect of the embodiments of the present invention, there is also provided a storage medium including a stored program, wherein when the program runs, a device in which the storage medium is located is controlled to execute the method for generating the prompt message in embodiment 1.
Example 6
According to another aspect of the embodiments of the present invention, there is also provided a processor, configured to execute a program, where the program executes the method for generating the hint information in embodiment 1.
The above-mentioned serial numbers of the embodiments of the present invention are merely for description and do not represent the merits of the embodiments.
In the above embodiments of the present invention, the descriptions of the respective embodiments have respective emphasis, and for parts that are not described in detail in a certain embodiment, reference may be made to related descriptions of other embodiments.
In the embodiments provided in the present application, it should be understood that the disclosed technology can be implemented in other ways. The above-described embodiments of the apparatus are merely illustrative, and for example, the division of the units may be a logical division, and in actual implementation, there may be another division, for example, multiple units or components may be combined or integrated into another system, or some features may be omitted, or not executed. In addition, the shown or discussed mutual coupling or direct coupling or communication connection may be an indirect coupling or communication connection through some interfaces, units or modules, and may be in an electrical or other form.
The units described as separate parts may or may not be physically separate, and parts displayed as units may or may not be physical units, may be located in one place, or may be distributed on a plurality of units. Some or all of the units can be selected according to actual needs to achieve the purpose of the solution of the embodiment.
In addition, functional units in the embodiments of the present invention may be integrated into one processing unit, or each unit may exist alone physically, or two or more units are integrated into one unit. The integrated unit can be realized in a form of hardware, and can also be realized in a form of a software functional unit.
The integrated unit, if implemented in the form of a software functional unit and sold or used as a stand-alone product, may be stored in a computer readable storage medium. Based on such understanding, the technical solution of the present invention may be embodied in the form of a software product, which is stored in a storage medium and includes instructions for causing a computer device (which may be a personal computer, a server, or a network device) to execute all or part of the steps of the method according to the embodiments of the present invention. And the aforementioned storage medium includes: a U-disk, a Read-Only Memory (ROM), a Random Access Memory (RAM), a removable hard disk, a magnetic or optical disk, and other various media capable of storing program codes.
The foregoing is only a preferred embodiment of the present invention, and it should be noted that, for those skilled in the art, various modifications and decorations can be made without departing from the principle of the present invention, and these modifications and decorations should also be regarded as the protection scope of the present invention.

Claims (15)

1. A method for generating a hint, comprising:
acquiring position information of a target object;
determining whether the target object is in a preset area or not according to the position information;
and under the condition that the target object is detected to be in the preset area, determining whether to generate prompt information according to the time length of the target object in the preset area.
2. The method of claim 1, wherein prior to determining whether the target object is in a preset area according to the location information, the method further comprises:
receiving a marking instruction which is sent by the mobile terminal and used for marking the preset area;
acquiring a scene image in the area where the household appliance is located according to the marking instruction;
and sending the scene image to the mobile terminal, and receiving target area information of a preset area, which is obtained by labeling the scene image and is fed back by the mobile terminal.
3. The method according to claim 2, wherein after receiving target area information of a preset area obtained by labeling the scene image fed back by the mobile terminal, the method further comprises:
detecting whether a preset storage area stores area information or not;
under the condition that the preset storage area is detected not to store the area information, storing the target area information into the preset storage area;
and under the condition that the preset storage area is detected to store the area information, updating the area information into the target area information.
4. The method of claim 1, wherein determining whether the target object is in a preset area according to the position information comprises:
determining the coincidence proportion of the target object and the preset area according to the position information;
and under the condition that the coincidence proportion reaches a preset proportion, determining that the target object is in the preset area.
5. The method of claim 4, wherein determining whether to generate a prompt message according to a duration of the target object in the preset area comprises:
and generating the prompt message when detecting that the first duration of the target object continuously located in the preset area is longer than the first preset duration.
6. The method of claim 5, further comprising:
within the first duration, under the condition that the coincidence proportion of the target object is detected to be smaller than the preset proportion, acquiring a second duration of which the coincidence proportion of the target object is smaller than the preset proportion;
and under the condition that the second duration is less than the first preset duration, determining that the target object is continuously located in the preset area within the first duration.
7. The method of claim 5, further comprising:
under the condition that a first duration that the target object is continuously located in the preset area is detected to be longer than a first preset duration, detecting the posture of the target object in the first duration;
and generating the prompt information when the gesture of the target object is detected to belong to the same gesture type within the first duration.
8. A method for generating a hint, comprising:
acquiring position information of a target object;
determining the position relation between the position information and a preset area;
and determining whether to generate prompt information according to the position relationship and the duration of the position relationship.
9. An apparatus for generating a hint information, comprising:
the acquisition module is used for acquiring the position information of the target object;
the determining module is used for determining whether the target object is in a preset area according to the position information;
and the generating module is used for determining whether to generate prompt information according to the time length of the target object in the preset area under the condition that the target object is detected to be in the preset area.
10. A system for generating a reminder message, comprising:
the acquisition device is used for acquiring image information;
and the recognition device is used for analyzing the image information, determining the position information of the target object, and determining whether the target object is in a preset area according to the position information, wherein under the condition that the target object is detected to be in the preset area, whether prompt information is generated or not is determined according to the time length of the target object in the preset area.
11. The system of claim 10, wherein the collection device is a camera having a horizontal angle greater than 120 °.
12. The system according to claim 10, wherein the collection device is mounted on a home appliance, and an infrared light supplement device is provided on the home appliance in an area associated with a position of the collection device.
13. The system of claim 10, wherein the identification device comprises at least an image board.
14. A storage medium, characterized in that the storage medium comprises a stored program, wherein when the program runs, a device in which the storage medium is located is controlled to execute the method for generating the prompt message according to any one of claims 1 to 7.
15. A processor, characterized in that the processor is configured to run a program, wherein the program when running performs the method of generating a hint information according to any one of claims 1 to 7.
CN201910914021.7A 2019-09-25 2019-09-25 Method, device and system for generating prompt message Active CN110648509B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201910914021.7A CN110648509B (en) 2019-09-25 2019-09-25 Method, device and system for generating prompt message

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201910914021.7A CN110648509B (en) 2019-09-25 2019-09-25 Method, device and system for generating prompt message

Publications (2)

Publication Number Publication Date
CN110648509A true CN110648509A (en) 2020-01-03
CN110648509B CN110648509B (en) 2020-12-11

Family

ID=69011200

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201910914021.7A Active CN110648509B (en) 2019-09-25 2019-09-25 Method, device and system for generating prompt message

Country Status (1)

Country Link
CN (1) CN110648509B (en)

Cited By (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN113065456A (en) * 2021-03-30 2021-07-02 上海商汤智能科技有限公司 Information prompting method and device, electronic equipment and computer storage medium
CN113706616A (en) * 2021-08-27 2021-11-26 深圳创维-Rgb电子有限公司 Prompting method, device, equipment and storage medium
CN114234393A (en) * 2021-11-19 2022-03-25 青岛海尔空调器有限总公司 Air conditioner sitting posture auxiliary control method and device and air conditioner

Citations (13)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2000172962A (en) * 1998-12-09 2000-06-23 Uchida Seihon Kako:Kk Device for monitor and disaster prevention of unmanned space
US20080074546A1 (en) * 2006-09-21 2008-03-27 Momen Abdulmohsen A Warning signal interrupt device
CN104346802A (en) * 2013-08-05 2015-02-11 浙江大华技术股份有限公司 Method and device for monitoring off-job behaviors of personnel
CN204303137U (en) * 2014-12-11 2015-04-29 中国科学院深圳先进技术研究院 A kind of body posture monitoring terminal and system
CN104881228A (en) * 2015-05-13 2015-09-02 小米科技有限责任公司 Method, device and system for detecting learning time
CN105812564A (en) * 2016-03-11 2016-07-27 合肥联宝信息技术有限公司 Control method, electronic device and personal computer
CN106202976A (en) * 2016-08-15 2016-12-07 宁波高科美电子技术有限公司 A kind of learning quality and the assessment assay method of time
CN107292786A (en) * 2017-07-13 2017-10-24 广东小天才科技有限公司 A kind of learning time statistical method, device and terminal device
CN108376463A (en) * 2018-02-28 2018-08-07 成都信息工程大学 A kind of sitting intelligent prompt method and system
CN108960785A (en) * 2018-07-13 2018-12-07 维沃移动通信有限公司 A kind of information cuing method and device
CN109033919A (en) * 2017-06-08 2018-12-18 富泰华精密电子(郑州)有限公司 Post monitoring device, method and storage equipment
CN109257569A (en) * 2018-10-24 2019-01-22 广东佳鸿达科技股份有限公司 Security protection video monitoring analysis method
CN109948435A (en) * 2019-01-31 2019-06-28 深圳奥比中光科技有限公司 Sitting posture prompting method and device

Patent Citations (13)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2000172962A (en) * 1998-12-09 2000-06-23 Uchida Seihon Kako:Kk Device for monitor and disaster prevention of unmanned space
US20080074546A1 (en) * 2006-09-21 2008-03-27 Momen Abdulmohsen A Warning signal interrupt device
CN104346802A (en) * 2013-08-05 2015-02-11 浙江大华技术股份有限公司 Method and device for monitoring off-job behaviors of personnel
CN204303137U (en) * 2014-12-11 2015-04-29 中国科学院深圳先进技术研究院 A kind of body posture monitoring terminal and system
CN104881228A (en) * 2015-05-13 2015-09-02 小米科技有限责任公司 Method, device and system for detecting learning time
CN105812564A (en) * 2016-03-11 2016-07-27 合肥联宝信息技术有限公司 Control method, electronic device and personal computer
CN106202976A (en) * 2016-08-15 2016-12-07 宁波高科美电子技术有限公司 A kind of learning quality and the assessment assay method of time
CN109033919A (en) * 2017-06-08 2018-12-18 富泰华精密电子(郑州)有限公司 Post monitoring device, method and storage equipment
CN107292786A (en) * 2017-07-13 2017-10-24 广东小天才科技有限公司 A kind of learning time statistical method, device and terminal device
CN108376463A (en) * 2018-02-28 2018-08-07 成都信息工程大学 A kind of sitting intelligent prompt method and system
CN108960785A (en) * 2018-07-13 2018-12-07 维沃移动通信有限公司 A kind of information cuing method and device
CN109257569A (en) * 2018-10-24 2019-01-22 广东佳鸿达科技股份有限公司 Security protection video monitoring analysis method
CN109948435A (en) * 2019-01-31 2019-06-28 深圳奥比中光科技有限公司 Sitting posture prompting method and device

Cited By (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN113065456A (en) * 2021-03-30 2021-07-02 上海商汤智能科技有限公司 Information prompting method and device, electronic equipment and computer storage medium
CN113706616A (en) * 2021-08-27 2021-11-26 深圳创维-Rgb电子有限公司 Prompting method, device, equipment and storage medium
CN114234393A (en) * 2021-11-19 2022-03-25 青岛海尔空调器有限总公司 Air conditioner sitting posture auxiliary control method and device and air conditioner

Also Published As

Publication number Publication date
CN110648509B (en) 2020-12-11

Similar Documents

Publication Publication Date Title
CN110648509B (en) Method, device and system for generating prompt message
CN107390863B (en) Device control method and device, electronic device and storage medium
US11914640B2 (en) Adding system for adding scent information to digital photographs, and adding method for using the same
CN112866808B (en) Video processing method and device, electronic equipment and storage medium
CN110674664A (en) Visual attention recognition method and system, storage medium and processor
CN106200941B (en) Control method of virtual scene and electronic equipment
CN110362192A (en) Message position based on position
CN104463150A (en) Device and method for inquiring number of students in self-study room and distribution of occupied seats currently in real time
CN113932388B (en) Method and device for controlling air conditioner, air conditioner and storage medium
CN202795232U (en) Demonstration system based on sightline tracking technology
CN110312098A (en) Immediately monitoring method for interactive online teaching
CN202044243U (en) Vision detector
CN103908066A (en) Intelligent desk with sitting posture correcting function and correcting method implemented by intelligent desk
CN113345083A (en) Product display method and device based on virtual reality, electronic equipment and medium
CN109739353A (en) A kind of virtual reality interactive system identified based on gesture, voice, Eye-controlling focus
US20180095540A1 (en) Illumination device
CN113450448A (en) Image processing method, device and system
CN109619838B (en) Application method of intelligent desk and intelligent desk system
CN104618499B (en) A kind of information processing method and electronic equipment
CN112017495A (en) Information interaction method and system based on learning terminal
WO2022252655A1 (en) Display method and apparatus for use in air conditioner, and air conditioner
CN113568591B (en) Control method and control device of intelligent equipment, intelligent equipment and intelligent dining table
CN206191356U (en) Eyesight test desk lamp and eyesight test system
CN108965837B (en) Projection environment brightness control method and system and terminal equipment
CN112272333B (en) Sitting posture correction method and device for live class of student and electronic equipment

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant