CN115762743A

CN115762743A - Home service system, method and device and computer equipment

Info

Publication number: CN115762743A
Application number: CN202211395106.7A
Authority: CN
Inventors: 陈向文; 唐杰; 陈翀; 罗晓宇; 王聪
Original assignee: Gree Electric Appliances Inc of Zhuhai; Zhuhai Lianyun Technology Co Ltd
Current assignee: Gree Electric Appliances Inc of Zhuhai; Zhuhai Lianyun Technology Co Ltd
Priority date: 2022-11-08
Filing date: 2022-11-08
Publication date: 2023-03-07

Abstract

The present disclosure provides a home service system, a method, a device and a computer device, wherein the home service system comprises: a management module and a processor; the management module is used for acquiring data of the target object and the home environment where the target object is located to obtain monitoring data; the monitoring data comprise object state data and article data of articles in the household environment; the processor analyzes the object state data in the monitoring data, determines the state information of the target object, formulates the home service information matched with the state information for the target object based on the article data, and indicates the corresponding intelligent home equipment to execute the home service based on the home service information.

Description

Home service system, method and device and computer equipment

Technical Field

The disclosure relates to the technical field of smart home, in particular to a home service system, a method and a device and computer equipment.

Background

With the development of society, more and more people start to develop healthy diet and pay attention to the development of good living habits, for example, healthy living work and rest and healthy matching diet are developed, so that work efficiency and healthy bodies are improved, however, in the existing scheme for planning living of users, the users are often subjectively formulated and are reminded to execute the formulated scheme, theoretical knowledge reserves that the users may not have professional healthy diet and healthy habit development are not considered, and a miszone of subjective assumption may exist in the understanding of own physical health conditions, so that when the scheme is implemented based on the user formulation, the finally achieved effect is often poor in terms of improving work efficiency and developing healthy bodies of the users, and intellectualization and convenience are poor.

Disclosure of Invention

The embodiment of the disclosure at least provides a home service system, a home service method, a home service device and computer equipment.

In a first aspect, an embodiment of the present disclosure provides a home service system, including: a management module and a processor;

the management module is used for acquiring data of the target object and the home environment where the target object is located to obtain monitoring data; the monitoring data comprise object state data and article data of articles in the household environment;

the processor analyzes the object state data in the monitoring data, determines the state information of the target object, formulates the home service information matched with the state information for the target object based on the article data, and instructs corresponding intelligent home equipment to execute home service based on the home service information.

In an optional embodiment, the management module includes: the system comprises a state monitoring submodule, an article monitoring submodule and an environment monitoring submodule;

the state monitoring submodule is used for detecting the target state of the target object and acquiring object state data of the target object under the condition that the target object is detected to be in the target state;

the article monitoring submodule detects articles in the home environment and collects first subdata of articles of a preset type; wherein the preset type of article is an article used for nutrition intake of the target object; the first subdata is data in the article data;

the environment monitoring submodule monitors the home environment to obtain second subdata of the home environment; and the second subdata is data in the item data.

In an alternative embodiment, the item monitoring submodule includes: an item information identification network and/or an item type identification network;

the article information identification network detects articles of preset types in the home environment and determines article information of the articles of the preset types; wherein the article information is used for indicating the position and/or the size of the preset type of article;

and the article type identification network identifies the articles in the home environment and determines the article types of the identified articles.

In an alternative embodiment, the processor includes: an analyzer and a controller;

the analyzer is used for determining sleep quality information of the target object based on the sleep state data under the condition that the object state data comprises the sleep state data, and formulating home service information matched with the sleep quality information for the target object based on the article data;

the controller determines the intelligent household equipment indicated by the household service information and controls the intelligent household equipment to execute household service.

In an optional embodiment, the analyzer determines a preset type of article indicated by the article data, and determines a target article in the preset type of article, which matches the sleep quality information of the target subject, and/or an article intake scheme of the target article; wherein the preset type of article is an article used for nutritional intake by the target subject.

In an alternative embodiment, the analyzer includes: a sleep state analysis network;

the sleep state analysis network analyzes based on the video frame data of the target object included in the sleep state data and/or the vital sign data of the target object, determines at least one sleep state of the target object, and determines the sleep quality information of the target object based on the at least one sleep state.

In an optional implementation manner, the home service system further includes: an adjustment module;

the adjusting module is used for acquiring the target object and updated monitoring data corresponding to the home environment where the target object is located after the home service is executed, and instructing the processor to adjust the home service based on the updated monitoring data to obtain an updated home service; wherein the updating home service is used for indicating to adjust the object state of the target object.

In an optional implementation manner, the home service system further includes: a terminal device;

and the terminal equipment acquires the home service information and displays the home service information to the target object.

In a second aspect, an embodiment of the present disclosure further provides a home service method, including:

collecting monitoring data of a target object and a home environment where the target object is located; the monitoring data comprise object state data and article data of articles in the household environment;

analyzing based on object state data in the monitoring data to determine state information of the target object;

and formulating home service information matched with the state information for the target object based on the article data so as to perform home service on the target object based on the home service information.

In a third aspect, an embodiment of the present disclosure further provides a home service apparatus, including:

the acquisition unit is used for acquiring the target object and monitoring data of the home environment where the target object is located; the monitoring data comprise object state data and article data of articles in the household environment;

the analysis unit is used for analyzing based on object state data in the monitoring data and determining the state information of the target object;

and the formulating unit is used for formulating the home service information matched with the state information for the target object based on the article data so as to perform home service on the target object based on the home service information.

In a fourth aspect, an embodiment of the present disclosure further provides a computer device, including: a processor, a memory and a bus, the memory storing machine-readable instructions executable by the processor, the processor and the memory communicating over the bus when the computer device is running, the machine-readable instructions when executed by the processor performing the steps of the second aspect above.

In a fifth aspect, embodiments of the present disclosure further provide a computer-readable storage medium, where a computer program is stored on the computer-readable storage medium, and the computer program is executed by a processor to perform the steps in the second aspect.

In order to make the aforementioned objects, features and advantages of the present disclosure more comprehensible, preferred embodiments accompanied with figures are described in detail below.

Drawings

In order to more clearly illustrate the technical solutions of the embodiments of the present disclosure, the drawings required for use in the embodiments will be briefly described below, and the drawings herein incorporated in and forming a part of the specification illustrate embodiments consistent with the present disclosure and, together with the description, serve to explain the technical solutions of the present disclosure. It is appreciated that the following drawings depict only certain embodiments of the disclosure and are therefore not to be considered limiting of its scope, for those skilled in the art will be able to derive additional related drawings therefrom without the benefit of the inventive faculty.

Fig. 1 shows a schematic structural diagram of a home service system provided in an embodiment of the present disclosure;

FIG. 2 illustrates a scoring flow diagram for a sleep scoring mechanism provided by an embodiment of the present disclosure;

fig. 3 shows a schematic structural diagram of another home service system provided in the embodiment of the present disclosure;

fig. 4 is a schematic diagram illustrating that the processor coordinates the smart home devices corresponding to the sub-modules to execute the home service instruction based on the monitoring data according to the embodiment of the disclosure;

fig. 5 shows a flowchart of a home service method provided by an embodiment of the present disclosure;

fig. 6 shows a schematic diagram of a home service device provided by an embodiment of the present disclosure;

fig. 7 shows a schematic diagram of a computer device provided by an embodiment of the present disclosure.

Detailed Description

In order to make the objects, technical solutions and advantages of the embodiments of the present disclosure more clear, the technical solutions of the embodiments of the present disclosure will be described clearly and completely with reference to the drawings in the embodiments of the present disclosure, and it is obvious that the described embodiments are only a part of the embodiments of the present disclosure, not all of the embodiments. The components of the embodiments of the present disclosure, generally described and illustrated in the figures herein, can be arranged and designed in a wide variety of different configurations. Thus, the following detailed description of the embodiments of the disclosure, provided in the accompanying drawings, is not intended to limit the scope of the disclosure, as claimed, but is merely representative of selected embodiments of the disclosure. All other embodiments, which can be derived by a person skilled in the art from the embodiments of the disclosure without making any creative effort, shall fall within the protection scope of the disclosure.

It should be noted that: like reference numbers and letters refer to like items in the following figures, and thus, once an item is defined in one figure, it need not be further defined and explained in subsequent figures.

The term "and/or" herein merely describes an associative relationship, meaning that three relationships may exist, e.g., a and/or B, may mean: a exists alone, A and B exist simultaneously, and B exists alone. In addition, the term "at least one" herein means any one of a plurality or any combination of at least two of a plurality, for example, including at least one of a, B, and C, and may mean including any one or more elements selected from the group consisting of a, B, and C.

Research shows that in the existing scheme for planning living of the user, the user is often subjectively made and reminded to execute the made scheme, theoretical knowledge reserves that the user may not have professional healthy diet and living habit formation are not considered, and a subjective assumed error area may exist in the knowledge of the self body health condition, so that the finally achieved effect is often poor in the goals of improving the working efficiency and developing health of the user when the user is used for making the execution based on the scheme made by the user.

Based on the research, the disclosure provides a home service system, a method, a device and computer equipment. In the embodiment of the disclosure, data acquisition can be performed on a target object and a home environment in which the target object is located to obtain monitoring data, where the monitoring data may include object state data representing physical conditions of the object and item data obtained by sensing items included in the home environment. Next, status information may be determined based on the subject status data, wherein the status information may be used to learn the health of the target subject, and then home service information may be formulated for the target subject based on the item data, wherein the home service information may include health improvement plans formulated based on the status information. For example, the home service information may determine dishes contained in the home environment based on the item data, and formulate home service information containing a menu for the user based on the dishes. Based on this, the system and the method can help the user to improve the working efficiency and the living habit in a more convenient and intelligent mode, and further build the health.

In order to facilitate understanding of the present embodiment, a detailed description is first given of a home service system disclosed in the embodiments of the present disclosure.

Referring to fig. 1, a schematic structural diagram of a home service system provided in the embodiment of the present disclosure is shown, and as shown in fig. 1, the home service system includes: a management module 10 and a processor 20.

The management module 10 is used for acquiring data of the target object and the home environment where the target object is located to obtain monitoring data; wherein the monitoring data comprises object state data and article data of articles in the home environment;

in this disclosure, the target object may be a living object that can be monitored by the home service system, for example, a user to be monitored, and the home service system may be installed in a home environment where the target object is located, so as to implement data acquisition and intelligent home service for the target object.

Here, the management module may include a plurality of data acquisition devices, wherein each data acquisition device may be configured to acquire at least one monitoring data. In particular, the monitoring data may comprise subject state data for characterizing the physical condition of the subject, and item data perceived based on items contained in the home environment.

In embodiments of the present disclosure, the data acquisition device may include means for acquiring subject status data and means for acquiring item data. Specifically, the device for acquiring the state data of the subject may be a camera device, a sleep monitor, or the like, so as to acquire different types of state data of the subject, such as video frame data, vital sign data, or the like. Here, the imaging device may be configured to acquire video frame data including a target object, and the sleep monitor may be configured to acquire vital sign data of the target object, such as a heart rate and a blood pressure.

In addition, the article data may include first sub data and second sub data, where the second sub data may be used to indicate a home environment, and the first sub data may be used to indicate a preset type of article in the home environment, where the device for acquiring the first sub data may be a camera device, and the first sub data is data obtained based on the article contained in the home environment, and for example, the camera device may acquire a video frame in the home environment and determine the preset type of article contained in the video frame. Meanwhile, the device for collecting the second subdata can be a sensor and the like, the sensor can be used for sensing the home environment to obtain the second subdata, and for example, the sensor can be a humidity sensor for sensing the ambient humidity, a temperature sensor for sensing the ambient temperature, a light sensor for sensing ambient light and the like.

The processor 20 analyzes the object state data in the monitoring data, determines the state information of the target object, formulates the home service information matched with the state information for the target object based on the article data, and instructs the corresponding smart home device to execute the home service based on the home service information.

In this disclosure, the processor may be configured to obtain monitoring data of the target object acquired by the management module, and perform analysis based on object state data in the monitoring data to obtain state information of the target object, where the state information may be used to represent information such as a health condition of the target object. Specifically, in the case that the object state data includes video frame data, object features of the target object in each of the video frames may be acquired, where the object features may include facial features and/or pose features, and the object state of the target object may be analyzed based on the object features. For example, whether the target object is in a fatigue state may be analyzed based on the facial features, and whether the analysis result of the facial features is reliable may be assisted to be determined based on the object pose.

After the state information of the target object is determined, home service information matched with the state information can be formulated for the target object based on the article data, and the home service information can be a scheme which is used for indicating and adjusting living habits of the target object, improving the health condition of the target object and improving the comfort level of the target object.

In an optional implementation manner, in a case that the data acquired by the management module includes second sub-data, a scheme for adjusting the home environment may be determined based on the second sub-data. Specifically, if it is determined that the current temperature is 30 ℃ based on the second sub-data and it is determined that the target object is in the sleep state based on the object state data, a scheme for adjusting the current temperature to a suitable sleep state temperature may be determined.

In another alternative embodiment, a scheme for improving the health condition of the target object may be determined based on the item data, for example, based on the first sub-data, determining food materials stored or not stored in the current home environment, and making a recipe for the target object based on the state information of the target object. Specifically, if it is determined that the target object is currently in a state of lack of sleep based on the object state data, then, based on the first sub-data, a food material suitable for the target object to eat and a recipe corresponding to the food material may be determined, for example, the food material may be coarse cereals, and the recipe may be light porridge.

Next, a corresponding smart home device may be determined based on the home service information, where the smart home device may be a smart home device for executing the home service information, and send a home service instruction to the smart home device, so that the smart home device completes home service based on the home service. Specifically, if the home service information is used to instruct to adjust the temperature of the home environment, the smart home device may be an air conditioner.

Here, the smart home devices may be devices capable of accessing the home service system, where the smart home devices are in communication connection with the processor, and the processor may instruct any smart home device to perform home service on the target object based on the communication connection. Specifically, the intelligent household equipment can be air conditioners, refrigerators, ovens, electric cookers, humidifiers and the like.

After receiving the home service instruction, the smart home device may perform corresponding home service based on the home service instruction. For example, in a case that the smart home device is an air conditioner, and the home service instruction includes a target temperature, the home service performed by the air conditioner may be to adjust the temperature control parameter to the target temperature.

As can be seen from the above description, in the embodiment of the present disclosure, data acquisition may be performed on a target object and a home environment in which the target object is located, so as to obtain monitoring data, where the monitoring data may include object state data representing a physical condition of the object, and article data obtained by sensing an article included in the home environment. Next, status information may be determined based on the object status data, wherein the status information may be used to learn the health status of the user, and then home service information may be formulated for the target object based on the item data, wherein the home service information may include a health improvement scheme formulated based on the status information. For example, the home service information may determine dishes contained in the home environment based on the item data, and formulate home service information containing a menu for the user based on the dishes. Based on this, the system and the method can help the user to improve the working efficiency and the living habit in a more convenient and intelligent mode, and further build the health.

In an optional embodiment, the management module 10 includes: a state monitoring submodule 11, an article monitoring submodule 12 and an environment monitoring submodule 13;

the state monitoring sub-module 11 detects a target state of the target object, and acquires object state data of the target object when the target object is detected to be in the target state.

In the disclosed embodiments, the target state may be a preset state that may facilitate analysis of the health state of the target subject, e.g., a fatigue state, a sleep state, etc. Upon detecting whether the target object is in the target state, an analysis may be performed based on the object state data to determine whether the target object is in the target state.

For example, in a case where the target state is a sleep state, each frame of video frames in the video frame data may be analyzed to determine whether the target object is in the sleep state based on the facial features and/or pose features of the target object, and specifically, if the facial features of the target object are determined to be a closed-eye state based on the facial features and the closed-eye state lasts for a preset time period, then the target object may be determined to be in the sleep state.

In the case that it is determined that the target object is in the target state, object state data of the target object in the target state process, for example, video frame data and/or vital sign data of the target object in the target state, may be acquired.

The article monitoring submodule 12 detects articles in the home environment and collects first subdata of articles of a preset type; wherein the preset type of article is an article used for nutrition intake of the target object; the first subdata is data in the article data.

In the embodiment of the present disclosure, the preset type of object may be an object for nutrition intake of a target object, such as food or drink, for example, vegetables, fruits, various dishes, milk, and the like. Based on this, the article monitoring sub-module may include at least one camera, and each camera is respectively installed on the smart home device for storing the preset type of article, so as to collect first subdata of the stored article in the smart home device, where the first subdata may be an image frame including the preset type of article.

Specifically, the camera device can be installed in a storage chamber of the refrigerator to collect image frames of fruits, vegetables, meat and the like stored in each layer of the refrigerator. Or, the camera device can also be installed in the steaming and baking oven to collect image frames of food materials and the like processed in the steaming and baking oven, or the camera device can also be installed in the intelligent electric cooker to collect image frames of porridge and the like cooked in the intelligent electric cooker.

The environment monitoring submodule 13 is configured to monitor the home environment to obtain second subdata of the home environment; and the second subdata is data in the item data.

In the embodiment of the present disclosure, the environment monitoring sub-module may include at least one sensor, and the sensor may sense a home environment where the target object is located, so as to obtain the second sub-data. Specifically, the sensor may be a humidity sensor that senses the ambient humidity, so as to obtain the ambient humidity data of the home environment; the temperature sensor can sense the ambient temperature, so that the ambient temperature data of the home environment can be obtained; the second subdata is determined based on the ambient temperature data and the ambient humidity data.

According to the description, the management module can comprise a plurality of sub-modules, the sub-modules are definite in division and coordinated with each other, and the acquired data can relate to the aspect of life of the target object, so that home service can be provided for the target object in a more detailed mode.

In an alternative embodiment, the item monitoring sub-module 12 includes: an item information identification network 121 and/or an item type identification network 122;

the article information identification network 121 detects a preset type article in the home environment, and determines article information of the preset type article; wherein the item information is used for indicating the position and/or size of the preset type of item.

In the embodiment of the disclosure, the article information identification network may be a pre-trained neural network for identifying the position and the size of the article, and the article information identification network may determine the relative position and the size of the article in the smart home device. In addition, in the case where the item is a food or beverage, the item information recognition network may also analyze nutritional value information of the item, wherein the nutritional value information may be determined based on one or more elements of vitamins, proteins, fats, energy, and the like. Here, the article information identification network may be a Yolo5 neural network, or a VGG19 neural network, or may be other neural networks that can be used to identify the position of the article, and this disclosure is not limited in this respect.

Specifically, in the case that the item information identification network is a Yolo5 neural network, the Yolo5 neural network may analyze the nutritional value of the food in the refrigerator, where the Yolo5 neural network may determine the nutritional value of the food based on the preset type of the food in the refrigerator and the size of the item.

In addition, in the case that the item information identification network is a VGG19 neural network, the VGG19 neural network may analyze the nutritional value of the food in the oven, where the VGG19 neural network may determine a target position suitable for the heating temperature of the food based on the relative position of the food in the oven, so as to cook the food based on the target position, thereby determining the nutritional value of the food after cooking based on the target position.

The item type identification network 122 identifies items in the home environment and determines the type of item to which the identified item belongs.

In the embodiment of the present disclosure, the article type identification network may be a pre-trained neural network for identifying an article type, where after determining that an article in the plurality of smart home devices is a preset type of article, the article type to which the article belongs may be determined by the article type identification network. Specifically, if the smart home device is an intelligent electric cooker, and the article in the intelligent electric cooker is a preset type article "rice", after the cooking of the intelligent electric cooker is finished, the article type of the cooked dish can be determined through the article type identification network, for example, the article type may be rice or rice porridge. Here, the article type identification network may be a MobilenetV3 neural network, and similarly, may also be other neural networks that can be used for identifying an article type, and this disclosure is not limited in this respect.

It should be understood that the article type identification network and the article information identification network may be different neural networks or the same neural network, for example, the same neural network may implement the neural network having the article information identification network function and the article type identification network function at the same time.

In addition, the item monitoring sub-module may include the item information identification network and/or the item type identification network, and specifically, the item identification requirement may be determined based on the item monitoring sub-module. For example, if the article monitoring sub-module has the requirement for identifying the article information and the article type, the article monitoring sub-module may include an article information identification network and an article type identification network at the same time, for example, when the smart home device includes the smart rice cooker and the refrigerator at the same time, it may be determined that the article monitoring sub-module has the requirement for identifying the article information and the article type at the same time. Similarly, the item monitoring sub-module may only include an item information identification network or an item type identification network.

In the embodiment of the disclosure, the article information of the article can be identified through the article information identification network, and meanwhile, the article type of the article can be identified through the article type identification network, so that the article identification method and the article identification device can be suitable for requirements for article identification in different intelligent household devices, use scenes of the disclosure are increased, content of article data is increased, a controller can make more appropriate household service information for a target object based on the article data, and use experience of the target object is improved.

In an optional embodiment, the processor 20 includes: an analyzer 21 and a controller 22;

the analyzer 21 determines sleep quality information of the target object based on the sleep state data when the object state data includes the sleep state data, and formulates home service information matched with the sleep quality information for the target object based on the article data.

The controller 22 determines the smart home devices indicated by the home service information, and controls the smart home devices to execute home services.

In this embodiment of the present disclosure, the analyzer may include a deep learning neural network for performing sleep analysis, and the deep learning neural network may be configured to analyze sleep state data of a target object, so as to determine sleep quality information of the target object, where a process of specifically determining the sleep quality information of the target object is described as follows, and is not described herein again.

Here, the sleep quality information may be used to characterize the sleep quality of the target subject during the sleep process, and specifically, the sleep quality information may include a sleep evaluation score, and a domain of the sleep evaluation score may be [0, 99], that is, the sleep evaluation score is any positive integer from 0 to 99.

After the sleep quality information is determined, home service information matched with the sleep quality information can be formulated for the target object based on the sleep quality information, specifically, mapping information between the sleep quality information and preset home services can be obtained, and the mapping information is used for indicating an association relationship between the sleep evaluation score and the home services. After determining the home service corresponding to the sleep evaluation score, home service information may be determined based on the home service, where the home service information may be used to indicate how to perform the home service and the smart home device performing the home service.

For example, when the sleep evaluation score is determined to be lower than the threshold, the sleep quality of the target object may be determined to be poor, and the home service corresponding to the sleep evaluation score may be a recipe recommended to the target object and suitable for eating when the sleep quality is poor.

In the embodiment of the disclosure, mapping information between the sleep quality information and the home service may be preset, and after the sleep quality information of the target object is determined, the matching home service may be determined for the target object based on the mapping information, so that the efficiency of determining the home service information is improved.

In an optional embodiment, the analyzer 21 determines preset types of articles indicated by the article data, and determines target articles in the preset types of articles, which match with the sleep quality information of the target object, and/or article intake schemes of the target articles; wherein the preset type of article is an article used for nutrition intake of the target object.

In the embodiment of the present disclosure, in a case that it is determined that the home service corresponding to the target object is a recipe recommended for the target object and suitable for eating when the sleep quality is poor based on the mapping information, a historical cooking record of the target object stored in the storage space may be first used to determine a eating habit of the target object, and an item intake scheme, for example, a recipe, matching the sleep quality information of the target object may be determined based on the eating habit, where the recipe may include the target item and/or a cooking manner of the target item.

It should be understood that the target item may be a preset type item detected by the item monitoring sub-module, and may also be an unreported item that is not monitored by the item monitoring sub-module, and in a case that the target item is an unreported item, the home service information may include a prompt message for prompting the target object to purchase the unreported item.

In the embodiment of the disclosure, the matched target object and/or the object intake scheme of the target object can be determined based on the sleep quality of the target object, so that the health condition of a user is improved, the use experience of the target object is improved, and the life quality of the user is improved.

In an optional embodiment, the analyzer 21 includes: sleep state analysis network 211;

the sleep state analysis network 211 performs analysis based on the sleep state data including the video frame data of the target object and/or the vital sign data of the target object, determines at least one sleep state of the target object, and determines the sleep quality information of the target object based on the at least one sleep state.

In the embodiment of the present disclosure, after acquiring the sleep state data, the sleep state analysis network may determine the sleep evaluation score of the target object through a sleep scoring mechanism, and determine the sleep quality information of the target object based on the sleep evaluation score.

Here, the sleep state analysis network may include an image processing model and a matrix processing model, so as to process the video frame data and the matrix determined based on the vital sign data, respectively, to determine at least one sleep state of the target object, where the sleep state may include: wake period, light sleep period, REM (rapid eye movement) period, and deep sleep period. Next, a sleep assessment score for the target subject may be determined via a sleep scoring mechanism.

Specifically, the sleep scoring mechanism may first determine a sleep type of the target object based on the sleep duration of the target object, and in a case that the sleep type of the target object is the main body sleep, may determine a scoring base of the target object based on the sleep duration of the target object, determine a total point deduction value of the target object, and determine a point deduction weight of the target object based on the sleep duration. Next, a sleep assessment score for the target subject may be calculated based on a sleep score formula, the sleep formula being: sleep assessment score = score cardinality-total number of points deducted x number of points deducted weight, i.e. the difference between score cardinality and the product of total number of points deducted and weight of points deducted.

In addition, in the case where it is determined that the sleep type of the target subject is the temporary nap, the sleep evaluation score of the target subject may be determined based on the duration of the temporary nap.

Fig. 2 is a scoring flowchart of the sleep scoring mechanism, which includes S21-S26, where:

s21: determining a sleep type of the target subject; if the sleep type of the target subject is the main body sleep, S22 is performed, and if the sleep type of the target subject is the temporary nap, S26 is performed.

S22: determining a partial withholding value of the target object, wherein the partial withholding value comprises: the length of falling asleep is deducted, the sleep efficiency is deducted, the frequency of body movement is deducted and the length of deep sleep is added.

In the embodiment of the present disclosure, the score deduction rule for the score deduction of the sleeping time may be: and increasing the time delay of falling asleep by one minute every 10 minutes, wherein the maximum time delay of falling asleep is-3. The sleep efficiency may be used to indicate a percentage value of the sleep time length and the sleep time length of the target subject, and the deduction rule of the sleep efficiency may be: on the basis of 90%, the sleep efficiency deduction is increased by one minute for every 10% reduction, wherein the maximum sleep efficiency deduction is-4. The body movement frequency can be used for indicating the frequency of posture change of the target object in the sleep period, and the deduction rule of the body movement frequency deduction can be as follows: on the basis of 0.33, the body movement frequency per liter is increased by 0.33, and the body movement frequency deduction is increased by one minute, wherein the highest body movement frequency deduction is-3. The rule of adding points for the duration of the deep sleep period can be as follows: and increasing the time length of the deep sleep period by one point every 30 minutes, wherein the time length plus points of the deep sleep period is up to +3 points.

S23: and determining the deduction weight, the sleep duration deduction and the grading cardinality.

In the embodiment of the present disclosure, the rules for determining the score-off weight, the score-off for sleeping duration, and the scoring cardinality are as follows:

s231: in the case that the sleep time is in the [0, 3.5) interval, the sleep time is deducted to-5, the deduction weight is 1, and the scoring cardinality is 47.

S232: in the case that the sleep time is in the interval of [3.5, 4.5), the sleep time is deducted as-4, the deduction weight is 1, and the score cardinality is 57.

S237: in the case where the sleep time period is in the [7,7.5) interval, the sleep time period is deducted to-1, the deduction weight is 1.5, and the scoring cardinality is 94.

S238: under the condition that the sleep time length is in the interval of [8.5, 9.5), the sleep time length is deducted to be 0, the deduction weight is determined by the total deduction value, and the scoring base number is 99.

Here, the deduction weight is determined by the following rule: the point weight is 2.5 in the case of the point total value in the (5, 10) interval, and the point weight is 4 in the case of the point total value in the (1, 3) interval, wherein the point weight when the point total value in the (3, 5) interval is not shown in fig. 2.

It should be understood that in the case where the sleep time period of the target subject is in the [4.5,7) interval, the sleep time period score, the score weight, and the score base are not shown in fig. 2.

S24: and determining the total deduction value based on the sleep duration deduction value and the partial deduction value.

S25: and determining the sleep evaluation score of the target object based on the total deduction value, the scoring base number and the deduction weight.

S26: based on the duration of the temporary nap, a sleep assessment score for the target subject is determined.

In the disclosed embodiment, the score base of the target subject may be a basic score, for example, 60 points, and the score base increases by one point every 15 minutes for the duration of the temporary snooze, and the score increase by 12 points at the maximum.

After the sleep evaluation score of the target object is determined, the sleep quality information of the target object can be determined based on the sleep evaluation score, wherein the sleep quality information can include sleep quality levels of the target object, and each sleep quality level corresponds to a different sleep evaluation score interval.

In the embodiment of the disclosure, the sleep quality information of the target object can be determined based on the sleep state analysis network, so that the accuracy of the determined sleep quality information of the target object is improved.

In an optional implementation manner, the home service system further includes: an adjustment module 30;

the adjusting module 30, after executing the home service, obtains the target object and updated monitoring data corresponding to the home environment where the target object is located, and instructs the processor to adjust the home service based on the updated monitoring data to obtain an updated home service; wherein the updating home service is used for indicating to adjust the object state of the target object.

In the embodiment of the present disclosure, a feedback mechanism for a plurality of sub-modules in the management module may be established, where the feedback mechanism may wait for a preset time period after executing the home service, and obtain updated monitoring data corresponding to a home environment where the target object is located after the preset time period, where the updated monitoring data may include updated state data and updated article data.

Next, the object state of the target object may be determined based on the update object data by the state monitoring sub-module described above, and the update object state data may be determined based on the object state. In addition, the article monitoring submodule can identify and update article information and article types of preset type articles in the article data to obtain first update subdata. In addition, the conversion of the home environment can be determined through the environment monitoring submodule to obtain second updated subdata.

After the updated object data, the first updated subdata and the second updated subdata are determined, the analyzer may determine a target item matching the current object data and/or an item intake scheme of the target item to indicate that the target object takes in the target item, so as to adjust the current object state of the target object.

In an optional implementation manner, when the current object state of the target object is a good sleep quality, the home service information may be acquired, and the home service information is determined as the updated home service information, so that the target object maintains the current object state.

In another optional implementation manner, when the current object state of the target state is still poor in sleep quality, the home service information may be analyzed to determine an adjustment scheme of the home service information, and obtain updated home service information, for example, changing food materials and recipes for the target object, so as to adjust the object state of the target object.

In the embodiment of the present disclosure, a feedback mechanism may be established for a plurality of sub-modules in the management module, so that after the home service is executed, updated monitoring data is obtained, the home service information is adjusted based on the updated monitoring data, and thus a more humanized and more appropriate home service is provided for the target object.

In an optional implementation manner, the home service system further includes: a terminal device 40;

and the terminal device 40 acquires the home service information and displays the home service information to the target object.

In the embodiment of the present disclosure, the terminal device is a device that can be used for data reception and data display, for example, a mobile phone, a tablet computer, and the like. After receiving the home service information, the terminal device can display the home service information to the target object through the display screen, and remind the target object to check in a manner of sending out prompt tone.

Here, in the case where the home service information includes the target item matching the sleep quality information of the target object and/or an item intake scheme of the target item as described above, the controller may transmit the home service information to the terminal device through a home service instruction, so that the terminal device presents the target item and/or the item intake scheme of the target item in response to the home service instruction.

In the embodiment of the disclosure, the home service information can be displayed through the terminal device, so that the interaction between the home service system and the target object is realized through the terminal device, and further more refined and intelligent home service is provided for the target object.

In an optional implementation manner, the home service system further includes: smart home devices 30, wherein, this smart home devices includes: the environment conditioning device 31;

and the environment adjusting device 31 performs environment adjusting operation on the home environment based on the home service instruction.

In the embodiment of the present disclosure, the home service instruction may indicate a service time of the environment adjustment operation and service content, where the service content may be temperature adjustment, humidity adjustment, light adjustment, music playing, and the like. The service time may be used to indicate a start time and an end time of the service content, for example, the music playing time may be a time for playing happy music, the start time may be a time for starting a meal for the target object, and the end time may be a time for ending the meal for the target object, so as to provide a more comfortable dining environment for the target object and improve the mood of the target object at the time of dining.

The link adjusting device may be an intelligent home device for executing corresponding service content, and after receiving the home service instruction, the intelligent home device may execute a corresponding environment adjusting operation based on the service time and the service content indicated by the home service instruction.

In the embodiment of the disclosure, the environment adjusting device may execute the corresponding home service operation at the service time and the service content indicated by the home service instruction, so as to provide a more comfortable home environment for the target object, and further improve the use experience of the target object.

In an optional implementation, in the home service system, the object information input by the target object is acquired, so that the processor performs analysis based on the object information and the object state data, and formulates home service information matched with the object state data and the object information for the target object based on the article data.

In the embodiment of the present disclosure, the target object may input object information through the terminal device, and the terminal device may send the object information to the processor for storage, where the object information may include at least one of: the number of family members, age, sex, etc. of the target object. The processor can acquire the object information before formulating the home service information matched with the object state data for the target object, and can perform analysis based on the object information and the object state data, thereby formulating the home service information matched with the object state data and the object information for the target object.

In the embodiment of the disclosure, the home service information can be formulated for the target object based on the object information and the object state data of the target object, so that the determined home service information is more refined, and more comfortable and refined home service is provided for the target object.

Referring to fig. 3, a schematic structural diagram of another home service system provided in the embodiment of the present disclosure is shown, and as shown in fig. 3, the home service system includes a plurality of sub-modules: the system comprises a state monitoring submodule, an article monitoring submodule and an environment monitoring submodule, wherein a plurality of submodules are in communication connection with a processor, and the processor can be a chip with an operation function and a control function.

Specifically, the processor may perform an operation based on the sleep state data acquired by the state monitoring submodule, determine a home service for improving the sleep quality of the target object, and control the corresponding smart home device to execute the home service; the method can also be used for calculating based on the first subdata acquired by the article monitoring submodule, determining the nutritional value intake and the rationalization recommendation matched with the health condition of the target object, and controlling the corresponding intelligent household equipment to display the nutritional value intake and the rationalization recommendation; and the operation can be performed based on the second subdata acquired by the environment monitoring submodule, so that the home service for adjusting the home environment and improving the mental state of the target object is determined, and the corresponding intelligent home equipment is controlled to execute the home service.

In the embodiment of the present disclosure, as shown in fig. 4, a schematic diagram of the processor coordinating, based on the monitoring data, the smart home devices corresponding to the sub-modules to execute the home service instruction is shown, where the schematic diagram includes steps S41 to S49, where:

s41: acquiring sleep state data of a target object sent by a state monitoring submodule;

s42: determining at least one sleep state of the target object through a sleep state analysis network based on the sleep state data, and determining sleep quality information of the target object based on the at least one sleep state;

s43: obtaining second subdata sent by the environment monitoring submodule, wherein the second subdata may include at least one of: temperature, humidity, air quality of the home environment;

s44: the method comprises the steps of obtaining food material types, food material positions and nutritional values sent by a refrigerator monitoring submodule in environment monitoring submodules, wherein the refrigerator monitoring submodule is a submodule used for monitoring food materials in a refrigerator;

s45: acquiring the type and the nutritive value of food materials sent by a steaming oven monitoring submodule in the environment monitoring submodule, wherein the steaming oven monitoring submodule is a submodule for monitoring the food materials in the steaming oven;

s46: acquiring the food material type and the nutritive value sent by an intelligent electric cooker monitoring submodule in the environment monitoring submodule, wherein the intelligent electric cooker monitoring submodule is a submodule for monitoring food materials in the intelligent electric cooker;

s47: determining an environment adjustment operation matched with the target object sleep quality information based on the sleep quality information;

s48: and determining food materials matched with the sleep quality information of the target object and/or a recipe of the food materials based on the sleep quality information and the article data.

Referring to fig. 5, a flowchart of a home service method provided in the embodiment of the present disclosure is shown, where the method includes steps S101 to S105, where:

s101: collecting monitoring data of a target object and a home environment where the target object is located; wherein the monitoring data comprises object state data and item data of items in the home environment.

In embodiments of the present disclosure, object status data as well as item data may be collected based on a data collection device. Specifically, the device for acquiring the state data of the subject may be a camera device, a sleep monitor, or the like, so as to acquire different types of state data of the subject, such as video frame data, vital sign data, or the like. Here, the imaging device may be configured to acquire video frame data including a target object, and the sleep monitor may be configured to acquire vital sign data of the target object, such as a heart rate and a blood pressure.

In addition, the article data may include first sub data and second sub data, where the second sub data may be used to indicate a home environment, and the first sub data may be used to indicate a preset type of article in the home environment, where the device for acquiring the first sub data may be a camera device or the like, and the first sub data is data obtained based on perception of an article included in the home environment, for example, the camera device may acquire a video frame in the home environment and determine the preset type of article included in the video frame. Meanwhile, the device for collecting the second subdata can be a sensor and the like, the sensor can be used for sensing the home environment to obtain the second subdata, and for example, the sensor can be a humidity sensor for sensing the ambient humidity, a temperature sensor for sensing the ambient temperature, a light sensor for sensing ambient light and the like.

S103: and analyzing based on object state data in the monitoring data to determine the state information of the target object.

In the embodiment of the present disclosure, the monitoring data of the target object collected by the management module may be obtained, and the state information of the target object may be obtained by analyzing the object state data in the monitoring data, where the state information may be used to represent information such as a health status of the target object. Specifically, in the case that the object state data includes video frame data, object features of the target object in each of the video frames may be acquired, where the object features may include face features and/or pose features, and the object state of the target object is analyzed based on the object features. For example, whether the target object is in a fatigue state may be analyzed based on the facial features, and whether the analysis result of the facial features is reliable may be determined based on the pose features.

S105: and formulating home service information matched with the state information for the target object based on the article data so as to perform home service on the target object based on the home service information.

In the embodiment of the disclosure, after the state information of the target object is determined, the home service information matched with the state information may be formulated for the target object based on the article data, and the home service information may include a scheme for indicating and adjusting a living habit of the target object, improving a health condition of the target object, and improving a comfort level of the target object.

After the home service information is determined, the corresponding intelligent home equipment can be instructed to execute the corresponding home service on the target object through the home service instruction. The process of specifically determining the corresponding smart home device to execute the home service is as shown in the embodiment corresponding to fig. 1, and is not described herein again.

In summary, in the embodiment of the present disclosure, data acquisition may be performed on a target object and a home environment in which the target object is located to obtain monitoring data, where the monitoring data may include object state data representing a physical condition of the object and article data obtained by sensing an article included in the home environment. Next, status information may be determined based on the object status data, wherein the status information may be used to learn the health status of the user, and then home service information may be formulated for the target object based on the item data, wherein the home service information may include a health improvement scheme formulated based on the status information. For example, the home service information may determine dishes contained in the home environment based on the item data, and formulate home service information containing a menu for the user based on the dishes. Based on this, the system and the method can help the user to improve the working efficiency and the living habit in a more convenient and intelligent mode, and further build the health.

It will be understood by those of skill in the art that in the above method of the present embodiment, the order of writing the steps does not imply a strict order of execution and does not impose any limitations on the implementation, as the order of execution of the steps should be determined by their function and possibly inherent logic.

Based on the same inventive concept, a home service device corresponding to the home service method is also provided in the embodiments of the present disclosure, and as the principle of solving the problem of the device in the embodiments of the present disclosure is similar to the home service method described above in the embodiments of the present disclosure, the implementation of the device may refer to the implementation of the method, and repeated details are not described again.

Referring to fig. 6, a schematic diagram of a home service device provided in an embodiment of the present disclosure is shown, where the device includes: the system comprises a collecting unit 61, an analyzing unit 62 and a formulating unit 63; wherein, the first and the second end of the pipe are connected with each other,

the acquisition unit 61 is used for acquiring a target object and monitoring data of a home environment where the target object is located; the monitoring data comprise object state data and article data of articles in the household environment;

an analyzing unit 62, configured to perform analysis based on object status data in the monitoring data, and determine status information of the target object;

and the formulating unit 63 is configured to formulate home service information matched with the state information for the target object based on the article data, so as to perform home service on the target object based on the home service information.

In the embodiment of the disclosure, data acquisition may be performed on a target object and a home environment in which the target object is located to obtain monitoring data, where the monitoring data may include object state data representing a physical condition of the object and article data obtained by sensing an article included in the home environment. Next, status information may be determined based on the object status data, wherein the status information may be used to learn the health status of the user, and then home service information may be formulated for the target object based on the item data, wherein the home service information may include a health improvement scheme formulated based on the status information. For example, the home service information may determine dishes contained in the home environment based on the item data, and formulate home service information containing a menu for the user based on the dishes. Based on this, the system and the method can help the user to improve the working efficiency and the living habit in a more convenient and intelligent mode, and further build the health.

In a possible embodiment, the acquiring unit 61 is further configured to:

detecting the target state of the target object, and acquiring object state data of the target object under the condition that the target object is detected to be in the target state; and

detecting the articles in the home environment, and collecting first subdata of articles of a preset type; wherein the preset type of article is an article used for nutrition intake of the target object; the first subdata is data in the article data; and

monitoring the home environment to obtain second subdata of the home environment; and the second subdata is data in the item data.

In a possible embodiment, the acquiring unit 61 is further configured to:

detecting a preset type article in the home environment, and determining article information of the preset type article; wherein the article information is used for indicating the position and/or the size of the preset type article;

identifying an item in the home environment, and determining an item type to which the identified item belongs.

In a possible embodiment, the analyzing unit 62 is further configured to:

under the condition that the object state data comprises sleep state data, determining sleep quality information of the target object based on the sleep state data, and formulating home service information matched with the sleep quality information for the target object based on the article data;

and determining the intelligent household equipment indicated by the household service information, and controlling the intelligent household equipment to execute household service.

In a possible embodiment, the analyzing unit 62 is further configured to:

determining preset type articles indicated by the article data, and determining target articles matched with the sleep quality information of the target object in the preset type articles, and/or article intake schemes of the target articles; wherein the preset type of article is an article used for nutritional intake by the target subject.

In a possible embodiment, the analyzing unit 62 is further configured to:

analyzing based on the sleep state data including the video frame data of the target object and/or the vital sign data of the target object, determining at least one sleep state of the target object, and determining the sleep quality information of the target object based on the at least one sleep state.

In one possible embodiment, the apparatus is further configured to:

after the home service is executed, acquiring the target object and updated monitoring data corresponding to a home environment where the target object is located, and instructing the processor to adjust the home service based on the updated monitoring data to obtain an updated home service; the updating home service is used for indicating to adjust the object state of the target object.

In one possible embodiment, the apparatus is further configured to:

and acquiring the home service information, and displaying the home service information to the target object.

The description of the processing flow of each unit in the device and the interaction flow between each unit may refer to the related description in the above method embodiments, and will not be described in detail here.

Corresponding to the home service method in fig. 1, an embodiment of the present disclosure further provides a computer device 700, and as shown in fig. 7, a schematic structural diagram of the computer device 700 provided in the embodiment of the present disclosure includes:

a processor 71, a memory 72, and a bus 73; the memory 72 is used for storing execution instructions and includes a memory 721 and an external memory 722; the memory 721 is also referred to as an internal memory, and is used for temporarily storing the operation data in the processor 71 and the data exchanged with the external memory 722 such as a hard disk, the processor 71 exchanges data with the external memory 722 through the memory 721, and when the computer device 700 is operated, the processor 71 communicates with the memory 72 through the bus 73, so that the processor 71 executes the following instructions:

collecting monitoring data of a target object and a home environment where the target object is located; wherein the monitoring data comprises object state data and article data of articles in the home environment;

The embodiment of the present disclosure further provides a computer-readable storage medium, where a computer program is stored on the computer-readable storage medium, and when the computer program is executed by a processor, the steps of the home service method in the foregoing method embodiment are executed. The storage medium may be a volatile or non-volatile computer-readable storage medium.

The embodiment of the present disclosure further provides a computer program product, where the computer program product carries a program code, and instructions included in the program code may be used to execute the steps of the home service method in the foregoing method embodiment, which may be referred to specifically in the foregoing method embodiment, and are not described herein again.

The computer program product may be implemented by hardware, software or a combination thereof. In an alternative embodiment, the computer program product is embodied in a computer storage medium, and in another alternative embodiment, the computer program product is embodied in a Software product, such as a Software Development Kit (SDK), or the like.

It is clear to those skilled in the art that, for convenience and brevity of description, the specific working processes of the system and the apparatus described above may refer to the corresponding processes in the foregoing method embodiments, and are not described herein again. In the several embodiments provided in the present disclosure, it should be understood that the disclosed system, apparatus and method may be implemented in other ways. The above-described embodiments of the apparatus are merely illustrative, and for example, the division of the units is only one logical division, and there may be other divisions when actually implemented, and for example, a plurality of units or components may be combined or integrated into another system, or some features may be omitted, or not executed. In addition, the shown or discussed mutual coupling or direct coupling or communication connection may be an indirect coupling or communication connection of devices or units through some communication interfaces, and may be in an electrical, mechanical or other form.

The units described as separate parts may or may not be physically separate, and parts displayed as units may or may not be physical units, may be located in one place, or may be distributed on a plurality of network units. Some or all of the units can be selected according to actual needs to achieve the purpose of the solution of the embodiment.

In addition, functional units in the embodiments of the present disclosure may be integrated into one processing unit, or each unit may exist alone physically, or two or more units are integrated into one unit.

The functions, if implemented in software functional units and sold or used as a stand-alone product, may be stored in a non-transitory computer-readable storage medium executable by a processor. Based on such understanding, the technical solution of the present disclosure may be embodied in the form of a software product, which is stored in a storage medium and includes several instructions for causing a computer device (which may be a personal computer, a server, or a network device) to execute all or part of the steps of the method according to the embodiments of the present disclosure. And the aforementioned storage medium includes: various media capable of storing program codes, such as a usb disk, a removable hard disk, a Read-Only Memory (ROM), a Random Access Memory (RAM), a magnetic disk, or an optical disk.

Finally, it should be noted that: the above-mentioned embodiments are merely specific embodiments of the present disclosure, which are used for illustrating the technical solutions of the present disclosure and not for limiting the same, and the scope of the present disclosure is not limited thereto, and although the present disclosure is described in detail with reference to the foregoing embodiments, those skilled in the art should understand that: those skilled in the art can still make modifications or changes to the embodiments described in the foregoing embodiments, or make equivalent substitutions for some of the technical features, within the technical scope of the disclosure; such modifications, changes or substitutions do not depart from the spirit and scope of the embodiments of the present disclosure, and should be construed as being included therein. Therefore, the protection scope of the present disclosure shall be subject to the protection scope of the claims.

Claims

1. A home service system, comprising: a management module and a processor;

the management module is used for acquiring data of the target object and the home environment where the target object is located to obtain monitoring data; wherein the monitoring data comprises object state data and article data of articles in the home environment;

the processor analyzes the object state data in the monitoring data, determines the state information of the target object, formulates the home service information matched with the state information for the target object based on the article data, and indicates the corresponding intelligent home equipment to execute the home service based on the home service information.

2. The system of claim 1, wherein the management module comprises: the system comprises a state monitoring submodule, an article monitoring submodule and an environment monitoring submodule;

the state monitoring submodule is used for detecting the target state of the target object and acquiring the object state data of the target object under the condition that the target object is detected to be in the target state;

3. The system of claim 2, wherein the item monitoring sub-module comprises: an item information identification network and/or an item type identification network;

4. The system of claim 1, wherein the processor comprises: an analyzer and a controller;

and the controller determines the intelligent household equipment indicated by the household service information and controls the intelligent household equipment to execute the household service.

5. The system according to claim 4, wherein the analyzer determines a preset type of item indicated by the item data, and determines a target item matching the sleep quality information of the target subject among the preset type of item, and/or an item intake scheme of the target item; wherein the preset type of article is an article used for nutrition intake of the target object.

6. The system of claim 4, wherein the analyzer comprises: a sleep state analysis network;

7. The system of claim 1, wherein the home service system further comprises: an adjustment module;

the adjusting module is used for acquiring the target object and updated monitoring data corresponding to the home environment where the target object is located after the home service is executed, and instructing the processor to adjust the home service based on the updated monitoring data to obtain an updated home service; the updating home service is used for indicating to adjust the object state of the target object.

8. The system of claim 1, wherein the home service system further comprises: a terminal device;

9. A home service method is characterized by comprising the following steps:

10. A home service apparatus, comprising:

11. A computer device, comprising: a processor, a memory and a bus, the memory storing machine-readable instructions executable by the processor, the processor and the memory communicating over the bus when a computer device is running, the machine-readable instructions when executed by the processor performing the steps of the home service method of claim 9.

12. A computer-readable storage medium, characterized in that the computer-readable storage medium has stored thereon a computer program which, when being executed by a processor, performs the steps of the home service method as claimed in claim 9.