CN114251798A

CN114251798A - Control method, device and equipment of air conditioning system and storage medium

Info

Publication number: CN114251798A
Application number: CN202011027492.5A
Authority: CN
Inventors: 单联瑜; 梁艳争
Original assignee: Beijing Xiaomi Mobile Software Co Ltd
Current assignee: Beijing Xiaomi Mobile Software Co Ltd
Priority date: 2020-09-25
Filing date: 2020-09-25
Publication date: 2022-03-29

Abstract

The disclosure relates to a control method, a device, equipment and a storage medium of an air conditioning system, wherein the air conditioning system comprises an image acquisition device and an image processing device; the method comprises the following steps: acquiring image information of the current environment of the user through the image acquisition device; processing the image information through the image processing device to obtain a processing result, wherein the processing result comprises air conditioner control information corresponding to the user; controlling the air conditioning system based on the air conditioning control information. This is disclosed because based on image acquisition device obtains the image information of the current environment that the user is located to obtain the air conditioning control information that the user corresponds based on the processing result of this image information, and then can be based on this air conditioning control information control air conditioning system, can improve the intelligent level of controlling air conditioning system, promote the control effect to air conditioning system, and then can promote user experience, be favorable to promoting air conditioning system's market competition.

Description

Control method, device and equipment of air conditioning system and storage medium

Technical Field

The present disclosure relates to the field of smart home technologies, and in particular, to a method, an apparatus, a device, and a storage medium for controlling an air conditioning system.

Background

Air conditioning systems in the related art generally employ thermal infrared devices to achieve simple identification of the location of a human body. However, these methods have low accuracy in positioning the human body, and further may affect the subsequent control effect on the air conditioning system, affect the user experience, and further are not favorable for improving the market competitiveness of the air conditioning system.

Disclosure of Invention

In order to overcome the problems in the related art, embodiments of the present disclosure provide a control method, device, apparatus and storage medium for an air conditioning system, so as to solve the defects in the related art.

According to a first aspect of the embodiments of the present disclosure, there is provided a control method of an air conditioning system, the air conditioning system including an image acquisition device and an image processing device;

the method comprises the following steps:

acquiring image information of the current environment of the user through the image acquisition device;

processing the image information through the image processing device to obtain a processing result, wherein the processing result comprises air conditioner control information corresponding to the user;

controlling the air conditioning system based on the air conditioning control information.

In an embodiment, the processing, by the image processing apparatus, the image information to obtain a processing result includes:

acquiring a face recognition result of the user in the image information through the image processing device;

and determining air conditioner control information corresponding to the user based on the face recognition result.

In an embodiment, the determining, based on the face recognition result, air conditioning control information corresponding to the user includes:

determining identity information of the user based on the face recognition result;

and determining air conditioner control information corresponding to the user based on the identity information.

In one embodiment, the air conditioning system comprises a plurality of air conditioning sub-devices, wherein each air conditioning sub-device is arranged in a set space in the environment where the user is located;

the determining the air conditioner control information corresponding to the user based on the identity information includes:

determining user behavior habit information corresponding to the identity information based on pre-constructed corresponding relation data;

and prejudging the current set space of the user based on the user behavior habit information, and acquiring air conditioner control information of target air conditioner sub-equipment in the set space.

acquiring a human body positioning result of the user in the image information through the image processing device;

and determining air conditioner control information corresponding to the user based on the human body positioning result.

In an embodiment, the determining, based on the human body positioning result, air conditioner control information corresponding to the user includes:

determining limb information of the user based on the human body positioning result, wherein the limb information comprises at least one of body structure information and motion information;

acquiring an action pre-judging result of the user based on the limb information;

and determining air conditioner control information corresponding to the user based on the action prejudgment result.

determining relative information of the user and an air outlet of the air conditioning system based on the human body positioning result, wherein the relative information comprises at least one of relative distance, relative height and relative angle;

and determining air conditioner control information corresponding to the user based on the relative information and the environmental parameters preset by the user, wherein the environmental parameters comprise air output and/or temperature, and the air conditioner control information comprises at least one of air output, temperature and air door angle.

In an embodiment, the method further comprises:

extracting depth-of-field information of the human body positioning result from the image information;

the determining the relative information between the user and the air outlet of the air conditioning system based on the human body positioning result comprises:

and determining the relative information between the user and the air outlet of the air conditioning system based on the depth of field information and the human body positioning result.

In an embodiment, in a case that the image processing apparatus includes a wireless communication module, the processing, by the image processing apparatus, the processing the image information to obtain a processing result includes:

sending the image information to a server side for processing through the wireless communication module;

and receiving the processing result of the image information returned by the server through the wireless communication module.

According to a second aspect of the embodiments of the present disclosure, there is provided a control device of an air conditioning system, the air conditioning system further comprising an image acquisition device and an image processing device;

the device comprises:

the image information acquisition module is used for acquiring the image information of the current environment of the user through the image acquisition device;

the processing result acquisition module is used for processing the image information through the image processing device to obtain a processing result, and the processing result comprises air conditioner control information corresponding to the user;

and the air conditioning system control module is used for controlling the air conditioning system based on the air conditioning control information.

In an embodiment, the processing result obtaining module includes:

a face recognition unit, configured to obtain, by the image processing apparatus, a face recognition result of the user in the image information;

and the first information determining unit is used for determining the air conditioner control information corresponding to the user based on the face recognition result.

In an embodiment, the first information determining unit is further configured to:

the first information determination unit is further configured to:

In an embodiment, the processing result obtaining module includes:

the human body positioning unit is used for acquiring a human body positioning result of the user in the image information through the image processing device;

and the second information determining unit is used for determining the air conditioner control information corresponding to the user based on the human body positioning result.

In an embodiment, the second information determining unit is further configured to:

In an embodiment, the second information determination unit is further configured to:

In an embodiment, the processing result obtaining module further includes:

a depth of field information extraction unit that extracts depth of field information of the human body positioning result from the image information;

the second information determination unit is further configured to:

In an embodiment, in a case where the image processing apparatus includes a wireless communication module, the processing result obtaining module includes:

the image information sending unit is used for sending the image information to a server side for processing through the wireless communication module;

and the processing result acquisition unit is used for receiving the processing result of the image information returned by the server through the wireless communication module.

According to a third aspect of the embodiments of the present disclosure, there is provided a control apparatus of an air conditioning system, the air conditioning system including an image acquisition device and an image processing device;

the control apparatus includes:

a processor, and a memory for storing processor-executable instructions;

wherein the processor is configured to:

According to a fourth aspect of embodiments of the present disclosure, there is provided a computer-readable storage medium having stored thereon a computer program which, when executed by a processor, implements:

acquiring image information of an environment where a user is located through an image acquisition device;

processing the image information through an image processing device to obtain a processing result, wherein the processing result comprises air conditioner control information corresponding to the user;

and controlling an air conditioning system based on the air conditioning control information.

The technical scheme provided by the embodiment of the disclosure can have the following beneficial effects:

the image acquisition device acquires image information of the current environment where the user is located, the image processing device processes the image information to obtain a processing result, the processing result comprises air conditioner control information corresponding to the user, and the air conditioning system can be controlled based on the air conditioner control information.

It is to be understood that both the foregoing general description and the following detailed description are exemplary and explanatory only and are not restrictive of the disclosure.

Drawings

The accompanying drawings, which are incorporated in and constitute a part of this specification, illustrate embodiments consistent with the present disclosure and together with the description, serve to explain the principles of the disclosure.

FIG. 1 is a flow chart illustrating a method of controlling an air conditioning system according to an exemplary embodiment;

FIG. 2 is a flow diagram illustrating how the image information is processed by the image processing apparatus according to an example embodiment;

FIG. 3 is a flow diagram illustrating how air conditioning control information corresponding to the user is determined based on the face recognition result, according to an example embodiment;

FIG. 4 is a flow diagram illustrating how air conditioning control information corresponding to the user is determined based on the identity information in accordance with an exemplary embodiment;

FIG. 5 is a flow chart illustrating how the image information is processed by the image processing apparatus according to yet another exemplary embodiment;

FIG. 6 is a flowchart illustrating how to determine air conditioning control information corresponding to the user based on the human body positioning result according to an example embodiment;

FIG. 7 is a flowchart illustrating how to determine air conditioning control information corresponding to the user based on the human body positioning result according to yet another exemplary embodiment;

FIG. 8 is a flowchart illustrating how to determine air conditioning control information corresponding to the user based on the human body positioning result according to another exemplary embodiment;

FIG. 9 is a flow chart illustrating how the image information is processed by the image processing apparatus according to another exemplary embodiment;

FIG. 10 is a schematic diagram illustrating an application scenario of a control method of an air conditioning system according to an exemplary embodiment;

fig. 11 is a block diagram illustrating a control apparatus of an air conditioning system according to an exemplary embodiment;

fig. 12 is a block diagram illustrating a control apparatus of an air conditioning system according to still another exemplary embodiment;

FIG. 13 is a block diagram illustrating an electronic device in accordance with an example embodiment.

Detailed Description

Reference will now be made in detail to the exemplary embodiments, examples of which are illustrated in the accompanying drawings. When the following description refers to the accompanying drawings, like numbers in different drawings represent the same or similar elements unless otherwise indicated. The embodiments described in the following exemplary embodiments do not represent all embodiments consistent with the present disclosure. Rather, they are merely examples of apparatus and methods consistent with certain aspects of the present disclosure, as detailed in the appended claims.

FIG. 1 is a flow chart illustrating a method of controlling an air conditioning system according to an exemplary embodiment; the method of the embodiment can be applied to control equipment of an air conditioning system (such as an air conditioner, a fresh air machine, an air purifier and the like). The air conditioning system comprises an image acquisition device and an image processing device.

As shown in fig. 1, the method comprises the following steps S101-S103:

in step S101, image information of an environment where the user is currently located is obtained through the image capturing device.

In this embodiment, when the image acquisition device detects the presence of the user, the image acquisition device may acquire image information of the current environment where the user is located, and send the image information to the control device of the air conditioning system.

The image information includes an image of a user and an environment where the user is located.

In step S102, the image processing apparatus processes the image information to obtain a processing result.

In this embodiment, after the image information of the current environment of the user is acquired by the image acquisition device, the image information may be processed by the image processing device to obtain a processing result.

The image processing device may include at least one of a network camera processing chip or a wireless communication module, and the processing result may include air conditioner control information corresponding to the user.

In an embodiment, in a case that the image processing apparatus includes a network camera processing chip, the image information may be processed by the network camera processing chip to obtain a processing result.

In another embodiment, in a case that the image processing apparatus includes a wireless communication module, the image information may be sent to the server through the wireless communication module, so that the server processes the image information to obtain a processing result, and then receives the processing result returned by the server.

In another embodiment, the manner of processing the image information by the image processing apparatus can also refer to the embodiments shown in fig. 2 to 9, which will not be described in detail herein.

In step S103, the air conditioning system is controlled based on the air conditioning control information.

In this embodiment, after the image processing apparatus processes the image information to obtain a processing result, the air conditioning system may be controlled based on air conditioning control information included in the processing result.

For example, the air conditioning control information may include control parameters of the air conditioning system, such as at least one of an air volume, a wind direction, a wind speed, a temperature, a humidity, a volume mode, and an opening/closing of the air outlet.

As can be seen from the above description, this embodiment passes through the image information of the current environment where the user is located is obtained by the image acquisition device, and passes through the image processing device is right the image information is processed to obtain the processing result, the processing result includes the air conditioning control information that the user corresponds, and then can be based on the control of the air conditioning control information the air conditioning system, because the image information of the current environment where the user is located is obtained based on the image acquisition device, and the air conditioning control information that the user corresponds is obtained based on the processing result of this image information, and then can control the air conditioning system based on this air conditioning control information, can improve the intelligent level of controlling the air conditioning system, promote the control effect to the air conditioning system, and then can promote user experience, be favorable to promoting the market competitiveness of the air conditioning system.

FIG. 2 is a flow diagram illustrating how the image information is processed by the image processing apparatus according to an example embodiment; the present embodiment exemplifies how the image information is processed by the image processing apparatus on the basis of the above-described embodiments. As shown in fig. 2, the processing of the image information by the image processing apparatus in the above step S102 to obtain a processing result may include the following steps S201 to S202:

in step S201, a face recognition result of the user in the image information is acquired by the image processing apparatus.

In this embodiment, after the image information of the current environment where the user is located is acquired by the image acquisition device, the face recognition result of the user in the image information may be acquired by the image processing device.

For example, after the image information of the environment where the user is located is obtained, a preset face recognition technology may be adopted to perform face recognition on the user in the image information, so as to obtain a face recognition result of the user.

It should be noted that, in the preset face recognition technology, a developer may select a scheme in a related technology based on actual service needs, which is not limited in this embodiment.

In step S202, air conditioning control information corresponding to the user is determined based on the face recognition result.

In this embodiment, after the image processing apparatus obtains the face recognition result of the user in the image information, the air-conditioning control information corresponding to the user may be determined based on the face recognition result.

For example, after the face recognition result of the user in the image information is obtained, the pre-constructed corresponding relationship data may be queried based on the face recognition result to determine the air conditioner control information corresponding to the user.

The correspondence data may be correspondence data between pre-constructed face image information of different users and required air conditioner control information.

It should be noted that the air-conditioning control information required by the different users may be set by the user based on the self-requirement, or set by the developer based on the business experience of the air-conditioning control requirements of the different users, which is not limited in this embodiment.

As can be seen from the above description, in this embodiment, the image processing device is used to obtain the face recognition result of the user in the image information, and the air conditioning control information corresponding to the user is determined based on the face recognition result, so that the air conditioning control information suitable for the user can be accurately determined based on the face recognition result of the user, a foundation is laid for subsequently controlling the air conditioning system based on the determined air conditioning control information, the control effect of the air conditioning system can be improved, and the user experience can be improved.

FIG. 3 is a flow diagram illustrating how air conditioning control information corresponding to the user is determined based on the face recognition result, according to an example embodiment; the present embodiment takes an example of how to determine the air conditioning control information corresponding to the user based on the face recognition result on the basis of the above-mentioned embodiments. As shown in fig. 3, the determining of the air conditioning control information corresponding to the user based on the face recognition result in step S202 may include the following steps S301 to S302:

in step S301, identity information of the user is determined based on the face recognition result.

In this embodiment, after the image processing apparatus obtains the face recognition result of the user in the image information, the identity information of the user may be determined based on the face recognition result.

For example, after the face recognition result of the user in the image information is obtained, the identity information of the user may be determined based on the matching relationship between the face recognition result of the user and the identity information of the user, and for specific explanation and explanation, reference may be made to related technologies, which is not limited in this embodiment.

In step S302, air conditioning control information corresponding to the user is determined based on the identity information.

In this embodiment, after the identity information of the user is determined based on the face recognition result, the air conditioner control information corresponding to the user may be determined based on the identity information.

For example, after the identity information of the user is determined, the pre-constructed corresponding relationship data may be queried based on the identity information to determine the air conditioning control information corresponding to the user.

The correspondence data may be correspondence data between pre-constructed identity information of different users and required air conditioner control information.

As can be seen from the above description, in this embodiment, the identity information of the user is determined based on the face recognition result, and the air conditioning control information corresponding to the user is determined based on the identity information, so that the air conditioning control information suitable for the user can be accurately determined based on the identity information of the user, a foundation is laid for subsequently controlling the air conditioning system based on the determined air conditioning control information, the control effect of the air conditioning system can be improved, and the user experience can be improved.

FIG. 4 is a flow diagram illustrating how air conditioning control information corresponding to the user is determined based on the identity information in accordance with an exemplary embodiment; the present embodiment is exemplified by how to take the example on the basis of the above-described embodiments. In this embodiment, the air conditioning system includes a plurality of air conditioning sub-devices, and each of the air conditioning sub-devices is disposed in a setting space in an environment where the user is located. As shown in fig. 4, the determining of the air conditioning control information corresponding to the user based on the identity information in step S302 may include the following steps S401 to S402:

in step S401, based on the pre-constructed correspondence data, the user behavior habit information corresponding to the identity information is determined.

In this embodiment, after the identity information of the user is determined based on the face recognition result, the user behavior habit information corresponding to the identity information may be determined based on the pre-constructed correspondence data. The user behavior habit information may include a behavior habit of the user in a set time setting space.

For example, after the identity information of the user is determined, the behavior habit information of the user in the current time period, such as the behavior habit that the user lies down in the room a at 11 pm, can be determined based on the identity information of the user.

The user behavior habit information corresponding to the identity information can be obtained based on the following modes:

considering that the activity habits and the occurrence time of the user at home are relatively fixed under the common condition, the normally open type camera can be used for collecting the air conditioner control information of the user at each set time (such as every 5 minutes, half hour and the like) and each set space (such as each room and the like), and uploading the air conditioner control information to the cloud server (or sending the air conditioner control information to the network camera chip) for continuous accumulation and learning, so that the behavior habits of the user at the set time and the set space are obtained. For example: when the user is in the room B at the time A, the cloud server (or the network camera chip) can issue corresponding air conditioner control information to the air conditioning system according to the previous memory so as to meet the use habit of the user.

In step S402, a set space where the user is currently located is pre-determined based on the user behavior habit information, and air conditioner control information of a target air conditioner sub-device in the set space is acquired.

In this embodiment, after determining the user behavior habit information corresponding to the identity information based on the pre-constructed corresponding relationship data, the set space where the user is currently located may be pre-determined based on the user behavior habit information, and the air-conditioning control information of the target air-conditioning sub-device in the set space may be acquired.

For example, after determining the user behavior habit information corresponding to the identity information, the set space where the user is currently located may be determined based on the user behavior habit information, and then the air conditioner control information of the target air conditioner sub-device in the set space may be obtained. For example, when it is determined that the identity information of the user is "user a", it may be determined that the behavior habit information of "user a" is "a rest in room B at nine night", and then the air-conditioning sub-device of room B may be turned on at nine night, and the air-conditioning sub-device is controlled based on the acquired air-conditioning control information of the air-conditioning sub-device.

It is to be noted that, considering that the user does not generally want the head to be directly blown by the air conditioner when using the air conditioning system, the air conditioning control information for the opening angle of the damper and the amount of air volume of the air conditioning system can be determined when judging the posture of the user currently sitting or standing based on the user behavior habit information. The air conditioning control information may be used to prevent the head of the user from being blown straight.

As can be seen from the above description, in this embodiment, based on the pre-constructed corresponding relationship data, the user behavior habit information corresponding to the identity information is determined, the set space where the user is currently located is pre-determined based on the user behavior habit information, and the air conditioning control information of the target air conditioning sub-device in the set space is acquired, so that the determination of the air conditioning control information corresponding to the user based on the user identity information can be realized, the accuracy of determining the air conditioning control information can be improved, an accurate basis can be provided for subsequently controlling the air conditioning system based on the determined air conditioning control information, the control effect of the air conditioning system can be improved, and the user experience can be improved.

FIG. 5 is a flow chart illustrating how the image information is processed by the image processing apparatus according to yet another exemplary embodiment; the present embodiment exemplifies how the image information is processed by the image processing apparatus on the basis of the above-described embodiments. As shown in fig. 5, the processing of the image information by the image processing apparatus in the above step S102 to obtain a processing result may include the following steps S501 to S502:

in step S501, a result of positioning the human body of the user in the image information is obtained by the image processing apparatus.

In this embodiment, after the image information of the current environment where the user is located is acquired by the image acquisition device, the human body positioning result of the user in the image information may be acquired by the image processing device.

For example, after acquiring image information of the environment where the user is located, the image processing apparatus may determine, based on the image information, a positioning result of the human body in the current environment, such as an orientation of the human body relative to the air conditioner, a volume of the human body, and a shape (e.g., lying, standing, sitting, etc.) of the human body.

In step S502, air conditioning control information corresponding to the user is determined based on the human body positioning result.

In this embodiment, after the human body positioning result of the user in the image information is obtained by the image processing device, the air conditioner control information corresponding to the user may be determined based on the human body positioning result.

In an embodiment, when the human body positioning result of the user in the image information is obtained by the image processing device, in order to avoid that the head of the user is directly blown by an air conditioner when the user uses an air conditioning system, the air conditioning control information corresponding to the user may be determined based on the human body positioning result.

The air conditioning control information may include control parameters of the air conditioning system, such as at least one of an air volume, a wind direction, a wind speed, and an opening/closing of the air outlet.

For example, in a home environment, the ambient temperature requirements of users are consistent, but when the users are close to the air outlet or far from the air outlet, the actual feelings of the users are completely different due to no change in the air output, the air door angle, and the like of the air conditioning system. Therefore, at the moment, the control device of the air conditioning system can accurately judge the current position of the human body according to the obtained human body positioning result of the user, so that the operation parameters of the air conditioning system are actively modified, such as the air volume, the temperature, the air door angle and the like are improved/reduced.

For another example, in a bedroom environment, when a user lies on a bed to prepare for a rest, the control device of the air conditioning system determines that the air door of the air conditioning system faces the bed of the user based on the human body positioning result of the user, and the user is in a lying position, and at this time, the control device of the air conditioning system can automatically adjust the angle of the air door to prevent the user from being directly blown by wind.

Under the condition that children exist at home, the vertical air conditioner air outlet completely covers the whole body of the children due to the fact that the heights of the children are short, and the children are completely exposed to cold air and directly blow the cold air. By adopting the scheme, when the camera identifies the human body positioning result of the child, the control parameters of the air conditioning system can be adjusted, such as an air door at the lower part of the air conditioning system is automatically closed, and the child is prevented from being directly blown by wind.

As can be seen from the above description, in this embodiment, the image processing device is used to obtain the human body positioning result of the user in the image information, and the air conditioner control information corresponding to the user is determined based on the human body positioning result, so that the determination of the air conditioner control information corresponding to the user based on the human body positioning result of the user can be realized, the reduction of user experience due to direct blowing by an air conditioner can be avoided, the influence on the health of the user can be avoided, the control effect of an air conditioning system can be improved, and the user experience can be improved.

FIG. 6 is a flowchart illustrating how to determine air conditioning control information corresponding to the user based on the human body positioning result according to an example embodiment; the present embodiment takes how to determine the air conditioning control information corresponding to the user based on the human body positioning result as an example based on the above embodiments. As shown in fig. 6, the determining of the air conditioning control information corresponding to the user based on the human body positioning result in step S502 may include the following steps S601-S603:

in step S601, limb information of the user is determined based on the human body positioning result.

In this embodiment, after the image processing apparatus obtains the human body positioning result of the user in the image information, the limb information of the user may be determined based on the human body positioning result.

Wherein the limb information includes at least one of body structure information and motion information.

For example, after the human body positioning result of the user is determined, the limb information of the user may be determined based on the human body positioning result of the user, such as the user currently doing actions of sitting down, rising up, moving left and right, and the like.

In step S602, an action prediction result of the user is obtained based on the limb information.

In this embodiment, after determining the limb information of the user based on the human body positioning result, the action prediction result of the user may be obtained based on the limb information.

For example, after the body information of the user is determined, the features of the body information may be extracted, and the extracted features may be input into a pre-trained motion pre-judging model to obtain a result of the motion pre-judging of the user.

It should be noted that the motion prediction model may be constructed and trained in advance based on sample data, for example, sample image information of a user may be acquired by an image acquisition device, the acquired sample image information is uploaded to a cloud server, and the cloud server performs image processing and analysis on the sample image information, so as to train to obtain the pre-constructed motion prediction model. The action pre-judging model can learn by continuously extracting the human body structure model and the action characteristics of the user, and gradually learns to pre-judge the body actions of the user.

The action anticipation result may include actions that the user will sit down, stand up, move left/right, and the like.

In step S603, air conditioning control information corresponding to the user is determined based on the action prediction result.

In this embodiment, after the action prediction result of the user is obtained based on the limb information, the air conditioner control information corresponding to the user may be determined based on the action prediction result.

For example, after the action pre-determination result of the user is obtained, if the user is pre-determined to take actions such as sitting down, standing up, moving left/right, and the like, the screenshot adjusts the wind direction and/or the wind speed of the air conditioning system in advance so as to prevent the head of the user from being directly blown by wind.

According to the above description, this embodiment is based on the human body positioning result is determined the user's limb information, and is based on the limb information obtains user's action prejudgment result, and then is based on the action prejudgment result is determined the air conditioner control information that the user corresponds can realize prejudgment to the user's action, and then can be based on the action prejudgment result is determined the air conditioner control information that the user corresponds can improve accuracy and rationality of determining the air conditioner control information, avoids reducing user experience because of being directly blown by the air conditioner, influences the user healthy, can promote air conditioning system's control effect, promotes user's experience.

FIG. 7 is a flowchart illustrating how to determine air conditioning control information corresponding to the user based on the human body positioning result according to yet another exemplary embodiment; the present embodiment takes how to determine the air conditioning control information corresponding to the user based on the human body positioning result as an example based on the above embodiments. As shown in fig. 7, the determining of the air conditioning control information corresponding to the user based on the human body positioning result in step S502 may include the following steps S701 to S702:

in step S701, relative information between the user and an air outlet of the air conditioning system is determined based on the human body positioning result.

In this embodiment, after the image processing device obtains the human body positioning result of the user in the image information, the relative information between the user and the air outlet of the air conditioning system may be determined based on the human body positioning result. Wherein the relative information may include at least one of a relative distance, a relative height, and a relative angle.

For example, after the human body positioning result of the user is obtained from the image information based on the image processing device, the position, height and direction of the user may be obtained, and then at least one of the relative distance, the relative height and the relative angle between the user and the air outlet of the air conditioning system, that is, the relative information between the user and the air outlet of the air conditioning system may be calculated by combining the position, the height and the direction of the air outlet of the air conditioning system.

It is noted that the height of the user may be a distance between the highest point and the lowest point of the user's body. For example, when the user is in a standing position, the height of the user may be the height of the user; when the user is in a sitting posture, the height of the user can be the distance from the highest point of the head of the user to the sole of the foot of the user; similarly, when the user is in the lying posture, the height of the user may be the distance from the highest point of the user's body to the lowest point of the user's body.

In step S702, air conditioning control information corresponding to the user is determined based on the relative information and the environmental parameter preset by the user.

In this embodiment, after determining the relative information between the user and the air outlet of the air conditioning system based on the human body positioning result, the air conditioning control information corresponding to the user may be determined based on the relative information and the environmental parameter preset by the user.

The environmental parameter may include an air output and/or a temperature of the air conditioning system. The air conditioning control information may include at least one of an air output, a temperature, and an air door angle of the air conditioning system.

For example, after determining the relative information such as the relative distance, the relative height, and the relative angle between the user and the air outlet of the air conditioning system, the influence of the relative information may be considered on the basis of the environmental parameters preset by the user. For example, when the user is close to the air conditioning system, if the environmental parameter preset by the user includes 20 ℃, the value of the temperature in the air conditioning control information may be appropriately increased (e.g., increased by 0.5 degrees celsius, etc., and the adjustment amplitude may be set based on actual needs); and when the distance between the user and the air conditioning system is far, if the environmental parameter preset by the user comprises 20 ℃, the value of the corresponding parameter in the air conditioning control information can be properly reduced. Similarly, the influence of the environmental parameters preset by the user, such as the relative height and the relative angle between the user and the air outlet of the air conditioning system, can be considered to determine the air conditioning control information corresponding to the user, and the specific mediation mode can be set based on the actual demand, which is not limited in this embodiment.

As can be seen from the above description, in this embodiment, the relative information between the user and the air outlet of the air conditioning system is determined based on the human body positioning result, and includes at least one of the relative distance, the relative height, and the relative angle, and then the air conditioning control information corresponding to the user is determined based on the relative information and the environmental parameter preset by the user, so that the information such as the relative distance, the relative height, and the relative angle between the user and the air outlet of the air conditioning system can be accurately determined based on the human body positioning result of the user, and then the air conditioning control information corresponding to the user is determined by combining the relative information and the environmental parameter preset by the user, and the accuracy of determining the air conditioning control information can be further improved, so that the determined air conditioning control information meets the requirements of the user more, and the intelligence level of air conditioning control is improved.

FIG. 8 is a flowchart illustrating how to determine air conditioning control information corresponding to the user based on the human body positioning result according to another exemplary embodiment; the present embodiment takes how to determine the air conditioning control information corresponding to the user based on the human body positioning result as an example based on the above embodiments. As shown in fig. 8, the determining of the air conditioning control information corresponding to the user based on the human body positioning result in step S502 may include the following steps S801 to S803:

in step S801, depth information of the human body positioning result is extracted from the image information.

In this embodiment, the image information and the depth-of-field information of the image may be acquired by using a binocular camera or other cameras capable of calculating the depth-of-field information, so that the human body positioning result of the user may be determined based on the acquired image, and the depth-of-field information of the human body positioning result may be extracted.

In step S802, relative information between the user and the air outlet of the air conditioning system is determined based on the depth of field information and the human body positioning result.

In this embodiment, after the depth of field information of the human body positioning result is extracted from the image information, the relative information between the user and the air outlet of the air conditioning system may be determined based on the depth of field information and the human body positioning result.

For example, when depth information of the human body positioning result of the user is determined, relative information (e.g., at least one of a relative distance, a relative height, and a relative angle) of the body of the user with respect to the image capturing device of the air conditioning system may be determined based on the depth information. Further, the information of the user relative to the air outlet of the air conditioning system may be obtained by converting based on a position relationship (the position relationship is known) between the image capturing device of the air conditioning system and the air outlet, and a specific conversion manner may refer to explanations and descriptions in related technologies, which is not limited in this embodiment.

In step S803, air conditioning control information corresponding to the user is determined based on the relative information and the environmental parameter preset by the user. The environmental parameters may include an air output and/or a temperature of the air conditioning system. The air conditioning control information may include at least one of an air output, a temperature, and an air door angle of the air conditioning system.

For the explanation and explanation of step S803, reference may be made to the above embodiments, which are not repeated herein.

As can be seen from the above description, in this embodiment, by extracting the depth-of-field information of the human body positioning result from the image information, and determining the relative information between the user and the air outlet of the air conditioning system based on the depth-of-field information and the human body positioning result, the accuracy of determining the relative information between the user and the air outlet of the air conditioning system can be improved, and then the accuracy of subsequently determining the air conditioning control information corresponding to the user based on the relative information and the environmental parameter preset by the user is ensured, so that the determined air conditioning control information can better meet the requirements of the user, and the intelligence level of air conditioning control is improved.

FIG. 9 is a flow chart illustrating how the image information is processed by the image processing apparatus according to another exemplary embodiment; the present embodiment takes how to determine the air conditioning control information corresponding to the user based on the human body positioning result as an example based on the above embodiments. The image processing device comprises at least one of a network camera processing chip or a wireless communication module.

In this embodiment, when the image processing apparatus includes a wireless communication module, as shown in fig. 9, the processing of the image information by the image processing apparatus in the step S102 may include the following steps S901 to S902:

in step S901, the image information is sent to a server for processing through the wireless communication module.

In this embodiment, after the image information of the current environment of the user is acquired by the image acquisition device, the image information may be sent to the server side for processing through the wireless communication module.

Wherein, above-mentioned wireless communication module can include wifi bluetooth module etc. and this embodiment is not restricted to this.

For example, after the image information of the environment where the user is located is obtained, the image information can be sent to the server based on the wifi/bluetooth module, so that the image information is processed by the server through a preset image processing technology.

It should be noted that the preset image processing technology may be set by a developer based on actual business requirements, which is not limited in this embodiment.

In step S902, a processing result of the image information returned by the server is received by the wireless communication module.

In this embodiment, after the image information is sent to the server side for processing through the wireless communication module, the processing result of the image information returned by the server side can be received through the wireless communication module.

For example, after the control device of the air conditioning system sends the image information to the server through the wifi/bluetooth module, the server may process the image information by using a preset image processing technology to obtain a processing result, where the processing result may include air conditioning control information corresponding to the user. Furthermore, the control device of the air conditioning system can receive the processing result of the image information returned by the server through the wifi/Bluetooth module.

As can be seen from the above description, in this embodiment, the wireless communication module is used to send the image information to the server for processing, and the wireless communication module is used to receive the processing result of the image information returned by the server, so that the processing result of accurately obtaining the image information based on the interaction with the server can be realized, and then the air conditioning system can be subsequently controlled based on the air conditioning control information included in the processing result, the control effect of the air conditioning system can be improved, and the user experience can be improved.

Fig. 10 is a schematic diagram illustrating an application scenario of a control method of an air conditioning system according to an exemplary embodiment. As shown in fig. 10, the air conditioning system 100 of the present embodiment includes an image capturing device 110 and an image processing device 120, wherein the image processing device 120 may include a network camera processing chip or a wireless communication module (e.g., wifi/bluetooth module, etc.).

The method of the present embodiment is applied to a control apparatus (not shown in the drawings) of the air conditioning system 100.

In an embodiment, in a case where the image processing apparatus 120 includes a network camera processing chip, the method may include:

the control device obtains image information of an environment where the user 200 is located through the image acquisition device 110, processes the image information through the network camera processing chip to obtain a processing result, wherein the processing result includes air conditioner control information corresponding to the user 200, and then controls the operation of the air conditioning system 100 based on the air conditioner control information.

In another embodiment, in the case where the image processing apparatus 120 includes a wifi/bluetooth module, the method may include:

the control device obtains the image information of the environment where the user 200 is located through the image acquisition device 110, sends the image information to the server 300 through the wifi/bluetooth module for processing, and receives the processing result of the image information returned by the server 300 through the wifi/bluetooth module, wherein the processing result includes the air conditioning control information corresponding to the user 200, and then controls the operation of the air conditioning system 100 based on the air conditioning control information.

Fig. 11 is a block diagram illustrating a control apparatus of an air conditioning system according to an exemplary embodiment. The device of the embodiment can be applied to control equipment of an air conditioning system (such as an air conditioner, a fresh air machine, an air purifier and the like).

In this embodiment, the air conditioning system further includes an image acquisition device and an image processing device. As shown in fig. 11, the apparatus includes: image information acquisition module 110, processing result acquisition module 120 and air conditioning system control module 130, wherein:

the image information acquisition module 110 is configured to acquire image information of an environment where a user is currently located through the image acquisition device;

a processing result obtaining module 120, configured to process the image information through the image processing apparatus to obtain a processing result.

The image processing device can comprise at least one of a network camera processing chip or a wireless communication module; and the processing result comprises air conditioner control information corresponding to the user.

An air conditioning system control module 130 for controlling the air conditioning system based on the air conditioning control information.

Fig. 12 is a block diagram illustrating a control apparatus of an air conditioning system according to still another exemplary embodiment. The device of the embodiment can be applied to control equipment of an air conditioning system (such as an air conditioner, a fresh air machine, an air purifier and the like). The image information acquisition module 210, the processing result acquisition module 220, and the air conditioning system control module 230 have the same functions as the image information acquisition module 110, the processing result acquisition module 120, and the air conditioning system control module 130 in the embodiment shown in fig. 11, and are not described herein again.

As shown in fig. 12, in an embodiment, the processing result obtaining module 220 may include:

a face recognition unit 221, configured to obtain, by the image processing apparatus, a face recognition result of the user in the image information;

a first information determining unit 222, configured to determine air conditioning control information corresponding to the user based on the face recognition result.

In an embodiment, the first information determining unit 222 may further be configured to:

In one embodiment, the air conditioning system may include a plurality of air conditioning sub-devices, each of which is disposed in a set space in an environment where the user is located;

the first information determination unit 222 is further configured to:

In another embodiment, the processing result obtaining module 220 may include:

a human body positioning unit 223, configured to obtain a human body positioning result of the user in the image information through the image processing apparatus;

a second information determining unit 224, configured to determine air conditioning control information corresponding to the user based on the human body positioning result.

In an embodiment, the second information determining unit 224 may further be configured to:

In an embodiment, the second information determining unit 224 may be further configured to:

In an embodiment, the processing result obtaining module 220 may further include:

a depth-of-field information extracting unit 227 extracting depth-of-field information of the human body positioning result from the image information;

the second information determination unit 224 may be further configured to:

In another embodiment, in the case that the image processing apparatus includes a wireless communication module, the processing result obtaining module 220 may include:

an image information sending unit 225, configured to send the image information to a server through the wireless communication module for processing;

a processing result obtaining unit 226, configured to receive, through the wireless communication module, a processing result of the image information returned by the server.

With regard to the apparatus in the above-described embodiment, the specific manner in which each module performs the operation has been described in detail in the embodiment related to the method, and will not be elaborated here.

FIG. 13 is a block diagram illustrating an electronic device in accordance with an example embodiment. For example, the apparatus 900 may be a mobile phone, a computer, a digital broadcast terminal, a messaging device, a game console, a tablet device, a medical device, an exercise device, a personal digital assistant, and the like.

Referring to fig. 13, the apparatus 900 may include one or more of the following components: processing component 902, memory 904, power component 906, multimedia component 908, audio component 910, input/output (I/O) interface 912, sensor component 914, and communication component 916.

The processing component 902 generally controls overall operation of the device 900, such as operations associated with display, telephone calls, data communications, camera operations, and recording operations. Processing element 902 may include one or more processors 920 to execute instructions to perform all or a portion of the steps of the methods described above. Further, processing component 902 can include one or more modules that facilitate interaction between processing component 902 and other components. For example, the processing component 902 can include a multimedia module to facilitate interaction between the multimedia component 908 and the processing component 902.

The memory 904 is configured to store various types of data to support operation at the device 900. Examples of such data include instructions for any application or method operating on device 900, contact data, phonebook data, messages, pictures, videos, and so forth. The memory 904 may be implemented by any type or combination of volatile or non-volatile memory devices such as Static Random Access Memory (SRAM), electrically erasable programmable read-only memory (EEPROM), erasable programmable read-only memory (EPROM), programmable read-only memory (PROM), read-only memory (ROM), magnetic memory, flash memory, magnetic or optical disks.

Power component 906 provides power to the various components of device 900. The power components 906 may include a power management system, one or more power sources, and other components associated with generating, managing, and distributing power for the device 900.

The multimedia component 908 comprises a screen providing an output interface between the device 900 and a user. In some embodiments, the screen may include a Liquid Crystal Display (LCD) and a Touch Panel (TP). If the screen includes a touch panel, the screen may be implemented as a touch screen to receive an input signal from a user. The touch panel includes one or more touch sensors to sense touch, slide, and gestures on the touch panel. The touch sensor may not only sense the boundary of a touch or slide action, but also detect the duration and pressure associated with the touch or slide operation. In some embodiments, the multimedia component 908 includes a front facing camera and/or a rear facing camera. The front camera and/or the rear camera may receive external multimedia data when the device 900 is in an operating mode, such as a shooting mode or a video mode. Each front camera and rear camera may be a fixed optical lens system or have a focal length and optical zoom capability.

The audio component 910 is configured to output and/or input audio signals. For example, audio component 910 includes a Microphone (MIC) configured to receive external audio signals when apparatus 900 is in an operating mode, such as a call mode, a recording mode, and a voice recognition mode. The received audio signals may further be stored in the memory 904 or transmitted via the communication component 916. In some embodiments, audio component 910 also includes a speaker for outputting audio signals.

I/O interface 912 provides an interface between processing component 902 and peripheral interface modules, which may be keyboards, click wheels, buttons, etc. These buttons may include, but are not limited to: a home button, a volume button, a start button, and a lock button.

The sensor component 914 includes one or more sensors for providing status assessment of various aspects of the apparatus 900. For example, sensor assembly 914 may detect an open/closed state of device 900, the relative positioning of components, such as a display and keypad of device 900, the change in position of device 900 or a component of device 900, the presence or absence of user contact with device 900, the orientation or acceleration/deceleration of device 900, and the change in temperature of device 900. The sensor assembly 914 may also include a proximity sensor configured to detect the presence of a nearby object in the absence of any physical contact. The sensor assembly 914 may also include a light sensor, such as a CMOS or CCD image sensor, for use in imaging applications. In some embodiments, the sensor assembly 914 may also include an acceleration sensor, a gyroscope sensor, a magnetic sensor, a pressure sensor, or a temperature sensor.

The communication component 916 is configured to facilitate communications between the apparatus 900 and other devices in a wired or wireless manner. The apparatus 900 may access a wireless network based on a communication standard, such as WiFi, 2G or 3G, 4G or 5G or a combination thereof. In an exemplary embodiment, the communication component 916 receives a broadcast signal or broadcast associated information from an external broadcast management system via a broadcast channel. In an exemplary embodiment, the communications component 916 further includes a Near Field Communication (NFC) module to facilitate short-range communications. For example, the NFC module may be implemented based on Radio Frequency Identification (RFID) technology, infrared data association (IrDA) technology, Ultra Wideband (UWB) technology, Bluetooth (BT) technology, and other technologies.

In an exemplary embodiment, the apparatus 900 may be implemented by one or more Application Specific Integrated Circuits (ASICs), Digital Signal Processors (DSPs), Digital Signal Processing Devices (DSPDs), Programmable Logic Devices (PLDs), Field Programmable Gate Arrays (FPGAs), controllers, micro-controllers, microprocessors or other electronic components for performing the above-described methods.

In an exemplary embodiment, a non-transitory computer readable storage medium comprising instructions, such as the memory 904 comprising instructions, executable by the processor 920 of the apparatus 900 to perform the above-described method is also provided. For example, the non-transitory computer readable storage medium may be a ROM, a Random Access Memory (RAM), a CD-ROM, a magnetic tape, a floppy disk, an optical data storage device, and the like.

Other embodiments of the disclosure will be apparent to those skilled in the art from consideration of the specification and practice of the disclosure disclosed herein. This disclosure is intended to cover any variations, uses, or adaptations of the disclosure following, in general, the principles of the disclosure and including such departures from the present disclosure as come within known or customary practice within the art to which the disclosure pertains. It is intended that the specification and examples be considered as exemplary only, with a true scope and spirit of the disclosure being indicated by the following claims.

It will be understood that the present disclosure is not limited to the precise arrangements described above and shown in the drawings and that various modifications and changes may be made without departing from the scope thereof. The scope of the present disclosure is limited only by the appended claims.

Claims

1. The control method of the air conditioning system is characterized in that the air conditioning system comprises an image acquisition device and an image processing device;

the method comprises the following steps:

2. The method according to claim 1, wherein the processing the image information by the image processing device to obtain a processing result comprises:

3. The method of claim 2, wherein the determining the air conditioning control information corresponding to the user based on the face recognition result comprises:

4. The method of claim 3, wherein the air conditioning system comprises a plurality of air conditioning sub-devices, each of which is disposed in a defined space in an environment in which the user is located;

determining user behavior habit information corresponding to the identity information based on pre-constructed corresponding relation data, wherein the user behavior habit information comprises behavior habits of the user in a set space at set time;

5. The method according to claim 1, wherein the processing the image information by the image processing device to obtain a processing result comprises:

6. The method of claim 5, wherein the determining the air conditioning control information corresponding to the user based on the human body positioning result comprises:

7. The method of claim 5, wherein the determining the air conditioning control information corresponding to the user based on the human body positioning result comprises:

8. The method of claim 5, further comprising:

9. The method according to claim 1, wherein in a case that the image processing apparatus includes a wireless communication module, the processing the image information by the image processing apparatus to obtain a processing result includes:

10. The control device of the air conditioning system is characterized by further comprising an image acquisition device and an image processing device;

the device comprises:

11. The apparatus of claim 10, wherein the processing result obtaining module comprises:

12. The apparatus of claim 11, wherein the first information determining unit is further configured to:

13. The apparatus of claim 12, wherein the air conditioning system comprises a plurality of air conditioning sub-units, each of the air conditioning sub-units being disposed in a defined space in an environment in which the user is located;

the first information determination unit is further configured to:

14. The apparatus of claim 10, wherein the processing result obtaining module comprises:

15. The apparatus of claim 14, wherein the second information determining unit is further configured to:

16. The apparatus of claim 14, wherein the second information determining unit is further configured to:

17. The apparatus of claim 14, wherein the processing result obtaining module further comprises:

the second information determination unit is further configured to:

18. The apparatus according to claim 10, wherein in a case where the image processing apparatus includes a wireless communication module, the processing result obtaining module includes:

19. The control equipment of the air conditioning system is characterized in that the air conditioning system comprises an image acquisition device and an image processing device;

the control apparatus includes:

a processor, and a memory for storing processor-executable instructions;

wherein the processor is configured to:

20. A computer-readable storage medium on which a computer program is stored, the program, when executed by a processor, implementing: