CN113668201B - Circulating fan control method, circulating fan control system and storage medium - Google Patents
Circulating fan control method, circulating fan control system and storage medium Download PDFInfo
- Publication number
- CN113668201B CN113668201B CN202010366650.3A CN202010366650A CN113668201B CN 113668201 B CN113668201 B CN 113668201B CN 202010366650 A CN202010366650 A CN 202010366650A CN 113668201 B CN113668201 B CN 113668201B
- Authority
- CN
- China
- Prior art keywords
- clothes
- circulating fan
- color
- state
- image
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
Classifications
-
- D—TEXTILES; PAPER
- D06—TREATMENT OF TEXTILES OR THE LIKE; LAUNDERING; FLEXIBLE MATERIALS NOT OTHERWISE PROVIDED FOR
- D06F—LAUNDERING, DRYING, IRONING, PRESSING OR FOLDING TEXTILE ARTICLES
- D06F58/00—Domestic laundry dryers
-
- D—TEXTILES; PAPER
- D06—TREATMENT OF TEXTILES OR THE LIKE; LAUNDERING; FLEXIBLE MATERIALS NOT OTHERWISE PROVIDED FOR
- D06F—LAUNDERING, DRYING, IRONING, PRESSING OR FOLDING TEXTILE ARTICLES
- D06F34/00—Details of control systems for washing machines, washer-dryers or laundry dryers
- D06F34/14—Arrangements for detecting or measuring specific parameters
- D06F34/18—Condition of the laundry, e.g. nature or weight
-
- D—TEXTILES; PAPER
- D06—TREATMENT OF TEXTILES OR THE LIKE; LAUNDERING; FLEXIBLE MATERIALS NOT OTHERWISE PROVIDED FOR
- D06F—LAUNDERING, DRYING, IRONING, PRESSING OR FOLDING TEXTILE ARTICLES
- D06F34/00—Details of control systems for washing machines, washer-dryers or laundry dryers
- D06F34/28—Arrangements for program selection, e.g. control panels therefor; Arrangements for indicating program parameters, e.g. the selected program or its progress
-
- D—TEXTILES; PAPER
- D06—TREATMENT OF TEXTILES OR THE LIKE; LAUNDERING; FLEXIBLE MATERIALS NOT OTHERWISE PROVIDED FOR
- D06F—LAUNDERING, DRYING, IRONING, PRESSING OR FOLDING TEXTILE ARTICLES
- D06F58/00—Domestic laundry dryers
- D06F58/32—Control of operations performed in domestic laundry dryers
- D06F58/34—Control of operations performed in domestic laundry dryers characterised by the purpose or target of the control
- D06F58/36—Control of operational steps, e.g. for optimisation or improvement of operational steps depending on the condition of the laundry
- D06F58/38—Control of operational steps, e.g. for optimisation or improvement of operational steps depending on the condition of the laundry of drying, e.g. to achieve the target humidity
-
- D—TEXTILES; PAPER
- D06—TREATMENT OF TEXTILES OR THE LIKE; LAUNDERING; FLEXIBLE MATERIALS NOT OTHERWISE PROVIDED FOR
- D06F—LAUNDERING, DRYING, IRONING, PRESSING OR FOLDING TEXTILE ARTICLES
- D06F2103/00—Parameters monitored or detected for the control of domestic laundry washing machines, washer-dryers or laundry dryers
- D06F2103/02—Characteristics of laundry or load
-
- D—TEXTILES; PAPER
- D06—TREATMENT OF TEXTILES OR THE LIKE; LAUNDERING; FLEXIBLE MATERIALS NOT OTHERWISE PROVIDED FOR
- D06F—LAUNDERING, DRYING, IRONING, PRESSING OR FOLDING TEXTILE ARTICLES
- D06F2105/00—Systems or parameters controlled or affected by the control systems of washing machines, washer-dryers or laundry dryers
- D06F2105/30—Blowers
Landscapes
- Engineering & Computer Science (AREA)
- Textile Engineering (AREA)
- Image Analysis (AREA)
Abstract
The application relates to the field of intelligent home, and particularly discloses a circulating fan control method, a circulating fan control system and a storage medium, wherein the method comprises the following steps: acquiring a color depth image comprising hanging clothes, wherein the color depth image comprises depth information, and the color depth image is acquired by the depth camera; determining the blowing distance of the circulating fan in the first direction according to the depth information; determining the current state of the hung clothes according to the color depth image; acquiring boundary coordinates of the hung clothes in a wet state in the current state; and calculating a left deflection angle section and a right deflection angle section of the circulating fan in a second direction according to the boundary coordinates and the blowing distance, so as to adjust the blowing range of the circulating fan according to the left deflection angle section and the right deflection angle section. So that the circulating fan can automatically adjust the air supply range according to the position of wet clothes hung on the clothes hanger.
Description
Technical Field
The application relates to the field of intelligent home, in particular to a circulating fan control method, a circulating fan control system and a storage medium.
Background
In overcast and rainy or humid weather, the clothes aired on the clothes hanger cannot be dried in time due to weather, and bacteria can be bred in the clothes after long-time wetness, so that skin diseases are caused. Therefore, in order to enable the clothes aired on the clothes hanger to be dried in time, the circulating fan can be utilized to blow the position of the clothes hanger so as to promote air circulation and speed up clothes drying.
But current circulation fan mostly needs the manual swing angle and the air supply mode of adjusting the circulation fan of user to realize that the circulation fan is bloied according to the position of clothes hanger, and because the clothes that have dried in the sun and wet clothing have been hung simultaneously to the clothes hanger that dries in the air, the circulation fan can't be pointed to blow to wet clothing, complex operation, and user's use experience has been reduced.
Therefore, how to automatically adjust the air supply range of the circulation fan according to the position of the wet clothes hung on the clothes hanger is a problem to be solved.
Disclosure of Invention
The application provides a circulating fan control method, a circulating fan control system and a storage medium, so that the circulating fan can automatically adjust the air supply range according to the position of wet clothes hung on a clothes hanger.
In a first aspect, the present application provides a control method for a circulation fan, where a depth camera is disposed on the circulation fan, the method includes:
acquiring a color depth image comprising hanging clothes, wherein the color depth image comprises depth information, and the color depth image is acquired by the depth camera;
determining the blowing distance of the circulating fan in the first direction according to the depth information;
determining the current state of the hung clothes according to the color depth image;
acquiring boundary coordinates of the hung clothes in a wet state in the current state;
and calculating a left deflection angle section and a right deflection angle section of the circulating fan in a second direction according to the boundary coordinates and the blowing distance, so as to adjust the blowing range of the circulating fan according to the left deflection angle section and the right deflection angle section.
In a second aspect, the present application also provides a circulation fan, the circulation fan including a depth camera, a memory, and a processor;
the depth camera is used for collecting color depth images comprising hanging clothes;
the memory is used for storing a computer program;
the processor is configured to execute the computer program and implement the circulating fan control method as described above when the computer program is executed.
In a third aspect, the application also provides a circulating fan control system, which is characterized by comprising a circulating fan and a clothes hanger;
the clothes hanger is used for collecting pressure data of hanging clothes and sending the pressure data to the circulating fan;
the circulating fan is used for receiving the pressure data and executing the circulating fan control method.
In a fourth aspect, the present application also provides a computer readable storage medium storing a computer program which, when executed by a processor, causes the processor to implement a circulating fan control method as described above.
The application discloses a circulating fan control method, a circulating fan control system and a storage medium, wherein a color depth image which is acquired by a depth camera and comprises hanging clothes is acquired, then the blowing distance of the circulating fan is determined according to depth information in the color depth image, then the color depth image is input into a state identification model to identify the hanging clothes state so as to acquire boundary coordinates of the hanging clothes in a current state which is a wet state, and finally a left deflection angle interval and a right deflection angle interval of the circulating fan in a second direction are calculated according to the boundary coordinates and the blowing distance, so that the circulating fan can adjust the blowing range according to the left deflection angle interval and the right deflection angle interval. The current state of the hung clothes is determined according to the collected color depth image, the hung clothes in the wet state are screened out, the left-right deflection angle interval of the circulating fan is determined according to the space range of the hung clothes in the wet state, and accordingly the air supply range of the circulating fan is determined, the circulating fan can accurately blow the space range of the hung clothes in the wet state, and convenience and accuracy in control of the circulating fan are improved.
Drawings
In order to more clearly illustrate the technical solutions of the embodiments of the present application, the drawings required for the description of the embodiments will be briefly described below, and it is obvious that the drawings in the following description are some embodiments of the present application, and other drawings may be obtained according to these drawings without inventive effort for a person skilled in the art.
Fig. 1 is a schematic structural diagram of a circulating fan control system according to an embodiment of the present application;
FIG. 2 is a schematic block diagram of a circulation fan provided by an embodiment of the present application;
FIG. 3 is a schematic diagram of steps of a training method of a state recognition model according to an embodiment of the present application;
FIG. 4 is a schematic diagram illustrating steps of a control method of a circulation fan according to an embodiment of the present application;
fig. 5 is a schematic diagram of a blowing distance of a circulation fan in a first direction according to an embodiment of the present application;
FIG. 6 is a schematic diagram of sub-steps of one method of controlling a circulation fan provided in FIG. 3;
FIG. 7 is a schematic diagram showing steps for determining a current state of hanging clothes according to pressure data according to an embodiment of the present application;
FIG. 8 is a schematic diagram of a step of acquiring boundary coordinates of a hanging garment in a wet state according to an embodiment of the present application;
FIG. 9 is a schematic view of the deflection distance of the circulation fan in a second direction provided by an embodiment of the present application;
fig. 10 is a schematic diagram of a step of calculating a left-right deflection angle interval of the circulation fan in the second direction according to an embodiment of the present application.
Detailed Description
The following description of the embodiments of the present application will be made clearly and fully with reference to the accompanying drawings, in which it is evident that the embodiments described are some, but not all embodiments of the application. All other embodiments, which can be made by those skilled in the art based on the embodiments of the application without making any inventive effort, are intended to be within the scope of the application.
The flow diagrams depicted in the figures are merely illustrative and not necessarily all of the elements and operations/steps are included or performed in the order described. For example, some operations/steps may be further divided, combined, or partially combined, so that the order of actual execution may be changed according to actual situations.
It is to be understood that the terminology used in the description of the application herein is for the purpose of describing particular embodiments only and is not intended to be limiting of the application. As used in this specification and the appended claims, the singular forms "a," "an," and "the" are intended to include the plural forms as well, unless the context clearly indicates otherwise.
It should also be understood that the term "and/or" as used in the present specification and the appended claims refers to any and all possible combinations of one or more of the associated listed items, and includes such combinations.
The embodiment of the application provides a circulating fan control method, a circulating fan control system and a storage medium.
Referring to fig. 1, fig. 1 is a schematic structural diagram of a circulating fan control system according to an embodiment of the application. The circulation fan control system 100 comprises a circulation fan 10 and a clothes hanger 20, wherein the circulation fan 10 is in communication connection with the clothes hanger 20, so that the circulation fan 10 can adjust the air supply range of the circulation fan 10 according to the information sent by the clothes hanger 20.
The laundry rack 20 is provided with a pressure sensor for collecting pressure data of the hung laundry and transmitting the pressure data to the circulation fan. In the clothes airing process, as moisture in the clothes gradually evaporates, the value acquired by the pressure sensor gradually decreases, and the clothes hanger 20 acquires the pressure data of the hung clothes through the pressure sensor, so as to judge the current state of the hung clothes.
If the pressure data of the hung clothes collected by the clothes hanger 20 continuously changes within the preset time interval, the hung clothes are in a wet state at the moment, and if the pressure data of the hung clothes collected by the clothes hanger 20 does not change within the preset time interval, the hung clothes are in a dry state at the moment.
The clothes hanger 20 sends the pressure data of the hung clothes to the circulating fan 10, the circulating fan 10 judges the current state of the hung clothes according to the pressure data, when the current state of the hung clothes is a wet state, the circulating fan 10 obtains the boundary coordinates of the hung clothes in the wet state, and further the left-right deflection angle interval of the circulating fan 10 in the second direction is determined, so that the air supply range of the circulating fan 10 is adjusted.
It should be noted that, in the embodiment of the present application, the nose of the circulation fan 10 may swing in a certain direction, such as swinging in a horizontal direction, and/or swinging in a vertical direction, where the swinging may be implemented using a motor and a driving mechanism, such as including a crank and a link, or a driving wheel and a driven wheel cooperate, etc.
It will be appreciated that in embodiments of the present application, a combination of swinging in the horizontal direction and swinging in the vertical direction may be used, so that the circulation fan 10 has more swinging blowing modes, i.e., a blowing mode in more directions may be achieved.
Specifically, the circulation fan 10 is provided with a depth camera and a communication module, and the number of the depth cameras can be single or multiple; the communication module is configured to be communicatively coupled to the laundry stand 20, such as a bluetooth module, a Wi-Fi module, an LTE module, an NB-IoT module, a LoRa module, and the like.
The circulating fan 10 and the clothes hanger 20 are matched to execute the control method of the circulating fan provided by the embodiment of the application, so as to control the air supply range of the circulating fan.
In some embodiments, the circulation fan control method may also be applied in a terminal device, so that a user can control the blowing range of the circulation fan by means of the terminal device.
Specifically, an application program (APP) may be installed in the terminal device, so that the user can control the circulation fan using the APP.
The terminal equipment comprises electronic equipment such as a smart phone, a tablet personal computer, a personal computer or a wearable device.
The circulation fan is used for acquiring a color depth image comprising hanging clothes, wherein the color depth image comprises depth information, and the color depth image is acquired by the depth camera; determining the blowing distance of the circulating fan in the first direction according to the depth information; determining the current state of the hung clothes according to the color depth image; acquiring boundary coordinates of the hung clothes in a wet state in the current state; and calculating a left deflection angle section and a right deflection angle section of the circulating fan in a second direction according to the boundary coordinates and the blowing distance, so as to adjust the blowing range of the circulating fan according to the left deflection angle section and the right deflection angle section. The circulating fan can blow according to the space range of hanging clothes in a wet state of the current state on the clothes hanger, the accuracy of the control of the blowing range of the circulating fan is improved, meanwhile, the control of a user is convenient, and the user experience is improved.
Referring to fig. 2, fig. 2 is a schematic block diagram of a circulation fan according to an embodiment of the present application. The circulation fan 10 comprises a depth camera 11, a processor 12 and a memory 13, wherein the depth camera 11, the processor 12 and the memory 13 are connected through a bus.
The memory 13 may include a nonvolatile storage medium and an internal memory.
The non-volatile storage medium may store an operating system and a computer program. The computer program includes program instructions that, when executed, cause the processor to perform any one of a number of circulating fan control methods.
The depth camera 11 is used for capturing color depth images, and is mainly used for capturing depth images of hanging clothes in a circulating fan blowing range in the embodiment of the application.
The processor 12 is used to provide computing and control capabilities supporting the operation of the overall terminal device.
The internal memory provides an environment for the execution of a computer program in a non-volatile storage medium that, when executed by a processor, causes the processor to perform any of a number of circulating fan control methods.
It will be appreciated that the configuration shown in fig. 2 is merely a block diagram of a portion of the configuration associated with the present application and is not limiting of the circulation fan to which the present application is applied, and that a particular circulation fan may include more or less components than those shown, or may combine certain components, or have a different arrangement of components.
It should be appreciated that the processor 12 may be a central processing unit (Central Processing Unit, CPU), which may also be other general purpose processors, digital signal processors (Digital Signal Processor, DSP), application specific integrated circuits (Application Specific Integrated Circuit, ASIC), field programmable gate arrays (Field-Programmable Gate Array, FPGA) or other programmable logic devices, discrete gate or transistor logic devices, discrete hardware components, or the like. Wherein the general purpose processor may be a microprocessor or the processor may be any conventional processor or the like.
Wherein in one embodiment the processor is configured to run a computer program stored in the memory to implement the steps of:
acquiring a color depth image comprising hanging clothes, wherein the color depth image comprises depth information, and the color depth image is acquired by the depth camera;
determining the blowing distance of the circulating fan in the first direction according to the depth information;
determining the current state of the hung clothes according to the color depth image;
acquiring boundary coordinates of the hung clothes in a wet state in the current state;
and calculating a left deflection angle section and a right deflection angle section of the circulating fan in a second direction according to the boundary coordinates and the blowing distance, so as to adjust the blowing range of the circulating fan according to the left deflection angle section and the right deflection angle section.
In some embodiments, the processor, when implementing the determining the current state of the hanging laundry from the color depth image, is configured to implement:
extracting color components of the color depth image in a color space, and judging whether the color components are in a preset range or not;
if the color component is not in the preset range, acquiring pressure data of the hung clothes collected by the clothes hanger to determine the current state of the hung clothes;
and if the color component is in the preset range, inputting the color depth image into a pre-trained state identification model.
In some embodiments, the processor, when implementing the extracting the color components of the color depth image within a color space, is to implement:
converting the color depth image to an HSV color space to obtain a saturation component and a brightness component of the HSV color space;
the processor is configured to, when implementing the determining whether the color component is within a preset range, implement:
and judging whether the saturation component and the brightness component are in a preset range or not.
In some embodiments, the processor is configured, when implementing the acquiring the pressure data of the hung laundry collected by the laundry rack to determine the current state of the hung laundry, to implement:
Acquiring the pressure data of the hung clothes collected by the clothes hanger, and judging whether the pressure data changes within a preset time interval;
and if the value of the pressure sensor changes within a preset time interval, determining that the current state of the clothes to be dried is a wet state.
In some embodiments, the processor, when implementing the acquiring the boundary coordinates of the hanging clothes whose current state is a wet state, is configured to implement:
cutting the color depth image to obtain an area image of the hung clothes in a wet state at the current state;
and extracting the outline of the area image to obtain the boundary coordinates of the hung clothes in the current state of being in a wet state.
In some embodiments, the processor, when implementing the calculating the left and right deflection angle intervals of the circulation fan in the second direction according to the boundary coordinates and the blowing distance, is configured to implement:
calculating the deflection distance of the circulating fan in the second direction according to the blowing distance and the boundary coordinates;
and calculating left and right deflection angle intervals of the circulating fan according to the blowing distance and the deflection distance.
In some embodiments, the processor is further configured to implement:
acquiring multi-frame color depth images continuously acquired by the depth camera;
if the multi-frame color depth image does not contain the hanging clothes in the current state of being in the wet state within the preset period, the circulating fan is turned off.
In some embodiments, the processor is further configured to implement:
acquiring a sample image, wherein the sample image comprises a wet-state clothing image and a corresponding dry-state clothing image which are shot by a depth camera;
labeling the sample image according to the wet state and the dry state to construct sample data;
based on a convolutional neural network, model training is carried out according to the sample data to obtain a state recognition model, and the obtained state recognition model is used as a pre-trained state recognition model.
Referring to fig. 3, fig. 3 is a schematic diagram illustrating steps of a training method of a state recognition model according to an embodiment of the application. The state recognition model is obtained by model training based on a convolutional neural network, and can be obtained by training by other networks.
As shown in fig. 3, the training method of the state recognition model is used for training the state recognition model so as to be applied to the control method of the circulating fan. The training method comprises a step S201 and a step S203.
S201, acquiring a sample image, wherein the sample image comprises a wet-state clothing image and a corresponding dry-state clothing image which are shot by a depth camera.
Specifically, a depth camera is used to capture an image of the same laundry in a wet state and an image of the laundry in a dry state, so that the captured images of the laundry are taken together as a sample image. In the specific implementation process, in the shooting sample image, clothes with different colors and different materials can be used for shooting, so that the diversity of the sample image is improved, and the recognition accuracy of the state recognition model obtained through training is improved.
S202, labeling the sample image according to the wet state and the dry state to construct sample data.
Specifically, the images in the wet state and the dry state in the sample image are respectively marked, so that sample data are constructed, and a state recognition model is trained according to the sample data with marks.
S203, based on a convolutional neural network, performing model training according to the sample data to obtain a state recognition model, and taking the obtained state recognition model as a pre-trained state recognition model.
Specifically, the convolutional neural network is utilized, the sample data is input into the convolutional neural network for model training, and after repeated iterative training and verification, the finally obtained state recognition model is used as a pre-trained state recognition model.
In some embodiments, since the control method of the circulation fan is applied to the circulation fan, the trained model can be stored in the state recognition device of the circulation fan, so as to improve the data processing speed and the response speed of the model, improve the interaction speed, and bring more real-time experience to the user.
In some embodiments, in order to ensure the normal operation of the circulation fan and quickly identify the state of hanging clothes, the training state identification model is further required to be compressed, and the compressed model is stored in the state identification device of the circulation fan.
The compression processing specifically includes quantization processing and the like on the state recognition model, so as to reduce the size of the state recognition model, and further facilitate storage in a state recognition device of a circulating fan with smaller capacity.
According to the training method provided by the embodiment, the clothing images in the wet state and the dry state are obtained, the sample images are marked, the sample data are constructed, finally, the model training is carried out according to the sample data based on the convolutional neural network to obtain the state identification model, and the obtained state identification model is applied to the clothing collecting reminding method, so that the image identification of the hung clothing is improved, and the accuracy of determining the dry state and the wet state of the hung clothing is improved.
Referring to fig. 4, fig. 4 is a schematic diagram illustrating steps of a control method of a circulation fan according to an embodiment of the application. The control method of the circulation fan can be applied to the circulation fan shown in fig. 2, the blowing distance of the circulation fan in the first direction is determined through the depth image comprising the hung clothes, then the current state of the hung clothes is identified according to the color depth image comprising the hung clothes, so that the boundary coordinates of the hung clothes in the current state of a wet state are obtained, the left and right deflection angle intervals of the circulation fan are obtained through calculation, the blowing range of the circulation fan is adjusted, and the circulation fan can blow the hung clothes in the wet state better.
As shown in fig. 4, the control method of the circulation fan specifically includes: step S301 to step S305.
S301, acquiring a color depth image which is acquired by the depth camera and comprises hanging clothes.
Wherein the color depth image includes depth information. The depth camera on the circulation fan is started, and the processor acquires color depth images including hanging clothes, which are acquired by the depth camera on the circulation fan, so that the acquired color depth images are further processed.
In some embodiments, to reduce the power consumption of the depth camera on the circulation fan, the depth camera may be controlled to be turned on once every preset period, for example, once every 6 hours. Acquiring a color depth image near the clothes hanger after opening, carrying out image recognition on the acquired color depth image near the clothes hanger to judge whether the clothes hanger is hung or not, continuously acquiring the color depth image comprising the hung clothes if the clothes hanger is hung or not, and closing the depth camera if the clothes hanger is not hung or not.
It should be noted that, for convenience of description, the depth camera mounted on the circulation fan in the present application is collected when the circulation fan is at the initial position, that is, when the deflection angle of the fan head of the circulation fan is 0, when collecting the color depth image including hanging clothes.
S302, determining the blowing distance of the circulating fan in the first direction according to the depth information.
The first direction refers to a first direction of the circulating fan relative to the clothes hanging and placing, wherein the first direction can be a horizontal longitudinal direction, and the blowing distance refers to a distance between the clothes hanging and placing and the circulating fan in the horizontal longitudinal direction. As shown in fig. 5, F represents the blowing distance.
The pixels in the depth image represent the distance of the object at the specific coordinates from the plane of the depth camera in the field of view of the depth camera. Accordingly, by the depth information included in the color depth image, a blowing distance of the circulation fan with respect to the hanging laundry in the first direction can be determined.
In some embodiments, the circulating fan control method further comprises: and determining the blowing gear of the circulating fan according to the blowing distance.
Specifically, the higher the gear of blowing of circulation fan, then wind-force is bigger, and its distance of blowing is also far away, consequently, acquire the distance interval of blowing of each gear of circulation fan respectively, after obtaining the distance of blowing, can judge the gear of blowing of circulation fan according to this distance of blowing for circulation fan can automatically regulated wind-force, it is convenient to use.
S303, determining the current state of the hung clothes according to the color depth image.
Specifically, the current state includes a wet state and a dry state. For the same color of clothes, the colors displayed in the wet state and the dry state are slightly different, so that the current state of hanging clothes can be determined according to the acquired color depth image.
In some embodiments, referring to fig. 6, step S303 specifically includes steps S3031 to S3033.
S3031, extracting color components of the color depth image in a color space, and judging whether the color components are in a preset range or not.
Specifically, for the clothes made of the same material, the darker the color (i.e. closer to black) or the lighter the color (i.e. closer to white) of the hung clothes, the less obvious the color change of the hung clothes in the wet state and the dry state is, so that the corresponding judging method can be determined according to the color of the hung clothes. And extracting color components of the color depth image in a color space so as to judge whether the color components are in a preset range, if the extracted color components are in the preset range, identifying by using a pre-trained state identification model, and if the extracted color components are not in the preset range, identifying the state of clothes by using a pressure sensor, classifying and identifying the clothes, and improving the accuracy of identifying the state of the clothes.
In some embodiments, the extracting color components of the color depth image in a color space specifically includes: converting the color depth image to an HSV color space to obtain a saturation component and a brightness component of the HSV color space; the judging whether the color component is within a preset range includes: and judging whether the saturation component and the brightness component are in a preset range or not.
Specifically, the coordinate conversion of the RGB color space and the HSV color space may be performed using a mathematical formula. The image collected by the depth camera is an image of an RGB color space, and the color depth image of the RGB color space is converted into an image of an HSV color space, wherein H in the HSV color space represents hue, S represents saturation, V represents brightness, the saturation represents the shade of the color, and the brightness represents the brightness of the color.
The preset range may be preset, for example, a saturation range of 0.6 to 1 and a brightness range of 0.5 to 0.75, extracts a saturation component and a brightness component of the HSV color space, and determines whether the extracted saturation component and brightness component are both in the corresponding ranges.
S3032, if the color component is not in the preset range, acquiring pressure data of the hung clothes collected by the clothes hanger to determine the current state of the hung clothes.
Specifically, if the color component is not within the preset range, the pressure sensor is used to determine the current state of the hung clothes, and as the weight of the hung clothes is heavy in the wet state, the weight of the hung clothes is gradually lightened along with the gradual drying of the hung clothes until the weight of the hung clothes in the dry state is reached, so that the current state of the dried clothes can be determined according to the pressure sensor.
In some embodiments, referring to fig. 7, determining the current state of hanging laundry according to the pressure data specifically includes steps S3032a and S3032b.
S3032a, acquiring the pressure data of the hung clothes collected by the clothes hanger, and judging whether the pressure data changes within a preset time interval.
Specifically, the pressure data of the hung clothes collected by the clothes hanger, namely the numerical value of the pressure sensor, is obtained, the numerical value collected by the pressure sensor is gradually reduced in the clothes airing process, and whether the numerical value of the pressure sensor changes in a preset time interval is judged to judge the current state of the clothes. The preset time interval is a preset adjustable value, for example, may be 6 hours.
S3032b, if the value of the pressure sensor changes within a preset time interval, determining that the current state of the clothes to be dried is a wet state.
Specifically, if the value of the pressure sensor changes within a preset time interval, it is indicated that the hanging clothes are not dried at the moment, and the current state of the hanging clothes is determined to be a wet state.
S3033, if the color component is within the preset range, inputting the color depth image into a pre-trained state identification model.
Specifically, if the color component is within the preset range, the color depth image is input into a pre-trained state recognition model, and the state recognition model is used for carrying out state recognition on the hung clothes so as to obtain the current state of the hung clothes, wherein the current state comprises a wet state and a dry state.
S304, acquiring boundary coordinates of the hung clothes in the current state of being in a wet state.
Specifically, after the state identification is performed on the hanging clothes, boundary coordinates of the hanging clothes in the current state of the wet state are obtained from the plurality of hanging clothes, so that the air supply range of the circulation fan is adjusted, and the circulation fan can supply air according to the position of the hanging clothes in the wet state.
It should be noted that, for convenience of description, the coordinate system of the coordinates of the hung clothes in the collected color depth image is a coordinate system established by taking the position of the depth camera on the circulation fan as the origin.
In some embodiments, as shown in fig. 8, the step of acquiring the boundary coordinates of the hanging clothes in the current state is a wet state includes step S3041 and step S3042.
S3041, cutting the color depth image to obtain an area image of the hung clothes in a wet state at the current state.
Specifically, after the current state of the hung clothes is identified, the color depth image is cut according to the current state of the hung clothes, so that an area image of the hung clothes with the current state being a wet state is obtained.
When cutting is carried out, the color depth image can be cut according to the identified pixel points of the hung clothes in the current state of being in the wet state, so that the area image is obtained.
S3042, extracting the outline of the area image to obtain the boundary coordinates of the hung clothes in the current state of being in a wet state.
Specifically, contour recognition is performed on the region image including the hung clothes, wherein the contour recognition can be related detection algorithms such as edge detection and the like so as to recognize the contour of the image of the hung clothes in the region image. And determining boundary coordinates of the hung clothes according to the image contour, wherein the boundary coordinates can be a plurality of boundary coordinates.
S305, calculating a left deflection angle section and a right deflection angle section of the circulating fan in the second direction according to the boundary coordinates and the blowing distance, and adjusting the blowing range of the circulating fan according to the left deflection angle section and the right deflection angle section.
Specifically, the second direction refers to a second direction of the circulation fan relative to the hanging clothes, wherein the second direction may be a horizontal transverse direction, and the deflection distance of the circulation fan relative to the hanging clothes in the second direction, that is, the distance between the hanging clothes and the fan head of the circulation fan in the transverse horizontal direction, as shown in fig. 9, W represents the deflection distance.
The deflection distance of the circulation fan in the second direction can be calculated according to the boundary coordinates and the blowing distance, and then the left and right deflection angle intervals of the circulation fan in the second direction can be calculated according to the blowing distance and the deflection distance, so that the circulation fan can adjust the blowing range according to the left and right deflection angle intervals.
In some embodiments, referring to fig. 10, calculating the left-right deflection angle interval of the circulating fan in the second direction specifically includes step S3051 and step S3052.
And S3051, calculating the deflection distance of the circulating fan in the second direction according to the blowing distance and the boundary coordinates.
After the boundary coordinates are obtained, the deflection distance of the circulation fan in the second direction can be calculated according to the boundary coordinates and the blowing distance.
In some embodiments, the deflection distance may include a left deflection distance and a right deflection distance, and step S3051 may further include:
screening the boundary coordinates to obtain left boundary coordinates and right boundary coordinates; acquiring a reference line of the color depth image, and calculating a left image distance between a left boundary coordinate and the reference line and a right image distance between a right boundary coordinate and the reference line; and calculating left deflection distance and right deflection distance of the hung clothes relative to the circulating fan in a second direction according to the left image distance and the right image distance, the focal length of the depth camera and the first distance.
Specifically, the boundary coordinates are screened, and the left boundary coordinates and the right boundary coordinates of the hung clothes are determined. When the left boundary coordinate and the right boundary coordinate are determined, the abscissa among the plurality of boundary coordinates can be screened, the boundary coordinate corresponding to the maximum value of the abscissa is taken as the right boundary coordinate, and the boundary coordinate corresponding to the minimum value of the abscissa is taken as the left boundary coordinate.
The datum line refers to the position of the plane where the depth camera mounted on the circulation fan is located in a coordinate system.
When calculating the left image distance, the abscissa in the left boundary coordinate and the abscissa of the reference line may be subtracted, and the absolute value of the difference may be taken as the left image distance, and similarly, when calculating the right image distance, the abscissa in the right boundary coordinate and the abscissa of the reference line may be subtracted, and the absolute value of the difference may be taken as the right image distance. For example, the left boundary coordinates are (-20, 40), the right boundary coordinates are (60, 40), the reference line is x=25, the left image distance is |20-25|=45, and the right image distance is |60-25|=35.
After calculating the left image distance and the right image distance, a left deflection distance and a right deflection distance of the hung laundry with respect to the circulation fan in the second direction may be calculated, respectively, according to a deflection distance calculation formula.
The deflection distance calculation formula is as follows:
wherein W is i The left deflection distance or the right deflection distance is represented, F represents the blowing distance, F represents the focal length of the camera, and x represents the focal length of the camera i Representing either a left image distance or a right image distance.
When x in the formula is the left image distance, the left deflection distance is calculated, and when x in the formula is the right image distance, the right deflection distance is calculated.
S3052, calculating a left deflection angle section and a right deflection angle section of the circulating fan according to the blowing distance and the deflection distance.
Specifically, after the blowing distance and the deflection distance are obtained, a left deflection angle section and a right deflection angle section of the circulation fan in the second direction can be calculated according to the blowing distance and the deflection distance, and the left deflection angle section and the right deflection angle section are sent to the circulation fan so as to adjust the air supply range of the circulation fan according to the left deflection angle section and the right deflection angle section.
In some embodiments, step S3052 may further include:
calculating a left deflection included angle between the hung clothes and the circulating fan according to the blowing distance and the left deflection distance by using an inverse trigonometric function formula; calculating a right deflection included angle between the hung clothes and the circulating fan according to the blowing distance and the right deflection distance by using an inverse trigonometric function formula; and determining left and right deflection angle intervals of the circulating fan based on the left deflection angle and the right deflection angle.
Specifically, after knowing the blowing distance and the left deflection distance, the degree of the included angle A between the hung clothes and the circulating fan can be calculated by using an inverse trigonometric function, and the calculated degree of the angle A is used as the left deflection angle of the circulating fan. Specifically, the degrees of included angle a are:
Wherein, angle A is left deflection angle, W Left side The left deflection distance is represented, and F represents the blowing distance.
Similarly, after knowing the blowing distance and the right deflection distance, the degree of the included angle B between the hung clothes and the circulating fan can be calculated by using an inverse trigonometric function, and the calculated degree of the angle B is used as the right deflection angle of the circulating fan. Specifically, the degrees of included angle B are:
wherein, B is the right deflection angle, W Right side The right deflection distance is represented, and F represents the blowing distance.
After the left deflection angle and the right deflection angle are calculated, the left deflection angle section and the right deflection angle section of the circulating fan in the second direction can be determined.
In some embodiments, determining the left and right deflection angle intervals of the circulation fan based on the left deflection angle and the right deflection angle may further include the steps of:
determining the position of the hung clothes in the depth image according to the left boundary coordinate, the right boundary coordinate and the datum line; determining the left-right deflection direction of the circulating fan according to the position of the hanging clothes in the depth image; and determining left and right deflection angle intervals of the circulating fan according to the left and right deflection directions, the left deflection included angle and the right deflection included angle.
Specifically, the position of the hung laundry in the color depth image, that is, the position of the hung laundry with respect to the circulation fan, is determined according to the left boundary coordinate, the right boundary coordinate and the reference line of the hung laundry.
The position of the hanging clothes relative to the circulating fan can be that the hanging clothes are all on the left side of the circulating fan, the hanging clothes are all on the right side of the circulating fan, and the hanging clothes are partially on the left side of the circulating fan and partially on the right side of the circulating fan.
For example, if it is defined that the angle of the circulation fan when the initial position is rotated to the right is positive and the angle when the circulation fan is rotated to the left is negative, then:
when the clothes are hung on the left side of the circulating fan, if the left deflection angle is 70 degrees and the right deflection angle is 15 degrees, the left deflection angle interval and the right deflection angle interval of the circulating fan are-15 degrees to-70 degrees.
When the hung clothes are all on the right side of the circulating fan, if the left deflection angle is 15 degrees and the right deflection angle is 70 degrees, the left deflection angle interval and the right deflection angle interval of the circulating fan are 15-70 degrees.
When the clothes hanging part is at the left side of the circulating fan and the clothes hanging part is at the right side of the circulating fan, if the left deflection angle is 15 degrees and the right deflection angle is 70 degrees, the left deflection angle interval and the right deflection angle interval of the circulating fan are-15 degrees to 70 degrees.
In the specific implementation process, after the readings of the left deflection angle and the right deflection angle are calculated, the calculated left deflection angle can be reduced by 5 degrees, the calculated right deflection angle is increased by 5 degrees, and the calculated left deflection angle is used as a left deflection angle interval and a right deflection angle interval of a final circulation fan so as to compensate the calculation errors of the left deflection angle and the right deflection angle in calculation and improve the blowing effect of the circulation fan.
In some embodiments, to reduce energy consumption of the circulation fan, the circulation fan control method further includes:
acquiring multi-frame color depth images continuously acquired by the depth camera; if the multi-frame color depth image does not contain the hanging clothes in the current state of being in the wet state within the preset period, the circulating fan is turned off.
Specifically, the depth camera continuously collects multi-frame color depth images, the collected multi-frame color depth images are sent to the processor, the processor obtains multi-frame color depth images continuously collected by the depth camera, and image analysis is carried out on the obtained color depth images so as to judge whether the depth images comprise hanging clothes in a current state of being in a wet state or not.
If the processor judges that the hanging clothes in the current state is in the wet state are not included in each frame of color depth image in the preset period, the processor considers that the hanging clothes which need to be blown do not exist on the clothes hanger at the moment, sends a judging result to the control module, and the control module generates a control instruction to automatically control the circulation fan to be closed so as to reduce the energy consumption of the circulation fan. The preset time period may be preset by a user or set by a developer.
For example, if the preset period is ten minutes, the depth camera continuously collects the current color depth image, the collected color depth image is sent to the processor, and if the processor does not detect that the depth image includes hanging clothes in a wet state in ten continuous minutes, the circulation fan is controlled to be automatically closed.
According to the circulating fan control method, the color depth image including the hung clothes, acquired by the depth camera, is acquired, the blowing distance of the circulating fan is determined according to the depth information in the color depth image, the color depth image is input into the state recognition model to recognize the hanging clothes state, so that the boundary coordinates of the hung clothes in the current state in the wet state are acquired, and finally the left and right deflection angle intervals of the circulating fan in the second direction are calculated according to the boundary coordinates and the blowing distance, so that the circulating fan can adjust the blowing range according to the left and right deflection angle intervals. The current state of the hung clothes is determined according to the collected color depth image, the hung clothes in the wet state are screened out, the left-right deflection angle interval of the circulating fan is determined according to the space range of the hung clothes in the wet state, and accordingly the air supply range of the circulating fan is determined, the circulating fan can accurately blow the space range of the hung clothes in the wet state, and convenience and accuracy in control of the circulating fan are improved.
The embodiment of the application also provides a computer readable storage medium, wherein the computer readable storage medium stores a computer program, the computer program comprises program instructions, and the processor executes the program instructions to realize any one of the circulating fan control methods provided by the embodiment of the application.
The computer readable storage medium may be an internal storage unit of the computer device according to the foregoing embodiment, for example, a hard disk or a memory of the computer device. The computer readable storage medium may also be an external storage device of the computer device, such as a plug-in hard disk, a Smart Media Card (SMC), a Secure Digital (SD) Card, a Flash memory Card (Flash Card), or the like, which are provided on the computer device.
While the application has been described with reference to certain preferred embodiments, it will be understood by those skilled in the art that various changes and substitutions of equivalents may be made and equivalents will be apparent to those skilled in the art without departing from the scope of the application. Therefore, the protection scope of the application is subject to the protection scope of the claims.
Claims (9)
1. The method for controlling the circulating fan is characterized in that a depth camera is arranged on the circulating fan, and the method comprises the following steps:
acquiring a color depth image comprising hanging clothes, wherein the color depth image comprises depth information, and the color depth image is acquired by the depth camera;
determining the blowing distance of the circulating fan in the first direction according to the depth information;
extracting color components of the color depth image in a color space, and judging whether the color components are in a preset range or not;
if the color component is not in the preset range, acquiring the pressure data of the hung clothes collected by the clothes hanger, and judging whether the pressure data changes in a preset time interval;
if the pressure data changes within a preset time interval, determining that the current state of the hung clothes is a wet state;
if the color component is in the preset range, inputting the color depth image into a pre-trained state identification model;
acquiring boundary coordinates of the hung clothes in a wet state in the current state;
and calculating a left deflection angle section and a right deflection angle section of the circulating fan in a second direction according to the boundary coordinates and the blowing distance, so as to adjust the blowing range of the circulating fan according to the left deflection angle section and the right deflection angle section.
2. The circulation fan control method according to claim 1, wherein the extracting color components of the color depth image in a color space includes:
converting the color depth image to an HSV color space to obtain a saturation component and a brightness component of the HSV color space;
the judging whether the color component is within a preset range includes:
and judging whether the saturation component and the brightness component are in a preset range or not.
3. The circulation fan control method according to claim 1, wherein the acquiring the boundary coordinates of the hanging clothes in the current state as the wet state includes:
cutting the color depth image to obtain an area image of the hung clothes in a wet state at the current state;
and extracting the outline of the area image to obtain the boundary coordinates of the hung clothes in the current state of being in a wet state.
4. The circulation fan control method according to claim 1, wherein the calculating the left and right deflection angle sections of the circulation fan in the second direction from the boundary coordinates and the blowing distance includes:
calculating the deflection distance of the circulating fan in the second direction according to the blowing distance and the boundary coordinates;
And calculating left and right deflection angle intervals of the circulating fan according to the blowing distance and the deflection distance.
5. The circulation fan control method according to claim 1, characterized in that the method further comprises:
acquiring multi-frame color depth images continuously acquired by the depth camera;
if the multi-frame color depth image does not contain the hanging clothes in the current state of being in the wet state within the preset period, the circulating fan is turned off.
6. The circulation fan control method according to claim 1, characterized in that the method further comprises:
acquiring a sample image, wherein the sample image comprises a wet-state clothing image and a corresponding dry-state clothing image which are shot by a depth camera;
labeling the sample image according to the wet state and the dry state to construct sample data;
based on a convolutional neural network, model training is carried out according to the sample data to obtain a state recognition model, and the obtained state recognition model is used as a pre-trained state recognition model.
7. A circulation fan, which is characterized by comprising a depth camera, a memory and a processor;
The depth camera is used for collecting color depth images comprising hanging clothes;
the memory is used for storing a computer program;
the processor is configured to execute the computer program and to implement the circulation fan control method according to any one of claims 1 to 6 when the computer program is executed.
8. A circulating fan control system, which is characterized by comprising a circulating fan and a clothes hanger;
the clothes hanger is used for collecting pressure data of hanging clothes and sending the pressure data to the circulating fan;
the circulation fan is configured to receive the pressure data and perform the circulation fan control method according to any one of claims 1 to 6.
9. A computer-readable storage medium, characterized in that the computer-readable storage medium stores a computer program which, when executed by a processor, causes the processor to implement the circulation fan control method according to any one of claims 1 to 6.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202010366650.3A CN113668201B (en) | 2020-04-30 | 2020-04-30 | Circulating fan control method, circulating fan control system and storage medium |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202010366650.3A CN113668201B (en) | 2020-04-30 | 2020-04-30 | Circulating fan control method, circulating fan control system and storage medium |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN113668201A CN113668201A (en) | 2021-11-19 |
| CN113668201B true CN113668201B (en) | 2023-10-03 |
Family
ID=78536772
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202010366650.3A Active CN113668201B (en) | 2020-04-30 | 2020-04-30 | Circulating fan control method, circulating fan control system and storage medium |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN113668201B (en) |
Families Citing this family (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN114963420A (en) * | 2022-04-20 | 2022-08-30 | 青岛海尔空调器有限总公司 | Method and device for controlling air conditioner, air conditioner and storage medium |
Citations (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN103776099A (en) * | 2012-10-17 | 2014-05-07 | 日立空调·家用电器株式会社 | Air conditioner |
| CN104471362A (en) * | 2013-05-17 | 2015-03-25 | 松下电器（美国）知识产权公司 | Thermal image sensor and user interface |
| CN105241022A (en) * | 2015-10-29 | 2016-01-13 | 广东美的制冷设备有限公司 | Air outlet control method of air conditioner |
| JP2016166708A (en) * | 2015-03-10 | 2016-09-15 | ジョンソンコントロールズ ヒタチ エア コンディショニング テクノロジー（ホンコン）リミテッド | Air conditioner |
| CN107314511A (en) * | 2017-08-23 | 2017-11-03 | 广东美的制冷设备有限公司 | The control method and device of air-conditioning equipment, air-conditioning |
| CN110373874A (en) * | 2019-07-18 | 2019-10-25 | 珠海格力电器股份有限公司 | Method and device for controlling clothes drying |
| CN110605952A (en) * | 2019-09-18 | 2019-12-24 | 恒大新能源汽车科技(广东)有限公司 | Intelligent drying method, device and system |
-
2020
- 2020-04-30 CN CN202010366650.3A patent/CN113668201B/en active Active
Patent Citations (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN103776099A (en) * | 2012-10-17 | 2014-05-07 | 日立空调·家用电器株式会社 | Air conditioner |
| CN104471362A (en) * | 2013-05-17 | 2015-03-25 | 松下电器（美国）知识产权公司 | Thermal image sensor and user interface |
| JP2016166708A (en) * | 2015-03-10 | 2016-09-15 | ジョンソンコントロールズ ヒタチ エア コンディショニング テクノロジー（ホンコン）リミテッド | Air conditioner |
| CN105241022A (en) * | 2015-10-29 | 2016-01-13 | 广东美的制冷设备有限公司 | Air outlet control method of air conditioner |
| CN107314511A (en) * | 2017-08-23 | 2017-11-03 | 广东美的制冷设备有限公司 | The control method and device of air-conditioning equipment, air-conditioning |
| CN110373874A (en) * | 2019-07-18 | 2019-10-25 | 珠海格力电器股份有限公司 | Method and device for controlling clothes drying |
| CN110605952A (en) * | 2019-09-18 | 2019-12-24 | 恒大新能源汽车科技(广东)有限公司 | Intelligent drying method, device and system |
Also Published As
| Publication number | Publication date |
|---|---|
| CN113668201A (en) | 2021-11-19 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN111402135B (en) | Image processing method, device, electronic equipment and computer readable storage medium | |
| CN108229369B (en) | Image shooting method and device, storage medium and electronic equipment | |
| CN113584843B (en) | Circulating fan control method, circulating fan and storage medium | |
| CN109654676B (en) | Adjusting method, device and system of air supply device, computer equipment and storage medium | |
| EP2709062B1 (en) | Image processing device, image processing method, and computer readable medium | |
| CN110798592B (en) | Object movement detection method, device and equipment based on video image and storage medium | |
| JP6351243B2 (en) | Image processing apparatus and image processing method | |
| WO2019033570A1 (en) | Lip movement analysis method, apparatus and storage medium | |
| CN106859595B (en) | Tongue picture acquisition method, device and system | |
| CN113668201B (en) | Circulating fan control method, circulating fan control system and storage medium | |
| US20130286218A1 (en) | Image recognition device that recognizes specific object area, method of controlling the device, and storage medium, as well as image pickup apparatus, and display device | |
| CN111582045B (en) | Living body detection method and device and electronic equipment | |
| CN108985263A (en) | A kind of collecting method, device, electronic equipment and computer-readable medium | |
| CN110936920A (en) | Vehicle trunk opening method and device, vehicle and storage medium | |
| JP2017027492A (en) | Face collation apparatus, face collation system with same, and face collation method | |
| CN107705279B (en) | Image data real-time processing method and device for realizing double exposure and computing equipment | |
| JP2018081402A (en) | Image processing system, image processing method, and program | |
| CN113093556A (en) | Clothing collection reminding method, clothes hanger, system and storage medium | |
| CN110618129A (en) | Automatic power grid wire clamp detection and defect identification method and device | |
| CN110766631A (en) | Face image modification method and device, electronic equipment and computer readable medium | |
| JP2001167273A5 (en) | ||
| CN113584836B (en) | Fan blowing method, fan and computer readable storage medium | |
| CN113584848B (en) | Circulating fan control method, circulating fan control system and storage medium | |
| KR20140095601A (en) | Pose classification apparatus and pose classification method | |
| CN113584840B (en) | Fan control method, fan and computer readable storage medium |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |