CN108361928B - Air conditioner control method and system based on image recognition - Google Patents
Air conditioner control method and system based on image recognition Download PDFInfo
- Publication number
- CN108361928B CN108361928B CN201810132060.7A CN201810132060A CN108361928B CN 108361928 B CN108361928 B CN 108361928B CN 201810132060 A CN201810132060 A CN 201810132060A CN 108361928 B CN108361928 B CN 108361928B
- Authority
- CN
- China
- Prior art keywords
- human body
- family
- temperature
- visitor
- current
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
Images
Classifications
-
- F—MECHANICAL ENGINEERING; LIGHTING; HEATING; WEAPONS; BLASTING
- F24—HEATING; RANGES; VENTILATING
- F24F—AIR-CONDITIONING; AIR-HUMIDIFICATION; VENTILATION; USE OF AIR CURRENTS FOR SCREENING
- F24F11/00—Control or safety arrangements
- F24F11/62—Control or safety arrangements characterised by the type of control or by internal processing, e.g. using fuzzy logic, adaptive control or estimation of values
- F24F11/63—Electronic processing
- F24F11/64—Electronic processing using pre-stored data
-
- F—MECHANICAL ENGINEERING; LIGHTING; HEATING; WEAPONS; BLASTING
- F24—HEATING; RANGES; VENTILATING
- F24F—AIR-CONDITIONING; AIR-HUMIDIFICATION; VENTILATION; USE OF AIR CURRENTS FOR SCREENING
- F24F11/00—Control or safety arrangements
- F24F11/50—Control or safety arrangements characterised by user interfaces or communication
- F24F11/56—Remote control
- F24F11/58—Remote control using Internet communication
-
- F—MECHANICAL ENGINEERING; LIGHTING; HEATING; WEAPONS; BLASTING
- F24—HEATING; RANGES; VENTILATING
- F24F—AIR-CONDITIONING; AIR-HUMIDIFICATION; VENTILATION; USE OF AIR CURRENTS FOR SCREENING
- F24F11/00—Control or safety arrangements
- F24F11/70—Control systems characterised by their outputs; Constructional details thereof
- F24F11/72—Control systems characterised by their outputs; Constructional details thereof for controlling the supply of treated air, e.g. its pressure
- F24F11/79—Control systems characterised by their outputs; Constructional details thereof for controlling the supply of treated air, e.g. its pressure for controlling the direction of the supplied air
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06V40/00—Recognition of biometric, human-related or animal-related patterns in image or video data
- G06V40/10—Human or animal bodies, e.g. vehicle occupants or pedestrians; Body parts, e.g. hands
Landscapes
- Engineering & Computer Science (AREA)
- General Engineering & Computer Science (AREA)
- Chemical & Material Sciences (AREA)
- Combustion & Propulsion (AREA)
- Mechanical Engineering (AREA)
- Signal Processing (AREA)
- Human Computer Interaction (AREA)
- Physics & Mathematics (AREA)
- Fuzzy Systems (AREA)
- Mathematical Physics (AREA)
- General Physics & Mathematics (AREA)
- Multimedia (AREA)
- Theoretical Computer Science (AREA)
- Air Conditioning Control Device (AREA)
Abstract
The application relates to an air conditioner control method and system based on image recognition, wherein the control method comprises the following steps: acquiring and identifying images of people and non-people in a room; marking the identified personnel as family and visitors; determining an air-conditioning regulation and control scheme for the personnel marked as the family comprises the steps of comparing the temperature of the human body characteristic part of the family in the current body posture with the temperature reference value of the human body characteristic part of the family in the corresponding body posture, determining the current human body temperature state of the family according to the comparison result, and further determining the air-conditioning regulation and control scheme for the family; the method for determining the air conditioning regulation and control scheme for the personnel marked as the visitors comprises the steps of comparing the temperature of the human body characteristic part of the current body posture of the visitor with a preset temperature reference value of the human body characteristic part of the corresponding body posture of the visitor, determining the current human body temperature state of the visitor according to the comparison result, and determining the air conditioning regulation and control scheme for the visitor. The application can meet the increasing use requirements of people.
Description
Technical Field
The application belongs to the technical field of intelligent control, and particularly relates to an air conditioner control method and system based on image recognition.
Background
With the development of economy and the continuous improvement of the living standard of people, the air conditioner is widely used in the daily life of people. In the use process of the traditional air conditioner, a user mainly adjusts the temperature, the wind direction and the like through a remote controller so as to realize the cooling or heating function. However, the traditional air conditioner control method cannot meet the increasing use requirements of people, and the control method cannot be adjusted according to the actual situation of the space, which wastes electric energy to a great extent.
Disclosure of Invention
In order to overcome the problems in the related art at least to a certain extent, the application provides an air conditioner control method and system based on image recognition.
According to a first aspect of embodiments of the present application, there is provided an air conditioner control method based on image recognition, including:
acquiring and identifying images of people and non-people in a room;
marking the identified personnel as family and visitors according to the occurrence frequency of the personnel in the continuous preset time period;
determining an air conditioner regulation and control scheme for the personnel marked as family, which specifically comprises the following steps:
locking the personnel marked as the family and extracting the human body characteristic parts of the family;
recognizing the body postures of the family according to the relative position relationship among the human body characteristic parts, respectively obtaining the temperature of the human body characteristic parts under each body posture of the family for multiple times, and taking the temperature value obtained by data analysis as the temperature reference value of the human body characteristic parts under each body posture of the family; wherein the body postures comprise sitting, lying, standing and moving postures;
acquiring the temperature of the current human body characteristic part of the family;
recognizing the current body posture of the family;
comparing the temperature of the human body characteristic part of the family in the current body posture with the temperature reference value of the human body characteristic part of the family in the corresponding body posture, and determining the current human body temperature state of the family according to the comparison result;
determining an air conditioner regulation and control scheme for the family according to the current human body temperature state of the family;
determining an air conditioning regulation and control scheme for a person marked as a visitor, which specifically comprises:
locking the personnel marked as the visitors, and extracting the human body characteristic parts of the visitors;
acquiring the temperature of the current human body characteristic part of the visitor;
identifying a current body posture of the visitor;
comparing the temperature of the human body characteristic part of the visitor in the current body posture with a preset temperature reference value of the human body characteristic part of the visitor in the corresponding body posture, and determining the current human body temperature state of the visitor according to the comparison result;
and determining an air conditioner regulation and control scheme for the visitor according to the current human body temperature state of the visitor.
Further, the process of image acquisition and identification of people and non-people in the room is as follows:
extracting features from the acquired images;
comparing the extracted features with preset comparison features;
and identifying corresponding personnel and non-personnel in the room according to the comparison result.
Further, the marking the identified persons as family and visitors according to the occurrence frequency of the persons in the continuous preset time period comprises:
presetting a personnel occurrence frequency threshold;
if the occurrence frequency of a person in a certain continuous preset time period is greater than a preset person occurrence frequency threshold value, marking the person as a family, otherwise, marking the person as a visitor;
if the frequency of occurrence of the person marked as the visitor within a certain continuous preset time period is greater than a preset person occurrence frequency threshold value, the person marked as the visitor is modified and marked as a family.
Further, the comparing the temperature of the human body feature part in the current body posture of the family with the temperature reference value of the human body feature part in the corresponding body posture of the family, and determining the current human body temperature state of the family according to the comparison result includes:
when the temperature of the human body characteristic part of the family in the current body posture is higher than the temperature reference value of the human body characteristic part in the corresponding body posture, determining that the current human body temperature state of the family is a partial heat state; when the temperature of the human body characteristic part under the current body posture of the family is equal to the temperature reference value of the human body characteristic part under the corresponding body posture, determining that the current human body temperature state of the family is a normal state; when the temperature of the human body characteristic part of the family in the current body posture is lower than the temperature reference value of the human body characteristic part in the corresponding body posture, determining that the current human body temperature state of the family is a partial cold state;
compare the temperature of the human body characteristic part under the current body gesture of visitor with the temperature reference value of the human body characteristic part under the visitor's corresponding body gesture of predetermineeing to confirm according to the comparison result that the current human body temperature state of visitor includes:
when the temperature of the human body characteristic part in the current body posture of the visitor is higher than a preset temperature reference value of the human body characteristic part in the corresponding body posture of the visitor, determining that the current human body temperature state of the visitor is a partial heat state; when the temperature of the human body characteristic part in the current body posture of the visitor is equal to a preset temperature reference value of the human body characteristic part in the corresponding body posture of the visitor, determining that the current human body temperature state of the visitor is a normal state; and when the temperature of the human body characteristic part of the visitor in the current body posture is lower than a preset temperature reference value of the human body characteristic part of the visitor in the corresponding body posture, determining that the current human body temperature state of the visitor is a partial cold state.
Still further, the air conditioning regulation scheme includes adjusting any one or more of a set value of temperature, air volume, and wind direction.
Furthermore, the determining of the air conditioning regulation and control scheme for the family according to the current human body temperature state of the family comprises:
the current working condition is a refrigeration working condition, and when the current human body temperature state of the family is a partial heat state, the wind direction is adjusted, namely the wind port is controlled to face the direction of the family; when the current human body temperature state of the family is a cold state, controlling the air opening to avoid the direction of the family;
the current working condition is a heating working condition, and when the current human body temperature state of the family is a partial cold state, the wind direction is adjusted, namely the wind port is controlled to face the direction of the family; when the current human body temperature state of the family is a partial heat state, controlling the air opening to avoid the direction of the family;
the method for determining the air conditioner regulation and control scheme for the visitor according to the current human body temperature state of the visitor comprises the following steps:
the current working condition is a refrigeration working condition, and when the current human body temperature state of the visitor is a partial heat state, the wind direction is adjusted, namely the wind port is controlled to face the direction of the visitor; when the current human body temperature state of the visitor is a cold state, controlling the air opening to avoid the direction of the visitor;
the current working condition is a heating working condition, and when the current human body temperature state of the visitor is a partial cold state, the wind direction is adjusted, namely the wind port is controlled to face the direction of the visitor; when the current human body temperature state of the visitor is a heat bias state, the air opening is controlled to avoid the direction of the visitor.
Further, the air conditioner control method based on image recognition further comprises the following steps:
acquiring the distance between a person and an air conditioner;
acquiring the directions between the personnel and the air conditioner;
and determining an air conditioner regulation and control scheme according to the distance and the direction, wherein the personnel comprise family and visitors.
Further, the acquiring the distance between the person and the air conditioner comprises:
adopting a binocular camera to acquire images of personnel;
selecting a point of the face or the trunk of a person as a target point;
according to the formula
Calculating the distance from the target point to the central connecting line of the two cameras; wherein Z represents the distance from a target point to the air conditioner, f represents the focal length of the camera, T represents the horizontal distance between two cameras on the air conditioner, and xlRepresenting the distance, x, from the imaging point of the left camera to the left side of the photoreceptorrRepresenting the distance from the imaging point of the right camera to the left side of the photoreceptor;
taking the distance from the target point to the central connecting line of the two cameras as the distance between the personnel and the air conditioner;
the acquiring of the orientation between the person and the air conditioner includes:
establishing a spherical coordinate system by taking a central point of an image formed by any one monocular camera in the binocular cameras as an original point O, taking a horizontal direction as an X-axis direction, taking a vertical direction as a Y-axis, and taking a direction perpendicular to an imaging plane XOY as a Z-axis;
an included angle between a connecting line of an imaging point of the target point on the imaging plane XOY and the origin O and the X axis is used as an azimuth angle, and an included angle between a connecting line between the target point and the imaging point and the Z axis is used as a zenith angle;
the orientation between the person and the air conditioner is determined by the azimuth angle and the zenith angle.
According to a second aspect of the embodiments of the present application, the present application further provides an air conditioner control system based on image recognition, which includes an image acquisition device, an infrared temperature scanning device, a temperature adjustment module, an air supply module, a data storage module, and a central processing module;
the image acquisition equipment is used for acquiring images of people and non-people in the room;
the central processing module is used for processing the acquired image, identifying personnel in the room, distinguishing the personnel into families or visitors, extracting human body characteristic parts of the personnel, identifying the current body posture of the personnel, and calculating to obtain temperature reference values of the human body characteristic parts of the families under the body postures;
the infrared temperature scanning equipment is used for acquiring the temperature of the current human body characteristic part of a person;
the data storage module is used for storing the temperature reference values of the human body characteristic parts of all the family in all the body postures and the preset temperature reference values of the human body characteristic parts of the visitor in all the body postures;
the central processing module is also used for comparing the temperature of the current human body characteristic part of the family with the temperature reference value of the human body characteristic part of the family in the corresponding body posture, comparing the temperature of the current human body characteristic part of the visitor with the preset temperature reference value of the human body characteristic part of the visitor in the corresponding body posture, and correspondingly controlling the image acquisition device, the infrared temperature scanning device, the temperature adjusting module, the air supply module and the data storage module;
the temperature adjusting module is used for adjusting the temperature of the air conditioner;
the air supply module is used for adjusting the air quantity or the air direction of the air conditioner.
Further, the air conditioner control system comprises a wireless communication module 7, the wireless communication module 7 is connected with a central processing module, and the central processing module is communicated with an external intelligent terminal through the wireless communication module 7.
The technical scheme provided by the embodiment of the application can have the following beneficial effects:
this application adopts image recognition technology can improve human discernment and the accuracy of tracking, can distinguish family and visitor to confirm air conditioner regulation and control scheme respectively to family and visitor, realize the dynamic identification and the tracking of a plurality of human objects simultaneously, according to the condition of one or more human objects, can carry out real time control to a plurality of wind gaps, satisfy people's ever-increasing user demand. By adopting the scheme, the air conditioner can carry out real-time and intelligent control on the temperature, the air quantity or the wind direction according to the actual conditions in the room, and the electric energy is saved.
It is to be understood that both the foregoing general description and the following detailed description are exemplary and explanatory only and are not restrictive of the application.
Drawings
The accompanying drawings, which are incorporated in and constitute a part of this specification, illustrate embodiments consistent with the present application and together with the description, serve to explain the principles of the application.
Fig. 1 is a flowchart illustrating an air conditioner control method based on image recognition according to an exemplary embodiment.
Fig. 2 is a flowchart illustrating a method for controlling an air conditioner based on image recognition to determine an air conditioning control scheme for a person labeled as a family member according to an exemplary embodiment.
Fig. 3 is a flowchart illustrating a method for determining an air conditioning control scheme for a person who is tagged as a visitor in an image recognition-based air conditioning control method according to an exemplary embodiment.
Fig. 4 is a schematic diagram illustrating binocular ranging in an image recognition-based air conditioning control method according to an exemplary embodiment.
Fig. 5 is a block diagram illustrating a configuration of an air conditioning control system based on image recognition according to an exemplary embodiment.
Detailed Description
Reference will now be made in detail to the exemplary embodiments, examples of which are illustrated in the accompanying drawings. When the following description refers to the accompanying drawings, like numbers in different drawings represent the same or similar elements unless otherwise indicated. The embodiments described in the following exemplary embodiments do not represent all embodiments consistent with the present application. Rather, they are merely examples of apparatus and methods consistent with certain aspects of the present application, as detailed in the appended claims.
Fig. 1 is a diagram illustrating an air conditioner control method based on image recognition according to an exemplary embodiment. Fig. 2 is a flowchart illustrating a method for controlling an air conditioner based on image recognition to determine an air conditioning control scheme for a person labeled as a family member according to an exemplary embodiment. Fig. 3 is a flowchart illustrating a method for determining an air conditioning control scheme for a person who is tagged as a visitor in an image recognition-based air conditioning control method according to an exemplary embodiment. As shown in fig. 1 to 3, the air conditioner control method based on image recognition includes the following steps:
and S1, acquiring and identifying the images of the people and the non-people in the room.
And a monocular or binocular camera is adopted to acquire images of people and non-people in the room. And extracting features from the acquired image, comparing the extracted features with preset comparison features, and identifying corresponding personnel and non-personnel in the room according to the comparison result.
S2, according to the occurrence frequency of the persons in the continuous preset time period, marking the identified persons as family persons and visitors, and specifically comprising the following steps:
and presetting a human occurrence frequency threshold.
And if the occurrence frequency of a person in a certain continuous preset time period is greater than a preset person occurrence frequency threshold value, marking the person as a family, otherwise, marking the person as a visitor.
And if the frequency of the people marked as the visitors appearing in a certain continuous preset time period is larger than a preset people appearing frequency threshold value, modifying and marking the people marked as the visitors as family.
Wherein, family refers to a single individual of family, not to a group of family; a visitor refers to a single individual of a visitor and not to a group of visitors.
S3, determining an air conditioner regulation and control scheme for the personnel marked as family, which comprises the following steps:
and S31, locking the personnel marked as family members, and extracting the human body characteristic parts of the family members.
S32, recognizing the body postures of the family according to the relative position relation among the human body characteristic parts, respectively obtaining the temperature of the human body characteristic parts under each body posture of the family for multiple times, and taking the temperature value obtained by data analysis as the temperature reference value of the human body characteristic parts under each body posture of the family. Wherein, the human body characteristic parts comprise a face, four limbs, a trunk and the like; body positions include sitting, lying, standing and exercising positions.
Specifically, the average value of the temperatures of the characteristic parts of the human body of the family in the body postures acquired for multiple times may be obtained, and the obtained average value may be used as the temperature reference value of the characteristic parts of the human body of the family in the body postures corresponding to the human body.
For example, for the family a, the temperature of the face of the family a in the sitting posture is acquired a plurality of times, the average value of the temperatures of the face of the family a in the sitting posture acquired a plurality of times is obtained, and the obtained average value is used as the temperature reference value of the face of the family a in the sitting posture.
And for the family B, the temperature of the trunk of the family B under the standing posture is obtained for multiple times, the average value of the temperature of the trunk of the family B under the standing posture obtained for multiple times is obtained, and the obtained average value is used as the temperature reference value of the trunk of the family B under the standing posture.
And S33, acquiring the temperature of the current human body characteristic part of the family.
And acquiring the temperature of the current human body characteristic part of the family by adopting an infrared thermometer, an infrared thermal imaging scanner and the like.
And S34, recognizing the current body posture of the family.
And identifying the current body posture of the family according to the relative position relation between the human body characteristic parts.
S35, comparing the temperature of the human body characteristic part of the family in the current body posture with the temperature reference value of the human body characteristic part of the family in the corresponding body posture, and determining the current human body temperature state of the family according to the comparison result.
When the temperature of the human body characteristic part of the family in the current body posture is higher than the temperature reference value of the human body characteristic part in the corresponding body posture, determining that the current human body temperature state of the family is a partial heat state; when the temperature of the human body characteristic part under the current body posture of the family is equal to the temperature reference value of the human body characteristic part under the corresponding body posture, determining that the current human body temperature state of the family is a normal state; and when the temperature of the human body characteristic part of the family in the current body posture is lower than the temperature reference value of the human body characteristic part in the corresponding body posture, determining that the current human body temperature state of the family is a partial cold state.
Specifically, the temperature of the face of the family in the sitting posture is compared with a reference value of the face temperature in the sitting posture, the temperature of the limbs of the family in the sitting posture is compared with a reference value of the limb temperature in the sitting posture, and the temperature of the trunk of the family in the sitting posture is compared with a reference value of the trunk temperature of the family in the sitting posture. The temperature of the face of the family in the prone position is compared with the reference value of the face temperature in the sitting position, the temperature of the limbs of the family in the prone position is compared with the reference value of the limb temperature in the prone position, and the temperature of the trunk of the family in the prone position is compared with the reference value of the trunk temperature in the prone position. The temperature of the lower face of the family in the standing posture is compared with the temperature reference value of the lower face of the standing posture, the temperature of the four limbs of the family in the standing posture is compared with the temperature reference value of the four limbs of the standing posture, and the temperature of the trunk of the family in the standing posture is compared with the temperature reference value of the trunk of the standing posture. The temperature of the face of the family in the exercise posture is compared with the temperature reference value of the face in the exercise posture, the temperature of the limbs of the family in the exercise posture is compared with the temperature reference value of the limbs of the family in the exercise posture, and the temperature of the trunk of the family in the exercise posture is compared with the temperature reference value of the trunk of the family in the exercise posture.
For example, the temperature of the face of family a currently in the sitting posture is compared with the reference temperature of the face of family a in the sitting posture. And comparing the temperature of the trunk of the family B in the standing state with the temperature reference value of the trunk of the family B in the standing state.
And S36, determining an air conditioner regulation and control scheme for the family according to the current human body temperature state of the family.
The air conditioning regulation and control scheme comprises the step of regulating any one or more set values of temperature, air quantity and wind direction.
Specifically, the current working condition is a refrigeration working condition, and when the current human body temperature state of the family is a partial heat state, the wind direction is adjusted, namely the wind port is controlled to face the direction of the family; and when the current human body temperature state of the family is a cold state, controlling the air opening to avoid the direction of the family.
The current working condition is a heating working condition, and when the current human body temperature state of the family is a partial cold state, the wind direction is adjusted, namely the wind port is controlled to face the direction of the family; and when the current human body temperature state of the family is a partial heat state, controlling the air opening to avoid the direction of the family.
S4, determining an air conditioner regulation and control scheme for the personnel marked as the visitors, which comprises the following steps:
and S41, locking the personnel marked as the visitor and extracting the human body characteristic parts of the visitor.
And S42, acquiring the temperature of the current human body characteristic part of the visitor.
And acquiring the temperature of the current human body characteristic part of the family by adopting an infrared thermometer, an infrared thermal imaging scanner and the like.
And S43, identifying the current body posture of the visitor.
And identifying the current body posture of the visitor according to the relative position relation among the human body characteristic parts.
S44, comparing the temperature of the human body characteristic part of the visitor in the current body posture with a preset temperature reference value of the human body characteristic part of the visitor in the corresponding body posture, and determining the current human body temperature state of the visitor according to the comparison result.
When the temperature of the human body characteristic part in the current body posture of the visitor is higher than a preset temperature reference value of the human body characteristic part in the corresponding body posture of the visitor, determining that the current human body temperature state of the visitor is a partial heat state; when the temperature of the human body characteristic part in the current body posture of the visitor is equal to a preset temperature reference value of the human body characteristic part in the corresponding body posture of the visitor, determining that the current human body temperature state of the visitor is a normal state; and when the temperature of the human body characteristic part of the visitor in the current body posture is lower than a preset temperature reference value of the human body characteristic part of the visitor in the corresponding body posture, determining that the current human body temperature state of the visitor is a partial cold state.
Specifically, the temperature of the face of the visitor in the current sitting posture is compared with a preset temperature reference value of the face of the visitor in the sitting posture, the temperature of the limbs of the visitor in the current sitting posture is compared with a preset temperature reference value of the limbs of the visitor in the sitting posture, and the temperature of the trunk of the visitor in the current sitting posture is compared with a preset temperature reference value of the trunk of the visitor in the sitting posture. The temperature of the face of the visitor in the current lying posture is compared with a preset reference value of the face temperature of the visitor in the sitting posture, the temperature of the limbs of the visitor in the current lying posture is compared with a preset reference value of the limb temperature of the visitor in the lying posture, and the temperature of the trunk of the visitor in the current lying posture is compared with a preset reference value of the trunk temperature of the visitor in the lying posture. The method comprises the steps of comparing the temperature of the face of a visitor in the current standing posture with a preset temperature reference value of the face of the visitor in the standing posture, comparing the temperature of limbs of the visitor in the current standing posture with a preset temperature reference value of the limbs of the visitor in the standing posture, and comparing the temperature of the trunk of the visitor in the current standing posture with a preset temperature reference value of the trunk of the visitor in the standing posture. The method comprises the steps of comparing the temperature of the face of a visitor in the current movement posture with a preset temperature reference value of the face of the visitor in the movement posture, comparing the temperature of limbs of the visitor in the current movement posture with a preset temperature reference value of the limbs of the visitor in the movement posture, and comparing the temperature of the trunk of the visitor in the current movement posture with a preset temperature reference value of the trunk of the visitor in the movement posture.
For example, the temperature of the face of the visitor C in the sitting posture is compared with a preset reference value of the temperature of the face of the visitor in the sitting posture.
And S45, determining an air conditioner regulation and control scheme for the visitor according to the current human body temperature state of the visitor.
The air conditioning regulation and control scheme comprises the step of regulating any one or more set values of temperature, air quantity and wind direction.
Specifically, the current working condition is a refrigeration working condition, and when the current human body temperature state of the visitor is a partial heat state, the wind direction is adjusted, namely the wind port is controlled to face the direction of the visitor; when the current human body temperature state of the visitor is a cold state, the air opening is controlled to avoid the direction of the visitor.
The current working condition is a heating working condition, and when the current human body temperature state of the visitor is a partial cold state, the wind direction is adjusted, namely the wind port is controlled to face the direction of the visitor; when the current human body temperature state of the visitor is a heat bias state, the air opening is controlled to avoid the direction of the visitor.
The air conditioner control method based on image recognition further comprises the following steps:
obtain the distance between personnel and the air conditioner, wherein, personnel include family and visitor, and it specifically includes:
and a binocular camera is adopted to acquire images of the personnel.
One point of the face or torso of the person is selected as the target point.
As shown in fig. 4, the distance from the target point to the center-connecting line of the two cameras is calculated according to the binocular distance measuring principle. Assuming that the target point is P point, the horizontal distance between two cameras on the air conditioner is T, the focal length of the cameras is f, and the distance from the imaging point of the left camera to the left side of the photoreceptor is xlDistance x from imaging point of right camera to left side of photoreceptorrThe optical centers of the two cameras are O respectivelylAnd OrAnd then, according to the principle of binocular distance measurement, the distance Z from the point P where the personnel are located to the air conditioner is as follows:
and taking the distance from the target point to the central connecting line of the two cameras as the distance between the personnel and the air conditioner.
The method comprises the following steps of obtaining the position between a person and an air conditioner, wherein the method specifically comprises the following steps:
a spherical coordinate system is established by taking the central point of the image formed by any one monocular camera in the binocular cameras as an original point O, taking the horizontal direction as the X-axis direction, taking the vertical direction as the Y-axis, and taking the direction perpendicular to the imaging plane XOY as the Z-axis.
An included angle between a connecting line of an imaging point of the target point on the imaging plane XOY and the origin O and the X axis is used as an azimuth angle, and an included angle between a connecting line of the target point and the imaging point and the Z axis is used as a zenith angle.
The orientation between the person and the air conditioner is determined by the azimuth angle and the zenith angle.
According to the distance and the direction, an air conditioner regulation and control scheme is determined for the personnel, and the method specifically comprises the following steps:
the current working condition is a refrigeration working condition, when the current human body temperature state of a person is a partial heat state, and the distance between the person and the air conditioner is smaller than a preset distance threshold value, firstly controlling an air outlet to face the direction of the person, and secondly controlling and reducing the air outlet quantity of an air conditioner fan; when the current human body temperature state of the personnel is a partial heat state and the distance between the personnel and the air conditioner is greater than a preset distance threshold value, firstly controlling an air port to face the personnel direction, and secondly controlling and increasing the air output of an air conditioner fan; when the current human body temperature state of the personnel is a cold state, the air opening is controlled to avoid the direction of the personnel.
The current working condition is a heating working condition, when the current human body temperature state of a person is a partial cold state and the distance between the person and the air conditioner is smaller than a preset distance threshold, firstly controlling an air inlet to face the direction of the person, and secondly controlling and reducing the air output of an air conditioner fan; when the current human body temperature state of the personnel is a partial cold state and the distance between the personnel and the air conditioner is greater than a preset distance threshold value, firstly, the air inlet is controlled to face the direction of the personnel, and secondly, the air outlet quantity of the air conditioner fan is controlled to be increased.
In addition, for the variable frequency air conditioner, dynamic frequency increasing or reducing can be carried out according to the increase and decrease conditions of people in a room, so that the requirements of room temperature regulation and energy conservation are met.
Fig. 5 is a diagram illustrating an air conditioning control system based on image recognition according to an exemplary embodiment. As shown in fig. 5, the air conditioner control system based on image recognition of the present application includes an image acquisition device 1, a central processing module 2, an infrared temperature scanning device 3, a data storage module 4, a temperature adjustment module 5, and an air supply module 6.
The image acquisition equipment 1 is used for acquiring images of people and non-people in a room; the central processing module 2 is used for processing the acquired image, identifying personnel in the room, distinguishing the personnel into families or visitors, extracting human body characteristic parts of the personnel, identifying the current body posture of the personnel, and calculating to obtain temperature reference values of the human body characteristic parts of the families in all the body postures; the infrared temperature scanning device 3 is used for acquiring the temperature of the current human body characteristic part of a person; the data storage module 4 is used for storing the temperature reference values of the human body characteristic parts of all the family in all the body postures and the preset temperature reference values of the human body characteristic parts of the visitor in all the body postures; the central processing module 2 is further configured to compare the temperature of the current human body feature part of the family with a temperature reference value of the human body feature part of the family in the body posture corresponding to the family, compare the temperature of the current human body feature part of the visitor with a preset temperature reference value of the human body feature part of the visitor in the body posture corresponding to the visitor, and correspondingly control the image acquisition device 1, the infrared temperature scanning device 3, the temperature adjustment module 5, the air supply module 6 and the data storage module 4; the temperature adjusting module 5 is used for adjusting the temperature of the air conditioner; the air supply module 6 is used for adjusting the air quantity or the wind direction of the air conditioner.
Further, the central processing module 2 is also configured to perform big data analysis on the acquired image, and mark non-human features in the image within a certain time period. Such as furniture, appliances and other fixtures in a room, where a person enters the room, the person may be directly identified.
The air conditioner control system based on image recognition further comprises a wireless communication module 7, and when a visitor appears, the personnel information which is marked as the visitor can be sent to the intelligent terminal of the family through the wireless communication module 7 according to the requirement. The wireless communication module 7 can also be used for sending the temperature reference values of the human body characteristic parts of all the family in all the body postures stored in the data storage module of the air-conditioning control system and the preset temperature reference values of the human body characteristic parts of all the body postures of visitors to the intelligent terminal, and the wireless communication module 7 can also be used for receiving the temperature reference values of the human body characteristic parts of all the family in all the body postures and the preset temperature reference values of the human body characteristic parts of all the body postures of visitors from the intelligent terminal, which are stored in the data storage module of other air-conditioning control systems, so that the same type of air-conditioners can directly adopt the temperature reference values with the same standard.
According to the air conditioner control method based on image recognition, the accuracy of human body recognition and tracking can be improved by adopting the image recognition technology, dynamic recognition and tracking of a plurality of human body objects are achieved, real-time control can be carried out on a plurality of air ports according to the condition of one or more human body objects, and the ever-increasing use requirements of people are met. By adopting the scheme, the air conditioner can carry out real-time and intelligent control on the temperature, the air quantity or the wind direction according to the actual conditions in the room, and the electric energy is saved.
In addition, the accuracy of identifying and positioning the personnel in the room by adopting the image identification technology is far better than that of ultrasonic positioning or infrared positioning, and after the personnel are accurately positioned, the requirements of people on air conditioner refrigeration or heating can be met more accurately. The image that this application was gathered based on camera among the air conditioner control system of image recognition can be used for intelligent security protection, sends visitor's information intelligent terminal from family as required, when guaranteeing air conditioner intelligent control, can play a role in intelligent security protection.
With regard to the apparatus in the above-described embodiment, the specific manner in which each module performs the operation has been described in detail in the embodiment related to the method, and will not be elaborated here.
It is understood that the same or similar parts in the above embodiments may be mutually referred to, and the same or similar parts in other embodiments may be referred to for the content which is not described in detail in some embodiments.
It should be noted that, in the description of the present application, the terms "first", "second", etc. are used for descriptive purposes only and are not to be construed as indicating or implying relative importance. Further, in the description of the present application, the meaning of "a plurality" means at least two unless otherwise specified.
Any process or method descriptions in flow charts or otherwise described herein may be understood as representing modules, segments, or portions of code which include one or more executable instructions for implementing specific logical functions or steps of the process, and the scope of the preferred embodiments of the present application includes other implementations in which functions may be executed out of order from that shown or discussed, including substantially concurrently or in reverse order, depending on the functionality involved, as would be understood by those reasonably skilled in the art of the present application.
It will be understood by those skilled in the art that all or part of the steps carried by the method for implementing the above embodiments may be implemented by hardware related to instructions of a program, which may be stored in a computer readable storage medium, and when the program is executed, the program includes one or a combination of the steps of the method embodiments.
In addition, each functional unit in the embodiments of the present application may be integrated into one central processing module, or each unit may exist alone physically, or two or more units are integrated into one module. The integrated module can be realized in a hardware mode, and can also be realized in a software functional module mode. The integrated module, if implemented in the form of a software functional module and sold or used as a stand-alone product, may also be stored in a computer readable storage medium.
The storage medium mentioned above may be a read-only memory, a magnetic or optical disk, etc.
In the description herein, reference to the description of the term "one embodiment," "some embodiments," "an example," "a specific example," or "some examples," etc., means that a particular feature, structure, material, or characteristic described in connection with the embodiment or example is included in at least one embodiment or example of the application. In this specification, the schematic representations of the terms used above do not necessarily refer to the same embodiment or example. Furthermore, the particular features, structures, materials, or characteristics described may be combined in any suitable manner in any one or more embodiments or examples.
Although embodiments of the present application have been shown and described above, it is understood that the above embodiments are exemplary and should not be construed as limiting the present application, and that variations, modifications, substitutions and alterations may be made to the above embodiments by those of ordinary skill in the art within the scope of the present application.
Claims (10)
1. An air conditioner control method based on image recognition is used for carrying out image acquisition and recognition on personnel and non-personnel in a room, and is characterized by comprising the following steps:
marking the identified personnel as family and visitors according to the occurrence frequency of the personnel in the continuous preset time period;
determining an air conditioner regulation and control scheme for the personnel marked as family, which specifically comprises the following steps:
locking the personnel marked as the family and extracting the human body characteristic parts of the family;
recognizing the body postures of the family according to the relative position relationship among the human body characteristic parts, respectively obtaining the temperature of the human body characteristic parts under each body posture of the family for multiple times, and taking the temperature value obtained by data analysis as the temperature reference value of the human body characteristic parts under each body posture of the family; wherein the body postures comprise sitting, lying, standing and moving postures;
acquiring the temperature of the current human body characteristic part of the family;
recognizing the current body posture of the family;
comparing the temperature of the human body characteristic part of the family in the current body posture with the temperature reference value of the human body characteristic part of the family in the corresponding body posture, and determining the current human body temperature state of the family according to the comparison result;
determining an air conditioner regulation and control scheme for the family according to the current human body temperature state of the family;
determining an air conditioning regulation and control scheme for a person marked as a visitor, which specifically comprises:
locking the personnel marked as the visitors, and extracting the human body characteristic parts of the visitors;
acquiring the temperature of the current human body characteristic part of the visitor;
identifying a current body posture of the visitor;
comparing the temperature of the human body characteristic part of the visitor in the current body posture with a preset temperature reference value of the human body characteristic part of the visitor in the corresponding body posture, and determining the current human body temperature state of the visitor according to the comparison result;
and determining an air conditioner regulation and control scheme for the visitor according to the current human body temperature state of the visitor.
2. The air conditioner control method based on image recognition as claimed in claim 1, wherein the process of image acquisition and recognition of the people and non-people in the room is as follows:
extracting features from the acquired images;
comparing the extracted features with preset comparison features;
and identifying corresponding personnel and non-personnel in the room according to the comparison result.
3. The air conditioner control method based on image recognition as set forth in claim 1, wherein the marking of the recognized persons as family and visitor according to the frequency of the persons appearing within the consecutive preset time period comprises:
presetting a personnel occurrence frequency threshold;
if the occurrence frequency of a person in a certain continuous preset time period is greater than a preset person occurrence frequency threshold value, marking the person as a family, otherwise, marking the person as a visitor;
if the frequency of occurrence of the person marked as the visitor within a certain continuous preset time period is greater than a preset person occurrence frequency threshold value, the person marked as the visitor is modified and marked as a family.
4. The air conditioner control method based on image recognition according to any one of claims 1 to 3, wherein the comparing the temperature of the human body characteristic part in the current body posture of the family with the temperature reference value of the human body characteristic part in the corresponding body posture of the family, and the determining the current human body temperature state of the family according to the comparison result comprises:
when the temperature of the human body characteristic part of the family in the current body posture is higher than the temperature reference value of the human body characteristic part in the corresponding body posture, determining that the current human body temperature state of the family is a partial heat state; when the temperature of the human body characteristic part under the current body posture of the family is equal to the temperature reference value of the human body characteristic part under the corresponding body posture, determining that the current human body temperature state of the family is a normal state; when the temperature of the human body characteristic part of the family in the current body posture is lower than the temperature reference value of the human body characteristic part in the corresponding body posture, determining that the current human body temperature state of the family is a partial cold state;
compare the temperature of the human body characteristic part under the current body gesture of visitor with the temperature reference value of the human body characteristic part under the visitor's corresponding body gesture of predetermineeing to confirm according to the comparison result that the current human body temperature state of visitor includes:
when the temperature of the human body characteristic part in the current body posture of the visitor is higher than a preset temperature reference value of the human body characteristic part in the corresponding body posture of the visitor, determining that the current human body temperature state of the visitor is a partial heat state; when the temperature of the human body characteristic part in the current body posture of the visitor is equal to a preset temperature reference value of the human body characteristic part in the corresponding body posture of the visitor, determining that the current human body temperature state of the visitor is a normal state; and when the temperature of the human body characteristic part of the visitor in the current body posture is lower than a preset temperature reference value of the human body characteristic part of the visitor in the corresponding body posture, determining that the current human body temperature state of the visitor is a partial cold state.
5. The image recognition-based air conditioner control method according to claim 4, wherein the air conditioner regulation scheme includes adjusting any one or more set values of temperature, air volume, and wind direction.
6. The image recognition-based air conditioner control method according to claim 5, wherein the determining of the air conditioner regulation and control scheme for the family according to the current human body temperature state of the family comprises:
the current working condition is a refrigeration working condition, and when the current human body temperature state of the family is a partial heat state, the wind direction is adjusted, namely the wind port is controlled to face the direction of the family; when the current human body temperature state of the family is a cold state, controlling the air opening to avoid the direction of the family;
the current working condition is a heating working condition, and when the current human body temperature state of the family is a partial cold state, the wind direction is adjusted, namely the wind port is controlled to face the direction of the family; when the current human body temperature state of the family is a partial heat state, controlling the air opening to avoid the direction of the family;
the method for determining the air conditioner regulation and control scheme for the visitor according to the current human body temperature state of the visitor comprises the following steps:
the current working condition is a refrigeration working condition, and when the current human body temperature state of the visitor is a partial heat state, the wind direction is adjusted, namely the wind port is controlled to face the direction of the visitor; when the current human body temperature state of the visitor is a cold state, controlling the air opening to avoid the direction of the visitor;
the current working condition is a heating working condition, and when the current human body temperature state of the visitor is a partial cold state, the wind direction is adjusted, namely the wind port is controlled to face the direction of the visitor; when the current human body temperature state of the visitor is a heat bias state, the air opening is controlled to avoid the direction of the visitor.
7. The air conditioner control method based on image recognition according to any one of claims 1 to 3, further comprising the steps of:
acquiring the distance between a person and an air conditioner;
acquiring the directions between the personnel and the air conditioner;
and determining an air conditioner regulation and control scheme according to the distance and the direction, wherein the personnel comprise family and visitors.
8. The air conditioner control method based on image recognition as claimed in claim 7, wherein the obtaining of the distance between the person and the air conditioner comprises:
adopting a binocular camera to acquire images of personnel;
selecting a point of the face or the trunk of a person as a target point;
according to the formula
Calculating the distance from the target point to the central connecting line of the two cameras; wherein Z represents the distance from a target point to the air conditioner, f represents the focal length of the camera, T represents the horizontal distance between two cameras on the air conditioner, and xlRepresenting the distance, x, from the imaging point of the left camera to the left side of the photoreceptorrRepresenting the distance from the imaging point of the right camera to the left side of the photoreceptor;
taking the distance from the target point to the central connecting line of the two cameras as the distance between the personnel and the air conditioner;
the acquiring of the orientation between the person and the air conditioner includes:
establishing a spherical coordinate system by taking a central point of an image formed by any one monocular camera in the binocular cameras as an original point O, taking the horizontal direction as the X-axis direction, taking the vertical direction as the Y-axis, and taking the direction perpendicular to the imaging plane X0Y as the Z-axis;
an included angle between a connecting line of an imaging point of the target point on the imaging plane XOY and the origin O and the X axis is used as an azimuth angle, and an included angle between a connecting line between the target point and the imaging point and the Z axis is used as a zenith angle;
the orientation between the person and the air conditioner is determined by the azimuth angle and the zenith angle.
9. An air conditioner control system based on image recognition comprises image acquisition equipment and a central processing module, wherein the image acquisition equipment is used for acquiring images of people and non-people in a room; the central processing module is used for processing the acquired images and identifying the personnel in the room, and is characterized by further comprising an infrared temperature scanning device, a temperature adjusting module, an air supply module and a data storage module;
the central processing module is used for distinguishing the personnel into families or visitors, extracting human body characteristic parts of the personnel, identifying the current body postures of the entrants and the entrants, and calculating to obtain temperature reference values of the human body characteristic parts under all the body postures of the families;
the infrared temperature scanning equipment is used for acquiring the temperature of the current human body characteristic part of a person;
the data storage module stores temperature reference values of human body characteristic parts under all body postures of all the family members and preset temperature reference values of human body characteristic parts under all body postures of visitors;
the central processing module is also used for comparing the temperature of the current human body characteristic part of the family with the temperature reference value of the human body characteristic part of the family in the corresponding body posture, comparing the temperature of the current human body characteristic part of the visitor with the preset temperature reference value of the human body characteristic part of the visitor in the corresponding body posture, and correspondingly controlling the image acquisition device, the infrared temperature scanning device, the temperature adjusting module, the air supply module and the data storage module;
the temperature adjusting module is used for adjusting the temperature of the air conditioner;
the air supply module is used for adjusting the air quantity or the air direction of the air conditioner.
10. The air conditioner control system based on image recognition as claimed in claim 9, wherein the air conditioner control system comprises a wireless communication module, the wireless communication module is connected with a central processing module, and the central processing module communicates with an external intelligent terminal through the wireless communication module.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201810132060.7A CN108361928B (en) | 2018-02-09 | 2018-02-09 | Air conditioner control method and system based on image recognition |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201810132060.7A CN108361928B (en) | 2018-02-09 | 2018-02-09 | Air conditioner control method and system based on image recognition |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN108361928A CN108361928A (en) | 2018-08-03 |
| CN108361928B true CN108361928B (en) | 2020-04-07 |
Family
ID=63005507
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201810132060.7A Active CN108361928B (en) | 2018-02-09 | 2018-02-09 | Air conditioner control method and system based on image recognition |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN108361928B (en) |
Families Citing this family (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN109752965B (en) * | 2019-01-28 | 2020-08-11 | 珠海格力电器股份有限公司 | Method and device for controlling household appliance and household appliance |
| CN111294706A (en) * | 2020-01-16 | 2020-06-16 | 珠海格力电器股份有限公司 | Voice electrical appliance control method and device, storage medium and voice electrical appliance |
| CN111412622A (en) * | 2020-03-31 | 2020-07-14 | 广东美的制冷设备有限公司 | Control method of air conditioner, air conditioner and storage medium |
| CN111397136A (en) * | 2020-04-09 | 2020-07-10 | 安徽诺星信息科技有限公司 | Intelligent air conditioner control system |
| CN113865065A (en) * | 2021-10-12 | 2021-12-31 | 珠海格力电器股份有限公司 | Air outlet temperature control method and device, storage medium, processor and air supply equipment |
Citations (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN103090503A (en) * | 2011-10-27 | 2013-05-08 | 海尔集团公司 | Air-conditioning device and control method thereof |
| JP2013088075A (en) * | 2011-10-20 | 2013-05-13 | Panasonic Corp | Gesture decoder |
| JP2015098990A (en) * | 2013-11-20 | 2015-05-28 | 日立アプライアンス株式会社 | Air conditioning system |
| CN106196496A (en) * | 2016-08-08 | 2016-12-07 | 合肥泰好乐电子科技有限公司 | A kind of family air conditioning control method |
| CN106765922A (en) * | 2016-12-08 | 2017-05-31 | 广东志高空调有限公司 | A kind of air-conditioning and air conditioning control method |
| CN107131607A (en) * | 2017-03-17 | 2017-09-05 | 珠海格力电器股份有限公司 | Monitoring method, device and system based on air conditioner and air conditioner |
| CN107178881A (en) * | 2017-07-10 | 2017-09-19 | 绵阳美菱软件技术有限公司 | A kind of intelligent air condition, operation of air conditioner method and air-conditioner control system |
Family Cites Families (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US10372990B2 (en) * | 2016-03-18 | 2019-08-06 | International Business Machines Corporation | System and method for identification of personal thermal comfort |
-
2018
- 2018-02-09 CN CN201810132060.7A patent/CN108361928B/en active Active
Patent Citations (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| JP2013088075A (en) * | 2011-10-20 | 2013-05-13 | Panasonic Corp | Gesture decoder |
| CN103090503A (en) * | 2011-10-27 | 2013-05-08 | 海尔集团公司 | Air-conditioning device and control method thereof |
| JP2015098990A (en) * | 2013-11-20 | 2015-05-28 | 日立アプライアンス株式会社 | Air conditioning system |
| CN106196496A (en) * | 2016-08-08 | 2016-12-07 | 合肥泰好乐电子科技有限公司 | A kind of family air conditioning control method |
| CN106765922A (en) * | 2016-12-08 | 2017-05-31 | 广东志高空调有限公司 | A kind of air-conditioning and air conditioning control method |
| CN107131607A (en) * | 2017-03-17 | 2017-09-05 | 珠海格力电器股份有限公司 | Monitoring method, device and system based on air conditioner and air conditioner |
| CN107178881A (en) * | 2017-07-10 | 2017-09-19 | 绵阳美菱软件技术有限公司 | A kind of intelligent air condition, operation of air conditioner method and air-conditioner control system |
Also Published As
| Publication number | Publication date |
|---|---|
| CN108361928A (en) | 2018-08-03 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN108361928B (en) | Air conditioner control method and system based on image recognition | |
| CN106196509B (en) | air conditioner sleep mode control method and system | |
| JP6576568B2 (en) | Air conditioning system | |
| KR101203607B1 (en) | Air conditioning control system and air conditioning control method | |
| CN110110629A (en) | Personal information detection method and system towards indoor environmental condition control | |
| JP2005172288A (en) | Controlling system for air conditioner | |
| CN110726476A (en) | Thermal environment regulation and control system and regulation and control method based on human body infrared temperature monitoring | |
| WO2021057527A1 (en) | Smart air conditioner control method and smart air conditioner | |
| JP2015017728A (en) | Air conditioner | |
| CN110864440A (en) | Air supply method, air supply device and air conditioner | |
| US20230083027A1 (en) | Multi-area artificial fog pipe network intelligent control method and system based on yolov5 algorithm | |
| CN112815490A (en) | Sleep thermal comfort sensing method and system and air conditioner control method | |
| CN112178785A (en) | Dehumidification control method and dehumidification control equipment for air conditioner | |
| CN111832697A (en) | Intelligent human body recognition energy-saving temperature regulating system | |
| CN111023510A (en) | Air conditioner control system based on human face temperature monitoring and human face image tracking | |
| CN114017909A (en) | Air conditioner and control method | |
| CN112944617B (en) | Control method and device for air conditioner and air conditioner | |
| CN110274367A (en) | air conditioner control device, method, controller, air conditioner and storage medium | |
| CN111561771A (en) | Intelligent air conditioner temperature adjusting method | |
| CN112032990A (en) | Air conditioner control system and method based on temperature correction model | |
| CN108489032A (en) | air conditioning system control method and device | |
| CN111856953A (en) | Ecological home intelligent management method and system applying Internet of things technology | |
| CN111306711A (en) | Air conditioner control method of linkage intelligent equipment and intelligent air conditioner | |
| CN110410975A (en) | Control method, device and the apparatus of air conditioning of the apparatus of air conditioning | |
| CN108253599B (en) | Humidifying air conditioner for yoga room and control method thereof |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant | ||
| TR01 | Transfer of patent right | ||
| TR01 | Transfer of patent right |
Effective date of registration: 20221208 Address after: 214400 1001-13, Floor 10, Building F, No. 9, East Outer Ring Road, Jiangyin, Wuxi, Jiangsu Patentee after: Wuxi Jialeshi Environmental Technology Co.,Ltd. Address before: 100176 203, Floor 2, Building 2, Yard 5, Jinghui East Road, Beijing Economic and Technological Development Zone, Daxing District, Beijing Patentee before: BEIJING JINGHAI TECHNOLOGY Co.,Ltd. |