CN114909786A

CN114909786A - Air conditioning system and control method thereof

Info

Publication number: CN114909786A
Application number: CN202210435722.4A
Authority: CN
Inventors: 杨晓波; 孙铁军; 韩海力
Original assignee: Qingdao Hisense Hitachi Air Conditioning System Co Ltd
Current assignee: Qingdao Hisense Hitachi Air Conditioning System Co Ltd
Priority date: 2022-04-24
Filing date: 2022-04-24
Publication date: 2022-08-16

Abstract

The embodiment of the application provides an air conditioning system and a control method thereof, relates to the technical field of air conditioners, and is used for enabling the air conditioning system to meet the requirement of each user on the comfort degree as much as possible. The air conditioning system comprises an outdoor unit; the indoor unit comprises a camera device, and the camera device is used for acquiring an image of a space where the indoor unit is located; a controller connected with the image pickup apparatus, configured to: acquiring an image of a space where the indoor unit is located through a camera device; according to the image, identifying a registered user in the space where the indoor unit is located; under the condition that a plurality of registered users are identified, determining target working parameters of the indoor unit according to preset air conditioner use preference information of each registered user in the plurality of registered users; and controlling the indoor unit to work according to the target working parameters.

Description

Air conditioning system and control method thereof

Technical Field

The application relates to the technical field of air conditioners, in particular to an air conditioning system and a control method thereof.

Background

With the development of economic society, air conditioners are increasingly widely used in various places such as entertainment, home and work. As air conditioning technology is becoming mature, users have increasingly high demands for comfort while enjoying the convenience of air conditioning. Different users have different requirements on comfort, for example, some users like the air conditioner to blow directly, and some users like the air conditioner not to blow to themselves. For example, some users prefer low temperature, and some users prefer high temperature. For example, some users prefer dryness and some users prefer wetness.

The current air conditioner has low intelligentization degree, can only identify the position, the action and the like of each user in the space where the air conditioner is located, and can be started or shut down according to the position, the action and the like, so that the comfort level of the space where the air conditioner is located can not meet the requirement of each user on the comfort level.

Disclosure of Invention

The embodiment of the application provides an air conditioning system and a control method thereof, which are used for enabling the air conditioning system to meet the requirement of each user on comfort degree as much as possible.

In order to achieve the purpose, the following technical scheme is adopted in the application.

In a first aspect, an embodiment of the present application provides an air conditioning system, including: an outdoor unit; the indoor unit comprises a camera device, and the camera device is used for acquiring an image of a space where the indoor unit is located; a controller connected with the image pickup apparatus, configured to: acquiring an image of a space where the indoor unit is located through a camera device; then, according to the image, identifying the registered user in the space where the indoor unit is located; under the condition that a plurality of registered users are identified, determining target working parameters of the indoor unit according to preset air conditioner use preference information of each registered user in the plurality of registered users; and controlling the indoor unit to work according to the target working parameters.

The technical scheme provided by the embodiment of the application at least has the following beneficial effects: the preset air conditioner usage preference information of a registered user may reflect the registered user's requirement for comfort. Therefore, the working parameters of the indoor unit are determined according to the preset air conditioner use preference information of each registered user in the space where the indoor unit is located, and the accuracy of determining the working parameters is improved, so that under the condition that the indoor unit works, the comfort level of the space where the indoor unit is located can meet the requirement of each registered user in the space where the indoor unit is located on the comfort level as much as possible, the intelligent degree of an air conditioning system is improved, and meanwhile, the user experience is improved.

In some embodiments, the outdoor unit further includes a distance sensor for detecting a distance between each of the plurality of registered users and the indoor unit; the controller is configured to determine a target working parameter of the indoor unit according to preset air conditioner use preference information of each registered user in the plurality of registered users, and specifically execute the following steps: acquiring the distance between each registered user in a plurality of registered users and an indoor unit; and according to the distance between each registered user in the plurality of registered users and the indoor unit, selecting preset air conditioner use preference information of the registered user closest to the indoor unit, and determining the target working parameters of the indoor unit.

In some embodiments, the controller is configured to determine a target operating parameter of the indoor unit according to preset air conditioner usage preference information of each of a plurality of registered users, and specifically perform the following steps: and determining target working parameters of the indoor unit according to preset air conditioner use preference information of each registered user in the plurality of registered users on the basis of a few majority-obeying principles.

In some embodiments, the controller is configured to identify, according to the image, a registered user located in a space where the indoor unit is located, and specifically perform the following steps: carrying out face detection on the images, and determining at least one face image in the images, wherein each face image corresponds to a human body target; for each face image in at least one face image, sequentially performing enhancement processing, feature extraction processing and feature matching processing on the face image to obtain a recognition result of the face image, wherein the recognition result of the face image indicates whether a human body target corresponding to the face image is a registered user; and determining the registered user in the space where the indoor unit is located according to the recognition result of each face image.

In some embodiments, the controller is configured to perform face detection on the images, determine at least one face image in the images, and specifically perform the following steps: inputting the image into a face detection model based on a Convolutional Neural Network (CNN) to obtain a face detection result, wherein the face detection result is used for indicating at least one face image in the image.

In some embodiments, the enhancement processing includes noise reduction processing and bad point removal processing; the controller is configured to sequentially perform enhancement processing, feature extraction processing and feature matching processing on the face image to obtain a recognition result of the face image, and specifically execute the following steps: enhancing the face image to obtain an enhanced face image; inputting the enhanced face image into a feature extraction model based on a convolutional neural network to obtain a feature extraction result, wherein the feature extraction result is used for indicating feature data in the face image; and inputting the feature extraction result into a feature matching model based on a convolutional neural network to obtain a recognition result of the face image.

In a second aspect, an embodiment of the present application provides a method for controlling an air conditioning system, where the method is applied to an air conditioning system, the air conditioning system includes an outdoor unit and an indoor unit, the indoor unit includes a camera device, and the camera device is configured to collect an image of a space where the indoor unit is located, and the method includes: acquiring an image of a space where an indoor unit is located; according to the image, identifying a registered user in the space where the indoor unit is located; under the condition that a plurality of registered users are identified, determining target working parameters of the indoor unit according to preset air conditioner use preference information of each registered user in the plurality of registered users; and controlling the indoor unit to work according to the target working parameters.

In a third aspect, an embodiment of the present application provides a controller, including: one or more processors; one or more memories; wherein the one or more memories are configured to store computer program code comprising computer instructions, and the controller is configured to execute any one of the control methods of the air conditioning system provided by the second aspect when the one or more processors execute the computer instructions.

In a fourth aspect, embodiments of the present application provide a computer-readable storage medium, where the computer-readable storage medium includes computer instructions, and when the computer instructions are executed on a computer, the computer is caused to execute any one of the control methods of the air conditioning system provided in the second aspect.

In a fifth aspect, an embodiment of the present invention provides a computer program product, which is directly loadable into a memory and contains software codes, and which, when loaded and executed by a computer, is capable of implementing any one of the control methods of the air conditioning system as provided in the second aspect.

It should be noted that all or part of the computer instructions may be stored on the computer readable storage medium. The computer readable storage medium may be packaged with or separately from a processor of the controller, which is not limited in this application.

The beneficial effects described in the second aspect to the fifth aspect in the present application may refer to the beneficial effect analysis of the first aspect, and are not described herein again.

Drawings

The accompanying drawings are included to provide a further understanding of the invention and are incorporated in and constitute a part of this specification, illustrate embodiments of the invention and together with the example serve to explain the principles of the invention and not to limit the invention.

Fig. 1 is a schematic composition diagram of an air conditioning system according to an embodiment of the present disclosure;

fig. 2 is a schematic structural diagram of an air conditioning system according to an embodiment of the present disclosure;

fig. 3 is a schematic structural diagram of another air conditioning system provided in the embodiment of the present application;

fig. 4 is a schematic diagram of a refrigeration cycle of an air conditioning system according to an embodiment of the present disclosure;

fig. 5 is a block diagram of a hardware configuration of an air conditioning system according to an embodiment of the present disclosure;

fig. 6 is an interaction diagram of a controller and a terminal device of an air conditioning system according to an embodiment of the present disclosure;

fig. 7 is a schematic view of a management interface of a terminal device according to an embodiment of the present application;

fig. 8 is a flowchart of a control method of an air conditioning system according to an embodiment of the present disclosure;

fig. 9A is a flowchart of another control method for an air conditioning system according to an embodiment of the present disclosure;

fig. 9B is a flowchart of another control method for an air conditioning system according to an embodiment of the present disclosure;

fig. 9C is a flowchart of another control method for an air conditioning system according to an embodiment of the present disclosure;

fig. 10 is a flowchart illustrating another control method for an air conditioning system according to an embodiment of the present disclosure;

fig. 11 is a flowchart illustrating another control method for an air conditioning system according to an embodiment of the present disclosure;

fig. 12 is a diagram illustrating a conventional VGG-16 network structure according to an embodiment of the present disclosure;

fig. 13 is a structural diagram of an improved VGG-16 network provided by an embodiment of the present application;

fig. 14 is a schematic management interface diagram of another terminal device according to an embodiment of the present application;

fig. 15 is a schematic hardware structure diagram of a controller according to an embodiment of the present disclosure.

Detailed Description

The technical solutions in the embodiments of the present application will be clearly and completely described below with reference to the drawings in the embodiments of the present application, and it is obvious that the described embodiments are only a part of the embodiments of the present application, and not all of the embodiments. All other embodiments, which can be derived by a person skilled in the art from the embodiments given herein without making any creative effort, shall fall within the protection scope of the present application.

In the description of the present invention, it is to be understood that the terms "center", "upper", "lower", "front", "rear", "left", "right", "vertical", "horizontal", "top", "bottom", "inner", "outer", and the like indicate orientations or positional relationships based on those shown in the drawings, and are only for convenience of description and simplicity of description, and do not indicate or imply that the referenced devices or elements must have a particular orientation, be constructed and operated in a particular orientation, and thus, are not to be construed as limiting the present invention.

The terms "first", "second" and "first" are used for descriptive purposes only and are not to be construed as indicating or implying relative importance or implicitly indicating the number of technical features indicated. Thus, a feature defined as "first" or "second" may explicitly or implicitly include one or more of that feature. In the description of the present application, "a plurality" means two or more unless otherwise specified.

In the description of the present application, it is to be noted that the terms "connected" and "connected" are to be interpreted broadly, and may be, for example, fixedly connected, detachably connected, or integrally connected, unless explicitly stated or limited otherwise. The specific meaning of the above terms in the present application can be understood in a specific case by those of ordinary skill in the art. In addition, when a pipeline is described, the terms "connected" and "connected" are used in this application to have a meaning of conducting. The specific meaning is to be understood in conjunction with the context.

As air conditioning technology matures, the comfort level requirements of users are higher and higher. The existing air conditioner can detect the position, the action and the like of a user according to human sensing technology (such as infrared human sensing, image recognition human sensing, radar wave human sensing and the like), so as to adjust the working parameters of the air conditioner. When the number of users in a room where an air conditioner is located is too large, the comfort level requirements of different users may be different, and the working parameters of the air conditioner are adjusted only according to the location and the action of the user, which may cause that the comfort level of the space where the air conditioner is located cannot meet the comfort level requirements of each user.

Based on this, an embodiment of the present application provides a control method for an air conditioning system, where a camera is configured on an indoor unit of the air conditioning system, so as to obtain an image of a space where the indoor unit is located, and then, in combination with a face recognition technology, a registered user located in the space where the indoor unit is located is identified from the image, and then, according to preset air conditioner usage preference information of each registered user, a working parameter of the indoor unit is determined. Because the working parameters of the indoor unit are confirmed according to the preset air conditioner use preference information of each registered user, the comfort level of the space where the indoor unit is located can meet the requirement of each registered user on the comfort level as far as possible under the working condition of the indoor unit, and the intelligent degree of the air conditioner is improved while the user experience is improved.

For the sake of understanding, the basic concepts of some terms or techniques related to the embodiments of the present invention will be briefly described and explained.

A refrigeration mode: the compressor of the air conditioning system sucks the low-temperature and low-pressure gaseous refrigerant evaporated by the evaporator into a compressor cavity, compresses the low-temperature and low-pressure gaseous refrigerant into high-temperature and high-pressure gaseous refrigerant, and enters the condenser. The high-temperature high-pressure gas refrigerant is condensed into a high-temperature high-pressure liquid refrigerant in the condenser, then the high-temperature high-pressure liquid refrigerant is throttled by a throttling element such as a capillary tube to be changed into a low-temperature low-pressure liquid refrigerant, the low-temperature low-pressure liquid refrigerant enters the evaporator to be evaporated, and finally the low-temperature low-pressure liquid refrigerant returns to the compressor, so that the whole refrigeration cycle is completed. The outdoor heat exchanger in the cooling mode is used as a condenser, and the indoor heat exchanger is used as an evaporator.

Refrigerant: a substance which is easily changed into gas by heat absorption and liquid by heat release. In an air conditioning system, heat energy is transferred through evaporation and condensation of a refrigerant, and a refrigeration effect is generated.

Degree of superheat: the difference between the actual temperature of the refrigerant at the outlet of the evaporator and the corresponding saturation temperature of the refrigerant at the pressure is referred to, that is, the difference between the outlet temperature of the evaporator and the evaporation temperature.

Supercooling degree: the difference between the saturation temperature corresponding to the pressure of the refrigerant at a certain point of the outlet of the condenser and the actual temperature of the refrigerant is indicated.

An expansion valve: the valve consists of a valve body and a coil and is used for throttling, reducing pressure and regulating flow. An expansion valve in the air conditioning system can enable a medium-temperature high-pressure liquid refrigerant to be throttled into low-temperature low-pressure wet steam, then the refrigerant absorbs heat in an evaporator to achieve a refrigeration effect, and the flow of a valve is controlled through the change of the superheat degree of an outlet of the evaporator.

The air conditioning system performs a refrigeration cycle of the air conditioning system by using a compressor, a condenser, an expansion valve, and an evaporator. The refrigeration cycle includes a series of processes involving compression, condensation, expansion, and evaporation, and supplies refrigerant to the air that has been conditioned and heat-exchanged.

The compressor compresses a refrigerant gas in a high-temperature and high-pressure state and discharges the compressed refrigerant gas. The discharged refrigerant gas flows into the condenser. The condenser condenses the compressed refrigerant into a liquid phase, and heat is released to the surrounding environment through the condensation process.

The expansion valve expands the liquid-phase refrigerant in a high-temperature and high-pressure state condensed in the condenser into a low-pressure liquid-phase refrigerant. The evaporator evaporates the refrigerant expanded in the expansion valve and returns the refrigerant gas in a low-temperature and low-pressure state to the compressor. The evaporator can achieve a cooling effect by heat-exchanging with a material to be cooled using latent heat of evaporation of a refrigerant. The air conditioning system may regulate the temperature of the indoor space throughout the cycle.

The outdoor unit of the air conditioning system refers to a portion of the refrigeration cycle including the compressor and the outdoor heat exchanger, the indoor unit of the air conditioning system includes the indoor heat exchanger, and the expansion valve may be provided in the indoor unit or the outdoor unit.

The indoor heat exchanger and the outdoor heat exchanger serve as a condenser or an evaporator. When the indoor heat exchanger is used as a condenser, the air conditioning system is used as a heater in a heating mode, and when the indoor heat exchanger is used as an evaporator, the air conditioning system is used as a cooler in a cooling mode.

Fig. 1 is a schematic diagram illustrating the components of an air conditioning system according to an exemplary embodiment of the present application, and as shown in fig. 1, the air conditioning system 10 includes an outdoor unit 11, a throttling device 12 (not shown in fig. 1), an indoor unit 13, and a controller 13 (not shown in fig. 1).

The indoor unit 13 is exemplified by the indoor unit 13 as an on-hook (shown in fig. 1), and the on-hook is usually attached to an indoor wall surface or the like. For another example, an indoor cabinet (not shown in fig. 1) is also an indoor unit configuration of the indoor unit.

The outdoor unit 11 is generally installed outdoors and used for heat exchange in an indoor environment. In the illustration of fig. 1, the outdoor unit 11 is indicated by a broken line because the outdoor unit 11 is located outdoors on the opposite side of the indoor unit 13 with respect to the wall surface.

Wherein the throttle means 12 comprises an electronic expansion valve 121. There is a pipe connection between the outdoor unit 11 and the indoor unit 13, and an electronic expansion valve 121 is provided in the pipe between the indoor unit 13 and the outdoor unit 11. The conduit, also known as a gas-liquid line, comprises: a gas pipe for transporting gaseous refrigerant and a liquid pipe for transporting two-phase refrigerant.

The throttling device 12 is used for adjusting the flow rate of fluid in a gas-liquid pipe of the air conditioner and adjusting the flow rate of refrigerant. The electronic expansion valve 121 is used to adjust the supply amount of refrigerant in the pipe. Fig. 2 is a schematic structural diagram of an air conditioning system according to an exemplary embodiment of the present application, as shown in fig. 2, the electronic expansion valve 121 may be independent of the outdoor unit 11, or may be attached to a part of the outdoor unit 11 (as shown in fig. 3), and fig. 3 is a schematic structural diagram of another air conditioning system according to an exemplary embodiment of the present application.

Furthermore, the outdoor unit 11, the throttling device 12 and the indoor unit 13 are all in communication connection with a controller 14 (not shown in fig. 1), and perform related operations according to instructions of the controller 14.

Taking the electronic expansion valve 121 as an example, which is independent of the outdoor unit 11, fig. 4 shows a schematic diagram of a refrigeration cycle of an air conditioning system.

As shown in fig. 4, the air conditioning system 10 includes an outdoor unit 11, a throttle device 12, an indoor unit 13, and a controller 14 (not shown in fig. 4).

The outdoor unit 11 includes: a compressor 111, an outdoor heat exchanger 112, an accumulator 113, and a four-way valve 114. In some embodiments, the outdoor unit 11 further comprises one or more of: an outdoor fan, and an outdoor fan motor.

The throttling device 12 is used to regulate the flow rate of the fluid in the air and liquid pipes of the air conditioning system.

The indoor unit 13 includes: an indoor heat exchanger 131, a display 132, and an indoor fan 133. In some embodiments, the indoor unit 13 further includes an indoor fan motor.

In some embodiments, the compressor 111 is disposed between the throttling device 12 and the accumulator 113, and is configured to compress the refrigerant delivered by the accumulator 113 and deliver the compressed refrigerant to the throttling device 12 via the four-way valve 114. The compressor 111 may be an inverter compressor with variable capacity that performs rotational speed control by an inverter.

In some embodiments, the controller 14 may obtain an operating current value (which may also be referred to as a compressor current value) of the compressor 111 at each time.

In some embodiments, the outdoor heat exchanger 112 is connected at one end to the accumulator 113 via a four-way valve 114 and at the other end to the throttling device 12. The outdoor heat exchanger 112 has a first inlet and outlet for allowing the refrigerant to flow between the outdoor heat exchanger 112 and the suction port of the compressor 111 via the accumulator 113, and has a second inlet and outlet for allowing the refrigerant to flow between the outdoor heat exchanger 112 and the expansion device 12. The outdoor heat exchanger 112 exchanges heat between the outdoor air and the hot cooler flowing through the heat transfer pipe connected between the first inlet and the second inlet, and the outdoor heat exchanger 112 operates as a condenser in the cooling cycle.

In some embodiments, the accumulator 113 is connected to the compressor 111 at one end and to the outdoor heat exchanger 112 at the other end via a four-way valve 114. In the accumulator 113, the refrigerant flowing from the outdoor heat exchanger 112 to the compressor 111 via the four-way valve 114 is separated into a gas refrigerant and a liquid refrigerant. Then, the gas refrigerant is mainly supplied from the accumulator 113 to the suction port of the compressor 111.

In some embodiments, four ports of the four-way valve 114 are connected to the compressor 111, the outdoor heat exchanger 112, the accumulator 113, and the plurality of electronic expansion valves 121, respectively. The four-way valve 114 is used for switching between cooling and heating by changing the flow direction of the refrigerant in the system pipeline.

In some embodiments, the outdoor fan causes heat exchange between the refrigerant flowing in the heat transfer pipe between the first inlet and the second inlet and the outdoor air by generating an airflow of the outdoor air through the outdoor heat exchanger 112.

In some embodiments, an outdoor fan motor is used to drive or vary the rotational speed of the outdoor fan.

In some embodiments, the electronic expansion valve 121 has a function of expanding and decompressing the refrigerant flowing through the electronic expansion valve 121, and may be used to adjust the supply amount of the refrigerant in the pipe. When the opening degree of the electronic expansion valve 121 is decreased, the flow resistance of the refrigerant passing through the electronic expansion valve 121 increases. When the electronic expansion valve 121 increases the opening degree, the flow resistance of the refrigerant passing through the electronic expansion valve 121 decreases. In this way, even if the state of other components in the circuit does not change, when the opening degree of the electronic expansion valve 121 changes, the flow rate of the refrigerant flowing to the indoor unit 13 changes.

In some embodiments, the indoor heat exchanger 131 has a third inlet and outlet for passing liquid refrigerant between the electronic expansion valve 121 and a fourth inlet and outlet for passing gas refrigerant between the discharge port of the compressor 111. The indoor heat exchanger 131 exchanges heat between the refrigerant flowing through the heat transfer pipe connected between the third inlet and the fourth inlet and the indoor air.

In some embodiments, the indoor fan 133 generates an airflow of the indoor air passing through the indoor heat exchanger 131 to promote heat exchange between the refrigerant flowing in the heat transfer pipe between the third inlet and the fourth inlet and the indoor air.

In some embodiments, an indoor fan motor is used to drive or vary the rotational speed of the indoor fan 133.

In some embodiments, display 132 is used to display the indoor temperature or current operating mode.

In the embodiment shown in the present application, the controller 14 refers to a device capable of generating an operation control signal according to the command operation code and the timing signal, and instructing the air conditioning system to execute the control command. For example, the controller may be a Central Processing Unit (CPU), a general purpose processor Network (NP), a Digital Signal Processor (DSP), a microprocessor, a microcontroller, a Programmable Logic Device (PLD), or any combination thereof. The controller may also be other devices with processing functions, such as a circuit, a device, or a software module, which is not limited in any way by the embodiments of the present application.

In addition, the controller 14 may be configured to control the operation of various components within the interior of the air conditioning system 10 such that the various components of the air conditioning system 10 operate to perform various predetermined functions of the air conditioning system.

In some embodiments, the air conditioning system 10 is also accompanied by a remote control having functionality to communicate with the controller 14, for example, using infrared or other communication means. The remote control is used for various controls that the user can control the air conditioning system, and the interaction between the user and the air conditioning system 10 is realized.

Fig. 5 is a block diagram illustrating a hardware configuration of an air conditioning system according to an exemplary embodiment of the present application. As shown in fig. 5, the air conditioning system 10 may also include one or more of the following: an image pickup device 101, a distance sensor 102, a communicator 103, and a memory 104.

In some embodiments, the camera 101 is used to capture an image of the space where the indoor unit 13 is located.

In some embodiments, the camera 101 is connected to the controller 14. The imaging device 101 may be provided on the indoor unit 13, that is, the indoor unit 13 further includes the imaging device 101. Illustratively, as shown in fig. 6, the camera 101 may include a camera 1011, an image recognition module 1102, and the like. The camera 1101 is configured to photograph an image within a visual angle range of the camera to obtain a corresponding image, and may specifically be a monocular camera or a multi-view camera; the camera can be a 2D camera or a 3D camera, and is determined according to actual requirements. The image recognition module 1102 may be a dedicated image processing chip connected to the camera 1101, which may be used to implement the following functions: the image of the space where the indoor unit 13 is located, which is captured by the camera 1101, is subjected to face recognition, and the face recognition result is sent to the controller 13.

The distance sensor 102, also called a displacement sensor, is a type of sensor for sensing a distance between the sensor and an object to perform a predetermined function. The distance sensor may be classified into an optical distance sensor, an infrared distance sensor, an ultrasonic distance sensor, and the like according to different working principles, and the embodiment of the present application is not limited to a specific form of the distance sensor 102.

In some embodiments, the distance sensor 102 is connected to the controller 14; the distance sensor 102 may be disposed on the indoor unit 13, that is, the indoor unit 13 further includes the distance sensor 13.

In some embodiments, the distance sensor 102 is configured to detect a distance between each of the registered users located in the space where the indoor unit is located and the indoor unit 13, and send the detected distance between each of the registered users and the indoor unit 13 to the controller 14.

In some embodiments, the communicator 103 is configured to establish a communication connection with other network entities, for example, a terminal device. The communicator 103 may include a Radio Frequency (RF) module, a cellular module, a wireless fidelity (WIFI) module, a GPS module, and the like. Taking the RF module as an example, the RF module can be used for receiving and transmitting signals, and particularly, transmitting the received information to the controller 14 for processing; in addition, the signal generated by the controller 14 is sent out. In general, the RF circuit may include, but is not limited to, an antenna, at least one amplifier, a transceiver, a coupler, a Low Noise Amplifier (LNA), a duplexer, and the like.

The memory 104 may be used to store software programs and data. The controller 14 executes various functions of the air conditioning system 10 and data processing by executing software programs or data stored in the memory 104. The memory 14 may include high speed random access memory and may also include non-volatile memory, such as at least one magnetic disk storage device, flash memory device, or other volatile solid state storage device. The memory 14 stores an operating system that enables the air conditioning system 10 to operate. The memory 14 may store an operating system and various application programs, and may also store codes for executing the control method of the air conditioning system provided in the embodiment of the present application.

Those skilled in the art will appreciate that the hardware configuration shown in FIG. 5 does not constitute a limitation of air conditioning systems, which may include more or fewer components than shown, or some components may be combined, or a different arrangement of components.

Fig. 6 is an interaction diagram of the controller 14 and the terminal device 300 of the air conditioning system according to the exemplary embodiment of the present application.

As shown in fig. 6, the terminal device 300 may establish a communication connection with the controller 14 of the air conditioning system. Establishment of the communication connection may be accomplished, illustratively, using any known network communication protocol. The network communication protocol may be any of a variety of wired or wireless communication protocols, such as Ethernet, Universal Serial Bus (USB), FIREWIRE (FIREWIRE), any cellular communication protocol (e.g., 3G/4G/5G), Bluetooth, Wireless Fidelity (Wi-Fi), NFC, or any other suitable communication protocol. The communication connection may be a bluetooth connection, NFC, zigbee, wireless fidelity (Wi-Fi), or the like. This is not particularly limited by the examples of the present application.

It should be noted that the terminal device 300 shown in fig. 6 is only one example of a terminal device. The terminal device 300 in the present application may be a remote controller, a mobile phone, a tablet computer, a Personal Computer (PC), a Personal Digital Assistant (PDA), a smart watch, a netbook, a wearable electronic device, an Augmented Reality (AR) device, a Virtual Reality (VR) device, a robot, etc., and the present application does not make any special limitation on the specific form of the terminal device.

For example, taking the terminal device 300 as a mobile phone as an example, a user may download an intelligent home APP on the mobile phone, and the intelligent home APP may be used for managing the intelligent home device, which is exemplified by taking the intelligent home device as the air conditioning system 10 in the embodiment of the present application. Further, the user may select the on-line device of the air conditioning system 10 and select a control function to be executed on the air conditioning system 10 among the management options of the air conditioning system 10. For example, the control functions of turning on, turning off, switching modes (such as a cooling mode and a heating mode) and the like. If it is detected that the user clicks a start button of the air conditioning system 10 in the smart home APP, the mobile phone may send a start instruction to the air conditioning system 10.

Illustratively, as shown in fig. 7, a management interface 301 of the air conditioning system 10 is displayed on the terminal device 300, and the management interface 301 includes a "power on" button 302. When the mobile phone detects that the user clicks the "power on" button 302 in the management interface 301, the mobile phone sends a power on command to the air conditioning system 10 to control the air conditioning system 10 to start up for operation.

In some embodiments, before the user uses the smart home APP to control the air conditioning system, the user needs to log in the smart home APP. If the user is a user who is not registered by the intelligent home APP, the user needs to register the identity through the intelligent home APP.

The embodiments provided in the present application will be described in detail below with reference to the accompanying drawings.

As shown in fig. 8, an embodiment of the present application provides a control method of an air conditioning system, which is applied to the controller 14 in the air conditioning system 10 shown in fig. 2, and the method includes:

s101, obtaining an image of a space where the indoor unit is located.

In some embodiments, when the user needs to use the air conditioning system, the user may issue the power-on instruction to the air conditioning system through a remote controller of the air conditioning system, or may issue the power-on instruction to the air conditioning system through the terminal device. And responding to the starting instruction, and acquiring the image of the space where the indoor unit is located by the controller through a camera device included in the indoor unit. The space where the indoor unit is located may be a living room, a bedroom, a study room, and the like, which is not limited in the embodiment of the present application.

In some embodiments, the air conditioning system may periodically acquire an image of a space where the indoor unit is located, and then determine whether to adjust its working parameter according to the image of the space where the indoor unit is located, so that after a new registered user enters the space where the indoor unit is located, the air conditioning system may adjust its working parameter in time, so that the comfort level of the space where the indoor unit is located may meet the requirement of each registered user for comfort level as much as possible.

And S102, identifying the registered user in the space where the indoor unit is located according to the image.

After the image of the space where the indoor unit is located is obtained, the image can be identified, so that the registered user located in the space where the indoor unit is located can be identified. The registered user refers to a user who is registered in the smart home APP. The user can input the requirement of the user on the comfort level, namely the following preset air conditioner use preference information, in the process of registering the information of the intelligent home APP, so that the controller can determine the target working parameters of the indoor unit according to the preset air conditioner use preference information of each registered user in the space where the indoor unit is located. As to how the user registers in the smart home APP, the following description of how the user becomes a registered user may be referred to, and details are not repeated herein.

It can be understood that, if a user is a user who is not registered through the smart home APP, the controller cannot recognize the identity of the user according to the image, and further cannot acquire the preset air conditioner use preference information of the user.

S103, under the condition that a plurality of registered users are identified, determining target working parameters of the indoor unit according to preset air conditioner use preference information of each registered user in the plurality of registered users.

The preset air conditioner use preference information of the registered user comprises wind direction preference, temperature preference and humidity preference. The wind direction preference comprises blowing, avoiding and uniformly sweeping. The temperature preferences include high temperature preferences, low temperature preferences, and personal settings. The individual sets a specific temperature to be set by the user according to his own taste. Humidity preferences include dry, wet, and comfortable.

It can be understood that if only one registered user is identified, the target working parameters of the indoor unit can be directly determined according to the preset air conditioner use preference information of the registered user. When a plurality of registered users are identified, in order to enable the comfort level of the space where the indoor unit is located to meet the comfort level requirement of each registered user as much as possible, the target working parameters of the indoor unit need to be determined according to the preset air conditioner use preference information of each registered user in the plurality of registered users.

It should be noted that the database of the controller is pre-established with a corresponding relationship between the preset air conditioner usage preference information of each registered user and the identifier of each registered user. After a plurality of registered users are identified, the registered users can be searched from the database according to the identification of each registered user, and then the preset air conditioner use preference information of each registered user is determined. The identifier of the registered user is used to uniquely indicate one registered user, and may be a nickname, a mobile phone number, or the like of the registered user, which is not limited in this respect.

Optionally, as shown in fig. 9A, step S103 may be implemented as the following steps:

and S1031, obtaining the distance between each registered user in the plurality of registered users and the indoor unit.

For example, the controller may obtain the distance between each registered user and the indoor unit through a distance sensor included in the indoor unit.

And S1032, according to the distance between each registered user in the plurality of registered users and the indoor unit, selecting the preset air conditioner use preference information of the registered user closest to the indoor unit, and determining the target working parameters of the indoor unit.

It can be understood that, the closer a registered user is to the indoor unit, the more appropriate the indoor unit experiences (e.g., wind direction, temperature) the registered user will feel to the indoor unit under the working condition, so the target working parameters of the indoor unit can be determined by the preset air conditioner use preference information of the registered user closest to the indoor unit.

Illustratively, assume that the plurality of registered users includes a first registered user and a second registered user. And if the first distance between the first registered user and the indoor unit is smaller than the second distance between the second registered user and the indoor unit, the controller determines the target working parameters of the indoor unit according to the preset air conditioner use preference information of the first registered user. And determining target working parameters of the indoor unit to be a blowing person, a low temperature and dryness if wind direction preference, temperature preference and humidity preference of the preset air conditioner use preference information of the first registered user are a blowing person, low temperature and dryness.

Optionally, as shown in fig. 9B, step S103 may also be specifically implemented as the following steps:

and S1033, based on the principle that a minority is subject to a majority, determining target working parameters of the indoor unit according to preset air conditioner use preference information of each registered user in the registered users.

Illustratively, assume that the plurality of registered users includes a first registered user, a second registered user, and a third registered user. And if the wind direction preference of the first registered user is a wind blowing person, the wind direction preference of the second registered user is a wind avoiding person, and the wind direction preference of the third registered user is a wind blowing person, determining that the wind direction in the target working parameter of the indoor unit is set as the wind blowing person.

In some embodiments, when none of the preset air conditioner use preference information of the plurality of registered users is the same, the intermediate mode is adopted. For example, if the wind direction preference of the first registered user is a wind blowing person, the wind direction preference of the second registered user is a wind avoiding person, and the wind direction preference of the third registered user is uniform wind sweeping. The wind direction in the target working parameter of the indoor unit is determined to be set as uniform wind sweeping.

It can be understood that if a few principles that are subject to majority are adopted, the target working parameters of the indoor unit are determined according to the preset air conditioner use preference information of each registered user in the at least one registered user, so that the comfort level of the space where the indoor unit is located under the working condition of the indoor unit can meet the requirement of most registered users on the comfort level to a certain extent, the use experience of most registered users can be improved, and the requirement of each registered user on the comfort level is met as much as possible.

Optionally, as shown in fig. 9C, step S103 may also be specifically implemented as the following steps:

s1034, the weight of each registered user in the plurality of registered users is obtained.

Wherein the weight of a registered user may be the age group or priority of the registered user.

In some embodiments, the user can input the age and priority of the user when performing identity registration on the smart home APP, so that after the controller identifies each registered user located in the space where the indoor unit is located according to the image, the controller can obtain the age and priority of each registered user, and further determine the weight of each registered user according to the age or priority of each registered user.

For example, the age group may include children, young, middle-aged, and old people, and the priority may include a first priority and a second priority, wherein the first priority is higher than the second priority. For example, a pregnant woman and a patient can choose to set the first priority, and other people default to the second priority, which can be specifically set according to actual situations, and the embodiment of the present application does not limit this.

For example, the weight of the children and the elderly can be set to be equal, the weight of the children and the elderly is set to be greater than that of the middle aged, and the weight of the middle aged is set to be greater than that of the young, namely the weight of the children and the elderly is the highest and the weight of the young is the lowest. Similarly, the first priority is set to be heavier than the second priority.

And S1035, determining target working parameters of the indoor unit according to the preset air conditioner use preference information of each registered user in the plurality of registered users and the weight of each registered user.

Optionally, when a plurality of registered users are detected, the age group with the highest specific gravity of the plurality of registered users may be determined according to the age group of each registered user, and then the target operating parameter of the indoor unit is determined according to the preset air conditioner usage preference information of the registered user corresponding to the age group with the highest specific gravity.

It can be understood that the requirement of the old and the children on the comfort level is higher to a certain extent, so that the weight of the old and the children can be set to be higher. So, when having old man or children in the space of indoor set place, can satisfy as far as and be arranged in the requirement of old man and children to the comfort level in the space of indoor set place, promoted air conditioning system's intelligent degree.

Optionally, the priority with the highest specific gravity in the multiple registered users may be determined according to the priority of each registered user, and then the target operating parameter of the indoor unit is determined according to the preset air conditioner usage preference information of the registered user corresponding to the priority with the highest specific gravity. The target working parameters of the indoor unit can also be directly determined by the preset air conditioner use preference information of one or more registered users with the highest priority in all the registered users.

Therefore, the target working parameters of the indoor unit are determined according to the priority of each registered user, the accuracy of determining the working parameters of the indoor unit is improved, meanwhile, the comfort level of the space where the indoor unit is located can meet the requirement of the registered user with higher priority on the comfort level preferentially as much as possible, and the intelligent degree of the air-conditioning system is improved.

And S104, controlling the indoor unit to work according to the target working parameters.

After the target working parameter of the indoor unit is determined, the controller can control the indoor unit to work according to the target working parameter, so that the comfort level of the space where the indoor unit is located can meet the requirement of each registered user on the comfort level in the plurality of registered users located in the space where the indoor unit is located as far as possible.

Optionally, the controller may send a control instruction to the indoor unit, where the control instruction includes the target working parameter, and the control instruction is used to instruct the indoor unit to work with the target working parameter.

And after receiving the control instruction sent by the controller, the indoor unit responds to the control instruction and works according to the target working parameters included in the control instruction.

Based on the embodiment shown in fig. 8, in order to solve the problem that the comfort level of a room cannot meet the requirement of each user for the comfort level when a plurality of users are not present in the room in the current air conditioner, the embodiment of the present application provides a control method of an air conditioning system, in which a camera is configured on an indoor unit, so as to identify a registered user located in a space where the indoor unit is located. And under the condition that a plurality of registered users exist, intelligently determining the target working parameters of the indoor unit according to the preset air conditioner use preference information of each registered user. It is understood that the preset air conditioner usage preference information of one registered user may reflect the requirement of the registered user for comfort. Therefore, the working parameters of the indoor unit are determined according to the preset air conditioner use preference information of each registered user in the space where the indoor unit is located, and the accuracy of determining the working parameters is improved, so that under the condition that the indoor unit works, the comfort level of the space where the indoor unit is located can meet the requirement of each registered user in the space where the indoor unit is located on the comfort level as much as possible, the intelligent degree of the air conditioner is improved, and meanwhile, the comfort level of the space where the indoor unit is located under the working condition of the indoor unit can meet the requirement of each user on the comfort level as much as possible.

In some embodiments, as shown in fig. 10, the step S102 may be implemented as the following steps:

and S1021, carrying out face detection on the image, and determining at least one face image in the image.

Each face image corresponds to a human body target, that is, each face image corresponds to a user. It will be appreciated that in general, each person's face is unique, i.e., each face image corresponds to a user.

Optionally, step S1021 may be specifically implemented as: and inputting the image into a face detection model based on a convolutional neural network to obtain a face detection result. The face detection result is used for indicating at least one face image in the image.

Exemplarily, taking an AlexNET network structure as an example, a face detection model based on a convolutional neural network CNN is exemplified.

In some embodiments, the memory of the controller stores a trained face detection model based on the AlexNET network structure in advance. After the controller acquires the image of the space where the indoor unit is located, the image can be input into the trained face detection model to obtain a face detection result, and the face detection result indicates at least one face image in the image.

The explanation of how to train the face detection model of CNN based on AlexNET network structure is as follows: the image with the face is used as a positive sample, the image without the face is used as a negative sample to train the face detection model, and the trained face detection model has the capability of judging whether the image is the face image. The whole network structure of the AlexNET network consists of 5 convolutional layers and 3 full-connection layers, and the depth of the AlexNET network is 8 layers in total.

After acquiring the image of the space where the indoor unit is located, the controller may first perform scaling processing on the image in multiple proportions. For the original image and each zoomed image, the original image and each zoomed image can be intercepted from the upper left corner to the lower right corner of the image according to a certain step length, a plurality of 224 × 224 (227 × 227 after the following preprocessing) images can be intercepted, and then the plurality of images are input into a trained face recognition model to judge whether the images are human faces, so that a judgment matrix is obtained, and the judgment matrix indicates which images are face images. And then reversely finding the coordinate position of the image containing the face in the original image according to the judgment matrix to intercept, and finally obtaining at least one face image in the image, namely a face detection result.

And S1022, sequentially performing enhancement processing, feature extraction processing and feature matching processing on each face image in the at least one face image to obtain a recognition result of the face image.

And the recognition result of the face image indicates whether the human body target corresponding to the face image is a registered user.

Optionally, as shown in fig. 11, step S1022 may be implemented as the following steps:

s10221, the face image is enhanced to obtain an enhanced face image.

After the face image is obtained, in order to achieve the purpose of improving the face recognition rate, enhancement processing needs to be performed on the face image. The enhancement processing is carried out on the face image, and the enhancement processing can also be called as the preprocessing of the face image. The enhancement processing comprises noise reduction processing and dead pixel removal processing, wherein the noise reduction processing is to reduce noise and interfere the face image, the dead pixel removal processing is to remove redundant information in the face image, and the detectability of related information is enhanced, so that the purpose of improving the face recognition efficiency is achieved.

And carrying out noise reduction processing and dead point removal processing on the face image to obtain an enhanced face image.

S10222, inputting the enhanced face image into a feature extraction model based on a convolutional neural network to obtain a feature extraction result.

Illustratively, a feature extraction model based on the convolutional neural network CNN is illustrated by taking a VGG-16 network structure as an example.

In some embodiments, the memory of the controller is pre-stored with a trained feature extraction model based on the VGG-16 network structure. After the controller acquires the enhanced face image, the enhanced face image can be input into the trained feature extraction model to obtain a feature extraction result, and the feature extraction result is used for indicating feature data in the face image.

Fig. 12 is a diagram illustrating a conventional VGG-16 network architecture according to an exemplary embodiment of the present application. The input to the conventional VGG-16 network model is a fixed-size RGB 2D image, which is then passed through a series of stacked convolutional layers with a kernel size of 3 x 3. Every two or three sequentially stacked convolutional layers are a network of small unit modules named blocks, such as

blocks

1, 2, 3, 4, and 5 shown in fig. 11. Each Block is followed by a Max-posing layer to reduce the input size and maintain the translation invariance of the network. The output after passing through a plurality of stacked Block units is accessed into a three-layer traditional neural network, namely a three-layer full-connection layer, and the final classification output is a SoftMax multi-classifier. In the figure, Conv is a vector convolution operation.

In some embodiments, considering that too many parameters of the conventional VGG-16 network model affect the training speed, the embodiment of the application proposes to modify the network structure of the conventional VGG-16. As shown in fig. 13, an improved VGG-16 network architecture diagram is presented for the present application in accordance with an exemplary embodiment. As can be seen from the above description of the conventional VGG-16 network model, the conventional VGG-16 network model has low requirements on the fully connected layer, and the current development trend is to remove the fully connected layer as much as possible in the network structure, for example, google lenet has difficulty in seeing the fully connected layer, and so is ResNet. And google lenet not only discards the fully-connected layer, but also employs Averagepooling, i.e., uses mean pooling, at the pooling layer in front of the fully-connected layer. The method not only reduces the parameters of the network and has no great influence on the overall performance of the network, but also is beneficial to extracting the characteristics with more identification degree by the model. Therefore, in the embodiment of the application, the similar improvement method is also adopted for the traditional VGG-16 network structure, and the basic idea strategy is to reduce the full-connection layer of the network, namely, to remove two full-connection layers, namely, full-connection-1 and full-connection-1, and to change maxpoiring into Averagepooling, that is, to average pooling, in the area of Block 5. The convolution kernel is added from the original 512 to the current 600, mainly for better extracting the feature data of the face image. This approach, in turn, reduces the hardware storage requirements to some extent due to the use of the Averagepooling layer. Through the improvement, parameters in the network can be effectively reduced, so that the calculation amount is reduced, and the requirement of the control method of the air conditioning system provided by the embodiment of the application is met while the image characteristic data can be well extracted.

Optionally, the enhanced face image may be input into a feature extraction model based on a conventional VGG-16 network structure, so as to obtain a feature extraction result. The enhanced face image may also be input into a feature extraction model based on the improved VGG-16 network structure to obtain a feature extraction result, which is not limited in this respect.

S10223, inputting the feature extraction result into a feature matching model based on a convolutional neural network to obtain a recognition result of the face image.

Exemplarily, taking a Lightened VGG network structure as an example, a feature matching model based on the convolutional neural network CNN is illustrated.

In some embodiments, the memory of the controller stores a trained feature matching model based on the Lightened VGG network structure in advance. After the controller obtains the feature extraction result, the feature extraction result can be input into the trained feature matching model to obtain the recognition result of the face image.

In some embodiments, the training process of the feature matching model based on the Lightened VGG network structure is set forth as follows: and selecting the face image on the Facescub face database and the face image collected from the Internet as a training set of the feature matching model, and storing the face image on the Facescub face database and the face image collected from the Internet to form a face database of the Facescub face database. The trained feature matching model needs to be tested on an LFW face database to finish the identity authentication of whether two face images belong to the same user. In the process of forming the face database, the face images of people of different ages are collected, including the old, the young and the children, and the face images are closer to a real life scene. And the images are respectively collected from different angles, illumination and backgrounds, so that the authenticity and diversity of the face images are ensured. The human face images collected from the Internet are combined with the human face images in the faceScrub human face database to perform combined training, so that the performance and accuracy of the feature matching model can be effectively improved, and the generalization performance of the feature matching model can be guaranteed.

In some embodiments, before training the feature matching model based on the lightned VGG network structure, the face images in the Facescrub face database and the face images collected from the internet need to be preprocessed, which mainly includes the following steps:

firstly, aligning face images, and converting face angles mainly according to key point positions in faces to achieve the purpose of rectifying the faces.

Further, the face image is clipped. The periphery of the original face image has more background patterns, which are not useful data for the feature matching model, so that the redundant background part needs to be cut off.

Further, the training data set is expanded. Training of feature matching models requires a large data set in order to learn more discriminative features. The training set is expanded, and the embodiment of the application mainly uses two methods: firstly, turning over the image left and right (flipping); the second is to perform random cropping (scrop) of the middle region of the image. By the two methods, the total data amount of the training set can be increased, more differential images are increased, the feature matching model is insensitive to background change in the face image, and the translation invariance is good.

Further, a mean image of the training data set is calculated. Specifically, the pixel values at the corresponding positions of all the images in the training data set may be added and then averaged to obtain an average face image. In the process of training the feature matching model, the mean image needs to be subtracted from both the training set and the testing machine, so that the purpose is as follows: the normalization processing is carried out on the input face image, data (image pixel values) are distributed in the whole space more uniformly, and the convergence of the network is accelerated.

The training process of the feature matching model based on the Lightened VGG network structure comprises the following steps:

step 1, after a feature matching model based on a Lightened VGG network structure is built, parameters of the previous layers of convolution layers of the original VGG network on ImageNet are used for carrying out parameter initialization on the previous layers of the feature matching model, and all the rest parameter layers are retrained to adapt to a new face database.

And 2, training the feature matching model on a Facecececececececrab face database. Randomly using part of 1/10 in the FaceScrub data set as a verification set and the rest as a training set. When the feature matching model starts to be trained, the learning rate of 0.001 is used for learning, the learning rate is reduced by 1/10 after about 10 epochs, and one epoch is the time for one cycle of all training samples. At the moment, the accuracy rate of the test set reaches about 50%; then 10 epochs are learned again keeping the learning rate, and then the learning rate is again decreased 1/10. The learning rate is sequentially decreased at a magnification of 1/10 later.

And 3, taking the trained feature matching model as a face feature extractor, extracting the features of all face images in an LFW face database, and using the features in a face verification stage (verification). All face images in the LFW face database are sequentially subjected to forward calculation of the feature matching model and converted into corresponding feature values, namely, the output feature vectors of the averagepoolling layer are extracted. The test is performed using a test set provided by the LFW face database, where the test set is a series of image pairs, and the image pairs are of the same user or different users. The face verification method is that the Euclidean distance (corresponding to L2 norm) between each pair of feature vectors in a test set is calculated, then the test set is divided into ten parts, nine parts of the ten parts are used as training samples of a Support Vector Machine (SVM), a threshold value for distinguishing similarity or not is searched, the other part is used as a test sample, the test is carried out alternately and circularly, and finally, an average result is obtained.

And 4, performing training similar to the step 2 in a face database established by the user. The training set of the face database built by the user is fused into the faceScrub face database, and is trained on the feature matching model which is adjusted and optimized before, so as to carry out model fine adjustment. And then, randomly constructing a sample pair, calculating the feature similarity (Euclidean distance), and training a corresponding SVM classifier to judge the result. The on-line face recognition process of the system is used for testing on a self-built small face library test set, and the testing process comprises the following steps: 200 pictures are randomly extracted from a test set, ten people are extracted from a training set, 3 pictures are extracted from each person to serve as known faces, and the probability value that the pictures are correctly classified on a convolutional neural network model is high. The system acceptance means that the test picture is judged as the face known by the system, wherein the ratio of the correctly judged test picture is correct acceptance rate; conversely, what is determined by the system to be unknown is a system rejection. After extracting the feature vectors from the test pictures, carrying out feature similarity calculation with the known face pictures one by one, then judging by an SVM model, and counting the hit times of ten people (three known pictures per person) if the same person is judged and the same person is hit once. And when the number of times of hitting of a certain person is the largest, judging the identity of the tested face picture as the person. If a plurality of the same hits occur, the system takes the minimum similarity mean value as the final judgment result. If a hit is not found, the system rejects.

After the four steps of training, a well-trained feature matching model based on the Lightened VGG network structure is obtained. After the controller obtains the feature extraction result, the feature extraction result can be input into the trained feature matching model to obtain the recognition result of the face image. The recognition result of the face image indicates whether the human body target corresponding to the face image is a registered user. And if the recognition result of the face image indicates that the human body target corresponding to the face image is the registered user, determining that the human body target corresponding to the face image is the registered user. And if the recognition result of the face image indicates that the human body target corresponding to the face image is not the registered user, determining that the human body target corresponding to the face image is not the registered user.

Specifically, the feature matching model compares the feature vectors in the feature extraction result with the face feature vectors in the face database one by one, and calculates the distance between the vectors. And if the characteristic vector of a certain face is similar to the characteristic vector in the characteristic extraction result and the distance between the two vectors meets a threshold value, judging that the human target corresponding to the face image is the human target corresponding to the characteristic vector of the face, and returning the recognition result of the face image as the result. And if the traversing face database does not have the face feature vector meeting the threshold, returning the recognition result of the face image with a negative result.

And S1023, determining the registered user in the space where the indoor unit is located according to the recognition result of each face image.

And (4) performing the processing of the steps S10221 to S10223 on each face image to obtain the identification result of each face image, and further identifying at least one registered user in the space where the indoor unit is located.

The foregoing embodiments have focused on how to determine the target operating parameter of the indoor unit in the control method of the air conditioning system provided in the embodiments of the present application. In some embodiments, the control method of the air conditioning system provided in the embodiment of the present application may further include a process in which the user becomes a registered user of the smart home APP.

In some embodiments, in the process that a user uses the smart home APP through the terminal device, when the user is an unregistered user, the user may select to become a registered user. As shown in fig. 14, the registration interface of the smart home APP displayed by the terminal device includes a nickname, a mobile phone number, a wind direction preference, a temperature preference, a humidity preference, and the like. The user can input the nickname, the age bracket, the priority, the mobile phone number, the wind direction preference, the temperature preference, the humidity preference and the like in sequence according to the display on the registration interface. The terminal equipment responds to the input operation of the user and stores the related data input by the user. The rectangular boxes corresponding to five options such as age, priority, wind direction preference, temperature preference and humidity preference in the registration interface of the smart home APP can be check boxes, so that the user can complete the setting of the air conditioner use preference information.

After the terminal device stores the relevant data input by the user, the terminal device may display prompt information for prompting the user to take a picture of the face of the user. After the user uses the terminal device to shoot the self face photo, the terminal device can establish a corresponding relation between the self face photo shot by the user and the related data input by the user, and complete the registration process of the user, namely complete the input of the preset air conditioner use preference information of the registered user.

After the terminal device generates the corresponding relation between the self face picture shot by the user and the related data input by the user, the corresponding relation can be sent to the controller through WIFI or Bluetooth.

After receiving the corresponding relationship sent by the terminal device, the controller may perform the processing of the step S10221 and the step S10222 on the self face picture taken by the user included in the corresponding relationship to extract the face feature vector in the self face picture taken by the user, and further store the face feature vector and the identifier of the user in a face information base formed by the controller, so that when the registered user enters a space where an indoor unit is located, the controller may quickly identify the registered user, and efficiency of identifying the registered user is improved.

It can be seen that the foregoing describes the solution provided by the embodiments of the present application primarily from a methodological perspective. In order to implement the functions, the embodiments of the present application provide corresponding hardware structures and/or software modules for performing the respective functions. Those of skill in the art will readily appreciate that the various illustrative modules and algorithm steps described in connection with the embodiments disclosed herein may be implemented as hardware or combinations of hardware and computer software. Whether a function is performed as hardware or computer software drives hardware depends upon the particular application and design constraints imposed on the solution. Skilled artisans may implement the described functionality in varying ways for each particular application, but such implementation decisions should not be interpreted as causing a departure from the scope of the present invention.

In the embodiment of the present application, the controller may be divided into the functional modules according to the above method example, for example, each functional module may be divided corresponding to each function, or two or more functions may be integrated into one processing module. The integrated module can be realized in a hardware mode, and can also be realized in a software functional module mode. Optionally, the division of the modules in the embodiment of the present application is schematic, and is only a logic function division, and there may be another division manner in actual implementation.

As shown in fig. 15, the controller 3000 includes a processor 3001, and optionally, a memory 3002 and a communication interface 3003, which are connected to the processor 3001. The processor 3001, the memory 3002, and the communication interface 3003 are connected by a bus 3004.

The processor 3001 may be a Central Processing Unit (CPU), a general purpose processor Network Processor (NP), a Digital Signal Processor (DSP), a microprocessor, a microcontroller, a Programmable Logic Device (PLD), or any combination thereof. The processor 3001 may also be any other means having processing functionality such as a circuit, device, or software module. The processor 3001 may also include multiple CPUs, and the processor 3001 may be a single-core (single-CPU) processor or a multi-core (multi-CPU) processor. A processor herein may refer to one or more devices, circuits, or processing cores that process data (e.g., computer program instructions).

Memory 3002 may be a read-only memory (ROM) or other type of static storage device that may store static information and instructions, a Random Access Memory (RAM) or other type of dynamic storage device that may store information and instructions, but is not limited to, electrically erasable programmable read-only memory (EEPROM), compact disk read-only memory (CD-ROM) or other optical disk storage, optical disk storage (including compact disk, laser disk, optical disk, digital versatile disk, blu-ray disk, etc.), magnetic disk storage media or other magnetic storage devices, or any other medium that can be used to carry or store desired program code in the form of instructions or data structures and that can be accessed by a computer. The memory 3002 may be separate or integrated with the processor 3001. The memory 3002 may contain, among other things, computer program code. The processor 3001 is configured to execute the computer program code stored in the memory 3002, so as to implement a control method of the air conditioning system provided by the embodiment of the present application.

Communication interface 3003 may be used to communicate with other devices or communication networks (e.g., ethernet, Radio Access Network (RAN), Wireless Local Area Networks (WLAN), etc.). Communication interface 3003 may be a module, circuitry, transceiver, or any device capable of enabling communication.

The bus 3004 may be a Peripheral Component Interconnect (PCI) bus, an Extended Industry Standard Architecture (EISA) bus, or the like. The bus 3004 may be divided into an address bus, a data bus, a control bus, etc. For ease of illustration, only one thick line is shown in FIG. 15, but this is not intended to represent only one bus or type of bus.

An embodiment of the present invention further provides a computer-readable storage medium, where the computer-readable storage medium includes computer-executable instructions, and when the computer-executable instructions run on a computer, the computer is enabled to execute the control method of the air conditioning system provided in the foregoing embodiment.

The embodiment of the present invention further provides a computer program product, which can be directly loaded into the memory and contains software codes, and after the computer program product is loaded and executed by the computer, the control method of the air conditioning system provided by the above embodiment can be implemented.

Those skilled in the art will recognize that, in one or more of the examples described above, the functions described in this invention may be implemented in hardware, software, firmware, or any combination thereof. When implemented in software, the functions may be stored on or transmitted over as one or more instructions or code on a computer-readable medium. Computer-readable media includes both computer storage media and communication media including any medium that facilitates transfer of a computer program from one place to another. A storage media may be any available media that can be accessed by a general purpose or special purpose computer.

Through the above description of the embodiments, it is clear to those skilled in the art that, for convenience and simplicity of description, the foregoing division of the functional modules is merely used as an example, and in practical applications, the above function distribution may be completed by different functional modules according to needs, that is, the internal structure of the device may be divided into different functional modules to complete all or part of the above described functions.

In the several embodiments provided in the present application, it should be understood that the disclosed apparatus and method may be implemented in other ways. For example, the above-described apparatus embodiments are merely illustrative, and for example, the division of the modules or units is only one logical function division, and there may be other division ways in actual implementation. For example, various elements or components may be combined or may be integrated into another device, or some features may be omitted, or not implemented. In addition, the shown or discussed mutual coupling or direct coupling or communication connection may be an indirect coupling or communication connection through some interfaces, devices or units, and may be in an electrical, mechanical or other form. Units described as separate parts may or may not be physically separate, and parts displayed as units may be one physical unit or a plurality of physical units, may be located in one place, or may be distributed to a plurality of different places. Some or all of the units can be selected according to actual needs to achieve the purpose of the solution of the embodiment.

In addition, functional units in the embodiments of the present invention may be integrated into one processing unit, or each unit may exist alone physically, or two or more units are integrated into one unit. The integrated unit may be implemented in the form of hardware, or may also be implemented in the form of a software functional unit. The integrated unit, if implemented in the form of a software functional unit and sold or used as a stand-alone product, may be stored in a readable storage medium. Based on such understanding, the technical solutions of the embodiments of the present application may be essentially or partially contributed to by the prior art, or all or part of the technical solutions may be embodied in the form of a software product, where the software product is stored in a storage medium and includes several instructions to enable a device (which may be a single chip, a chip, or the like) or a processor (processor) to execute all or part of the steps of the method according to the embodiments of the present invention. And the aforementioned storage medium includes: various media capable of storing program codes, such as a U disk, a removable hard disk, a ROM, a RAM, a magnetic disk, or an optical disk.

The above description is only an embodiment of the present application, but the scope of the present application is not limited thereto, and any changes or substitutions within the technical scope of the present disclosure should be covered by the scope of the present application. Therefore, the protection scope of the present application shall be subject to the protection scope of the claims.

Claims

1. An air conditioning system, comprising:

an outdoor unit;

the indoor unit comprises a camera device, and the camera device is used for collecting an image of a space where the indoor unit is located;

a controller connected with the image pickup apparatus, configured to:

acquiring an image of a space where the indoor unit is located through the camera device;

according to the image, identifying a registered user in the space where the indoor unit is located;

under the condition that a plurality of registered users are identified, determining target working parameters of the indoor unit according to preset air conditioner use preference information of each registered user in the plurality of registered users;

and controlling the indoor unit to work according to the target working parameters.

2. The air conditioning system of claim 1, wherein the indoor unit further comprises a distance sensor for detecting a distance between each of the plurality of registered users and the indoor unit;

the controller is configured to determine a target working parameter of the indoor unit according to preset air conditioner use preference information of each of the plurality of registered users, and specifically execute the following steps:

acquiring the distance between each registered user in the plurality of registered users and the indoor unit;

and according to the distance between each registered user in the plurality of registered users and the indoor unit, selecting preset air conditioner use preference information of the registered user closest to the indoor unit, and determining a target working parameter of the indoor unit.

3. The air conditioning system of claim 1, wherein the controller is configured to determine the target operating parameter of the indoor unit according to preset air conditioner usage preference information of each of the plurality of registered users, and specifically perform the following steps:

and determining the target working parameters of the indoor unit according to preset air conditioner use preference information of each registered user in the plurality of registered users on the basis of a principle that a minority obeys a majority.

4. The air conditioning system of claim 1,

the controller is configured to identify a registered user located in a space where the indoor unit is located according to the image, and specifically execute the following steps:

carrying out face detection on the images, and determining at least one face image in the images, wherein each face image corresponds to a human body target;

for each face image in the at least one face image, sequentially performing enhancement processing, feature extraction processing and feature matching processing on the face image to obtain a recognition result of the face image, wherein the recognition result of the face image indicates whether a human body target corresponding to the face image is a registered user;

and determining the registered user in the space where the indoor unit is located according to the recognition result of each face image.

5. The air conditioning system of claim 4,

the controller is configured to perform face detection on the images, determine at least one face image in the images, and specifically execute the following steps:

and inputting the image into a face detection model based on a convolutional neural network to obtain a face detection result, wherein the face detection result is used for indicating at least one face image in the image.

6. The air conditioning system according to claim 4, wherein the enhancement processing includes noise reduction processing and bad point removal processing;

the controller is configured to sequentially perform enhancement processing, feature extraction processing and feature matching processing on the face image to obtain a recognition result of the face image, and specifically execute the following steps:

enhancing the face image to obtain an enhanced face image;

inputting the enhanced face image into a feature extraction model based on a convolutional neural network to obtain a feature extraction result, wherein the feature extraction result is used for indicating feature data in the face image;

and inputting the feature extraction result into a feature matching model based on a convolutional neural network to obtain the recognition result of the face image.

7. A control method of an air conditioning system is characterized by being applied to the air conditioning system, the air conditioning system comprises an indoor unit and an outdoor unit, the indoor unit comprises a camera device, the camera device is used for collecting images of a space where the indoor unit is located, and the method comprises the following steps:

acquiring an image of a space where the indoor unit is located;

8. The method of claim 7, wherein the determining the target operating parameters of the indoor unit according to the preset air conditioner usage preference information of each of the plurality of registered users comprises:

9. The method of claim 7, wherein the determining the target operating parameters of the indoor unit according to the preset air conditioner usage preference information of each of the plurality of registered users comprises:

10. The method of claim 7, wherein the identifying, according to the image, the registered user located in the space where the indoor unit is located comprises: