WO2024082658A1 - Method and system for temperature rise detection of air conditioner - Google Patents

Abstract

The present application relates to the technical field of air conditioners, and discloses a method for temperature rise detection of an air conditioner. The method comprises: obtaining an image comprising an electric appliance element, the electric appliance element being located in an outdoor unit of an air conditioner; performing electric appliance element recognition on the image to obtain a recognized electric appliance element; recognizing a target temperature rise point in the image, wherein the target temperature rise point is a pixel point satisfying a preset condition in the image; and determining the temperature rise condition of the recognized electric appliance element according to the target temperature rise point and the recognized electric appliance element. Therefore, the temperature rise condition of each electric appliance element is detected by means of the image of the electric appliance element in the outdoor unit, so that the temperature rise condition of all electric appliance elements comprised in the image can be detected, thereby improving the coverage rate of temperature rise detection of the electric appliance elements in the outdoor unit. The present application further discloses a system for temperature rise detection of an air conditioner.

Description

Method and system for detecting temperature rise of air conditioner

This application is based on the Chinese patent application with application number 202211267738.5 and application date October 17, 2022, and claims the priority of the Chinese patent application. The entire content of the Chinese patent application is hereby introduced into this application as a reference.

Technical Field

The present application relates to the field of air conditioning technology, for example, to a method and system for detecting temperature rise of an air conditioner.

Background technique

The electrical components in the electrical box of the outdoor unit of the air conditioner will release a lot of heat when working. If the temperature of the electrical components is too high when the outdoor unit is working, the outdoor unit of the air conditioner will not work properly. Therefore, it is necessary to test the temperature rise of the electrical components in the electrical box of the outdoor unit before leaving the factory to ensure that the temperature of the electrical components does not exceed the standard when the air conditioner outdoor unit is in use. At present, the relevant technology is to test the temperature rise of the electrical components of the outdoor unit during operation by bonding thermocouple wires to the electrical components in the electrical box of the outdoor unit.

In the process of implementing the embodiments of the present disclosure, it is found that there are at least the following problems in the related art:

The related technology can only detect the temperature rise of electrical components connected to thermocouple wires. It is difficult to detect the temperature rise of some electrical components that are in special positions, small in size or cannot be connected to thermocouple wires, resulting in low coverage of temperature rise detection of electrical components in outdoor units.

It should be noted that the information disclosed in the above background technology section is only used to enhance the understanding of the background of the present application, and therefore may include information that does not constitute the prior art known to ordinary technicians in the field.

Summary of the invention

In order to provide a basic understanding of some aspects of the disclosed embodiments, a brief summary is given below. The summary is not an extensive review, nor is it intended to identify key/critical components or delineate the scope of protection of these embodiments, but rather serves as a prelude to the detailed description that follows.

The embodiments of the present disclosure provide a method and system for temperature rise detection of an air conditioner, which can improve the coverage of temperature rise detection of electrical components in an outdoor unit.

In some embodiments, the method for detecting temperature rise of an air conditioner includes: acquiring an image containing an electrical component, wherein the electrical component is located in an outdoor unit of the air conditioner; performing electrical component recognition on the image to obtain recognized electrical components; recognizing a target temperature rise point in the image, wherein the target temperature rise point is a pixel point in the image that meets a preset condition; and The temperature rise of the identified electrical component is determined according to the target temperature rise point and the identified electrical component.

In some embodiments, the performing electrical component recognition on the image includes: inputting the image into a preset electrical component recognition model to perform electrical component recognition to obtain recognized electrical components.

In some embodiments, identifying the target temperature rise point in the image includes: inputting the image into a preset temperature recognition model for temperature recognition to obtain the temperature value corresponding to each pixel point on the image; and determining the pixel point corresponding to the temperature value that meets the preset conditions as the target temperature rise point.

In some embodiments, determining the pixel point corresponding to the temperature value satisfying the preset condition as the target temperature rise point includes: determining the pixel point corresponding to the temperature value greater than or equal to the first preset threshold as the target temperature rise point.

In some embodiments, determining the temperature rise of the identified electrical component based on the target temperature rise point and the identified electrical component includes: obtaining a first pixel coordinate and a second pixel coordinate; the first pixel coordinate is the pixel coordinate of the identified electrical component, and the second pixel coordinate is the pixel coordinate of the target temperature rise point; matching each of the first pixel coordinates with each of the second pixel coordinates to obtain a matching result; when the matching result is that the second pixel coordinate matches the first pixel coordinate, determining the temperature rise of the identified electrical component corresponding to the first pixel coordinate according to the temperature value corresponding to the second pixel coordinate.

In some embodiments, the system for detecting temperature rise of an air conditioner includes: a temperature rise monitoring device, configured to obtain an image containing electrical components, wherein the electrical components are located in an outdoor unit of an air conditioner; identifying a target temperature rise point in the image, wherein the target temperature rise point is a pixel point in the image that meets a preset condition; an electrical component identification device, configured to identify electrical components in the image to obtain identified electrical components; and a control device, configured to determine the temperature rise of the identified electrical components based on the target temperature rise point and the identified electrical components.

In some embodiments, the electrical component identification device includes: an electrical component identification module configured to input the image into a preset electrical component identification model to perform electrical component identification and obtain an identified electrical component.

In some embodiments, the temperature rise monitoring device includes: a temperature recognition module, configured to input the image into a preset temperature recognition model for temperature recognition, and obtain the temperature value corresponding to each pixel point on the image; and determine the pixel point corresponding to the temperature value that meets the preset conditions as the target temperature rise point.

In some embodiments, the temperature identification module is configured to determine the pixel points corresponding to the temperature values satisfying the preset conditions as the target temperature rise points in the following manner: determine the pixel points corresponding to the temperature values greater than or equal to the first preset threshold as the target temperature rise points.

In some embodiments, the system for detecting temperature rise of an air conditioner further comprises: a positioning device configured to obtain a first pixel coordinate and a second pixel coordinate; match each of the first pixel coordinates with each of the second pixel coordinates to obtain a matching result; and send the matching result to the control module; wherein the first pixel coordinate is the pixel coordinate of the identified electrical component, and the second pixel coordinate is the pixel coordinate of the target temperature rise point; the control module The device is configured to determine the temperature rise of the identified electrical component corresponding to the first pixel coordinate according to the temperature value corresponding to the second pixel coordinate when the matching result is that the second pixel coordinate matches the first pixel coordinate.

The method and system for detecting the temperature rise of an air conditioner provided by the embodiments of the present disclosure can achieve the following technical effects: by acquiring an image of the electrical components in the outdoor unit of the air conditioner and identifying the acquired image, the electrical components in the image and the target temperature rise points in the image are identified. The temperature rise of the identified electrical components is determined based on the identified electrical components and the target temperature rise points. In this way, the temperature rise of each electrical component is detected through the image of the electrical components in the outdoor unit, and the temperature rise of all electrical components contained in the image can be detected, thereby improving the coverage of temperature rise detection of the electrical components in the outdoor unit.

The above general description and the following description are exemplary and explanatory only and are not intended to limit the present application.

BRIEF DESCRIPTION OF THE DRAWINGS

One or more embodiments are exemplarily described by corresponding drawings, which do not limit the embodiments. Elements with the same reference numerals in the drawings are shown as similar elements, and the drawings do not constitute a scale limitation, and wherein:

FIG1 is a schematic diagram of a method for detecting temperature rise of an air conditioner provided by an embodiment of the present disclosure;

FIG2 is a schematic structural diagram of a temperature rise detection system for an air conditioner provided by an embodiment of the present disclosure;

FIG3 is a schematic diagram of the structure of a temperature rise monitoring device provided in an embodiment of the present disclosure;

FIG4 is a schematic diagram of the structure of an electrical component identification device provided by an embodiment of the present disclosure;

FIG5 is a schematic structural diagram of another temperature rise detection system for an air conditioner provided by an embodiment of the present disclosure;

FIG6 is a schematic diagram of the structure of a positioning device provided in an embodiment of the present disclosure;

FIG. 7 is a schematic diagram of the structure of a control device provided in an embodiment of the present disclosure.

Detailed ways

In order to be able to understand the features and technical contents of the embodiments of the present disclosure in more detail, the implementation of the embodiments of the present disclosure is described in detail below in conjunction with the accompanying drawings. The attached drawings are for reference only and are not used to limit the embodiments of the present disclosure. In the following technical description, for the convenience of explanation, a full understanding of the disclosed embodiments is provided through multiple details. However, one or more embodiments can still be implemented without these details. In other cases, to simplify the drawings, well-known structures and devices can be simplified for display.

The terms "first", "second", etc. in the specification and claims of the embodiments of the present disclosure and the above-mentioned drawings are used to distinguish similar objects, and are not necessarily used to describe a specific order or sequence. It should be understood that the terms used in this way can be interchanged under appropriate circumstances to describe the embodiments of the present disclosure herein. In addition, the terms "including" and "having" are used to distinguish similar objects, and are not necessarily used to describe a specific order or sequence. and any variations thereof, are intended to cover a non-exclusive inclusion.

Unless otherwise stated, the term "plurality" means two or more.

In the embodiment of the present disclosure, the character "/" indicates that the preceding and following objects are in an "or" relationship. For example, A/B indicates: A or B.

The term "and/or" is a description of the association relationship between objects, indicating that three relationships can exist. For example, A and/or B means: A or B, or, A and B.

The term "correspondence" may refer to an association relationship or a binding relationship. The correspondence between A and B means that there is an association relationship or a binding relationship between A and B.

By bonding thermocouple wires to detect the temperature rise of electrical components in the electrical box of the outdoor unit, only the electrical components connected to the thermocouple wires can be detected. It is difficult to perform temperature rise detection on electrical components in special positions, small in size or unable to connect thermocouple wires, resulting in low coverage of temperature rise detection. At the same time, by bonding thermocouple wires to detect temperature rise, it is necessary to arrange thermocouple wires at multiple points, which is cumbersome and labor-intensive, resulting in confusion of thermocouple wires and increased safety hazards. Thermocouple wires may also have poor contact or loose contact, resulting in inaccurate temperature rise detection results. The present application uses an infrared camera to capture images of electrical components in the outdoor unit of the air conditioner, and identifies the electrical components in the image and the target temperature rise points in the image. The temperature rise of the identified electrical components is determined based on the identified electrical components and the target temperature rise points. In this way, the temperature rise of each electrical component is detected by the image of the electrical components in the outdoor unit, and the temperature rise of all electrical components contained in the image can be detected, including the temperature rise of electrical components in some special positions, small in size or unable to connect thermocouple wires. This improves the coverage of temperature rise detection of electrical components in the outdoor unit. At the same time, by detecting the temperature rise of each electrical component through the image of the electrical components in the outdoor unit, there is no need to manually arrange thermocouple wires, which reduces the workload and reduces safety hazards. There is no poor contact or loose contact, and the occurrence of inaccurate temperature rise detection results can be reduced.

The method for detecting temperature rise of an air conditioner provided in the embodiments of the present disclosure is applied to an electronic device, and the electronic device can be connected to the air conditioner, camera, etc. by connecting to the Internet, or can be directly connected to the air conditioner, camera, etc. by Bluetooth, wifi, etc. In some embodiments, the electronic device is, for example, a computer or a server. The camera is, for example, an infrared camera or a thermal imaging camera.

As shown in FIG1 , the embodiment of the present disclosure provides a method for detecting temperature rise of an air conditioner, including:

Step S101, the electronic device acquires an image containing an electrical component, wherein the electrical component is located in an outdoor unit of an air conditioner.

Step S102: the electronic device performs electrical component recognition on the image containing the electrical component to obtain recognized electrical components.

Step S103, the electronic device identifies a target temperature rise point in the image, wherein the target temperature rise point is a pixel point in the image that meets a preset condition.

Step S104: the electronic device determines the temperature rise of the identified electrical component according to the target temperature rise point and the identified electrical component.

The method for detecting temperature rise of an air conditioner provided by the embodiment of the present disclosure is adopted. By acquiring an image of electrical components in an outdoor unit of the air conditioner and identifying the acquired image, the electrical components in the image and the target temperature rise points in the image are identified. The temperature rise of the identified electrical components is determined based on the identified electrical components and the target temperature rise points. In this way, the temperature rise of each electrical component is detected by using the image of the electrical components in the outdoor unit, and the temperature rise of all electrical components contained in the image can be detected, thereby improving the coverage rate of temperature rise detection of the electrical components in the outdoor unit.

Further, the electronic device is connected to a camera, and the electronic device acquires an image containing the electrical component, including: the electronic device acquires the image containing the electrical component through the camera. Optionally, the camera is an infrared camera. Alternatively, the camera is a thermal imaging camera.

In some embodiments, a camera is used to capture images of the interior of the electrical box of the air conditioner outdoor unit to obtain images containing electrical components. The camera is set so that the area captured by the camera can fully cover all electrical components in the electrical box of the air conditioner outdoor unit, so that the captured image can include all electrical components in the electrical box, thereby improving the coverage rate of temperature rise detection of electrical components in the outdoor unit.

In some embodiments, before acquiring an image containing electrical components, it also includes: establishing a pixel coordinate system and an actual coordinate system of the object. Establishing the pixel coordinate system includes: acquiring an initial image of the interior of the electrical box of the air conditioner outdoor unit through a camera. Taking the upper left corner of the initial image as the origin, horizontally to the right is the x-axis, and the x-axis is the horizontal axis. Vertically downward is the y-axis, and the y-axis is the vertical axis, and a pixel coordinate system is established. Among them, the coordinates in the pixel coordinate system are used to characterize the pixel coordinates of the pixel points in the image. Establishing the actual coordinate system of the object includes: taking the upper left corner of the actual object corresponding to the initial image as the origin. Horizontally to the right is the u-axis, and the u-axis is the horizontal axis. Vertically downward is the v-axis, and the v-axis is the vertical axis, and a real object coordinate system is established. Among them, the coordinates in the real object coordinate system are used to characterize the actual coordinates of the object. The u-axis of the real object coordinate system coincides with the x-axis of the pixel coordinate system, and the v-axis of the real object coordinate system coincides with the y-axis of the pixel coordinate system. The pixel coordinate system and the real object coordinate system can be converted into each other.

Optionally, the electronic device performs electrical component recognition on an image containing electrical components, including: the electronic device inputs the image containing electrical components into a preset electrical component recognition model to perform electrical component recognition, and obtains recognized electrical components. In this way, the electrical components in the image are recognized using the electrical component recognition model, and the electrical components in the image can be automatically recognized, which is convenient for detecting the temperature rise of the electrical components.

The electrical component recognition model is obtained by: obtaining a first sample image with a first label, inputting the first sample image into a preset convolutional neural network model for training, and obtaining the electrical component recognition model. The first sample image contains an electrical component. The first label includes the name of the electrical component. Optionally, the first label also includes the pixel coordinates of the electrical component.

In some embodiments, an image containing electrical components is input into a preset electrical component recognition model to perform electrical component recognition, and the electrical components in the image are recognized, and the recognized electrical components in the image are determined as recognized electrical components. The recognized electrical components include the names and pixel coordinates of the recognized electrical components in the image.

In some embodiments, the identified electrical component includes the name of the identified electrical component in the image. The acquired image is processed to obtain the pixel coordinates of each pixel in the image. The pixel coordinates of the identified electrical component are determined according to the pixel coordinates of each pixel in the image and the name of the identified electrical component. The actual coordinates of the identified electrical component are determined using two coordinate systems that can be converted, the pixel coordinate system and the actual coordinate system of the object.

Optionally, the electronic device identifies the target temperature rise point in the image, including: the electronic device inputs the image containing the electrical component into a preset temperature recognition model for temperature recognition, and obtains the temperature value corresponding to each pixel point on the image; and determines the pixel point corresponding to the temperature value that meets the preset condition as the target temperature rise point. In this way, by using the temperature recognition model to perform temperature recognition on the pixel points in the image, the temperature value of each pixel point on the image can be automatically obtained, so as to facilitate the determination of the temperature rise of the identified electrical component according to the target temperature rise point.

The temperature recognition model is obtained by: obtaining a second sample image with a second label, inputting the second sample image into a preset convolutional neural network model for training, and obtaining the temperature recognition model. The second label is the temperature of each pixel in the second sample image.

In some embodiments, the electronic device collects a frame of image containing electrical components through a camera at a preset time interval, identifies the target temperature rise point in each frame of image containing electrical components, and determines the temperature rise of the identified electrical components for each frame of image containing electrical components. In this way, the temperature rise of the electrical components in the electrical box of the outdoor unit can be obtained in real time.

The electronic device inputs each frame of the image containing the electrical components into the preset temperature recognition model for temperature recognition. The feature network in the temperature recognition model extracts features from the important frame images to obtain the depth feature map of the important frame images. The depth feature map of the important frame images is propagated to the non-important frames corresponding to the important frame images by the optical flow method. Among them, the important frame image is the image of the i-th frame containing the electrical components collected, and i is a positive integer. The non-important frame corresponding to the important frame image is the image of the k-th frame containing the electrical components after the important frame image, k=i+x, 1≤x≤12, and x is a positive integer. For example, the feature network extracts features from the first frame of the image containing the electrical components, and then the continuous 12 frames after the first frame are no longer feature extracted, but the depth feature map of the first frame is propagated to the continuous 12 frames after the first frame containing the electrical components. The task network in the temperature recognition model performs temperature recognition on the depth feature map of each frame of the image to obtain the temperature value of each pixel in each frame of the image containing the electrical components. In this way, only the important frames are feature extracted, which reduces the computational complexity of the temperature recognition model, thereby improving the efficiency of temperature rise detection. Among them, the feature network is a fully convolutional network.

Optionally, the electronic device determines a pixel point corresponding to a temperature value satisfying a preset condition as a target temperature rise point, including: the electronic device determines a pixel point corresponding to a temperature value greater than a first preset threshold value as a target temperature rise point.

In some embodiments, the first preset threshold is an ambient temperature value. The temperature rise is the difference between the temperature of the electrical component in the working state and the ambient temperature. The pixel points exceeding the ambient temperature are determined as the target temperature rise points. In this way, the temperature rise of the identified electrical component can be determined based on the pixel points exceeding the ambient temperature and the corresponding temperature values.

Optionally, the electronic device determines the pixel points corresponding to the temperature values that meet the preset conditions as the target temperature rise points, including: the electronic device determines the pixel points corresponding to the temperature values greater than the first preset threshold as the temperature rise points, and determines the temperature rise points with temperature values greater than or equal to the second preset threshold as the target temperature rise points. Among them, the second preset threshold is greater than the first preset threshold. When the air conditioner outdoor unit is working, the electrical components in the electrical box will have a certain temperature rise, but if the temperature of the electrical components exceeds a certain threshold, for example, greater than or equal to the second preset threshold, the electrical components will work abnormally. In this way, the temperature rise of the identified electrical components is determined based on the pixel points with temperature values greater than or equal to the second preset threshold, and the electrical components that are working abnormally among the identified electrical components can be directly determined.

Optionally, the electronic device determines the temperature rise of the identified electrical component according to the target temperature rise point and the identified electrical component, including: the electronic device obtains the first pixel coordinate and the second pixel coordinate, matches each first pixel coordinate with each second pixel coordinate, and obtains a matching result. When the matching result is that the second pixel coordinate matches the first pixel coordinate, the electronic device determines the temperature rise of the identified electrical component corresponding to the first pixel coordinate according to the temperature value corresponding to the second pixel coordinate. Among them, the first pixel coordinate is the pixel coordinate of the identified electrical component, and the second pixel coordinate is the pixel coordinate of the target temperature rise point. By acquiring an image of the electrical components in the outdoor unit of the air conditioner and identifying the acquired image, all the electrical components in the image and the target temperature rise point in the image are identified. Through the matching result of the pixel coordinates of the identified electrical components and the pixel coordinates of the target temperature rise point, the temperature rise of the identified electrical component is determined according to the temperature value of the target temperature rise point. In this way, the temperature rise of all electrical components contained in the image can be detected, and the coverage rate of temperature rise detection of the electrical components in the outdoor unit is improved.

In some embodiments, each identified electrical component in the image corresponds to one or more pixel coordinates. Each second pixel coordinate is matched with the first pixel coordinate of each identified electrical component to obtain a matching result. The matching result includes: there is a second pixel coordinate that matches the first pixel coordinate, or there is no second pixel coordinate that matches the first pixel coordinate. There are one or more second pixel coordinates included in the first pixel coordinate, that is, it is determined that there is a second pixel coordinate that matches the first pixel coordinate. The first pixel coordinate does not include the second pixel coordinate, that is, it is determined that there is no second pixel coordinate that matches the first pixel coordinate.

Optionally, determining the temperature rise of the identified electrical component corresponding to the first pixel coordinate according to the temperature value corresponding to the second pixel coordinate includes: determining the temperature value of the identified electrical component corresponding to the first pixel coordinate according to the temperature value corresponding to the second pixel coordinate, and determining the temperature value of the identified electrical component as the temperature rise of the identified electrical component. In this way, the temperature rise of all electrical components in the image is obtained, and the coverage of temperature rise detection of outdoor unit electrical components is improved.

Optionally, the temperature of the identified electrical component corresponding to the first pixel coordinate is determined according to the temperature value corresponding to the second pixel coordinate. The temperature rise condition includes: determining the temperature value of the identified electrical component corresponding to the first pixel coordinate according to the temperature value corresponding to the second pixel coordinate, and subtracting the temperature value of the identified electrical component from the ambient temperature to obtain the temperature rise condition of the identified electrical component. In this way, the temperature rise condition of all electrical components in the image is obtained, and the coverage rate of temperature rise detection of outdoor unit electrical components is improved.

Optionally, the temperature value of the identified electrical component corresponding to the first pixel coordinate is determined based on the temperature value corresponding to the second pixel coordinate, including: when the first pixel coordinate of the identified electrical component contains multiple second pixel coordinates, the maximum temperature value or the minimum temperature value among the temperature values corresponding to the included second pixel coordinates, or a randomly selected temperature value is used as the temperature value of the identified electrical component corresponding to the first pixel coordinate.

Optionally, the temperature value of the identified electrical component corresponding to the first pixel coordinate is determined based on the temperature value corresponding to the second pixel coordinate, including: when the first pixel coordinate of the identified electrical component contains multiple second pixel coordinates, calculating the average value of the temperature values corresponding to the included second pixel coordinates, and using the average value as the temperature value of the identified electrical component corresponding to the first pixel coordinate.

Optionally, the temperature value of the identified electrical component corresponding to the first pixel coordinate is determined based on the temperature value corresponding to the second pixel coordinate, including: when the first pixel coordinate of the identified electrical component only contains one second pixel coordinate, the temperature value corresponding to the second pixel coordinate is used as the temperature value of the identified electrical component corresponding to the first pixel coordinate.

In some embodiments, when the outdoor unit of the air conditioner is in operation, the camera is used to collect images of the interior of the outdoor unit electrical box to obtain images containing electrical components. Three electrical components, resistors, capacitors and inductors, and 10 target temperature rise points are identified in the image containing electrical components. Among them, the temperature value corresponding to the first target temperature rise point A is 51°C, the temperature value corresponding to the second target temperature rise point B is 53°C, the temperature value corresponding to the third target temperature rise point C is 52°C, the temperature value corresponding to the fourth target temperature rise point D is 53°C, the temperature value corresponding to the fifth target temperature rise point E is 55°C, the temperature value corresponding to the sixth target temperature rise point F is 51°C, the temperature value corresponding to the seventh target temperature rise point G is 52°C, the temperature value corresponding to the eighth target temperature rise point H is 57°C, the temperature value corresponding to the ninth target temperature rise point I is 54°C, and the temperature value corresponding to the tenth target temperature rise point J is 56°C. These 10 target temperature rise points are matched with the pixel coordinates corresponding to the resistors, capacitors and inductors respectively. Among them, the pixel coordinates corresponding to the resistor include the six target temperature rise points A, C, D, F, G, and H. A temperature value can be randomly selected from the temperature values corresponding to the six target temperature rise points as the temperature value of the resistor, such as selecting 53°C corresponding to D as the temperature value of the resistor. The pixel coordinates corresponding to the capacitor include the three target temperature rise points B, E, and J. The maximum temperature value can be selected from the temperature values corresponding to the three target temperature rise points as the temperature value of the resistor, that is, 56°C corresponding to J is used as the temperature value of the capacitor. The pixel coordinates corresponding to the inductor include the target temperature rise point I, so the 54°C corresponding to I is used as the temperature value of the inductor.

Optionally, after determining the temperature rise of the identified electrical component according to the target temperature rise point and the identified electrical component, the method further includes: determining the identified electrical component in the actual object coordinate system according to the pixel coordinates of the identified electrical component. The actual coordinates of the components are determined, and the actual coordinates of the identified electrical components and the temperature rise of the identified electrical components are displayed to the user. In this way, the user can understand the temperature rise of the electrical components of the outdoor unit in real time.

Optionally, the electronic device is provided with a display screen, or the electronic device is connected to a display device. Displaying the actual coordinates of the identified electrical component and the temperature rise of the identified electrical component to the user includes: displaying the actual coordinates of the identified electrical component and the temperature rise of the identified electrical component through the display device. Or, sending the actual coordinates of the identified electrical component and the temperature rise of the identified electrical component to a user terminal. The user terminal includes a smart phone, etc.

As shown in FIG2 , the embodiment of the present disclosure provides a system 1 for detecting temperature rise of an air conditioner, comprising: a temperature rise monitoring device 2, an electrical component identification device 3 and a control device 4. The temperature rise monitoring device 2 is configured to obtain an image containing electrical components, which are located in the outdoor unit of the air conditioner; identify the target temperature rise point in the image, and the target temperature rise point is a pixel point in the image that meets a preset condition. The electrical component identification device 3 is configured to identify the electrical components of the image and obtain the identified electrical components. The control device 4 is configured to determine the temperature rise of the identified electrical components based on the target temperature rise point and the identified electrical components.

The system for detecting temperature rise of an air conditioner provided by the embodiment of the present disclosure is used to obtain an image containing electrical components in the outdoor unit of the air conditioner, perform electrical component identification and temperature identification on the image containing electrical components, and obtain the identified electrical components and the target temperature rise point. The temperature rise of the identified electrical components is determined based on the identified electrical components and the target temperature rise point. In this way, the temperature rise of each electrical component is detected through the image of the electrical components in the outdoor unit, and the temperature rise of all electrical components contained in the image can be detected, thereby improving the coverage of temperature rise detection of the electrical components in the outdoor unit.

As shown in FIG3 , FIG3 is a schematic diagram of the structure of the temperature rise monitoring device 2. The temperature rise monitoring device 2 includes: a camera module 5, a temperature recognition module 7, and a second control unit 6. The second control unit 6 is connected to the camera module 5 and the temperature recognition module 7 respectively, and the camera module 5 is connected to the temperature recognition module 7. The second control unit 6 is connected to the control device 4. The camera module 5 is connected to the electrical component recognition device 3.

The camera module is configured to acquire images containing electrical components. Optionally, the camera module is an infrared camera module. Alternatively, the camera is a thermal imaging camera module.

In some embodiments, a camera module is used to capture images of the interior of the electrical box of the air conditioner outdoor unit to obtain images containing electrical components. The camera module is set so that the area captured by the camera module can fully cover all electrical components in the electrical box of the air conditioner outdoor unit, so that the captured image can include all electrical components in the electrical box, thereby improving the coverage rate of temperature rise detection of electrical components in the outdoor unit.

The camera module sends the acquired image containing the electrical components to the temperature recognition module.

Furthermore, the temperature recognition module is configured to input the image containing the electrical components into a preset temperature recognition model for temperature recognition, and obtain the temperature value corresponding to each pixel point on the image. In this way, the temperature recognition model is used to perform temperature recognition on the pixels in the image, and the temperature value of each pixel on the image can be automatically obtained, so that the temperature rise of the identified electrical components can be determined according to the target temperature rise point.

In some embodiments, the camera module collects an image containing an electrical component at a preset time interval, the temperature recognition module recognizes the target temperature rise point in each image containing an electrical component, and the control device determines the temperature rise of the recognized electrical component for each image containing an electrical component. In this way, the temperature rise of the electrical components in the electrical box of the outdoor unit can be obtained in real time.

The temperature recognition module inputs each frame of the image containing electrical components into the preset temperature recognition model for temperature recognition. The feature network in the temperature recognition model extracts features from the important frame images to obtain the depth feature map of the important frame images. The depth feature map of the important frame images is propagated to the non-important frames corresponding to the important frame images by the optical flow method. Among them, the important frame image is the image of the i-th frame containing electrical components collected, and i is a positive integer. The non-important frame corresponding to the important frame image is the image of the k-th frame containing electrical components after the important frame image, k=i+x, 1≤x≤12, and x is a positive integer. For example, the feature network extracts features from the first frame of the image containing electrical components, and then the continuous 12 frames after the first frame are no longer feature extracted, but the depth feature map of the first frame is propagated to the continuous 12 frames after the first frame containing electrical components. The task network in the temperature recognition model performs temperature recognition on the depth feature map of each frame image to obtain the temperature value of each pixel in each frame of the image containing electrical components. In this way, only feature extraction is performed on the important frames, which reduces the amount of calculation of the temperature recognition model, thereby improving the efficiency of temperature rise detection. Among them, the feature network is a fully convolutional network.

Further, the temperature recognition module is configured to determine the pixel points corresponding to the temperature values satisfying the preset conditions as the target temperature rise points in the following manner: the temperature recognition module determines the pixel points corresponding to the temperature values greater than or equal to the first preset threshold as the target temperature rise points.

In some embodiments, the first preset threshold is an ambient temperature value. The temperature rise is the difference between the temperature of the electrical component in the working state and the ambient temperature. The pixel points exceeding the ambient temperature are determined as the target temperature rise points. In this way, the temperature rise of the identified electrical component can be determined based on the pixel points exceeding the ambient temperature and the corresponding temperature values.

Optionally, the temperature recognition module determines the pixel points corresponding to the temperature values that meet the preset conditions as the target temperature rise points, including: the temperature recognition module determines the pixel points corresponding to the temperature values greater than the first preset threshold as the temperature rise points, and determines the temperature rise points with temperature values greater than or equal to the second preset threshold as the target temperature rise points. Among them, the second preset threshold is greater than the first preset threshold. When the air conditioner outdoor unit is working, the electrical components in the electrical box will have a certain temperature rise, but if the temperature of the electrical components exceeds a certain threshold, for example, greater than or equal to the second preset threshold, the electrical components will work abnormally. In this way, the temperature rise of the identified electrical components is determined based on the pixel points with temperature values greater than or equal to the second preset threshold, so that the electrical components that are working abnormally among the identified electrical components can be directly determined.

As shown in FIG4 , FIG4 is a schematic diagram of the structure of the electrical component identification device 3. The electrical component identification device 3 includes: an electrical component identification module 9 and a third control unit 8. The third control unit 8 is connected to the control device 4. The electrical component identification module 9 is connected to the third control unit 8 and is connected to the camera module 5. The camera module sends the acquired image containing the electrical component to the electrical component identification module of the electrical component identification device.

Furthermore, the electrical component recognition module is configured to input an image containing electrical components into a preset electrical component recognition model to perform electrical component recognition and obtain recognized electrical components. In this way, by using the electrical component recognition model to recognize electrical components in an image, the electrical components in the image can be automatically recognized, which is convenient for detecting the temperature rise of the electrical components.

In some embodiments, the electrical component recognition module inputs an image containing electrical components into a preset electrical component recognition model to perform electrical component recognition, recognizes the electrical components in the image, and determines the recognized electrical components in the image as recognized electrical components. The recognized electrical components include the names and pixel coordinates of the recognized electrical components in the image.

5 , the system for detecting temperature rise of an air conditioner further includes a positioning device 10. The positioning device 10 is connected to the temperature rise monitoring device 2, the electrical component identification device 3 and the control device 4 respectively.

As shown in FIG6 , FIG6 is a schematic diagram of the structure of the positioning device 10. The positioning device 10 includes: a positioning calculation module 11, a pixel coordinate calculation module 12 and a fourth control unit 13. Among them, the fourth control unit 13 is connected to the positioning calculation module 11 and the pixel coordinate calculation module 12. The fourth control unit 13 is connected to the control device 4. The pixel coordinate calculation module 12 is connected to the camera module 5 and the positioning calculation module 11. The positioning calculation module 11 is connected to the electrical component recognition module 9. The camera module sends the acquired image containing the electrical component to the pixel coordinate calculation module of the positioning device.

In some embodiments, the positioning calculation module is configured to establish a pixel coordinate system and an actual coordinate system of the object. The positioning calculation module establishes the pixel coordinate system in the following manner, including: obtaining an initial image of the interior of the electrical box of the air conditioner outdoor unit through the camera module. Taking the upper left corner of the initial image as the origin, horizontally to the right is the x-axis, and the x-axis is the horizontal axis. Vertically downward is the y-axis, and the y-axis is the vertical axis, and a pixel coordinate system is established. Among them, the coordinates in the pixel coordinate system are used to characterize the pixel coordinates of the pixel points in the image. The positioning calculation module establishes the actual coordinate system of the object in the following manner, including: taking the upper left corner of the actual object corresponding to the initial image as the origin. Horizontally to the right is the u-axis, and the u-axis is the horizontal axis. Vertically downward is the v-axis, and the v-axis is the vertical axis, and a real object coordinate system is established. Among them, the coordinates in the real object coordinate system are used to characterize the real coordinates of the object. The u-axis of the real object coordinate system coincides with the x-axis of the pixel coordinate system, and the v-axis of the real object coordinate system coincides with the y-axis of the pixel coordinate system. The pixel coordinate system and the real object coordinate system can be converted into each other.

In some embodiments, the identified electrical component includes the name of the identified electrical component in the image. The electrical component identification module sends the identified electrical component to the positioning calculation module. The pixel coordinate calculation module processes the acquired image to obtain the pixel coordinates of each pixel in the image, and sends the pixel coordinates of each pixel in the image to the positioning calculation module. The positioning calculation module determines the identified electrical component based on the pixel coordinates of each pixel in the image and the name of the identified electrical component. The actual coordinates of the identified electrical components are determined by using the pixel coordinate system and the object's actual coordinate system, two coordinate systems that can be converted.

As shown in FIG. 7 , FIG. 7 is a schematic diagram of the structure of the control device 4, and the control device 4 includes: a control module 14, a data processing module 15, a display module 16, and a first control unit 17. Among them, the first control unit 17 is connected to the control module 14, the data processing module 15, and the display module 16 respectively. The control module 14 is connected to the second control unit 6, the third control unit 8, and the fourth control unit 13. The data processing module 15 is connected to the display module 16.

The control module 14 of the control device sends instructions for controlling the temperature rise monitoring device, the electrical component identification device and the positioning device to start up, respectively, to the second control unit 6 of the temperature rise monitoring device, the third control unit 8 of the electrical component identification device and the fourth control unit 13 of the positioning device.

The data processing module 15 is connected to the temperature identification module 7 and the positioning calculation module 11. The positioning calculation module sends the actual coordinates of the identified electrical components to the data processing module. The temperature identification module sends the identified target temperature rise point and the corresponding temperature value to the data processing module.

The pixel coordinate calculation module of the positioning device is configured to obtain the first pixel coordinate and the second pixel coordinate, and send the first pixel coordinate and the second pixel coordinate to the positioning calculation module. The positioning calculation module matches each first pixel coordinate with each second pixel coordinate, obtains a matching result, and sends the matching result to the control device. Among them, the first pixel coordinate is the pixel coordinate of the identified electrical component, and the second pixel coordinate is the pixel coordinate of the target temperature rise point. The data processing module of the control device is configured to determine the temperature rise of the identified electrical component corresponding to the first pixel coordinate according to the temperature value corresponding to the second pixel coordinate when the matching result is that the second pixel coordinate matches the first pixel coordinate.

In some embodiments, each identified electrical component in the image corresponds to one or more pixel coordinates. The positioning calculation module matches each second pixel coordinate with the first pixel coordinate of each identified electrical component to obtain a matching result. The matching result includes: there is a second pixel coordinate that matches the first pixel coordinate, or there is no second pixel coordinate that matches the first pixel coordinate. There are one or more second pixel coordinates included in the first pixel coordinate, that is, it is determined that there is a second pixel coordinate that matches the first pixel coordinate. The first pixel coordinate does not include the second pixel coordinate, that is, it is determined that there is no second pixel coordinate that matches the first pixel coordinate.

Optionally, the data processing module determines the temperature rise of the identified electrical component corresponding to the first pixel coordinate according to the temperature value corresponding to the second pixel coordinate in the following manner, including: determining the temperature value of the identified electrical component corresponding to the first pixel coordinate according to the temperature value corresponding to the second pixel coordinate, and determining the temperature value of the identified electrical component as the temperature rise of the identified electrical component. In this way, the temperature rise of all electrical components in the image is obtained, and the coverage of temperature rise detection of outdoor unit electrical components is improved.

Optionally, the data processing module determines the temperature rise of the identified electrical component corresponding to the first pixel coordinate according to the temperature value corresponding to the second pixel coordinate in the following manner, including: determining the temperature rise of the identified electrical component corresponding to the first pixel coordinate according to the temperature value corresponding to the second pixel coordinate The temperature value of the identified electrical component corresponding to the pixel coordinate is obtained by subtracting the temperature value of the identified electrical component from the ambient temperature to obtain the temperature rise of the identified electrical component. In this way, the temperature rise of all electrical components in the image is obtained, and the coverage of temperature rise detection of outdoor unit electrical components is improved.

Optionally, the data processing module determines the temperature value of the identified electrical component corresponding to the first pixel coordinate based on the temperature value corresponding to the second pixel coordinate in the following manner, including: when the first pixel coordinate of the identified electrical component contains multiple second pixel coordinates, the maximum temperature value or the minimum temperature value among the temperature values corresponding to the included second pixel coordinates, or a randomly selected temperature value as the temperature value of the identified electrical component corresponding to the first pixel coordinate.

Optionally, the data processing module determines the temperature value of the identified electrical component corresponding to the first pixel coordinate based on the temperature value corresponding to the second pixel coordinate in the following manner, including: when the first pixel coordinate of the identified electrical component contains multiple second pixel coordinates, calculating the average value of the temperature values corresponding to the included second pixel coordinates, and using the average value as the temperature value of the identified electrical component corresponding to the first pixel coordinate.

Optionally, the data processing module determines the temperature value of the identified electrical component corresponding to the first pixel coordinate based on the temperature value corresponding to the second pixel coordinate in the following manner, including: when the first pixel coordinate of the identified electrical component contains only one second pixel coordinate, the temperature value corresponding to the second pixel coordinate is used as the temperature value of the identified electrical component corresponding to the first pixel coordinate.

Optionally, the data processing module sends the actual coordinates of the identified electrical component and the temperature rise of the identified electrical component to the display module. The display module is configured to display the actual coordinates of the identified electrical component and the temperature rise of the identified electrical component.

Optionally, the system for detecting temperature rise of an air conditioner further comprises: a power supply device and a communication device. The power supply device is configured to supply power to the system for detecting temperature rise of the air conditioner. The communication device is configured to realize communication connection among the temperature rise monitoring device, the positioning device, the electrical component identification device and the control device.

In some embodiments, when the air conditioner outdoor unit is in operation, the user sends a control instruction to the second control unit of the temperature rise monitoring device through the control module, and the second control unit controls the camera module to collect images and sends the image containing the electrical components to the temperature recognition module, electrical component recognition device and positioning device of the temperature rise monitoring device. The temperature recognition module of the temperature rise monitoring device uses a pre-trained convolutional neural network to perform temperature recognition on the image containing the electrical components to obtain the target temperature rise point. The target temperature rise point and the corresponding temperature value are sent to the control device and the positioning device. The electrical component recognition device performs electrical component recognition on the image containing the electrical components to obtain the recognized electrical components. The recognized electrical components are sent to the positioning device and the control device. The pixel coordinate calculation module of the positioning device obtains the pixel coordinates of each pixel in the image containing the electrical components. The pixel coordinates of each pixel in the image are sent to the positioning calculation module. The positioning calculation module of the positioning device determines the pixel coordinates of the recognized electrical components based on the recognized electrical components and the pixel coordinates of each pixel in the image. The positioning calculation module of the positioning device determines the pixel coordinates of the recognized electrical components based on the target temperature rise point and the pixel coordinates of each pixel in the image. The pixel coordinates of the target temperature rise point are determined by the pixel coordinates of the identified electrical component. The positioning calculation module matches the pixel coordinates of the target temperature rise point and sends the matching result to the control device. When the data processing module of the control device receives the matching result that the pixel coordinates of the electrical component match the pixel coordinates of the target temperature rise point, it determines the temperature rise of the identified electrical component according to the temperature value corresponding to the pixel coordinates of the target temperature rise point, and sends the temperature value of the identified electrical component to the display module for display. In this way, the temperature rise of each electrical component is detected through the image of the electrical component in the outdoor unit, and the temperature rise of all electrical components contained in the image can be detected, thereby improving the coverage rate of temperature rise detection of the electrical components in the outdoor unit.

The embodiment of the present disclosure provides a computer program, which, when executed by a computer, enables the computer to implement the above-mentioned method for detecting temperature rise of an air conditioner.

An embodiment of the present disclosure provides a computer program product, which includes computer instructions stored on a computer-readable storage medium. When the program instructions are executed by a computer, the computer implements the above-mentioned method for detecting temperature rise of an air conditioner.

The above description and the accompanying drawings fully illustrate the embodiments of the present disclosure so that those skilled in the art can practice them. Other embodiments may include structural, logical, electrical, process and other changes. The embodiments represent only possible changes. Unless explicitly required, individual components and functions are optional, and the order of operations may vary. Parts and features of some embodiments may be included in or replace parts and features of other embodiments. Moreover, the words used in this application are only used to describe the embodiments and are not used to limit the claims. As used in the description of the embodiments and the claims, unless the context clearly indicates otherwise, the singular forms "a", "an" and "the" are intended to include plural forms as well. Similarly, the term "and/or" as used in this application refers to any and all possible combinations of one or more associated listings. In addition, when used in this application, the term "comprise" and its variants "comprises" and/or including (comprising) refer to the existence of stated features, wholes, steps, operations, elements, and/or components, but do not exclude the existence or addition of one or more other features, wholes, steps, operations, elements, components and/or these groups. In the absence of further restrictions, the elements defined by the sentence "comprising a ..." do not exclude the existence of other identical elements in the process, method or device comprising the elements. In this article, each embodiment may focus on the differences from other embodiments, and the same or similar parts between the embodiments may refer to each other. For the methods, products, etc. disclosed in the embodiments, if they correspond to the method part disclosed in the embodiments, then the relevant parts can refer to the description of the method part.

Those skilled in the art will appreciate that the units and algorithm steps of each example described in conjunction with the embodiments disclosed herein can be implemented in electronic hardware, or a combination of computer software and electronic hardware. Whether these functions are performed in hardware or software may depend on the specific application and design constraints of the technical solution. The technicians may use different methods to implement the described functions for each specific application, but such implementation should not be considered beyond the scope of this document. The technical personnel can clearly understand that for the convenience and brevity of description, the specific working processes of the above-described systems, devices and units can refer to the corresponding processes in the aforementioned method embodiments, and will not be repeated here.

The flowcharts and block diagrams in the accompanying drawings show the possible architecture, functions and operations of the system, method and computer program product according to the embodiments of the present disclosure. In this regard, each box in the flowchart or block diagram can represent a module, a program segment or a part of a code, and the module, the program segment or a part of the code contains one or more executable instructions for implementing the specified logical function. In some alternative implementations, the functions marked in the box can also occur in an order different from that marked in the accompanying drawings. For example, two consecutive boxes can actually be executed substantially in parallel, and they can sometimes be executed in the opposite order, which can depend on the functions involved. In the descriptions corresponding to the flowcharts and block diagrams in the accompanying drawings, the operations or steps corresponding to different boxes can also occur in an order different from that disclosed in the description, and sometimes there is no specific order between different operations or steps. For example, two consecutive operations or steps can actually be executed substantially in parallel, and they can sometimes be executed in the opposite order, which can depend on the functions involved. Each box in the block diagram and/or flowchart, and the combination of boxes in the block diagram and/or flowchart can be implemented with a dedicated hardware-based system that performs a specified function or action, or can be implemented with a combination of dedicated hardware and computer instructions.

Claims (12)

1. A method for detecting temperature rise of an air conditioner, characterized by comprising:

   Acquire an image containing an electrical component, wherein the electrical component is located in an outdoor unit of an air conditioner;

   Performing electrical component recognition on the image to obtain recognized electrical components;

   Identifying a target temperature rise point in the image, wherein the target temperature rise point is a pixel point in the image that meets a preset condition;

   The temperature rise of the identified electrical component is determined according to the target temperature rise point and the identified electrical component.
2. The method according to claim 1, characterized in that the step of performing electrical component recognition on the image comprises:

   The image is input into a preset electrical component recognition model to perform electrical component recognition to obtain recognized electrical components.
3. The method according to claim 1 or 2, characterized in that the identifying the target temperature rise point in the image comprises:

   Input the image into a preset temperature recognition model for temperature recognition, and obtain the temperature value corresponding to each pixel point on the image;

   The pixel point corresponding to the temperature value that meets the preset conditions is determined as the target temperature rise point.
4. The method according to claim 3 is characterized in that determining the pixel point corresponding to the temperature value that meets the preset condition as the target temperature rise point comprises:

   The pixel point corresponding to the temperature value greater than the first preset threshold is determined as the target temperature rise point.
5. The method according to claim 3, characterized in that the step of determining the temperature rise of the identified electrical component according to the target temperature rise point and the identified electrical component comprises:

   Acquire a first pixel coordinate and a second pixel coordinate; the first pixel coordinate is the pixel coordinate of the identified electrical component, and the second pixel coordinate is the pixel coordinate of the target temperature rise point;

   Matching each of the first pixel coordinates with each of the second pixel coordinates to obtain a matching result;

   When the matching result is that the second pixel coordinate matches the first pixel coordinate, the temperature rise of the identified electrical component corresponding to the first pixel coordinate is determined according to the temperature value corresponding to the second pixel coordinate.
6. A system for detecting temperature rise of an air conditioner, characterized by comprising:

   The temperature rise monitoring device is configured to obtain an image containing an electrical component, wherein the electrical component is located in an outdoor unit of an air conditioner; identify a target temperature rise point in the image, wherein the target temperature rise point is a pixel point in the image that meets a preset condition;

   The electrical component recognition device is configured to recognize the electrical components of the image and obtain the recognized electrical components. Item;

   The control device is configured to determine the temperature rise of the identified electrical component based on the target temperature rise point and the identified electrical component.
7. The system according to claim 6 is characterized in that the electrical component identification device comprises: an electrical component identification module configured to input the image into a preset electrical component identification model to perform electrical component identification and obtain an identified electrical component.
8. The system according to claim 6 or 7 is characterized in that the temperature rise monitoring device comprises: a temperature recognition module configured to input the image into a preset temperature recognition model for temperature recognition, and obtain a temperature value corresponding to each pixel point on the image;

   The pixel point corresponding to the temperature value that meets the preset conditions is determined as the target temperature rise point.
9. The system according to claim 8, characterized in that the temperature recognition module is configured to determine the pixel point corresponding to the temperature value that meets the preset condition as the target temperature rise point in the following manner:

   The pixel point corresponding to the temperature value greater than or equal to the first preset threshold is determined as the target temperature rise point.
10. The system according to claim 8, further comprising:

    A positioning device, configured to obtain a first pixel coordinate and a second pixel coordinate; match each of the first pixel coordinates with each of the second pixel coordinates to obtain a matching result; and send the matching result to the control device; wherein the first pixel coordinate is the pixel coordinate of the identified electrical component, and the second pixel coordinate is the pixel coordinate of the target temperature rise point;

    The control device is configured to determine the temperature rise of the identified electrical component corresponding to the first pixel coordinate according to the temperature value corresponding to the second pixel coordinate when the matching result is that the second pixel coordinate matches the first pixel coordinate.
11. A computer program, when executed by a computer, enables the computer to implement the method for detecting temperature rise of an air conditioner as claimed in any one of claims 1 to 5.
12. A computer program product, comprising computer instructions stored on a computer-readable storage medium, wherein when the program instructions are executed by a computer, the computer implements the method for detecting temperature rise of an air conditioner as described in any one of claims 1 to 5.