JP2022142018A - Stain determination system of air conditioner, stain determination method and program - Google Patents

Abstract

To provide an air conditioner stain determination system, a stain determination method and a program which can make a highly accurate stain determination by acquiring an image of an air outlet surely usable for a stain determination even though a camera does not have to be installed in an air conditioner, and is easily used in a general home.SOLUTION: A stain determination system 1 includes an acquisition part 2 for acquiring object information including an object image obtained by imaging an object air outlet of a determination object from a communication terminal 50, a propriety determination part 3 for determining whether the object image can be used for stain determination of the object air outlet, and creating a propriety determination result, a stain determination part 4 for determining a stain state of the object air outlet on the basis of the object image, and creates a stain determination result, and a notification part 5 for notifying result information including the propriety determination result and the stain determination result. If the propriety determination result is appropriate, the stain determination part 4 starts to determine a stain state, and if the propriety determination result is negative, the notification part 5 notifies a guidance to promote reimaging of the object air outlet.SELECTED DRAWING: Figure 1

Description

The present invention relates to an air conditioner pollution determination system, a pollution determination method, and a program for determining the degree of pollution of an air conditioner from an image of a part of the air conditioner, and in particular, to a user, who has taken an image of the air conditioner. The present invention relates to a stain determination system, a stain determination method, and a program for an air conditioner that can reliably acquire an image that can be used for stain determination by notifying the result of determining whether or not an image of an air outlet is appropriate.

The inside of the air conditioner and the air outlet are unsanitary due to the adhesion of dust and the growth of mold. In addition, since contamination is accompanied by discoloration, the user can recognize the need for cleaning by paying attention to the occurrence of discoloration at the air outlet, which is easier to see than the inside of the air conditioner.
However, even if the user finds the discoloration, the user cannot judge the progress of the staining, and often misses the proper timing for cleaning. Therefore, whether the user cleans the air conditioner themselves or asks a professional maintenance company to clean it, even if the progress of contamination takes a lot of time and money, even if it is not necessary to clean it immediately. There was a problem that it was too expensive to ask a specialist to do it.
In order to solve such a problem, techniques have been developed for periodically taking images of the soiled portions of the air conditioner and recognizing the degree of soiling, and inventions have already been disclosed with regard to this technology.

Patent Literature 1 discloses an invention titled "Dirt Information Estimation System" capable of estimating the degree of contamination from now on by taking an image of a drain pan, which is one of the components of an air treatment device.
The invention disclosed in Patent Document 1 includes an imaging unit for imaging the current state of components inside a casing of an air treatment device, and based on the current image data captured by the imaging unit, the components after the current state. and an estimating unit for estimating a situation regarding the degree of contamination of the component, the estimating unit obtaining a feature amount regarding the degree of contamination of the component after the present based on the current image data, and generating estimated image data according to this feature amount. is characterized by creating
In the invention having such features, a drain pan installed at the bottom inside the casing is selected as a component. Also, a camera installed on the inner surface of an inspection lid provided on the side wall of the casing takes an image of the bottom surface of the drain pan automatically at predetermined time intervals or according to operation by a service provider. The image data captured by the camera is then sequentially transmitted to the arithmetic unit, and the arithmetic unit estimates information about the contamination of the drain pan. This estimated dirt information is reported to the user's communication terminal via the network.
Therefore, the user can easily imagine the degree of contamination of the drain pan based on the received information, and easily recognize the importance of maintenance.

Japanese Patent Application Laid-Open No. 2020-139803

In the invention disclosed in Patent Document 1, image data having uniform image quality can be obtained for each image pickup by constantly installing the camera in the air treatment device. However, it is not easy to install a camera in, for example, an air treatment device in a general home, because some models do not have installation space, and remodeling costs and time are required. Therefore, although the invention disclosed in Patent Document 1 can acquire image data having a uniform image quality that can be used for stain determination, it may be difficult to use in general households.

The present invention has been made in response to such conventional circumstances, and it is possible to acquire an image of an air outlet that can be reliably used for contamination determination while eliminating the need to install a camera in an air conditioner. It is an object of the present invention to provide a pollution determination system, a pollution determination method, and a program for an air conditioner, which enables highly accurate pollution determination and is easily used in general households.

In order to achieve the above object, a first invention provides an acquisition unit for acquiring, from a communication terminal, target information including a target image obtained by imaging a target air outlet of a target air conditioner to be determined; A propriety judging unit that judges whether the data can be used to judge whether the target air outlet is defaced and creates adequacy judgment results; and a notification unit for notifying result information including the suitability judgment result and the contamination judgment result. In the case of no, the notification unit notifies of guidance prompting re-imaging of the target outlet.

In the invention having such a configuration, the target image is captured using, for example, a digital camera owned by the user, or a communication terminal with an image capturing function such as a smart phone or a tablet. Also, the acquisition unit acquires the target image from the communication terminal, for example, via a network.
Furthermore, the propriety determination unit determines whether the target image acquired by the acquisition unit can be used for determining whether the target outlet is damaged. Such suitability judgment is based on, for example, when the target image is dark due to lack of light at the time of imaging, when the target image is blurred, and the location of the contamination cannot be specified accurately, or when the imaging direction or imaging range is inappropriate. This is done to prevent the shape of the target outlet from becoming unrecognizable.

When the suitability determination unit determines that the target image can be used to determine the contamination of the target outlet, the notification unit notifies the communication terminal owned by the user of the suitability determination result via, for example, a network, A defacement determination unit starts defacement state determination using the target image.
On the other hand, if it is determined that the target image cannot be used to determine the contamination state of the target outlet, the notification unit sends guidance to the communication terminal owned by the user, for example, via a network to prompt the user to re-image the target outlet. Notice.

Among the above, when the target image can be used for the determination of the stain state in the stain determination unit, for example, the ratio of the area occupied by the stain location in the target outlet in the target image, or the pixel value of the arbitrarily set region of interest from which the degree of fouling is determined. The notification unit notifies the communication terminal owned by the user of such a contamination determination result via, for example, a network.

Next, according to a second invention, in the first invention, a plurality of air outlet images obtained by respectively imaging air outlets of a plurality of air conditioners different in terms of model are generated in association with the corresponding model. A master image storage unit for storing a master image is provided, the target information includes identification information capable of identifying the model of the target air conditioner in addition to the target image, and the propriety determination unit stores a plurality of master images based on the identification information. The corresponding master image corresponding to the target image is extracted from the target image, and the target shape, which is the shape of the target outlet in the target image, is compared with the corresponding master shape, which is the shape of the outlet in the corresponding master image. When the master shapes match, the suitability determination result is judged as acceptable, and when the target shape and the corresponding master shape do not match, the suitability judgment result is rejected.

In the invention having such a configuration, the propriety judging section judges suitability by utilizing the fact that the shape of the outlet of the air conditioner is known for each model of the air conditioner. The identification information that can identify the model of the target air conditioner is, for example, a character string or code displayed on the surface of the housing of the air conditioner and containing the manufacturer's name, serial number, and the like.
In the above-configured invention, in addition to the effects of the first invention, the acquisition unit acquires the identification information capable of identifying the model of the target air conditioner in addition to the target image. A corresponding master image corresponding to the target image is extracted from the master images.

Next, the suitability determination unit compares the target shape of the target outlet in the target image with the corresponding master shape of the outlet in the extracted corresponding master image. As this comparison method, for example, edge detection processing for detecting edges of an object shown in an image is performed to detect a target shape and a corresponding master shape, and compare the two.
As a result of the comparison, if the target shape and the corresponding master shape match, the propriety judging section determines that the propriety judging result is appropriate, so the contamination judging is performed in the contamination judging section. On the other hand, if the target shape and the corresponding master shape do not match, the suitability determination unit rejects the result of the suitability determination.

Furthermore, a third invention is the first or second invention, further comprising a stain classification storage unit for storing stain classifications in which the degree of stain is classified into a plurality of stages, It is characterized in that the contamination state is determined by comparing with the contamination category.
In the invention having such a configuration, in addition to the effects of the first or second invention, since the contamination determination unit determines the contamination state of the target outlet by classifying it into a plurality of stages, the current contamination state are recognized in detail.

Subsequently, according to a fourth aspect of the present invention, an image capturing step of capturing an image of a target outlet of a target air conditioner to be determined, and target information including a target image obtained by capturing the target outlet are acquired from a communication terminal. an acquisition step, a propriety judgment step of judging whether or not the target image can be used for judging the contamination of the target outlet and creating a propriety judgment result, and judging the contamination state of the target outlet based on the target image and a notification step of notifying result information including the suitability judgment result and the contamination judgment result. is started, and if the result of the suitability determination is negative, a notification is sent in the notification step to prompt re-imaging of the target outlet.
The invention having such a configuration has the same effects as those of the first invention.

Furthermore, a fifth invention is a program for causing a computer to execute each step of the pollution determination method for an air conditioner according to the fourth invention. This program includes a communication terminal program installed in a computer used as a communication terminal and a pollution determination system program installed in a computer used as a pollution determination system for an air conditioner.
The invention having such a configuration exerts the effect of the pollution determination method for an air conditioner according to claim 4 . Specifically, the communication terminal program causes the user to perform the imaging process. Further, the contamination determination system program automatically executes the acquisition process, the suitability determination process, the contamination determination process, and the notification process.

According to the first aspect, since the target image is captured using, for example, a communication terminal with an image capturing function owned by the user, there is no need to install a camera in the air conditioner. Therefore, it is easy to use the contamination determination system for air conditioners in general households.
Further, the propriety judging section judges whether or not the target image can be used for the contamination judgment of the target outlet, and only when the propriety judging result is judged to be suitable, the contamination judging section judges whether the target image is damaged by the contamination judging section. Since it is used to determine the state, highly accurate contamination determination is possible.

According to the second invention, in addition to the effects of the first invention, the contamination determination is performed only when the target shape and the corresponding master shape match. judgment is possible. On the other hand, if the target shape and the corresponding master shape do not match, a guidance prompting re-imaging of the target blower outlet is notified, so that a target image for which stain determination can be performed can be reliably obtained.

According to the third invention, in addition to the effects of the first or second invention, the current contamination state of the target air outlet is recognized in detail, so that the user or a professional can grasp the appropriate timing for cleaning. It becomes easier and it becomes easier for a professional to determine the contents of the cleaning.

According to the fourth invention, the same effects as those of the first invention are obtained.

According to the fifth invention, the program automatically executes the processes other than the imaging process among the processes constituting the fourth invention, so that the human burden can be greatly reduced. Also, in the image capturing process, the user only has to perform a simple task of capturing an image using a communication terminal or the like according to the program, so that the user's burden is reduced.
Furthermore, according to the execution of the suitability judgment process and the contamination judgment process by the program, compared with the case where the suitability judgment and the contamination judgment are performed by a person, variations based on human subjectivity in the suitability judgment result and the contamination judgment result can be reduced. can be eliminated and good reproducibility can be obtained.

1 is a configuration diagram of a contamination determination system for an air conditioner according to Embodiment 1. FIG. FIG. 11 is a flowchart of a method for determining contamination of an air conditioner according to a second embodiment; FIG. 10 is a flow diagram of an image quality judgment step in the propriety judgment step that constitutes the contamination judgment method for an air conditioner according to the second embodiment. FIG. 10 is a flow diagram of a shape determination step in the suitability determination process that constitutes the contamination determination method for an air conditioner according to the second embodiment. FIG. 10 is a flowchart of a contamination determination process that constitutes a contamination determination method for an air conditioner according to Embodiment 2;

A configuration of an air conditioner contamination determination system according to a first embodiment of the present invention will be described with reference to FIG. FIG. 1 is a configuration diagram of a contamination determination system for an air conditioner according to a first embodiment.
The contamination determination system 1 for an air conditioner according to the first embodiment (hereinafter referred to as the contamination determination system 1) is owned by a specialist who performs maintenance of air conditioners, and the user cleans the air conditioner by this specialist. It is assumed that when a request is made to a professional trader, the requesting user will be allowed to use a part of the functions of the contamination determination system 1. Further, both the air conditioner and the target air conditioner in the first embodiment are wall-mounted air conditioners installed in ordinary homes and offices, for example.

As shown in FIG. 1 , the contamination determination system 1 according to the first embodiment includes an acquisition unit 2 , an adequacy determination unit 3 , a contamination determination unit 4 , a notification unit 5 and a storage unit 6 . Specifically, the contamination determination system 1 is a personal computer.
Also, the acquisition unit 2 and the notification unit 5 are communication means configured to be able to communicate with the user's communication terminal 50 via the network 51, respectively. Although only one communication terminal 50 is shown in FIG. 1, the contamination determination system 1 can communicate with a plurality of communication terminals 50, respectively.

Next, the contamination determination system 1 incorporates a CPU (Central Processing Unit) 7 . The CPU 7 has a suitability determination section 3 and a contamination determination section 4 as a calculation section. Furthermore, the CPU 7 includes a control section (not shown) capable of controlling the operations of the acquisition section 2 , suitability determination section 3 , contamination determination section 4 , notification section 5 and storage section 6 .

On the other hand, the communication terminal 50 is a portable computer including an imaging unit 50a for capturing a target image, a transmission/reception unit 50b, a storage unit 50c, an operation screen 50d, and a CPU 50e for controlling these operations.
Among these, a communication terminal program for controlling the operation of the communication terminal 50 is stored in the storage section 50c. This communication terminal program is downloaded to the storage unit 50c by the user operating the operation screen 50d of the communication terminal 50 in advance, for example, by requesting the download to the defacement determination system 1 on the homepage of a specialist company, and then communicating. It is installed in a predetermined installation destination folder (not shown) of the terminal 50 .

When the user executes the communication terminal program, a guidance message is displayed on the operation screen 50d to guide the user to capture a target image using the imaging unit 50a and transmit target information including the target image. When the user takes an image and transmits it according to this guidance message, the target information is transmitted from the transmission/reception unit 50b to the acquisition unit 2. FIG. Details of the target information will be described later.
Next, the acquisition unit 2 acquires the target information transmitted from the communication terminal 50 and transmits it to the suitability determination unit 3 . Then, the propriety judging section 3 starts operating, and the contamination judging section 4 and the notifying section 5 respectively start operating according to the propriety judging result. The configuration and operation of the acquisition unit 2 and the like will be described below in order.

First, the acquisition unit 2 will be described in detail. When acquiring the target information from the communication terminal 50, the acquisition unit 2 not only transmits it to the propriety determination unit 3, but also transmits it to the main storage unit 6a of the storage unit 6, which will be described later, for storage. This target information includes a target image of the target outlet taken by the user, identification information that can identify the model of the target air conditioner, and personal information of the user.
Of these, identification information refers to information that can identify the model, such as the manufacturer name and serial number, in addition to the model itself, and is displayed on the surface of the housing of the target air conditioner or written in the instruction manual. Say what you have. In addition to this, the identification information is not particularly limited as long as it is information that can identify the model, and the data format is text data input from the operation screen, character strings in image files, barcodes and two-dimensional codes may be either.
Furthermore, specifically, the target image and the identification information may be collectively included in one image file, or may be separated into separate image files or separate image files and text data.

Next, the suitability determination unit 3 will be described in detail. The propriety determination unit 3 determines whether or not the target image in the target information can be used for determining whether the target outlet is damaged, and creates a propriety determination result.
Further, the suitability determination unit 3 is configured to execute a known processing method capable of reading necessary information from character strings and codes in the image file. Therefore, the propriety determination unit 3 can automatically recognize the model and the like from the identification information including the character strings and codes in the image file among the target information.

Next, when the suitability determination unit 3 determines that the suitability determination result is appropriate, it transmits the suitability determination result to the contamination determination unit 4, the notification unit 5, and the main storage unit 6a.
Then, the contamination determination unit 4 starts determining the contamination state of the target outlet. At the same time, the notification unit 5 transmits the suitability determination result to the communication terminal 50 via the network 51 . The adequacy determination result notified to the communication terminal 50 by the notification unit 5, the contamination determination result described later, and various guidance messages constitute result information. In addition, the notification unit 5 transmits the fact of the notification made by the notification unit 5, its content, and the date and time to the main storage unit 6a for storage.

On the other hand, when the suitability determination unit 3 determines that the suitability determination result is negative, the suitability determination result is transmitted to the notification unit 5 and the main storage unit 6a.
As a result, the notification unit 5 reads out the guidance message for prompting re-imaging of the target air outlet stored in the main storage unit 6 a and notifies the communication terminal 50 of the user via the network 51 . Further, the guidance message for prompting reimaging may be composed of text information, image information and voice information to the effect that reimaging is urged.
Then, the communication terminal 50 displays the guidance message on the operation screen 50d. Following this guidance message, the user takes an image of the target air outlet again and transmits the target information including the target image to the acquisition unit 2 .

Further, the storage unit 6 includes a main storage unit 6a, a master image storage unit 6b, and a soiled classification storage unit 6c. Of these, the main storage unit 6a stores the aforementioned communication terminal program, the defacement determination system program for controlling the operation of the defacement determination system 1, the target information, the suitability determination result of the defacement determination unit 3, and the defacement determination unit 4 Defacement determination result, standard explanatory text used as a message when notification unit 5 notifies, various information generated in the process of suitability determination and defacement determination by propriety determination unit 3 and defacement determination unit 4, respectively, notification unit Store data and programs other than a plurality of master images and defacement categories, such as the facts of the notification made by 5, its contents, date and time.

Also, the master image storage unit 6b stores a plurality of master images. The plurality of master images is a data set created in advance by associating a plurality of air outlet images obtained by respectively imaging air outlets of a plurality of air conditioners of different models with the corresponding model.
Further, the contamination classification storage unit 6c stores contamination classifications in which the degree of contamination is divided into a plurality of stages. As this contamination classification, for example, an image of a fictitious air outlet is assumed in advance, and this assumed image is binarized with a threshold value of pixel values, and the total area of the area having the pixel value below this threshold and the total area of the area exceeding the threshold It is conceivable that it was created using the ratio of
Note that the master image storage unit 6b and the stain classification storage unit 6c may be provided in one computer together with the acquisition unit 2 and the like, or may be provided in a server that can communicate with the acquisition unit 2 and the like via the network 51. FIG.

According to the contamination determination system 1 configured as described above, the target image is captured using the communication terminal 50 owned by the user, so there is no need to install a camera in the air conditioner. Therefore, it is easy to use the contamination determination system 1 in ordinary homes and businesses.
Further, by installing a communication terminal program in the communication terminal 50, it is possible to transmit the target image to the acquisition unit 2 via the network 51 and receive the stain determination result and the stain determination result from the notification unit 5. can. Therefore, the user can operate the communication terminal 50 to easily pick up a target image and browse the stain determination result. Therefore, from this point of view as well, it is easy to use the pollution determination system for air conditioners in ordinary homes and offices.

Furthermore, regardless of whether the suitability determination result of the suitability determination unit 3 is appropriate or not, the user is notified of the suitability determination result via the notification unit 5, so that the user can know in real time whether the target image captured by the user is appropriate. can be done.
Further, when the suitability determination result is negative, the notification unit 5 notifies a guidance message prompting re-imaging of the target outlet, so that the target image for which the stain determination can be performed can be reliably acquired.

Next, the processing steps of the contamination determination method for an air conditioner according to the second embodiment of the present invention will be described with reference to FIG. FIG. 2 is a flowchart of a method for determining contamination of an air conditioner according to the second embodiment. 1 are denoted by the same reference numerals in FIG. 2 as well, and description thereof will be omitted.
As shown in FIG. 2, the pollution determination method 10 for an air conditioner according to the second embodiment (hereinafter referred to as the pollution determination method 10) comprises an imaging process in step S1, an acquisition process in step S2, and a suitability determination in step S3. step, a contamination determination step in step S4, and a notification step in steps S5 and S5'. Furthermore, although illustration is omitted, between the suitability judgment step of step S3 and the notification step of step S5′, and between the contamination judgment step of step S4 and the notification step of step S5, the suitability judgment result and the contamination judgment result are mainly Each has a storage step for storing in the storage unit 6a.
Among these processes, the imaging process of step S<b>1 is executed based on the communication terminal program installed in the communication terminal 50 . Further, the acquisition process of step S2 to the notification process of step S5 are executed based on the defacement determination program installed in the defacement determination system 1. FIG. Each step will be described below in order.

First, the imaging step of step S<b>1 is a step of imaging the target outlet of the target air conditioner, which is the determination target, and is executed by the communication terminal 50 . Specifically, the image capturing step of step S1 includes an image capturing guidance step of step S1-1 in which the communication terminal 50 guides the user to capture an image of the target outlet of the target air conditioner, and is used to perform imaging of the target air outlet according to imaging guidance in step S1-2.

Among these, in the imaging guidance step of step S1-1, the user's communication terminal 50 displays a guidance message on the operation screen 50d to guide the user to transmit the target information.
The operation screen 50d also displays a guide message at the time of imaging, along with sentences of appropriate advice about the imaging direction and imaging range when imaging the target air outlet so that the target image can be compared with a plurality of master images. Alternatively, it is desirable to display a figure or the like indicating the imaging position and imaging range.
Specifically, when each outlet in a plurality of master images to be described later is imaged in a common imaging direction and imaging range, the advice is to request imaging in accordance with this common imaging direction. Or it is good to display figures. In detail, the advice on the common imaging direction is, for example, requesting imaging from the direction in which the innermost surface of the target air outlet and the horizontal louver can be imaged as widely as possible, and the advice on the common imaging range is for the target image. In order to fit within a specific range of the imaging screen, it is conceivable to display on the operation screen 50d a graphic consisting of a frame line designating the imaging range.

Next, in the imaging execution step of step S1-2, the user shoots the target image using the imaging unit 50a according to the guidance message at the time of shooting. Then, the user transmits the target image to the acquiring unit 2 as target information together with identification information, personal information, and the like. After this, the communication terminal 50 may keep displaying another message on the operation screen 50d to guide the user to wait.

Subsequently, in the acquisition step of step S2, the acquisition section 2 acquires the target information transmitted by the user and transmits it to the suitability determination section 3. FIG.
Accordingly, the suitability determination unit 3 executes the suitability determination step of step S3. In this process, the propriety determination unit 3 first associates the target image, the identification information, and the personal information included in the target information to form target related information, and transfers this target related information to the main storage unit 6a for storage. Let
Then, the propriety determination unit 3 cannot specify the damaged portion because the target image in the target-related information is dark due to, for example, insufficient light intensity at the time of imaging, or the image is blurred due to defocus. Also, it is determined whether the shape of the target outlet cannot be recognized because the imaging direction and imaging range are inappropriate.

Of these, the later-described multiple master images stored in the master image storage unit 6b are used for the latter determination regarding the shape of the target outlet. Note that the above two types of determination methods will be described later with reference to FIGS. 3 and 4, respectively.
Then, when the suitability determination unit 3 determines that the target image can identify the soiled portion and the shape of the target outlet can be recognized, the suitability determination result is regarded as appropriate, and the suitability determination result is used as the target related information. Create target eligibility information in association with Then, the suitability determination unit 3 transmits the target suitability information to the defacement determination unit 4 and the main storage unit 6a.

When the object suitability information is transmitted to the defacement determination section 4, the defacement determination section 4 starts executing the defacement determination step of step S4. In this step, the defacement determination unit 4 determines to which of the defacement categories stored in the defacement category storage unit 6c the defacement state of the target outlet in the target image corresponds to the defacement state. Create judgment results.
Furthermore, the defacement determination unit 4 associates the defacement determination result with the target suitability information read from the main storage unit 6a to create target defacement information, and transmits this target defacement information to the notification unit 5 and the main storage unit 6a. . A method of determining the contamination state using this contamination classification will be described later with reference to FIG.
When the target damage information is transmitted to the notification unit 5, the notification unit 5 executes the notification step of step S5 and notifies the communication terminal 50 of the user of the target damage information or the result of the damage determination. Furthermore, the notification unit 5 may notify a message explaining this.

Further, the suitability determination unit 3 may transmit the target suitability information to the notification unit 5 . In this case, the notification unit 5 executes the notification step of step S5, and for example, can notify the user's communication terminal 50 of the target suitability information or suitability determination result and a progress message explaining the progress.
Based on this notification, the communication terminal 50 can display, on the operation screen 50d, a progress message to the effect that the suitability judgment result is suitable and the contamination judgment can be started. Furthermore, in addition to this progress message, the communication terminal 50 may display a message on the operation screen 50d to the effect that the user is requested to wait again until the contamination determination is completed. However, the notification step of step S5 between the suitability determination step of step S3 and the contamination determination step of step S4 may be omitted.

On the other hand, in the propriety judgment step of step S3, the propriety judging unit 3 determines whether the target image (1) cannot identify the soiled location, (2) cannot recognize the shape of the target outlet, or (3) cannot identify the soiled location. If it is determined that it cannot be specified and the shape of the target outlet cannot be recognized, the suitability judgment result is rejected, and the suitability judgment result is associated with the object related information to provide the object suitability information. create. This target suitability information is transmitted to the notification unit 5 and the main storage unit 6a, but does not have to be transmitted to the contamination determination unit 4. FIG. Further, the reason for determination consisting of the above (1) to (3) may be included in the target suitability information.

When the target suitability information is transmitted to the notification unit 5, the notification unit 5 executes the notification step of step S5'. In this process as well, the notification unit 5 notifies the communication terminal 50 of the user of the suitability determination result and a guidance message prompting recapture of the target image, etc., via the network 51 . Based on this notification, the communication terminal 50 executes the imaging guidance process of step S1-1. Then, the communication terminal 50 displays, on the operation screen 50d, a guidance message to the effect that reimaging and retransmission of the target outlet is requested, for example, because the suitability determination result is inappropriate.
Further, in the case where the reason for determination is included in the target suitability information and is transmitted to the notification unit 5, even if an explanatory text explaining why the target image taken by the user is unsuitable is attached to the guidance message prompting re-imaging, etc. good. This explanation can be, for example, any one of (1) to (3) above.
After confirming the guidance message, the user again takes an image of the target outlet and transmits the target information including the target image to the acquiring unit 2 as the imaging execution step of step S1-2. At this time, retransmission of the identification number, user's personal information, etc. may be omitted.

Next, the suitability judgment process of step S3 will be described in detail with reference to FIGS. 3 and 4. FIG. FIG. 3 is a flow chart of an image quality judgment step among the propriety judgment steps constituting the contamination judgment method for an air conditioner according to the second embodiment. FIG. 4 is a flow chart of a shape determination step among the suitability determination steps constituting the contamination determination method for an air conditioner according to the second embodiment. 1 and 2 are denoted by the same reference numerals in FIGS. 3 and 4, and description thereof will be omitted.
As shown in FIGS. 3 and 4, the suitability determination process of step S3 includes an image quality determination process of step S3-1 and a shape determination process of step S3-2.
Further, as shown in FIG. 3, the image quality determination process of step S3-1 includes a brightness determination process of step S3-1-1 and a sharpness determination process of step S3-1-2.

In the brightness determination step of step S3-1-1, the ratio of the total area S _B of regions having brightness less than a threshold to the total area S _W of regions having brightness equal to or greater than a predetermined threshold in the target image is used as an index. , is a step of determining whether or not the target image can be used to determine whether or not the target outlet is defaced.
This is because contamination is recognized as a location where discoloration has occurred at the target air outlet, that is, a location where brightness has decreased on the target image. This is to prevent a decrease in the accuracy of discrimination from a soiled portion due to a decrease in the brightness of a portion where no soiling has occurred.

Specifically, the lightness is given by the brightness value of a pixel after performing a known monochrome binarization process on the target image. When the target image is a color image, the target image may be binarized after being converted into a grayscale image by a known processing method. Also, the total areas S _W and S _B may be calculated by a known processing method.
Furthermore, the target outlet in the target image usually has structures such as vertical louvers and groove structures that are unnecessary for detection of soiled locations. Therefore, before the monochrome binarization process, an erasing step may be performed in which the specialist selects and erases unnecessary structures from the target image.

Therefore, in the brightness determination process of step S3-1-1, the propriety determination unit 3 determines that the ratio (S _B /S _W ) related to the area (hereinafter, (S _B /S _W ) is referred to as the brightness ratio R _L ) is For example, if the lightness is less than or equal to an arbitrarily set brightness judgment value k (where k is a constant of 0.0 or more and 1.0 or less), the amount of light when the target image is captured is not insufficient, and the target image can be used to determine the contamination of the target outlet. Then, the propriety judging section 3 transmits the target image after the monochrome binarization processing, the lightness ratio R _L and the lightness judgment value k as a part of the target propriety information to the main storage section 6a. The sharpness judgment step of 1-2 is executed.
On the other hand, when the lightness ratio _RL exceeds the lightness judgment value k, the amount of light is insufficient when the target image is captured by the propriety determination unit 3, and the target image cannot be used to determine whether the target outlet is damaged. I judge. Then, the propriety judging unit 3 stores the target image after the monochrome binarization processing, the lightness ratio _RL , and the lightness judgment value k as part of the target propriety information in the notification unit 5 and the main storage unit 6a, respectively. After the transmission, the notification unit 5 executes the notification step of step S5'.

Next, in the sharpness determination process of step S3-1-2, when the degree of blurring or camera shake in the target image is within the allowable range, it is determined that the target outlet can be used for contamination determination. is. This is to prevent deterioration in the accuracy of discriminating the soiled portion due to insufficient sharpness of the target image due to blurring or the like.
Specifically, whether or not the target image is sharp is determined by a known processing method capable of performing edge processing on the image and detecting an image including blur or the like.
Therefore, in the sharpness judging process of step S3-1-2, when the suitability judging section 3 judges that the target image is sharp, the judgment result is transmitted to the main storage section 6a as part of the target suitability information. . After that, the propriety judging section 3 executes the shape judging process of step S3-2.
On the other hand, when the suitability determination unit 3 determines that the target image is not sharp, after transmitting this determination result to the main storage unit 6a as a part of the target suitability information, the notification unit 5 performs the notification step of step S5'. to run.

Subsequently, as shown in FIG. 4, the shape determination process of step S3-2 includes a reading process of step S3-2-1, an extraction process of step S3-2-2, and a detection process of step S3-2-3. and a shape comparison step of step S3-2-4.

The reading step of step S3-2-1 is a step in which the propriety determination section 3 reads the target image from the main storage section 6a and reads a plurality of master images from the master image storage section 6b.
Next, the extraction step of step S3-2-2 is a step in which the propriety determination unit 3 extracts a corresponding master image corresponding to the target image from a plurality of master images.
Here, the target image is part of the target-related information, and is associated with identification information that enables the suitability determination unit 3 to identify the model of the target air conditioner. Also, the plurality of master images are created by associating the plurality of air outlet images with the corresponding model of the air conditioner. Therefore, by using the model as an index, it is possible to extract, from a plurality of master images, an image of an air conditioner having a model that matches the model of the target air conditioner shown in the target image, that is, the corresponding master image.

Further, in the detection step of step S3-2-3, the target shape, which is the shape of the target outlet in the target image, and the corresponding master shape, which is the shape of the outlet in the corresponding master image, are detected. As such a shape detection method, for example, a method of detecting an edge forming a rectangle having the maximum area among edges detected by monochrome binarization, or a geometric shape search method are conceivable.
In the former shape detection method, the suitability determination unit 3 recognizes rectangular edge portions detected on the target image and the corresponding master image as the target shape and the corresponding master shape, respectively, and part of the target suitability information. to the main storage unit 6a, the shape comparison step of step S3-2-4 is executed.

Next, the shape comparison step of step S3-2-4 is a step of comparing each detected target shape with the corresponding master shape. The suitability determination unit 3 determines that the suitability determination result is acceptable when the target shape and the corresponding master shape match, and rejects the suitability determination result when the target shape and the corresponding master shape do not match. Note that the shape matches when the target shape on the target image and the corresponding master shape on the corresponding master image are the same including the size, and when the target shape and the corresponding master shape are different in size. It also includes cases in which there is a similarity.

If the suitability determination result is acceptable, the suitability determination unit 3 transmits the suitability determination result to the main storage unit 6a and the contamination determination unit 4 as part of the target suitability information. After that, the contamination determination unit 4 executes the contamination determination process of step S4.
Further, the suitability determination unit 3 may transmit the suitability determination result to the notification unit 5 as part of the target suitability information. In this case, the notification unit 5 notifies the user's communication terminal 50 via the network 51 of a message that, for example, since the suitability judgment result of the target image sent by the user is correct, the contamination judgment is being continued. You may However, such notification may be omitted.
On the other hand, if the suitability determination result is negative, the suitability determination unit 3 transmits the suitability determination result to the main storage unit 6a and the notification unit 5 as part of the target suitability information. Then, the notification part 5 performs the notification process of step S5'.

Further, the contamination determination step of step S4 will be described in detail using FIG.
FIG. 5 is a flow diagram of a contamination determination process that constitutes a contamination determination method for an air conditioner according to the second embodiment. 1 to 4 are denoted by the same reference numerals in FIG. 5 as well, and description thereof will be omitted.
As shown in FIG. 5, the contamination determination process in step S4 includes a brightness ratio reading process in step S4-1 and a contamination comparison process in step S4-2.
The lightness ratio reading step of step S4-1 is the lightness ratio R _L (S _B /S _W , where S _W is the lightness equal to or greater than a predetermined threshold) regarding the area of the target image obtained in the lightness determination step of step S3-1-1. , and _SB is the total area of regions having brightness less than the threshold), and the brightness judgment value k are read from the main memory 6a by the contamination determination section 4. FIG.
However, instead of this step, a new brightness ratio _RL may be obtained by selecting the optimal brightness threshold value for detecting the stain location and subjecting the target image to monochrome binarization processing again.

Next, the contamination comparison step of step S4-2 is a step of judging the contamination state of the target outlet by comparing it with the contamination classifications in which the degree of contamination is divided into a plurality of stages. Specifically, the stain classification is obtained by classifying the lightness ratio _RL below the lightness judgment value k into five stages, and is stored in the stain classification storage section 6c.
Specifically, the division [1] to division [5] of the brightness ratio _RL is [1] 0 when the increase K of the brightness ratio _RL for each division is (k/n, where n is the number of divisions 5). .0 ≤ _RL < K, [2] K ≤ _RL < 2K, [3] 2K ≤ _RL < 3K, [4] 3K ≤ _RL < 4K, [5] 4K ≤ _RL ≤ k, It is That is, it means that the fouling condition worsens as the category [1] changes to the category [5].

Then, the defacement determination unit 4 compares the brightness ratio RL of the target image with the above _defacement categories, and selects one of the categories [1] to [5] to which the brightness ratio _RL of the target image corresponds. This is the contamination judgment result. Then, the defacement determination unit 4 associates the defacement determination result with the target suitability information, and transmits the result to the main storage unit 6a and the notification unit 5 .
Accordingly, when the notification unit 5 transmits the contamination determination result to the communication terminal 50, the communication terminal 50 displays the contamination determination result on the operation screen 50d as a notification step of step S5. Note that the stain determination result displayed on the operation screen 50d is, for example, "not dirty" when the brightness ratio R _L of the target image falls under category [1], and " Slightly dirty, but not enough to clean", if it falls under category [3], "slightly dirty and may be cleaned", if it falls under category [4], "dirty and should be cleaned It is preferable to display sentences that make it easy for the user to understand the contamination condition, such as "Good" and "It is very dirty and needs cleaning" if it falls under category [5].

Further, a cleaning request obtaining step of obtaining a cleaning request from the user may be provided after the user is notified of the contamination determination result. In this process, if the user can transmit to the acquiring unit 2 the date and time of the cleaning work desired by the user to the specialist, and the surrounding information image obtained by the user capturing the surrounding area including the entire target air conditioner, the specialist will be able to can begin preparations for cleaning.

According to the contamination determination method 10 configured as described above, the user can quickly know the contamination state of the target outlet by transmitting the target image or the like. Therefore, there is no need to wait for the visit of a maintenance specialist to know the appropriate timing for cleaning, which is highly convenient for the user.
Also, it is possible for the specialist to save the trouble of going to the user's house just to judge the contamination state. As a result, it is possible to save costs and time before actually starting the cleaning work, so it is possible to improve work efficiency.

Furthermore, by performing a double determination of suitability in step S3-1-1 of brightness determination step and step S3-1-2 of sharpness determination step, it is possible to reliably select target images that can be used for defacement determination. can be done. Therefore, it is possible to prevent defacement determination based on an inappropriate target image, which leads to improvement in the accuracy of defacement determination in the defacement determination step of step S4.
In addition, in the defacement determination step of step S4, defacement determination is performed by comparing the defacement location of the target image with the defacement classification, so that an objective defacement determination result can be obtained rather than a human judgment. Therefore, for example, it is possible to accurately track changes over time in the contamination state of a single target air conditioner, and there is no variation in the contamination determination results among a plurality of target air conditioners, thereby increasing the reliability of the contamination determination results. It is possible.

Then, in each of the suitability judgment step of step S3 and the contamination judgment step of step S4, a message notifying the respective results is displayed on the operation screen 50d of the communication terminal 50, so that the user can perform the suitability judgment and the contamination judgment in real time. can know the status of
Of these, if the guide message for prompting re-imaging notified in the suitability determination step of step S3 is accompanied by an explanation of the reasons for unsuitability of the target image captured by the user, points to note when the user captures the image. can be understood more deeply, it is possible to prevent the repeated capture and transmission of inappropriate target images.
Further, since the result of the contamination determination is notified after the contamination determination step of step S4, the user can recognize the degree of contamination and the appropriate timing of cleaning. Therefore, it is possible to solve the problem of requiring a great deal of time and money due to the progress of contamination, and having to ask a professional to clean even when it is not necessary to clean immediately, which also costs money.

Note that the contamination determination system 1, the contamination determination method 10, and the program according to the present invention are not limited to those shown in the embodiments. For example, in the defacement determination system 1, the defacement classification stored in the defacement classification storage unit 6c may be created using the brightness ratio regarding the pixel value as an index instead of the brightness ratio _RL regarding the area. In this case, the brightness ratio of the pixel values of the region of interest set on the target outlet of the target image (more specifically, the average pixel value of the region of interest on the target outlet to the unpolluted region of interest outside the target outlet) The value obtained by subtracting the average pixel value and dividing it by the average pixel value of the region of interest without staining) is the degree of staining depending on which of the multiple divisions indexed by the brightness ratio for similar pixel values is included. can be determined.
Further, in the image quality determination process of step S3-1, the order of the brightness determination process of step S3-1-1 and the sharpness determination process of step S3-1-2 may be changed. In addition, after a certain period of time has passed since the contamination determination result was transmitted in the notification process of step S5, the notification unit 5 may transmit a guidance message to the communication terminal 50 to guide cleaning of the target outlet. good.
Furthermore, as the contamination determination system 1, a smartphone or a tablet may be used in addition to a personal computer.

INDUSTRIAL APPLICABILITY The present invention can be used as a pollution determination system, a pollution determination method, and a program for determining the degree of pollution of an air conditioner.

1 Defacement determination system 2 Acquisition unit 3 Adequacy determination unit 4 Defacement determination unit 5 Notification unit 6 Storage unit 6a Main storage unit 6b Master image storage unit 6c Defilement classification storage unit 7 CPU 10 Defilement Determination method 50... Communication terminal 50a... Imaging unit 50b... Transmission/reception unit 50c... Storage unit 50d... Operation screen 50e... CPU 51... Network

Claims (5)

an acquisition unit configured to acquire, from a communication terminal, target information including a target image obtained by imaging a target air outlet of a target air conditioner to be determined;
a propriety determination unit that determines whether the target image can be used for determining whether the target outlet is defaced, and creates a propriety determination result;
a contamination determination unit that determines the contamination state of the target outlet based on the target image and creates a contamination determination result;
A notification unit that notifies result information including the suitability determination result and the contamination determination result,
When the suitability determination result is appropriate, the contamination determination unit starts determination of the contamination state,
The contamination determination system for an air conditioner, wherein the notification unit notifies a guide prompting re-imaging of the target air outlet when the suitability determination result is negative. a master image storage unit for storing a plurality of master images generated by associating a plurality of air outlet images obtained by respectively imaging air outlets of a plurality of air conditioners of different types with the corresponding model,
The target information includes, in addition to the target image, identification information capable of identifying the model of the target air conditioner,
The propriety judgment unit
Based on the identification information, a corresponding master image corresponding to the target image is extracted from the plurality of master images, and a target shape, which is the shape of the target outlet in the target image, and the outlet in the corresponding master image. Compare the corresponding master shape, which is the shape of
If the target shape and the corresponding master shape match, the propriety judgment result is considered appropriate,
2. The contamination determination system for an air conditioner according to claim 1, wherein the suitability determination result is rejected when the target shape and the corresponding master shape do not match. a contamination classification storage unit that stores contamination classifications in which the degree of contamination is divided into a plurality of stages;
3. The contamination determination system for an air conditioner according to claim 1, wherein the contamination determination unit determines the contamination state of the target outlet by comparing with the contamination category. an image capturing step of capturing an image of a target air outlet of a target air conditioner to be determined;
an obtaining step of obtaining, from a communication terminal, target information including a target image obtained by imaging the target outlet;
a propriety judgment step of judging whether or not the target image can be used to judge whether the target outlet is defaced, and creating a propriety judgment result;
a contamination determination step of determining the contamination state of the target outlet based on the target image and creating a contamination determination result;
A notification step of notifying result information including the suitability determination result and the contamination determination result,
When the suitability judgment result is suitable, in the contamination judgment step, the judgment of the contamination state is started,
A contamination determination method for an air conditioner, wherein, in the notification step, guidance prompting re-imaging of the target air outlet is notified when the suitability determination result is negative. A program for causing a computer to execute each step of the pollution determination method for an air conditioner according to claim 4.

Images