WO2024071259A1

WO2024071259A1 - Program, information processing method, information processing device, and display device

Info

Publication number: WO2024071259A1
Application number: PCT/JP2023/035292
Authority: WO
Inventors: 寛子樫本
Original assignee: ダイキン工業株式会社
Priority date: 2022-09-27
Filing date: 2023-09-27
Publication date: 2024-04-04
Also published as: JP2024048396A

Abstract

A program according to the first embodiment of the present disclosure acquires an indoor image of a room, recognizes objects in the acquired indoor image, and identifies an installation area for an air conditioner on the basis of the recognized objects. The objects include wall surfaces, ceiling surfaces, electrical outlets, pipe openings, curtain rails, sprinklers, or fire alarms. The program identifies the installation area on the basis of the positional relationship of the objects and the size of the air conditioner.

Description

PROGRAM, INFORMATION PROCESSING METHOD, INFORMATION PROCESSING APPARATUS AND DISPLAY D

This technology relates to a program, an information processing method, an information processing device, and a display device.

　Conventionally, devices have been proposed that determine whether or not equipment can be installed based on images of a space. For example, the device described in Patent Document 1 determines whether or not a gas meter can be installed in a new space based on image information obtained by capturing an image of the gas meter installation site.

JP 2021-124353 A

The device described in Patent Document 1 determines whether or not a gas meter can be installed based on the size and shape of the physical space within the space, so it cannot be applied to identifying the installation area of an air conditioner, which cannot be installed unless a wide range of installation conditions are met. Therefore, in order to identify the installation area of the air conditioner, a contractor with specialized knowledge must actually visit the installation site (the room or other space that includes the installation area), which is inefficient.

This disclosure has been made in light of these circumstances, and aims to provide a program etc. that can efficiently identify the installation area of an air conditioner.

The program according to the first aspect of the present disclosure acquires an image of the room, recognizes objects in the acquired image, and identifies the installation area of the air conditioner based on the recognized objects.

According to the present disclosure, a user can identify the installation area of an air conditioner simply by taking an image of the room, making it possible to efficiently identify the installation area of the air conditioner.

The program according to the second aspect of the present disclosure is the program according to the first aspect, in which the object includes a wall surface, a ceiling surface, an electrical outlet, a pipe opening, a curtain rail, a sprinkler, or a fire alarm.

According to the present disclosure, it is possible to identify the installation area based on the positions of objects present in the room.

The program according to the third aspect of the present disclosure is a program according to the first or second aspect, and identifies the installation area based on the positional relationship of the objects and the size of the air conditioner.

According to this disclosure, it is possible to identify a position in the installation area that does not interfere with the object.

The program according to the fourth aspect of the present disclosure is the program according to the second or third aspect, and identifies the installation area based on the distance from the outlet or curtain rail and the size of the air conditioner.

According to this disclosure, if there are conditions regarding the distance from the electrical outlet and the distance to the curtain rail when installing an air conditioner, it is possible to identify a location that meets the conditions as the installation area.

The program according to the fifth aspect of the present disclosure is a program according to any one of the first to fourth aspects, and displays the installation area of the air conditioner superimposed on the indoor image.

According to this disclosure, the user can visually grasp the installation area in which an air conditioner can be installed.

The program according to the sixth aspect of the present disclosure is a program according to any one of the first to fifth aspects, and displays an air conditioner image showing the external appearance of the air conditioner superimposed on the identified installation area in the indoor image.

According to this disclosure, it is possible to provide the user with an image of what the air conditioner will look like when actually installed in the installation area.

The program according to the seventh aspect of the present disclosure is a program according to the sixth aspect, which receives an input of movement of the air conditioner image in the indoor image, and outputs information about the interfering object if the position of the air conditioner after the movement according to the received input is in a position that interferes with the object.

According to the present disclosure, if the location where a user wishes to install an air conditioner is one where installation is impossible because the air conditioner would interfere with an object, it is possible to notify the user of the reason why installation is impossible.

The program according to the eighth aspect of the present disclosure is a program according to the sixth aspect, which outputs the range of a movable area around the installation area in which the air conditioner does not interfere with the object, and receives input for movement of the air conditioner image in the indoor image based on the movable area.

According to the present disclosure, if a user does not wish to install an air conditioner in the output installation area, the user can select a location to install the air conditioner within the range of the area that does not interfere with objects.

The program according to the ninth aspect of the present disclosure is a program according to any one of the first to eighth aspects, and outputs information requesting re-imaging if the installation area cannot be identified within the indoor image.

According to the present disclosure, if there is no installation area in which an air conditioner can be installed within the acquired indoor image, it is possible to acquire an indoor image that captures another position within the room.

The program according to the tenth aspect of the present disclosure is a program according to any one of the first to ninth aspects, and identifies an area in the installation area where the inclination angle of the drain pipe of the air conditioner is within a standard value.

According to this disclosure, if there are conditions regarding the angle of the drain pipe that drains water from the air conditioner, it is possible to identify a location that meets the conditions in the installation area.

The program according to an eleventh aspect of the present disclosure is a program according to any one of the first to tenth aspects, which accepts modifications to the recognized object and identifies the installation area based on the modified object.

According to the present disclosure, when an object that does not affect the installation of an air conditioner, such as a removable object, is detected, it is possible to identify the installation area without taking the object into consideration.

The program according to the twelfth aspect of the present disclosure is a program according to any one of the second to eleventh aspects, and when the pipe outlet is recognized, the installation area is identified on the pipe outlet.

According to this disclosure, since it is desirable to install the air conditioner on the pipe outlet, it is possible to identify a more appropriate location in the installation area.

The program according to the thirteenth aspect of the present disclosure is a program according to any one of the second to eleventh aspects, and if the installation area cannot be identified on the pipe opening, identifies the installation area on the wall surface within a predetermined distance from the pipe opening.

According to this disclosure, if there are conditions regarding the distance from the pipe outlet when installing an air conditioner, it is possible to identify a location that meets the conditions as the installation area.

The program according to the fourteenth aspect of the present disclosure is a program according to any one of the first to thirteenth aspects, which acquires architectural drawing data of a target building having the room, and identifies the installation area based on the acquired architectural drawing data and the object.

According to the present disclosure, it is possible to identify the installation area based on the internal structure of the wall, making it possible to identify the most desirable location for installing the air conditioner as the installation area.

The program according to the fifteenth aspect of the present disclosure is a program according to any one of the first to fourteenth aspects, in which the object includes furniture, fixtures, or equipment.

The program according to the sixteenth aspect of the present disclosure is a program according to any one of the first to fifteenth aspects, and selects the model of the air conditioner to be installed based on the size of the room, the shape of the room, or the performance of the air conditioner.

According to this disclosure, it is possible to suggest to the user the model of air conditioner that is suitable for the room including the installation area.

The program according to the seventeenth aspect of the present disclosure is a program according to any one of the second to sixteenth aspects, and selects the model of the air conditioner to be installed based on the recognized size of the pipe opening.

According to this disclosure, if there are requirements regarding the size of the pipe opening through which the piping passes when installing an air conditioner, it is possible to suggest to the user an air conditioner model that meets the requirements.

An information processing method according to one aspect of the present disclosure acquires an indoor image of a room, recognizes objects in the acquired indoor image, and identifies the installation area of an air conditioner based on the recognized objects.

An information processing device according to one aspect of the present disclosure includes a control unit that acquires an image of the interior of a room, recognizes objects in the acquired image of the room, and identifies an installation area of an air conditioner based on the recognized objects.

A display device according to one aspect of the present disclosure obtains information about the possible installation range of an air conditioner that is identified based on an image of the room and an object recognized in the image, and displays the possible installation range superimposed on the image.

According to this disclosure, it is possible to present to the user the area in which an air conditioner can be installed.

The display device according to one embodiment of the present disclosure acquires information relating to an air conditioner image showing the external appearance of the air conditioner, and displays the air conditioner image superimposed on the possible installation area.

This disclosure allows users to imagine what an air conditioner would look like when installed, which can increase their desire to purchase.

The program according to one aspect of the present disclosure makes it possible to efficiently identify the area in which the air conditioner is installed.

1 is an explanatory diagram showing the configuration of an air-conditioner installation area identification system according to a first embodiment; 1 is a block diagram showing an example of the configuration of an information processing device according to a first embodiment; FIG. 2 is a block diagram showing a configuration example of a user terminal according to the first embodiment. FIG. 4 is an explanatory diagram illustrating an example of a model table according to the first embodiment. FIG. 11 is an explanatory diagram illustrating an example of an input acceptance screen for a model according to the first embodiment. FIG. 4 is an explanatory diagram showing an example of a display screen of an indoor image according to the first embodiment. FIG. 2 is an explanatory diagram illustrating an example of an object detection model according to the first embodiment. 6 is a flowchart illustrating an example of processing by a control unit of the information processing device according to the first embodiment. 11 is a flowchart illustrating an example of an installation area specification process according to the first embodiment. FIG. 11 is an explanatory diagram illustrating an example of a model table according to the second embodiment. FIG. 11 is an explanatory diagram showing a room information input acceptance screen according to the second embodiment. FIG. 11 is an explanatory diagram showing an example of a display screen of an indoor image according to the second embodiment. 10 is a flowchart illustrating an example of processing by a control unit of an information processing device according to a second embodiment. FIG. 13 is an explanatory diagram showing an example of a display screen of an indoor image according to the third embodiment. 13 is a flowchart illustrating an example of processing by a control unit of an information processing device according to a third embodiment. FIG. 13 is a block diagram showing a configuration example of a user terminal according to a fourth embodiment. FIG. 2 is an explanatory diagram showing an example of architectural drawing data. FIG. 2 is an explanatory diagram showing an input screen for architectural drawing data; FIG. 13 is an explanatory diagram showing an example of a display screen of an indoor image according to the fourth embodiment. FIG. 13 is an explanatory diagram showing an example of a display screen of an indoor image according to the fourth embodiment. 13 is a flowchart illustrating an example of processing by a control unit of an information processing device according to a fourth embodiment. FIG. 13 is an explanatory diagram showing an example of an object detection result display screen according to the fifth embodiment. 13 is a flowchart illustrating an example of processing by a control unit of an information processing device according to embodiment 5. FIG. 23 is an explanatory diagram illustrating an example of an object detection model according to the sixth embodiment. FIG. 13 is an explanatory diagram showing an installation area display screen according to the sixth embodiment. FIG. 13 is a block diagram showing a configuration example of a user terminal according to a seventh embodiment. FIG. 13 is an explanatory diagram showing an example of a display screen of an indoor image according to the seventh embodiment. 13 is a flowchart illustrating an example of processing by a terminal control unit of a user terminal according to embodiment 7. FIG. 23 is an explanatory diagram showing an object input screen according to an eighth embodiment. 13 is a flowchart illustrating an example of processing by a control unit of an information processing device according to an eighth embodiment. FIG. 13 is a block diagram showing an example of the configuration of an information processing device according to a ninth embodiment. FIG. 23 is an explanatory diagram showing an example of an object condition table according to the ninth embodiment. 23 is a flowchart illustrating an example of an installation area specification process according to a ninth embodiment.

(Embodiment 1)
FIG. 1 is an explanatory diagram showing the configuration of an air conditioner installation area specification system S according to the first embodiment. The air conditioner installation area specification system S includes an information processing device 1 and a user terminal 2. The information processing device 1 can communicate with the user terminal 2 via a network N using wide-area wireless communication. The user terminal 2 is a terminal owned by a user who is considering purchasing or leasing an air conditioner, and takes an image (indoor image) of the room including the location where the user is considering installing the air conditioner, and accepts input of the model of the air conditioner that the user is considering installing. In addition, the user terminal 2 transmits the model of the air conditioner that has been input and the captured indoor image to the information processing device 1 via the network N. The information processing device 1 specifies an area (installation area) in which the air conditioner can be installed based on the received indoor image and the dimensions of the model of the air conditioner, and transmits the specified installation area and an AR (Augmented Reality) image of the air conditioner. The user terminal 2 displays the specified installation area and the AR image received from the information processing device 1 superimposed on the indoor image and shows it to the user. In this embodiment, the following description will be given assuming that the air conditioner refers to a wall-mounted air conditioner. Note that a part or all of the processing of the information processing device 1 according to the present embodiment and the following embodiments may be executed by the user terminal 2. Furthermore, the information stored in the information processing device 1 according to the present embodiment and the following embodiments may be stored in the user terminal 2.

FIG. 2 is a block diagram showing an example of the configuration of the information processing device 1 according to the first embodiment. The information processing device 1 is, for example, a server computer, and includes a control unit 11, a storage unit 12, and a communication unit 13. The control unit 11 is configured with a CPU (Central Processing Unit), an MPU (Micro Processing Unit), a GPU (Graphical Processing Unit), a quantum processor, or the like, and performs various control processes, arithmetic processes, and the like by reading and executing a program P (program product) and a database pre-stored in the storage unit 12. Note that a database server or the like may be provided outside the information processing device 1, and the database may be read from the database server or the like. Furthermore, the information processing device 1 may be one whose functions are realized by multiple server devices or computers. Furthermore, the information processing device 1 may correspond to a node on a blockchain.

The storage unit 12 of the information processing device 1 is, for example, a volatile memory and a non-volatile memory. The storage unit 12 stores a program P and a model table 121. The program P may be provided to the information processing device 1 using a storage medium 12a in which the program P is stored in a computer-readable manner. The storage medium 12a is, for example, a portable memory. Examples of the portable memory include a CD-ROM, a USB (Universal Serial Bus) memory, an SD card, a micro SD card, and a Compact Flash Memory (registered trademark). When the storage medium 12a is a portable memory, the processing element of the control unit 11 may read the program P from the storage medium 12a using a reading device (not shown). The read program P is written to the storage unit 12. Furthermore, the program P may be provided to the information processing device 1 by the communication unit 13 communicating with an external device. Details of the model table 121 will be described later.

The communication unit 13 is a communication module or communication interface for communicating with the user terminal 2 by wire or wirelessly, and is, for example, a wide-area wireless communication module such as LTE (registered trademark), 4G, or 5G. The control unit 11 communicates with the user terminal 2 via the communication unit 13 through an external network N such as the Internet.

FIG. 3 is a block diagram showing an example of the configuration of the user terminal 2 according to the first embodiment. The user terminal 2 is a terminal capable of accepting input from a user or displaying an image, such as a smartphone, a tablet terminal, wearable glasses, a wearable computer, or a personal computer. In this embodiment, an example in which the user terminal 2 is a smartphone will be described. The user terminal 2 includes a terminal control unit 21, a storage unit 22, a communication unit 23, an input unit 24, a display unit 25, and an image capture unit 26. The terminal control unit 21 is configured with a CPU or an MPU, and performs various control processes, arithmetic processes, and the like. The functions of the user terminal 2 may be realized by multiple devices. For example, arithmetic processes may be performed by a smartphone, and input acceptance or screen display may be performed by wearable glasses.

The storage unit 22 stores an app program Pa, which is an application that takes images of the space, accepts input of the model the user is considering installing, and presents the user with an AR image of the installation area and the air conditioner. The app program Pa is provided to the user terminal 2, for example, using the storage medium 22a. The terminal control unit 21 of the user terminal 2 may obtain the app program Pa using the Internet and store it in the storage unit 22.

The communication unit 23 is a communication module or communication interface for wirelessly communicating with the information processing device 1. The terminal control unit 21 communicates with the information processing device 1 through the external network N via the communication unit 23.

The input unit 24 accepts input of the model of air conditioner that the user is considering purchasing.

The display unit 25 displays an input reception screen for receiving input of the type of air conditioner, an installation area display image in which the installation area identified by the information processing device 1 is superimposed on the indoor image, and an installation image in which the AR image of the air conditioner received from the information processing device 1 is superimposed on the indoor image. In this embodiment, the user terminal 2 is a smartphone, and the input unit 24 and the display unit 25 are integrated into a touch panel.

The photographing unit 26 photographs images within the space. If the user terminal 2 is a smartphone, the photographing unit 26 is a camera built into the smartphone.

4 is an explanatory diagram showing an example of a model table 121 according to the first embodiment. The model table 121 stores the dimensions of each model of air conditioner and an AR image file. The management items (fields) of the model table 121 include, for example, a model name field, a width field, a height field, a depth field, a required installation width field, a required installation height field, a required installation ceiling distance field, a protrusion limit distance field, a tilt angle reference value field, a drain outlet position (vertical) field, a drain outlet position (horizontal) field, and an AR image field. The model name field stores the model name of the air conditioner. The width field stores the width dimension of the model. The height field stores the height dimension of the model. The depth field stores the depth dimension of the model. The required installation width field stores a predetermined width distance that needs to be separated from the side wall when installing the air conditioner. The required installation height field stores a predetermined height distance that needs to be separated from the floor when installing the air conditioner. The required ceiling distance field stores a predetermined distance that the air conditioner needs to be separated from the ceiling surface when it is installed. The protrusion limit distance field stores an upper limit value (protrusion limit distance) of a predetermined distance that an object (e.g., a curtain rail) protruding from the wall surface directly below the air conditioner when the air conditioner is installed. The protrusion limit distance is a distance at which the flap of the air conditioner does not interfere with the object when the flap is deployed. In this embodiment, the units of the dimensions stored in the width field, height field, and depth field, and the predetermined distances stored in the required width field, required height field, required ceiling distance field, and protrusion limit distance field are mm. The inclination angle standard value field stores a standard value of the angle of the drain drain pipe from the air conditioner to the pipe opening. The drain drain pipe is a hose for discharging drainage water generated by condensation inside the air conditioner to the outside, and needs to be inclined downward from the air conditioner to the pipe opening. The inclination angle standard value field stores a range of inclination angles that are allowable for the drain drain pipe of each model. The drain outlet position (vertical) field stores the distance from the bottom side of the air conditioner to the position of the drain outlet, which is the root of the drain pipe extending from the air conditioner. The drain outlet position (horizontal) field stores, for example, the distance of the drain outlet position from the right side of the air conditioner. In this embodiment, the drain outlet position is near the right side of the air conditioner, but the drain outlet position may be near the left side. In this case, the drain outlet position (horizontal) field stores the distance of the drain outlet position from the left side of the air conditioner. Also, if the drain outlet position can be either near the right side or near the left side, the drain outlet position (horizontal) field may store the distance from the side of the air conditioner for the positions of multiple drain outlets. The AR image field stores, for example, an AR image showing the appearance of the model of the air conditioner in file format. That is, the model table 121 records information about the area required for installation of the air conditioner.

5 is an explanatory diagram showing an example of an input acceptance screen for a model according to the first embodiment. When the application program Pa is started, the terminal control unit 21 of the user terminal causes the display unit 25 to display the input acceptance screen. The terminal control unit 21 may also cause the display unit 25 to display the screen described below via a web base. The terminal control unit 21 of the user terminal 2 displays a plurality of air conditioner model names and external images selectable on the input acceptance screen shown in FIG. 5A. The input unit 24 accepts input of the model of the air conditioner that the user is considering purchasing by the user selecting the displayed model name or external image. When the model of the air conditioner is selected on the screen shown in FIG. 5A, the terminal control unit 21 causes the display unit 25 to display detailed information including, for example, information on the functions of the selected model, as shown in FIG. 5B. Also, a command for instructing AR display of the air conditioner is displayed in FIG. 5B.

6 is an explanatory diagram showing an example of a display screen of an indoor image according to the first embodiment. When a command for instructing AR display is selected on the screen shown in FIG. 5B, the terminal control unit 21 of the user terminal 2 causes the display unit 25 to display an indoor image taken by the photographing unit 26, as shown in FIG. 6A. Also, a command for instructing installation area identification is displayed on the screen shown in FIG. 6A. When a command for instructing installation area identification is selected on FIG. 6A, the terminal control unit 21 superimposes the installation area in the indoor image identified by the information processing device 1 on the indoor image, as shown in FIG. 6B. In this embodiment, the installation area is indicated by a dashed line. A method for identifying the installation area will be described later. Note that, if the information processing device 1 is unable to identify the installation area in the indoor image, the terminal control unit 21 causes the display unit 25 to display information indicating that the installation area could not be identified and requesting re-imaging, as shown in FIG. 6C. Also, a command for instructing redoing is displayed on the screen shown in FIG. 6C. When the command for instructing redoing is selected, the space is photographed again. Also, a command for instructing AR display of the selected model is displayed on the screen shown in FIG. 6B. When a command to display AR is selected, the terminal control unit 21 acquires an AR image of the model selected in FIG. 5A from the information processing device 1, and displays the AR image superimposed on the indoor image, as shown in FIG. 6D.

7 is an explanatory diagram showing an example of an object detection model M according to the first embodiment. The object detection model M is a learning model that detects objects contained in an indoor image, such as RCNN (Regions with Convolutional Neural Network), Fast RCNN, Faster RCNN, SSD (Single Shot Multibook Detector), or YOLO (You Only Look Once). When the object detection model M is configured with a neural network including a CNN (Convolutional Neural Network) that extracts image features such as RCNN, the object detection model M has a plurality of neurons that accept input of pixel values of the indoor image and passes the input pixel values to the intermediate layer. The intermediate layer has a plurality of neurons that extract image features of the indoor image and passes the extracted image features to the output layer. The output layer outputs the type and position of objects, including walls, ceilings, electrical outlets, pipe openings, curtain rails, sprinklers, or fire alarms, in the indoor image based on the image features. The control unit 11 may also output the type and position of each object using a technique such as pattern matching.

When the control unit 11 of the information processing device 1 acquires an indoor image from the user terminal 2, the control unit 11 inputs the acquired image into the object detection model M and recognizes objects in the indoor image by outputting the type and position of the object in the indoor image. The control unit 11 of the information processing device 1 also measures the distance between each detected object. The distance between each object is measured by a markerless AR method including, for example, PTAM or SmartAR. The control unit 11 may measure the distance between each object by a function such as Lidar (Light Detection And Ranging) or an infrared sensor provided in the user terminal 2, or may measure the distance based on mapping by SLAM (Simultaneous Localization and Mapping) technology. Also, a marker may be placed in the room and the distance may be measured by a marker-based AR method, or the distance may be estimated based on the size of the object in the indoor image. That is, the control unit 11 of the information processing device 1 recognizes the type and position of the object by analyzing the indoor image.

The control unit 11 of the information processing device 1 identifies the installation area of the air conditioner based on the type and position of each detected object, the measured distance between each object, the dimensions of the model of the air conditioner selected by the user, and the inclination angle reference value of the drain pipe. Specifically, the control unit 11 identifies the installation area as an area where the air conditioner does not interfere with objects other than the pipe opening and where the inclination angle of the drain pipe of the air conditioner is within the range of the inclination angle reference value. If the control unit 11 cannot identify the installation area on the pipe opening because the air conditioner interferes with other objects when installed on the pipe opening, it identifies the installation area on the wall surface within a predetermined distance from the pipe opening. If the control unit 11 cannot identify the installation area even within a predetermined distance from the pipe opening, the control unit 11 outputs information requesting re-taking of the image to the user terminal 2. The terminal control unit 21 of the user terminal 2 that has acquired the information requesting re-taking of the image displays the information requesting re-taking of the image on the display unit 25 (see FIG. 6C).

FIG. 8 is a flowchart showing an example of processing by the control unit 11 of the information processing device 1 according to the first embodiment. FIG. 9 is a flowchart showing an example of installation area identification processing according to the first embodiment. The control unit 11 acquires from the user terminal 2 the model of air conditioner that the user who has accepted the input is considering purchasing (S1). The control unit 11 acquires an interior image of the room from the user terminal 2 (S2). The control unit 11 inputs the acquired interior image into the object detection model M (S3), and outputs the type and position of the object in the interior image (S4). The control unit 11 measures the distance between each object (S5). The control unit 11 reads out the dimensions and the specified distance of the selected model from the model table 121 (S6).

The control unit 11 executes an installation area specification process based on the output object type and position, and the distance between each object (S7). The installation area specification process will be described below with reference to FIG. 9. The control unit 11 sets the range that is a predetermined distance or more away from the wall and ceiling surfaces as the installation possible range (S701). If a wall or ceiling surface is not detected, the range included in the indoor image is set as being a predetermined distance or more away from the wall or ceiling surface. The control unit 11 reduces the installation possible range to a range that is a predetermined distance or more away from the fire alarm (S702). If a fire alarm is not detected, S702 is not executed. The control unit 11 reduces the installation possible range to a range that is a predetermined distance or more away from the sprinkler (S703). If a sprinkler is not detected, S703 is not executed. The control unit 11 reduces the installation possible range to a range that is a predetermined distance or more away from the curtain rail (S704). In S704, if the distance that the curtain rail protrudes from the wall surface including the possible installation range is within the protrusion limit distance, the control unit 11 reduces the possible installation range to include the area directly above the curtain rail. If a curtain rail is not detected, S704 is not executed. The control unit 11 reduces the possible installation range to a range within a predetermined distance from an outlet (S705). If an outlet is not detected, S705 is not executed. Based on the dimensions of the model read in S6, the control unit 11 determines whether the model of air conditioner selected by the user can be installed within the possible installation range reduced up to S705 (S706).

If the model is not installable (S706: NO), the control unit 11 determines that the installation area cannot be specified (S710) and ends the installation area specification process. If the model is installable (S706: YES), the control unit 11 determines whether or not a pipe outlet is detected in the indoor image (S707). If a pipe outlet is not detected (S707: NO), the control unit 11 specifies an area located a predetermined distance from the wall and ceiling surfaces within the installation possible range as the installation area (S711), and ends the installation area specification process. If a drain is detected (S707: YES), the control unit 50 determines whether or not the air conditioner can be installed within the installation possible range so that the pipe outlet and the drain outlet overlap (S708) based on the drain outlet position of the selected model. If the air conditioner can be installed so that the pipe outlet and the drain outlet overlap (S708: YES), the control unit 11 specifies an area where the pipe outlet and the drain outlet of the air conditioner overlap as the installation area (S709), and ends the installation area specification process. If the air conditioner cannot be installed so that the pipe opening and the drain opening overlap (S708: NO), the control unit 11 reduces the installation range to a range in which the drain pipe's inclination angle is within the inclination angle standard value based on the drain opening position and the inclination angle standard value (S712). The control unit 11 specifies the area in the installation range in which the pipe opening and the drain opening are closest to each other based on the drain opening position (S713), and ends the installation area specification process. Note that the method of specifying the installation area in S711 or S713 is not limited to these, and the control unit 11 may, for example, specify the center of the installation range as the installation area, or may specify a random area within the installation range as the installation area.

Returning to FIG. 8, the processing after the installation area identification process (S7) will now be described. The control unit 11 determines whether the installation area has been identified (S8). If the installation area has not been identified (S8: NO), the control unit 11 sends information to the user terminal 2 requesting that an image be re-taken (S12) and returns the process to S2. If the installation area has been identified (S8: YES), the control unit 11 sends the identified installation area to the user terminal 2 (S9). The control unit 11 reads out an AR image of the model selected by the user from the model table 121 (S10), sends the AR image to the user terminal 2 (S11), and ends the processing.

The above process makes it possible to identify an installation area where the model desired by the user can be installed based on an indoor image, making it possible to efficiently identify the installation area for the air conditioner. Note that the information processing device 1 may identify models that can be installed in the installation area in addition to the model selected by the user, and send information on the relevant model to the user terminal 2. In this case, the screen shown in FIG. 6D may accept an input to change the model for which the AR image is displayed. The control unit 11 may also identify the installation area using a learning model that outputs the installation area when an indoor image in which the type and position of an object are output and the dimensions of the model of the air conditioner are input. The learning model is composed of a model that can output coordinates within an image, such as a CNN (Convolutional Neural Network).

(Embodiment 2)
The information processing device 1 according to the second embodiment identifies the installation area of the air conditioner in the room, selects the model of the air conditioner suitable for the room, and presents it to the user. The following describes the differences between the second embodiment and the first embodiment. The other configurations, except for the configurations described below, are common to the first embodiment. Therefore, the components common to the first embodiment are given the same reference numerals as the first embodiment, and the description of those components is omitted.

10 is an explanatory diagram showing an example of a model table 121 according to the second embodiment. The model table 121 according to the second embodiment includes a compatible tatami mat size field, a pipe diameter field, and multiple function fields. The compatible tatami mat size field stores, for example, the upper limit of the size of the room (tatami mat size) that each model can perform air conditioning. The pipe diameter field stores the diameter of the pipe port required to install each model. The function field stores the functions provided by each model. The functions include, for example, ventilation, humidification, AI automatic comfort, air purification, internal cleaning, automatic filter cleaning, smartphone connection, and air circulation function. In the example shown in FIG. 10, the model table includes three function fields, but the number of function fields is not limited to this and may be one, two, four or more.

FIG. 11 is an explanatory diagram showing a room information input reception screen according to the second embodiment. The terminal control unit 21 of the user terminal 2 causes the display unit 25 to display, on the room information input reception screen, an area input field for receiving input of the area of the room, a function selection field for receiving selection of a function desired by the user, and a shape selection field for receiving selection of the shape of the room. The area input field is used to input the area of the room in units of, for example, tatami mats. The function selection field includes icons indicating multiple functions, and when an icon is selected, input of the function desired by the user is received. The shape input field includes icons indicating multiple room shapes, and when an icon is selected, input of the room shape is received. In addition, a command for instructing capture of an interior image of the room is displayed on the room information input reception screen.

12 is an explanatory diagram showing an example of a display screen of an indoor image according to the second embodiment. When a command for instructing to capture an indoor image is selected on the room information input reception screen, the terminal control unit 21 of the user terminal 2 causes the display unit 25 to display the room image captured by the capture unit 26, as shown in FIG. 12A. In addition, a command for instructing to display the installation area is displayed on the screen shown in FIG. 12A. When a command for instructing to display the installation area is selected on the screen shown in FIG. 12A, the terminal control unit 21 superimposes the installation area identified by the information processing device 1 on the indoor image, as shown in FIG. 12B. Note that the size of the installation area superimposed on FIG. 12B is the size in the case where the model that can be installed and has the largest dimensions is installed among the models selected by the information processing device 1 based on the information input on the room information input reception screen. In addition, a command for instructing to display the AR of the air conditioner is displayed on the screen shown in FIG. 12B. When a command to instruct AR display is selected, the terminal control unit 21 acquires from the information processing device 1 an AR image of the model that can be installed and has the maximum dimensions, and superimposes the acquired AR image on the indoor image as shown in FIG. 12C. Also, FIG. 12C displays a command to instruct a change of the model to be displayed in AR. When a command to change the model to be displayed in AR is selected, the terminal control unit 21 causes the display unit 25 to display models that can be installed in the installation area, other than the model for which the AR image is displayed in FIG. 12C, as shown in FIG. 12D. The model selected in FIG. 12D is superimposed on the indoor image.

13 is a flowchart showing an example of the processing of the control unit 11 of the information processing device 1 according to the second embodiment. The control unit 11 acquires room information input from the user terminal 2 (S21). The control unit 11 selects an air conditioner model that matches the conditions of the acquired room information from the models stored in the model table 121 (S22). In S22, the control unit 11 selects a model for the user terminal 2 that has a larger number of tatami mats than the number of tatami mats input on the room information input reception screen and has the functions selected on the room information input reception screen. Note that if the shape of the room selected on the room information input reception screen is a specific shape such as "long and narrow," "L-shaped," or "two rooms used," the control unit 11 selects a model with an air circulation function. The control unit 11 acquires an indoor image of the room from the user terminal 2 (S23). The control unit 11 inputs the acquired indoor image to the object detection model M (S24) and outputs the type and position of the object in the indoor image (S25). The control unit 11 measures the distance between each object (S26). The control unit 11 identifies the model with the largest possible installation dimensions among the models of air conditioners selected in S22 based on the positions of the objects in the indoor image and the distances between the objects (S27). The control unit 11 identifies an installation area in which the model identified in S27 can be installed (S28), and transmits the identified installation area to the user terminal 2 (S29). The control unit 11 reads an AR image of the model identified in S27 from the model table 121 (S30), and transmits the AR image to the user terminal 2 (S31). The control unit 11 also reads information including an AR image of a model smaller than the model identified in S27 (a model whose width, height, and depth dimensions are equal to or less than the dimensions of the model identified in S27) among the models selected in S22 from the model table 121 (S32), transmits the read information to the user terminal 2 (S33), and ends the process.

(Embodiment 3)
The information processing device 1 according to the third embodiment outputs the range of a movable area around the installation area in which the object does not interfere with other objects, and accepts input of movement of the air conditioner in the indoor image of the AR image within the movable area. The following describes the differences between the third embodiment and the first embodiment. The other configurations, except for the configurations described below, are common to the first embodiment. Therefore, the same reference symbols as those in the first embodiment are used for the components common to the first embodiment, and the description of those components is omitted.

14 is an explanatory diagram showing an example of a display screen of an indoor image according to the third embodiment. FIG. 14A shows a display screen of an installation area and a movable area. The control unit 11 of the information processing device 1 specifies the installation area and specifies a movable area in which the AR image of the air conditioner does not interfere with objects even if the AR image of the air conditioner is moved. The movable area in this embodiment may correspond to the installation range in the first embodiment. The terminal control unit 21 of the user terminal 2 causes the display unit 25 to display the AR image of the air conditioner and the movable area superimposed on the indoor image. In this embodiment, the movable area is indicated by diagonal lines. Furthermore, the terminal control unit 21 displays a cursor on the AR image of the air conditioner to accept input for moving the installation area. The input unit 24 of the user terminal 2 accepts input for moving the AR image of the air conditioner within the movable area. As shown in FIG. 14B, when a part or all of the AR image of the air conditioner is moved outside the movable area, the terminal control unit 21 causes the display unit 25 to display information about the object with which the air conditioner interferes. In the example shown in FIG. 14B, a message is displayed indicating that the air conditioner cannot be moved because it is interfering with the curtain rail. The terminal control unit 21 may output information regarding the object that the air conditioner is interfering with by flashing the object on the screen or by outputting audio, etc.

15 is a flowchart showing an example of the processing of the control unit 11 of the information processing device 1 according to the third embodiment. For example, after identifying the installation area, the control unit 11 of the information processing device 1 performs the following processing. The control unit 11 identifies a movable area based on the positional relationship of each object, the distance between each object, and the dimensions of the model of the selected air conditioner (S41), and transmits the identified movable area to the user terminal 2 (S42). The control unit 11 acquires the position after movement of the AR image of the air conditioner that the user terminal 2 accepted the input (S43), and determines whether the acquired position is outside the movable area (S44). If it is outside the movable area (S44: NO), the control unit 11 identifies an object that the air conditioner interferes with (S45), transmits information on the identified object to the user terminal 2 (S46), and returns the processing to S43. If the acquired position is within the movable area (S44: YES), the control unit 11 ends the processing.

(Embodiment 4)
The information processing device 1 according to the fourth embodiment acquires architectural drawing data of a building (target building) having a room in which an indoor image is captured, matches the architectural drawing data with the indoor image, and identifies the installation area based on the architectural drawing data. The following describes the differences between the fourth embodiment and the first embodiment. The other configurations, except for the configurations described below, are common to the first embodiment. Therefore, the same reference symbols as those in the first embodiment are used for the components common to the first embodiment, and the description of those components is omitted.

FIG. 16 is a block diagram showing an example of the configuration of a user terminal 2 according to the fourth embodiment. The storage unit 22 of the user terminal 2 according to the fourth embodiment stores architectural drawing data D.

FIG. 17 is an explanatory diagram showing an example of architectural drawing data D. Architectural drawing data D is data showing the positions of air conditioner bases or concealed piping inside walls on a floor plan including information on the positions of windows, fixtures, furniture, or equipment such as fire alarms in a building having a room in which an interior image is taken. In the example shown in FIG. 17, the positions where the air conditioner bases exist are indicated by shading, and the positions where the hidden piping exists are indicated by dashed lines. Architectural drawing data D is not limited to floor plans, but may be more detailed design drawings. In this case, the vertical positions where the air conditioner bases or hidden piping exist may be included in the architectural drawing data D.

FIG. 18 is an explanatory diagram showing the input screen for architectural drawing data D. The terminal control unit 21 of the user terminal 2 reads out the architectural drawing data D from the storage unit 22 and displays it on the display unit 25. The input unit 24 accepts the selection of a room in which the user wishes to install an air conditioner within the floor plan of the displayed architectural drawing data D.

19 and 20 are explanatory diagrams showing an example of a display screen of an indoor image according to the fourth embodiment. As shown in FIG. 19A, the terminal control unit 21 causes the display unit 25 to display the indoor image captured by the capture unit 26. In addition, a command for instructing to match the architectural drawing data D with the indoor image is displayed on the screen shown in FIG. 19A. When the command for matching the architectural drawing data D with the indoor image is selected, the terminal control unit 21 transmits the architectural drawing data D and the indoor image to the information processing device 1. When the control unit 11 of the information processing device 1 receives the architectural drawing data D and the indoor image, it detects objects from the indoor image and identifies the position of the air conditioner base or hidden piping on the wall surface included in the indoor image based on the positions of the windows, fittings, furniture, or equipment such as fire alarms included in the architectural drawing data D and the type and position of the detected object. In the example shown in FIG. 19A, the control unit 11 of the information processing device 1 matches the positions of the wall surface and curtain rail included in the indoor image with the architectural drawing data D, and identifies the position where the indoor image in the architectural drawing data D was captured. In this example, the control unit 11 of the information processing device 1 assumes that the position of the curtain rail in the indoor image is the same as the position of the window in the architectural drawing data D, and makes the correspondence between them. The control unit 11 may also make the architectural drawing data D correspond to the indoor image by using a method such as position measurement using GPS or WiFi (registered trademark), or matching using a gyro sensor.

The control unit 11 of the information processing device 1 identifies the position of the air conditioner base or hidden piping within the wall surface included in the indoor image based on the correspondence between the architectural drawing data D and the indoor image. The control unit 11 transmits the identified position of the air conditioner base or hidden piping within the wall surface included in the indoor image to the user terminal 2. The terminal control unit 21 of the user terminal 2 superimposes and displays the position of the air conditioner base or hidden piping on the display unit 25, as shown in FIG. 19B. In the example shown in FIG. 19B, the air conditioner base is shown by shading, and the hidden piping is shown by double dashed lines. In addition, a command for instructing the display of the installation area is displayed on the screen shown in FIG. 19B.

The control unit 11 of the information processing device 1 also identifies the installation area of the air conditioner based on the identified position of the air conditioner base or concealed piping. Specifically, when the air conditioner base is included in the indoor image, the control unit 11 identifies the installation area as a position where the joint for fastening the air conditioner to the wall surface is located on the air conditioner base and does not interfere with the concealed piping. The control unit 11 of the information processing device 1 transmits the identified installation area to the user terminal 2. When a command to instruct the display of the installation area is selected on the screen shown in FIG. 19B, the terminal control unit 21 of the user terminal 2 that has received the installation area causes the display unit 25 to display the installation area superimposed on the indoor image, as shown in FIG. 19C. Also, a command to instruct the display of an AR image of the air conditioner is displayed on the screen shown in FIG. 19C.

When a command to instruct the display of an AR image is selected on the screen shown in FIG. 19C, the terminal control unit 21 of the user terminal 2 causes the display unit 25 to display candidate models of air conditioners for AR display, as shown in FIG. 20A. When the terminal control unit 21 accepts the selection of the model for AR display from the displayed candidate models, it causes the display unit 25 to display the AR image of the air conditioner superimposed on the indoor image, as shown in FIG. 20B.

21 is a flowchart showing an example of processing of the control unit 11 of the information processing device 1 according to the fourth embodiment. The control unit 11 acquires architectural drawing data D from the user terminal 2 (S51). The control unit 11 acquires an indoor image from the user terminal 2 (S52). The control unit 11 inputs the acquired indoor image to the object detection model M (S53) and outputs the type and position of the object included in the indoor image (S54). The control unit 11 identifies the position where the indoor image was taken in the architectural drawing data D based on the positions of the windows, fittings, furniture, fire alarms, and other equipment included in the architectural drawing data D and the objects included in the output indoor image (S55). The control unit 11 identifies the position of the air conditioner base or hidden piping in the wall surface included in the indoor image based on the correspondence between the architectural drawing data D and the indoor image (S56). The control unit 11 transmits the identified position of the air conditioner base or hidden piping in the wall surface included in the indoor image to the user terminal 2 (S57). The control unit 11 identifies the installation area of the air conditioner based on the identified position of the air conditioner base or concealed piping (S58), and transmits the identified installation area to the user terminal 2 (S59). The control unit 11 reads out an AR image of the model of air conditioner selected on the user terminal 2 from the model table 121 (S60), transmits the read AR image to the user terminal 2 (S61), and ends the process.

(Embodiment 5)
The information processing device 1 according to the fifth embodiment transmits the type and position of the object output by the object detection model to the user terminal 2. The user terminal 2 displays the received type and position of the object and accepts corrections to the object. If the objects recognized by the information processing device 1 include an object that can be removed from the wall, such as a clock, the user can input a correction to the object to the user terminal 2 so that the object does not exist. The following describes the differences between the fifth embodiment and the first embodiment. The other configurations, except for the configuration described below, are common to the first embodiment. For this reason, the same reference symbols as those in the first embodiment are used for the components common to the first embodiment, and the description of those components is omitted.

FIG. 22 is an explanatory diagram showing an example of an object detection result display screen according to embodiment 5. The terminal control unit 21 of the user terminal 2 causes the display unit 25 to display the type and position of the object received from the information processing device 1 on the indoor image. The terminal control unit 21 accepts the selection of the object to be modified via the input unit 24, thereby accepting modifications to the object.

FIG. 23 is a flowchart showing an example of processing by the control unit 11 of the information processing device 1 according to embodiment 5. The control unit 11 of the information processing device 1 acquires an indoor image from the user terminal 2 (S71). The control unit 11 inputs the indoor image into the object detection model M (S72), and outputs the type and position of the object included in the indoor image (S73). The control unit 11 transmits the type and position of the object to the user terminal 2 (S74). The control unit 11 acquires corrections to the object input by the user terminal 2 (S75), and identifies the installation area based on the type and position of the object after correction (S76). The control unit 11 transmits the identified installation area to the user terminal 2 (S77), and ends the processing.

(Embodiment 6)
In the above-described embodiments, the air conditioner has been described as a wall-mounted type air conditioner, but the air conditioner may be a cassette type air conditioner that is embedded in the ceiling. The following describes the differences between embodiment 6 and embodiment 1. Except for the configuration described below, the other configurations are the same as embodiment 1. For this reason, components that are the same as embodiment 1 are given the same reference numerals as embodiment 1, and descriptions of those components are omitted.

FIG. 24 is an explanatory diagram showing an example of an object detection model M according to embodiment 6. The control unit 11 of the information processing device 1 according to embodiment 6 inputs an indoor image in which the ceiling of a room is photographed to an object detection model. The object detection model M according to embodiment 6 detects objects including lighting, fans, ventilation fans, fire alarms, and sprinklers. The control unit 11 identifies a position on the ceiling surface that does not interfere with the detected objects as the installation area of an air conditioner (cassette type air conditioner).

FIG. 25 is an explanatory diagram showing an installation area display screen according to embodiment 6. The terminal control unit 21 of the user terminal 2 causes the display unit 25 to display the installation area identified by the information processing device 1 superimposed on the indoor image. The terminal control unit 21 of the user terminal 2 may also cause an example of the placement of drain pipes to be superimposed on the indoor image, as indicated by the dotted line in FIG. 25.

When the control unit 11 of the information processing device 1 identifies the installation area based on architectural drawing data D, the control unit 11 may identify the installation area based on architectural drawing data D that includes the location of the concealed piping above the ceiling.

(Embodiment 7)
The user terminal 2 according to the seventh embodiment stores the model table 121 and the object detection model M, and identifies the possible installation range based on the position of the object in the indoor image output by the object detection model M, as well as the dimensions of the selected model and a specified distance, and displays it superimposed on the indoor image. The display unit 25 of the user terminal 2 functions as a display device that displays the indoor image. The following describes the differences between the seventh embodiment and the first embodiment. The other configurations, except for the configuration described below, are common to the first embodiment. For this reason, the components common to the first embodiment are given the same reference symbols as the first embodiment, and descriptions of those components will be omitted.

FIG. 26 is a block diagram showing an example of the configuration of a user terminal 2 according to embodiment 7. The storage unit 22 of the user terminal 2 according to embodiment 7 stores a model table 121 and an object detection model M. The model table 121 according to this embodiment is similar to the model table 121 (see FIG. 4) stored by the information processing device 1 according to embodiment 1. Furthermore, the object detection model M according to this embodiment is similar to the object detection model M (see FIG. 7) stored by the information processing device 1 according to embodiment 1.

FIG. 27 is an explanatory diagram showing an example of a display screen of an indoor image according to embodiment 7. FIG. 27A shows a possible installation range display screen. When the terminal control unit 21 of the user terminal 2 receives an input for selecting a model on the input receiving screen (see FIG. 5), it reads out the dimensions and a specified distance of the selected model from the model table 121. The terminal control unit 21 specifies the possible installation range (movable area) based on the read out dimensions and the specified distance, and causes the display unit 25 to display the specified possible installation range superimposed on the indoor image. In other words, the display unit 25 obtains information on the possible installation range from the terminal control unit 21, and displays the possible installation range superimposed on the indoor image. Also, FIG. 27A displays a command for instructing AR display of the air conditioner.

FIG. 27B shows the AR image display screen. When a command to instruct AR display of the air conditioner is selected on the possible installation range display screen shown in FIG. 27A, the AR image display screen is displayed. The terminal control unit 21 of the user terminal 2 reads out the AR image of the selected model from the model table 121 of the storage unit 22, and causes the display unit 25 to superimpose and display it on the possible installation range of the read indoor image. In other words, the display unit 25 obtains information regarding the AR image of the air conditioner (air conditioner image) from the storage unit 22, and superimposes and displays the AR image of the air conditioner on the possible installation range.

FIG. 28 is a flowchart showing an example of processing by the terminal control unit 21 of the user terminal 2 according to the seventh embodiment. The terminal control unit 21 of the user terminal 2 causes the input unit 24 to accept input of the model of air conditioner that the user is considering purchasing (S81). The terminal control unit 21 causes the photographing unit 26 to photograph an image of the room (S82).

The terminal control unit 21 inputs the acquired indoor image into the object detection model M (S83), and outputs the type and position of the object in the indoor image (S84). The terminal control unit 21 measures the distance between each object (S85). The distance between each object is measured by a markerless AR method including, for example, PTAM or SmartAR. The terminal control unit 21 may measure the distance between each object using a function such as Lidar (Light Detection And Ranging) or an infrared sensor provided in the user terminal 2, or may measure the distance based on mapping using SLAM (Simultaneous Localization and Mapping) technology. Also, a marker may be placed in the room and the distance may be measured by a marker-based AR method, or the distance may be estimated based on the size of the object in the indoor image.

The terminal control unit 21 reads out the dimensions and the specified distance of the selected model from the model table 121 (S86). The terminal control unit 21 specifies the possible installation range in the indoor image based on the output object type and position, the distance between each object, and the dimensions and the specified distance of the selected model (S87). The method of specifying the possible installation range in S87 may be the same as the process of S701 to S705 shown in FIG. 9. The terminal control unit 21 superimposes the specified possible installation range on the indoor image (S88). The terminal control unit 21 reads out an AR image of the selected model from the model table 121 (S89). The terminal control unit 21 superimposes the read out AR image on the possible installation range (S90) and ends the process.

Part of the processing executed by the user terminal 2 according to the seventh embodiment may be executed by the information processing device 1. For example, the storage unit 12 of the information processing device 1 may store the model table 121 and the object detection model M. In this case, the control unit 11 of the information processing device 1 may specify the possible installation range based on the position of the object in the indoor image output by the object detection model M, as well as the dimensions of the selected model and a predetermined distance.

(Embodiment 8)
The information processing device 1 according to the eighth embodiment recognizes the type and position of an object in an indoor image based on a user input on the user terminal 2. The following describes the differences between the eighth embodiment and the first embodiment. Except for the configuration described below, the other configurations are common to the first embodiment. For this reason, the same reference symbols as those in the first embodiment are used for the components common to the first embodiment, and descriptions of those components are omitted.

FIG. 29 is an explanatory diagram showing an object input screen according to embodiment 8. As shown in FIG. 29A, the terminal control unit 21 of the user terminal 2 causes the display unit 25 to display an indoor image captured by the photographing unit 26 and a message prompting the user to input the type and position of the object. As shown in FIG. 29B, the terminal control unit 21 causes the input unit 24 to accept input of the type and position of the object from the user.

FIG. 30 is a flowchart showing an example of the processing of the control unit 11 of the information processing device 1 according to embodiment 8. The processing of S101 to S102 is similar to the processing of S1 to S2 shown in FIG. 8. The control unit 11 of the information processing device 1 acquires the type and position of the object input by the user from the user terminal 2 (S103). The control unit 11 recognizes the type and position of the object in the indoor image based on the type and position of the object input by the user (S104). The processing of S105 to S112 is similar to the processing of S5 to S12 shown in FIG. 8.

(Embodiment 9)
The information processing device 1 according to the eighth embodiment stores conditions regarding the positional relationship between the object and the air conditioner to be installed, which are determined for each type of object. The conditions are determined based on the distance required from the object to the installation area of the air conditioner. The following describes the differences between the eighth embodiment and the first embodiment. The other configurations, except for those described below, are common to the first embodiment. For this reason, the components common to the first embodiment are given the same reference numerals as the first embodiment, and the description of those components will be omitted.

FIG. 31 is a block diagram showing an example of the configuration of an information processing device 1 according to embodiment 9. The storage unit 12 of the information processing device 1 according to embodiment 9 stores an object condition table 122.

FIG. 32 is an explanatory diagram showing an example of an object condition table 122 according to the ninth embodiment. The object condition table 122 stores the distance that an object needs to be kept away from the location (installation area) of the air conditioner to be installed, which is determined for each type of object. The management items (fields) of the object condition table 122 include, for example, an object field and a condition distance field. The object field stores the type of object. The condition distance field stores the distance (condition distance) that each type of object needs to be kept away from the installation area. Note that when the object is an outlet, the condition distance indicates the maximum distance between the object (outlet) and the installation area. The control unit 11 of the information processing device 1 refers to the object condition table 122 to identify the installation area, based on the type and position of the object detected from the indoor image.

FIG. 33 is a flowchart showing an example of the installation area specification process according to the ninth embodiment. The control unit 11 sets the range that is away from the wall surface and the ceiling surface by the condition distance or more as the installation possible range (S721). If the wall surface or the ceiling surface is not detected, the range included in the indoor image is set as being away from the wall surface or the ceiling surface by the condition distance or more. The control unit 11 reduces the installation possible range to a range that is away from the fire alarm by the condition distance or more (S722). If the fire alarm is not detected, S722 is not executed. The control unit 11 reduces the installation possible range to a range that is away from the sprinkler by the condition distance or more (S723). If the sprinkler is not detected, S723 is not executed. The control unit 11 reduces the installation possible range to a range that is away from the curtain rail by the condition distance or more (S724). If the distance that the curtain rail protrudes from the wall surface including the installation possible range is within the protrusion limit distance in S724, the control unit 11 reduces the installation possible range to include directly above the curtain rail. If a curtain rail is not detected, step S724 is not executed. The control unit 11 reduces the possible installation range to a range within the condition distance from the outlet (S725). The processes of steps S726 to S730 are the same as the processes of steps S706 to S710 shown in FIG. 9. If a pipe outlet is not detected in the indoor image (S727: NO), the control unit 11 specifies an area located within the possible installation range at a condition distance from the wall and ceiling surfaces as the installation area (S731), and ends the installation area specification process. The processes of steps S732 to S733 are the same as the processes of steps S712 to S713 shown in FIG. 9.

(Modification)
The control unit 11 of the information processing device 1 may simulate the airflow when an air conditioner is installed in a room based on the type and position of the object or the performance of the air conditioner, and may identify the installation area or select the model based on the simulation results.

The examples of air conditioners are not limited to those mentioned above, and may be, for example, floor-standing air conditioners or ceiling-mounted air conditioners.

The embodiments disclosed herein are illustrative in all respects and should not be considered restrictive. The technical features described in each embodiment may be combined with one another, and the scope of the present disclosure is intended to include all modifications within the scope of the claims and equivalents to the scope of the claims. Furthermore, the independent claims and dependent claims described in the claims may be combined with one another in any and all combinations, regardless of the citation format. Furthermore, the claims use a format in which a claim cites two or more other claims (multi-claim format), but this is not limited to this. They may also be written in a format in which a multiple claim cites at least one other claim (multi-multi-claim).

REFERENCE SIGNS LIST 1 Information processing device 2 User terminal 11 Control unit 12 Memory unit 12a Storage medium 13 Communication unit 21 Terminal control unit 22 Memory unit 22a Storage medium 23 Communication unit 24 Input unit 25 Display unit 26 Photography unit 121 Model table D Architectural drawing data M Object detection model N Network P Program Pa Application program S Air conditioner installation area identification system

Claims

Capture images of the room,
Recognizing objects in the acquired images;
A program that causes a computer to execute a process of identifying an area in the room where an air conditioner can be installed based on the recognized object.
The program according to claim 1 , further comprising: recognizing a type and a position of the object based on a user's input to the image or by analyzing the image.
Recognizing the type and location of the object in the image;
The program according to claim 1 or 2, further comprising: identifying the area based on a condition regarding a positional relationship between the air conditioner and each type of object, the condition being determined for each type of object, and the type and position of the recognized object.
Recognizing the location of the object in the image;
Obtaining information regarding the area required for the air conditioner;
The program according to claim 1 , further comprising: identifying the area based on information regarding a position of the object and an area required for installation of the air conditioner.
The program according to claim 1 , wherein the object includes a wall surface, a ceiling surface, an electrical outlet, a pipe opening, a curtain rail, a sprinkler, or a fire alarm.
The program according to claim 1 , further comprising: displaying the area of the air conditioner in a superimposed manner on the image.
The program according to claim 1 , further comprising: displaying an air conditioner image showing an external appearance of the air conditioner in a superimposed manner in the specified area of the image.
Accepting an input of a movement of the air conditioner image in the image;
The program according to claim 7 , further comprising: when the position of the air conditioner after the movement for which an input has been received is a position where it interferes with the object, outputting information about the interfering object.
outputting a range of a movable area around the area in which the air conditioner does not interfere with the object;
The program according to claim 7 , further comprising: receiving an input of movement of the air conditioner image in the image based on the movable area.
The program according to claim 1 , further comprising: outputting information requesting re-imaging when the area cannot be identified in the image.
The program according to claim 1 , further comprising: specifying, as the area, a region in which an inclination angle of the drain pipe of the air conditioner falls within a reference value.
Accepting modifications to the recognized object;
The program according to claim 1 , further comprising: identifying the area based on the object after modification.
The program according to claim 5 , further comprising: identifying the area on the pipe opening when the pipe opening is recognized.
The program according to claim 5 , further comprising: if the area cannot be identified on the pipe opening, identifying the area on the wall surface within a predetermined distance from the pipe opening.
the image is an image of the interior of a room;
Acquire architectural drawing data of a target building having the room;
The program according to claim 1 , further comprising: identifying the area based on the acquired architectural drawing data and the object.
The program according to claim 1 , wherein the object includes furniture, fixtures, or equipment.
the image is an image of the interior of a room;
The program according to claim 1 , further comprising: selecting a model of the air conditioner to be installed based on the size of the room, the shape of the room, or the performance of the air conditioner.
The program according to claim 5 , further comprising: selecting a model of the air conditioner to be installed based on the recognized size of the pipe opening.
Capture images of the room,
Recognizing objects in the acquired images;
and identifying an area in the room where an air conditioner can be installed based on the recognized object.
Capture images of the room,
Recognizing objects in the acquired images;
and a control unit that identifies an area in the room where an air conditioner can be installed based on the recognized object.
acquiring information regarding an installation range of the air conditioner identified based on an image of the room and an object recognized in the image;
A display device that displays the possible installation range superimposed on the image.
Acquire information regarding an air conditioner image showing an external appearance of the air conditioner;
The display device according to claim 21 , wherein the air conditioner image is displayed so as to be superimposed on the possible installation range.