WO2024058556A1

WO2024058556A1 - Method and device for automatically calculating window set information using artificial neural network

Info

Publication number: WO2024058556A1
Application number: PCT/KR2023/013760
Authority: WO
Inventors: 김학성; 김상일; 이세민; 김규원; 한영구
Original assignee: 한양대학교 산학협력단
Priority date: 2022-09-15
Filing date: 2023-09-13
Publication date: 2024-03-21
Also published as: KR20240037716A

Abstract

A device for automatically calculating window set information using an artificial neural network according to one embodiment comprises: a pre-trained window set information calculation artificial neural network module which uses first input information including image information as input information and uses window set information obtained by extracting window set characteristics from the image information as output information; and a feature extraction unit for extracting a 1-1 feature map and a 1-2 feature map having different scale values for the image information from the window set information calculation artificial neural network module, wherein the window set information calculation artificial neural network module can generate a 3-1 feature map and a 3-2 feature map by applying convolution to the 1-1 feature map and the 1-2 feature map, respectively, determine one of the 3-1 feature map and the 3-2 feature map as the final feature map according to a preset standard, and then calculate the window set information on the basis of the selected final feature map.

Description

Automatic calculation method and device for window set information using artificial neural network

The present invention relates to a method and device for automatically calculating window set information using an artificial neural network. More specifically, the present invention relates to a method and device for automatically calculating window set information using an artificial neural network. More specifically, the present invention classifies the window set area in an input image using a pre-trained artificial neural network, and simultaneously classifies the window set area into the classified window set area. This invention relates to technology that can automatically calculate window set information.

The indoor space in a building is a space that maintains the comfort of occupants from changes in the indoor and outdoor environments in terms of architectural environment facilities. Occupants' comfort can change in real time due to a combination of various thermal factors, of which the most representative thermal factor is temperature. Therefore, it is necessary to evaluate temperature distribution to create a comfortable indoor environment for occupants.

Meanwhile, recently, due to environmental issues such as global warming, technologies for efficiently managing and reducing thermal energy in industrial and domestic buildings have been attracting attention. As a result, various remodeling to manage and reduce daylight energy in industrial and public buildings is being developed. It is being done.

In the case of remodeling to manage and reduce daylight energy, the light energy characteristics of the building should be analyzed using the design drawings of the existing building, and the building should be designed based on this. In designing this, various factors that affect the light energy characteristics of the building must be considered. Among the various factors, the element that most closely affects the building is the window set, and the window set determines the building's solar radiation gain and daylight area. It has the greatest impact on the light energy flowing into the building.

In order to calculate the light characteristic values of a window set, such as solar radiation gain and daylight area, the detailed shape dimensions of the window set are required. In general, when designing a building window set, shape information about the existing building window set is required. . However, in the case of older buildings that have been around for a long time, there is a problem in that the drawings are lost and window set shape information cannot be secured. In this case, the constructor or designer must directly measure the shape of the window set of the existing building, which is costly and time-consuming. This problem also serves as a limitation when analyzing window set optical characteristic values using the shape information of existing building window sets.

Therefore, the method and device for automatically calculating window set information using an artificial neural network according to an embodiment are inventions designed to solve the problems described above, and automatically classify window set areas for input images and The purpose is to provide an automatic calculation method of window set information that can automatically calculate window set information.

In addition, the purpose is to provide a method for managing buildings more efficiently by calculating information on solar radiation gain and daylight area that affect the light characteristics of the building based on the calculated window set information.

The effects of the present invention are not limited to the technical problems mentioned above, and other effects not mentioned will be clearly understood by those skilled in the art from the description below.

According to one embodiment, an automatic calculation device for window set information using an artificial neural network performs pre-learning using first input information including image information as input information, and window set information obtained by extracting window set characteristics from the image information as output information. In the window set information calculating artificial neural network module and the window set information calculating artificial neural network module, it includes a feature extraction unit that extracts a 1-1 feature map and a 1-2 feature map having different scale values for the image information. And the window set information calculation artificial neural network module generates a 3-1 feature map and a 3-2 feature map by applying convolution to the 1-1 feature map and the 1-2 feature map, respectively. After that, one of the 3-1 feature map and the 3-2 feature map is determined as the final feature map according to a preset standard, and then the window set information can be calculated based on the selected final feature map.

The window set information calculation artificial neural network module calculates reliability information for the 3-1 feature map and the 3-2 feature map, and then selects the feature map with a higher reliability value according to the preset standard. It can be determined by the final feature map.

The window set information calculation artificial neural network module may include a pre-trained first artificial neural network that uses the first input information as input information and outputs a 1-1 feature map corresponding to the image information as output information. You can.

The feature extraction unit may extract a 1-2 feature map having a scale value different from the scale value of the 1-1 feature map from the first artificial neural network.

The window set information calculation artificial neural network module uses the 1-1 feature map as input information, the 1-2 feature map as intermediate input information, and generates a 2-1 corresponding to the 1-1 feature map. It may include a pre-trained second artificial neural network that outputs a first feature map and a second-second feature map corresponding to the first-second feature map as output information.

The window set information calculation artificial neural network module uses the 2-1 feature map and the 2-2 feature map as input information, a 3-2 feature map corresponding to the 2-2 feature map, and the 2-2 feature map. It may include a previously learned third artificial neural network that outputs the 3-2 feature map corresponding to the 3-1 feature map as output information.

The window set information calculation artificial neural network module may further include an FC-layer that determines one of the 3-1 feature map and the 3-2 feature map as the final feature map according to a preset standard. .

The automatic window set information calculation device using the artificial neural network calculates window set information including area information and length information of windows and doors corresponding to the image information and area information and length information of frames based on the final feature map. It may further include a characteristic information calculation unit.

The light characteristic information calculation unit may calculate solar radiation gain and daylight area based on the window set information.

The feature extraction unit extracts a 1-3 feature map having a scale value different from the 1-1 feature map and the 1-2 feature map for the image information in the window set information calculation artificial neural network module. You can.

The window set information calculation artificial neural network module calculates reliability information for the 3-1 feature map, the 3-2 feature map, and the 3-2 feature map, and then calculates the feature with a higher reliability value. The map may be determined as the final feature map according to the preset criteria.

According to one embodiment, a method for automatically calculating window set information using an artificial neural network uses first input information including image information as input information, and outputs a 1-1 feature map corresponding to the image information as output information. A first feature map generating step of outputting the 1-1 feature map using a previously learned first artificial neural network, a 1-1 feature map and a 1-2 feature having different scale values for the image information A feature extraction step of extracting a map through the first artificial neural network, applying convolution to the 1-1 feature map and the 1-2 feature map respectively to create a 3-1 feature map and a 3-2 feature map. After determining one of the 3-1 feature map and the 3-2 feature map as the final feature map according to the 3rd feature map generation step of generating a map and a preset standard, the window is displayed based on the selected final feature map. A window set information calculation step of calculating set information may be included.

A method of automatically calculating window set information using an artificial neural network according to an embodiment includes window set information including area information and length information of windows and doors corresponding to the image information and area information and length information of frames based on the final feature map. A window set information calculation step may be further included.

According to one embodiment, an automatic calculation device for window set information using an artificial neural network uses first input information including image information as input information, and uses window set information extracted from the image information as output information. a window set information calculating artificial neural network module, the window set information calculating artificial neural network module including a feature extraction unit for extracting a 1-1 feature map and a 1-2 feature map having different scale values for the image information; And the window set information calculation artificial neural network module generates a 3-1 feature map and a 3-2 feature map by applying convolution to the 1-1 feature map and the 1-2 feature map, respectively. Then, one of the 3-1 feature map and the 3-2 feature map is determined as the final feature map according to a preset standard, and then the window set information is calculated based on the selected final feature map, and the window set information is calculated based on the selected final feature map. The set information calculating artificial neural network module can perform learning using labeling information labeled with window set information included in the image information.

The window set information calculating artificial neural network module may perform learning by using second input information including the labeling information together with the first input information as input information of the window set information calculating artificial neural network module.

According to one embodiment, the method and device for automatically calculating window set information using an artificial neural network labels the shape of the window in the window set image of the building and learns this with the algorithm of the artificial neural network module, so that the window set shape information of the building can be quickly obtained using only a photographic image. It can be extracted within time, and there is an advantage in being able to detect the shape information of the window set and extract the window set information even when an unlearned window set image is input.

In addition, the method and device for automatically calculating window set information using an artificial neural network according to an embodiment have the effect of continuously improving accuracy by automatically performing additional learning by auto-labeling new images.

In addition, the method and device for automatically calculating window set information using an artificial neural network according to an embodiment facilitates information on the optical characteristics of the window set, such as solar radiation gain and daylight area, by using the extracted window set information. There are advantages that can be derived.

In order to more fully understand the drawings cited in the detailed description of the present invention, a brief description of each drawing is provided.

Figure 1 is a diagram illustrating some components of a method and device for automatically calculating window set information using an artificial neural network according to an embodiment of the present invention.

Figure 2 is a diagram showing the components of a window set to be measured in the present invention.

Figure 3 is a diagram illustrating input information and output information when inferred by an artificial neural network module for calculating window set information according to an embodiment of the present invention.

Figure 4 is a diagram illustrating input information and output information when the window set information calculating artificial neural network module learns according to an embodiment of the present invention.

Figure 5 is a diagram specifically illustrating the configuration of an artificial neural network module for calculating window set information according to an embodiment of the present invention.

Figure 6 is a diagram briefly illustrating the process of an artificial neural network module for calculating window set information according to an embodiment of the present invention.

Figure 7 is a diagram illustrating in detail the process of the artificial neural network module for calculating window set information according to an embodiment of the present invention.

Figure 8 is a diagram for explaining the process of a first artificial neural network according to an embodiment of the present invention.

Figure 9 is a diagram for explaining the process of a second artificial neural network according to an embodiment of the present invention.

Figure 10 is a diagram showing the final output information of the artificial neural network module for calculating window set information according to an embodiment of the present invention.

Figure 11 is a diagram for explaining a learning method of an artificial neural network module for calculating window set information, according to an embodiment of the present invention.

Figure 12 is a diagram illustrating a method of labeling learning data according to an embodiment of the present invention.

Figure 13 is a diagram illustrating a method for calculating solar heat gain by a window set information calculation device according to an embodiment of the present invention.

FIG. 14 is a graph showing solar radiation gain by month/year of a window set calculated according to the method shown in FIG. 13.

Figure 15 is a diagram illustrating a method for calculating a daylight area by a window set information calculation device according to an embodiment of the present invention.

Figure 16 is a diagram comparing the value of the daylight area derived by the window set information calculation device and the value derived by the finite element analysis result according to an embodiment of the present invention.

Hereinafter, embodiments according to the present invention will be described with reference to the attached drawings. When adding reference signs to components in each drawing, it should be noted that the same components are given the same reference numerals as much as possible even if they are shown in different drawings. Additionally, when describing embodiments of the present invention, if detailed descriptions of related known configurations or functions are judged to impede understanding of the embodiments of the present invention, the detailed descriptions will be omitted. In addition, embodiments of the present invention will be described below, but the technical idea of the present invention is not limited or limited thereto and may be modified and implemented in various ways by those skilled in the art.

Additionally, the terms used in this specification are used to describe embodiments and are not intended to limit and/or limit the disclosed invention. Singular expressions include plural expressions unless the context clearly dictates otherwise.

In this specification, terms such as “comprise,” “provide,” or “have” are intended to designate the presence of features, numbers, steps, operations, components, parts, or combinations thereof described in the specification. It does not exclude in advance the existence or addition of other features, numbers, steps, operations, components, parts, or combinations thereof.

In addition, throughout the specification, when a part is said to be “connected” to another part, this refers not only to the case where it is “directly connected” but also to the case where it is “indirectly connected” with another element in between. Terms including ordinal numbers, such as “first” and “second,” used in this specification may be used to describe various components, but the components are not limited by the terms.

Below, with reference to the attached drawings, embodiments of the present invention will be described in detail so that those skilled in the art can easily implement the present invention. In order to clearly explain the present invention in the drawings, parts unrelated to the description are omitted.

Meanwhile, the name of the present invention is described as 'A method and device for automatically calculating window set information using an artificial neural network,' but in the specification below, for convenience of explanation, 'A device for automatically calculating window set information using an artificial neural network' is referred to as 'Calculating window set information.' It will be referred to as 'device', and 'window set information automatic calculation method using artificial neural network' will be referred to as 'window set information calculation method'.

Figure 1 is a diagram showing some components of an automatic window set information calculation device using an artificial neural network according to an embodiment of the present invention.

Referring to FIG. 1, the window set information calculation device 1 using an artificial neural network according to an embodiment includes a labeling information generator 100, a processor 200, an optical characteristic information generator 400, and a memory module 500. ) may include. The components of the window set information calculation device 1 according to the present invention are not limited to those configured in FIG. 1, and may be implemented with fewer components than those shown, or by additionally combining other components.

The labeling information generation unit 100 refers to a generation unit that generates data necessary for the window set information calculation artificial neural network module 300 (see FIG. 3) according to the present invention to perform learning.

The labeling information generator 100 is a component that generates data for the window set information generating artificial neural network module 300 to learn or infer. The data generated by the labeling information generator 100 includes the window set information calculating artificial neural network module 300. It contains specific numerical information and area information regarding the window set corresponding to the image input to the neural network module 300. This can serve as learning data for the window set information calculating artificial neural network module 300 to perform learning.

The labeling data generated by the labeling information generation unit 100 may be input as input information together with the image information 10 to the window set information calculation device 1, or may be used as reference information corresponding to inferred information output later. . A detailed explanation of this will be provided later.

The processor 200 may serve to control the overall operation of the window set information calculation device 1 according to the present invention. The processor 200 includes a window set information calculation artificial neural network module 300, and can calculate area information and numerical information about the window set from the image input to the processor 200. The specific processor of the window set information calculation artificial neural network module 300 will be described in detail with reference to FIGS. 3 to 9.

The light characteristic information generator 400 generates an amount of solar radiation corresponding to the light characteristic value of the window set flowing into the building, based on the area information and numerical information about the window set calculated by the processor 200. heat gas) and daylight area can be calculated. A detailed explanation of this will be provided through FIGS. 13 to 16.

The memory module 500 includes input image information 10, labeling data generated by the labeling information generator 100, window set information generated by the process 200, and light generated by the optical characteristic information generator 400. Characteristic information, etc. may be stored, and various information about the building being analyzed may be stored.

Meanwhile, in FIG. 1, the memory module 500 and the processor 200 are shown as separate components, but the embodiment of the present invention is not limited thereto, and the memory module 500 and the processor 200 are one component. The present invention may be implemented by combining.

Window sets installed in buildings include various components such as windows, frames, and panels. In order to accurately calculate window set information, information on where these components are located and the area and length they occupy must be known.

Specifically, as shown in (A) of Figure 2, the window set includes a mullion corresponding to a vertical frame, a window corresponding to a fixed window, a transom corresponding to a horizontal frame, and a T/T window corresponding to an opening/closing window. , panels corresponding to spandrels, etc., and their areas and values can be defined in various ways.

Specifically, the window set information includes the total width, total height, total area, mullion/transom frame area, fixed window glass area, T/T window glass area, and T of the window set, as shown in (B) of Figure 2. /TCan include information about window frame area, panel area, panel-mullion/transom length, glass-mullion/transom length, frame-mullion/transom length, glass-frame length, etc.

When an image is input as input information as shown in (A) of FIG. 2, the window set information calculation device 100 according to the present invention includes division information dividing the components in the image and numerical information for each component. The purpose is to automatically calculate as shown in (B) of Figure 2. Let us learn more about the specific process of the present invention through the drawings below.

Figure 3 is a diagram showing input information and output information when inferred by the window set information calculating artificial neural network module according to an embodiment of the present invention, and Figure 4 is a diagram showing the artificial neural network module calculating window set information according to an embodiment of the present invention. This diagram shows the input information and output information when the neural network module learns.

Referring to Figures 3 and 4, the window set information calculating artificial neural network module 300 according to the present invention uses first input information including image information 10 as input information, and inputs information from the input image information 10. It refers to a pre-trained artificial neural network whose output information includes window set information 40 that extracts area information and numerical information about the window set.

As shown in FIG. 4, the window set information calculating artificial neural network module 300 according to the present invention includes first input information 10 including image information, output information 40 including window set information, and output information. It may include a learning session that performs learning based on reference information (ground truth, 50) corresponding to (40), and an inference session that infers first output information (40) based on first input information (10). You can. Although the drawing shows the learning session and the inference session separately, the embodiment of the present invention is limited to this and the learning session and the inference session may be implemented separately.

Meanwhile, in the case of the present invention, when the window set information calculating artificial neural network module 300 performs learning, learning may be performed based on the first output information 40 and reference information 50 as shown in the figure. , Learning may be performed by inputting numerical information corresponding to image information into the window set information calculation artificial neural network module 300.

Specifically, the input information input to the window set information calculation artificial neural network module 300 includes first input information 10 including image information and second input information labeled with numerical information about the window set included in the image information. Since the input information 20 is included, the window set information calculation artificial neural network module 300 can perform learning based on the two input information.

Meanwhile, in the present invention, performing learning means adjusting the parameters of the artificial neural network, and the second input information 20 input to the window set information calculation artificial neural network module 300 is the labeling information generator ( 100) may refer to labeling information corresponding to the image information generated. This will be explained later with reference to FIG. 12.

Figures 5 to 9 are diagrams for explaining the learning method of the window set information calculating artificial neural network module 300, and Figure 5 specifically shows the configuration of the window set information calculating artificial neural network module according to an embodiment of the present invention. This is a drawing.

Referring to FIG. 5, the window set information calculation artificial neural network module 300 according to the present invention includes a first artificial neural network 310, a second artificial neural network 320, a third artificial neural network 330, and an FC-layer 340. ) may include.

Meanwhile, in FIG. 5, the window set information calculating artificial neural network module 300 is shown divided into three artificial neural networks and one FC-layer, but this is for convenience of explanation and the embodiment of the present invention is not limited thereto. Therefore, all three artificial neural networks can be combined to form one artificial neural network, or all three artificial neural networks and one FC-layer can be combined to form one artificial neural network.

The first artificial neural network 310 includes first input information 10 including image information and second input information 20 including at least one of numerical information and area information about the window set included in the image information. It refers to a pre-trained artificial neural network that uses input information, applies convolution to the image information, and outputs the 1-1 feature map 11 as output information.

Meanwhile, in the case of the first artificial neural network 310, since the convolution operation is performed multiple times, a plurality of feature maps with different scales may be generated internally in the first artificial neural network 310. You can.

Therefore, the feature map extraction method (not shown) extracts the 1-2 feature map 12 and the 1-3 feature map 13 from the first artificial neural network 310, and then extracts the 1-2 feature map 12 and the 1-3 feature map 13 from the first artificial neural network 310. It can be output as intermediate output information of the artificial neural network 310, and the intermediate output information output in this way can be input as intermediate input information of the second artificial neural network 320 in parallel.

Meanwhile, in Figure 5, the intermediate output information output as intermediate output information of the first artificial neural network 310 is shown as two pieces (1-2 feature map and 1-3 feature map), but the embodiment of the present invention is like this. It is not limited. As described above, since the feature maps corresponding to the intermediate output information output by the first artificial neural network 310 refer to feature maps having a scale value different from that of the 1-1 feature map 11, Depending on the purpose of the invention, the number of feature maps corresponding to intermediate output information can be freely modified.

As an example, two, four, or five feature maps may be implemented with a scale value different from that of the 1-1 feature map 11, and in this case, each feature map may have a different scale value. You can. For convenience of explanation below, the description will be limited to two feature maps, which are intermediate output information of the first artificial neural network 310, namely the 1-1 feature map 11 and the 1-2 feature map 12.

The second artificial neural network 320 includes the 1-1 feature map 11 output by the first artificial neural network 310 and the 1-2 feature map 12, which is intermediate output information of the first artificial neural network 310. A convolution operation is performed based on the 1-3 feature map 13, and the 2-1 feature map 21, which strengthens the features of the 1-1 feature map 11, the 1-2 feature map ( The 2-2 feature map 22, which enhances the features of 12), and the 2-3 feature map 23, which enhances the features of the 1-3 feature map 13, can be output as output information.

As described above, if the intermediate output information of the first artificial neural network 310 is one, the output information output by the second artificial neural network 320 may be a total of two (2-1 feature map and 2- 2 feature map), when the intermediate output information of the first artificial neural network 310 is three, a total of four pieces of output information can be output by the second artificial neural network.

The third artificial neural network 330 inputs the 2-1 feature map 21, the 2-2 feature map 22, and the 2-3 feature map 23 output from the second artificial neural network 320. Thus, a convolution operation is independently performed on each input feature map to obtain the 3-1 feature map 31, 3-2 feature map 32, and 3-3 including the anchor box image. The feature map 33 can be output as output information.

The FC-layer (340, Fully-connected Layer) includes the 3-1 feature map (31), the 3-2 feature map (32), and the 3-3 feature map (33) output by the third artificial neural network (330). ) can be analyzed individually to output a preset standard (a map with the most reliable information output) as the final output information.

The purpose of the artificial neural network module 300 for calculating window set information according to the present invention is to extract area information about the window set from the input image information 10 and calculate numerical information from the extracted area information. To achieve this, window set information is calculated using multiple artificial neural networks.

Therefore, the window set information calculation artificial neural network module 300 extracts a first feature map that extracts image features for the input image information 10 using the first artificial neural network 310, as shown in FIG. 6, and , extracting the second feature map through a process of enhancing image features for the extracted first feature map, and extracting the third feature through a process of extracting final object detection information for the extracted second feature map. The map can be extracted. Let's learn more about the process of each artificial neural network through the drawings below.

Figure 7 is a diagram illustrating in detail the process of the artificial neural network module for calculating window set information according to an embodiment of the present invention. FIG. 8 is a diagram for explaining the process of a first artificial neural network according to an embodiment of the present invention, and FIG. 9 is a diagram for explaining the process of a second artificial neural network according to an embodiment of the present invention.

Referring to FIGS. 7 and 8, the first artificial neural network 310 is an artificial neural network that extracts features from the input image information 10, and applies a convolution-based network to generate the 1-1 feature map (11). ) can be extracted.

Specifically, the first artificial neural network 310 can serve to convert input image information from three-dimensional data to one-dimensional data using a convolution-based BottleNeck-CSP (Cross Stage Neterok) network. there is.

The first process of the first artificial neural network 310 is the focus step, which is a process in which model calculation can be easily performed by unifying several images in a certain format (for example, 3 x 1024 x 1024). The advantage of doing this is that the effect of learning is accelerated.

When the focus step is completed, the first artificial neural network 310 extracts features from the input image information by repeating the pass through the convolution layer and BottleneckCSP multiple times. BottleneckCSP is a structure that compresses the channel of the input value, extracts features, and increases the channel again.

256 channels are reduced to 64 channels through Conv 1 x1, which has the effect of reducing the amount of computation.

Afterwards, since it is impossible to extract spatial features from Conv 1x1, features are extracted from Conv 3x3. Afterwards, the channels are expanded again to 256 and the parameters are reduced to Conv 1x1. When the first artificial neural network 310 performs learning, the more features in the feature map the better the learning, so the number of channels was increased through Conv 1x1.

After the convolution layer in the first artificial neural network 310, it goes through a batch normalization process and proceeds to BottleneckCSP. In this step, four convolutional layers are created, two of which are connected to each other through a short-connection to derive the calculated value, and the calculated values from other convolutional layers are combined to pass through the remaining convolutional layer. 1Artificial neural network (310) was implemented. Afterwards, the calculation was performed by applying batch normalization only to the first and fourth layers.

As the last step of the first artificial neural network 310, the extracted feature map is arranged in a fixed one-dimensional form through the SPP (Spatial Pyramid Pooling Layer) process, and then the feature map to which the SPP process is applied is an FC-layer (Fully). By allowing it to be input as input information of the Connected Layer, the final output information of the first artificial neural network 310 becomes the 1-1 feature map 11.

Meanwhile, as shown in the figure, the first artificial neural network 310 can output the 1-2 feature map 12 and the 1-3 feature map 13 as intermediate output information, where the 1-2 feature The map 12 and the 1-3 feature map 13 refer to feature maps having different scale values from the 1-1 feature map 11.

That is, since the input image information 10 is structured in layers so that the number of channels increases as it passes through the first artificial neural network 310 step by step, the scale of the feature map changes accordingly each time it passes through the layer. Therefore, the 1-3 feature map 13 is a feature map with a smaller number of channels than the 1-2 feature map 12, and the 1-2 feature map 12 is a feature map with a smaller number of channels than the 1-2 feature map 12. ), and the feature maps extracted in the intermediate process of the first artificial neural network 310 are input as intermediate input values of the second artificial neural network 320.

The second artificial neural network 320 is an artificial neural network composed of a PANet (Path-Aggregation Network) stage that specifies features for the feature map that has passed through the first artificial neural network 310, and strengthens the information flow. It corresponds to an artificial neural network that aims to

Specifically, the second artificial neural network 320 is an artificial neural network that collects and processes feature maps of various sizes (with various scale values) through the first artificial neural network 310, and uses the low level acquired in the previous stage. )'s feature map is not properly input to the convolution layer at the back, so there is a feature that improves the accuracy of localization by strengthening the entire feature layer through bottom-up path augmentation.

A shortcut connecting the bottom layer to the top layer and a convolution layer enable smooth flow compared to the existing backbone model.

The Concat layer 321 of the second artificial neural network plays the role of combining the upsampling layer 325 corresponding to the immediately preceding layer in the second artificial neural network 320 and the third CSP layer 313 of the first artificial neural network 310. Perform.

Specifically, the second artificial neural network 320 uses a total of four Concat layers (321, 322, 323, 324), and the first Concat layer is connected to the third CSP layer 313 of the first artificial neural network 310, and the first artificial neural network 310 is connected to the third CSP layer 313. The second Concat layer 322, which combines the CSP layer 313 of (310) and the upsampling layer, detects small-scale objects, and the remaining two Concat layers 323 and 324 detect the CSP of the second artificial neural network 320 and The Conv layer is combined to detect medium-scale and large-scale objects.

Therefore, the 2-1 feature map 21 passed through the 2nd concat (322) layer, the 2-2 feature map 22 passed through the 3rd contact (323) layer, and the 2-2 feature map 22 passed through the 4th contact (324) layer. The 2-3 feature maps 23 have different scales (the scale of the 2-3 feature map is the largest, the scale of the 2-2 feature map is medium, and the scale of the 2-1 feature map is (smallest) feature maps are output, respectively, and the feature maps output in this way are each input as input information to the third artificial neural network 330.

The third artificial neural network 330 performs convolution on the scales of the three input images and finally converts the resulting values into the 3-1 feature map 31, the 3-2 feature map 32, and the 3- 3 Derived from feature map (33). The resulting value uses a multi-scale feature map to quickly generate anchor boxes with fast inference speed.

The three feature maps output from the third artificial neural network 330 are finally input to the FC-layer 340, and in the FC-layer, window set information is calculated based on the most reliable feature map among the three feature maps. (Area information and numerical information) are output as final output information of the window set information calculation artificial neural network module 300.

Figure 10 is a diagram showing the final output information of the window set information calculating artificial neural network module 300 according to an embodiment of the present invention.

Referring to FIG. 10, the final output information can be output as an anchor box image that divides the window set into sections, and it can be seen that the image is derived by accurately creating an anchor box only in the portion corresponding to the glass in the image. In addition, it can be seen that the discrimination results are good because the obstacles blocking the front of the window set and the images reflected on the windows are also reflected in deep learning learning.

Additionally, as shown in the drawing, the final information may include information about the window number and corresponding X-coordinates, Y-coordinates, width, height, etc., as text file information.

FIG. 11 is a diagram illustrating a learning method of an artificial neural network module for calculating window set information, according to an embodiment of the present invention, and FIG. 12 is a diagram illustrating a method of labeling learning data, according to an embodiment of the present invention. It is a drawing.

Referring to Figures 11 and 12, the window set information calculation artificial neural network module 300 according to the present invention receives a new image as input data. Then, object detection is performed on the input image, and if the uncertainty result for object detection is lower than the target uncertainty, object data is manually created and additional learning is performed.

The method of manually generating learning data includes the process of labeling data. As shown in FIG. 12, a part corresponding to the glass area is designated in the image of the exterior wall of the building, and then the data value is labeled for the designated part. and save the data. For example, in this step, data augmentation was performed by regenerating 20 images with the contrast and brightness of the images adjusted using data augmentation.

Returning to Figure 11, object detection is performed on the input image, and if the uncertainty result for object detection is higher than the target uncertainty, the object data is increased and learned while simultaneously extracting the detected object data. did.

In the case of the present invention, since the auto-labeling method was used in this process, in the case of the present invention, when an untrained image is input to the artificial neural network model, the resulting labeling data is used for training of the artificial neural network. By using it, there was an effect of improving the accuracy of the artificial neural network model and dramatically shortening the work time.

FIG. 13 is a diagram illustrating a method by which a window set information calculation device calculates solar heat gain according to an embodiment of the present invention, and FIG. 14 is a window set monthly/year calculated according to the method shown in FIG. 13. This is a graph showing the solar radiation gain.

The optical characteristic information generator 400 according to one embodiment may calculate solar heat gain information based on the output information output by the window set information calculation artificial neural network module 300.

Referring to FIG. 13, the optical characteristics information generator 400 calculates the window area (A) based on the window set information output by the window set information calculation artificial neural network module 300, and then calculates the window area (A) as the average monthly solar radiation (I). _s ), the presence or absence of a shading device in the window set, the total effective energy transmittance (g _eff ), which includes the characteristics of single or double windows, and the glass area ratio ( _F The amount of heat gain (Q _S,tr ) can be calculated.

(Equation 1)

Q _S,tr = A x I _s xg _eff x F _F

Referring to FIG. 15, the optical characteristics information generator 400 according to one embodiment derives the maximum depth of the daylight zone through the window vertical dimension derived by the window set information calculation artificial neural network module 300. . Afterwards, the width of the daylight zone is derived using the derived horizontal dimension of the window and the maximum depth of the daylight zone, and then the daylight area can be derived as shown in Equation 2 below by using the product of the width and depth of the daylight zone. .

(Equation 2)

a _D,max = 2.5 x (h _Li -h _Ta ) [m]

In Equation 2, a _D,max refers to the maximum depth of the daylight zone, h _Li refers to the height to the top of the window, and h _Ta refers to the height to the bottom of the window.

Additionally, the optical characteristic information generator 400 can derive the maximum depth of the daylight zone through Equation 2 and the vertical dimension of the window calculated by the window set information calculation artificial neural network module 300.

(Equation 3)

b _D = b _wi x 1/2 xa _D,max [m]

In Equation 3, b _D means the width of the daylight zone, and b _wi means the width of the window.

And the optical characteristics information generation unit 400 uses Equation 3, the horizontal dimension of the window calculated by the window set information calculation artificial neural network module 300, and the derived maximum depth of the daylight zone to determine the width of the daylight zone using the equation below: It can be derived as in 4.

(Equation 4)

A _D = a _D x b _D [m ² ]

In Equation 4, A _D means the daylight area and a _D means the depth of the daylight zone. The light characteristic information generator 400 can finally derive information about the daylight area by multiplying the width and depth of the daylight zone using Equation 4 above.

Figure 16 is a diagram comparing the value for the daylight area derived by the window set information calculation device and the value derived from the finite element analysis results according to an embodiment of the present invention.

Referring to Figure 16, the main light area value (2.1100625) calculated by the present invention and the value (2.1) derived by finite element analysis have an error of only 0.48%, showing that the accuracy of the present invention is very high.

So far, we have looked at the drawings in detail about the method and device for automatically calculating window set information using an artificial neural network according to an embodiment.

The device described above may be implemented with hardware components, software components, and/or a combination of hardware components and software components. For example, devices and components described in embodiments may include, for example, a processor, a controller, an arithmetic logic unit (ALU), a digital signal processor, a microcomputer, a field programmable array (FPA), It may be implemented using one or more general-purpose or special-purpose computers, such as a programmable logic unit (PLU), microprocessor, or any other device capable of executing and responding to instructions. A processing device may perform an operating system (OS) and one or more software applications that run on the operating system. Additionally, a processing device may access, store, manipulate, process, and generate information in response to the execution of software. For ease of understanding, a single processing device may be described as being used; however, those skilled in the art will understand that a processing device includes multiple processing elements and/or multiple types of processing elements. It can be seen that it may include. For example, a processing device may include multiple processors or one processor and one controller. Additionally, other processing configurations, such as parallel processors, are possible.

Software may include a computer program, code, instructions, or a combination of one or more of these, which may configure a processing unit to operate as desired, or may be processed independently or collectively. You can command the device. Software and/or information may be used by any type of machine, component, physical device, virtual equipment, computer storage medium or device to be interpreted by or to provide instructions or information to a processing device. It can be embodied in . Software may be distributed over networked computer systems and stored or executed in a distributed manner. Software and information may be stored on one or more computer-readable recording media.

Methods according to embodiments may be implemented in the form of program instructions that can be executed through various computer means and recorded on computer-readable media. Examples of computer-readable recording media include hard disks, floppy disks, and magnetic tapes. Magnetic media, optical media such as CD-ROM and DVD, magneto-optical media such as floptical disk, and ROM and RAM ( It includes specially configured hardware devices to store and execute program instructions, such as RAM, flash memory, etc. Examples of program instructions include machine language code, such as that produced by a compiler, as well as high-level language code that can be executed by a computer using an interpreter, etc.

As described above, although the embodiments have been described with limited examples and drawings, various modifications and variations can be made by those skilled in the art from the above description. For example, the described techniques are performed in a different order than the described method, and/or components of the described system, structure, device, circuit, etc. are combined or combined in a different form than the described method, or other components are used. Alternatively, appropriate results may be achieved even if substituted or substituted by an equivalent. Therefore, other implementations, other embodiments, and equivalents of the claims also fall within the scope of the claims described below.

Claims

an artificial neural network module for calculating pre-learned window set information, which uses first input information including image information as input information, and window set information obtained by extracting window set characteristics from the image information as output information; and

In the window set information calculation artificial neural network module, a feature extraction unit that extracts a 1-1 feature map and a 1-2 feature map having different scale values for the image information,

The window set information calculation artificial neural network module,

After applying convolution to the 1-1 feature map and the 1-2 feature map respectively to generate a 3-1 feature map and a 3-2 feature map, the 3-1 feature map is generated according to a preset standard. After determining one of the first feature map and the third-second feature map as the final feature map, the window set information is calculated based on the selected final feature map.

Automatic window set information calculation device using artificial neural network.
According to claim 1,

The window set information calculation artificial neural network module,

After calculating reliability information for the 3-1 feature map and the 3-2 feature map, the feature map with a higher reliability value is determined as the final feature map according to the preset standard. doing,

Automatic window set information calculation device using artificial neural network.
According to claim 1,

The window set information calculation artificial neural network module,

Characterized in that it includes a pre-trained first artificial neural network that uses the first input information as input information and outputs a 1-1 feature map corresponding to the image information as output information,

Automatic window set information calculation device using artificial neural network.
According to clause 3,

The feature extraction unit,

Characterized in extracting a 1-2 feature map having a scale value different from the scale value of the 1-1 feature map from the first artificial neural network,

Automatic window set information calculation device using artificial neural network.
According to clause 4,

The window set information calculation artificial neural network module,

Using the 1-1 feature map as input information and the 1-2 feature map as intermediate input information, a 2-1 feature map corresponding to the 1-1 feature map, and the 1-2 Characterized by comprising a pre-trained second artificial neural network that outputs a 2-2 feature map corresponding to the feature map as output information,

Automatic window set information calculation device using artificial neural network.
According to clause 5,

The window set information calculation artificial neural network module,

The 2-1 feature map and the 2-2 feature map are input information, a 3-2 feature map corresponding to the 2-2 feature map, and a 3-2 feature map corresponding to the 3-1 feature map. 3-2 Characterized by comprising a previously learned third artificial neural network that outputs the feature map as output information,

Automatic window set information calculation device using artificial neural network.
According to clause 6,

The window set information calculation artificial neural network module,

Characterized in that it further comprises an FC-layer that determines one of the 3-1 feature map and the 3-2 feature map as the final feature map according to a preset standard,

Automatic window set information calculation device using artificial neural network.
According to clause 7,

Characterized by further comprising; an optical characteristic information calculation unit that calculates window set information including area information and length information of the window and frame area information and length information corresponding to the image information based on the final feature map; doing,

Automatic window set information calculation device using artificial neural network.
According to claim 8,

The optical characteristic information calculation unit,

Characterized in calculating the solar radiation gain and daylight area based on the window set information,

Automatic window set information calculation device using artificial neural network.
According to clause 1,

The feature extraction unit,

Characterized in that, in the window set information calculation artificial neural network module, a 1-3 feature map having a different scale value from the 1-1 feature map and the 1-2 feature map is extracted for the image information,

Automatic window set information calculation device using artificial neural network.
According to clause 10,

The window set information calculation artificial neural network module,

After calculating reliability information for the 3-1 feature map, the 3-2 feature map, and the 3-2 feature map, the feature map with a higher reliability value is selected as the final feature map according to the preset standard. Characterized by determining with a feature map,

Automatic window set information calculation device using artificial neural network.
The 1-1 feature is obtained using a previously learned first artificial neural network that uses first input information including image information as input information and outputs a 1-1 feature map corresponding to the image information as output information. A first feature map generating step of outputting a map;

A feature extraction step of extracting a 1-1 feature map and a 1-2 feature map having different scale values for the image information through the first artificial neural network;

A third feature map generating step of generating a 3-1 feature map and a 3-2 feature map by applying convolution to the 1-1 feature map and the 1-2 feature map, respectively; and

A window set information calculation step of determining one of the 3-1 feature map and the 3-2 feature map as a final feature map according to a preset standard, and then calculating window set information based on the selected final feature map; Characterized by including

Automatic calculation method of window set information using artificial neural network.
According to clause 12,

A window set information calculation step of calculating window set information including area information and length information of windows and doors and area information and length information of frames corresponding to the image information based on the final feature map. doing,

Automatic calculation method of window set information using artificial neural network.
an artificial neural network module for calculating pre-learned window set information, which uses first input information including image information as input information, and window set information obtained by extracting window set characteristics from the image information as output information;

In the window set information calculation artificial neural network module, a feature extraction unit that extracts a 1-1 feature map and a 1-2 feature map having different scale values for the image information,

The window set information calculation artificial neural network module,

After applying convolution to the 1-1 feature map and the 1-2 feature map respectively to generate a 3-1 feature map and a 3-2 feature map, the 3-1 feature map is generated according to a preset standard. After determining one of the first feature map and the third-second feature map as the final feature map, calculating the window set information based on the selected final feature map,

The window set information calculating artificial neural network module is characterized in that it performs learning using labeling information labeled with the window set information included in the image information,

Automatic window set information calculation device using artificial neural network.
According to clause 14,

The window set information calculation artificial neural network module,

Characterized in that learning is performed by using second input information including the labeling information together with the first input information as input information to the window set information calculating artificial neural network module,

Automatic window set information calculation device using artificial neural network.