JP6997664B2 - Status judgment device - Google Patents

Description

The present invention relates to a state determination device.

In recent years, deterioration diagnosis of structures such as bridges has been carried out. As an example of the deterioration diagnosis technique of a structure, Patent Document 1 discloses an inspection support device for estimating a deterioration state of a concrete structure based on a deterioration factor of the concrete structure. In this inspection support device, area information indicating the area where the concrete structure is located is used as a deterioration factor. Regional information indicates geographic characteristics that contribute to the deterioration of concrete structures, such as salt-damaged areas.

Japanese Unexamined Patent Publication No. 2016-65809

In a passage such as a bridge, an object such as a person or a vehicle passes on the passage, and it is considered that the weight of the object affects the deterioration of the passage. In the deterioration diagnosis technique described in Patent Document 1, deterioration of the structure is diagnosed in consideration of geographical characteristics, but when the deterioration of the passage is diagnosed by this technique, the deterioration of the passage is appropriately determined. May not be possible.

The present invention provides a state determination device capable of improving the determination accuracy of the deterioration state of the passage.

The state determination device according to one aspect of the present invention is a first image acquisition unit that acquires an area image that is an image of an area including one or more passages, and a passage to be determined among one or more passages. Based on the second image acquisition unit that acquires the traffic image, which is an image of an object passing on a certain target passage, and the area image, the geographical information indicating the geographical characteristics of the installation area where the target passage is located is calculated. It is provided with a geographic information calculation unit, an object information calculation unit that calculates object information about an object based on a traffic image, and a determination unit that determines a deterioration state of a target passage based on the geographic information and the object information. ..

In this state determination device, geographic information showing the geographical characteristics of the installation area where the target passage is located is calculated based on the area image including the target passage, and the traffic image of the object passing on the target passage is captured. Based on this, object information about the object is calculated. Then, the deterioration state of the target passage is determined based on the geographical information and the object information. In this way, the deterioration state of the target passage is determined in consideration of not only the geographical characteristics of the installation area but also the information about the object passing on the target passage. As a result, it is possible to improve the accuracy of determining the deterioration state of the passage.

According to the present invention, it is possible to improve the accuracy of determining the deterioration state of the passage.

FIG. 1 is a diagram showing a configuration of a passage determination system including a state determination device according to an embodiment. FIG. 2 is a block diagram showing a functional configuration of the state determination device shown in FIG. FIG. 3 is a diagram for explaining a method of extracting a selectable area. FIG. 4 is a diagram showing an example of selection of a target passage by a user. FIG. 5 is a diagram for explaining a method of determining a vehicle type of a vehicle. FIG. 6 is a diagram showing an example of a vehicle database. FIG. 7 is a diagram for explaining a method of determining a deterioration state. FIG. 8 is a flowchart showing a series of processes of the state determination method performed by the state determination device shown in FIG. FIG. 9 is a diagram showing a hardware configuration of the state determination device shown in FIG. 2.

Hereinafter, embodiments of the present invention will be described in detail with reference to the accompanying drawings. In the description of the drawings, the same elements are designated by the same reference numerals, and duplicate description will be omitted.

FIG. 1 is a diagram showing a configuration of a passage determination system including a state determination device according to an embodiment. The passage determination system 1 shown in FIG. 1 is a system for determining a deterioration state of a passage. Examples of routes include bridges, roads, and railroad tracks. For example, the degree of soundness or the degree of deterioration is used as an index indicating the deterioration state. The soundness is, for example, an index indicating that the larger the value, the worse the deterioration. The degree of deterioration is, for example, an index indicating that the larger the value, the more the deterioration. As an index indicating the deterioration state, a binary index indicating whether or not deterioration has occurred in the passage may be used. The determination result by the passage determination system 1 is used, for example, for determination of reinforcement or repair of the passage.

The passage determination system 1 includes a camera 2, a camera 3, an external server 4, and a state determination device 10. The camera 2, the camera 3, the external server 4, and the state determination device 10 are configured to be able to communicate with each other via the network NW. The network NW may be configured by either wired or wireless. Examples of network NWs include mobile communication networks, the Internet, and WANs (Wide Area Networks).

The camera 2 is an imaging device that acquires a regional image, which is an image of an area, by capturing an image of an area including a candidate passage, which is a passage that can be a determination target, from the sky. The area includes one or more candidate routes. The camera 2 is mounted on, for example, manned aircraft, unmanned aerial vehicles, and artificial satellites. As the area image, an aerial image or a satellite image may be used. The area image may be a still image or a moving image. As the camera 2, a well-known camera capable of taking an image at a resolution that can be used for processing by the state determination device 10 described later is used. The camera 2 transmits the area image to the state determination device 10.

The camera 3 is an image pickup device that acquires a moving image by taking an image of an object (moving object) such as a vehicle passing through a candidate passage. Cameras 3 are installed in all candidate passages. The camera 3 is fixedly installed in advance at a position where the object can be imaged. As the camera 3, a well-known camera capable of taking an image at a resolution that can be used for processing by the state determination device 10 described later is used. The camera 3 captures an image of the passage at a preset frame rate (fps), and transmits the captured moving image to the state determination device 10.

The external server 4 is a device that provides various environmental information used for determination of the state determination device 10. The environmental information provided by the external server 4 is information that changes over time and does not include the geographical characteristics described later. Geographical characteristics can also change over time, but environmental information and geographical characteristics differ in the rate of change. Geographical characteristics can change gradually over months to years. On the other hand, environmental information changes from moment to moment (changes dynamically).

Examples of such environmental information include meteorological information, ground information, and noise information. As the meteorological information, for example, the amount of precipitation, the amount of snowfall, and the amount of solar radiation in the area (installation area) where the passage is located are used. The installation area is predetermined for each passage. The installation area may have the same size as the area described later, or may have a different size. As the ground information, for example, the amount of sedimentation of the ground in the installation area is used. Noise information is the amount of noise in the passage. The external server 4 may be configured by one server or may be configured by a plurality of servers. These environmental information may be acquired and provided by a sensor or the like installed in the passageway.

The state determination device 10 is a device for determining a deterioration state of a passage. The functional configuration of the state determination device 10 will be described with reference to FIG. FIG. 2 is a block diagram showing a functional configuration of the state determination device shown in FIG. As shown in FIG. 2, the state determination device 10 functionally includes an image acquisition unit 11 (first image acquisition unit), a classification unit 12, an extraction unit 13, a specific unit 14, and an image acquisition unit. It includes a 15 (second image acquisition unit), an environment information acquisition unit 16, a geographic information calculation unit 17, an object information calculation unit 18, a determination unit 19, and an output unit 20.

The image acquisition unit 11 is a functional unit that acquires a regional image. The image acquisition unit 11 acquires a regional image by receiving the regional image from the camera 2. The image acquisition unit 11 outputs the acquired area image to the classification unit 12.

The classification unit 12 is a functional unit that classifies each of a plurality of areas included in the area based on geographical characteristics. As shown in FIG. 3, the classification unit 12 receives the regional image G from the image acquisition unit 11 and divides the regional image G into a plurality of partial image gms. The partial image gm is an image of the area. The area may be defined as a mesh having a rectangular shape with a side of about several hundred meters. The classification unit 12 determines which geographical characteristic each area has, and assigns a label indicating the geographical characteristic to the partial image gm of each area. Examples of geographical characteristics include residential areas, industrial areas, forest areas (mountainous areas), and coastal areas. The classification unit 12 determines the geographical characteristics of each area by using, for example, the classification model Mc generated by machine learning. That is, the geographical characteristics of each area are obtained by inputting the partial image gm of the area into the classification model Mc. The classification unit 12 outputs the area image and the area information indicating the geographical characteristics of each area to the extraction unit 13 and the geographic information calculation unit 17.

The classification model Mc is prepared in advance and stored in the classification unit 12. For example, a user captures a plurality of different areas from the sky and divides each image obtained into a rectangle. Then, the user determines the geographical characteristics of the area included in the divided partial image, and assigns a label indicating the geographical characteristics to the partial image. A classification model Mc is generated (constructed) by learning a partially image with a label as teacher data by a machine learning method such as deep learning. The classification model Mc may be a regression model obtained by linear regression, SVM (Support Vector Machine), Random forest, or the like.

The extraction unit 13 is a functional unit that extracts a selectable area from the area image. The selectable area is an area in which the target passage, which is the passage to be determined, can be selected. The rate of deterioration varies depending on the surrounding environment of the passage. In consideration of this point, in the present embodiment, a passage route having a high possibility of deterioration is selected as a determination target. The extraction unit 13 receives the area image and the area information from the classification unit 12, and extracts the selectable area based on the geographical characteristics of each area included in the area corresponding to the area image. The extraction unit 13 extracts, for example, an area having geographical characteristics that affect the deterioration of the passage. The extraction unit 13 sets a region formed by the extracted area as a selectable region.

For example, in coastal areas, there is a risk that the passage will deteriorate due to salt damage. In addition, in forest areas, there is a risk that the passageway will deteriorate due to snow cover. In consideration of these points, the extraction unit 13 may extract a partial image of the area belonging to the coastal area and the forest area from the area image. The extraction unit 13 may give a weight to each geographical characteristic and extract a partial image of an area having a weight larger than a predetermined threshold value. For example, a geographical characteristic that has a greater effect on the deterioration of a passage is given a larger weight.

The extraction unit 13 presents the user with a selectable area, for example, via a display device. As shown in FIG. 3, the extraction unit 13 may present the selectable area Rs to the user by, for example, superimposing the selectable area Rs on the area image G.

The specific unit 14 is a functional unit that specifies the target passage route. The specifying unit 14 identifies the candidate passage route selected by the user from one or more candidate passage routes belonging to the area corresponding to the area image as the target passage route. Here, the specifying unit 14 specifies the candidate passage route selected by the user among the candidate passage routes included in the selectable area as the target passage route. As shown in FIG. 4, the user uses the input device to select the target passage from the candidate passages included in the selectable area Rs with the rectangular pointer P. The specific unit 14 outputs the passage information that can uniquely identify the target passage to the image acquisition unit 15, the environment information acquisition unit 16, and the geographic information calculation unit 17.

The image acquisition unit 15 is a functional unit that acquires a passage image, which is an image of an object passing on the target passage. When the image acquisition unit 15 receives the passage information from the specific unit 14, the image acquisition unit 15 acquires the passage image by receiving a moving image from the camera 3 installed in the target passage indicated by the passage information. The image acquisition unit 15 outputs the acquired traffic image to the object information calculation unit 18.

The environmental information acquisition unit 16 is a functional unit that acquires environmental information of the installation area. Upon receiving the traffic route information from the specific unit 14, the environmental information acquisition unit 16 specifies the installation area of the target traffic route indicated by the traffic route information. The environment information acquisition unit 16 acquires the environment information of the installation area from the external server 4 by accessing the external server 4. For the determination of the determination unit 19, for example, the weather information of the installation area, the ground information of the installation area, and the noise information in the target passage are used as the environmental information.

As the amount of precipitation, for example, the average amount of precipitation in the installation area is used. The average precipitation may be the average precipitation for each year or the average precipitation in the same month as the month in which the determination is made. As the precipitation amount, the cumulative precipitation amount, which is the total precipitation amount from the completion of the target passage to the day when the determination is made, may be used. As the amount of snowfall, for example, the average amount of snowfall in the installation area is used. The average amount of snow cover may be the average amount of precipitation for each year. As the amount of snowfall, the cumulative amount of snowfall, which is the total amount of snowfall from the completion of the target passage to the day when the determination is made, may be used. As the amount of subsidence, the amount of subsidence indicating the altitude at which the ground in the installation area is submerged with respect to the reference altitude is used. As the noise amount, the average noise amount in the target passage is used. The average noise level may be the average daily noise level. As the noise amount, the integrated noise amount, which is the total noise amount from the completion of the target passage to the day when the determination is made, may be used.

The environment information acquisition unit 16 may directly acquire the environment information used for the determination of the determination unit 19 from the external server 4, or the environment used for the determination of the determination unit 19 using the information acquired from the external server 4. Information may be calculated. The environmental information acquisition unit 16 outputs the environmental information to the determination unit 19.

The geographic information calculation unit 17 is a functional unit that calculates geographic information indicating the geographical characteristics of the installation area based on the regional image. As the geographical information, for example, a residential area, an industrial area, a forest area, and a distance to the sea are used. The degree of residential area is an index showing the possibility that the installation area is a residential area. The larger the value of the degree of residential area, the higher the possibility that the installation area is a residential area. The degree of industrial land is an index showing the possibility that the installation area is an industrial land. The larger the value of the degree of industrial land, the higher the possibility that the installation area is an industrial land. The degree of forest land is an index showing the possibility that the installation area is a forest land. The larger the value of the degree of forest land, the higher the possibility that the installation area is forest land. The distance to the sea is the straight line distance from the installation position where the target passage is installed to the sea (coastline).

The geographic information calculation unit 17 calculates the residential area, the industrial area, and the forest area of the installation area according to the geographical characteristics of the area around the installation position. Specifically, the geographic information calculation unit 17 calculates the residential area, industrial area, and forest area of the installation area from the geographical characteristics of the area within a predetermined range centered on the installation position. For example, in the geographic information calculation unit 17, among the areas within a predetermined range, the number of areas whose geographical characteristics are residential areas, the number of areas whose geographical characteristics are industrial areas, and the geographical characteristics are forest areas. Calculate the residential area, industrial area, and forest area of the installation area according to the number of areas. For example, if the number of areas whose geographical characteristics are residential areas is relatively large, the degree of residential areas is set to a large value. Further, the geographic information calculation unit 17 may give a weight to the geographical characteristics of the area within a predetermined range when counting the number of areas. For example, the closer the area is to the installation position, the larger the weight is given.

The geographic information calculation unit 17 calculates the distance from the installation position to the sea based on the area image. The geographic information calculation unit 17 connects the installation position and the sea (coastline) with a straight line (line segment) in the area image, and counts the number of pixels through which the straight line passes. The geographic information calculation unit 17 calculates the distance to the sea from the number of pixels and the preset or calculated distance in real space per pixel. The geographic information calculation unit 17 may obtain the distance to the sea by acquiring the coastline information indicating the position of the coastline and calculating the straight line distance from the position where the target passage is installed to the coastline. The coastline information can be acquired from the external server 4.

The geographic information calculation unit 17 outputs the geographic information to the determination unit 19.

The object information calculation unit 18 is a functional unit that calculates object information about an object that has passed through a target passage based on a traffic image. As the object information, for example, the weight and speed of the object passing through the target passage are used. As the weight of the object, the total weight of the object that has passed through the target passageway from the completion of the completion of the target passageway to the day when the determination is made may be used. As the velocity of the object, the average velocity of the object passing through the target passage may be used. In the present embodiment, a vehicle such as an automobile will be described as an object passing through the target passage. The object may be a vehicle other than an automobile or a moving object other than the vehicle (for example, a person). When the target passage is a railroad track, the object passing through the target passage may be a vehicle such as a train.

The object information calculation unit 18 receives a passing image from the image acquisition unit 15. For example, the object information calculation unit 18 specifies a vehicle type of a vehicle such as an automobile passing on the target passage as an object passing on the target passage. The object information calculation unit 18 identifies the vehicle type of the vehicle from a frame (image) of a preset timing in the traffic image. The vehicle type can be specified by using a well-known method such as pattern recognition. FIG. 5 schematically shows an example of a method for specifying a vehicle type.

The object information calculation unit 18 stores an image database in advance. The image database is a database that stores images of vehicles. The image database is used to extract a portion of the vehicle from the traffic image received from the image acquisition unit 15. The object information calculation unit 18 extracts a portion of the vehicle from the traffic image from the cascade classifier stored in advance in the object information calculation unit 18 and the image stored in the image database.

The object information calculation unit 18 stores the vehicle database in advance. The vehicle database is a database that stores vehicle images for each vehicle type. The vehicle database is used to identify the vehicle type from the above extracted partial images. FIG. 6 is a diagram showing an example of a vehicle database. As shown in FIG. 6, the vehicle database stores images of vehicles for each vehicle type. Further, in the vehicle database, information indicating the weight (weight) of the vehicle of each vehicle type may be stored in association with the vehicle type.

The object information calculation unit 18 is stored in the cascade classifier (different from the cascade classifier for extracting the above partial image) and the vehicle database stored in advance in the object information calculation unit 18 from the extracted partial image. Identify the vehicle type from the image. The object information calculation unit 18 acquires the weight of the vehicle from the vehicle type by referring to the vehicle database.

The object information calculation unit 18 specifies the speed of the vehicle for which the vehicle type has been specified. The object information calculation unit 18 calculates the pixel displacement of the vehicle from each frame (image) constituting the traffic image (moving image) by optical flow. The object information calculation unit 18 calculates the displacement amount of the vehicle in the real space from the calculated pixel displacement and the preset or calculated distance per pixel in the real space. The object information calculation unit 18 calculates the speed of the vehicle from the calculated displacement amount of the vehicle and the frame rate of the moving image. It should be noted that the specification (calculation) of the vehicle speed from the traffic image does not necessarily have to be performed by the above method, but may be performed by any conventional method.

The object information calculation unit 18 outputs the object information to the determination unit 19. When a person passes through the target passage, the object information calculation unit 18 may use the weight and speed of the passerby as object information, as in the case of a vehicle. The object information calculation unit 18 may include the number of passersby in the object information.

The determination unit 19 is a functional unit that determines the deterioration state of the target passage based on the geographical information and the object information. In the present embodiment, the determination unit 19 further bases the target on the in-service period of the target passage (elapsed time since the completion of the target passage) and the environmental information of the installation area in addition to the geographical information and the object information. Determine the deterioration state of the passage. The service period can be obtained from the external server 4. As shown in FIG. 7, the determination unit 19 determines the deterioration state of the target passage using, for example, the prediction model Md generated by machine learning. In this embodiment, soundness is used as an index indicating a deterioration state. That is, the soundness of the target passage is obtained by inputting the values of each parameter (geographical information, object information, service period, and environmental information) into the prediction model Md.

The prediction model Md is prepared in advance and stored in the determination unit 19. For example, a prediction model Md is generated (constructed) by learning by a machine learning method such as deep learning using the value of a passage parameter whose soundness is known as training data. The prediction model Md may be a regression model obtained by linear regression, SVM, Random forest, or the like.

The determination unit 19 outputs the result information, which is information indicating the determination result, to the output unit 20. The result information is, for example, information indicating the soundness. The result information may be information indicating the degree of deterioration, or may be information indicating whether or not deterioration has occurred in the target passage.

The output unit 20 is a functional unit that outputs result information. The output unit 20 may output the result information to a display device such as a display included in the state determination device 10 and display the determination result, for example. The output unit 20 may transmit the result information to another terminal connected to the state determination device 10 and display the determination result. The output by the output unit 20 is referred to by, for example, the user of the passage determination system 1, and is used for determination of reinforcement or repair of the passage as described above. The output unit 20 may output the result information to a device other than the above, or may output the result information in a form other than the above.

Next, a state determination method performed by the state determination device 10 will be described with reference to FIG. FIG. 8 is a flowchart showing a series of processes of the state determination method performed by the state determination device shown in FIG. The series of processes shown in FIG. 8 is started, for example, by the user taking an image of an area including a passage with a camera 2.

First, the area is imaged from the sky by the camera 2, so that the area image is acquired and the area image is transmitted from the camera 2 to the state determination device 10. Then, the image acquisition unit 11 acquires the regional image by receiving the regional image from the camera 2 (step S11). Then, the image acquisition unit 11 outputs the regional image to the classification unit 12.

Subsequently, when the classification unit 12 receives the area image from the image acquisition unit 11, each area included in the area corresponding to the area image is classified based on the geographical characteristics (step S12). Specifically, the classification unit 12 determines which geographical characteristic each area has by using the classification model Mc (see FIG. 3), and puts a label indicating the geographical characteristic on the portion of each area. Give to the image. Then, the classification unit 12 outputs the area image and the area information to the extraction unit 13 and the geographic information calculation unit 17.

Subsequently, when the extraction unit 13 receives the area image and the area information from the classification unit 12, the extraction unit 13 extracts the selectable area from the area image based on the geographical characteristics of each area (step S13). Then, the extraction unit 13 presents the selectable area to the user via the display device.

Subsequently, the specific unit 14 determines whether or not the target passage has been selected from the candidate passages included in the selectable area by the user (step S14). When the specific unit 14 determines that the target passage has not been selected (step S14: NO), the specific unit 14 repeats the determination in step S14 until the target passage is selected. Then, when the specific unit 14 determines that the target traffic route has been selected (step S14: YES), the specific unit 14 transfers the traffic route information indicating the target traffic route to the image acquisition unit 15, the environmental information acquisition unit 16, and the geographic information calculation unit 17. Output.

Subsequently, when the image acquisition unit 15 receives the passage information from the specific unit 14, the image acquisition unit 15 acquires the passage image by receiving a moving image from the camera 3 installed in the target passage indicated by the passage information (). Step S15). Then, the image acquisition unit 15 outputs the acquired traffic image to the object information calculation unit 18.

Subsequently, when the environmental information acquisition unit 16 receives the passage information from the specific unit 14, the environment information acquisition unit 16 identifies the installation area of the target passage indicated by the passage information. Then, the environment information acquisition unit 16 acquires the environment information of the installation area from the external server 4 by accessing the external server 4 (step S16). Then, the environmental information acquisition unit 16 outputs the environmental information to the determination unit 19.

Subsequently, when the geographic information calculation unit 17 receives the area image and the area information from the classification unit 12, and receives the passage information from the specific unit 14, the geographic information calculation unit 17 installs the target passage indicated by the passage information based on the area image. The geographic information of the area is calculated (step S17). For example, the geographic information calculation unit 17 calculates the residential area, the industrial area, the forest area, and the distance to the sea as geographic information for the installation area. Then, the geographic information calculation unit 17 outputs the geographic information to the determination unit 19.

Subsequently, when the object information calculation unit 18 receives the passage image from the image acquisition unit 15, the object information calculation unit 18 calculates the object information regarding the object passing through the target passage based on the passage image (step S18). For example, the object information calculation unit 18 calculates the weight and speed of an object that has passed through the target passage as object information. Then, the object information calculation unit 18 outputs the object information to the determination unit 19.

Subsequently, when the determination unit 19 receives the geographic information from the geographic information calculation unit 17, the object information from the object information calculation unit 18, and the environmental information from the environmental information acquisition unit 16, the in-service period of the target passage and the geography Based on the information, the object information, and the environmental information, the deterioration state of the target passage is determined (step S19). Specifically, the determination unit 19 determines the deterioration state of the target passage using the prediction model Md (see FIG. 7). Then, the determination unit 19 outputs the result information indicating the determination result to the output unit 20.

Subsequently, when the output unit 20 receives the result information from the determination unit 19, the output unit 20 outputs the result information (step S20). For example, the output unit 20 transmits the determination result to the display device included in the state determination device 10 and displays the determination result.

As described above, a series of processes of the state determination method performed by the state determination device 10 is completed.

A series of processes including acquisition of a traffic image in step S15 and calculation of object information in step S18, acquisition of environmental information in step S16, and calculation of geographic information in step S17 are performed in an arbitrary order. It may be done in parallel. That is, in steps S15 to S18, step S18 is performed after step S15, but the processing order other than that is arbitrary. Steps S16 and S17 may be performed before step S15, or may be performed in parallel with step S15. Steps S16 and S17 may be performed after step S18, or may be performed in parallel with step S18. Further, step S16 may be performed after step S17, or may be performed in parallel with step S17.

As described above, in the state determination device 10, the geographical information indicating the geographical characteristics of the installation area is calculated based on the area image including the target passage, and the traffic image obtained by capturing the object passing on the target passage is obtained. Based on this, object information about the object is calculated. Then, the deterioration state of the target passage is determined based on the geographical information and the object information. In this way, the deterioration state of the target passage is determined in consideration of not only the geographical characteristics of the installation area but also the information about the object passing on the target passage. As a result, it is possible to improve the accuracy of determining the deterioration state of the passage. Further, in the state determination device 10, it is not necessary to prepare an image to the extent that deterioration (damage) occurring in the passage can be recognized, so that the work efficiency can be improved and such an image is stored. Memory capacity can be reduced.

The specifying unit 14 specifies the candidate passage route selected by the user from among the one or more candidate passage routes included in the regional image as the target passage route. Therefore, the user can select the target passage route, which improves convenience.

The extraction unit 13 extracts the selectable area from the area image, and the specific unit 14 specifies the candidate passage route selected by the user among the candidate passage routes included in the selectable region as the target passage route. Since the range in which the user can select the target passage is limited to the selectable area, the maximum number of target passages that can be selected is reduced as compared with the case where the selectable area is not set. As a result, the calculation load performed by the state determination device 10 can be reduced. That is, it is possible to reduce the processing load of hardware resources such as a processor in the state determination device 10.

The classification unit 12 classifies each of the plurality of areas included in the area based on the geographical characteristics. The extraction unit 13 extracts selectable areas based on the geographical characteristics of the plurality of areas. The rate of deterioration varies depending on the surrounding environment of the target passage. For example, by setting an area formed by an area having geographical characteristics that affect the deterioration of the passage as a selectable area, it is possible to select a passage that is likely to be deteriorated as a target passage. can.

The determination unit 19 determines the deterioration state of the target passage based on the environmental information. Environmental information such as precipitation and noise also affects the deterioration of traffic routes. Therefore, by considering the environmental information, it is possible to further improve the accuracy of determining the deterioration state of the passage.

The determination unit 19 determines the deterioration state of the target passage based on the service period of the target passage. The longer the target traffic route is in service, the worse the target traffic route will be. Therefore, by considering the service period, it is possible to further improve the accuracy of determining the deterioration state of the passage.

Although the embodiment of the present invention has been described above, the present invention is not limited to the above embodiment.

In the above embodiment, the target passage is selected from the selectable area, but the target passage may be selected from the entire area image (region). In this case, the state determination device 10 does not have to include the extraction unit 13. The specifying unit 14 identifies the candidate passage route selected by the user from one or more candidate passage routes belonging to the area corresponding to the area image as the target passage route.

Environmental information may not be used to determine the deterioration of the passage. In this case, the state determination device 10 does not have to include the environment information acquisition unit 16. Further, the service period may not be used for determining the deterioration of the passage.

The geographic information calculation unit 17 calculates the geographic information of the installation area based on the geographical characteristics of each area determined by the classification unit 12, but the geographical characteristics of each area are used in the calculation of the geographic information. It does not have to be used. The geographic information calculation unit 17 inputs geographical information (residential area, industrial area, forest area, and distance to the sea) by inputting a regional image into a model stored in advance in the geographic information calculation unit 17. It may be calculated (acquired). In this case, the state determination device 10 does not have to include the classification unit 12.

In the present embodiment, the camera 3 takes an image and acquires a traffic image, but it is not always necessary to acquire a moving image when only the vehicle type is specified from the image. In this case, the camera 3 may acquire a still image.

Further, since the passage route determination system 1 only needs to be able to acquire a regional image and a moving image, it may have a configuration in which each image can be acquired from other than the passage route determination system 1.

The state determination device 10 may include a camera 2 or a camera 3. Further, although the state determination device 10 acquires the environmental information from the external server 4, the state determination device 10 may include a storage unit for storing the environmental information of each passage instead of this configuration. In this case, the environmental information acquisition unit 16 may acquire environmental information from the storage unit.

The block diagram used in the description of the above embodiment shows a block of functional units. These functional blocks (components) are realized by any combination of hardware and / or software. Further, the means for realizing each functional block is not particularly limited. That is, each functional block may be realized by one physically and / or logically coupled device, or directly and / or indirectly by two or more physically and / or logically separated devices. (For example, wired and / or wireless) may be connected and realized by these plurality of devices.

For example, the state determination device 10 in one embodiment of the present invention may function as a computer that processes the state determination device 10 of the present embodiment. FIG. 9 is a diagram showing an example of the hardware configuration of the state determination device 10 according to the present embodiment. The above-mentioned state determination device 10 may be physically configured as a computer device including a processor 1001, a memory 1002, a storage 1003, a communication device 1004, an input device 1005, an output device 1006, a bus 1007, and the like.

In the following description, the word "device" can be read as a circuit, a device, a unit, or the like. The hardware configuration of the state determination device 10 may be configured to include one or more of the devices shown in the figure, or may be configured not to include some of the devices.

For each function in the state determination device 10, by loading predetermined software (program) on hardware such as the processor 1001 and the memory 1002, the processor 1001 performs an calculation, communication by the communication device 1004, and the memory 1002 and the storage. It is realized by controlling the reading and / or writing of data in 1003.

Processor 1001 operates, for example, an operating system to control the entire computer. The processor 1001 may be composed of a central processing unit (CPU) including an interface with a peripheral device, a control device, an arithmetic unit, a register, and the like. For example, each function of the state determination device 10 may be realized by the processor 1001.

Further, the processor 1001 reads a program (program code), a software module, and data from the storage 1003 and / or the communication device 1004 into the memory 1002, and executes various processes according to these. As the program, a program that causes a computer to execute at least a part of the operations described in the above-described embodiment is used. For example, each function of the state determination device 10 may be realized by a control program stored in the memory 1002 and operated by the processor 1001. Although it has been described that the various processes described above are executed by one processor 1001, they may be executed simultaneously or sequentially by two or more processors 1001. Processor 1001 may be mounted on one or more chips. The program may be transmitted from the network via a telecommunication line.

The memory 1002 is a computer-readable recording medium, and is composed of at least one such as a ROM (Read Only Memory), an EPROM (Erasable Programmable ROM), an EEPROM (Electrically Erasable Programmable ROM), and a RAM (Random Access Memory). May be done. The memory 1002 may be referred to as a register, a cache, a main memory (main storage device), or the like. The memory 1002 can store a program (program code), a software module, or the like that can be executed to carry out the method according to the embodiment of the present invention.

The storage 1003 is a computer-readable recording medium, for example, an optical disk such as a CD-ROM (Compact Disc ROM), a hard disk drive, a flexible disk, an optical magnetic disk (for example, a compact disk, a digital versatile disk, a Blu-ray). It may consist of at least one (registered trademark) disk), smart card, flash memory (eg, card, stick, key drive), floppy (registered trademark) disk, magnetic strip, and the like. The storage 1003 may be referred to as an auxiliary storage device. The storage medium described above may be, for example, a database, server or other suitable medium containing memory 1002 and / or storage 1003.

The communication device 1004 is hardware (transmission / reception device) for communicating between computers via a wired and / or wireless network, and is also referred to as, for example, a network device, a network controller, a network card, a communication module, or the like. For example, each function of the state determination device 10 may be realized by the communication device 1004.

The input device 1005 is an input device (for example, a keyboard, a mouse, a microphone, a switch, a button, a sensor, etc.) that receives an input from the outside. The output device 1006 is an output device (for example, a display, a speaker, an LED lamp, etc.) that performs output to the outside. The input device 1005 and the output device 1006 may have an integrated configuration (for example, a touch panel).

Further, each device such as the processor 1001 and the memory 1002 is connected by a bus 1007 for communicating information. The bus 1007 may be composed of a single bus or may be composed of different buses between the devices.

Further, the state determination device 10 includes hardware such as a microprocessor, a digital signal processor (DSP: Digital Signal Processor), an ASIC (Application Specific Integrated Circuit), a PLD (Programmable Logic Device), and an FPGA (Field Programmable Gate Array). It may be configured by, and a part or all of each functional block may be realized by the hardware. For example, the processor 1001 may be implemented on at least one of these hardware.

Although the present embodiment has been described in detail above, it is clear to those skilled in the art that the present embodiment is not limited to the embodiments described in the present specification. This embodiment can be implemented as an amendment or modification without departing from the spirit and scope of the present invention as determined by the description of the scope of claims. Therefore, the description herein is for purposes of illustration only and has no limiting implications for this embodiment.

The notification of information is not limited to the embodiments / embodiments described herein, and may be performed by other methods. For example, information notification includes physical layer signaling (eg, DCI (Downlink Control Information), UCI (Uplink Control Information)), higher layer signaling (eg, RRC (Radio Resource Control) signaling, MAC (Medium Access Control) signaling, etc. It may be carried out by broadcast information (MIB (Master Information Block), SIB (System Information Block)), other signals, or a combination thereof. Further, the RRC signaling may be referred to as an RRC message, and may be, for example, an RRC Connection Setup message, an RRC Connection Reconfiguration message, or the like.

The processing procedures, sequences, flowcharts, and the like of each aspect / embodiment described in the present specification may be rearranged in order as long as there is no contradiction. For example, the methods described herein present elements of various steps in an exemplary order and are not limited to the particular order presented.

The input / output information and the like may be stored in a specific place (for example, a memory) or may be managed by a management table. Information to be input / output may be overwritten, updated, or added. The output information and the like may be deleted. The input information or the like may be transmitted to another device.

The determination may be made by a value represented by 1 bit (0 or 1), by a boolean value (Boolean: true or false), or by comparing numerical values (for example, a predetermined value). It may be done by comparison with the value).

Each aspect / embodiment described in the present specification may be used alone, in combination, or may be switched and used according to the execution. Further, the notification of predetermined information (for example, the notification of "being X") is not limited to the explicit one, but is implicitly (for example, by not notifying the predetermined information). You may.

Software, whether referred to as software, firmware, middleware, microcode, hardware description language, or other names, is an instruction, instruction set, code, code segment, program code, program, subprogram, software module. , Applications, software applications, software packages, routines, subroutines, objects, executable files, execution threads, procedures, features, etc. should be broadly interpreted.

Further, software, instructions, and the like may be transmitted and received via a transmission medium. For example, the software may use wired technology such as coaxial cable, fiber optic cable, twisted pair and digital subscriber line (DSL) and / or wireless technology such as infrared, wireless and microwave to website, server, or other. When transmitted from a remote source, these wired and / or wireless technologies are included within the definition of transmission medium.

The information, signals, etc. described herein may be represented using any of a variety of different techniques. For example, data, instructions, commands, information, signals, bits, symbols, chips, etc. that may be referred to throughout the above description are voltages, currents, electromagnetic waves, magnetic fields or magnetic particles, light fields or photons, or any of these. It may be represented by a combination of.

The terms described herein and / or the terms necessary for understanding the present specification may be replaced with terms having the same or similar meanings.

The terms "system" and "network" used herein are used interchangeably.

Further, the information, parameters, etc. described in the present specification may be represented by an absolute value, a relative value from a predetermined value, or another corresponding information. ..

The names used for the parameters mentioned above are not limited in any way. Further, mathematical formulas and the like using these parameters may differ from those expressly disclosed herein.

As used herein, the terms "determining" and "determining" may include a wide variety of actions. “Judgment” and “decision” are, for example, judgment, calculation, computing, processing, deriving, investigating, and looking up (for example, a table). , Searching in a database or another data structure), ascertaining can be regarded as "judgment" or "decision". Also, "judgment" and "decision" are receiving (for example, receiving information), transmitting (for example, transmitting information), input (input), output (output), and access. (Accessing) (for example, accessing data in memory) may be regarded as "judgment" or "decision". In addition, "judgment" and "decision" are considered to be "judgment" and "decision" when the things such as solving, selecting, selecting, establishing, and comparing are regarded as "judgment" and "decision". Can include. That is, "judgment" and "decision" may include considering some action as "judgment" and "decision".

The terms "connected", "coupled", or any variation thereof, mean any direct or indirect connection or connection between two or more elements and each other. It can include the presence of one or more intermediate elements between two "connected" or "combined" elements. The connection or connection between the elements may be physical, logical, or a combination thereof. As used herein, the two elements are by using one or more wires, cables and / or printed electrical connections, and, as some non-limiting and non-comprehensive examples, radio frequencies. By using electromagnetic energies such as electromagnetic energies with wavelengths in the region, microwave region and light (both visible and invisible) regions, they can be considered to be "connected" or "coupled" to each other.

The phrase "based on" as used herein does not mean "based on" unless otherwise stated. In other words, the statement "based on" means both "based only" and "at least based on".

As used herein by designations such as "first", "second", etc., any reference to that element does not generally limit the quantity or order of those elements. These designations can be used herein as a convenient way to distinguish between two or more elements. Therefore, references to the first and second elements do not mean that only two elements can be adopted there, or that the first element must somehow precede the second element.

As long as "include", "including", and variations thereof are used herein or within the scope of the claims, these terms are similar to the term "comprising". In addition, it is intended to be inclusive. Moreover, the term "or" as used herein or in the claims is intended to be non-exclusive.

In the present specification, a plurality of devices shall be included unless the device has only one device apparently in context or technically. The entire disclosure is intended to include more than one, unless the context clearly indicates the singular.

1 ... Traffic path determination system, 2 ... Camera, 3 ... Camera, 4 ... External server, 10 ... Status determination device, 11 ... Image acquisition unit (first image acquisition unit), 12 ... Classification unit, 13 ... Extraction unit, 14 ... Specific unit, 15 ... Image acquisition unit (second image acquisition unit), 16 ... Environmental information acquisition unit, 17 ... Geographic information calculation unit, 18 ... Object information calculation unit, 19 ... Judgment unit, 20 ... Output unit, 1001 ... Processor, 1002 ... Memory, 1003 ... Storage, 1004 ... Communication device, 1005 ... Input device, 1006 ... Output device, 1007 ... Bus.

Claims (6)

The first image acquisition unit that acquires an area image that is an image of an area including one or more passages, and
A second image acquisition unit that acquires a passage image that is an image of an object passing on the target passage, which is the passage to be determined among the one or more passages, and the second image acquisition unit.
Based on the area image, a geographic information calculation unit that calculates geographic information indicating the geographical characteristics of the installation area where the target passage is located, and
An object information calculation unit that calculates object information about the object based on the traffic image,
A determination unit for determining a deterioration state of the target passage based on the geographic information and the object information, and a determination unit.
Equipped with
The object information is a state determination device including the weight of the object . The state determination device according to claim 1, further comprising a specific unit that identifies the passage selected by the user as the target passage among the one or more passages. Further, an extraction unit for extracting a selectable area, which is a selectable area for the target passage, is provided from the area image.
The state determination device according to claim 2, wherein the specifying unit specifies a passage selected by a user among the passages included in the selectable area as the target passage. Further equipped with a classification unit that classifies each of the plurality of areas included in the area by geographical characteristics.
The state determination device according to claim 3, wherein the extraction unit extracts the selectable area based on the geographical characteristics of the plurality of areas. It is further equipped with an environmental information acquisition unit that acquires environmental information that changes over time in the installation area.
The state determination device according to any one of claims 1 to 4, wherein the determination unit determines a deterioration state of the target passage based on the environmental information. The state determination device according to any one of claims 1 to 5, wherein the determination unit determines a deterioration state of the target passage based on the service period of the target passage.

Images