JP2022155170A - Information processing system, and control method of information processing system - Google Patents

Abstract

To easily acquire temperature data of a road surface and a facility existing in the whole town, etc. and to appropriately utilize the acquired temperature data of the road surface or the facility.SOLUTION: An information processing system 1000 comprises: a thermography camera which is provided in a vehicle to photograph a road surface or a facility; a photography data acquisition unit 102 which acquires road surface temperature data which is temperature data of the road surface or facility temperature data which is temperature data of the facility from the thermography camera; a current position acquisition unit 104 which acquires position information of the vehicle when the thermography camera photographs the road surface or the facility; and an on-vehicle communication control unit 106 which links the road surface temperature data or the facility temperature data acquired by the photography data acquisition unit 102 with the position information of the vehicle acquired by the current position acquisition unit 104 to be output.SELECTED DRAWING: Figure 2

Description

The present invention relates to an information processing system and an information processing system control method.

2. Description of the Related Art Conventionally, techniques for utilizing data obtained by sensors such as cameras are known.
For example, Patent Literature 1 discloses a system that analyzes street congestion situations and the like using street information collected by sensors installed by clients installed on the street.

JP 2017-60164 A

By the way, there is a demand to utilize the temperature data of road surfaces or facilities existing in the city for various purposes. be. However, if the sensor for detecting temperature is a stationary sensor as in the client described in Patent Document 1, in order to obtain temperature data at multiple locations, it is necessary to install sensors at each of the multiple locations. It is not possible to easily obtain temperature data of road surfaces or facilities that
SUMMARY OF THE INVENTION The present invention has been made in view of such a background, and it is an object of the present invention to easily acquire temperature data of road surfaces or facilities existing in a city or the like, and to appropriately utilize the acquired temperature data of road surfaces or facilities. With the goal.

One aspect of an information processing system for achieving the above object includes a thermography camera provided in a vehicle for photographing a road surface or a facility; a first acquisition unit that acquires temperature data from the thermography camera; a second acquisition unit that acquires position information of the vehicle when the thermography camera captures the image; and the road surface temperature data acquired by the first acquisition unit, or A first output unit that associates and outputs the facility temperature data and the position information of the vehicle acquired by the second acquisition unit.

In the above information processing system, the thermography camera may be a rear camera that is provided in a cabin of the vehicle and captures an image behind the vehicle.

In the above information processing system, the thermography camera may be a rear camera outside the vehicle that is provided in the vehicle and captures an image behind the vehicle.

The information processing system may further include a freeze prediction unit that predicts whether or not the road surface may freeze based on the road surface temperature data output by the first output unit.

In the information processing system, based on the road surface temperature data output by the first output unit, a heat stroke prediction unit that predicts whether heat stroke may occur on the road corresponding to the road surface, may be configured.

In the above information processing system, a storage unit that stores the road surface temperature data output by the first output unit for each region based on the position information of the vehicle output by the first output unit; and a second output unit that outputs the road surface temperature data obtained for each of the regions.

In the above information processing system, the facility is a house, and a determination unit that determines whether or not the house is vacant based on the temperature of the windows of the house indicated by the facility temperature data output by the first output unit. may be provided.

In the above information processing system, the determination unit determines the position of the vehicle when the image was captured by the thermography camera and the location of the vehicle captured by the thermography camera, based on the map data and the position information of the vehicle output by the first output unit. It may be determined whether or not the house is vacant when the distance from the target house is less than a predetermined distance.

In the above information processing system, the road surface temperature data acquired by the first acquisition unit is corrected in accordance with the road surface being photographed by the thermography camera, and the facility temperature acquired by the first acquisition unit is corrected. A correcting unit that corrects the data corresponding to the fact that the thermography camera captures the facility, and the first output unit outputs the road surface temperature data or the facility temperature data corrected by the correcting unit. It is good also as composition.

In the above information processing system, the correction unit that corrects the road surface temperature data acquired by the first acquisition unit, and the road surface temperature data output by the first output unit are obtained by the thermography camera of the vehicle that is different at the same time. an estimating unit for estimating the temperature of the road surface reflected in the duplicate road surface temperature data when duplicate road surface temperature data, which is the obtained road surface temperature data and is the road surface temperature data of the same road surface, exists, The correction unit corrects the road surface temperature data acquired by the first acquisition unit when the temperature indicated by the duplicated road surface temperature data indicates a temperature different from the road surface temperature estimated by the estimation unit by a predetermined temperature or more. , the first output unit may output the road surface temperature data corrected by the correction unit.

In the information processing system, the correction unit that corrects the facility temperature data acquired by the first acquisition unit, and the facility temperature data output by the first output unit are obtained by the thermography camera of the vehicle that is different at the same time. an estimating unit for estimating the temperature of the facility reflected in the duplicate facility temperature data when duplicate facility temperature data, which is the obtained facility temperature data and is the facility temperature data of the same facility, exists, The correcting unit corrects the facility temperature data acquired by the first acquiring unit when the temperature indicated by the overlapping facility temperature data indicates a temperature that is different from the temperature of the facility estimated by the estimating unit by a predetermined temperature or more. , wherein the first output unit outputs the facility temperature data corrected by the correction unit.

According to another aspect of the information processing system control method for achieving the above object, there is provided a photographing step of photographing a road surface or facility with a thermography camera provided in a vehicle; A first acquisition step of acquiring facility temperature data, which is temperature data of from the thermography camera, a second acquisition step of acquiring position information of the vehicle when the thermography camera captured the image, and the first acquisition step an output step of linking and outputting the acquired road surface temperature data or facility temperature data and the position information of the vehicle acquired in the second acquiring step.

ADVANTAGE OF THE INVENTION According to this invention, it is effective in being able to acquire easily the temperature data of the road surface or the facility which exist in a town etc., and to utilize the acquired temperature data of the road surface or the facility appropriately.

FIG. 1 is an explanatory diagram showing an outline of an information processing system. FIG. 2 is a diagram showing the configuration of the information processing system. FIG. 3 is a flow chart showing the operation of the information processing system. FIG. 4 is a flow chart showing the operation of the information processing system. FIG. 5 is a flow chart showing the operation of the information processing system. FIG. 6 is a diagram showing the configuration of an information processing system.

[1. Information processing system overview]
An overview of an information processing system 1000 according to the present embodiment will be described with reference to FIG.
In the information processing system 1000 of the present embodiment, a thermography camera provided in the vehicle interior of the vehicle 1 photographs the road surface RA of the road R or the facility F in the city or the like. Then, the information processing system 1000 provides various types of information to the user U of the local application 211 based on the photographed data of the thermography camera. In this embodiment, the facility F is exemplified by a house.

The photographed data of the thermography camera is image data representing the heat distribution of the object to be photographed, and is temperature data of the object to be photographed. Hereinafter, the temperature data of the road surface RA obtained by photographing with the thermography camera will be referred to as "road surface temperature data". Further, hereinafter, the temperature data of the facility F obtained by photographing with the thermography camera will be referred to as "facility temperature data".

The area application 211 is an application program that provides the user U with information about the target area. Information related to the target area includes road surface temperature data of roads R existing in the target area, information of roads R that have a possibility of freezing road surface RA among the roads R existing in the target area, and road surface temperature data existing in the target area. Among R, information on roads R on which heatstroke may occur, information on vacant houses in the target area, and the like can be mentioned. The information provided to the user U by the local application 211 is not limited to these, and may include other information such as events held in the target area.

In the example of FIG. 1 , users U1 and U2 are shown as users U of the local application 211 . User U1 is a resident of area A and uses user terminal 21 in which area application 211 is installed. A regional application 211 installed in the user terminal 21 provides information on the region A to the user U1. User U2 is a resident of area B and uses user terminal 22 in which area application 211 is installed. Regions A and B are regions different from each other. A regional application 211 installed in the user terminal 22 provides information on the region B to the user U2.

The example of FIG. 1 shows a case where vehicles 1A and 1B are photographing with rear cameras 3 in area A. In FIG. A rear camera 3A for photographing the rear of the vehicle 1A is provided in the vehicle interior of the vehicle 1A. The rear camera 3A is equipped with an infrared temperature sensor and functions as a thermography camera. A rear camera 3B for photographing the rear of the vehicle 1B is provided in the vehicle interior of the vehicle 1B. The rear camera 3B functions as a thermography camera like the rear camera 3A.

In the example of FIG. 1, the rear camera 3A functioning as a thermography camera is photographing the road surface RA1 of the road R1 in the region A. In FIG. The photographed data of the rear camera 3A, in other words, the road surface temperature data of the road surface RA1 is transmitted to the information processing server 5 via the communication network 4 by the communication unit 7A of the vehicle 1A. The communication network 4 may be any data communication network, and examples include a wide area communication network including a public line network, a LAN (Local Area Network), and the like. The transmitted road surface temperature data of the road surface RA1 is associated with the position information of the vehicle 1A when the rear camera 3A captures the image. The road surface temperature data of the road surface RA1 may be transmitted to the information processing server 5 via the driver terminal 6A used by the driver D1 of the vehicle 1A.

Further, in the example of FIG. 1, the rear camera 3B functioning as a thermography camera photographs the side of the facility F1 existing in the area A. The photographing range of the rear camera 3B includes the window W of the facility F1. The photographed data of the rear camera 3B, in other words, the facility temperature data of the facility F1 is transmitted to the information processing server 5 via the communication network 4 by the communication unit 7B of the vehicle 1B. The transmitted facility temperature data of the facility F1 is associated with position information of the vehicle 1B when the rear camera 3B captures the image. The facility temperature data of the facility F1 may be transmitted to the information processing server 5 via the driver terminal 6B used by the driver D2 of the vehicle 1B.

The example of FIG. 1 shows a case where vehicles 1C and 1D are photographing with the rear cameras 3 in area B. FIG. A rear camera 3C for photographing the rear of the vehicle 1C is provided in the vehicle interior of the vehicle 1C. The rear camera 3C functions as a thermography camera like the rear camera 3A. A rear camera 3D for capturing an image behind the vehicle 1D is provided in the vehicle interior of the vehicle 1D. The rear camera 3D functions as a thermography camera like the rear camera 3A.

In the example of FIG. 1, a rear camera 3C functioning as a thermography camera captures a side view of a facility F2 located in area B. In the example of FIG. The photographing range of the rear camera 3C includes the window W of the facility F2. The photographed data of the rear camera 3C, in other words, the facility temperature data of the facility F2 is transmitted to the information processing server 5 via the communication network 4 by the communication unit 7C of the vehicle 1C. The transmitted facility temperature data of the facility F2 is associated with the position information of the vehicle 1C when the rear camera 3C captures the image. The facility temperature data of the facility F2 may be transmitted to the information processing server 5 via the driver terminal 6C used by the driver D3 of the vehicle 1C.

Further, in the example of FIG. 1, the rear camera 3D functioning as a thermography camera photographs the road surface RA2 of the road R2 in the area B. The photographed data of the rear camera 3D, in other words, the road surface temperature data of the road surface RA2 is transmitted to the information processing server 5 via the communication network 4 by the communication unit 7D of the vehicle 1D. The transmitted road surface temperature data of the road surface RA2 is associated with the position information of the vehicle 1D when the rear camera 3D captures the image. The road surface temperature data of the road surface RA2 may be transmitted to the information processing server 5 via the driver terminal 6D used by the driver D4 of the vehicle 1D.

[2. Configuration of information processing system]
Next, the configuration of the information processing system 1000 will be described with reference to FIG.
An information processing system 1000 of this embodiment includes a user terminal 2 , a vehicle 1 and an information processing server 5 .

First, the configuration of the user terminal 2 will be described.
The user terminal 2 is a mobile device or a portable computer called a handheld computer, such as a smart phone.

As shown in FIG. 2, the user terminal 2 includes a terminal processor 200, a terminal memory 210, a communication unit 220, and a touch panel 230.

The terminal processor 200 is a processor such as a CPU (Central Processing Unit) or MPC (Micro-processing unit). It functions as an application execution unit 201 by reading out and executing the local application 211 stored in the terminal memory 210 .

The terminal memory 210 is a memory that stores programs and data. The terminal memory 210 stores programs executed by the terminal processor 200 and data processed by the terminal processor 200 . The terminal memory 210 stores a regional application 211 executed by the terminal processor 200 and various other data. The terminal memory 210 has a non-volatile storage area. The terminal memory 210 may also comprise a volatile storage area and constitute a work area for the terminal processor 200 .

Communication unit 220 comprises a wireless communication device having an antenna, RF circuitry, encoders, decoders, and the like. The communication unit 220 performs data communication with the information processing server 5 via the communication network 4 .

Touch panel 230 has a configuration in which a liquid crystal display panel that displays characters and images and a touch sensor that detects contact with the liquid crystal display panel are superimposed.

Application execution unit 201 communicates with information processing server 5 via communication unit 220 . The application executing unit 201 receives information about the region from the information processing server 5 and displays the received information about the region on the touch panel 230 . As a result, the user U is provided with information about the area.

Next, the configuration of the vehicle 1 will be described.
The vehicle 1 includes an in-vehicle device 10 , a communication unit 7 , a touch panel 120 , a rear camera 3 , a GNSS (Global Navigation Satellite System) 130 and an orientation sensor 140 .

The in-vehicle device 10 is a device mounted on the vehicle 1 . The in-vehicle device 10 is a device provided with a touch panel 120 provided in the vehicle 1, and is, for example, a device called display audio (DA) or a car navigation device.

As shown in FIG. 2, the in-vehicle device 10 includes an in-vehicle processor 100 that is a processor such as a CPU or MPC, and an in-vehicle memory 110 that stores programs and data.

The in-vehicle processor 100 reads out and executes the control program 111 stored in the in-vehicle memory 110 to control the imaging control unit 101, the imaging data acquisition unit 102, the correction unit 103, the current position acquisition unit 104, and the in-vehicle communication control unit 106. function as
The captured data acquisition unit 102 corresponds to an example of a first acquisition unit. The current position acquisition unit 104 corresponds to an example of a second acquisition unit. The in-vehicle communication control unit 106 corresponds to an example of a first output unit.

The in-vehicle memory 110 stores programs executed by the in-vehicle processor 100 and data processed by the in-vehicle processor 100 . The in-vehicle memory 110 stores a control program 111 executed by the in-vehicle processor 100 and other various data. The in-vehicle memory 110 has a non-volatile storage area. The vehicle-mounted memory 110 may also include a volatile storage area and constitute a work area for the vehicle-mounted processor 100 .

A communication unit 7 , a touch panel 120 , a rear camera 3 , a GNSS 130 , and an orientation sensor 140 are connected to the in-vehicle processor 100 . Devices connected to the in-vehicle processor 100 are not limited to these devices, and other devices such as a front camera may be connected.

The communication unit 7 comprises a wireless communication device having an antenna, RF circuits, encoders, decoders and the like. The communication unit 7 performs data communication with the information processing server 5 .

The touch panel 120 has a configuration in which a liquid crystal display panel that displays characters and images and a touch sensor that detects contact with the liquid crystal display panel are superimposed, and is installed on the dashboard of the vehicle 1, for example.

The rear camera 3 is provided in the vehicle interior of the vehicle 1, and photographs the road surface RA or the facility F through the rear glass.

The GNSS 130 measures the current position of the vehicle 1 . When the vehicle 1 is equipped with a car navigation system (not shown), as the GNSS 130, a GPS (Global Positioning System) unit or the like provided in the car navigation device may be used.

Direction sensor 140 detects the direction of vehicle 1 . The azimuth sensor 140 outputs azimuth information indicating the orientation of the vehicle 1 to the in-vehicle processor.

As described above, the in-vehicle processor 100 functions as an imaging control unit 101, an imaging data acquisition unit 102, a correction unit 103, a current position acquisition unit 104, an orientation acquisition unit 105, and an in-vehicle communication control unit .

The shooting control unit 101 controls ON/OFF of shooting of the rear camera 3 . Further, the photographing control unit 101 causes the rear camera 3 to function as a thermography camera. The photographing control unit 101 causes the rear camera 3 to function as a thermography camera in order to obtain temperature data of the object to be photographed. Further, the photographing control unit 101 functions the rear camera 3 as a thermography camera as a device for detecting an object (a person, another vehicle, etc.) existing behind the vehicle 1 when the vehicle 1 moves backward. As a result, the driver of the vehicle 1 can be assisted when the vehicle 1 moves backward at night or in bad weather.

The captured data acquisition unit 102 acquires captured data from the rear camera 3 . When the rear camera 3 functions as a thermography camera, the captured data acquisition unit 102 acquires temperature data from the rear camera 3 . In this embodiment, the rear camera 3 functioning as a thermography camera photographs the road surface RA or the facility F. Therefore, the photographed data acquisition unit 102 acquires road surface temperature data or facility temperature data from the rear camera 3 functioning as a thermography camera. The captured data acquisition unit 102 outputs the road surface temperature data or facility temperature data acquired from the rear camera 3 to the correction unit 103 .

When the photographed data acquisition unit 102 outputs the road surface temperature data, the correction unit 103 performs correction corresponding to the road surface RA being photographed by the thermography camera. For example, the correction unit 103 corrects the road surface temperature data to temperature data that is lowered by α°C.
The correcting unit 103 performs correction corresponding to the fact that the photographing target of the thermography camera is the facility F when the photographed data acquiring unit 102 outputs the facility temperature data. For example, the correction unit 103 corrects the facility temperature data to temperature data lowered by β°C.
The temperature corrected by the correction unit 103 is appropriately determined in advance and recorded as information in the vehicle-mounted memory 110 .
The correction unit 103 outputs the corrected temperature data to the in-vehicle communication control unit 106 .

Note that the correction unit 103 may determine whether the temperature data acquired by the photographed data acquisition unit 102 is the road surface temperature data or the facility temperature data from the image appearing in the temperature data. is attached with identification information corresponding to the object to be photographed, determination may be made from this identification information.

The current position acquisition unit 104 acquires the current position of the vehicle 1 by acquiring position information indicating the current position of the vehicle 1 from the GNSS 130 . The current position acquisition unit 104 acquires position information indicating the current position of the vehicle 1 when the rear camera 3 captures the image. The current position acquisition unit 104 outputs the acquired position information to the in-vehicle communication control unit 106 .

The azimuth acquisition unit 105 acquires the azimuth of the vehicle 1 by acquiring azimuth information indicating the orientation of the vehicle 1 from the azimuth sensor 140 . The azimuth acquisition unit 105 acquires azimuth information indicating the azimuth of the vehicle 1 when the rear camera 3 captures the image. Direction obtaining section 105 outputs the obtained direction information to in-vehicle communication control section 106 .

The in-vehicle communication control unit 106 communicates with the information processing server 5 via the communication unit 7 . The in-vehicle communication control unit 106 receives the road surface temperature data or the facility temperature data output by the correction unit 103, the position information of the vehicle 1 output by the current position acquisition unit 104, and the direction information of the vehicle 1 output by the direction acquisition unit 105. are associated with each other and transmitted to the information processing server 5 .

Next, the configuration of the information processing server 5 will be described.
The information processing server 5 is a server device that performs information processing. Although the information processing server 5 is represented by one block, this does not necessarily mean that the information processing server 5 is composed of a single server device. For example, the information processing server 5 may be configured including a plurality of server devices with different processing contents.

The information processing server 5 includes a server processor 500 that is a processor such as a CPU or MPC, a server memory 510 that is memory for storing programs and data, and a communication unit 520 .
Server memory 510 corresponds to an example of a storage unit.

The server processor 500 reads out and executes the control program 511 stored in the server memory 510 to obtain a receiving unit 501, a freezing prediction unit 502, a heat stroke prediction unit 503, a determination unit 504, a database processing unit 505, and a transmission unit. 506.
The transmission unit 506 corresponds to an example of a second output unit.

The server memory 510 stores programs executed by the server processor 500 and data processed by the server processor 500 . The server memory 510 includes a control program 511 executed by the server processor 500, a user DB (database) 512, a road surface temperature DB 513, a facility temperature DB 514, a freezing prediction DB 515, a heat stroke prediction DB 516, an empty house DB 517, map data 518, and other data. Stores various data. The server memory 510 has a non-volatile storage area. The server memory 510 may also include a volatile storage area and constitute a work area for the server processor 500 .

The user DB 512 records information of the user U for each user U of the local application 211 . The information on the user U includes information on the area where the user U resides, information on the name of the user U, information on the age of the user U, communication information for communicating with the user terminal 2, and the like.

Information on the temperature of the road surface RA is recorded in the road surface temperature DB 513 . The information on the temperature of the road surface RA includes the road surface temperature data obtained by the rear camera 3, the position information of the vehicle 1 when the road surface temperature data was obtained by the rear camera 3, and the area where the road surface temperature data was obtained. including information, etc.

In the facility temperature DB 514, information on the temperature of facility F is recorded. The information on the temperature of the facility F includes facility temperature data obtained by the rear camera 3, location information of the facility F captured in this facility temperature data, information about the area where the facility F captured in this facility temperature data exists, and the like. The location information of the facility F is information of the address of the facility F, for example.

The freeze prediction DB 515 records information related to roads R on which road surfaces RA may freeze. The information on the road R recorded in the freeze prediction DB 515 includes identification information of the road R on which the road surface RA may freeze (for example, the name of the road R) and road surface RA on which the road surface RA may freeze. Contains information about the region where R is located. The freezing prediction DB 515 is appropriately updated.

The heat stroke prediction DB 516 records information on roads R on which heat stroke may occur. Information on the road R recorded in the heat stroke prediction DB 516 includes identification information of the road R on which heat stroke may occur (for example, the name of the road R), and road R on which heat stroke may occur. Contains information about the region in which the is located.

The vacant house DB 517 records information on facilities F that are determined to be vacant houses. The information on the facility F recorded in the vacant house DB 517 includes location information on the facility F determined to be vacant and information on the area where the facility F determined to be vacant exists.

The map data 518 is data that stores road map information, facility information such as various facilities, data for map matching, and the like. The road map information consists of a road network in which roads on the map are represented by lines, and includes information on links in which intersections, branch points, etc. are divided into a plurality of parts and the parts between each node are defined as links. The facility information indicates the location (latitude and longitude) of the facility, the name of the facility, and the like.

Communication unit 520 comprises a wireless communication device having an antenna, RF circuitry, encoders, decoders, and the like. The communication unit 520 performs data communication with the communication unit 7 of the vehicle 1 and the user terminal 2 via the communication network 4 .

As described above, the server processor 500 functions as a receiving section 501 , a freezing prediction section 502 , a heat stroke prediction section 503 , a determination section 504 , a database processing section 505 and a transmission section 506 .

The receiving unit 501 communicates with the communication unit 7 of the vehicle 1 via the communication unit 520. The receiving unit 501 transmits the road surface temperature data or facility temperature data linked with the position information of the vehicle 1 to the communication unit 7 of the vehicle 1. receive from The receiving unit 501 outputs the received road surface temperature data or facility temperature data to the database processing unit 505 .

When the receiving unit 501 receives the road surface temperature data, the freezing prediction unit 502 predicts whether or not the road surface RA may freeze based on the received road surface temperature data.
For example, the freezing prediction unit 502 predicts that the road surface RA may freeze when the area showing the temperature below a predetermined temperature (for example, 0° C.) is equal to or above a predetermined threshold in the image of the heat distribution indicated by the road surface temperature data. If the area showing the temperature below a predetermined temperature (for example, 0° C.) is less than the threshold, it is predicted that there is no possibility of freezing the road surface RA.
Next, when the freezing prediction unit 502 predicts that the road surface RA may freeze, the road surface RA freezes based on the map data 518 and the position information of the vehicle 1 linked to the road surface temperature data to be processed. The road R predicted that there is a possibility that the road R will be damaged and the area where this road R exists are specified. Then, the freeze prediction unit 502 outputs prediction results including information on the specified road R and area to the database processing unit 505 .

When the receiving unit 501 receives the road surface temperature data, the heat stroke prediction unit 503 predicts whether or not there is a possibility of heat stroke occurring on the road R of the road surface RA based on the received road surface temperature data.
For example, in the heat distribution indicated by the road surface temperature data, the heat stroke prediction unit 503 predicts that a heat stroke may occur when an area indicating a temperature of a predetermined temperature (for example, 31° C.) is equal to or greater than a predetermined threshold. It is predicted that there is no possibility of heatstroke if the area showing a temperature equal to or higher than a predetermined temperature (for example, 31° C.) is below the threshold.
Next, when the heat stroke prediction unit 503 predicts that heat stroke may occur, the heat stroke will occur based on the map data 518 and the location information of the vehicle 1 linked to the road surface temperature data to be processed. A road R predicted to be possible and an area where this road R exists are specified. Then, the heat stroke prediction unit 503 outputs prediction results including information on the specified road R and area to the database processing unit 505 .

When the receiving unit 501 receives the facility temperature data, the determining unit 504 determines the facility temperature data received by the receiving unit 501, the position information of the vehicle 1 associated with the facility temperature data, and the position information of the vehicle 1 associated with the facility temperature data. Based on the azimuth information, the facility temperature DB 514, and the map data 518, it is determined whether or not the facility F shown in the received facility temperature data is an empty house.
For example, the determining unit 504 determines based on the facility temperature data received by the receiving unit 501, the position information of the vehicle 1 associated with the facility temperature data, the azimuth information of the vehicle 1 associated with the facility temperature data, and the map data 518. , the position information of the facility F reflected in the facility temperature data is acquired. Then, the determining unit 504 acquires facility temperature data associated with position information that is the same as or close to the acquired position information of the facility F (for example, the distance is less than 1 meter) from the facility temperature DB 514 . Then, the determination unit 504 compares a plurality of facility temperature data including the received facility temperature data, and if the temperature change of the window W of the facility F is within a predetermined range (for example, within 5° C.), the received facility temperature data It is determined that the facility F reflected in the temperature data is an empty house. Then, the determination unit 504 identifies the position of the facility F determined to be an empty house and the area where the facility F is located from the map data 518 and outputs information on the identified position and area to the database processing unit 505 .

A database processing unit 505 records and erases data in various databases.
When the temperature data output by the receiving unit 501 is the road surface temperature data, the database processing unit 505 determines the road surface temperature data based on the map data 518 and the location information of the vehicle 1 linked to the road surface temperature data output by the receiving unit 501. The area where the road surface RA indicated by the road surface temperature data exists is specified. Then, the database processing unit 505 associates the information of the specified area, the road surface temperature data output by the receiving unit 501, and the position information of the vehicle 1 linked to the road surface temperature data, and records them in the road surface temperature DB 513.

When the temperature data output by the receiving unit 501 is facility temperature data, the database processing unit 505, based on the map data 518 and the location information of the vehicle 1 linked to the facility temperature data output by the receiving unit 501, The location information of the facility F indicated by the facility temperature data and the area where this facility F is located are identified. Then, the database processing unit 505 associates the information of the specified area, the facility temperature data output by the receiving unit 501, and the location information of the facility F indicated by this facility temperature data, and records them in the facility temperature DB 514 .

The database processing unit 505 records the prediction results output from the freeze prediction unit 502 in the freeze prediction DB 515 .

Database processing unit 505 records the prediction result output from heat stroke prediction unit 503 in heat stroke prediction DB 516 .

The database processing unit 505 records the address and region information output by the determination unit 504 in the vacant house DB 517 .

The transmission unit 506 transmits information about the area to the user terminal 2 in which the area application 211 is installed via the communication unit 520 .

The transmission unit 506 receives road surface temperature request information requesting road surface temperature data from the user terminal 2 . The road surface temperature request information includes information indicating the target area of the local application 211 installed in the user terminal 2 that is the transmission source. The transmission unit 506 acquires the road surface temperature data of the target area indicated by the road surface temperature request information from the road surface temperature DB 513, and transmits the acquired road surface temperature data to the user terminal 2 as a response to the road surface temperature request information.

The transmitting unit 506 receives, from the user terminal 2, frozen road request information requesting information on the road R on which the road surface RA may be frozen. The frozen road request information includes information indicating the target area of the local application 211 installed in the user terminal 2 that is the transmission source. The transmission unit 506 acquires information on the road R in the target area indicated by the frozen road request information from the freeze prediction DB 515, and transmits the acquired information on the road R to the user terminal 2 as a response to the frozen road request information.

The transmission unit 506 receives from the user terminal 2 heat stroke road request information requesting information on the road R on which heat stroke may occur. The heatstroke road request information includes information indicating the target area of the local application 211 installed in the user terminal 2 that is the transmission source. The transmission unit 506 acquires the information of the road R in the target area indicated by the heat stroke road request information from the heat stroke prediction DB 516, and transmits the acquired information of the road R to the user terminal 2 as a response to the heat stroke road request information. do.

The transmitting unit 506 receives, from the user terminal 2, vacant house request information requesting information on vacant houses (location information of vacant houses in this embodiment). The vacant house request information includes information indicating the target area of the area application 211 installed in the user terminal 2 that is the transmission source. The transmission unit 506 acquires information on vacant houses existing in the target area indicated by the vacant house request information from the vacant house DB 517, and transmits the acquired information on the vacant houses to the user terminal 2 as a response to the vacant house request information.

[3. Operation of information processing system 1000]
Next, operations of the information processing system 1000 will be described.
First, the operation of the information processing system 1000 when the rear camera 3 functioning as a thermography camera captures an image of the road surface RA will be described.

FIG. 3 is a flow chart showing the operation of the information processing system 1000. As shown in FIG.
In FIG. 3 , a flowchart FA shows the operation of the vehicle 1 and a flowchart FB shows the operation of the information processing server 5 . In the flowchart shown in FIG. 3, the rear camera 3 functions as a thermography camera.

As shown in the flowchart FA, the rear camera 3 of the vehicle 1 photographs the road surface RA of the road R under the control of the photographing control unit 101 (step SA1). Step SA1 corresponds to an example of a photographing step.

Next, the captured data acquisition unit 102 of the in-vehicle device 10 acquires road surface temperature data from the rear camera 3 (step SA2). Step SA2 corresponds to an example of the first acquisition step.

Next, the current position acquisition unit 104 acquires the position information of the vehicle 1 when the rear camera 3 captured the image from the GNSS 130 (step SA3). Step SA3 corresponds to an example of the second acquisition step.

Next, the direction acquisition unit 105 acquires the direction information of the vehicle 1 when the rear camera 3 captures the image from the direction sensor 140 (step SA4).

Next, the imaging data acquisition unit 102 outputs the road surface temperature data acquired in step SA2 to the correction unit 103 (step SA5).

Next, the correction unit 103 corrects the road surface temperature data (step SA6).

Next, the in-vehicle communication control unit 106 associates the road surface temperature data corrected in step SA6 with the position information of the vehicle 1 acquired in step SA3 and the azimuth information of the vehicle 1 acquired in step SA4. It is transmitted to the processing server 5 (step SA7). Step SA7 corresponds to an example of the output step.

As shown in the flowchart FB, the receiving unit 501 of the information processing server 5 receives the road surface temperature data, the position information of the vehicle 1, and the azimuth information of the vehicle 1 from the vehicle 1 (step SB1).

Next, the database processing unit 505 records the road surface temperature data and the position information of the vehicle 1 received in step SB1 in the road surface temperature DB 513 (step SB2).

Next, based on the road surface temperature data received at step SB1, the freezing prediction unit 502 predicts whether there is a possibility that the road surface RA will freeze (step SB3).

Next, database processing unit 505 determines whether or not freezing prediction unit 502 has predicted that road surface RA may freeze (step SB4).

When database processing unit 505 determines that freezing prediction unit 502 has predicted that road surface RA is unlikely to freeze (step SB4: NO), server processor 500 advances the process to step SB6.

On the other hand, when the database processing unit 505 determines that the freezing prediction unit 502 has predicted that the road surface RA may freeze (step SB4: YES), the database processing unit 505 processes the prediction output by the freezing prediction unit 502. The result is recorded in the freezing prediction DB 515 (step SB5).

Next, based on the road surface temperature data received in step SB1, the heat stroke prediction unit 503 predicts whether or not heat stroke may occur on the road R corresponding to this road surface RA (step SB6).

Next, the database processing unit 505 determines whether or not the heat stroke prediction unit 503 has predicted that heat stroke may occur (step SB7).

When the database processing unit 505 determines that the heat stroke prediction unit 503 has predicted that there is no possibility of heat stroke (step SB7: NO), the server processor 500 ends the process.

On the other hand, when the database processing unit 505 determines that the heat stroke prediction unit 503 has predicted that heat stroke may occur (step SB7: YES), the prediction result output by the heat stroke prediction unit 503 is Record in the disease prediction DB 516 (step SB8).

The operation of FIG. 3 will be specifically described with reference to FIG.
The vehicle 1A transmits to the information processing server 5 the road surface temperature data of the road surface RA1, the position information of the vehicle 1A, and the azimuth information of the vehicle 1A. Then, the information processing server 5 associates the road surface temperature data of the road surface RA1, the position information of the vehicle 1A, and the information of the area A, and records them in the road surface temperature DB 513. FIG. Then, when it is predicted that the road surface RA1 may freeze, the information about the road R1 and the information about the area A are recorded in the freezing prediction DB 515 . Moreover, when it is predicted that heat stroke may occur on road R1, the information of road R1 and the information of area A are recorded on heat stroke prediction DB516.
The vehicle 1D transmits to the information processing server 5 the road surface temperature data of the road surface RA2, the position information of the vehicle 1D, and the azimuth information of the vehicle 1D. Then, the information processing server 5 associates the road surface temperature data of the road surface RA2, the position information of the vehicle 1D, and the information of the area B, and records them in the road surface temperature DB 513. FIG. Then, when it is predicted that the road surface RA2 may freeze, the information about the road R2 and the information about the area B are recorded in the freezing prediction DB 515 . Moreover, when it is predicted that heat stroke may occur on road R2, the information on road R2 and the information on area B are recorded on heat stroke prediction DB516.

Next, the operation of the information processing system 1000 when the rear camera 3 functioning as a thermography camera takes an image of the facility F will be described.

FIG. 4 is a flowchart showing the operation of the information processing system 1000. As shown in FIG.
In FIG. 4 , a flowchart FC shows the operation of the vehicle 1 and a flowchart FD shows the operation of the information processing server 5 . In the flowchart shown in FIG. 4, the rear camera 3 functions as a thermography camera.

As shown in a flowchart FC, the rear camera 3 of the vehicle 1 takes an image of the facility F under the control of the imaging control section 101 (step SC1). Step SC1 corresponds to an example of a photographing step.

Next, the captured data acquisition unit 102 of the in-vehicle device 10 acquires facility temperature data from the rear camera 3 (step SC2). Step SC2 corresponds to an example of a first acquisition step.

Next, the current position acquisition unit 104 acquires the position information of the vehicle 1 when the rear camera 3 captured the image from the GNSS 130 (step SC3). Step SC3 corresponds to an example of the second obtaining step.

Next, the direction acquisition unit 105 acquires the direction information of the vehicle 1 when the rear camera 3 captures the image from the direction sensor 140 (step SC4).

Next, the imaging data acquisition unit 102 outputs the acquired facility temperature data to the correction unit 103 (step SC5).

Next, the correction unit 103 corrects the facility temperature data (step SC6).

Next, the in-vehicle communication control unit 106 associates the facility temperature data corrected in step SC6 with the position information of the vehicle 1 acquired in step SC3 and the azimuth information of the vehicle 1 acquired in step SC4. It is transmitted to the processing server 5 (step SC7). Step SC7 corresponds to an example of the output step.

As shown in the flowchart FD, the receiving unit 501 of the information processing server 5 receives the facility temperature data, the position information of the vehicle 1, and the azimuth information of the vehicle 1 from the vehicle 1 (step SD1).

Next, database processing unit 505 records the facility temperature data and the location information of vehicle 1 received in step SB1 in facility temperature DB 514 (step SD2).

Next, the determining unit 504 refers to the map data 518 and the direction information of the vehicle 1 to determine the position of the vehicle 1 indicated by the position information of the vehicle 1 linked to the temperature data received in step SD1 and the position of the vehicle 1 received in step SD1. It is determined whether or not the distance from the position of facility F shown in the obtained temperature data is less than a predetermined distance (step SD3).

When the determining unit 504 determines that the distance between the position of the vehicle 1 and the position of the facility F is equal to or greater than the predetermined distance (step SD3: NO), the server processor 500 ends the process.

On the other hand, when determining unit 504 determines that the distance between the position of vehicle 1 and the position of facility F is less than the predetermined distance (step SD3: YES), facility F reflected in the facility temperature data received in step SD1 is It is determined whether or not the house is vacant (step SD4).

When the determination unit 504 determines that the facility F reflected in the facility temperature data received in step SD1 is not an empty house (step SDB4: NO), the server processor 500 terminates the process.

On the other hand, when the determination unit 504 determines that the facility F reflected in the facility temperature data received in step SD1 is an empty house (step SD4: YES), the database processing unit 505 stores information on the house determined to be an empty house. Record in the vacant house DB 517 (step SD5).

The operation of FIG. 4 will be specifically described with reference to FIG.
The vehicle 1B transmits the facility temperature data of the facility F1, the position information of the vehicle 1B, and the azimuth information of the vehicle 1B to the information processing server 5 . Then, the information processing server 5 associates the facility temperature data of the facility F1, the location information of the facility F1, and the information of the area A, and records them in the facility temperature DB 514 . Then, when the determination unit 504 determines that the facility F1 is an empty house, the information of the address of the facility F1 and the information of the area A are recorded in the empty house DB 517 .
The vehicle 1C transmits the facility temperature data of the facility F2 and the position information of the vehicle 1C to the information processing server 5 . Then, the information processing server 5 associates the facility temperature data of the facility F2, the position information of the vehicle 1C, and the information of the area B, and records them in the facility temperature DB 514 . Then, when the determining unit 504 determines that the facility F2 is an empty house, the location information of the facility F2 and the information of the area B are recorded in the empty house DB 517 .

Next, the operation when the information processing server 5 provides the user U with information about the area will be described.

FIG. 5 is a flow chart showing the operation of the information processing system 1000. As shown in FIG.
In FIG. 5, a flowchart FE shows the operation of the information processing server 5, and a flowchart FF shows the operation of the user terminal 2. FIG.

As shown in a flowchart FF, the application execution unit 201 of the user terminal 2 transmits request information to the information processing server 5 (step SF1).

In step SF<b>1 , the application execution unit 201 transmits to the information processing server 5 any one of road surface temperature request information, frozen road request information, heatstroke road request information, and empty house request information.

As shown in a flowchart FE, the receiving unit 501 of the information processing server 5 receives request information from the user terminal 2 (step SE1).

Next, the transmission unit 506 of the information processing server 5 acquires from the database information to be transmitted to the user terminal 2 as a response to the request information received in step SE1 (step SE2).

In step SE2, if the request information received in step SE1 is the road surface temperature request information, the transmission unit 506 acquires the road surface temperature data of the target area indicated by the road surface temperature request information from the road surface temperature DB513.
Also, in step SE2, if the request information received in step SE1 is frozen road request information, the transmission unit 506 acquires information on the road R in the target area indicated by the frozen road request information from the freeze prediction DB 515.
Further, in step SE2, if the request information received in step SE1 is the heat stroke road request information, the transmitting unit 506 acquires the information of the road R in the target area indicated by the heat stroke road request information from the heat stroke prediction DB 516. .
Also, in step SE2, if the request information received in step SE1 is vacant house request information, the transmitting unit 506 acquires information on vacant houses existing in the target area indicated by the vacant house request information from the heat stroke prediction DB 516.

Next, the transmission unit 506 transmits the information acquired in step SE2 to the user terminal 2 as a response to the request information (step SE3).

As shown in a flowchart FF, the application executing unit 201 of the user terminal 2 receives the response to the request information (step SF2), and causes the touch panel 230 to display the information transmitted as the response (step SF3).

In step SF3, when the road surface temperature request information is transmitted in step SF1, the application execution unit 201 displays the road surface temperature data of the target area.
Further, in step SF3, when the frozen road request information is transmitted in step SF1, the application execution unit 201 displays information of the roads R, among the roads R in the target area, on which the road surface RA may be frozen.
Further, in step SF3, when heat stroke road request information is transmitted in step SF1, the application execution unit 201 displays information of roads R that may cause heat stroke among the roads R in the target area.
Also, in step SF3, when the vacant house request information is transmitted in step SF1, the application execution unit 201 displays information on vacant houses existing in the target area.

[4. Other embodiments]
In another embodiment, the correction unit 103 corrects road surface temperature data and facility temperature data based on correction data transmitted from the information processing server 5 . This other embodiment will be described with reference to FIG.

FIG. 6 is a diagram showing the configuration of an information processing system 1000 according to another embodiment. In the description of FIG. 6, the same reference numerals are given to the same components as the components of the above-described embodiments, and detailed description thereof will be omitted as appropriate. 6 and 2, the server processor 500 functions as an estimator 507 and a correction controller 508 in addition to the functional units shown in FIG.

The estimating unit 507 refers to the road surface temperature DB 513 to refer to the road surface temperature data obtained by the rear cameras 3 of different vehicles 1 at the same time (for example, within 10 minutes), and the road surface temperature data of the same road surface R. Determine whether temperature data exists. This road surface temperature data is referred to as "duplicated road surface temperature data". The estimating unit 507 identifies the vehicle 1 to which the road surface photographed data is transmitted by a predetermined method, recognizes the photographing timing at which the road surface photographed data is obtained by a predetermined method, and determines whether duplicate road surface temperature data exists. A determination is made as to whether or not When determining that there is overlapping road surface temperature data, the estimating unit 507 acquires information about the outside air temperature around the road surface R indicated by the determined overlapping road surface temperature data from an external server. Then, the estimating unit 507 estimates the temperature of the road surface R indicated by the redundant road surface temperature data based on the obtained outside air temperature information and the temperature indicated by the redundant road surface temperature data.

The estimating unit 507 also refers to the facility temperature DB 514 to refer to facility temperature data obtained by the rear cameras 3 of different vehicles 1 at the same time (for example, within a time interval of 10 minutes) and the same facility F facility temperature data exists. This facility temperature data is referred to as "duplicate facility temperature data". The estimation unit 507 identifies, by a predetermined method, the vehicle 1 to which the facility photographing data is transmitted, recognizes the photographing timing at which the facility photographing data is obtained by a predetermined method, and determines whether duplicate facility temperature data exists. A determination is made as to whether or not When determining that there is overlapping facility temperature data, the estimating unit 507 acquires information on the outside air temperature around the facility F indicated by the determined overlapping facility temperature data from the external server. Then, the estimating unit 507 estimates the temperature of the facility F indicated by the overlapping facility temperature data based on the acquired outside temperature information and the overlapping facility temperature data.

The correction control unit 508 determines whether or not there is road surface temperature data indicating a temperature different from the temperature of the road surface R estimated by the estimation unit 507 by a predetermined temperature or more among the redundant road surface temperature data. The temperature indicated by the duplicated road surface temperature data to be compared with the estimated temperature of the road surface R may be the average temperature indicated by the duplicated road surface temperature data, the lowest temperature, or the highest temperature. When the correction control unit 508 determines that there is road surface temperature data indicating a temperature different from the temperature of the road surface R estimated by the estimation unit 507 by a predetermined temperature or more, the correction control unit 508 corrects the road surface temperature data, which is correction data for correcting the road surface temperature data. to generate This road surface temperature correction data is data for calibration, and is based on the road surface temperature data indicating the temperature that deviates from the temperature of the road surface R estimated by the estimation unit 507 by a predetermined temperature or more, and the temperature of the road surface R estimated by the estimation unit 507. generated based on The correction control unit 508 transmits the generated road surface temperature correction data to the vehicle 1 that has transmitted the road surface temperature data indicating the temperature that deviates from the temperature of the road surface R estimated by the estimation unit 507 by a predetermined temperature or more via the communication unit 520 . .

Further, the correction control unit 508 determines whether or not there is facility temperature data indicating a temperature different from the temperature of the facility F estimated by the estimating unit 507 by a predetermined temperature or more among the redundant facility temperature data. The temperature to be compared with the estimated temperature of the facility F may be the average temperature of the temperatures indicated by the overlapping facility temperature data, the lowest temperature, or the highest temperature. The correction control unit 508 generates facility temperature correction data for correcting the facility temperature data when it is determined that there is facility temperature data indicating a temperature different from the temperature of the facility F estimated by the estimation unit 507 by a predetermined temperature or more. This facility temperature correction data is data for calibration, and is based on facility temperature data indicating a temperature different from the temperature of the road surface R estimated by the estimation unit 507 by a predetermined temperature or more, and the temperature of the facility F estimated by the estimation unit 507. generated based on The correction control unit 508 transmits the generated facility temperature correction data to the vehicle 1 that has transmitted the facility temperature data indicating the temperature deviating from the temperature of the facility F estimated by the estimation unit 507 by a predetermined temperature or more via the communication unit 520 . Send.

When receiving the road surface temperature correction data from the information processing server 5, the correction unit 103 corrects the road surface temperature data acquired by the photographing data acquisition unit 102 based on the received road surface temperature correction data. For example, when the received road surface temperature correction data indicates the content of correction to be increased by γ°C, the correction unit 103 corrects the road surface temperature data acquired by the photographed data acquisition unit 102 to temperature data increased by γ°C.

When receiving facility temperature correction data from the information processing server 5, the correction unit 103 corrects the facility temperature data acquired by the imaging data acquisition unit 102 based on the received facility temperature correction data. For example, when the received facility temperature correction data indicates correction content to be increased by δ°C, the correction unit 103 corrects the facility temperature data acquired by the imaging data acquisition unit 102 to temperature data to be increased by δ°C.

According to the other embodiments described above, the road surface temperature data and the facility temperature data transmitted from the vehicle 1 can be automatically corrected.

Returning to the description of other embodiments, in the above-described embodiment, the camera provided inside the vehicle 1 as the rear camera 3 was exemplified. good too.

In the above-described embodiment, the facility F is exemplified as a house, but the facility F is not limited to a house, and may be a structure or building other than a house.

Although the in-vehicle communication control unit 106 was exemplified as the first output unit in the above-described embodiment, the first output unit is not limited to the in-vehicle communication control unit 106 . When the transmission source that transmits the road surface temperature data or the facility temperature data to the information processing server 5 is the driver terminal 6 used by the driver D, the driver terminal 6 or the functional unit of the processor of the driver terminal 6 Of these, the functional unit that outputs road surface temperature data or facility temperature data may be the first output unit.

The in-vehicle processor 100, the terminal processor 200, and the server processor 500 may be composed of one or more processors.

FIG. 2 is a schematic diagram showing functional configurations of the user terminal 2, the vehicle 1, and the information processing server 5, classified according to main processing contents. is not intended to limit the configuration of For example, the processing of the constituent elements of server processor 500 may be executed by one hardware unit or by a plurality of hardware units. The same applies to the in-vehicle processor 100 and terminal processor 200 . Also, each process shown in FIGS. 3 to 5 may be executed by one program or may be executed by a plurality of programs.

The control program 511 executed by the server processor 500 can also be realized by recording the control program 511 on a portable information recording medium. Examples of information recording media include magnetic recording media such as hard disks, optical recording media such as CDs, and semiconductor storage devices such as USB (Universal Serial Bus) memories and SSD (Solid State Drives). It is also possible to use This is the same for the control program 111 and the regional application 211 as well.

The operation step units shown in FIGS. 3 to 5 are divided according to the main processing content in order to facilitate understanding of the operation of each unit of the information processing system 1000. It is not limited by name. It may be divided into more steps depending on the processing contents. Also, one step unit may be divided to include more processes. Also, the order of the steps may be changed as appropriate.

[5. Configuration supported by the above embodiment]
The above embodiment supports the following configurations.

(Configuration 1) A thermography camera provided in a vehicle for photographing a road surface or a facility, and road surface temperature data, which is the temperature data of the road surface, or facility temperature data, which is the temperature data of the facility, are captured by the thermography camera. a first acquisition unit that acquires from, a second acquisition unit that acquires position information of the vehicle when the thermography camera captures the image, the road surface temperature data or the facility temperature data acquired by the first acquisition unit, An information processing system, comprising: a first output unit that outputs the position information of the vehicle acquired by the second acquisition unit in association with the position information of the vehicle.
According to the information processing system of Configuration 1, since the photographing range of the thermography camera can be changed as the vehicle moves, temperature data of road surfaces or facilities at many locations can be obtained with one thermography camera. In addition, by outputting the acquired temperature data and the position information of the vehicle in association with each other, the temperature data can be utilized considering the position of the temperature data. Therefore, it is possible to easily acquire the temperature data of road surfaces or facilities existing in the city or the like, and to appropriately utilize the acquired temperature data of the road surfaces or facilities.

(Arrangement 2) The information processing system according to Arrangement 1, wherein the thermography camera is a rear camera that is provided in a vehicle interior of the vehicle and captures an image behind the vehicle.
In general, while the front glass is processed to suppress ultraviolet rays and infrared rays, the rear glass is often not subjected to such processing. Therefore, when acquiring the temperature data of the road surface or facility using the camera provided in the vehicle interior, the appropriate temperature data can be acquired with the rear camera. Therefore, according to the information processing system of Configuration 2, it is possible to obtain accurate temperature data of the road surface or facilities by utilizing the camera provided in the vehicle compartment.

(Arrangement 3) The information processing system according to Arrangement 1, wherein the thermography camera is an exterior rear camera provided in the vehicle for photographing the rear of the vehicle.
According to the information processing system of configuration 3, the temperature data of the road surface or facility can be acquired by utilizing the rear camera outside the vehicle.

(Configuration 4) Any one of configuration 1 to configuration 3, further comprising a freeze prediction unit that predicts whether or not the road surface is likely to freeze based on the road surface temperature data output by the first output unit. Information processing system according to the item.
According to the information processing system of Configuration 4, it is possible to predict whether or not the road surface may freeze using the thermography camera provided in the vehicle.

(Configuration 5) Configuration 1, comprising a heat stroke prediction unit that predicts whether or not there is a possibility of heat stroke occurring on a road corresponding to the road surface, based on the road surface temperature data output by the first output unit. The information processing system according to any one of the configurations 4, comprising:
According to the information processing system of configuration 5, it is possible to predict whether or not there is a possibility of heat stroke using a thermography camera provided in the vehicle.

(Configuration 6) a storage unit for storing, for each region, the road surface temperature data output by the first output unit based on the position information of the vehicle output by the first output unit; The information processing system according to any one of configurations 1 to 5, further comprising: a second output unit that outputs road surface temperature data for each region.
According to the information processing system of configuration 6, the temperature data of the road surface for each region can be output using the thermography camera provided in the vehicle.

(Configuration 7) The facility is a house, and includes a determination unit that determines whether the house is vacant based on the temperature of the windows of the house indicated by the facility temperature data output by the first output unit. , the information processing system according to any one of configurations 1 to 6.
According to the information processing system of configuration 7, it is possible to determine whether or not a house is vacant by using a thermography camera provided in a vehicle.

(Arrangement 8) The determination unit determines the position of the vehicle when the image was captured by the thermography camera and the target imaged by the thermography camera based on the map data and the position information of the vehicle output by the first output unit. The information processing system according to configuration 7, wherein, when the distance from the position of the certain house is less than a predetermined distance, it is determined whether or not the house is vacant.
The accuracy of temperature data of a thermography camera decreases as the distance from the object to be photographed increases. According to the information processing system of Configuration 8, it is determined whether or not the house is vacant when the distance between the vehicle 1 and the house to be photographed is less than the predetermined distance. It can be determined whether or not the house reflected in the temperature data is vacant with high accuracy.

(Arrangement 9) The road surface temperature data acquired by the first acquisition unit is corrected in accordance with the fact that the road surface is an object to be photographed by the thermography camera, and the facility temperature data acquired by the first acquisition unit is corrected. On the other hand, a correction unit that performs correction corresponding to the facility being photographed by the thermography camera, and the first output unit outputs the road surface temperature data or the facility temperature data corrected by the correction unit. The information processing system according to any one of Configurations 1 to 8.
According to the information processing system of Configuration 9, since the temperature data can be corrected according to the object to be photographed by the thermography camera, it is possible to utilize accurate road surface or facility temperature data.

(Configuration 10) A correction unit that corrects the road surface temperature data acquired by the first acquisition unit; an estimating unit for estimating the temperature of the road surface reflected in the duplicate road surface temperature data when there is duplicate road surface temperature data that is the road surface temperature data that is the road surface temperature data that is the same as the road surface temperature data that is the same as the road surface temperature data that is the same as the road surface temperature data; The unit corrects the road surface temperature data acquired by the first acquisition unit when the temperature indicated by the duplicated road surface temperature data indicates a temperature that is different from the temperature of the road surface estimated by the estimation unit by a predetermined temperature or more, and The information processing system according to any one of configurations 1 to 9, wherein the first output unit outputs the road surface temperature data corrected by the correction unit.
According to the information processing system of configuration 10, the road surface temperature data obtained by the thermography camera can be used to automatically correct the road surface temperature data output by the first output unit. This makes it easy to take advantage of accurate road temperature data.

(Configuration 11) A correction unit that corrects the facility temperature data acquired by the first acquisition unit, and the facility temperature data output by the first output unit are obtained by different thermography cameras of the vehicle at the same time. an estimating unit for estimating the temperature of the facility reflected in the duplicated facility temperature data when there is duplicated facility temperature data that is the facility temperature data that is the same facility temperature data and is the facility temperature data of the same facility; The unit corrects the facility temperature data acquired by the first acquisition unit when the temperature indicated by the overlapping facility temperature data indicates a temperature different from the temperature of the facility estimated by the estimation unit by a predetermined temperature or more, and The information processing system according to any one of configurations 1 to 10, wherein the first output unit outputs the facility temperature data corrected by the correction unit.
According to the information processing system of configuration 11, the facility temperature data obtained by the thermography camera can be used to automatically correct the facility temperature data output by the first output unit. This makes it easy to take advantage of accurate facility temperature data.

(Configuration 12) A photographing step of photographing a road surface or a facility with a thermography camera provided in a vehicle, and acquiring road surface temperature data that is the temperature data of the road surface or facility temperature data that is the temperature data of the facility from the thermography camera. a first acquisition step; a second acquisition step of acquiring position information of the vehicle when the thermography camera captures the image; the road surface temperature data or the facility temperature data acquired in the first acquisition step; and an output step of linking and outputting the position information of the vehicle acquired in the acquisition step.
According to the control method for the information processing system of configuration 12, the same effects as those of the information processing system of configuration 1 are obtained.

1, 1A, 1B, 1C, 1D... vehicle, 2... user terminal, 3, 3A, 3B, 3C, 3D... rear camera, 4... communication network, 5... information processing server, 6, 6A, 6B, 6C, 6D... driver terminal, 7, 7A, 7B, 7C, 7D... communication unit, 10... in-vehicle device, 21, 22... user terminal, 100... in-vehicle processor, 101... photography control unit, 102... photography data acquisition unit ( First acquisition unit), 103 Correction unit 104 Current position acquisition unit (second acquisition unit) 105 Orientation acquisition unit 106 In-vehicle communication control unit (first output unit) 110 In-vehicle memory 111 Control program 120 Touch panel 130 GNSS 140 Orientation sensor 200 Terminal processor 201 Application execution unit 210 Terminal memory 211 Regional application 220 Communication unit 230 Touch panel 500 Server Processor 501 Reception unit 502 Freezing prediction unit 503 Heat stroke prediction unit 504 Judgment unit 505 Database processing unit 506 Transmission unit (second output unit) 507 Estimation unit 508 Correction Control unit 510 Server memory (storage unit) 511 Control program 518 Map data 520 Communication unit 1000 Information processing system A, B Region F, F1, F2 Facility R R1, R2... Road, RA, RA1, RA2... Road surface, U, U1, U2... User, W... Window.

Claims (12)

A thermography camera provided on the vehicle for photographing the road surface or facility;
a first acquisition unit that acquires road surface temperature data, which is the temperature data of the road surface, or facility temperature data, which is the temperature data of the facility, from the thermography camera;
a second acquisition unit that acquires position information of the vehicle when the thermography camera captures the image;
a first output unit that links and outputs the road surface temperature data or the facility temperature data acquired by the first acquisition unit and the position information of the vehicle acquired by the second acquisition unit;
Information processing system. The thermography camera is a rear camera that is provided in the interior of the vehicle and captures the rear of the vehicle.
The information processing system according to claim 1. The thermography camera is a rear camera outside the vehicle that is provided in the vehicle and captures the rear of the vehicle.
The information processing system according to claim 1. A freezing prediction unit that predicts whether there is a possibility that the road surface will freeze based on the road surface temperature data output by the first output unit.
The information processing system according to any one of claims 1 to 3. Based on the road surface temperature data output by the first output unit, a heat stroke prediction unit that predicts whether heat stroke may occur on the road corresponding to the road surface,
The information processing system according to any one of claims 1 to 4. a storage unit that stores the road surface temperature data output by the first output unit for each region based on the position information of the vehicle output by the first output unit;
a second output unit that outputs the road surface temperature data stored in the storage unit for each region;
The information processing system according to any one of claims 1 to 5. the facility is a residence,
A determination unit that determines whether the house is vacant based on the temperature of the window of the house indicated by the facility temperature data output by the first output unit,
The information processing system according to any one of claims 1 to 6. The determination unit is
Based on the map data and the position information of the vehicle output by the first output unit,
When the distance between the position of the vehicle when the thermography camera captures the image and the position of the house to be photographed by the thermography camera is less than a predetermined distance, determining whether the house is vacant;
The information processing system according to claim 7. The road surface temperature data acquired by the first acquisition unit is corrected in accordance with the fact that the road surface is an imaging target of the thermography camera, and the facility temperature data acquired by the first acquisition unit is corrected by the thermography camera. A correction unit that performs correction corresponding to the fact that the imaging target of is the facility,
The first output unit outputs the road surface temperature data or the facility temperature data corrected by the correction unit.
The information processing system according to any one of claims 1 to 8. a correction unit that corrects the road surface temperature data acquired by the first acquisition unit;
In the road surface temperature data output by the first output unit, duplicate road surface temperature data which is the road surface temperature data obtained by the thermography cameras of the different vehicles at the same time and which is the road surface temperature data of the same road surface. an estimating unit that, if present, estimates the temperature of the road surface reflected in the duplicate road surface temperature data;
The correction unit is
correcting the road surface temperature data obtained by the first obtaining unit when the temperature indicated by the duplicated road surface temperature data indicates a temperature different from the road surface temperature estimated by the estimating unit by a predetermined temperature or more;
The first output unit outputs the road surface temperature data corrected by the correction unit.
The information processing system according to any one of claims 1 to 9. a correction unit that corrects the facility temperature data acquired by the first acquisition unit;
Among the facility temperature data output by the first output unit, duplicate facility temperature data that is the facility temperature data obtained by the thermography cameras of the different vehicles at the same time and that is the facility temperature data of the same facility. an estimating unit that, if present, estimates the temperature of the facility reflected in the duplicate facility temperature data;
The correction unit is
correcting the facility temperature data acquired by the first acquiring unit when the temperature indicated by the overlapping facility temperature data indicates a temperature that is different from the temperature of the facility estimated by the estimating unit by a predetermined temperature or more;
The first output unit outputs the facility temperature data corrected by the correction unit.
The information processing system according to any one of claims 1 to 10. a photographing step in which a thermography camera provided in the vehicle photographs the road surface or facility;
a first acquisition step of acquiring road surface temperature data, which is the temperature data of the road surface, or facility temperature data, which is the temperature data of the facility, from the thermography camera;
a second acquisition step of acquiring position information of the vehicle when the thermography camera captures the image;
an output step of linking and outputting the road surface temperature data or the facility temperature data acquired in the first acquisition step and the position information of the vehicle acquired in the second acquisition step;
Information processing system control method.

Images