JP7026003B2 - Display control device and program - Google Patents

Description

The present invention relates to a display control device and a program.

An in-vehicle system having a means of receiving an observation point setting from a user, requesting another in-vehicle system to take a picture of the observation point, and receiving and displaying an image of the observation point from another in-vehicle system has been known (for example). , Patent Document 1).
[Prior Art Document]
[Patent Document]
[Patent Document 1] Japanese Unexamined Patent Publication No. 2006-031583

When providing a captured image of an imaging target point, it is desirable to realize a technology that can preferentially provide a newer captured image.

According to the first aspect of the present invention, a display control device is provided. The display control device may include a target point acquisition unit for acquiring an image pickup target point. When there is a vehicle capable of imaging the image pickup target point, the display control device receives the image captured by the vehicle from the vehicle, and there is no vehicle capable of imaging the image pickup target point. If the captured image can be received from the vehicle storing the captured image of the imaging target point, the captured image receiving unit may be provided to receive the captured image from the vehicle. The display control device may include a display control unit that displays the captured image received by the captured image receiving unit.

A plurality of the captured image receiving units are used when there is no vehicle capable of capturing the imaging target point and the captured image cannot be received from the vehicle storing the captured image captured at the imaging target point. The captured image of the imaging target point may be received from the image management server that manages the captured image captured by the vehicle. The display control unit may display the imaging time information indicating the time when the captured image was captured in correspondence with the captured image.

The display control device may include a request information transmitting unit that broadcasts request information including position information indicating the imaging target point, and the captured image receiving unit captures the imaging target point in response to the request information. When the first response information indicating that it is possible is received, the captured image of the imaging target point captured by the vehicle that transmitted the first response information may be received. The first response information may include time information indicating the time until the vehicle receiving the request information reaches the image pickup target point, and the captured image receiving unit may satisfy the predetermined condition of the time information. If the condition is satisfied, the captured image may be received from the vehicle that has transmitted the first response information. The first response information may include distance information indicating the distance of the vehicle that has received the request information to the imaging target point, and the captured image receiving unit may use the captured image receiving unit if the distance information satisfies a predetermined condition. The captured image may be received from the vehicle that has transmitted the first response information. The request information transmitting unit may transmit request information including time information indicating a predetermined time, and the captured image receiving unit may transmit the request information with respect to the request information from the time when the request information is received to the time before the predetermined time. When the first response information indicating that the imaging target point can be imaged is received within the period of, the captured image of the imaging target point captured by the vehicle that transmitted the first response may be received. .. The request information transmitting unit may transmit request information including distance information indicating a predetermined distance, and the captured image receiving unit has a distance to the imaging target point shorter than the predetermined distance with respect to the requested information. When the first response information indicating that the first response is received, the captured image of the imaging target point captured by the vehicle that transmitted the first response may be received.

When the captured image receiving unit does not receive the first response information in response to the request information, but receives the second response information indicating that the captured image captured at the imaging target point is stored. The captured image may be received from the vehicle that has transmitted the second response information. The second response information may include imaging time information indicating the time when the captured image captured at the imaging target point is captured, and the captured image receiving unit may use the captured image receiving unit when the imaging time information satisfies a predetermined condition. The captured image may be received from the vehicle that has transmitted the second response information. The request information transmitting unit may transmit request information including the position information and the time information indicating a predetermined time, and the captured image receiving unit may transmit the request information with respect to the request information from the time when the request information is received. When the second response information indicating that the captured image of the imaging target point is stored within the period up to a predetermined time is received, the captured image is received from the vehicle that transmitted the second response. You can do it.

According to the first aspect of the present invention, a program for making a computer function as the display control device is provided.

The outline of the above invention does not list all the necessary features of the present invention. A subcombination of these feature groups can also be an invention.

An example of the communication environment of the vehicle 100 is shown schematically. An example of the configuration of the vehicle 100 is shown schematically. An example of the positional relationship of a plurality of vehicles 100 is shown schematically. An example of the functional configuration of the control device 200 is schematically shown. An example of the processing flow by the control device 200 is schematically shown. An example of the hardware configuration of the computer 1000 that functions as the control device 200 is schematically shown. An example of the functional configuration of the communication terminal 500 is shown schematically. An example of the hardware configuration of the computer 1100 that functions as the communication terminal 500 is schematically shown.

Hereinafter, the present invention will be described through embodiments of the invention, but the following embodiments do not limit the invention to which the claims are made. Also, not all combinations of features described in the embodiments are essential to the means of solving the invention.

FIG. 1 schematically shows an example of the communication environment of the vehicle 100 according to the present embodiment. The vehicle 100 wirelessly communicates with another vehicle 100. The vehicle 100 is wireless communication with another vehicle 100 via the network 10, direct wireless communication with another vehicle 100 (may be referred to as vehicle-to-vehicle direct communication), and other via road-to-vehicle communication. Wireless communication with another vehicle 100 may be performed by at least one of wireless communication with the vehicle 100 (may be described as road-to-vehicle communication).

The network 10 may be any network. For example, the network 10 includes the Internet, a mobile phone network such as so-called 3G (3rd Generation), LTE (Long Term Evolution), 4G (4th Generation) and 5G (5th Generation), and a public wireless LAN (Local Area Network). , At least one with a dedicated network may be included.

The vehicle 100 may execute vehicle-to-vehicle direct communication and road-to-vehicle communication using any known vehicle-to-vehicle communication technology and road-to-vehicle communication technology. For example, the vehicle 100 executes vehicle-to-vehicle direct communication and road-to-vehicle communication by communication using a predetermined frequency band such as a 700 MHz band and a 5.8 GHz band. The vehicle 100 may wirelessly communicate with the other vehicle 100 via the other vehicle 100. For example, a plurality of vehicles 100 may form a vehicle-to-vehicle network by coordinating with each other through vehicle-to-vehicle direct communication and road-to-vehicle communication, and even if vehicles 100 at remote locations execute communication via the vehicle-to-vehicle network. good.

The vehicle management server 300 manages a plurality of vehicles 100. The vehicle management server 300 may manage the vehicle information of each of the plurality of vehicles 100. The vehicle information may include the position of the vehicle 100. The vehicle information may include the traveling situation of the vehicle 100. For example, the vehicle information includes the traveling direction and the traveling speed of the vehicle 100. Further, for example, the vehicle information includes route information indicating a route to the destination of the vehicle 100. The vehicle management server 300 may periodically receive various vehicle information from the vehicle 100 via the network 10.

The vehicle 100 may receive various vehicle information from the vehicle management server 300 via the network 10. Further, the vehicle 100 may receive various vehicle information from another vehicle 100 via at least one of vehicle-to-vehicle direct communication, road-to-vehicle communication, and vehicle-to-vehicle network. The vehicle 100 grasps the situation of another vehicle 100 from the received vehicle information.

The vehicle 100 includes an image pickup unit that captures an image of the surroundings of the vehicle 100, and transmits the captured image captured by the image pickup unit to the vehicle management server 300 or to another vehicle 100. Further, the vehicle 100 receives the captured image captured by the imaging unit of the other vehicle 100 from the other vehicle 100 or from the vehicle management server 300. In this way, the plurality of vehicles 100 share the captured image. The captured image may be a still image or a moving image (moving image). The vehicle management server 300 may be an example of an image management server.

For example, the vehicle 100 receives and displays a captured image of an imaging target point designated by the user of the vehicle 100 from another vehicle 100 or a vehicle management server 300. For example, the vehicle 100 can receive a captured image from a vehicle 100 that is capturing an image of an imaging target point while traveling in the vicinity of the imaging target point. Further, the vehicle 100 can receive the captured image from the vehicle 100 that stores the captured image captured when the vehicle travels in the vicinity of the imaging target point. Further, the vehicle 100 can also receive the captured image of the imaging target point from the vehicle management server 300.

The user of the vehicle 100 often wants to view a new captured image as much as possible in order to confirm the current congestion condition at a certain point, the current road condition at a certain point, and the like. Therefore, it is desirable to be able to receive a real-time captured image from the vehicle 100 that is imaging the imaging target point while traveling in the vicinity of the imaging target point and present it to the user. However, since the vehicle 100 is not always traveling in the vicinity of the imaging target point, it may not be possible to present a real-time captured image to the user. In such a case, it is desirable that even a past captured image can be provided to the user rather than not presenting any image. In this case, it is more desirable to be able to provide a newer captured image among the past captured images.

In the vehicle 100 according to the present embodiment, when there is a vehicle capable of imaging the imaging target point, the vehicle capable of receiving the captured image of the imaging target point captured by the vehicle from the vehicle and imaging the imaging target point is the vehicle. If the captured image does not exist and the captured image can be received from the vehicle that stores the captured image captured at the imaging target point, the captured image is received from the vehicle. As a result, if there is a real-time captured image, the captured image can be displayed, and even if there is no real-time captured image, the captured image that has not been captured for a long time can be displayed. .. Further, when the vehicle 100 does not have a vehicle capable of imaging the imaging target point and cannot receive the captured image from the vehicle storing the captured image captured by the imaging target point, the vehicle management server 300 The captured image of the imaging target point may be received from the above. Thereby, even if none of the above-mentioned captured images is available, the captured images captured in the past and uploaded to the vehicle management server 300 can be displayed.

FIG. 2 schematically shows an example of the configuration of the vehicle 100. The vehicle 100 includes an operation unit 110, a display unit 120, a wireless communication unit 130, an image pickup unit 140, a GNSS (Global Navigation Satellite System) reception unit 150, a sensor unit 160, and a control device 200. At least a part of these configurations may be a configuration included in a so-called car navigation system.

The operation unit 110 receives an operation by the user of the vehicle 100. The operation unit 110 may include physical operation buttons. The operation unit 110 and the display unit 120 may be a touch panel display. The operation unit 110 may accept voice operations. The operation unit 110 may include a microphone and a speaker.

The wireless communication unit 130 executes wireless communication with the vehicle management server 300 and another vehicle 100. The wireless communication unit 130 may include a communication unit that communicates with the network 10 via a wireless base station of the mobile phone network. Further, the wireless communication unit 130 may include a communication unit that communicates with the network 10 via a WiFi (registered trademark) access point. Further, the wireless communication unit 130 may include a communication unit that executes vehicle-to-vehicle communication. Further, the wireless communication unit 130 may include a communication unit that executes road-to-vehicle communication.

The image pickup unit 140 includes one or more cameras. The camera may be a drive recorder. When the image pickup unit 140 includes a plurality of cameras, each of the plurality of cameras is arranged at a different position on the vehicle 100. In addition, each of the plurality of cameras captures images in different imaging directions.

The GNSS receiving unit 150 receives radio waves transmitted from the GNSS satellite. The GNSS receiving unit 150 may specify the position of the vehicle 100 based on the signal received from the GNSS satellite.

The sensor unit 160 includes one or more sensors. The sensor unit 160 includes, for example, an acceleration sensor. The sensor unit 160 includes, for example, an angular velocity sensor (gyro sensor). The sensor unit 160 includes, for example, a geomagnetic sensor. The sensor unit 160 includes, for example, a vehicle speed sensor.

The control device 200 controls the operation unit 110, the display unit 120, the wireless communication unit 130, the image pickup unit 140, the GNSS receiver unit 150, and the sensor unit 160 to execute various processes. The control device 200 executes, for example, a navigation process. The control device 200 may execute a navigation process similar to the navigation process executed by a known car navigation system.

For example, the control device 200 identifies the current position of the vehicle 100 based on the outputs from the GNSS receiving unit 150 and the sensor unit 160, reads out the map data corresponding to the current position, and displays it on the display unit 120. Further, the control device 200 receives the input of the destination via the operation unit 110, identifies the recommended route from the current position of the vehicle 100 to the destination, and displays it on the display unit 120. When the control device 200 accepts the selection of the route, the control device 200 gives guidance on the route to be traveled by the vehicle 100 via the display unit 120 and the speaker according to the selected route.

The control device 200 according to the present embodiment executes a display process of receiving and displaying the captured image of the imaging target point designated by the user from another vehicle 100 or the vehicle management server 300. First, the control device 200 acquires a designated imaging target point via the operation unit 110. Next, the control device 200 broadcasts the request information for requesting the transmission of the captured image of the imaging target point to the other vehicle 100, including the position information indicating the imaging target point. Communication between the control device 200 and the outside of the vehicle 100 may be executed via the wireless communication unit 130. The request information transmitted by the wireless communication unit 130 reaches the plurality of vehicles 100 via at least one of the network 10 and the vehicle-to-vehicle network.

When the control device 200 receives the first response information indicating that the imaging target point can be imaged with respect to the transmitted request information, the control device 200 receives the captured image from the vehicle 100 that has transmitted the first response information. .. When the control device 200 does not receive the first response information for the request information and receives the second response information indicating that the captured image of the imaging target point is stored, the second response information is received. The captured image may be received from the vehicle 100 that has transmitted the above. When the control device 200 does not receive the first response information and the second response information, the control device 200 may receive the captured image of the imaging target point from the vehicle management server 300. The control device 200 may display the received captured image on the display unit 120.

FIG. 3 schematically shows an example of the positional relationship of a plurality of vehicles 100. In FIG. 3, as an example of a plurality of vehicles 100, a vehicle 100 and other vehicles 410, 420, 430, 440, and 450 are shown. The vehicle 410, the vehicle 420, the vehicle 430, the vehicle 440, and the vehicle 450 have the same configuration as the vehicle 100. When the vehicle 410, the vehicle 420, the vehicle 430, the vehicle 440, and the vehicle 450 are described without distinction, they may be described as other vehicles.

When the control device 200 of the vehicle 100 receives the designation of the image pickup target point from the user, for example, the control device 200 of the vehicle 100 broadcasts the request information including the position information indicating the image pickup target point. In the example shown in FIG. 3, the request information reaches the vehicle 410, the vehicle 420, the vehicle 430, the vehicle 440, and the vehicle 450 via at least one of the network 10 and the inter-vehicle network.

The other vehicle that has received the request information refers to the position and route information of the other vehicle to determine whether or not to pass the image pickup target point 402, and if the image pickup target point 402 has already passed, the image pickup target point. It may be determined whether or not the captured image obtained by capturing the 402 is stored.

In the example shown in FIG. 3, the vehicle 410 has already passed the image pickup target point 402 and stores the captured image obtained by capturing the image pickup target point 402, and the vehicle 420 receives the image pickup target point 402 after receiving the request information. Passing, the vehicle 430 does not pass the image pickup target point 402, the vehicle 440 passes through the image pickup target point 402 after receiving the request information, and the vehicle 450 has already passed the image pickup target point 402 and the image pickup target point. The case where the captured image obtained by capturing the 402 is stored will be described as an example.

The vehicle 410 transmits the second response information including the identification information and the position information of the vehicle 410 and the imaging time of imaging the imaging target point to the vehicle 100. The identification information of the vehicle 410 may be information that can identify the vehicle 410 in communication. The identification information of the vehicle 410 is, for example, an ID and an IP address assigned to the vehicle 410. The vehicle 420 transmits the first response information including the identification information and the position information of the vehicle 420 to the vehicle 100. Vehicle 430 does not transmit response information. The vehicle 440 transmits the first response information including the identification information and the position information of the vehicle 440 to the vehicle 100. The vehicle 450 transmits the second response information including the identification information and the position information of the vehicle 450 and the imaging time of imaging the imaging target point to the vehicle 100.

The control device 200 of the vehicle 100 determines to receive the captured image from the vehicle that has transmitted the first response information, on condition that the first response information has been received. When there are a plurality of vehicles that have transmitted the first response information, the control device 200 selects a vehicle that receives the captured image based on the positions of the plurality of vehicles. The control device 200 identifies, for example, the vehicle closest to the imaging target point 402. In the example shown in FIG. 3, the vehicle 100 identifies the vehicle 420. Then, the vehicle 100 transmits the request information requesting the captured image of the imaging target point 402 to the vehicle 420, and receives the captured image of the imaging target point 402 from the vehicle 420.

In the example shown in FIG. 3, when the vehicle 420 and the vehicle 440 are not present, the control device 200 of the vehicle 100 receives the second response information without receiving the first response information, and the second response information is received. Determines to receive the captured image from the vehicle that sent the response. When there are a plurality of vehicles that have transmitted the second response information, the control device 200 selects a vehicle that receives the captured image based on the imaging time at which the imaging target point is captured. The control device 200 selects, for example, the vehicle having the newest imaging time. In the example shown in FIG. 3, the vehicle 100 selects the vehicle 410. Then, the vehicle 100 transmits the request information requesting the captured image of the imaging target point 402 to the vehicle 410, and receives the captured image of the imaging target point 402 from the vehicle 410.

In the example shown in FIG. 3, when the vehicle 410, the vehicle 420, the vehicle 440, and the vehicle 450 are not present, the control device 200 of the vehicle 100 does not receive either the first response information or the second response information. Become. In this case, the control device 200 may transmit the position information indicating the imaging target point 402 to the vehicle management server 300 and receive the captured image of the imaging target point 402 from the vehicle management server 300.

FIG. 4 schematically shows an example of the functional configuration of the control device 200. The control device 200 includes a target point acquisition unit 202, a request information transmission unit 204, a response reception unit 206, a request information transmission unit 208, an image pickup image reception unit 210, a display control unit 212, and a vehicle information acquisition unit 214. It is not always essential that the control device 200 includes all of these configurations.

The target point acquisition unit 202 acquires an image pickup target point. The target point acquisition unit 202 may acquire a designated imaging target point via the operation unit 110. The target point acquisition unit 202 acquires, for example, an imaging target point for which the operation unit 110 has received a designation by pointing input. Further, the target point acquisition unit 202 acquires the image pickup target point for which the operation unit 110 has received the designation by voice input.

The request information transmission unit 204 broadcasts the request information to the other vehicle 100. The request information transmission unit 204 has identification information for identifying the vehicle 100 (may be described as a own vehicle) on which the control device 200 is mounted, and position information indicating the imaging target point acquired by the target point acquisition unit 202. Request information including and may be transmitted to another vehicle 100.

The request information transmission unit 204 may transmit request information including time information indicating a first predetermined time. In this case, the vehicle 100 that has received the request information and is scheduled to pass through the image pickup target point will set the image pickup target point within the period from the time when the request information is received to the first predetermined time indicated by the time information. When it is possible to take an image, the first response information indicating that effect is transmitted. The first predetermined time may be set by the user of the vehicle 100 or the like. For example, by setting the first predetermined time to 5 minutes, it is possible to prevent the first response information from being transmitted when the imaging target point is imaged after 5 minutes or more.

Further, the request information transmission unit 204 may transmit request information including time information indicating a second predetermined time. In this case, the vehicle 100 that has received the request information and stores the captured image of the imaging target point includes the imaging time of capturing the captured image in the request information from the time when the request information is received. The second response information is transmitted when it is within the period up to the second predetermined time indicated by the time information. The second predetermined time may be set by the user of the vehicle 100 or the like. For example, by setting the second predetermined time to 5 minutes, it is possible to prevent the second response information from being transmitted when 5 minutes or more have passed since the imaging target point was imaged. The first predetermined time and the second predetermined time may be the same or different.

The request information transmission unit 204 may transmit request information including distance information indicating a first predetermined distance. In this case, the vehicle 100 that has received the request information and is scheduled to pass through the image pickup target point receives the first response information when the distance to the image pickup target point is shorter than the first predetermined distance indicated by the distance information. Send. The first predetermined distance may be set by the user of the vehicle 100 or the like. For example, by setting the first predetermined distance to 5 km, it is possible to prevent the vehicle 100, which is 5 km or more away from the imaging target point, from transmitting the first response information.

Further, the request information transmission unit 204 may transmit the request information including the distance information indicating the second predetermined distance. In this case, the vehicle 100 that has received the request information and stores the captured image of the imaging target point has a case where the distance between the position of the vehicle 100 and the position of the imaging target point is within the second predetermined distance. The second response information is transmitted to. For example, by setting the second predetermined distance to 5 km, it is possible to prevent the vehicle 100, which is 5 km or more away from the image pickup target point after imaging the image pickup target point, from transmitting the second response information. The first predetermined distance and the second predetermined distance may be the same or different.

The response receiving unit 206 receives a response to the request information transmitted by the request information transmitting unit 204. The response receiving unit 206 receives, for example, the first response information indicating that the imaging target point can be imaged. The first response information may include identification information of the vehicle 100 that has transmitted the first response information. Further, the first response information may include time information indicating the time until the vehicle 100 that has received the request information reaches the image pickup target point. Further, the first response information may include distance information indicating the distance to the imaging target point of the vehicle 100 that has received the request information.

Further, the response receiving unit 206 receives, for example, the second response information indicating that the captured image of the imaging target point is stored. The second response information may include identification information of the vehicle 100 that has transmitted the second response information. In addition, the second response information may include the imaging time at which the imaging target point is imaged.

The request information transmitting unit 208 transmits the request information according to the reception status of the response by the response receiving unit 206. For example, when the response receiving unit 206 receives the first response information, the request information transmitting unit 208 transmits the request information requesting the captured image of the imaging target point to the vehicle 100 that has transmitted the first response information. ..

When the first response information includes time information, the request information transmission unit 208 may transmit the request information to the vehicle 100 that has transmitted the first response information, provided that the time information satisfies a predetermined condition. good. The predetermined condition may be, for example, that the time indicated by the time information is shorter than the predetermined time. The predetermined condition may be set by the user of the vehicle 100 or the like. If the first response information does not satisfy a predetermined condition, the control device 200 may consider that the first response information has not been received.

When the first response information includes the distance information, the request information transmission unit 208 may transmit the request information to the vehicle 100 that has transmitted the first response information, provided that the distance information satisfies a predetermined condition. good. The predetermined condition may be, for example, that the distance indicated by the distance information is shorter than the predetermined distance. The predetermined condition may be set by the user of the vehicle 100 or the like. If the first response information does not satisfy a predetermined condition, the control device 200 may consider that the first response information has not been received.

When there are a plurality of vehicles 100 that have transmitted the first response information, the request information transmission unit 208 may select the vehicle 100 that transmits the request information based on the positions of the plurality of vehicles.

When the response receiving unit 206 does not receive the first response information and receives the second response information, the request information transmitting unit 208 transmits the captured image of the imaging target point to the vehicle 100 that has transmitted the second response information. Send the requested information. When the second response information includes the imaging time for imaging the imaging target point, the request information transmitting unit 208 requests the vehicle that has transmitted the second response information, provided that the imaging time satisfies a predetermined condition. Information may be sent. The predetermined condition may be, for example, that the imaging time is later than a certain time. The predetermined condition may be set by the user of the vehicle 100 or the like. If the second response information does not satisfy a predetermined condition, the control device 200 may consider that the second response information has not been received. When there are a plurality of vehicles 100 that have transmitted the second response information, the request information transmission unit 208 may select the vehicle 100 that transmits the request information based on the imaging time at which the imaging target point is imaged.

When the response receiving unit 206 does not receive either the first response information or the second response information, the request information transmitting unit 208 requests the vehicle management server 300 for the captured image of the imaging target point. You may send it. The request information transmission unit 208 may transmit the request information requesting the image captured with the latest imaging time among the captured images of the imaging target points stored in the vehicle management server 300 to the vehicle management server 300. The vehicle management server 300 may transmit the captured image having the newest imaging time among the captured images of the imaging target points according to the request information. The vehicle management server 300 may transmit the imaging time of the captured image together with the captured image.

The captured image receiving unit 210 receives the captured image transmitted by the vehicle 100 or the vehicle management server 300 in response to the request information transmitted by the request information transmitting unit 208.

The display control unit 212 displays the captured image received by the captured image receiving unit 210. The display control unit 212 may display the captured image on the display unit 120. Further, the display control unit 212 may transmit the captured image to a communication terminal designated in advance and display the captured image on the communication terminal. As an example of the communication terminal, a mobile phone such as a smartphone owned by the user of the vehicle 100, a tablet terminal, or the like can be exemplified.

The display control unit 212 may display the imaging time information indicating the time when the captured image was captured in correspondence with the captured image. For example, when displaying the captured image received from the vehicle 100 that has transmitted the first response information, the display control unit 212 displays that the captured image is a real-time image or a live image together with the captured image. Further, for example, when the display control unit 212 displays the captured image received from the vehicle 100 that has transmitted the second response information, the display control unit 212 displays the captured image included in the second response information together with the captured image. Further, for example, when the display control unit 212 displays the captured image received from the vehicle management server 300, the display control unit 212 may display the captured image transmitted together with the captured image together with the captured image. As a result, it is possible for the viewer of the captured image to easily understand whether the displayed captured image indicates the current imaging target point or at what point in the past the imaging target point. ..

The vehicle information acquisition unit 214 acquires vehicle information of another vehicle 100. The vehicle information acquisition unit 214 may receive vehicle information from the vehicle management server 300 via the network 10. Further, the vehicle information acquisition unit 214 may receive various vehicle information from another vehicle 100 via at least one of vehicle-to-vehicle direct communication, road-to-vehicle communication, and vehicle-to-vehicle network. When the target point acquisition unit 202 acquires the image capture target point, the request information transmission unit 204 can image the image capture target point by first referring to the vehicle information of the other vehicle 100 acquired by the vehicle information acquisition unit 214. It may be determined whether or not there is a vehicle 100. Then, if it is determined that it exists, the request information transmission unit 204 may transmit the request information to the vehicle 100 capable of capturing the image pickup target point. If it is determined that the vehicle does not exist, the request information transmission unit 204 may broadcast the request information to the other vehicle 100.

FIG. 5 schematically shows an example of the processing flow by the control device 200. FIG. 5 shows an example of the process from receiving the designation of the imaging target point to displaying the captured image. Each process shown in FIG. 5 may be executed mainly by the control unit included in the control device 200.

When the operation unit 110 accepts the designation of the image pickup target point in the step (the step may be abbreviated as S) 102, the target point acquisition unit 202 acquires the designated image pickup target point. In S104, the request information transmission unit 204 broadcasts the request information including the identification information of the own vehicle to the other vehicle 100.

When the response receiving unit 206 receives the first response information within a predetermined time from the transmission of the request information (YES in S106) for the request information broadcast in S104, the process proceeds to S120 and the response information is not received (in S106). NO), proceed to S108. In S108, if the response receiving unit 206 receives the second response information within a predetermined time from the transmission of the request information (YES in S108), the process proceeds to S114, and if it is not received (NO in S108), the process proceeds to S110.

In S110, the request information transmission unit 208 transmits the request information to the vehicle management server 300, and the captured image receiving unit 210 receives the captured image of the imaging target point from the vehicle management server 300. In S112, the display control unit 212 causes the display unit 120 to display the captured image.

In S114, the request information transmitting unit 208 transmits the request information to the vehicle 100 that has transmitted the second response information, and the captured image receiving unit 210 receives the captured image of the imaging target point from the vehicle 100. In S118, the display control unit 212 causes the display unit 120 to display the captured image.

In S120, the request information transmission unit 208 transmits the request information to the vehicle 100 that has transmitted the first response information. In S122, the vehicle 100 waits for the start of imaging of the imaging target point. When the vehicle 100 starts imaging of the imaging target point, the vehicle 100 may notify the control device 200 to that effect. When imaging is started (YES in S122), the process proceeds to S124.

In S124, the captured image receiving unit 210 receives the captured image captured by the vehicle 100 while moving toward the imaging target point. In S126, the display control unit 212 causes the display unit 120 to display the captured image. In S128, it is determined whether or not the image pickup of the image pickup target point by the vehicle 100 is completed.

If it is determined in S128 that the imaging is not completed, the process returns to S124 to receive and display the captured image. If it is determined in S128 that the imaging is completed, the process is terminated.

FIG. 6 schematically shows an example of a computer 1000 that functions as a control device 200. The computer 1000 according to the present embodiment includes a CPU peripheral portion having a CPU 1010, a RAM 1030, and a graphic controller 1085 connected to each other by a host controller 1092, a ROM 1020 connected to the host controller 1092 by an input / output controller 1094, and a communication I /. It includes an input / output unit having an F1040, a hard disk drive 1050, and an input / output chip 1080.

The CPU 1010 operates based on the programs stored in the ROM 1020 and the RAM 1030, and controls each part. The graphic controller 1085 acquires the image data generated on the frame buffer provided in the RAM 1030 by the CPU 1010 or the like and displays it on the display. Alternatively, the graphic controller 1085 may include a frame buffer internally for storing image data generated by the CPU 1010 or the like.

The communication I / F 1040 communicates with other devices via a network by wire or wirelessly. Further, the communication I / F 1040 functions as hardware for communication. The hard disk drive 1050 stores programs and data used by the CPU 1010.

The ROM 1020 stores a boot program executed by the computer 1000 at startup, a program depending on the hardware of the computer 1000, and the like. The input / output chip 1080 connects various input / output devices to the input / output controller 1094 via, for example, a parallel port, a serial port, a keyboard port, a mouse port, and the like.

The program provided to the hard disk drive 1050 via the RAM 1030 is stored in a recording medium such as an IC card and provided by the user. The program is read from the recording medium, installed in the hard disk drive 1050 via the RAM 1030, and executed in the CPU 1010.

A program installed in the computer 1000 and causing the computer 1000 to function as the control device 200 may act on the CPU 1010 or the like to cause the computer 1000 to function as each part of the control device 200. The information processing described in these programs is read into the computer 1000, and the target point acquisition unit 202 and the request information transmission unit 204, which are specific means in which the software and the various hardware resources described above cooperate with each other. , The response receiving unit 206, the request information transmitting unit 208, the captured image receiving unit 210, the display control unit 212, and the vehicle information acquisition unit 214. Then, by realizing the calculation or processing of information according to the purpose of use of the computer 1000 in the present embodiment by these specific means, a specific control device 200 according to the purpose of use is constructed.

In the above embodiment, the control device 200 mounted on the vehicle 100 has been described as an example of the display control device, but the present invention is not limited to this, and for example, a communication terminal owned by a user riding in the vehicle 100 controls the display. It may function as a device.

FIG. 7 schematically shows an example of the functional configuration of the communication terminal 500. The communication terminal 500 includes a target point acquisition unit 502, a request information transmission unit 504, a response reception unit 506, a request information transmission unit 508, an image pickup image reception unit 510, a display control unit 512, and a vehicle information acquisition unit 514. Here, the points that the processing contents are different from those of the control device 200 shown in FIG. 4 will be mainly described.

The target point acquisition unit 502 acquires an image pickup target point. The target point acquisition unit 502 may acquire, for example, an image pickup target point that has been designated on the map application.

The request information transmission unit 504 broadcasts the request information to the other vehicle 100. The request information transmission unit 504 may transmit the request information including the identification information for identifying the communication terminal 500 and the position information indicating the imaging target point acquired by the target point acquisition unit 202 to the other vehicle 100.

The response receiving unit 506 receives the response to the request information transmitted by the request information transmitting unit 504. The request information transmission unit 508 transmits request information according to the reception status of the response by the response reception unit 506. The captured image receiving unit 510 receives the captured image transmitted by the vehicle 100 or the vehicle management server 300 in response to the request information transmitted by the request information transmitting unit 508. The display control unit 512 displays the captured image received by the captured image receiving unit 510. The display control unit 512 may display the captured image on the display provided in the communication terminal 500.

FIG. 8 shows an example of the hardware configuration of the computer 1100 that functions as the communication terminal 500. The computer 1100 according to this embodiment includes a SoC 1110, a main memory 1122, a flash memory 1124, an antenna 1132, an antenna 1134, an antenna 1136, a display 1140, a microphone 1142, a speaker 1144, a USB port 1152, and a card slot 1154.

The SoC1110 operates based on the programs stored in the main memory 1122 and the flash memory 1124, and controls each part. The antenna 1132 is a so-called cellular antenna. Antenna 1134 is a so-called WiFi® antenna. The antenna 1136 is an antenna for so-called short-range wireless communication such as Bluetooth (registered trademark). The SoC1110 may implement various communication functions using the antenna 1132, the antenna 1134, and the antenna 1136. The SoC1110 may use the antenna 1132, the antenna 1134, or the antenna 1136 to receive the program used by the SoC1110 and store it in the flash memory 1124.

The SoC1110 may realize various display functions by using the display 1140. The SoC1110 may realize various voice input functions by using the microphone 1142. The SoC1110 may realize various audio output functions by using the speaker 1144.

The USB port 1152 provides a USB connection. The card slot 1154 realizes connection with various cards such as SD cards. The SoC1110 may receive the program used by the SoC1110 from the device or memory connected to the USB port 1152 and the card connected to the card slot 1154 and store it in the flash memory 1124.

A program installed in the computer 1100 and causing the computer 1100 to function as the communication terminal 500 may act on the SoC 1110 or the like to cause the computer 1100 to function as each part of the communication terminal 500. The information processing described in these programs is read into the computer 1100, and the target point acquisition unit 502 and the request information transmission unit 504, which are specific means in which the software and the various hardware resources described above cooperate with each other. , Response receiving unit 506, request information transmitting unit 508, captured image receiving unit 510, display control unit 512, and vehicle information acquisition unit 514. Then, by realizing the calculation or processing of information according to the purpose of use of the computer 1100 in the present embodiment by these specific means, a unique communication terminal 500 according to the purpose of use is constructed.

Although the present invention has been described above using the embodiments, the technical scope of the present invention is not limited to the scope described in the above embodiments. It will be apparent to those skilled in the art that various changes or improvements can be made to the above embodiments. It is clear from the description of the claims that the form with such changes or improvements may be included in the technical scope of the present invention.

The order of execution of each process, such as operation, procedure, step, and step in the apparatus, system, program, and method shown in the claims, specification, and drawings, is particularly "before" and "prior to". It should be noted that it can be realized in any order unless the output of the previous process is used in the subsequent process. Even if the scope of claims, the specification, and the operation flow in the drawings are explained using "first", "next", etc. for convenience, it means that it is essential to carry out in this order. It's not a thing.

10 network, 100 vehicle, 110 operation unit, 120 display unit, 130 wireless communication unit, 140 image pickup unit, 150 GNSS receiver unit, 160 sensor unit, 200 control device, 202 target point acquisition unit, 204 request information transmission unit, 206 response Receiving unit, 208 request information transmitting unit, 210 captured image receiving unit, 212 display control unit, 214 vehicle information acquisition unit, 300 vehicle management server, 410, 420, 430, 440, 450 vehicles, 500 communication terminals, 502 target point acquisition Unit, 504 Request information transmission unit, 506 response reception unit, 508 request information transmission unit, 510 image capture image reception unit, 512 display control unit, 514 vehicle information acquisition unit, 1000 computer, 1010 CPU, 1020 ROM, 1030 RAM, 1040 communication I / F, 1050 hard disk drive, 1080 input / output chip, 1085 graphic controller, 1092 host controller, 1094 input / output controller, 1100 computer, 1110 SoC, 1122 main memory, 1124 flash memory, 1132 antenna, 1134 antenna, 1136 antenna, 1140 Display, 1142 microphone, 1144 speaker, 1152 USB port, 1154 card slot

Claims (14)

The target point acquisition unit that acquires the target point for imaging,
When there is a vehicle capable of capturing the imaging target point, the real-time captured image of the imaging target point captured by the vehicle can be directly communicated between vehicles, road-to-vehicle communication, and a plurality of images without going through a server. Received from the vehicle via at least one of the vehicle-to-vehicle networks formed by the vehicle working together by vehicle-to-vehicle direct communication or road-to-vehicle communication .
When there is no vehicle capable of capturing the imaging target point and the real-time captured image of the imaging target point cannot be received , the captured image is stored from the vehicle storing the captured image captured by the imaging target point. When the captured image can be received, the captured image is received from the vehicle via at least one of the vehicle-to-vehicle direct communication, the lane-to-vehicle communication, and the vehicle-to-vehicle network without going through a server. ,
A display control device including a display control unit for displaying the captured image received by the captured image receiving unit. A plurality of the captured image receiving units are used when there is no vehicle capable of capturing the imaging target point and the captured image cannot be received from the vehicle storing the captured image captured at the imaging target point. The display control device according to claim 1, which receives the captured image of the imaging target point from the image management server that manages the captured image captured by the vehicle. The display control device according to claim 1 or 2, wherein the display control unit displays image pickup time information indicating a time when the captured image is captured in correspondence with the captured image. It is provided with a request information transmission unit that broadcasts request information including position information indicating the image pickup target point to other vehicles via the vehicle-to-vehicle network .
When the captured image receiving unit receives the first response information indicating that the imaging target point can be imaged in response to the request information, the imaging image captured by the vehicle that transmitted the first response information. The display control device according to any one of claims 1 to 3, which receives a captured image of a target point. A response receiving unit that receives a response to the request information transmitted by the request information transmitting unit, and a response receiving unit.
When the response receiving unit receives the first response information, the request information transmitting unit transmits the request information for requesting the captured image of the imaging target point to the vehicle that has transmitted the first response information.
Equipped with
The display control device according to claim 4, wherein the captured image receiving unit receives a captured image of the imaging target point transmitted by the vehicle in response to the request information transmitted by the request information transmitting unit. The first response information includes the position information of the vehicle that transmitted the first response information.
The display according to claim 5, wherein when there are a plurality of vehicles that have transmitted the first response information, the request information transmitting unit selects a vehicle that transmits the request information based on the positions of the plurality of vehicles. Control device. The first response information includes time information indicating the time until the vehicle that has received the request information reaches the image pickup target point.
The display according to any one of claims 4 to 6 , wherein the captured image receiving unit receives the captured image from the vehicle that has transmitted the first response information when the time information satisfies a predetermined condition. Control device. The first response information includes distance information indicating the distance of the vehicle that received the request information to the imaging target point.
The display according to any one of claims 4 to 6 , wherein the captured image receiving unit receives the captured image from the vehicle that has transmitted the first response information when the distance information satisfies a predetermined condition. Control device. The request information transmission unit transmits request information including time information indicating a predetermined time, and the request information transmission unit transmits the request information.
The captured image receiving unit receives the first response information indicating that the imaging target point can be imaged within a period from the time when the request information is received to the predetermined time before the request information. The display control device according to any one of claims 4 to 6 , which receives an image of the image pickup target point imaged by the vehicle that has transmitted the first response. The request information transmission unit transmits request information including distance information indicating a predetermined distance, and the request information transmission unit transmits the request information.
When the captured image receiving unit receives the first response information indicating that the distance to the imaging target point is shorter than the predetermined distance with respect to the request information, the captured image receiving unit captures the image by the vehicle that transmitted the first response. The display control device according to any one of claims 4 to 6 , which receives the captured image of the image pickup target point. When the captured image receiving unit does not receive the first response information in response to the request information, but receives the second response information indicating that the captured image captured at the imaging target point is stored. The display control device according to any one of claims 4 to 6 , which receives the captured image from the vehicle that has transmitted the second response information. The second response information includes imaging time information indicating the time when the captured image of the imaging target point is captured.
The display control device according to claim 11 , wherein the captured image receiving unit receives the captured image from the vehicle that has transmitted the second response information when the imaging time information satisfies a predetermined condition. The request information transmission unit transmits request information including the position information and time information indicating a predetermined time.
The first image indicating that the captured image receiving unit stores the captured image of the imaging target point within the period from the time when the request information is received to the predetermined time before the request information. 2. The display control device according to claim 11 , wherein when the response information is received, the captured image is received from the vehicle that has transmitted the second response information. A program for causing a computer to function as the display control device according to any one of claims 1 to 13 .

Images