JP7016773B2 - Display control device and program - Google Patents

Description

The present invention relates to a display control device and a program.

A system for collecting captured images around a vehicle from an image pickup device mounted on a vehicle has been known (see, for example, Patent Document 1).
[Prior Art Document]
[Patent Document]
[Patent Document 1] Japanese Unexamined Patent Publication No. 2006-221537

It is desirable to provide a captured image that can assist the vehicle in properly arriving at the destination.

According to the first aspect of the present invention, a display control device is provided. The display control device may include a destination information acquisition unit that acquires destination information indicating the destination of the first vehicle. The display control device includes an image pickup image receiving unit that receives an image taken from the second vehicle arriving at the destination indicated by the destination information until the second vehicle arrives at the destination. good. The display control device may include a display control unit that displays the captured image received by the captured image receiving unit on the display unit.

The captured image receiving unit may receive the captured image captured by the second vehicle from the time when the second vehicle arrives at the destination to a predetermined time before. The captured image receiving unit receives the captured image captured while the second vehicle is traveling in the section of the moving route to the destination between the destination and a predetermined distance before. It's okay. The display control device may include a request information transmitting unit that broadcasts request information including the destination information, and the captured image receiving unit is located at the destination when the request information is received. The captured image may be received from the vehicle. The display control device may include a request information transmitting unit that broadcasts request information including the destination information, and the captured image receiving unit may have the purpose from the time when the request information is received to a predetermined time before. The captured image may be received from the second vehicle located on the ground. The display control device may include a route information acquisition unit that acquires route information indicating a route to the destination of the first vehicle, and the captured image receiving unit is a vehicle that has arrived at the destination. If there is a vehicle whose predetermined section until reaching the destination overlaps with the route indicated by the route information, the vehicle moves. The captured image captured while traveling along the path may be received. In the captured image receiving unit, the section between the time of arrival at the destination and the predetermined time before the destination overlaps with the route indicated by the route information in the travel route until the destination is reached. If there is a vehicle, the captured image captured while the vehicle is moving in the section may be received. When the captured image receiving unit has a vehicle in which the section between the destination and the predetermined distance before arriving at the destination overlaps with the route indicated by the route information. , The captured image captured while the vehicle is moving in the section may be received.

The captured image receiving unit is a vehicle that has arrived at the destination, and among the travel routes until the destination is reached, a predetermined section until the destination is reached is a route indicated by the route information. If there is no vehicle that overlaps with, the captured image taken while the vehicle is traveling on the different travel route from the vehicle that has traveled to the destination on a travel route different from the route indicated by the route information. May be received. The captured image receiving unit is a vehicle that has arrived at the destination, and among the travel routes until the destination is reached, a predetermined section until the destination is reached is a route indicated by the route information. When there is no vehicle that overlaps with the above and there are a plurality of vehicles that have moved to the destination by a movement route different from the route indicated by the route information, the shortest movement route among the plurality of different movement routes is the shortest. The captured image captured while the vehicle moved in the above moving path may be received while moving along the moving path. The display control unit may display the captured image on the display unit of the first vehicle. The display control unit may transmit the captured image to a communication terminal designated in advance and display the captured image on the communication terminal.

According to the second aspect of the present invention, a program for making a computer function as the display control device is provided.

The outline of the above invention does not list all the necessary features of the present invention. A subcombination of these feature groups can also be an invention.

An example of the communication environment of the vehicle 100 is shown schematically. An example of the configuration of the vehicle 100 is shown schematically. An example of the movement path 430 of the vehicle 300 that provides the captured image to the vehicle 100 is schematically shown. An example of the movement path 440 of the vehicle 300 that provides the captured image to the vehicle 100 is schematically shown. An example of the functional configuration of the control device 200 is schematically shown. An example of the processing flow by the control device 200 is schematically shown. An example of the hardware configuration of the computer 1000 functioning as the control device 200 is schematically shown. An example of the functional configuration of the communication terminal 500 is shown schematically. An example of the hardware configuration of the computer 1100 that functions as the communication terminal 500 is schematically shown.

Hereinafter, the present invention will be described through embodiments of the invention, but the following embodiments do not limit the invention to which the claims are made. Also, not all combinations of features described in the embodiments are essential to the means of solving the invention.

FIG. 1 schematically shows an example of the communication environment of the vehicle 100. The vehicle 100 according to this embodiment wirelessly communicates with another vehicle 100. The vehicle 100 is wireless communication with another vehicle 100 via the network 10, direct wireless communication with another vehicle 100 (may be referred to as vehicle-to-vehicle direct communication), and other via road-to-vehicle communication. Wireless communication with another vehicle 100 may be performed by at least one of wireless communication with the vehicle 100 (may be described as road-to-vehicle communication).

The network 10 may be any network. For example, the network 10 includes the Internet, a mobile phone network such as so-called 3G (3rd Generation), LTE (Long Term Evolution), 4G (4th Generation) and 5G (5th Generation), and a public wireless LAN (Local Area Network). , At least one with a dedicated network may be included.

The vehicle 100 may execute vehicle-to-vehicle direct communication and road-to-vehicle communication using known vehicle-to-vehicle communication technology and road-to-vehicle communication technology. For example, the vehicle 100 executes vehicle-to-vehicle direct communication and road-to-vehicle communication by communication using a predetermined frequency band such as a 700 MHz band and a 5.8 GHz band. The vehicle 100 may wirelessly communicate with the other vehicle 100 via the other vehicle 100. For example, a plurality of vehicles 100 may form a vehicle-to-vehicle network by coordinating with each other through vehicle-to-vehicle direct communication and road-to-vehicle communication, and even if vehicles 100 at remote locations execute communication via the vehicle-to-vehicle network. good.

The vehicle 100 according to the present embodiment includes an image pickup unit that captures an image of the surroundings of the vehicle 100, transmits an image captured by the image pickup unit to another vehicle 100, or takes an image captured by the image pickup unit of another vehicle 100. The image is received from another vehicle 100. The captured image may be a still image or a moving image (moving image). For example, the vehicle 100 broadcasts request information including destination information indicating the destination of the vehicle 100 to the other vehicle 100, and the other vehicle 100 arrives at the destination to the destination. Receive the captured image captured by the time it arrives. The vehicle 100 receives, for example, an captured image taken by the other vehicle 100 from the time when the other vehicle 100 arrives at the destination to a predetermined time before. Further, the vehicle 100 receives, for example, an image captured while the other vehicle 100 is traveling in a section of the movement route to the destination between the destination and a predetermined distance before. do. This makes it possible for the user of the vehicle 100 to grasp the status of the route around the destination until the destination is reached.

For example, when driving the vehicle 100 according to the route guidance by the navigation device, it may not be possible to proceed according to the route guidance depending on the situation of the destination. This is because the navigation device executes route guidance based on the stored map data, but the map data does not necessarily correspond to the real-time situation. For example, when the destination is some kind of facility, the entrance of the facility registered in the map data is closed for some reason, and another entrance must be used temporarily. You cannot proceed according to the route guidance provided by the navigation device. On the other hand, according to the vehicle 100 according to the present embodiment, the captured image captured before the other vehicle 100 actually arriving at the destination of the vehicle 100 arrives at the destination is received. Since it can be presented to the user, it is possible to let the user know an appropriate route for arriving at the destination.

FIG. 2 schematically shows an example of the configuration of the vehicle 100. The vehicle 100 includes an operation unit 110, a display unit 120, a wireless communication unit 130, an image pickup unit 140, a GNSS (Global Navigation Satellite System) reception unit 150, a sensor unit 160, and a control device 200. At least a part of these configurations may be a configuration included in a so-called car navigation system.

The operation unit 110 receives an operation by the user of the vehicle 100. The operation unit 110 may include physical operation buttons. The operation unit 110 and the display unit 120 may be a touch panel display. The operation unit 110 may accept voice operations. The operation unit 110 may include a microphone and a speaker.

The wireless communication unit 130 executes wireless communication with another vehicle 100. The wireless communication unit 130 may include a communication unit that communicates with the network 10 via a wireless base station of the mobile phone network. Further, the wireless communication unit 130 may include a communication unit that communicates with the network 10 via a WiFi (registered trademark) access point. Further, the wireless communication unit 130 may include a communication unit that executes vehicle-to-vehicle communication. Further, the wireless communication unit 130 may include a communication unit that executes road-to-vehicle communication.

The image pickup unit 140 includes one or more cameras. The camera may be a drive recorder. When the image pickup unit 140 includes a plurality of cameras, each of the plurality of cameras is arranged at a different position on the vehicle 100. In addition, each of the plurality of cameras captures images in different imaging directions.

The GNSS receiving unit 150 receives radio waves transmitted from the GNSS satellite. The GNSS receiving unit 150 may specify the position of the vehicle 100 based on the signal received from the GNSS satellite.

The sensor unit 160 includes one or more sensors. The sensor unit 160 includes, for example, an acceleration sensor. The sensor unit 160 includes, for example, an angular velocity sensor (gyro sensor). The sensor unit 160 includes, for example, a geomagnetic sensor. The sensor unit 160 includes, for example, a vehicle speed sensor.

The control device 200 controls the operation unit 110, the display unit 120, the wireless communication unit 130, the image pickup unit 140, the GNSS receiver unit 150, and the sensor unit 160 to execute various processes. The control device 200 executes, for example, a navigation process. The control device 200 may execute a navigation process similar to the navigation process executed by a known car navigation system.

For example, the control device 200 identifies the current position of the vehicle 100 based on the outputs from the GNSS receiving unit 150 and the sensor unit 160, reads out the map data corresponding to the current position, and displays it on the display unit 120. Further, the control device 200 receives the input of the destination via the operation unit 110, identifies the recommended route from the current position of the vehicle 100 to the destination, and displays it on the display unit 120. When the control device 200 accepts the selection of the route, the control device 200 gives guidance on the route to be traveled by the vehicle 100 via the display unit 120 and the speaker according to the selected route.

The control device 200 according to the present embodiment executes a request process of requesting another vehicle 100 to transmit a captured image. For example, the control device 200 receives request information including identification information for identifying the vehicle 100 and destination information indicating the destination of the vehicle 100 in response to receiving an instruction from the user via the operation unit 110. Broadcast to vehicle 100. The identification information that identifies the vehicle 100 is information that can identify the vehicle 100 in communication. The identification information is, for example, an ID and an IP address assigned to the vehicle 100. The control device 200 may have the wireless communication unit 130 broadcast the request information. The request information reaches the plurality of other vehicles 100 via at least one of the network 10 and the vehicle-to-vehicle network. When the destination is already specified, the control device 200 may include the destination information indicating the destination in the request information. When the destination is not specified, the control device 200 may receive the instruction of the destination from the user and include the destination information indicating the destination in the request information.

Further, the control device 200 according to the present embodiment executes a display process for displaying the captured image transmitted by the other vehicle 100 that has received the request information. The control device 200 may display the captured image transmitted by the other vehicle 100 and received by the wireless communication unit 130 via at least one of the network 10 and the inter-vehicle network on the display unit 120. The control device 200 displays the captured image at a position corresponding to the destination on the map displayed by the display unit 120, for example.

FIG. 3 schematically shows an example of the movement path 430 of the vehicle 300 that transmits the captured image to the vehicle 100. Here, the movement route 430 when the vehicle 300 can enter the destination 402 from the entrance 404 guided by the navigation is illustrated.

The vehicle 300 that has received the request information including the identification information of the vehicle 100 and the destination information indicating the destination 402 has the destination 402 on condition that the own vehicle has arrived at the destination 402 indicated by the destination information. Of the movement routes 430 until arriving at, the section information indicating the predetermined section 432 until arriving at the destination 402 may be transmitted to the vehicle 100. The predetermined section 432 may be, for example, a section of the movement route 430 between the time when the vehicle 300 arrives at the destination 402 and the time before the predetermined time. The predetermined time may be preset in the vehicle 300 and may be included in the request information. Further, the predetermined section 432 may be, for example, a section of the movement route 430 between the destination 402 and a predetermined distance before. The predetermined distance may be preset in the vehicle 300 and may be included in the request information.

For example, when the vehicle 300 is located at the destination 402 at the time of receiving the request information, the vehicle 300 transmits the section information to the vehicle 100. Further, for example, when the vehicle 300 is not located at the destination 402 at the time of receiving the request information, but is located at the destination within a predetermined time from the time when the request information is received. The section information is transmitted to the vehicle 100. The vehicle 100 is to transmit the section information only when it is located at the destination 402 when the request information is received, or is located at the destination between the time when the request information is received and the predetermined time before. In this case, it may be specified by the request information whether to send the section information. In this case, the request information may include information at the predetermined time.

For example, when there are a plurality of vehicles arriving at the destination 402, the vehicle 100 receives section information from the plurality of vehicles. In this case, the vehicle 100 determines whether or not there is a vehicle whose predetermined section 432 indicated by the section information overlaps with the route 410 between the vehicle 100 and the destination 402. In the example shown in FIG. 3, since the predetermined section 432 and the route 410 overlap, the vehicle 100 determines that there is a vehicle whose predetermined section 432 indicated by the section information overlaps with the route 410.

When the vehicle 100 determines that there is a vehicle whose predetermined section 432 indicated by the section information overlaps with the route 410, the vehicle 100 receives a captured image from the vehicle. In the example shown in FIG. 3, the vehicle 100 receives from the vehicle 300 the captured image captured while the vehicle 300 is moving in the predetermined section 432. The vehicle 100 may receive only the captured image captured while the vehicle 300 is moving in the predetermined section 432 from the vehicle 300. Further, the vehicle 100 may receive an image captured from the vehicle 300 in a section of the movement path 430 that is longer than the predetermined section 432 including the predetermined section 432. The section may be a section of the movement route 430 from the time when the vehicle 300 arrives at the destination 402 to a predetermined time before. The predetermined time may be preset in the vehicle 300 and may be included in the request information. Further, the section may be a section of the movement route 430 from the destination 402 to a predetermined distance before. The predetermined distance may be preset in the vehicle 300 and may be included in the request information.

FIG. 4 schematically shows an example of the movement path 440 of the vehicle 300 that provides the captured image to the vehicle 100. Here, the points different from those in FIG. 3 will be mainly described. FIG. 4 illustrates a movement route 440 when the vehicle 300 cannot enter the destination 402 from the entrance 404 guided by the navigation and enters from another entrance 406.

The vehicle 300 that has received the request information including the identification information of the vehicle 100 and the destination information indicating the destination 402 has the destination 402 on condition that the own vehicle has arrived at the destination 402 indicated by the destination information. The section information indicating the predetermined section 442 until the arrival at the destination 402 among the movement routes 440 until the arrival at the destination 402 may be transmitted to the vehicle 100. In this example, the predetermined section 442 does not overlap with the route 410.

The vehicle 100 moves differently from the route 410 as shown in FIG. 4 when there is no vehicle whose predetermined section until the arrival at the destination 402 overlaps with the route 410 among the movement routes until the arrival at the destination 402. The captured image may be received from the vehicle 300 that has moved to the destination 402 on the route 444. The movement route different from the route 410 among the movement routes until the arrival at the destination 402 may be a section of the movement routes until the arrival at the destination 402 that does not overlap with the route 410. The vehicle 100 captures images taken while the vehicle 300 is moving between a predetermined overlapping section 446 with the route 410 and the movement route 444, which is continuous with the start point 445 of the movement route 444 in the movement route 440. It may be received from the vehicle 300. The overlapping section 446 may be a section of the movement path 440 from the time when the starting point 445 of the movement path 444 is passed to a predetermined time before. The predetermined time may be preset in the vehicle 300 and may be included in the request information. Further, the overlapping section 446 may be a section of the movement path 440 from the start point of the movement path 444 to a predetermined distance before. The predetermined distance may be preset in the vehicle 300 and may be included in the request information. The vehicle 100 may receive only the captured image captured while the vehicle 300 is moving along the movement path 444 from the vehicle 300.

By presenting the captured image captured while the vehicle 300 is moving on the overlapping section 446 and the movement route 444 to the user of the vehicle 100, the destination 402 cannot be reached on the street of the route 410 and the destination 402. It is possible to let the user know what kind of route should be taken to arrive at.

FIG. 5 schematically shows an example of the functional configuration of the control device 200. The control device 200 includes a storage unit 210, a captured image acquisition unit 212, a destination information acquisition unit 222, a vehicle identification unit 224, a route information acquisition unit 226, a captured image receiving unit 230, a display control unit 232, and a request information receiving unit 242. It includes a determination unit 244 and an image pickup image transmission unit 246. It is not essential that the control device 200 includes all of these configurations.

The storage unit 210 stores various information. The storage unit 210 may store map data. The storage unit 210 may store position information indicating the current position of the vehicle 100. The storage unit 210 may store route information indicating a route to the destination of the vehicle 100.

The captured image acquisition unit 212 acquires the captured image captured by the image pickup unit 140 and stores it in the storage unit 210. The captured image acquisition unit 212 may store the captured image captured by the imaging unit 140 in the storage unit 210 in association with the imaging position indicating the imaging time and the imaging position.

The destination information acquisition unit 222 acquires destination information indicating the destination of the vehicle 100. The destination information acquisition unit 222 acquires, for example, destination information indicating a destination set by the user in the navigation process.

The vehicle identification unit 224 identifies the target vehicle for receiving the captured image based on the destination information acquired by the destination information acquisition unit 222. The vehicle identification unit 224 broadcasts request information including identification information and destination information for identifying the vehicle 100, for example. Then, when the vehicle identification unit 224 receives the consent response to the request information from another vehicle, the vehicle identification unit 224 identifies the vehicle as the target vehicle for receiving the captured image.

Further, when the vehicle 100 knows the position of another vehicle, the vehicle identification unit 224 may specify the target vehicle for receiving the captured image based on the position of the other vehicle 100. For example, when a plurality of vehicles 100 share position information via a network 10, an inter-vehicle network, or the like, the storage unit 210 sets the current position of the plurality of other vehicles 100 and the history of the positions. Store. The vehicle identification unit 224 refers to the current position and the history of the positions of the plurality of other vehicles 100 stored in the storage unit 210, identifies the vehicle 100 that has arrived at the destination indicated by the destination information, and identifies the vehicle 100. Request information is transmitted to the vehicle 100. Then, when the vehicle identification unit 224 receives the consent response to the request information from the vehicle 100, the vehicle identification unit 224 identifies the vehicle 100 as the target vehicle for receiving the captured image.

The route information acquisition unit 226 acquires route information indicating a route to the destination of the vehicle 100. The route information acquisition unit 226 acquires, for example, the route information set in the navigation process.

The vehicle identification unit 224 may further specify a vehicle based on the route information acquired by the route information acquisition unit 226. The vehicle identification unit 224 broadcasts request information including identification information and destination information for identifying the vehicle 100, for example. Next, the vehicle identification unit 224 receives the section information transmitted by the vehicle that has received the request information. As described above, the section information indicates a predetermined section until the arrival at the destination among the movement routes until the arrival at the destination indicated by the destination information. Then, the vehicle identification unit 224 identifies the vehicle based on the received section information.

For example, when there is a vehicle in which the predetermined section indicated by the section information overlaps with the route indicated by the route information, the vehicle specifying unit 224 identifies the vehicle. Further, the vehicle identification unit 224, for example, if there is no vehicle whose predetermined section indicated by the section information overlaps with the route indicated by the route information, the vehicle identification unit 224 reaches the destination by a movement route different from the route indicated by the route information. Identify the vehicle that has moved. Further, in the vehicle identification unit 224, for example, there is no vehicle whose predetermined section indicated by the section information overlaps with the route indicated by the route information, and the destination is a movement route different from the route indicated by the route information. When there are a plurality of vehicles that have traveled to, the vehicle that has traveled the shortest travel route among the plurality of travel routes is specified. When the vehicle identification unit 224 stores the current position and the history of the position of the other vehicle 100 in the storage unit 210, the vehicle identification unit 224 identifies the movement route of the other vehicle 100 with reference to these, and sets the specified movement route. , The vehicle may be identified based on the route information.

The captured image receiving unit 230 receives the captured image captured from the vehicle arriving at the destination indicated by the destination information until the vehicle arrives at the destination. The captured image receiving unit 230 receives, for example, captured images captured between the time when the vehicle arrives at the destination and the time before a predetermined time. Further, the captured image receiving unit 230 receives, for example, an captured image captured while the vehicle is traveling in a section of the movement route to the destination between the destination and a predetermined distance before.

The captured image receiving unit 230 transmits, for example, the request information requesting the captured image to the vehicle specified by the vehicle specifying unit 224, and receives the captured image from the vehicle. The captured image receiving unit 230 transmits, for example, request information for requesting an captured image captured between the time when the vehicle arrives at the destination and the time before a predetermined time to the vehicle specified by the vehicle specifying unit 224. do. Further, the captured image receiving unit 230 moves, for example, with respect to the vehicle specified by the vehicle identification unit 224, in the section of the movement route to the destination between the destination and a predetermined distance before. The request information requesting the captured image captured during the process is transmitted.

Further, when the vehicle identification unit 224 identifies a vehicle in which the predetermined section indicated by the section information overlaps with the route indicated by the route information, the captured image receiving unit 230 uses the vehicle to indicate that the vehicle is the predetermined vehicle. The captured image captured while moving through the section may be received. Further, when the vehicle identification unit 224 identifies a vehicle that has moved to the destination by a movement route different from the route indicated by the route information, the captured image receiving unit 230 continuously moves the vehicle to the starting point of the different movement route. The captured image captured while traveling on the overlapping section with the route indicated by the route information and the different movement route may be received from the vehicle. When the vehicle identification unit 224 identifies a vehicle that has moved to the destination by a movement route different from the route indicated by the route information, the captured image receiving unit 230 takes an image while the vehicle is moving on the different movement route. Only the captured image may be received from the vehicle.

The display control unit 232 causes the display unit to display the captured image received by the captured image receiving unit 230. The display control unit 232 causes the display unit 120 to display the captured image received by the captured image receiving unit 230, for example. Further, the display control unit 232 may transmit the captured image to a communication terminal designated in advance and display the captured image on the communication terminal. As an example of the communication terminal, a mobile phone such as a smartphone owned by the user of the vehicle 100, a tablet terminal, or the like can be exemplified.

The request information receiving unit 242 receives the request information transmitted by the other vehicle 100. The determination unit 244 determines whether or not the vehicle 100 has arrived at the destination indicated by the destination information by referring to the destination information included in the request information received by the request information receiving unit 242. The determination unit 244 may determine whether or not the vehicle 100 has arrived at the destination indicated by the destination information by, for example, referring to the current position specified by the navigation process and stored in the storage unit 210. ..

For example, the determination unit 244 determines whether or not the vehicle 100 is located at the destination indicated by the destination information when the request information receiving unit 242 receives the request information. Further, the determination unit 244 may determine whether or not the vehicle 100 is located at the destination indicated by the destination information between the time when the request information receiving unit 242 receives the request information and the time before the predetermined time. good. Whether or not the vehicle 100 is located at the destination when the request information is received, or whether or not the vehicle 100 is located at the destination between the time when the request information is received and the predetermined time before. Whether to determine is set in advance, or may be specified by request information.

When the determination unit 244 determines that the vehicle 100 has arrived at the destination indicated by the destination information, the captured image transmission unit 246 is a storage unit for the vehicle identified by the identification information included in the request information. The captured image stored in 210 is transmitted. Further, when the determination unit 244 determines that the vehicle 100 has arrived at the destination indicated by the destination information, the captured image transmission unit 246 first identifies the section information by the identification information included in the request information. May be sent to the vehicle. Then, when the request information is received from the vehicle 100 after the section information is transmitted, the captured image may be transmitted to the vehicle 100.

FIG. 6 schematically shows an example of the processing flow by the control device 200. Here, a state in which a user of the vehicle 100 receives a captured image and a display instruction via the operation unit 110 will be described as a start state. Each process shown in FIG. 6 is mainly executed by the control unit included in the control device 200.

In step 102 (the step may be abbreviated as S) 102, the destination information acquisition unit 222 acquires the destination information. In S104, the route information acquisition unit 226 acquires the route information.

In S106, the vehicle identification unit 224 causes the wireless communication unit 130 to broadcast the request information including the destination information acquired in S102 and the identification information for identifying the vehicle 100. In S108, section information from another vehicle that has received the request information is awaited until the predetermined time elapses.

In S110, it is determined whether or not the section information has been received. If it is received, it proceeds to S112, and if it is not received, it proceeds to S124.

In S112, it is determined whether or not there is a vehicle whose predetermined section indicated by the section information overlaps with the route indicated by the route information acquired in S104. If it is determined to be present, the process proceeds to S114, and if it is determined to be absent, the process proceeds to S118.

In S114, the captured image receiving unit 230 transmits the request information to the vehicle whose predetermined section overlaps with the route indicated by the route information. In S116, the captured image receiving unit 230 receives the captured image captured while the vehicle is moving in the predetermined section, which is transmitted by the vehicle that has received the requested information in response to the requested information.

In S118, the captured image receiving unit 230 transmits the request information to the vehicle that has moved to the destination by a movement route different from the route indicated by the route information. In S120, the captured image receiving unit 230 receives the captured image captured while the vehicle is moving along the different movement routes, which is transmitted by the vehicle that has received the requested information in response to the requested information. The captured image receiving unit 230 receives the captured image captured while the vehicle is traveling along the overlapping section with the route indicated by the route information and the different traveling route, which is continuous with the starting point of the different traveling route. It's okay.

In S122, the display control unit 232 displays the captured image received by the captured image receiving unit 230 in S116 or S120. In S124, the display control unit 232 displays the notification data notifying that there is no corresponding vehicle. The display control unit 232 causes, for example, display the notification data on the display unit 120 of the vehicle 100. Further, the display control unit 232 may display the notification data on the user's communication terminal. Then, the process is terminated.

FIG. 7 schematically shows an example of a computer 1000 that functions as a control device 200. The computer 1000 according to the present embodiment includes a CPU peripheral portion having a CPU 1010, a RAM 1030, and a graphic controller 1085 connected to each other by a host controller 1092, a ROM 1020 connected to the host controller 1092 by an input / output controller 1094, and a communication I /. It includes an input / output unit having an F1040, a hard disk drive 1050, and an input / output chip 1080.

The CPU 1010 operates based on the programs stored in the ROM 1020 and the RAM 1030, and controls each part. The graphic controller 1085 acquires the image data generated on the frame buffer provided in the RAM 1030 by the CPU 1010 or the like and displays it on the display. Alternatively, the graphic controller 1085 may include a frame buffer internally for storing image data generated by the CPU 1010 or the like.

The communication I / F 1040 communicates with other devices via a network by wire or wirelessly. Further, the communication I / F 1040 functions as hardware for communication. The hard disk drive 1050 stores programs and data used by the CPU 1010.

The ROM 1020 stores a boot program executed by the computer 1000 at startup, a program depending on the hardware of the computer 1000, and the like. The input / output chip 1080 connects various input / output devices to the input / output controller 1094 via, for example, a parallel port, a serial port, a keyboard port, a mouse port, and the like.

The program provided to the hard disk drive 1050 via the RAM 1030 is stored in a recording medium such as an IC card and provided by the user. The program is read from the recording medium, installed in the hard disk drive 1050 via the RAM 1030, and executed in the CPU 1010.

A program installed in the computer 1000 and causing the computer 1000 to function as the control device 200 may act on the CPU 1010 or the like to cause the computer 1000 to function as each part of the control device 200. The information processing described in these programs is read into the computer 1000, and the storage unit 210, the captured image acquisition unit 212, and the purpose, which are specific means in which the software and the various hardware resources described above cooperate with each other. It functions as a ground information acquisition unit 222, a vehicle identification unit 224, a route information acquisition unit 226, an image capture image reception unit 230, a display control unit 232, a request information reception unit 242, a determination unit 244, and an image capture image transmission unit 246. Then, by realizing the calculation or processing of information according to the purpose of use of the computer 1000 in the present embodiment by these specific means, a specific control device 200 according to the purpose of use is constructed.

In the above embodiment, the control device 200 has been described as an example of the display control device, but the present invention is not limited to this, and for example, a communication terminal owned by a user of the vehicle 100 in the vehicle 100 functions as the display control device. You may.

FIG. 8 schematically shows an example of the functional configuration of the communication terminal 500. The communication terminal 500 includes a destination information acquisition unit 502, a vehicle identification unit 504, a route information acquisition unit 506, a captured image receiving unit 508, and a display control unit 510.

The destination information acquisition unit 502 acquires destination information indicating the destination of the vehicle 100. The destination information acquisition unit 502 may receive destination information from the vehicle 100 by communicating with the vehicle 100.

The vehicle identification unit 504 identifies the target vehicle for receiving the captured image based on the destination information acquired by the destination information acquisition unit 502. The vehicle identification unit 504 broadcasts request information including identification information and destination information for identifying the vehicle 100, for example. Then, when the vehicle identification unit 504 receives the consent response to the request information from another vehicle, the vehicle identification unit 504 identifies the vehicle as the target vehicle for receiving the captured image.

Further, when the communication terminal 500 grasps the positions of the plurality of vehicles 100, the vehicle identification unit 504 may specify the target vehicle for receiving the captured image based on the positions of the other vehicles 100. For example, when a plurality of vehicles 100 share location information via a network 10, an inter-vehicle network, or the like, the communication terminal 500 may receive the shared information from the vehicle 100. In this case, the communication terminal 500 stores the current positions of the plurality of vehicles 100 and the history of the positions. The vehicle identification unit 224 may refer to the current position of the plurality of vehicles 100 and the history of the positions to identify the vehicle 100 that has arrived at the destination indicated by the destination information, and may transmit the request information to the vehicle 100. .. Then, when the vehicle identification unit 224 receives the consent response to the request information from the vehicle 100, the vehicle identification unit 224 identifies the vehicle 100 as the target vehicle for receiving the captured image.

The route information acquisition unit 506 acquires route information indicating a route to the destination of the vehicle 100. The route information acquisition unit 506 receives route information from the vehicle 100, for example, by communicating with the vehicle 100.

The vehicle identification unit 504 may further specify a vehicle based on the route information acquired by the route information acquisition unit 506. The vehicle identification unit 504 may specify the vehicle by the same method as the vehicle identification unit 224.

The captured image receiving unit 508 receives the captured image captured from the vehicle arriving at the destination indicated by the destination information until the vehicle arrives at the destination. The captured image receiving unit 508 transmits, for example, the request information requesting the captured image to the vehicle specified by the vehicle specifying unit 504, and receives the captured image from the vehicle. The captured image receiving unit 508 transmits, for example, request information requesting the captured image captured by the vehicle specified by the vehicle specifying unit 504 from the time when the vehicle arrives at the destination to a predetermined time before. do. Further, the captured image receiving unit 230 moves, for example, with respect to the vehicle specified by the vehicle identification unit 224, in the section of the movement route to the destination between the destination and a predetermined distance before. The request information requesting the captured image captured during the process is transmitted.

Further, when the vehicle identification unit 504 identifies a vehicle in which the predetermined section indicated by the section information overlaps with the route indicated by the route information, the captured image receiving unit 508 may use the vehicle to determine the vehicle. The captured image captured while moving through the section may be received. Further, when the vehicle identification unit 504 identifies a vehicle that has moved to the destination by a movement route different from the route indicated by the route information, the captured image receiving unit 508 continuously connects the vehicle to the starting point of the different movement route. The captured image captured while traveling on the overlapping section with the route indicated by the route information and the different movement route may be received from the vehicle. When the vehicle identification unit 224 identifies a vehicle that has moved to the destination by a movement route different from the route indicated by the route information, the captured image receiving unit 230 takes an image while the vehicle is moving on the different movement route. Only the captured image may be received from the vehicle.

The display control unit 510 displays the captured image received by the captured image receiving unit 508. The display control unit 510 displays the captured image on the display of the communication terminal 500, for example. Further, the display control unit 510 may transmit the captured image to the vehicle 100 and display the captured image on the display unit 120 of the vehicle 100.

FIG. 9 shows an example of the hardware configuration of the computer 1100 that functions as the communication terminal 500. The computer 1100 according to this embodiment includes a SoC 1110, a main memory 1122, a flash memory 1124, an antenna 1132, an antenna 1134, an antenna 1136, a display 1140, a microphone 1142, a speaker 1144, a USB port 1152, and a card slot 1154.

The SoC1110 operates based on the programs stored in the main memory 1122 and the flash memory 1124, and controls each part. The antenna 1132 is a so-called cellular antenna. Antenna 1134 is a so-called WiFi® antenna. The antenna 1136 is an antenna for so-called short-range wireless communication such as Bluetooth (registered trademark). The SoC1110 may implement various communication functions using the antenna 1132, the antenna 1134, and the antenna 1136. The SoC1110 may use the antenna 1132, the antenna 1134, or the antenna 1136 to receive the program used by the SoC1110 and store it in the flash memory 1124.

The SoC1110 may realize various display functions by using the display 1140. The SoC1110 may realize various voice input functions by using the microphone 1142. The SoC1110 may realize various audio output functions by using the speaker 1144.

The USB port 1152 provides a USB connection. The card slot 1154 realizes connection with various cards such as SD cards. The SoC1110 may receive the program used by the SoC1110 from the device or memory connected to the USB port 1152 and the card connected to the card slot 1154 and store it in the flash memory 1124.

A program installed in the computer 1100 and causing the computer 1100 to function as the communication terminal 500 may act on the SoC 1110 or the like to cause the computer 1100 to function as each part of the communication terminal 500. The information processing described in these programs is read into the computer 1100, and the destination information acquisition unit 502 and the vehicle identification unit 504, which are specific means in which the software and the various hardware resources described above cooperate with each other. , The route information acquisition unit 506, the captured image receiving unit 508, and the display control unit 510. Then, by realizing the calculation or processing of information according to the purpose of use of the computer 1100 in the present embodiment by these specific means, a unique communication terminal 500 according to the purpose of use is constructed.

Although the present invention has been described above using the embodiments, the technical scope of the present invention is not limited to the scope described in the above embodiments. It will be apparent to those skilled in the art that various changes or improvements can be made to the above embodiments. It is clear from the description of the claims that the form with such changes or improvements may be included in the technical scope of the present invention.

The order of execution of each process, such as operation, procedure, step, and step in the apparatus, system, program, and method shown in the claims, specification, and drawings, is particularly "before" and "prior to". It should be noted that it can be realized in any order unless the output of the previous process is used in the subsequent process. Even if the scope of claims, the specification, and the operation flow in the drawings are explained using "first", "next", etc. for convenience, it means that it is essential to carry out in this order. It's not a thing.

10 network, 100 vehicle, 110 operation unit, 120 display unit, 130 wireless communication unit, 140 image pickup unit, 150 GNSS receiver unit, 160 sensor unit, 200 control device, 210 storage unit, 212 image acquisition unit, 222 destination information Acquisition unit, 224 vehicle identification unit, 226 route information acquisition unit, 230 image receiving unit, 232 display control unit, 242 request information receiving unit, 244 judgment unit, 246 image transmitting unit, 300 vehicle, 402 destination, 404 entrance , 406 entrance, 410 route, 430 movement route, 432 predetermined section, 440 movement route, 442 predetermined section, 444 movement route, 445 start point, 446 overlapping section, 500 communication terminal, 502 destination information acquisition unit, 504 vehicle identification unit, 506 route information acquisition unit, 508 image capture image receiver, 510 display control unit, 1000 computer, 1010 CPU, 1020 ROM, 1030 RAM, 1040 communication I / F, 1050 hard disk drive, 1080 input / output chip, 1085 graphic controller, 1092 host Controller, 1094 I / O controller, 1100 computer, 1110 SoC, 1122 main memory, 1124 flash memory, 1132 antenna, 1134 antenna, 1136 antenna, 1140 display, 1142 microphone, 1144 speaker, 1152 USB port, 1154 card slot

Claims (10)

The destination information acquisition unit that acquires destination information indicating the destination of the first vehicle,
A request information transmission unit that broadcasts request information including the destination information, and
A second vehicle having a request information receiving unit for receiving the request information, the second vehicle located at the destination indicated by the destination information when the request information receiving unit receives the request information . An image receiving unit that receives an image taken from the vehicle until the second vehicle arrives at the destination.
A display control device including a display control unit for displaying the captured image received by the captured image receiving unit. The destination information acquisition unit that acquires destination information indicating the destination of the first vehicle,
A request information transmission unit that broadcasts request information including the destination information, and
A second vehicle having a request information receiving unit for receiving the request information, wherein the request information receiving unit was located at the destination between the time when the request information was received and the time before a predetermined time. An image receiving unit that receives an image captured from the second vehicle until the second vehicle arrives at the destination.
With a display control unit that displays the captured image received by the captured image receiving unit
Display control device. The display control device according to claim 1 or 2 , wherein the captured image receiving unit receives a captured image captured by the second vehicle from the time when the second vehicle arrives at the destination to a predetermined time before. The captured image receiving unit receives the captured image captured while the second vehicle is moving in the section of the movement route to the destination between the destination and a predetermined distance before. , The display control device according to claim 1 or 2 . A route information acquisition unit for acquiring route information indicating a route to the destination of the first vehicle is provided.
The captured image receiving unit is from the second vehicle in which a predetermined section of the movement route to reach the destination overlaps with the route indicated by the route information. The display control device according to any one of claims 1 to 4 , wherein the second vehicle receives an image captured while moving in the predetermined section. The captured image receiving unit has a section of the travel route from the time of arrival at the destination to a predetermined time before the destination overlaps with the route indicated by the route information. The display control device according to claim 5 , wherein a captured image captured while the second vehicle is moving in the section is received from the second vehicle. The second image receiving unit has the second section of the travel route to reach the destination, in which the section from the destination to a predetermined distance before overlaps with the route indicated by the route information. The display control device according to claim 6, wherein an image captured while the second vehicle is moving in the section is received from the vehicle. Route information acquisition unit that acquires route information indicating the route to the destination of the first vehicle.
Equipped with
The captured image receiving unit moves from the second vehicle that has moved to the destination by a movement route different from the route indicated by the route information, while the second vehicle is moving along the different movement route. The display control device according to any one of claims 1 to 4 , which receives the captured image. When there are a plurality of vehicles that have moved to the destination on a movement route different from the route indicated by the route information, the captured image receiving unit has moved on the shortest movement route among the plurality of different movement routes. The display control device according to claim 8, wherein an image captured by the second vehicle while the second vehicle is moving on the moving path is received from the second vehicle . A program for causing a computer to function as the display control device according to any one of claims 1 to 9 .

Images