CN110576793B

CN110576793B - Display control device and computer-readable storage medium

Info

Publication number: CN110576793B
Application number: CN201910334197.5A
Authority: CN
Inventors: 大高优; 町田巧
Original assignee: Honda Motor Co Ltd
Current assignee: Honda Motor Co Ltd
Priority date: 2018-06-11
Filing date: 2019-04-24
Publication date: 2022-09-23
Anticipated expiration: 2039-04-24
Also published as: JP6982548B2; CN110576793A; JP2019215639A

Abstract

It is desirable to provide a technique capable of selecting a captured image useful for a viewer among a large number of captured images and displaying the selected captured image to the viewer. Provided is a display control device provided with: a set route acquisition unit that acquires a set route to a destination of a 1 st vehicle, which is set by navigation processing in the 1 st vehicle; a shortest route acquisition unit that acquires a shortest route for a period up to a destination of the 1 st vehicle; a branch point determination unit that determines a shortest route and a branch point at which a route is set; a captured image receiving unit that receives, from the 2 nd vehicle, a captured image of a predetermined section set according to the branch point in the set route; and a display control unit that displays the captured image.

Description

Display control device and computer-readable storage medium

Technical Field

The invention relates to a display control apparatus and a computer-readable storage medium.

Background

A system is known that collects a captured image of the periphery of a vehicle from an imaging device mounted on the vehicle (see, for example, patent document 1).

Documents of the prior art

Patent document

Patent document 1: japanese laid-open patent publication No. 2006-221537

Disclosure of Invention

It is desirable to provide a technique for selecting a captured image useful for a viewer from a large number of captured images and displaying the selected captured image on the viewer.

According to claim 1 of the present invention, there is provided a display control device. The display control device may include a set route acquisition unit that acquires a set route to the destination of the 1 st vehicle set by the navigation process in the 1 st vehicle. The display control device may include a shortest route acquisition unit that acquires a shortest route in a section up to the destination of the 1 st vehicle. The display control device may include a branch point determination unit configured to determine a shortest route and a branch point at which a route is set. The display control device may include a captured image receiving unit that receives, from the 2 nd vehicle, a captured image of a predetermined section set according to the branch point in the set route. The display control device may include a display control unit that displays the captured image.

The photographed image receiving unit may receive the photographed image of the predetermined section including the branch point in the set route from the 2 nd vehicle. The photographed image receiving unit may receive the photographed image of the path passing through the branch point in the set route from the 2 nd vehicle. The captured image receiving unit may receive, from the 2 nd vehicle, a captured image of at least a partial section of a non-overlapping section that does not overlap with the shortest route in the set route.

The display control device may include a request information transmitting unit that broadcasts request information including section information indicating the predetermined section, and the captured image receiving unit may receive the captured image of the predetermined section captured by the vehicle that transmitted the 1 st response information when the 1 st response information indicating that the predetermined section can be captured is received with respect to the request information. When the 1 st response information is not received for the request information and the 2 nd response information indicating that the captured image obtained by capturing the predetermined section is stored is received, the captured image receiving unit may receive the captured image from the vehicle that transmitted the 2 nd response information. The predetermined section may be at least a part of a non-overlapping section of the shortest route, the non-overlapping section not overlapping with the set route.

According to the 2 nd aspect of the present invention, there is provided a computer-readable storage medium storing a program for causing a computer to function as the display control device.

Moreover, the above summary of the invention does not set forth all of the features of the invention. In addition, a subset of these feature groups can also constitute the invention.

Drawings

Fig. 1 schematically shows an example of a communication environment of a vehicle 100.

Fig. 2 schematically shows an example of the structure of the vehicle 100.

Fig. 3 schematically shows an example of the positional relationship of the plurality of vehicles 100.

Fig. 4 schematically shows an example of the functional configuration of the control device 200.

Fig. 5 schematically shows an example of the flow of processing performed by the control device 200.

Fig. 6 schematically shows an example of the hardware configuration of the computer 1000 that functions as the control device 200.

Fig. 7 schematically shows an example of a functional configuration of communication terminal 500.

Fig. 8 schematically shows an example of a hardware configuration of a computer 1100 that functions as the communication terminal 500.

(description of reference numerals)

10: a network; 100: a vehicle; 102: a route; 104: a bifurcation point; 106: a path; 110: an operation section; 120: a display unit; 130: a wireless communication unit; 140: a shooting part; 150: a GNSS receiving unit; 160: a sensor section; 200: a control device; 202: a storage section; 204: a set route acquisition unit; 206: a shortest route acquisition unit; 208: a branch point determination unit; 210: a request information transmitting unit; 212: a response receiving section; 214: a request information transmitting unit; 216: a photographed image receiving unit; 218: a display control unit; 410. 420, 430, 440: a vehicle; 500: a communication terminal; 502: a storage section; 504: a set route acquisition unit; 506: a shortest route acquisition unit; 508: a branch point determination unit; 510: a request information transmitting unit; 512: a response receiving section; 514: a request information transmitting unit; 516: a photographed image receiving unit; 518: a display control unit; 1000: a computer; 1010: a CPU; 1020: a ROM; 1030: a RAM; 1040: a communication I/F; 1050: a hard disk drive; 1080: an input-output chip; 1085: a graphics controller; 1092: a host controller; 1094: an input-output controller; 1100: a computer; 1110: SoC; 1122: a main memory; 1124: a flash memory; 1132: an antenna; 1134: an antenna; 1136: an antenna; 1140: a display; 1142: a microphone; 1144: a speaker; 1152: a USB port; 1154: a card slot.

Detailed Description

The present invention will be described below with reference to embodiments thereof, but the following embodiments do not limit the invention according to the claims. In addition, all combinations of the features described in the embodiments are not essential to the solution of the present invention.

Fig. 1 schematically shows an example of a communication environment of a vehicle 100. The vehicle 100 according to the present embodiment performs wireless communication with another vehicle 100. The vehicle 100 can perform wireless communication with the other vehicle 100 by at least one of wireless communication with the other vehicle 100 via the network 10, direct wireless communication with the other vehicle 100 (sometimes referred to as inter-vehicle direct communication), and wireless communication with the other vehicle 100 via inter-road communication (sometimes referred to as inter-vehicle communication).

The network 10 may be any network. For example, the network 10 may include at least one of the internet, a mobile telephone network such as a so-called 3G (3rd Generation), lte (long Term evolution), 4G (4th Generation), and 5G (5th Generation), a public wireless lan (local Area network), and a private network.

The vehicle 100 may perform vehicle-to-vehicle direct communication and vehicle-to-vehicle communication using known vehicle-to-vehicle communication techniques and road-to-vehicle communication techniques. For example, vehicle 100 executes vehicle-to-vehicle direct communication and vehicle-to-vehicle communication by communication using a predetermined frequency band such as the 700MHz band and the 5.8GHz band. The vehicle 100 may further perform wireless communication with another vehicle 100 via another vehicle 100. For example, the inter-vehicle network may be formed by a plurality of vehicles 100 cooperating with each other by inter-vehicle direct communication or vehicle-to-vehicle communication, or the remote vehicles 100 may be caused to perform communication with each other via the inter-vehicle network.

The vehicle 100 includes an imaging unit that images the surroundings of the vehicle 100, and transmits an image captured by the imaging unit to another vehicle 100, or receives an image captured by the imaging unit of another vehicle 100 from another vehicle 100. In this way, the vehicle 100 shares the captured image with other vehicles 100. The captured image may be a still image or a movie (moving image).

When a large number of vehicles 100 share captured images, the number of images that are not useful to the viewer also increases, and therefore it is desirable to provide a technique that enables appropriate selection of captured images that are useful to the viewer.

In the case where the route to the destination of the vehicle 100 includes an irregular section different from the usual one, the vehicle 100 according to the present embodiment acquires, for example, a captured image of the section captured while the other vehicle 100 is moving in the section, and provides the captured image to the user of the vehicle 100. For example, the vehicle 100 acquires a set route to a destination of the vehicle 100 set in a navigation system of the vehicle 100, further acquires a shortest route to the destination, and receives and displays a captured image of a predetermined section including a branch point with the shortest route in the set route from another vehicle 100.

For example, when there is a traffic prohibition due to an accident, a natural disaster, or the like, or a traffic jam occurs on the shortest route to the destination, the navigation system presents or sets the detour route as a backup. The detour route resulting from such irregularities may be a route to which the driver of the vehicle 100 is not familiar, and a situation may occur in which the driver cannot easily grasp the point at which the vehicle enters the detour route, or travels the detour route while feeling uncomfortable.

According to the vehicle 100 of the present embodiment, for example, the captured image of the route passing through the branch point with the shortest route in the set route can be displayed for the driver, so that the driver can grasp the point of the detour route in advance. Further, according to the vehicle 100 of the present embodiment, for example, the captured image of at least a part of the non-overlapping sections that do not overlap with the shortest route in the set route can be displayed for the driver, so that the driver can be made aware of the route that is not used to the driver in advance, and the anxiety of the driver can be reduced.

Fig. 2 schematically shows an example of the structure of the vehicle 100. The vehicle 100 includes an operation unit 110, a display unit 120, a wireless communication unit 130, an imaging unit 140, a GNSS (Global Navigation Satellite System) receiving unit 150, a sensor unit 160, and a control device 200. At least a part of these structures may be structures included in a so-called vehicle navigation system.

The operation unit 110 receives an operation performed by a user of the vehicle 100. The operation section 110 may include physical operation buttons. The operation unit 110 and the display unit 120 may be touch panel displays. The operation unit 110 may receive an audio operation. The operation part 110 may include a microphone and a speaker.

The wireless communication unit 130 performs wireless communication with another vehicle 100. The wireless communication section 130 may include a communication section that communicates with the network 10 via a wireless base station of a mobile phone network. In addition, the wireless communication section 130 may include a communication means that communicates with the network 10 via a WiFi (registered trademark) access point. In addition, the wireless communication section 130 may include a communication section that performs vehicle-to-vehicle communication. In addition, the wireless communication section 130 may include a communication means that performs road-to-road communication.

The photographing part 140 includes 1 or more cameras. The camera may also be a tachograph. When the imaging unit 140 includes a plurality of cameras, each of the plurality of cameras is disposed at a different position of the vehicle 100. In addition, each of the plurality of cameras photographs in a different photographing direction.

The GNSS receiver 150 receives radio waves transmitted from GNSS satellites. The GNSS receiver 150 may determine the position of the vehicle 100 based on signals received from GNSS satellites.

The sensor part 160 includes 1 or more sensors. The sensor unit 160 includes, for example, an acceleration sensor. The sensor unit 160 includes, for example, an angular velocity sensor (gyro sensor). The sensor unit 160 includes, for example, a geomagnetic sensor. The sensor unit 160 includes, for example, a vehicle speed sensor.

The control device 200 controls the operation unit 110, the display unit 120, the wireless communication unit 130, the imaging unit 140, the GNSS reception unit 150, and the sensor unit 160 to execute various processes. The control device 200 executes, for example, navigation processing. The control device 200 may execute navigation processing similar to navigation processing executed by a known vehicle navigation system.

For example, the control device 200 specifies the current position of the vehicle 100 based on the outputs from the GNSS receiver 150 and the sensor 160, reads map data corresponding to the current position, and displays the map data on the display 120. Further, the control device 200 receives an input of a destination via the operation unit 110, specifies a recommended route from the current position of the vehicle 100 to the destination, and displays the route on the display unit 120. When receiving the selection of the route, controller 200 directs the route on which vehicle 100 should travel via display unit 120 and the speaker in accordance with the selected route.

The control device 200 according to the present embodiment executes a request process of requesting transmission of a captured image of a predetermined section including a branch point of a set route and a shortest route to a destination to another vehicle 100, for example, when the set route to the destination set by the navigation process is different from the shortest route to the destination. For example, control device 200 broadcasts request information including section information indicating the predetermined section and identification information for identifying vehicle 100 to other vehicle 100. Communication between control device 200 and the outside of vehicle 100 may be performed via wireless communication unit 130.

The section information may be any information as long as it indicates a predetermined section including a branch point. For example, the section information may be information indicating a predetermined section by latitude and longitude, or may be information indicating a predetermined section by road identification information identifying a road.

The predetermined section including the branch point may be a path passing through the branch point. In this case, the section information may be, for example, information indicating the longitude and latitude of the branch point, a 1 st predetermined distance section before the branch point in the set route, and a 2 nd predetermined distance section after the branch point in the set route. The 1 st predetermined distance and the 2 nd predetermined distance may be the same distance or different distances. The 1 st predetermined distance and the 2 nd predetermined distance can be arbitrarily set and can be changed.

The predetermined section including the branch point may be at least a part of a non-overlapping section that does not overlap with the shortest route in the set route. In this case, the section information may be information indicating a section of the set route that is a predetermined distance from the branch point, for example. The predetermined section may be a section of the set route that travels from a point in time when the route passes the branch point until a predetermined time elapses, and in this case, the section information may include the predetermined time.

The identification information identifying the vehicle 100 is information capable of identifying the vehicle 100 in communication. The identification information is, for example, an ID and an IP address assigned to the vehicle 100. The control device 200 may cause the wireless communication unit 130 to broadcast the request information. The request information reaches the plurality of other vehicles 100 via at least one of the network 10 and the inter-vehicle network.

Further, the control device 200 according to the present embodiment executes display processing for displaying a captured image transmitted from another vehicle 100 that has received the request information. Control device 200 may display on display unit 120 a captured image transmitted by another vehicle 100 and received via at least one of network 10 and the inter-vehicle network. The control device 200 displays the captured image at a position corresponding to the branch point on the map displayed on the display unit 120, for example. In this example, the vehicle 100 on which the control device 200 is mounted may be an example of the 1 st vehicle, and the other vehicle 100 that transmits the captured image may be an example of the 2 nd vehicle.

Fig. 3 schematically shows an example of the positional relationship of a plurality of vehicles 100 and the branch point 104. In fig. 3, vehicle 100, and vehicle 410, vehicle 420, vehicle 430, and vehicle 440 other than vehicle 100 are shown as examples of a plurality of vehicles 100. Vehicle 410, vehicle 420, vehicle 430, and vehicle 440 have the same configuration as vehicle 100. When vehicle 410, vehicle 420, vehicle 430, and vehicle 440 are not distinguished, they may be referred to as other vehicles.

For example, when the route 102 is set, the control device 200 of the vehicle 100 specifies the branch point 104 of the route 102 and the shortest route 300 on the condition that the route 102 and the shortest route 300 are different from each other, and broadcasts request information including section information indicating a predetermined section including the branch point 104 in the route 102 and identification information of the vehicle 100. In the example shown in fig. 3, the request information reaches vehicle 410, vehicle 420, vehicle 430, and vehicle 440 via at least one of network 10 and the inter-vehicle network.

The predetermined section may be a path 106 passing through the branch point 104. The predetermined section may be a non-overlapping section 108 that does not overlap with the shortest route 300 in the route 102. The predetermined interval may be a part of the non-overlapping interval 108. Here, a case where the predetermined section is the route 106 will be described as an example.

The other vehicle that has received the request information may determine whether or not the vehicle has traveled a predetermined section and whether or not a captured image obtained by capturing an image of the predetermined section is stored when the vehicle has traveled the predetermined section, with reference to the position and route information of the other vehicle. In the example shown in fig. 3, a case will be described in which the vehicle 410 has already traveled the route 106 and has stored the captured image obtained by capturing the route 106, the vehicle 420 has already traveled the route 106 and has stored the captured image obtained by capturing the route 106, the vehicle 430 has traveled the route 106 after receiving the request information, and the vehicle 440 has traveled the route 106 after receiving the request information.

The vehicle 410 transmits the 2 nd response information including the identification information and the position information of the vehicle 410 and the photographing time for photographing the route 106 to the vehicle 100. The vehicle 420 transmits the 2 nd response information including the identification information and the position information of the vehicle 420 and the photographing time for photographing the route 106 to the vehicle 100. The vehicle 430 transmits the 1 st response information including the identification information and the position information of the vehicle 430 to the vehicle 100. The vehicle 440 transmits the 1 st response information including the identification information and the position information of the vehicle 440 to the vehicle 100.

On condition that the 1 st response information is received, control device 200 of vehicle 100 determines to receive the captured image from the vehicle that transmitted the 1 st response information. If there are a plurality of vehicles that transmit the 1 st response information, control device 200 selects a vehicle that receives a captured image based on the positions of the plurality of vehicles. Control device 200 determines, for example, the vehicle closest to route 106. In the example shown in FIG. 3, the vehicle 100 determines a vehicle 430. Then, vehicle 100 transmits request information requesting a captured image of route 106 to vehicle 430 via at least one of network 10 and the inter-vehicle network, and receives the captured image of route 106 from vehicle 430.

In the example shown in fig. 3, when there are no vehicle 430 and no vehicle 440, control device 200 of vehicle 100 receives the 2 nd response information without receiving the 1 st response information, and determines to receive a captured image from the vehicle that transmitted the 2 nd response information. If there are a plurality of vehicles transmitting the 2 nd response information, control device 200 selects a vehicle that receives a captured image according to the capturing time taken for path 106. Control device 200 selects, for example, a vehicle whose shooting time is the latest. In the example shown in fig. 3, vehicle 100 selects vehicle 420. Then, the vehicle 100 transmits request information requesting the captured image of the route 106 to the vehicle 420, and receives the captured image of the route 106 from the vehicle 420.

In the example shown in fig. 3, in the case where vehicle 410, vehicle 420, vehicle 430, and vehicle 440 are not present, control device 200 of vehicle 100 does not receive either 1 st response information or 2 nd response information. In this case, for example, control device 200 may notify the user of vehicle 100 that the set route is different from the shortest route and that the captured image of the predetermined section including the branch point cannot be acquired. Note that the control device 200 may not perform such notification.

For example, when a plurality of vehicles 100 can share a captured image via an image management server on the network 10, the control device 200 of the vehicle 100 may receive a captured image of a predetermined section including a branch point from the image management server. Such an image management server can share captured images among a plurality of vehicles 100 by, for example, appropriately collecting and storing captured images and captured positions captured when the plurality of vehicles 100 travel in various areas from each vehicle 100 and transmitting the stored captured images to the vehicle 100 in accordance with a request from the vehicle 100. For example, when any of the 1 st response information and the 2 nd response information is not received, the control device 200 transmits request information requesting a captured image of a predetermined section including a branch point to the image management server, and receives the captured image of the predetermined section including the branch point transmitted from the image management server in accordance with the request information.

Fig. 4 schematically shows an example of the functional configuration of the control device 200. The control device 200 includes a storage unit 202, a set route acquisition unit 204, a shortest route acquisition unit 206, a branch point specification unit 208, a request information transmission unit 210, a response reception unit 212, a request information transmission unit 214, a captured image reception unit 216, and a display control unit 218. The control device 200 does not necessarily have all of these configurations.

The storage unit 202 stores various information. The storage section 202 may store map data. The storage unit 202 may store position information indicating a current position of the vehicle 100 (which may be referred to as a vehicle) on which the control device 200 is mounted. The storage section 202 may store the destination of the vehicle 100. The storage section 202 may store a set route to the destination of the vehicle 100, which is set by the navigation process in the vehicle 100.

The set route acquisition unit 204 acquires a set route to the destination of the vehicle 100. The set route acquisition unit 204 can acquire the set route from the storage unit 202.

The shortest route acquisition unit 206 acquires a shortest route to the destination of the vehicle 100. The shortest route acquisition unit 206 can acquire the shortest route to the destination based on the map data stored in the storage unit 202 and the destination.

The branch point specifying unit 208 specifies a branch point of the set route acquired by the set route acquiring unit 204 and the shortest route acquired by the shortest route acquiring unit 206.

The request information transmitting unit 210 broadcasts request information including section information indicating a predetermined section set based on the branch point specified by the branch point specifying unit 208 and identification information of the vehicle 100. The request information transmitting unit 210 broadcasts request information including, for example, section information indicating a predetermined section including the branch point specified by the branch point specifying unit 208 and identification information of the vehicle 100. The request information transmitting unit 210 broadcasts request information including section information indicating a path passing through a branch point in a set route, for example. The request information transmitting unit 210 broadcasts request information including section information indicating at least a part of a non-overlapping section that does not overlap with the shortest route in the set route, for example.

The request information transmitting unit 210 may transmit request information that further includes time information indicating a predetermined time. In this case, the vehicle 100 that has received the request information transmits the 2 nd response information when it has already traveled the predetermined section indicated by the section information and has stored the captured image obtained by capturing the predetermined section, and when the capturing time for capturing the predetermined section is within a period from the time when the request information is received to before the predetermined time indicated by the time information included in the request information.

The response receiving unit 212 receives a response to the request information transmitted by the request information transmitting unit 210. The response receiving unit 212 receives, for example, the 1 st response information indicating that the predetermined section can be imaged. The 1 st response message may include identification information of the vehicle 100 that transmitted the 1 st response message.

The response receiving unit 212 receives, for example, the 2 nd response information indicating that the captured image obtained by capturing the predetermined section is stored. The 2 nd response message may include identification information of the vehicle 100 that transmitted the 2 nd response message. In addition, the 2 nd response information may include a photographing time for photographing a predetermined section.

The request information transmitting unit 214 transmits the request information according to the reception status of the response received by the response receiving unit 212. For example, when the response receiving unit 212 receives the 1 st response information, the request information transmitting unit 214 transmits request information requesting a captured image of a predetermined section to the vehicle 100 that transmitted the 1 st response information. When there are a plurality of vehicles 100 transmitting the 1 st response information, the request information transmitting unit 214 may select the vehicle 100 transmitting the request information based on the positions of the plurality of vehicles.

When the response receiving unit 212 does not receive the 1 st response information but receives the 2 nd response information, the request information transmitting unit 214 transmits request information requesting a captured image of a predetermined section to the vehicle 100 that transmitted the 2 nd response information. The request information transmitting unit 214 may transmit the request information to the vehicle transmitting the 2 nd response information on the condition that the photographing time for photographing the photographing target point included in the 2 nd response information satisfies a predetermined condition. The predetermined condition may be, for example, that the shooting time is after a certain time. The predetermined condition may be set by a user of vehicle 100 or the like. When the 2 nd response message does not satisfy the predetermined condition, the control device 200 may determine that the 2 nd response message is not received. When there are a plurality of vehicles 100 transmitting the 2 nd response information, the request information transmitting unit 214 may select the vehicle 100 transmitting the request information according to the shooting time for shooting the predetermined section.

The captured image receiving unit 216 receives the captured image transmitted by the vehicle 100 in accordance with the request information transmitted by the request information transmitting unit 214. The display control unit 218 displays the captured image received by the captured image receiving unit 216. The display controller 218 may display the captured image on the display unit 120. The display control unit 218 may transmit the captured image to a communication terminal designated in advance and display the captured image on the communication terminal. Examples of the communication terminal include a mobile phone such as a smartphone and a tablet terminal owned by the user of the vehicle 100.

Fig. 5 schematically shows an example of the flow of processing performed by the control device 200. Here, a state in which the set route is set by the navigation process in the vehicle 100 will be described as a start state. Each process shown in fig. 5 is executed mainly by a control unit provided in the control device 200.

In step (S may be omitted) 102, the set route acquisition unit 204 acquires the set route. In S104, the shortest route acquisition unit 206 acquires the shortest route. In S106, the branch point determination section 208 determines the branch point at which the route and the shortest route are set.

In S108, the request information transmitting unit 210 broadcasts, to the other vehicle 100, request information including section information indicating a predetermined section including the branch point specified by the branch point specifying unit 208 in the set route and the identification information of the vehicle 100.

If the response receiving unit 212 receives the 1 st response information within a predetermined time period from the transmission of the request information (yes in S110), the process proceeds to S122, and if the request information is not received (no in S110), the process proceeds to S112, for the request information broadcast in S108. In S112, when the response receiving unit 212 receives the 2 nd response information within a predetermined time period from the transmission of the request information (yes in S112), the process proceeds to S116, and when the response information is not received (no in S112), the process proceeds to S114.

In S114, the user is notified via the display unit 120 that the set route is different from the shortest route and that the captured image of the predetermined section including the branch point cannot be acquired. Note that the notification in S114 may not be executed. In S116, the request information transmitting unit 214 transmits the request information to the vehicle 100 that transmitted the 2 nd response information. In S118, the captured image receiving unit 216 receives a captured image of a predetermined section from the vehicle 100. In S120, the display controller 218 causes the display 120 to display the captured image.

In S122, request information transmitting unit 214 transmits the request information to vehicle 100 that transmitted the 1 st response information. In S124, the start of imaging of a predetermined section by the vehicle 100 is waited for. When the vehicle 100 having received the request information starts capturing an image of a predetermined section, it may notify the control device 200 of the fact. If the shooting has started (yes in S124), the process proceeds to S126.

In S126, the captured image receiving unit 216 receives the captured image captured while the vehicle 100 is moving in the predetermined section. In S128, the display controller 218 causes the display 120 to display the captured image. In S130, it is determined whether or not the photographing of the photographing target point by the vehicle 100 is finished.

If it is determined in S130 that the image capturing has not been completed, the process returns to S126, and the captured image is received and displayed. If it is determined in S130 that the imaging is completed, the process is terminated.

Fig. 6 schematically shows an example of a computer 1000 that functions as the control device 200. The computer 1000 according to the present embodiment includes: a CPU peripheral portion having a CPU1010, a RAM1030, and a graphics controller 1085 connected to each other through a host controller 1092; and an input/output unit having a ROM1020 connected to the host controller 1092 via an input/output controller 1094, a communication I/F1040, a hard disk drive 1050, and an input/output chip 1080.

The CPU1010 operates according to programs stored in the ROM1020 and the RAM1030 to control the respective units. The graphic controller 1085 acquires image data generated on a frame buffer built in the RAM1030, such as the CPU1010, and displays the image data on a display. Instead, the graphics controller 1085 may also internally include a frame buffer that stores image data generated by the CPU1010 or the like.

The communication I/F1040 communicates with other apparatuses via a network by wire or wirelessly. The communication I/F1040 functions as hardware for performing communication. The hard disk drive 1050 stores programs and data used by the CPU 1010.

The ROM1020 stores a boot program executed when the computer 1000 is started, a program dependent on hardware of the computer 1000, and the like. The input/output chip 1080 connects various input/output devices to the input/output controller 1094 via, for example, a parallel port, a serial port, a keyboard port, a mouse port, or the like.

The program supplied to the hard disk drive 1050 via the RAM1030 is supplied by being stored in a recording medium such as an IC card by the user. The program is read from the recording medium and installed in the hard disk drive 1050 via the RAM1030 to be executed in the CPU 1010.

A program installed in the computer 1000 to cause the computer 1000 to function as the control device 200 may operate the CPU1010 and the like to cause the computer 1000 to function as each unit of the control device 200. The information processing described in these programs is read into the computer 1000, and functions as specific means in which software and the various hardware resources described above cooperate, that is, the storage unit 202, the set route acquisition unit 204, the shortest route acquisition unit 206, the branch point specification unit 208, the request information transmission unit 210, the response reception unit 212, the request information transmission unit 214, the captured image reception unit 216, and the display control unit 218. By using these specific means, the calculation or processing of information corresponding to the purpose of use of the computer 1000 in the present embodiment is realized, and a unique control device 200 corresponding to the purpose of use is constructed.

In the above-described embodiment, the control device 200 has been described as an example of the display control device, but the present invention is not limited thereto, and for example, a communication terminal owned by a user of the vehicle 100 who is riding in the vehicle 100 may function as the display control device.

Fig. 7 schematically shows an example of a functional configuration of communication terminal 500. The communication terminal 500 includes a storage unit 502, a set route acquisition unit 504, a shortest route acquisition unit 506, a branch point specification unit 508, a request information transmission unit 510, a response reception unit 512, a request information transmission unit 514, a captured image reception unit 516, and a display control unit 518. Here, the processing content is mainly different from that of the control device 200 shown in fig. 4.

The storage unit 502 stores various information. The storage unit 502 may store map data.

The set route acquisition unit 504 acquires a set route of a section up to the destination of the vehicle 100. The set route acquiring unit 504 can receive a destination and a set route from the vehicle 100 (which may be referred to as a vehicle) on which the user having the communication terminal 500 rides by communicating with the vehicle. The set route acquisition unit 504 receives a destination and a set route from the host vehicle via short-range wireless communication such as bluetooth (registered trademark). The set route acquisition unit 504 may store the received destination and set route in the storage unit 502.

The shortest route acquisition unit 506 acquires the shortest route to the destination of the vehicle 100. The shortest route acquisition unit 506 can acquire the shortest route to the destination from the map data stored in the storage unit 202 and the destination. The branch point specification unit 508 specifies the branch point of the set route acquired by the set route acquisition unit 504 and the shortest route acquired by the shortest route acquisition unit 206.

Request information transmitting unit 510 broadcasts request information including section information indicating a predetermined section set based on the branch point specified by branch point specifying unit 508, and identification information of communication terminal 500. The response receiving unit 512 receives a response to the request information transmitted by the request information transmitting unit 510. The request information transmitting unit 514 transmits the request information according to the reception status of the response received by the response receiving unit 512. The captured image receiving unit 516 receives the captured image transmitted from the vehicle 100 in accordance with the request information transmitted from the request information transmitting unit 514. The display control unit 518 displays the captured image received by the captured image receiving unit 516. The display control unit 518 may display the captured image on a display provided in the communication terminal 500.

Fig. 8 shows an example of a hardware configuration of a computer 1100 that functions as the communication terminal 500. The computer 1100 according to this embodiment includes an SoC1110, a main memory 1122, a flash memory 1124, an antenna 1132, an antenna 1134, an antenna 1136, a display 1140, a microphone 1142, a speaker 1144, a USB port 1152, and a card slot 1154.

SoC1110 controls each unit in accordance with program operations stored in main memory 1122 and flash memory 1124. Antenna 1132 is a so-called cellular network antenna. The antenna 1134 is a so-called WiFi (registered trademark) antenna. The antenna 1136 is an antenna for so-called short-range wireless communication such as bluetooth (registered trademark). SoC1110 may implement various communication functions using antenna 1132, antenna 1134, and antenna 1136. SoC1110 can receive programs used by SoC1110 using antenna 1132, antenna 1134, or antenna 1136, and store the programs in flash memory 1124.

The SoC1110 may implement various display functions using the display 1140. The SoC1110 may implement various voice input functions using a microphone 1142. The SoC1110 may implement various sound output functions using a speaker 1144.

The USB port 1152 implements a USB connection. The card slot 1154 is used to connect various cards such as an SD card. The SoC1110 may receive programs used by the SoC1110 from a machine or a memory connected to the USB port 1152 and a card connected to the card slot 1154, and store the programs in the flash memory 1124.

A program installed in the computer 1100 to cause the computer 1100 to function as the communication terminal 500 may operate the SoC1110 and the like, and cause the computer 1100 to function as each unit of the communication terminal 500. The information processing described in these programs is read into the computer 1100, and functions as specific means in which software and the various hardware resources described above cooperate, that is, the storage unit 502, the set route acquisition unit 504, the shortest route acquisition unit 506, the branch point specification unit 508, the request information transmission unit 510, the response reception unit 512, the request information transmission unit 514, the captured image reception unit 516, and the display control unit 518. By using these specific means, the operation or processing of information corresponding to the purpose of use of the computer 1100 in the present embodiment is realized, and a unique communication terminal 500 corresponding to the purpose of use is constructed.

In the above-described embodiment, as an example of the predetermined section set based on the shortest route and the branch point at which the route is set, the predetermined section including the branch point in the route, the route passing through the branch point in the route, and at least a part of the non-overlapping section that does not overlap with the shortest route in the route are set as main examples, but the present invention is not limited thereto. For example, the predetermined section may be at least a part of the shortest route in a section in which the set route and the shortest route do not overlap. That is, the predetermined section may be at least a part of a non-overlapping section that does not overlap with the set route, among the shortest routes. The control device 200 may receive and display a captured image of at least a partial section of such the shortest route from the other vehicle 100. Thus, for example, when a detour route is selected due to congestion, the user of the vehicle 100 can view a captured image of a route that is traveling without detour, and the user can grasp the degree of congestion with which the detour route is selected.

The present invention has been described above with reference to the embodiments, but the technical scope of the present invention is not limited to the scope described in the above embodiments. Those skilled in the art will appreciate that various modifications and improvements can be made to the above-described embodiments. The technical scope of the present invention also includes the embodiments to which such changes or improvements are explicitly made according to the description of the claims.

It should be noted that the execution order of the operations, the sequence, the steps, the stages, and the like in the apparatus, the system, the program, and the method shown in the claims, the specification, and the drawings may be realized in any order unless it is specifically indicated as "before …", "before", and the like, and the output of the previous process is used in the subsequent process. In the operation flows in the claims, the specification, and the drawings, even if "first", "next", and the like are used for convenience of description, the description does not mean that the operations are necessarily performed in this order.

Claims

1. A display control device is provided with:

a set route acquisition unit that acquires a set route to a destination of a 1 st vehicle, which is set by a navigation process in the 1 st vehicle;

a shortest route acquisition unit that acquires a shortest route in a section up to the destination of the 1 st vehicle;

a branch point determination unit that determines a branch point of the shortest route and the set route;

a photographed image receiving unit that receives, from a 2 nd vehicle, a photographed image of a predetermined section set according to the branch point in the set route; and

and a display control unit that displays the captured image.

2. The display control apparatus according to claim 1,

the captured image receiving unit receives, from the 2 nd vehicle, a captured image of the predetermined section including the branch point in the set route.

3. The display control apparatus according to claim 1 or 2,

the captured image receiving section receives a captured image of a path that passes through the branch point in the set route from the 2 nd vehicle.

4. The display control apparatus according to claim 1 or 2,

the captured image receiving unit receives, from the 2 nd vehicle, a captured image of at least a partial section of a non-overlapping section that does not overlap with the shortest route in the set route.

5. The display control apparatus according to any one of claims 1 to 4, comprising a request information transmitting unit that broadcasts request information including section information indicating the predetermined section,

when the 1 st response information indicating that the predetermined section can be imaged is received for the request information, the imaged image receiving unit receives the imaged image of the predetermined section imaged by the vehicle that transmitted the 1 st response information.

6. The display control apparatus according to claim 5,

when the 1 st response information is not received and the 2 nd response information is received for the request information, the captured image receiving unit receives the captured image from the vehicle that transmitted the 2 nd response information, and the 2 nd response information indicates that the captured image obtained by capturing the predetermined section is stored.

7. The display control apparatus according to claim 1,

the predetermined section is at least a part of a non-overlapping section that does not overlap with the set route in the shortest route.

8. A computer-readable storage medium storing a program,

the program is for causing a computer to function as the display control apparatus according to any one of claims 1 to 7.