JP2018148284A - Base station device and communication system - Google Patents

Abstract

PROBLEM TO BE SOLVED: To suppress increase in communication traffic of a mobile communication network without requiring communication to the core network side, in communication processing in the case that one communication device existing in a cell utilizes information on another communication device.SOLUTION: A base station device for mobile communication of a cellular system includes: internal storage means for storing storage target information on each of a plurality of communication devices existing in a cell formed by the base station device; cell side communication means for performing radio communication with the communication devices existing in the cell; and processing means for executing transmission processing that in the case of acquiring from the cell side communication means an information acquisition request on another communication device from one communication device existing in the cell, uses storage target information on the other communication device stored in the internal storage means to transmit using the cell side communication means request information corresponding to the information acquisition request to the one communication device.SELECTED DRAWING: Figure 1

Description

  The present invention relates to a base station apparatus and communication system for cellular mobile communication.

  In Patent Document 1, an image captured by the front vehicle camera is superimposed on a portion of the captured image obtained by photographing the front of the own vehicle with the camera of the own vehicle, which is a blind spot by the front vehicle. An in-vehicle image processing device that generates a composite image that has passed through is disclosed. In this in-vehicle image processing apparatus, the host vehicle receives an image captured by the camera of the preceding vehicle from the preceding vehicle through inter-vehicle communication with the preceding vehicle.

  When inter-vehicle communication is used as a communication method for receiving an image captured by a camera of a preceding vehicle by the host vehicle as in the in-vehicle image processing device described in Patent Document 1, the vehicle is used for both the preceding vehicle and the host vehicle. It is assumed that a wireless communication device for inter-vehicle communication is installed. Therefore, it is difficult to realize the in-vehicle image processing apparatus described in Patent Document 1 unless such a wireless communication apparatus is sufficiently spread.

  On the other hand, cellular mobile communication used as a communication method for cellular phones and the like is sufficiently widespread, and if this is adopted as a communication method, the in-vehicle image processing device described in Patent Document 1 is realized. There is an advantage that it becomes easy. However, if the conventional cellular mobile communication is adopted as it is, for example, even communication between vehicles in a short distance existing in the same cell, the network to the core network on the network side rather than the base station device forming the cell There is a problem that communication occurs and causes an increase in communication traffic of the mobile communication network.

  This problem is not limited to using an image captured by a camera of a preceding vehicle located at a short distance in the host vehicle, and generally uses information related to another communication device located at a short distance in one communication device. In some cases, this can occur as well.

  A base station apparatus according to an aspect of the present invention is a base station apparatus for cellular mobile communication, and stores storage target information regarding each of a plurality of communication apparatuses located in a cell formed by the base station apparatus. An internal storage means, a cell-side communication means for wirelessly communicating with a communication device located within the cell, and an information acquisition request for another communication device from one communication device located within the cell. If acquired by the communication means, the request information corresponding to the information acquisition request is transmitted to the one communication apparatus by the cell side communication means using the storage target information regarding the other communication apparatus stored in the internal storage means. And processing means for executing transmission processing.

In the base station apparatus, the processing means may execute storage processing for acquiring storage target information regarding the communication apparatus from the communication apparatus by the cell side communication means and storing the information in the internal storage means. Good.
In the base station apparatus, the storage target information may include a captured image captured by an imaging unit provided in the communication apparatus.
In the base station apparatus, the storage target information may include position information indicating a position of the communication apparatus.
Further, in the base station apparatus, the storage target information may include individual identification information of a mobile object on which the communication apparatus is mounted.
In the base station apparatus, the individual identification information may be individual identification information displayed outside the mobile body.
In the base station apparatus, the individual identification information may be information specified based on a captured image obtained by capturing the moving body with an external imaging device positioned outside the corresponding moving body.
In the base station apparatus, the processing unit acquires the captured image captured by the external imaging device from the external imaging device by the cell-side communication unit, and specifies the individual identification information based on the captured image. The individual identification information specifying process may be executed.
Further, in the base station apparatus, the internal storage means stores storage target information related to the communication apparatus in association with identification information capable of identifying the communication apparatus, and the processing means corresponds to the another communication apparatus. Identification information is acquired by the cell side communication means in association with the information acquisition request, and storage target information related to the other communication apparatus corresponding to the identification information is transferred from the internal storage means to the one communication apparatus. The transmission process may be executed by transmitting by communication means.
Further, in the base station apparatus, the processing means specifies the storage target information related to the other communication apparatus stored in the internal storage means based on the acquired information acquisition request, and the specified storage target information The request information corresponding to the information acquisition request is acquired from the other communication device corresponding to the information, and the acquired request information is transmitted to the one communication device by the cell side communication means, thereby executing the transmission process. It may be a thing.
In the base station apparatus, the processing means may execute the processing without communicating with the core network side.

  A communication system according to another aspect of the present invention is a communication system that performs cellular mobile communication, and includes the base station apparatus and at least one communication apparatus that can communicate with the base station apparatus through mobile communication. .

  According to the present invention, the storage target information regarding each of a plurality of communication devices located in a cell formed by the base station device is stored in the internal storage means of the base station device, and from one communication device in the cell When request information for another communication apparatus is transmitted to one communication apparatus in response to the acquisition request, the storage target information stored in the internal storage unit of the base station apparatus is used. Therefore, communication processing when one communication device uses information about another communication device can be realized without requiring communication to the core network side, and an increase in communication traffic of the mobile communication network is suppressed. it can.

Explanatory drawing which shows an example of the communication system which concerns on embodiment of this invention. Explanatory drawing which shows the other example of the communication system which concerns on embodiment of this invention. Explanatory drawing which shows the further another example of the communication system which concerns on embodiment of this invention. Explanatory drawing which shows the further another example of the communication system which concerns on embodiment of this invention. The functional block diagram of the base station apparatus in the communication system which concerns on this embodiment. The schematic diagram which shows the structure of the own vehicle carrying the display apparatus which comprises the display system using the communication system which concerns on this embodiment. Explanatory drawing which shows the structure of HUD used with the display apparatus in this embodiment. FIG. 2 is a hardware block diagram illustrating a main configuration of an image processing apparatus in the display apparatus according to the present embodiment. The functional block diagram of the display apparatus in this embodiment. The functional block diagram of the camera mounted in the preceding vehicle in the display system of this embodiment. Explanatory drawing when the own vehicle and preceding vehicle in this embodiment are seen from the side. The schematic diagram which shows an example of the visual field in front of the own vehicle which a driver | operator visually recognizes through the windshield of the own vehicle in the state which is not displaying the preceding vehicle captured image by the display apparatus in this embodiment. The schematic diagram which shows an example of the visual field in front of the own vehicle which a driver | operator visually recognizes through the windshield of the own vehicle in the state which displayed the preceding vehicle captured image with the display apparatus in this embodiment. The sequence diagram which shows the flow of the process of this embodiment. The schematic diagram which shows the other example of the visual field in front of the own vehicle which a driver | operator visually recognizes through the windshield of the own vehicle in the state which displayed the preceding vehicle captured image by the display apparatus in this embodiment. The schematic diagram which shows the further another example of the visual field ahead of the own vehicle which a driver | operator visually recognizes through the windshield of the own vehicle in the state which displayed the preceding vehicle captured image by the display apparatus in this embodiment. Explanatory drawing which shows the example which is just before the front vehicle which is drive | working ahead of the own vehicle passes an intersection in the modification 1. FIG. The sequence diagram which shows the flow of the process in the modification 1. FIG. The sequence diagram which shows the flow of the process in the modification 2. In Modified Example 3, when the oncoming lane is congested, the pedestrian W crosses the traveling lane of the own vehicle through the space between the first oncoming vehicle and the second oncoming vehicle stopped in front of the first oncoming vehicle. Explanatory drawing which shows the example which is going to do. The schematic diagram which shows an example of the visual field in front of the own vehicle which a driver | operator visually recognizes through the windshield of the own vehicle in the state which is not displaying the pedestrian mark image by the display apparatus in the modification 3. FIG. The schematic diagram which shows an example of the visual field in front of the own vehicle which a driver | operator visually recognizes through the windshield of the own vehicle in the state which displayed the pedestrian mark image with the display apparatus in the modification 3. FIG. It is a sequence diagram which shows the flow of the process in the modification 3.

Hereinafter, embodiments of the present invention will be described with reference to the drawings.
FIG. 1 is an explanatory diagram showing an example of a communication system according to an embodiment of the present invention.
The communication system according to the present embodiment includes a base station apparatus 70 in a cellular mobile communication network 60 and mobile station apparatuses 12 and 52 as communication apparatuses mounted on automobiles 40 (1) and 40 (2) that are mobile bodies. With. In the present embodiment, the case where the moving body is an automobile (passenger car, truck, bus, etc.) will be described. However, the moving body in the present embodiment is not only an automobile but also a railway vehicle, aircraft, and ship that travels on a track. Industrial heavy machinery, industrial robots, and the like may also be used. Further, the communication system according to the present embodiment is an example in which the base station device 70 constitutes a macro cell base station, but the base station device 70 may constitute a small cell base station or the like.

  In the communication system of the present embodiment, the base station apparatus 70 constitutes a fixed base station arranged on the ground, and a cell 70S is formed as a communicable range of the base station apparatus 70, and each mobile station existing in the cell Wireless communication is established with the station apparatuses 12 and 52. The base station device 70 is connected to the core network 62 of the mobile communication network 60 via a backhaul line, and can communicate with other base station devices that form other cells via the core network 62. It is configured. The mobile station apparatuses 12 and 52 existing in the cell 70S of the base station apparatus 70 are other mobile station apparatuses existing in the cell of the other base station apparatus connected to the core network 62 via the base station apparatus 70. Can communicate with.

  The mobile station apparatuses 12 and 52 provided in the automobiles 40 (1) and 40 (2) communicate with the base station apparatus 70 by wireless communication using frequency bands such as 28 GHz band, 5 GHz band, and 4.2 GHz band, for example. . The antennas provided in the mobile station apparatuses 12 and 52 are the main bodies of the automobiles 40 (1) and 40 (2), for example, a flat part of the roof, a shark antenna part at the rear of the roof in which an antenna for other uses is incorporated, or a pillar part. Is provided. The antenna may have a plurality of antenna elements, and may have a beam forming function capable of tracking the base station apparatus 70 by controlling the number and direction of antenna beams.

  The mobile station apparatuses 12 and 52 are illustrated on the roofs of the automobiles 40 (1) and 40 (2) for the sake of illustration, but for example, in the trunks of the automobiles 40 (1) and 40 (2). , Installed inside the dashboard, under the seat, etc. The mobile station apparatuses 12 and 52 may be provided with a power source (battery) in their own apparatuses, but may be supplied with electric power from a battery on the side of the automobiles 40 (1) and 40 (2). When power is supplied from the battery on the side of the automobile 40 (1), 40 (2), the supply of power from the battery to the mobile station apparatus 12, 52 is performed by the automobile 40 (1), You may make it stop automatically when predetermined time (for example, 1 hour) passes since the drive stop (OFF) of 40 (2).

FIG. 2 is an explanatory diagram illustrating another example of the communication system according to the present embodiment.
In the communication system of FIG. 2, the satellite station (artificial satellite) 63 relays communication between the mobile station apparatuses 12 and 52 mounted on the automobiles 40 (1) and 40 (2) and the ground base station apparatus 70. This is an example. In this example, the cell 70S is formed in the communicable range of the satellite station (artificial satellite) 63.

FIG. 3 is an explanatory diagram showing still another example of the communication system according to the present embodiment.
In the communication system of FIG. 3, the mooring balloon relay station 65 provided in the mooring balloon 64 is provided between the mobile station apparatuses 12 and 52 mounted on the automobiles 40 (1) and 40 (2) and the ground base station apparatus 70. This is an example of relaying the communication. In this example, the cell 70S is formed in the communicable range of the mooring balloon relay station 65.

FIG. 4 is an explanatory diagram showing still another example of the communication system according to the present embodiment.
The communication system of FIG. 4 is a mobile base station (hereinafter referred to as “moving cell base station”) mounted on another automobile 40 (3) existing in the cell 70S-1 directly formed by the base station apparatus 70. ) 66 is an example of relaying communication between the mobile station apparatuses 12 and 52 mounted on the automobiles 40 (1) and 40 (2) and the base station apparatus 70 which is a fixed base station. In this example, even if the mobile station devices 12 and 52 mounted on the automobiles 40 (1) and 40 (2) do not exist in the cell 70S-1 directly formed by the base station device 70, the cell 70S. -1 establishes communication with the base station apparatus 70 if it exists in a mobile cell (hereinafter referred to as “moving cell”) 70S-2 formed by the moving cell base station 66 existing in -1. Can do. In this example, the cell 70S formed by the base station device 70 includes a cell 70S-1 and a moving cell 70S-2.

  The moving cell base station 66 includes a first antenna for performing wireless communication with the base station device 70, and mobile station devices mounted on the automobiles 40 (1) and 40 (2) in the moving cell 70S-2. 12, 52 and a second antenna for performing wireless communication. The first antenna and the second antenna are provided in a main body of the automobile 40 (3), for example, a flat portion of the roof, a shark antenna portion at the rear of the roof in which an antenna for other uses is incorporated, or a pillar portion. The first antenna and the second antenna may be a shared antenna. The first antenna may include a plurality of antenna elements, and may have a beam forming function capable of tracking the base station apparatus 70 by controlling the number and direction of antenna beams. The second antenna may include a plurality of antenna elements, and may have a beam forming function capable of controlling the number and direction of antenna beams.

  The moving cell base station 66 is shown on the roof of the automobile 40 (3) for convenience of illustration, but for example, in the trunk of the automobile 40 (3), inside the dashboard, under the seat, etc. Installed. The moving cell base station 66 may be provided with a power source (battery) in its own device, but may be supplied with electric power from a battery on the automobile 40 (3) side. When power is supplied from the battery on the side of the automobile 40 (3), the power supply from the battery to the moving cell base station 66 starts from the driving stop (OFF) of the automobile 40 (3) in which charging to the battery is stopped. You may make it stop automatically when predetermined time (for example, 1 hour) passes.

  Further, the moving cell base station 66 may have a repeater function that functions as a radio relay station of the base station device 70. Further, the moving cell base station 66 is assigned base station identification information (cell ID) that can be distinguished from other base stations, and can be connected to the core network 62 of the mobile communication network 60 via the base station device 70. It may have a function.

FIG. 5 is a functional block diagram of the base station apparatus 70 in the present embodiment.
The base station apparatus 70 of this embodiment mainly executes various processes of data communicated with a mobile station (mobile station apparatuses 12 and 52) or another base station (moving cell base station 66 or the like). A data processing unit 71 as a processing unit, a storage unit 72 as an internal storage unit for storing various data, and a cell side communication for communicating with each mobile station (mobile station apparatus 12, 52) existing in the cell 70S. A mobile communication unit 73 as a means, and a backhaul communication unit 74 as a core network side communication means for communicating with other base stations or management devices connected to the core network 62 of the mobile communication network 60. The

  The base station device 70 according to the present embodiment stores storage target information related to communication devices (mobile station devices 12, 52) and other base stations (moving cell base station 66, etc.) in the cell 70S in the storage unit 72. Function as a local data center to manage. For example, for a communication device having a function for acquiring position information (such as the GPS device 43), position information indicating the current position of the communication device is received from the communication device and stored in the storage unit 72. To do. Thereby, the base station apparatus 70 holds the position information of each communication apparatus existing in the cell 70S as a database.

Next, an example in which the communication system according to the present embodiment is applied to the following display system will be described.
The display system of the present embodiment includes a display device 1 mounted on a host vehicle (passenger car, truck, bus, etc.) 40 (1) that is a moving body, and a vehicle that travels in the same direction in front of the host vehicle 40 (1). And a camera 50 as an imaging means mounted on a preceding vehicle 40 (2) as a moving body in the same direction which is a moving body of the same, and the communication of the present embodiment as a communication means between the display device 1 and the camera 50 Use the system.

FIG. 6 is a schematic diagram showing the configuration of the host vehicle 40 (1) on which the display device 1 according to this embodiment is mounted.
FIG. 7 is an explanatory diagram showing a configuration of a head-up display (hereinafter referred to as “HUD”) 20 as display means used in the display device 1 in the present embodiment.
The display device 1 according to the present embodiment can be broadly divided into an image processing device 10 and a HUD 20. The HUD 20 projects an image onto the windshield 42 that is the front windshield of the host vehicle 40 (1), for example, by a projector disposed on the dashboard of the host vehicle 40 (1).

  The HUD 20 mainly controls a light irradiation device 21 that emits image light (light beam) for displaying an image generated in the image processing device 10 of the display device 1, an irradiation lens 22, and an irradiation range of the image light. Optical lens 23, reflecting mirror 24 for controlling the irradiation position of image light, and magnifying lens 25 for enlarging the image.

  The image light (light beam) irradiated by the light irradiation device 21 is irradiated to the reflection mirror 24 via the irradiation lens 22 and the optical lens 23. The image light reflected by the reflection mirror 24 is magnified by the magnifying lens 26 and projected onto the windshield 42 of the host vehicle 40 (1). The image light projected on the windshield 42 is reflected by the inner wall surface of the windshield 42 and travels toward the driver P of the host vehicle. Therefore, the display device 1 according to the present embodiment can display the image (superimposed image) G projected by the HUD 20 so as to be superimposed on the field of view in front of the host vehicle viewed through the windshield 42 of the host vehicle. The driver P can view the image G projected by the HUD 20 in a state where the image G is superimposed on the field of view in front of the host vehicle that is viewed through the windshield 42 of the host vehicle.

  The display range of the projected image G (image light irradiation range) can be controlled by moving the optical lens 23 in the optical axis direction. In addition, the display position of the image G (image light irradiation position) can be controlled by changing the angle of the reflection mirror 24. The movement of the optical lens 23 and the change of the angle of the reflection mirror 24 can be performed by controlling a predetermined drive unit by the image processing apparatus 10.

FIG. 8 is a hardware block diagram showing the main configuration of the image processing apparatus 10 in the display apparatus 1 of the present embodiment.
The hardware of the image processing apparatus 10 mainly includes a CPU 10A, a ROM 10B, a RAM 10C, a communication I / F 10D, and a data I / F 10E. The CPU 10A executes various programs stored in the ROM 10B, thereby executing image display control such as drive control of the HUD 20, executing various image processing, and controlling each function of the display device 1. . The ROM 10B stores various programs executed by the CPU 10A to control each function of the display device 1. The RAM 10C is used as a work area for the CPU 10A. The communication I / F 10D communicates with an external device such as the camera 50 mounted on the preceding vehicle 40 (2) via the mobile communication network 60, or the CAN (Controller Area Network) of the host vehicle 40 (1). Via 61, it communicates with various vehicle-mounted sensors, such as a navigation apparatus of the own vehicle 40 (1), a GPS apparatus, and a vehicle speed sensor. The data I / F 10E performs communication with the HUD 20.

FIG. 9 is a functional block diagram of the display device 1 mounted on the host vehicle 40 (1).
The image processing device 10 of the display device 1 includes a control unit 11 that controls the entire function of the display device 1 and a preceding vehicle captured image obtained by imaging the front of the preceding vehicle 40 (2) by the camera 50 of the preceding vehicle 40 (2). Based on the mobile station device (external communication unit) 12 that receives data via the mobile communication network 60 and the data of the preceding vehicle captured image received by the external communication unit 12, it is visually recognized through the windshield 42 of the host vehicle 40 (1). An image generation unit 13 that generates an image (superimposed image) to be displayed by the HUD 20 so as to be superimposed on the field of view in front of the host vehicle, and a display control unit 14 that controls the HUD 20 that displays the image generated by the image generation unit 13. The GPS (Global Positioning System) device 43 and various in-vehicle sensors (vehicle speed sensor, acceleration sensor, attitude sensor, radar, temperature sensor) mounted on the host vehicle 40 (1) And the like. The in-vehicle communication unit 15 that receives information from 44 via the CAN 61 of the host vehicle 40 (1) and the imaging unit 16 that captures the front of the host vehicle 40 (1) and obtains the host vehicle captured image are configured. Is done.

FIG. 10 is a functional block diagram of the camera 50 mounted on the preceding vehicle 40 (2).
The camera 50 includes a control unit 51 that controls the overall functions of the camera 50 and a mobile station device that transmits from the mobile communication network 60 data of a preceding vehicle captured image obtained by imaging the front of the preceding vehicle 40 (2) by the imaging unit 53. An external communication unit) 52, an imaging unit 53 that captures the front of the preceding vehicle 40 (2) and obtains a preceding vehicle captured image, and a GPS device 43 and various in-vehicle sensors 44 mounted on the preceding vehicle 40 (2). The in-vehicle communication unit 54 that receives the above information via the CAN 61 of the preceding vehicle 40 (2).

FIG. 11 is an explanatory diagram when the host vehicle 40 (1) and the preceding vehicle 40 (2) are viewed from the side.
FIG. 12 is a schematic diagram illustrating an example of a field of view in front of the host vehicle that is viewed by the driver P through the windshield 42 of the host vehicle 40 (1) in a state in which the preceding vehicle captured image is not displayed on the display device 1. .
FIG. 13 is a schematic diagram illustrating an example of a field of view in front of the host vehicle that is viewed by the driver P through the windshield 42 of the host vehicle 40 (1) in a state where the preceding vehicle captured image is displayed on the display device 1.

  The illustrated example is an example of a situation where the host vehicle 40 (1) is traveling following the preceding vehicle 40 (2) immediately before passing through the intersection. In this situation, as shown in FIG. 11, a blind spot area (in FIG. 11) by the preceding vehicle 40 (2) is present in the field of view in front of the host vehicle that is visually recognized by the driver P through the windshield 42 of the host vehicle 40 (1). The hatched portion D). In this example, as shown in FIG. 12, the driver P of the host vehicle 40 (1) hides the traffic signal 45 as the target object 45 existing in the blind spot area D from the preceding vehicle 40 (2). It cannot be visually recognized. Therefore, the driver P of the host vehicle 40 (1) may cause the host vehicle 40 (1) to enter the intersection without noticing that the traffic light 45 is red.

  In this embodiment, since the imaging area E by the camera 50 of the preceding vehicle 40 (2) includes the blind spot area D by the preceding vehicle 40 (2), an image captured by the camera 50 (preceding vehicle captured image) is obtained. The own vehicle 40 (1) receives via the mobile communication network 60. Then, the received preceding vehicle captured image (superimposed image) is projected by the HUD 20 so as to be superimposed on the rear surface of the preceding vehicle 40 (2) viewed through the windshield 42 of the host vehicle 40 (1) as shown in FIG. indicate. As a result, the driver P of the host vehicle 40 (1) can recognize the traffic signal 45 existing in the blind spot area D, and is not aware that the traffic signal 45 is red. The situation of entering 1) is suppressed. In particular, in the present embodiment, the driver P can recognize the traffic light 45 existing in the blind spot area D without removing the line of sight from the windshield 42, so that the traffic light 45 can be recognized quickly, and the above-mentioned. It is possible to more effectively suppress the situation.

FIG. 14 is a sequence diagram showing a processing flow in the present embodiment.
As described above, the base station device 70 according to the present embodiment uses the host vehicle 40 (1) in the cell 70S and the storage target information related to the host vehicle 40 (1) and the preceding vehicle 40 (2) in the cell 70S. Position information indicating the current position of the preceding vehicle 40 (2) is stored in the storage unit 72 as a database. This location information database is stored in each mobile station device (the external communication unit 12 of the own vehicle 40 (1) and the preceding vehicle 40 (2) in which communication with the base station device 70 is established in the cell 70S of the base station device 70. The position information transmitted from the external communication unit 52) is received and registered by wireless communication. This location information database manages location information of each mobile station device in association with identification information such as a mobile station ID unique to each mobile station device.

  The GPS device 43 is mounted on the host vehicle 40 (1) or the preceding vehicle 40 (2), and the base station device 70 forming the cell 70S in which the host vehicle 40 (1) or the preceding vehicle 40 (2) exists is provided. On the other hand, position information indicating the current positions of the host vehicle 40 (1) and the preceding vehicle 40 (2) is transmitted from the external communication units 12 and 52 at a predetermined timing (S1). Receiving this, the base station device 70 registers or updates the position information of the host vehicle 40 (1) and the preceding vehicle 40 (2) in the position information database in the storage unit 72 (S2). The position information database manages position information indicating the current position of the mobile station device in the cell 70S including the host vehicle 40 (1) and the preceding vehicle 40 (2).

  When a predetermined processing start condition is satisfied in the host vehicle 40 (1), the control unit 11 of the display device 1 mounted on the host vehicle 40 (1) controls the external communication unit 12 to the base station device 70. An image acquisition request for acquiring a preceding vehicle captured image (request information) captured by the camera 50 of the preceding vehicle 40 (2) is transmitted (S3).

The predetermined processing start condition is, for example, a condition that the ignition of the host vehicle 40 (1) is turned on when the preceding vehicle captured image received from the preceding vehicle 40 (2) is always projected and displayed by the HUD 20. The condition of turning on the power source 1 or the condition of operating the shift lever to the D position may be used.
Further, the predetermined process start condition may be, for example, a condition that a process start operation by the driver P is accepted when the preceding vehicle captured image is projected and displayed for a period desired by the driver P.
Further, the predetermined processing start condition is, for example, when the preceding vehicle captured image is projected and displayed only in a time determined in advance in the system (a situation where an object such as the traffic light 45 is hidden in the blind spot area D). The condition that the said situation was detected with the sensor etc. which were mounted in the own vehicle 40 (1) may be sufficient. For example, the front camera is mounted on the host vehicle 40 (1), and the traffic signal 45 identified based on the captured image captured by the front camera cannot be identified from the captured image. This can be realized by a method for judging this. In this method, it is possible to grasp that the traffic signal 45 has entered the blind spot area D when the traffic signal 45 cannot be identified from the captured image.

  When the base station device 70 receives an image acquisition request transmitted from the host vehicle 40 (1), the data processing unit 71 of the base station device 70 transmits the image acquisition request to the preceding vehicle 40 (2). Next, the process of identifying the preceding vehicle 40 (2) is performed with reference to the position information database stored in the storage unit 72 (S4).

  Specifically, when the control unit 11 of the display device 1 in the host vehicle 40 (1) transmits an image acquisition request from the external communication unit 12, the external communication unit 12 (mobile station device) of the host vehicle 40 (1). An image acquisition request is transmitted in association with the unique mobile station ID. When the image acquisition request is received by the base station device 70, the data processing unit 71 of the base station device 70 refers to the position information database stored in the storage unit 72 and is associated with the received image acquisition request. While identifying the position information of the own vehicle 40 (1) from the mobile station ID of the own vehicle 40 (1), the mobile station ID (with the position information in the front area of the own vehicle 40 (1) based on the position information ( The preceding vehicle 40 (2)) is specified. Then, the data processing unit 71 transmits an image acquisition request from the host vehicle 40 (1) to the identified mobile station ID, that is, the external communication unit 52 of the preceding vehicle 40 (2).

  The imaging unit 53 of the camera 50 mounted on the preceding vehicle 40 (2) is installed, for example, near a room mirror attached to the inner wall of the windshield of the preceding vehicle 40 (2). The camera 50 mounted on the preceding vehicle 40 (2) always images the front of the preceding vehicle 40 (2) through the windshield of the preceding vehicle 40 (2) by the imaging unit 53. The control unit 51 of the preceding vehicle 40 (2) that has received the image acquisition request from the host vehicle 40 (1) from the base station device 70, as a response, captures the preceding vehicle captured image captured by the imaging unit 53 of the camera 50. A process of transmitting from the external communication unit 52 is executed in association with the mobile station ID of the preceding vehicle 40 (2) (S5).

  When the preceding vehicle captured image is received by the base station device 70, the data processing unit 71 of the base station device 70 refers to the position information database stored in the storage unit 72 and the position of the preceding vehicle 40 (2). Together with the information, the received preceding vehicle captured image is transmitted to the host vehicle 40 (1). When the control unit 11 of the host vehicle 40 (1) receives the preceding vehicle captured image together with the position information of the preceding vehicle 40 (2) from the external communication unit 12 (S6), the viewpoint conversion process that converts the viewpoint of the preceding vehicle captured image. (S7). In this viewpoint conversion process, the viewpoint position of the preceding vehicle captured image captured by the imaging unit 53 of the preceding vehicle 40 (2) is converted into the viewpoint position of the driver P visually recognized through the windshield 42 of the host vehicle 40 (1). To do. By this viewpoint conversion processing, the preceding vehicle captured image that displays the field of view of the preceding vehicle 40 (2) is converted into an image that displays the field of view that is visible to the driver P of the host vehicle 40 (1).

  For example, from the position information of the preceding vehicle 40 (2) and the position information of the own vehicle 40 (1), the viewpoint position of the imaging unit 53 of the preceding vehicle 40 (2) (the viewpoint position of the preceding vehicle captured image) and the own vehicle 40 The positional relationship with the viewpoint position (1) (the viewpoint position of the driver P) can be specified. Therefore, the viewpoint conversion parameter corresponding to the positional relationship is used to change the image center of the preceding vehicle captured image, enlarge the image, etc., and convert the image into the image that shows the field of view seen from the driver P of the host vehicle 40 (1). . When specifying a more detailed positional relationship, not only the position information of the preceding vehicle 40 (2) but also the vehicle data of the preceding vehicle 40 (2) and the setting information of the imaging unit 53 (the installation height and imaging of the imaging unit 53) Direction data), the vehicle data of the host vehicle 40 (1), the viewpoint position information of the driver P of the host vehicle 40 (1), and the like, and the viewpoint conversion process may be executed using these pieces of information. .

  The viewpoint conversion process can also be performed without using such position information. For example, the subject vehicle captured image captured by the imaging unit 16 mounted on the subject vehicle 40 (1) is compared with the preceding vehicle captured image received from the preceding vehicle 40 (2), and the subject displayed in both images is matched. Process. Then, the relative positional relationship of the matched subject is specified, and the viewpoint conversion parameter corresponding to the relative positional relationship is used to change the image center of the preceding vehicle captured image, enlarge the image, etc., and drive the own vehicle 40 (1) It converts into the image which projects the field of vision which can be seen from person P.

  Next, the control unit 11 of the host vehicle 40 (1) determines the blind spot area of the host vehicle 40 (1) by the preceding vehicle 40 (2) (the hatched portion D in FIG. 11) from the preceding vehicle captured image after the viewpoint conversion process. ) A blind spot area extraction process for extracting an image portion corresponding to () is performed (S8). In this blind spot area extraction process, the preceding vehicle captured image (superimposed image) after the viewpoint conversion process is viewed by the HUD 20 through the windshield 42 of the host vehicle 40 (1) as shown in FIG. In order to prevent the preceding vehicle captured image from being projected and displayed on the field of view that is not the blind spot region D (the field of view other than the back of the preceding vehicle 40 (2)) when being projected and displayed on the rear surface (dead zone) of 2). It is processing of.

  When the preceding vehicle captured image is projected and displayed on the field of view that is not the blind spot area D, the preceding vehicle captured image is displayed on the object that is visible to the driver P of the host vehicle 40 (1) in the field of view that is not the blind spot area D. Will overlap, making it difficult to see the object. In particular, pedestrians, motorcycles, and the like jump out from the side areas on the windshield 42 of the host vehicle 40 (1) (both areas of the preceding vehicle 40 (2) visually recognized through the windshield 42). This is an important field of view for the driver P to detect. Therefore, it is particularly important to ensure the visibility of the driver P for the side region on the windshield 42 of the host vehicle 40 (1), and it is desirable to hide the preceding vehicle captured image.

  In this embodiment, by performing the blind spot area extraction process, the preceding vehicle captured image (superimposed image) is displayed only on the blind spot area D of the preceding vehicle 40 (2). The image (superimposed image) is not displayed. Therefore, the preceding vehicle captured image is not displayed in the side region on the windshield 42 of the host vehicle 40 (1), and the visibility of the driver P can be ensured.

  In the blind spot area extraction processing according to the present embodiment, the captured image of the host vehicle 40 (1) captured by the imaging unit 16 mounted on the host vehicle 40 (1) is analyzed to analyze the host vehicle 40 (1). The blind spot area D by the preceding vehicle 40 (2) in the field of view visually recognized by the driver P through the windshield 42 is specified. In the host vehicle captured image, an area including part or all of the field of view visually recognized by the driver P is projected, and the host vehicle captured image similar to that shown in FIG. 12 is obtained. From such a captured image of the host vehicle, an image portion (image portion of the blind spot area D) that displays the preceding vehicle 40 (2) is specified. There is no restriction | limiting in particular about the method of specifying the image part of the blind spot area | region D, For example, methods, such as extracting the edge part (part with a large brightness | luminance change) in the own vehicle captured image, can be used.

  Thereafter, the control unit 11 of the host vehicle 40 (1) uses the HUD 20 as the blind spot area view image as an image part of the preceding vehicle captured image extracted for the blind spot area D via the display control unit 14. Projection display is performed so as to overlap the rear surface of the preceding vehicle 40 (2) viewed through the windshield 42 of 1) (S9). As a result, as shown in FIG. 13, the image portion of the preceding vehicle captured image that shows the traffic signal 45 that has become a blind spot by the preceding vehicle 40 (2) is visually recognized through the windshield 42 of the host vehicle 40 (1). It is projected and displayed on the back surface of the vehicle 40 (2). As a result, the driver P of the host vehicle 40 (1) can recognize the traffic signal 45 existing in the blind spot area D, and is not aware that the traffic signal 45 is red. The situation of entering 1) is suppressed.

  In this embodiment, the blind spot area extraction process is executed, and the preceding vehicle captured image (superimposed image) is displayed only on the blind spot area D of the preceding vehicle 40 (2), but the blind spot area extraction process is performed. It is not always necessary to execute. For example, the blind spot area extraction process is not executed, and the preceding vehicle captured image after the viewpoint conversion process is projected and displayed on a predetermined area (such as a lateral center area) on the windshield 42 of the host vehicle 40 (1). You may do it. Even in this case, since the preceding vehicle captured image is not displayed in the side region on the windshield 42 of the host vehicle 40 (1), the visibility of the driver P can be ensured.

  Further, in the present embodiment, the traffic signal 45 that is an object existing in the blind spot area D is displayed in a superimposed manner on the blind spot area D by projecting the preceding vehicle captured image after the viewpoint conversion process. As long as the image can be recognized by P, a mark image or the like prepared in advance may be displayed superimposed on the blind spot area D in place of the preceding vehicle captured image. Use of such a mark image is effective when it is difficult to sufficiently ensure the visibility of the object when the preceding vehicle captured image is projected and displayed on the blind spot area D.

  As a specific example, for example, an identification process is performed to determine whether or not the traffic light 45 is included in the image portion of the blind spot area D extracted from the preceding vehicle captured image by the blind spot area extraction process described above. If it is identified, the color of the traffic light 45 is specified, and the mark image of the traffic light corresponding to the color is overlaid on the rear surface of the preceding vehicle 40 (2) visually recognized through the windshield 42 of the host vehicle 40 (1). To project. For example, the red signal mark image is designed to emphasize the red signal, for example, by relatively enlarging the red signal portion like a signal mark image 45 ′ of a traffic light as shown in FIG. preferable.

  Further, in the present embodiment, the case where the object existing in the blind spot area is the traffic signal 45 has been described as an example. However, the object is not limited to this, and it is beneficial for the passenger including the driver to visually recognize the object. As long as it is an object, it may be a person (pedestrian or the like), a light vehicle (bicycle or the like), or another structure (such as a power pole or guardrail) around the moving route. For example, in a situation where a pedestrian W on the side of a road (roadside, etc.) is blind spot by a preceding vehicle 40 (2) traveling immediately before the host vehicle 40 (1), the vehicle is mounted on the preceding vehicle 40 (2). The camera 50 can take an image of the pedestrian W. In this case, when the host vehicle 40 (1) receives the preceding vehicle captured image, the pedestrian W existing in the blind spot area D is visually recognized through the windshield 42 of the host vehicle 40 (1) as shown in FIG. Projected on the back of the preceding vehicle 40 (2) to be projected.

  Further, in the present embodiment, the windshield 42 is displayed by a projector as a display unit that displays a superimposed image superimposed on a field of view outside the host vehicle that is visually recognized from the windshield 42 (light transmissive windshield) of the host vehicle 40 (1). However, the present invention is not limited to this. For example, the front windshield itself of the host vehicle 40 (1) is configured with a transparent or translucent transmissive display (for example, a transparent or translucent liquid crystal display), and a superimposed image is displayed on the transmissive display. You may display a superimposition image so that it may overlap with the visual field outside the own vehicle visually recognized through a transmissive display. Further, for example, a transmissive display is placed on the windshield 42 (light transmissive windshield) of the host vehicle 40 (1) and a superimposed image is displayed on the transmissive display, so that the windshield 42 and the transmissive type are displayed. The superimposed image may be displayed so as to be superimposed on the field of view outside the host vehicle visually recognized through the display.

  In the present embodiment, the position information database in the storage unit 72 of the base station device 70 allows the mobile station device (the external communication unit 12 of the host vehicle 40 (1) or the preceding vehicle 40 (2) to exist in the cell 70S. ) Position information of the external communication unit 52) is managed in the base station apparatus 70. In addition, the process (S4) for specifying the preceding vehicle 40 (2) that is the transmission destination of the image acquisition request from the host vehicle 40 (1) is performed by the data processing unit 71 of the base station device 70 in the storage unit 72. It is executed with reference to the location information database. As a result of the base station device 70 functioning as a local data center as described above, the communication processing when the host vehicle 40 (1) uses the preceding vehicle captured image captured by the camera 50 of the preceding vehicle 40 (2) This is realized without the need for communication to the core network 62 via the hall line. Therefore, an image acquisition request between each mobile station device (the external communication unit 12 of the host vehicle 40 (1) or the external communication unit 52 of the preceding vehicle 40 (2)) and the base station device 70 existing in the same cell Even if communication of the preceding vehicle captured image occurs, communication traffic on the core network 62 side of the mobile communication network 60 does not increase, and communication traffic of the entire mobile communication network 60 can be suppressed.

  In particular, the individual base station devices constituting the mobile communication network 60 function as local data centers as described above, so that in each base station device, one communication device exists in the same cell at the same time. Even when a communication process for using the storage target information regarding the communication device occurs, the core network 62 of the mobile communication network 60 is not used, so that communication traffic of the entire mobile communication network 60 can be suppressed.

  Moreover, in this embodiment, it is the target object which exists in the blind spot area | region D because the own vehicle 40 (1) receives the preceding vehicle captured image imaged with the camera 50 mounted in the preceding vehicle 40 (2). Although the own vehicle 40 (1) acquires the captured image of the traffic light 45, the acquisition method is not limited to this. For example, a roadside camera as an image pickup means for picking up an image of the traffic light 45 is arranged on the roadside, and the host vehicle 40 (1) receives a roadside camera captured image captured by the roadside camera via the mobile communication network 60. The host vehicle 40 (1) may acquire a captured image of the traffic light 45 that is a target existing in the region D. In this case, the roadside camera includes a mobile station device that performs the same configuration and operation as the external communication unit 52 of the preceding vehicle 40 (2) described above.

  Further, in the present embodiment, the position information (storage target information) of the host vehicle 40 (1) and the preceding vehicle 40 (2) stored as the position information database in the storage unit 72 of the base station device 70 is used for each external communication. The mobile communication unit 73 of the base station device 70 acquires the information from the units (mobile station devices) 12 and 52, but the acquisition method is not limited to this. For example, a vehicle communication device arranged on the road side of a road through which the automobiles 40 (1) and 40 (2) pass is connected to each automobile 40 (1) by short-range wireless communication with the individual automobiles 40 (1) and 40 (2). ), 40 (2) mobile station ID (identification information) and position information may be acquired. The method of communicating the mobile station ID (identification information) and position information of each automobile 40 (1), 40 (2) acquired by the vehicle communication device from the vehicle communication device to the base station device 70 is not necessarily mobile communication. Alternatively, other communication means such as wired communication may be used.

[Modification 1]
Next, a modified example (hereinafter referred to as “modified example 1”) in the present embodiment will be described.
In the embodiment described above, the storage target information stored as a database in the storage unit 72 of the base station device 70 is the current position of each of the automobiles 40 (1) and 40 (2) existing in the cell 70S of the base station device 70. However, the position information is not limited to this. For example, it may be a picked-up image picked up by image pick-up means of individual automobiles existing in the cell 70S of the base station device 70. In the first modification, the captured image captured by the imaging unit of each automobile existing in the cell 70S of the base station device 70 is used as the storage target information, and the vehicle ahead in response to an acquisition request from the host vehicle 40 (1). The picked-up image (request information) picked up in (1) is transmitted. Therefore, in the first modification, the storage target information and the request information are the same information.

FIG. 17 is an explanatory diagram illustrating an example in which the forward vehicle 40 (4) traveling in front of the host vehicle 40 (1) is just before passing the intersection in the first modification.
In the illustrated example, the forward vehicle 40 (4) is in a situation immediately before passing through the intersection. The camera 50 mounted on the preceding vehicle 40 (4) has the same configuration and operation as the camera 50 of the preceding vehicle 40 (2) of the above-described embodiment, and the imaging unit 53 of the preceding vehicle 40 (4) The front of the front vehicle 40 (4) is imaged through the windshield 42. Therefore, in the situation in the illustrated example, the camera 50 of the forward vehicle 40 (4) is similar to the field of view (a field of view including an intersection) that a passenger such as a driver of the forward vehicle 40 (4) visually recognizes through the windshield 42. The image (intersection image) is captured.

  On the other hand, a map image around the current position of the host vehicle 40 (1) based on the measurement result of the GPS device 43 is displayed on the display screen of the car navigation device mounted on the host vehicle 40 (1). The display screen of the car navigation device may be a screen such as a liquid crystal display installed in a place (dashboard, instrument panel, etc.) different from the windshield 42, or is projected onto the windshield 42 by the HUD. It may be a screen. Further, the configuration of the car navigation device does not include the image generation unit 13, and the display of the above-described embodiment except that the control target of the display control unit 14 is not the HUD 20 but the display unit of the car navigation device. The configuration is the same as that of the device 1.

  In the first modification, when the host vehicle 40 (1) approaches the intersection, the display screen of the car navigation apparatus shows an intersection field of view that the driver will see immediately before passing the intersection. An image is displayed. In the first modification, an intersection captured image captured by the preceding vehicle 40 (4) immediately before the intersection is used as the intersection view image.

FIG. 18 is a sequence diagram showing the flow of processing in the first modification.
As described above, the base station device 70 according to the first modification includes the intersection image database (storage target information) captured by the camera 50 of the preceding vehicle 40 (4) in the cell 70S in the storage unit 72. Remember and manage as This intersection image database is an intersection captured image transmitted from a mobile station device (external communication unit 52 of the preceding vehicle 40 (4)) in which communication with the base station device 70 is established in the cell 70S of the base station device 70. Registered and updated by receiving via wireless communication. This intersection image database manages, for example, the intersection captured image of each intersection in association with identification information such as a unique intersection ID and intersection position information for each intersection.

  A GPS device 43 is mounted on the preceding vehicle 40 (4). When the control unit 51 of the camera 50 mounted on the preceding vehicle 40 (4) determines that the preceding vehicle 40 (4) is located immediately before a predetermined intersection based on the measurement result of the GPS device 43 (S11), the imaging unit 53 Thus, the front of the front vehicle 40 (4) is imaged through the windshield 42 of the front vehicle 40 (4) (S12). Thereby, the camera 50 of the front vehicle 40 (4) has the same image (intersection captured image) as the field of view (the field of view including the intersection) viewed by the passenger such as the driver of the front vehicle 40 (4) through the windshield 42. Can be imaged.

  Thereafter, the control unit 51 of the preceding vehicle 40 (4) identifies identification information (intersection ID and intersection position information (frontward) to the base station apparatus 70 forming the cell 70S corresponding to the intersection captured image. The position image of the vehicle 40 (4) can be substituted.)) And the intersection captured image is transmitted from the external communication unit 52 (S13). The data processing unit 71 of the base station device 70 that has received the information registers or updates the intersection captured image in the intersection image database in the storage unit 72 in association with the identification information of the intersection (S14). By this intersection image database, the intersection captured image that reflects the intersection in the cell 70S captured by the camera 50 of the forward vehicle 40 (4) existing in the cell 70S is managed.

  On the other hand, the GPS device 43 is also mounted on the host vehicle 40 (1). Based on the measurement result of the GPS device 43, the control unit 11 of the car navigation device mounted on the host vehicle 40 (1) is the vehicle 40 (1) before a predetermined intersection (before a predetermined distance from the intersection). When it is determined that the vehicle has reached (S15), an image acquisition request for acquiring an intersection captured image corresponding to the intersection is transmitted from the external communication unit 12 to the base station device 70 (S16). When the base station device 70 receives the image acquisition request transmitted from the host vehicle 40 (1), the data processing unit 71 of the base station device 70 refers to the intersection image database stored in the storage unit 72. A process of specifying an intersection captured image corresponding to the image acquisition request is performed (S17).

  Specifically, when the control unit 11 of the car navigation device in the host vehicle 40 (1) transmits an image acquisition request from the external communication unit 12, identification information (intersection ID) for identifying an intersection corresponding to the request. The image acquisition request is transmitted in association with the location information of the intersection or the location information of the own vehicle 40 (1). When this image acquisition request is received by the base station device 70, the data processing unit 71 of the base station device 70 refers to the intersection image database stored in the storage unit 72 and is associated with the received image acquisition request. An intersection captured image corresponding to the image acquisition request is specified from the intersection identification information.

  Then, the data processing unit 71 transmits the identified intersection captured image (request information) to the host vehicle 40 (1) as a response to the image acquisition request. When the control unit 11 of the host vehicle 40 (1) receives the intersection captured image from the external communication unit 12 (S18), the display control unit 14 displays the received intersection captured image on the display screen of the car navigation device. It is displayed as an image (S19).

  According to the first modification, the driver P of the host vehicle 40 (1) looks through the windshield 42 of the host vehicle 40 (1) by viewing the intersection viewpoint image displayed on the display screen of the car navigation device. The field of view of the intersection visually recognized through the windshield 42 of the host vehicle 40 (1) can be confirmed in advance before the intersection is directly visually recognized. As a result, for example, when the driver P is about to turn left at the intersection, the driver P mistakenly turns left at an intersection other than the intersection or passes through the intersection without noticing the intersection. Can be suppressed.

  In particular, in the first modification, the intersection viewpoint image displayed on the display screen of the car navigation device is an intersection captured image captured by the preceding vehicle 40 (4), and therefore the host vehicle 40 (1) enters the intersection. It is possible to confirm the latest situation at the time on the display screen of the car navigation device in advance. As a result, even if there is a change in the situation of the intersection a few months or days ago (buildings around the intersection have changed, stores have changed, signs have changed, etc.) The situation can be confirmed in advance on the display screen of the car navigation device before entering the intersection. Therefore, the driver P of the host vehicle 40 (1) can pass without making a mistake in the intersection even at the intersection where the situation has changed.

  Further, according to the first modification, for example, when the front of the host vehicle 40 (1) is congested, the driver P of the host vehicle 40 (1) is displayed on the display screen of the car navigation device. By confirming the intersection captured image, it is possible to confirm the traffic jam situation. Thereby, the driver P is provided with judgment materials for appropriately judging whether to pass along a traffic jam as it is or to pass through a detour route based on the intersection captured image displayed on the display screen of the car navigation device. can do.

  In the first modification, the timing at which the host vehicle 40 (1) acquires the intersection captured image captured by the preceding vehicle 40 (4) is determined in advance before the host vehicle 40 (1) is in front of the intersection. Although it is the timing which reached the point of distance, it is not restricted to this, For example, the timing when the driver | operator P of the own vehicle 40 (1) performed predetermined | prescribed operation may be sufficient. In this case, for example, at the timing when an operation for designating an intersection on a map image displayed on the display screen of the car navigation apparatus is received, an intersection captured image for the designated intersection may be acquired.

[Modification 2]
Next, another modification example of the present embodiment (hereinafter, this modification example is referred to as “Modification Example 2”) will be described.
In the embodiment described above, the storage target information stored as a database in the storage unit 72 of the base station device 70 is the current position of each of the automobiles 40 (1) and 40 (2) existing in the cell 70S of the base station device 70. However, the position information is not limited to this. For example, it may be a vehicle number (vehicle number) as individual identification information displayed on the outside of each automobile present in the cell 70S of the base station device 70. In the second modification, the vehicle number of each automobile existing in the cell 70S of the base station apparatus 70 is stored as information to be stored, and the vehicle number is used in place of the position information of each automobile. Similarly, the preceding vehicle captured image (superimposed image) received by the host vehicle 40 (1) is viewed by the HUD 20 through the windshield 42 of the host vehicle 40 (1) as shown in FIG. Projected and displayed on the back of 2).

FIG. 19 is a sequence diagram showing the flow of processing in the second modification.
The base station apparatus 70 in the second modification holds the vehicle number of the preceding vehicle 40 (2) in the cell 70S as storage target information in the storage unit 72 as a database. This vehicle number database wirelessly transmits a vehicle number transmitted from a mobile station device (external communication unit 52 of the preceding vehicle 40 (2)) in which communication with the base station device 70 is established in the cell 70S of the base station device 70. Registered and updated by receiving via communication. For example, the vehicle number database manages the vehicle number of each mobile station device in association with identification information such as a mobile station ID unique to the mobile station device (external communication unit 52 of the preceding vehicle 40 (2)).

  The vehicle number of the preceding vehicle 40 (2) is transmitted from the external communication unit 52 at a predetermined timing to the base station device 70 forming the cell 70S in which the preceding vehicle 40 (2) exists (S21). Receiving this, the base station device 70 registers the vehicle number of the preceding vehicle 40 (2) in the vehicle number database in the storage unit 72 (S22). The vehicle number database manages the vehicle numbers of the automobiles in the cell 70S.

  When a predetermined processing start condition is satisfied in the host vehicle 40 (1) as in the above-described embodiment, first, the host vehicle 40 (1) is operated by the imaging unit 16 as an external imaging device mounted on the host vehicle 40 (1). The front image of 1) is imaged to obtain a captured image of the host vehicle (S23). In the captured image of the host vehicle, the back surface of the preceding vehicle 40 (2) traveling in front of the host vehicle 40 (1) is projected, and the license plate disposed on the back surface of the preceding vehicle 40 (2). Is also projected. The control unit 11 of the display device 1 of the host vehicle 40 (1) analyzes the host vehicle captured image captured by the imaging unit 16 and identifies the vehicle number displayed on the license plate of the preceding vehicle 40 (2). (S24).

  Thereafter, the control unit 11 of the host vehicle 40 (1) receives an image acquisition request for acquiring the preceding vehicle captured image captured by the camera 50 of the preceding vehicle 40 (2) from the external communication unit 12 to the base station device 70. Is transmitted in association with the mobile station ID unique to the external communication unit 12 (mobile station device) of the host vehicle 40 (1) (S25). At this time, the control unit 11 also transmits the vehicle number of the identified preceding vehicle 40 (2) together with the image acquisition request in association with the mobile station ID.

  When this image acquisition request is received by the base station device 70, the data processing unit 71 of the base station device 70 refers to the vehicle number database stored in the storage unit 72 and receives the vehicle received together with the received image acquisition request. From the number, the mobile station ID (preceding vehicle 40 (2)) corresponding to the vehicle number is specified (S26). Then, the data processing unit 71 transmits an image acquisition request from the host vehicle 40 (1) to the identified mobile station ID, that is, the external communication unit 52 of the preceding vehicle 40 (2). The subsequent processing is the same as in the above-described embodiment.

  In the embodiment described above, position information indicating the current position in the mobile station apparatus in the cell 70S is managed by the position information database, so that the position information update process is performed for a mobile station apparatus mounted on a mobile object such as an automobile. Need to be done frequently. On the other hand, in the second modification, the vehicle number database manages the vehicle number unique to the moving object, so that the vehicle number update process is unnecessary. Therefore, in the second modification, communication traffic in the cell 70S is reduced and the processing load of the data processing unit 71 of the base station device 70 is smaller than in the above-described embodiment.

  In the second modification, the control unit 11 of the display device 1 of the host vehicle 40 (1) executes the process of analyzing the captured image of the host vehicle and specifying the vehicle number of the preceding vehicle 40 (2). For example, the data processing unit 71 of the base station device 70 may execute the processing. In this case, the control unit 11 of the host vehicle 40 (1) captures the host vehicle captured image on which the license plate of the preceding vehicle 40 (2) is projected (S23), and then transmits the image from the external communication unit 12 to the base station device 70. When the acquisition request is transmitted, the captured image of the host vehicle is also transmitted. And the data processing part 71 of the base station apparatus 70 performs the process which analyzes the received own vehicle captured image, and specifies the vehicle number of the preceding vehicle 40 (2).

  In the second modification, the vehicle number registered in the vehicle number database of the base station device 70 is acquired from the mobile station device (external communication unit 52) on the automobile 40 (2) corresponding to the vehicle number. The acquisition method is not limited to this. For example, a roadside camera captured image on which a license plate of a preceding vehicle 40 (2) is projected is captured by a roadside camera as an external imaging device that captures the vehicle number of a vehicle traveling on a road, and the roadside camera captured image is displayed on the roadside. The data is transmitted from the camera to the base station device 70 via the mobile communication network 60. Then, the data processing unit 71 of the base station device 70 performs processing (individual identification information specifying processing) for analyzing the received roadside camera captured image and specifying the vehicle number (individual identification information) of the preceding vehicle 40 (2). To do.

[Modification 3]
Next, still another modification example of the present embodiment (hereinafter, this modification example is referred to as “Modification Example 3”) will be described.
In the embodiment described above, the storage target information stored as a database in the storage unit 72 of the base station device 70 is the current position of each of the automobiles 40 (1) and 40 (2) existing in the cell 70S of the base station device 70. However, the position information is not limited to this. For example, location information indicating the current location of a mobile phone as a mobile station device possessed by a person driving a light vehicle such as a pedestrian or a bicycle may be included. In the third modification, the mobile phone existing in the cell 70S of the base station apparatus 70 is also stored as information.

FIG. 20 shows a case where the oncoming lane is congested in the third modification and passes between the first oncoming vehicle 40 (5) and the second oncoming vehicle 40 (6) stopped before that. It is explanatory drawing which shows the example which the pedestrian W is going to cross the driving | running | working lane of the own vehicle 40 (1).
In the illustrated example, as shown in FIG. 20, a blind spot area (second blind vehicle area) (see FIG. 20) in the field of view in front of the host vehicle P viewed by the driver P through the windshield 42 of the host vehicle 40 (1). A hatched portion D) in FIG. 20 exists. In this example, the driver P of the host vehicle 40 (1) has the pedestrian W as an object existing in the blind spot area D hidden behind the second oncoming vehicle 40 (6), and as shown in FIG. The pedestrian W cannot be visually recognized. Therefore, the driver P of the host vehicle 40 (1) causes the host vehicle 40 (1) to travel without noticing the presence of the pedestrian W trying to cross the travel lane of the host vehicle 40 (1). There is a risk of contact with the pedestrian W.

  In the third modification, the location information of the mobile phone transmitted from the mobile phone possessed by the pedestrian W is managed by the location information database in the storage unit 72 of the base station device 70, and the location of the pedestrian W is determined. 22 is visually recognized by the HUD 20 through the windshield 42 of the host vehicle 40 (1) with the pedestrian mark image W ′ indicating the presence of the pedestrian as a superimposed image, as shown in FIG. The second oncoming vehicle 40 (6) is projected and displayed on the side surface (dead angle area D). The pedestrian mark image W ′ is preferably designed to be emphasized so that the driver P can easily recognize the presence of the pedestrian W.

FIG. 23 is a sequence diagram showing the flow of processing in the third modification.
The mobile phone possessed by the pedestrian W has a GPS device and, as described above, indicates the current position of the mobile phone to the base station device 70 of the mobile communication network 60 functioning as a local data center. The position information is transmitted to the base station device 70 (S31). Receiving this, the data processing unit 71 of the base station apparatus 70 stores the location information of the mobile phone in the storage unit 72. Thereby, the location information of the mobile phone possessed by the pedestrian W, that is, the current location of the pedestrian W is registered and updated in the location information database of the base station device 70 (S32). The position information of the host vehicle 40 (1) is also registered in the position information database of the base station device 70 (S31).

  On the other hand, the control unit 11 of the display device 1 in the host vehicle 40 (1) transmits an acquisition request for pedestrian notification information from the external communication unit 12 to the base station device 70 (S33). At this time, the control unit 11 transmits an image acquisition request in association with a mobile station ID unique to the external communication unit 12 (mobile station device) of the host vehicle 40 (1). When the image acquisition request is received by the base station device 70, the data processing unit 71 of the base station device 70 refers to the position information database stored in the storage unit 72 and is associated with the received image acquisition request. The position information of the host vehicle 40 (1) is specified from the mobile station ID of the host vehicle 40 (1). Then, it is determined whether or not there is a mobile station (mobile phone of pedestrian W) having position information in the front area of the own vehicle 40 (1) from the specified position information of the own vehicle 40 (1) ( S34).

  When there is a mobile station (mobile phone of pedestrian W) having position information in the front area of the host vehicle 40 (1), the data processing unit 71 of the base station device 70 determines that the pedestrian notification condition is satisfied, Pedestrian notification information including the position information of the mobile phone (that is, the position information of the pedestrian W) is transmitted to the host vehicle 40 (1). When the control unit 11 of the host vehicle 40 (1) receives the pedestrian notification information (S35), the pedestrian W exists in the blind spot area D based on the position information of the pedestrian W included in the pedestrian notification information. It is determined whether or not to perform (S36).

  This determination can be made as follows, for example. The own vehicle captured image obtained by imaging the front of the own vehicle 40 (1) is analyzed by the imaging unit 16 mounted on the own vehicle 40 (1), and is visually recognized by the driver P through the windshield 42 of the own vehicle 40 (1). The blind spot area D by the preceding vehicle 40 (2) in the field of view is specified. In the host vehicle captured image, an area including part or all of the field of view visually recognized by the driver P is projected, and the host vehicle captured image similar to that shown in FIG. 21 is obtained. From such a captured image of the host vehicle, an image portion (image portion of the blind spot area D) that displays the second oncoming vehicle 40 (6) is specified. Thereafter, an actual range ahead of the host vehicle corresponding to the image portion of the blind spot area D is calculated, and it is determined whether or not the position of the pedestrian W belongs to the actual range.

  If it is determined that the pedestrian W is present in the blind spot area D, the control unit 11 of the host vehicle 40 (1) is visually recognized through the windshield 42 of the host vehicle 40 (1) via the display control unit 14. HUD20 as a blind spot area view image so that the pedestrian mark image W ′ overlaps the position of the person W, that is, the side surface of the second oncoming vehicle 40 (6) viewed through the windshield 42 of the host vehicle 40 (1). To project and display (S37). Thereby, as shown in FIG. 22, the pedestrian mark image W ′ showing the pedestrian W that has become a blind spot by the second oncoming vehicle 40 (6) is visually recognized through the windshield 42 of the host vehicle 40 (1). The second oncoming vehicle 40 (6) is projected on the side surface. As a result, the driver P of the host vehicle 40 (1) can recognize the pedestrian W existing in the blind spot area D, and travels the host vehicle 40 (1) without noticing the presence of the pedestrian W. Is suppressed.

  In the present embodiment, the object information indicating the object existing in the blind spot area D in the field of view visually recognized through the windshield 42 of the host vehicle 40 (1) is captured by the camera 50 of the preceding vehicle 40 (2). It was the data of the preceding vehicle captured image. However, other object information may be used, for example, object information based on the detection result of the object detection means such as an ultrasonic sensor or a radar mounted on the preceding vehicle 40 (2). .

  In the present embodiment, the object information indicating the object existing in the blind spot area D in the field of view visually recognized through the windshield 42 of the host vehicle 40 (1) is mounted on the preceding vehicle 40 (2). It was information acquired by the camera 50. However, other object information may be used, for example, data of an oncoming vehicle captured image captured by an imaging unit mounted on an oncoming vehicle that is a backward moving body.

  Moreover, in this embodiment, the superimposed image which shows objects, such as the traffic signal 45 which exists in the blind spot area D ahead of the own vehicle visually recognized through the windshield 42 of the own vehicle 40 (1), is visually recognized through the windshield 42. In this example, the image is displayed so as to overlap the blind spot area D in the field of view. However, the object existing in the blind spot region is not limited to the windshield such as the windshield 42 but is superimposed on the field of view visually recognized through another windshield such as the door window of the host vehicle 40 (1). The superimposed image shown may be displayed.

  Further, the display means in the present embodiment is the HUD 20 that displays a superimposed image superimposed on a field of view outside the host vehicle 40 (1) viewed through a light-transmitting windshield such as the windshield 42. However, in the case of including a display device that displays on the windshield of the host vehicle 40 (1) a view image that reflects the field of view outside the host vehicle imaged by the imaging means mounted on the host vehicle 40 (1). The display device may be used as display means to generate a composite image in which the superimposed image is superimposed on the view field image, and the composite image may be displayed on the windshield.

  In this case, the host vehicle 40 (1) is used as a display unit that displays a field-of-view image that reflects the field of view outside the host vehicle captured by the imaging unit mounted on the host vehicle 40 (1) on the windshield of the host vehicle 40 (1). However, the present invention is not limited to this, and a display device in which a display screen is arranged on a light-impermeable front windshield. For example, you may use HUD which projects a visual field image with a projector on the inner wall face of the light-impermeable front windshield of the own vehicle 40 (1). Further, for example, the front windshield itself of the host vehicle 40 (1) may be configured by a display device. As the display device, for example, a transparent or translucent transmissive display may be employed. In this case, when the composite image obtained by superimposing the superimposed image on the view field image is not displayed, the display device is externally connected through the transmissive display. It can comprise so that a visual field of can be visually recognized. In addition, for example, a configuration in which a transmissive display is overlaid on the windshield (light transmissive windshield) of the host vehicle 40 (1) may be employed, and in this case also, a composite in which a superimposed image is superimposed on a view field image. When the image is not displayed, the field of view outside the host vehicle can be viewed through the windshield and the transmissive display.

  Note that the components or processing steps of the display device, the moving body, and the display system described in this specification can be implemented by various means. For example, these components and processing steps may be implemented by hardware, firmware, software, or a combination thereof. For example, a predetermined program is read and executed by hardware described later, or is described later. This is realized by executing a predetermined program incorporated in advance in hardware.

  For hardware implementation, means such as processing units used to realize components and processing steps in an entity (for example, various wireless communication devices, Node Bs, terminals, hard disk drive devices, or optical disk drive devices) One or more application specific IC (ASIC), digital signal processor (DSP), digital signal processor (DSPD), programmable logic device (PLD), field programmable gate array (FPGA), processor , A controller, a microcontroller, a microprocessor, an electronic device, other electronic units designed to perform the functions described herein, a computer, or a combination thereof.

  Also, for firmware and / or software implementation, means such as processing units used to implement the above components may be programs (eg, procedures, functions, modules, instructions) that perform the functions described herein. , Etc.). In general, any computer / processor readable medium that specifically embodies firmware and / or software code may be used, such as a processing unit used to implement the processing steps and components described herein. It may be used to implement the means. For example, the firmware and / or software code may be stored in a memory, for example, in a control device, and executed by a computer or processor. The memory may be implemented inside the computer or processor, or may be implemented outside the processor. The firmware and / or software code may be, for example, random access memory (RAM), read only memory (ROM), nonvolatile random access memory (NVRAM), programmable read only memory (PROM), electrically erasable PROM (EEPROM) ), FLASH memory, floppy disk, compact disk (CD), digital versatile disk (DVD), magnetic or optical data storage, etc. Good. The code may be executed by one or more computers or processors, and may cause the computers or processors to perform the functional aspects described herein.

  Also, descriptions of embodiments disclosed herein are provided to enable any person skilled in the art to make or use the present disclosure. Various modifications to the present disclosure will be readily apparent to those skilled in the art, and the general principles defined herein may be applied to other variations without departing from the spirit or scope of the disclosure. The present disclosure is therefore not limited to the examples and designs described herein, but should be accorded the widest scope consistent with the principles and novel features disclosed herein.

DESCRIPTION OF SYMBOLS 1 Display apparatus 10 Image processing apparatus 11 Control part 12 External communication part (mobile station apparatus)
13 Image generation unit 14 Display control unit 15 In-car communication unit 16 Imaging unit 20 HUD
40 (1) Own vehicle 40 (2) Leading vehicle 40 (3) Automobile 40 (4) Forward vehicle 40 (5) First oncoming vehicle 40 (6) Second oncoming vehicle 42 Windshield 43 GPS device 44 Various in-vehicle sensors 45 Traffic light 50 Camera 51 Control unit 52 External communication unit (mobile station device)
53 Imaging unit 54 In-vehicle communication unit 60 Mobile communication network 62 Core network 64 Moored balloon 65 Moored balloon relay station 66 Moving cell base station 70 Base station device 70S Cell 71 Data processing unit 72 Storage unit 73 Mobile communication unit 74 Backhaul communication unit D Blind spot area E Imaging area P Driver W Pedestrian

JP 2003-319383 A

Claims (12)

A base station apparatus for cellular mobile communication,
Internal storage means for storing storage target information for each of a plurality of communication devices located in a cell formed by the base station device;
Cell-side communication means for wirelessly communicating with a communication device located in the cell;
When an information acquisition request for another communication device is acquired from one communication device located in the cell by the cell-side communication unit, the storage target information regarding the other communication device stored in the internal storage unit is used. And a processing means for executing transmission processing for transmitting the request information corresponding to the information acquisition request to the one communication apparatus by the cell side communication means. In the base station apparatus of Claim 1,
The base station apparatus characterized in that the processing means executes storage processing for acquiring storage target information related to the communication apparatus from the communication apparatus by the cell side communication means and storing the information in the internal storage means. In the base station apparatus of Claim 2,
The base station apparatus, wherein the storage target information includes a captured image captured by an imaging unit provided in the communication apparatus. In the base station apparatus according to any one of claims 1 to 3,
The base object apparatus characterized in that the storage target information includes position information indicating a position of the communication apparatus. In the base station apparatus according to any one of claims 1 to 4,
The base object apparatus characterized in that the storage target information includes individual identification information of a moving body on which the communication apparatus is mounted. In the base station apparatus of Claim 5,
The base station apparatus, wherein the individual identification information is individual identification information displayed outside the mobile body. In the base station apparatus of Claim 6,
The base station apparatus, wherein the individual identification information is information specified based on a captured image obtained by capturing the moving body by an external imaging device located outside the corresponding moving body. In the base station apparatus of Claim 7,
The processing unit acquires the captured image captured by the external imaging device from the external imaging device by the cell-side communication unit, and executes individual identification information specifying processing for specifying the individual identification information based on the captured image A base station apparatus. In the base station apparatus in any one of Claims 1 thru | or 8,
The internal storage means stores storage target information related to the communication device in association with identification information capable of identifying the communication device,
The processing unit obtains identification information corresponding to the other communication device by the cell side communication unit in association with the information acquisition request, and stores storage target information regarding the another communication device corresponding to the identification information. A base station apparatus that performs the transmission process by transmitting from an internal storage means to the one communication apparatus by the cell side communication means. In the base station apparatus in any one of Claims 1 thru | or 8,
Based on the acquired information acquisition request, the processing unit specifies storage target information related to the other communication device stored in the internal storage unit, and the other communication device corresponding to the specified storage target information Base station apparatus, which acquires request information corresponding to the information acquisition request from the mobile station and transmits the acquired request information to the one communication apparatus by the cell side communication means. . In the base station apparatus in any one of Claims 1 thru | or 10,
The base station apparatus, wherein the processing means executes the processing without communicating with the core network side. A communication system for performing cellular mobile communication,
A base station apparatus according to any one of claims 1 to 11,
A communication system comprising at least one communication device capable of communicating with the base station device by mobile communication.

Images