JP2020170341A - Display control device, display control method and program - Google Patents

Abstract

To provide a display control device, a display control method, and a program capable of identifying a positional relationship of different image information obtained by imaging surroundings of a vehicle.SOLUTION: A display control device 1 comprises an image information acquisition unit 3, a first image information generation unit 41, and a second image information generation unit 42. The image information acquisition unit 3 acquires imaging information obtained by capturing images of surroundings of a vehicle. The first image information generation unit 41 generates first image information to be displayed on a display device 30 by corresponding to a first area which is a part of an image information area. The second image information generation unit 42 generates second image information to be displayed on the display device 30 by corresponding to a second area which is a part of the image information area and is different from the first area. The display control device 1 further comprises an identification information generation unit 43. The identification information generation unit 43 generates identification information for identifying a positional relationship between the first image information and the second image information, and displays the identification information on the display device 30.SELECTED DRAWING: Figure 2

Description

The present invention relates to a display control device, a display control method and a program.

The following Patent Document 1 discloses a technique relating to a driving support device, a driving support method, and a driving support program. In this technology, a "reference image" is generated by synthesizing three images captured by each of the rear camera, the left side camera, and the right side camera of the own vehicle.
During normal driving of the own vehicle, a display image showing the rear view directly behind the own vehicle by the rear camera is cut out from the "reference image", and this display image is displayed on the display unit. The display unit is the display of the navigation system arranged on the instruments panel.
On the other hand, during abnormal driving of the own vehicle, a display image showing the rear side rear view of the own vehicle by the side camera and a display image showing the rear view directly behind the own vehicle by the rear camera are cut out from the "reference image". This display image is displayed on the display unit.

JP-A-2017-117120

By the way, in the above technique, when the display unit switches from the normal driving to the non-normal driving, the driver grasps the positional relationship of the display image added during the non-normal driving with respect to the display image during the normal driving. It's hard to do. Therefore, there was room for improvement. This is given as an example of the problem that the invention is trying to solve.

The present invention provides a display control device, a display control method, and a program for executing the display control method, which can identify the positional relationship of different image information obtained by imaging the surroundings of the vehicle.

The invention according to claim 1 corresponds to an acquisition unit that acquires image information captured around the vehicle and a first region that is a part of the image information region in the display control device, and displays the information on the display device. The first image information generation unit for generating the first image information to be generated and the second image information to be displayed on the display device are generated corresponding to the second area which is a part of the image information area and is different from the first area. A second image information generation unit is provided, and an identification information generation unit that generates identification information for identifying the positional relationship between the first image information and the second image information and displays the identification information on the display device.

The invention according to claim 12 is different from the first image information in which a part of the periphery of the vehicle is imaged and the first image information in which a part of the periphery of the vehicle is imaged in the display control device. When the acquisition unit for acquiring each of the above and the identification information for identifying the positional relationship between the first image information and the second image information are generated, and the second image information is displayed on the display device on which the first image information is displayed. Is provided with an identification information generation unit for displaying the identification information on the display device.

The invention according to claim 13 corresponds to a step of acquiring image information obtained by capturing an image of the surroundings of a vehicle and a first region which is a part of the region of the image information in the display control method, and causes the display device to display the information. The step of generating the first image information, the step of generating the second image information to be displayed on the display device corresponding to the second region which is a part of the region of the image information and is different from the first region, and the first It includes a step of generating identification information for identifying the positional relationship between the image information and the second image information and displaying the identification information on the display device.

The invention according to claim 14 is for causing a computer to execute a display control method of a display control device including an acquisition unit, a first image information generation unit, a second image information generation unit, and an identification information generation unit. In the program, the acquisition unit corresponds to the process of acquiring the image information captured around the vehicle and the first image information generation unit corresponds to the first area which is a part of the image information area, and is a display device. The step of generating the first image information to be displayed on the screen and the second image information generation unit correspond to the second region which is a part of the region of the image information and is different from the first region, and is displayed on the display device. 2. It includes a step of generating image information and a step of the identification information generation unit generating identification information for identifying the positional relationship between the first image information and the second image information and displaying it on a display device.

FIG. 1 is a schematic plan view illustrating a positional relationship between a display control system constructed including the display control device according to the first embodiment of the present invention, a vehicle equipped with the display control system, and its surroundings. .. FIG. 2 is a block configuration diagram of the display control device and the display control system shown in FIG. FIG. 3A is a front view seen from the driver sitting in the driver's seat of the vehicle, showing a state in which the first image information of the display device of the display control system shown in FIGS. 1 and 2 is displayed. FIG. 3B is a front view of a display device showing a state in which the second image information and the identification information are displayed. FIG. 4 (A) is a schematic perspective view for explaining the image information acquired by the display control device shown in FIG. 2, and FIG. 4 (B) shows the image information of one frame shown in FIG. 4 (A) and this image information. It is a schematic diagram explaining the relationship with the 1st image information and the 2nd image information generated from. FIG. 5 is a flowchart illustrating a display control method using the display control device shown in FIG. 2 and a program for causing a computer to execute the display control method. FIG. 6 (A) is a front view showing a state in which the first image information of the display device is displayed in the display control device and the display control system according to the first modification of the first embodiment, and FIG. 6 (B) is the first view. 2 A front view of a display device showing a state in which image information and identification information are displayed, FIG. 6C is a schematic view illustrating the relationship between the image information and the first image information and the second image information. FIG. 7 (A) is a front view showing a state in which the first image information of the display device is displayed in the display control device and the control display system according to the second modification of the first embodiment, and FIG. 7 (B) is the first. 2 A front view of a display device showing a state in which image information and identification information are displayed, FIG. 7C is a schematic view illustrating the relationship between the image information and the first image information and the second image information. FIG. 8 is a block configuration diagram of the display control device and the display control system according to the second embodiment of the present invention. FIG. 9 is a flowchart illustrating a display control method using the display control device shown in FIG. 8 and a program for causing a computer to execute the display control method. FIG. 10 is a schematic diagram illustrating the relationship between the image information acquired by the display control device shown in FIG. 8 and the first image information, the second image information, and the intermediate image information generated from the image information. FIG. 11 is a schematic diagram illustrating the relationship between the image information and the first image information, the second image information, and the intermediate image information in the display control device and the display control system according to the first modification of the second embodiment. FIG. 12 is a schematic diagram illustrating the relationship between the image information and the first image information, the second image information, and the intermediate image information in the display control device and the display control system according to the second modification of the second embodiment. FIG. 13 is a schematic diagram illustrating the relationship between the image information and the first image information, the second image information, and the intermediate image information in the display control device and the display control system according to the third modification of the second embodiment. FIG. 14A is a front view showing a state in which the first image information and identification information of the display device are displayed in the display control device and the display control system according to the third embodiment of the present invention, and FIG. 14B is a front view. A front view showing a state in which the second image information and the identification information of the display device are displayed, and each of FIGS. 14 (C) and 14 (D) is a diagram showing another example of the identification information. FIG. 15 is a schematic perspective view for explaining the relationship between the image information acquired in the display control device and the display control system according to the fourth embodiment of the present invention and the first image information and the second image information.

The display control device according to the first embodiment of the present invention corresponds to an acquisition unit that acquires image information captured around the vehicle and a first area that is a part of the image information area, and displays the information on the display device. The first image information generation unit for generating the first image information to be generated and the second image information to be displayed on the display device are generated corresponding to the second area which is a part of the image information area and is different from the first area. A second image information generation unit is provided, and an identification information generation unit that generates identification information for identifying the positional relationship between the first image information and the second image information and displays the identification information on the display device.

The display control device according to the first embodiment includes an acquisition unit, a first image information generation unit, and a second image information generation unit.
The acquisition unit acquires imaging information in which the surroundings of the vehicle are imaged. The first image information generation unit corresponds to the first area which is a part of the image information area, and generates the first image information to be displayed on the display device. The second image information generation unit corresponds to a second area that is a part of the image information area and is different from the first area, and generates the second image information to be displayed on the display device.

Here, the display control device further includes an identification information generation unit. The identification information generation unit generates identification information for identifying the positional relationship between the first image information and the second image information, and displays the identification information on the display device. Therefore, the display device can identify the positional relationship between the first image information and the second image information, which are different from each other and image the surroundings of the vehicle.

In the display control device according to the second embodiment of the present invention, in the display control device according to the first embodiment, the second region includes at least a part of the first region.

According to the display control device according to the second embodiment, since the second region includes at least a part of the first region, it is possible to generate the second image information including at least a part of the first image information.
For example, with respect to the first image information displayed on the display device, the display device can display the second image information in which the field of view around the vehicle is expanded in the left-right direction of the first image information. Further, the first image information displayed on the display device and the enlarged image information obtained by enlarging a part of the first image information can be displayed on the display device as the second image information.
Further, since the display control device switches from the first image information to the second image information, the display can be switched instantly.

In the display control device according to the third embodiment of the present invention, in the display control device according to the first embodiment, the second region does not include the first region.

According to the display control device according to the third embodiment, since the second region does not include the first region, the second image information is generated without including the first image information, with respect to the generation of the first image information. The second image information can be generated independently.
For example, the display device can display the first image information that images the rear of the surroundings of the vehicle and the second image information that images the rear side of the surroundings of the vehicle that is independent of the first image information.

The display control device according to the fourth embodiment of the present invention is the display control device according to the first embodiment or the second embodiment, and in switching between the display of the first image information and the display of the second image information, An intermediate image generation unit for generating intermediate image information to be displayed on the display device is further provided between the display of the first image information and the display of the second image information, and the intermediate image information includes the first of the image information areas. The third image information corresponding to the third region located between the regions and the second region is included.

The display control device according to the fourth embodiment further includes an intermediate image generation unit. In switching between the display of the first image information and the display of the second image information, the intermediate image generation unit displays the intermediate image information to be displayed on the display device between the display of the first image information and the display of the second image information. Generate. The intermediate image information includes a third image information corresponding to a third region located between the first region and the second region in the image information region.
Therefore, in the display device, since the second image information is displayed from the display of the first image information through the display of the intermediate image information, the display is switched gradually or stepwise.
Further, since the intermediate image information includes the third image information corresponding to the third region located between the first region and the second region in the image information region, the first image information to the second image It is possible to easily grasp the switching direction to information.

The display control device according to the fifth embodiment of the present invention switches from the display of the second image information to the display of the first image information in the display control device according to any one of the first to fourth embodiments. It also has display switching means.

The display control device according to the fifth embodiment further includes display switching means. The display switching means switches from the display of the second image information on the display device to the display of the first image information. Therefore, the driver can switch the display of the display device to the first image information after confirming the second image information displayed on the display device.

In the display control device according to the sixth embodiment of the present invention, in the display control device according to the first embodiment or the third embodiment, the first image information is matched with the arrangement direction of the second region with respect to the first region. On the other hand, the second image information is displayed on the display device.

According to the display control device according to the sixth embodiment, the positional relationship between the first region and the second region that image the surroundings of the vehicle and the positional relationship between the first image information and the second image information displayed on the display device. Can be matched.

In the display control device according to the seventh embodiment of the present invention, in the display control device according to any one of the first to sixth embodiments, the identification information is the first image information displayed on the display device. It is the information of the mark that emphasizes the corresponding area or the mark that represents the positional relationship of the second image information with respect to the first image information.

According to the display control device according to the seventh embodiment, the identification information is the mark information. The mark emphasizes the area corresponding to the first image information displayed on the display device, or represents the positional relationship of the second image information with respect to the first image information. Therefore, the driver can identify the positional relationship of the second image information with respect to the first image information at a glance by looking at the identification information of the mark displayed on the display device.

In the display control device according to the eighth embodiment of the present invention, the display control device according to any one of the first to seventh embodiments has image information, a first image information, a second image information, and an identification information. It also has a storage unit for storing images.

The display control device according to the eighth embodiment further includes a storage unit. The storage unit stores image information, first image information, second image information, and identification information. Therefore, in the storage unit, in addition to the image information obtained by capturing the surroundings of the vehicle, the first image information, the second image information, and the identification information displayed on the display device can be stored.

In the display control device according to the ninth embodiment of the present invention, the display control device according to any one of the first to seventh embodiments further includes a storage unit for storing at least image information, and the storage unit is provided with a storage unit. Each of the first image information and the second image information can be specified in the stored image information.

The display control device according to the ninth embodiment further includes a storage unit. The storage unit stores at least image information. In the image information stored in the storage unit, each of the first image information and the second image information can be specified. For example, when each of the first image information and the second image information is generated, an identifier is attached to each of the first region and the second region of the image information, and the image information is stored in the storage unit. Therefore, each of the first image information and the second image information can be retrieved from the image information stored in the storage unit.

The display control device according to the tenth embodiment of the present invention stores the first image information and the second image information displayed on the display device in the display control device according to any one of the first to seventh embodiments. It also has a storage unit.

The display control device according to the tenth embodiment further includes a storage unit. The storage unit stores the first image information and the second image information displayed on the display device. Therefore, the first image information and the second image information displayed on the display device can be retrieved from the storage unit.

In the display control device according to the eleventh embodiment of the present invention, a plurality of image information is generated at a predetermined frame rate in the display control device according to the first to tenth embodiments, and the first image information and the second image information are generated. Each of the image information is generated corresponding to each of the first region and the second region in the same frame or different frames of the image information.

In the display control device according to the eleventh embodiment, a plurality of image information is generated in a predetermined frame. Then, each of the first image information and the second image information is generated corresponding to each of the first region and the second region in the same frame of the image information. Therefore, since each of the first image information and the second image information is generated from the image information in one frame, the efficiency of using the image information can be improved, and the first image information at the same timing with no time difference. , Each of the second image information can be generated.
Further, each of the first image information and the second image information can be generated corresponding to each of the first region and the second region in different frames of the image information.

The display control device according to the twelfth embodiment of the present invention has a first image information in which a part of the periphery of the vehicle is imaged, and a second image information different from the first image information in which a part of the periphery of the vehicle is imaged. When the acquisition unit for acquiring each of the above and the identification information for identifying the positional relationship between the first image information and the second image information are generated, and the second image information is displayed on the display device on which the first image information is displayed. Is provided with an identification information generation unit for displaying the identification information on the display device.

The display control device according to the twelfth embodiment includes an acquisition unit. The acquisition unit acquires each of the first image information obtained by capturing a part of the periphery of the vehicle and the second image information different from the first image information obtained by capturing a part of the periphery of the vehicle.

Here, the display control device further includes an identification information generation unit. The identification information generation unit generates identification information for identifying the positional relationship between the first image information and the second image information. Then, the identification information generation unit causes the display device to display the identification information when the second image information is displayed on the display device on which the first image information is displayed. Therefore, the display device can identify the positional relationship between the first image information and the second image information, which are different from each other and image the surroundings of the vehicle.

The display control method according to the thirteenth embodiment of the present invention corresponds to a step of acquiring image information captured around the vehicle and a first region which is a part of the image information region, and causes the display device to display the image information. The step of generating the first image information, the step of generating the second image information to be displayed on the display device corresponding to the second region which is a part of the region of the image information and is different from the first region, and the first It includes a step of generating identification information for identifying the positional relationship between the image information and the second image information and displaying the identification information on the display device.

In the display control method according to the thirteenth embodiment, first, image information obtained by capturing the surroundings of the vehicle is acquired. The first image information to be displayed on the display device is generated corresponding to the first area which is a part of the image information area. On the other hand, the second image information to be displayed on the display device is generated corresponding to the second region which is a part of the image information and is different from the first region.

Here, the display control method further generates identification information for identifying the positional relationship between the first image information and the second image information, and causes the display device to display the identification information. Therefore, the display device can identify the positional relationship between the first image information and the second image information, which are different from each other and image the surroundings of the vehicle.

The program according to the 14th embodiment of the present invention executes a display control method of a display control device including an acquisition unit, a first image information generation unit, a second image information generation unit, and an identification information generation unit on a computer. The acquisition unit corresponds to the process of acquiring the image information captured around the vehicle, and the first image information generation unit corresponds to the first area which is a part of the image information area. , The step of generating the first image information to be displayed on the display device and the second image information generation unit correspond to the second area which is a part of the image information area and is different from the first area, and is used in the display device. It includes a step of generating a second image information to be displayed, and a step of the identification information generation unit generating identification information for identifying the positional relationship between the first image information and the second image information and displaying the identification information on the display device. ing.

The program according to the fourteenth embodiment causes a computer to execute a display control method of a display control device including an acquisition unit, a first image information generation unit, a second image information generation unit, and an identification information generation unit.
In this program, the acquisition unit acquires image information obtained by capturing an image of the surroundings of the vehicle. The first image information generation unit corresponds to the first area which is a part of the image information area, and generates the first image information to be displayed on the display device. The second image information generation unit corresponds to a second area that is a part of the image information area and is different from the first area, and generates the second image information to be displayed on the display device.

Here, in the program, the identification information generation unit further generates identification information for identifying the positional relationship between the first image information and the second image information, and causes the display device to display the identification information. Therefore, the display device can identify the positional relationship between the first image information and the second image information, which are different from each other and image the surroundings of the vehicle.

[First Example]
Hereinafter, with reference to FIGS. 1 to 5, a display control device according to the first embodiment, a display control method, and a program for causing a computer to execute the method will be described.
In the figure, the arrow FR indicated as appropriate indicates the front direction of the vehicle for an ordinary automobile as an example, and the arrow RR indicates the rear direction of the vehicle. Further, the arrow WL indicates the left side in the width direction of the vehicle, the arrow WR indicates the right side in the width direction of the vehicle, and the arrow UP indicates the upward direction of the vehicle. These directions are conveniently used to illustrate the examples and do not limit the directions in the present invention.

(Configuration of Display Control Device 1 and Display Control System 100)
As shown in FIG. 2, the display control system 100 according to the first embodiment is constructed including the display control device 1. In the display control system 100, the surrounding situation outside the vehicle interior of the vehicle Vm is imaged while the vehicle Vm (see FIG. 1) as the own vehicle is stopped or running, and the image information acquired by this imaging is stored (recorded). It is supposed to be configured. Further, the display control system 100 is configured to generate each of the first image information and the second image information corresponding to a specific area of the image information and display them on the display device 30 as appropriate.
In this embodiment, an example applied to an ordinary automobile as a vehicle will be described, but the vehicle includes at least a bus, a truck, a motorcycle, and a bicycle. Vehicles may further include railroads, ships and aircraft.

More specifically, the display control system 100 is constructed including a display control device 1, an image pickup device 10, an image recognition unit 15, an approach sensor 16, a line-of-sight sensor 17, and a display device 30.
Hereinafter, each component of the display control system 100 will be described.

(Configuration of Imaging Device 10)
As shown in FIGS. 1 and 2, the image pickup apparatus 10 includes a front camera 11, a rear camera (back camera) 12, a right side camera 13, and a left side camera 14 as vehicle outdoor cameras. There is.

As shown in FIG. 1, the front camera 11 is mounted toward the front of the vehicle at a position close to, for example, the front window glass in the vehicle interior of the vehicle Vm. The front camera 11 takes an image of the front of the vehicle around the vehicle Vm and acquires the image information PF of the front of the vehicle.
The rear camera 12 is mounted toward the rear of the vehicle at a position close to, for example, the rear window glass in the vehicle interior of the vehicle Vm. The rear camera 12 takes an image of the rear of the vehicle around the vehicle Vm and acquires the image information PR of the rear of the vehicle.

The right side camera 13 is directed toward the rear right side of the vehicle, for example, at the position of the right side mirror (here, the right door mirror) outside the vehicle interior of the vehicle Vm, or at a position near the right side mirror, or at a position where the right side mirror can be arranged. Is installed. The right side camera 13 takes an image of the right side after the vehicle around the vehicle Vm, and acquires the image information PWR on the right side after the vehicle.
The left side camera 14 is directed toward the rear left side of the vehicle, for example, at the position of the left side mirror (here, the left door mirror) outside the vehicle interior of the vehicle Vm, or at a position near the left side mirror, or at a position where the left side mirror can be arranged. Is attached. The left side camera 14 takes an image of the left side behind the vehicle around the vehicle Vm, and acquires the image information PWL on the left side behind the vehicle.

The front camera 11, the rear camera 12, the right side camera 13, and the left side camera 14 are all configured with, for example, a two-dimensional image sensor as a main imaging device. As the two-dimensional image sensor, for example, a CCD (Charge Coupled Device) image sensor or a CMOS (Complementary Metal Oxide Semiconductor) image sensor can be practically used.
In particular, each of the front camera 11 and the rear camera 12 is a wide-angle camera, and the wide-angle camera has a wide viewing angle of, for example, 120 degrees to 170 degrees. That is, each of the front camera 11 and the rear camera 12 can acquire the wide-angle image information PF and the image information PR.
Here, four cameras (front cameras 11 to left side cameras 14) are arranged as the image pickup apparatus 10, but in this embodiment, at least the front camera 11 and the rear camera 12 may be mounted. Further, in addition to the four cameras, the display control system 100 may be equipped with a vehicle interior camera that images the vehicle interior, and may acquire image information that images not only the surroundings of the vehicle Vm but also the vehicle interior.

(Structure of image recognition unit 15)
As shown in FIG. 1, in this embodiment, the image recognition unit 15 is mounted in the vicinity of the front camera 11 and in the vicinity of the front window glass in the vehicle interior toward the front of the vehicle. Further, the image recognition unit 15 is mounted near the rear camera 12 and at a position near the rear window glass in the vehicle interior toward the rear of the vehicle.
In the image recognition unit 15, other vehicles, people, obstacles, etc. (hereinafter, simply referred to as “other vehicles, etc.”) that are stopped or running are imaged by the camera around the vehicle Vm, and the image information captured here. Is analyzed by image recognition processing, and other vehicles and the like are recognized. This recognized recognition information is transmitted to the display control device 1.
Although the image recognition unit 15 is configured as an external component of the display control device 1 here, it may be included in the display control device 1. Further, it is not necessary to dispose the image recognition unit 15 for each camera of the image pickup apparatus 10. For example, only the image recognition unit 15 mounted toward the front side of the vehicle, which is most necessary, is mounted on the vehicle Vm. Just do it.

(Configuration of proximity sensor 16)
As shown in FIG. 1, in this embodiment, the proximity sensor 16 is mounted in the vicinity of the front camera 11 and in the vicinity of the front window glass in the vehicle interior toward the front of the vehicle. Further, the proximity sensor 16 is mounted in the vicinity of the rear camera 12 and also in the vicinity of the rear window glass in the vehicle interior toward the rear of the vehicle.
As the proximity sensor 16, for example, a sensor such as a laser radar sensor, a microwave radar sensor, an infrared sensor, or an ultrasonic sensor can be practically used. The approach sensor 16 can detect other vehicles and the like around the vehicle Vm. The detected proximity detection information is transmitted to the display control device 1.
As with the image recognition unit 15, the proximity sensor 16 may be included in the display control device 1, and the number of proximity sensors 16 arranged is not limited.

(Structure of line-of-sight sensor 17)
As shown in FIG. 1, in the present embodiment, the line-of-sight sensor 17 is a display device in the vicinity of the front camera 11 and on the rear side of the vehicle with respect to the front camera 11 as shown in FIG. 3 (A). It is mounted on the lower part around the 30 toward the vehicle interior. The line-of-sight sensor 17 is configured to detect the line-of-sight direction of the driver sitting in the driver's seat of the vehicle Vm.
Here, when the driver's line of sight is from the front of the vehicle to the display device 30, that is, in the case of a right-hand drive vehicle, when the driver's line of sight is switched from the front to the diagonally upward left, the line-of-sight sensor 17 changes the line-of-sight direction. Is detected. The detected line-of-sight detection information is transmitted to the display control device 1, and the display control device 1 switches the image information displayed on the display device 30. In this embodiment, the line-of-sight sensor 17 constructs a display switching unit (display switching means) 18 for switching the second image information displayed on the display device 30 to the display of the first image information. The first image information and the second image information displayed on the display device 30 will be described in detail later.
As with the image recognition unit 15, the line-of-sight sensor 17 may be included in the display control device 1.

(Configuration of display device 30)
As shown in FIG. 1, the display device 30 is mounted in the vicinity of the front camera 11 and toward the vehicle interior on the rear side of the front camera 11. The display device 30 is mounted at the mounting position of the rearview mirror instead of the rearview mirror (or rearview mirror) for visually recognizing the rear side of the vehicle.
As shown in FIG. 3A, the display device 30 includes a housing 32 and a display unit 31.
The housing 32 is formed in a rectangular cube shape with the vehicle width direction as the longitudinal direction, the vehicle vertical direction as the lateral direction, and the vehicle front-rear direction as the thickness direction. The housing 32 is, for example, a resin molded product.
The display unit 31 is arranged on substantially the entire surface of the housing 32 on the rear side of the vehicle. A liquid crystal display is used for the display unit 31. Circuit units (not shown) such as the drive circuit of the display unit 31 are arranged on the vehicle front side of the display unit 31 and inside the housing 32. As the display unit 31, an organic electroluminescence display can be used instead of the liquid crystal display.

(Configuration of display control device 1)
As shown in FIG. 2, the display control device 1 includes an interface (IF) 2, an interface (IF) 9, an image information acquisition unit 3, an image information generation unit 4, a determination unit 5, and a central processing unit. (CPU) 6, a first storage unit 7, and a second storage unit 8 are provided. These interfaces 2 and the like are connected to each other via a common bus 20.

(1) Configuration of Interface 2 Interface 2 is arranged as an input side interface. The front camera 11, the rear camera 12, the right side camera 13, and the left side camera 14 of the image pickup apparatus 10 are connected to the interface 2, and the image recognition unit 15, the approach sensor 16, and the line-of-sight sensor 17 are further connected to the interface 2. ing. On the other hand, the interface 2 is connected to the common bus 20.
The interface 2 displays image information output from the image pickup apparatus 10, recognition information output from the image recognition unit 15, proximity detection information output from the proximity sensor 16, and line-of-sight detection information output from the line-of-sight sensor 17. Various information including the information is taken into the display control device 1. Then, in the interface 2, the captured image information is transmitted to the image information acquisition unit 3 and the like via the common bus 20, and various captured information is transmitted to the determination unit 5 and the like via the common bus 20. To.

(2) Configuration of Image Information Acquisition Unit 3 In the image information acquisition unit 3, the image information PF around the vehicle Vm (in front of the vehicle) imaged by the front camera 11 of the image pickup device 10 is acquired via the interface 2. Similarly, in the image information acquisition unit 3, the image information PR around the vehicle Vm (rear of the vehicle) captured by the rear camera 12 is acquired via the interface 2. Further, the image information acquisition unit 3 acquires each of the image information PWR captured by the right side camera 13 and the image information PWL captured by the left side camera 14.

In this embodiment, an example in which a specific area of the image information PR captured by the rear camera 12 is displayed on the display device 30 will be mainly described. Other examples of displaying a specific area of the image information PF captured by the front camera 11 are the same as the example of displaying a specific area of the image information PR, and thus the description thereof will be omitted here.

As shown in FIG. 4A, for example, in the rear camera 12, a plurality of image information PRs (1), image information PRs (2), ..., Image information PRs (), with the passage of time at a predetermined frame rate, Each of n-1) and the image information PR (n) is sequentially imaged. Here, in the description of the embodiment, n is a natural number excluding zero, that is, 1, 2, 3, .... As a predetermined frame rate, for example, 30 FPS (Frames Per Second) or 27.5 FPS is used, and the increase in storage capacity is suppressed.
As shown in FIG. 4B, the one-frame image information PR such as the image information PR (1) is generated corresponding to the pixels of the rear camera 12 arranged vertically and horizontally in a matrix shape. Here, in order to make it easier to understand, it is assumed that the image information PR is generated corresponding to a total of 240 pixels, 12 in the vertical direction and 20 in the horizontal direction, and the image information PR will be briefly described. ..

(3) Configuration of Image Information Generation Unit 4 As shown in FIG. 2, the image information generation unit 4 includes a first image information generation unit 41 and a second image information generation unit 42, and further includes an identification information generation unit 42. It is configured to include 43.

As shown in FIGS. 1, 4 (A) and 4 (B), the first image information generation unit 41 is set in the first region which is a part of the image information PR region captured by the rear camera 12. Correspondingly, the first image information PR1 to be displayed on the display device 30 is generated. In the image information PR shown in FIG. 4B, the first image information PR1 cuts out an area corresponding to a total of 40 pixels, 4 in the vertical direction and 10 in the horizontal direction, as the first area. Is generated. As shown in FIG. 3A, the first image information PR1 is generated as an image to be always displayed on the display device 30 during normal traveling of the vehicle Vm (here, when the vehicle is normally stopped).
The first image information PR1 is generated as a still image in one frame of image information PR, but is generated as a moving image because it is generated from a plurality of image information PRs at a predetermined frame rate.

As shown in FIGS. 1, 4 (A) and 4 (B), the second image information generation unit 42 is located in a second region that is a part of the image information PR region and is different from the first region. Correspondingly, the second image information PR2 to be displayed on the display device 30 is generated. In the image information PR shown in FIG. 4B, the second image information PR2 includes all the first region and overlaps with the first region, and has 6 in the vertical direction and 16 in the horizontal direction, for a total of 96. It is generated by cutting out the region corresponding to the pixel of the above as the second region. As shown in FIG. 3B, the second image information PR2 is displayed on the display device 30 by switching from the display of the first image information PR1 as the vehicle Vm is in an abnormal traveling state (here, when the vehicle is stopped normally). It is generated as an image to be made.

Here, the non-normal stop is when, for example, "person H" is recognized on the left rear side of the vehicle Vm by the image recognition unit 15 shown in FIGS. 1 and 2, and is safer than when the vehicle is normally stopped. It is used to mean when improving sex. When, for example, "person H" is detected by the approach sensor 16, it is also an abnormal stop. The second image information PR2 is generated by being expanded to the area where "person H" is displayed, and is displayed on the display device 30 as shown in FIG. 3 (B). Here, each of the image information PR, the first image information PR1, and the second image information PR2 captured by the rear camera 12 is generally reversed left and right and displayed on the display device 30.
Although the second image information PR2 shown in FIG. 3B is generated including all the first image information PR1, the second image information PR2 is generated including a part of the first image information PR1. You may.

Here, as described above, each of the first image information PR1 and the second image information PR2 is generated from the image information PR, and the image information PR includes the first image information PR1 and the second image information PR2. .. Therefore, in the image information acquisition unit 3 shown in FIG. 2, the image information PR is acquired, and at least each of the first image information PR1 and the second image information PR2 is acquired.

As shown in FIG. 3B, the identification information generation unit 43 generates an identification information IM for identifying the positional relationship between the first image information PR1 and the second image information PR2, and displays the identification information IM. Display at 30. The identification information IM is displayed superimposed on the second image information PR2 displayed on the display device 30. The identification information IM is used as mark information that surrounds the contour corresponding to the first image information PR1 and emphasizes the area corresponding to the first image information PR1. The identification information IM is set to a rectangular frame shape whose longitudinal direction is the vehicle width direction, corresponding to the contour shape of the first image information PR1.
When displaying the second image information PR2 on the display device 30, in addition to displaying the identification information IM, cautions such as "caution", "be careful", and "please check the rear" are called out. A message or symbol to be displayed may be displayed.

(4) Configuration of Judgment Unit 5 and Display Switching Unit 18 The determination unit 5 shown in FIG. 2 acquires recognition information of another vehicle or the like recognized by the image recognition unit 15, and the vehicle (self) is based on this recognition information. Vehicle) It is determined whether or not another vehicle or the like is approaching Vm. Further, the determination unit 5 acquires the proximity detection information output from the proximity sensor 16, and determines whether or not another vehicle or the like is approaching the vehicle Vm based on the proximity detection information.
The determination unit 5 causes the second image information generation unit 42 to generate the second image information PR2 when the approach distance to the vehicle Vm of another vehicle or the like exceeds a certain threshold value. When the second image information PR2 is generated, the display device 30 switches the first image information PR1 to display the second image information PR2.

Further, the determination unit 5 and the line-of-sight sensor 17 constitute a display switching unit (display switching means) 18. The determination unit 5 determines whether or not the driver has changed the line-of-sight direction based on the line-of-sight detection information detected by the line-of-sight sensor 17. Here, it is determined whether or not the driver has changed the line-of-sight direction from the front direction to the direction of the display device 30. In other words, the determination unit 5 determines whether or not the driver has confirmed the second image information PR2 displayed on the display device 30.
When the determination unit 5 determines that the driver has changed the line-of-sight direction, the display device 30 switches from the display of the second image information PF2 to the display of the first image information PF1. That is, the display switching unit 18 is configured to return the display of the display device 30 to the original first image information PF1 when the vehicle is normally stopped.

(5) Configuration of Central Arithmetic Processing Unit 6, First Storage Unit 7, and Second Storage Unit 8 As shown in FIG. 2, the central arithmetic processing unit 6 constructs a computer and controls display via a common bus 20. It controls the operation of each component such as the image information acquisition unit 3, the image information generation unit 4, and the determination unit 5 of the device 1.

The first storage unit 7 includes, for example, a read-only storage circuit (for example, ROM: Read Only Memory) and a write-read-only storage circuit (for example, RAM: Random Access Memory). The first storage unit 7 is connected to the common bus 20. The first storage unit 7 stores a program necessary for operation control of the display control device 1, and temporarily stores information being executed by the central arithmetic processing unit 6.

The second storage unit 8 is arranged as a storage device having a large storage capacity such as a non-volatile storage device or a hard disk. The second storage unit 8 is connected to the common bus 20. The image information PR acquired by the image information acquisition unit 3 is stored in the second storage unit 8. Further, the second storage unit 8 is provided with the first image information PR1 generated by the first image information generation unit 41, the second image information PR2 generated by the second image information generation unit 42, and the identification information generation unit 43. The generated identification information IM is stored.
Further, since the display control device 1 according to the present embodiment includes an impact sensor (acceleration sensor) (not shown) and includes a function as a drive recorder, the second storage unit 8 has before and after receiving an impact. The image information PR is automatically stored as a separate file.

Of course, as shown in FIG. 1, the second storage unit 8 stores the image information PF captured by the front camera 11. At the same time, the second storage unit 8 contains the first image information PF1 generated by the first image information generation unit 41, the second image information PF2 generated by the second image information generation unit 42, and the identification information generation unit 43. The identification information IM (see FIG. 3B) generated by the above is stored.
Further, the second storage unit 8 stores the image information PWR captured by the right side camera 13 and the image information PWL captured by the left side camera 14.

Further, the second storage unit 8 is configured to store at least the image information PR, and each of the first image information PR1 and the second image information PR2 can be specified in the image information PR stored in the second storage unit 8. It may be configured. For example, when the image information PR is stored in the second storage unit 8, an identifier that identifies the first image information PR1 is added to the first image information PR1 corresponding to the first area of the image information PR, and the second area. An identifier that identifies the second image information PR2 is added to the second image information PR2 corresponding to. Since each of the first image information PR1 and the second image information PR2 is time-series information when stored in the second storage unit 8, an identifier is added to, for example, the preceding stage of this information. Each of the image information PR1 and the second image information PR2 to which the identifier is added in this way can be taken out from the second storage unit 8 as needed.

Further, the second storage unit 8 may have two or more storage areas, or may be composed of two or more storage devices. Then, the image information PR is stored in one storage area or storage device of the second storage unit 8, and the first image information PR1 and the second image to be displayed on the display device 30 in the other storage area or storage device. Each of the information PR2 is stored.

(6) Configuration of Interface 9 The interface 9 is arranged as an output side interface. The interface 9 is connected to the common bus 20, and the display device 30 is connected to the interface 9. The interface 9 includes a first image information PR1 generated by the first image information generation unit 41, a second image information PR2 generated by the second image information generation unit 42, and an identification information IM generated by the identification information generation unit 43. Is output to the display device 30.

(Display control method and program for executing the method)
With reference to FIGS. 1 to 4, a display control method using the display control device 1 and the display control system 100 will be described with reference to FIG. 5, and a program for executing the display control method will also be described.
As described above, a method of displaying a specific area (first area and second area) of the image information PR captured by the rear camera 12 on the display device 30 will be mainly described, but the image captured by the front camera 11 An example of displaying a specific area of the information PF will also be described. The specific area of the image information PF is displayed on a display device (not shown) mounted in the vehicle interior of the vehicle Vm. As this display device, for example, a display device of a navigation system, a display device of a drive recorder, or the like is used.

As shown in FIG. 5, when the display control method is started and the program is executed, it is first determined whether or not the accessory power supply (ACC) of the vehicle Vm is ON (step S1). When it is determined that the accessory power supply is OFF, the display control method ends and the program execution is stopped.

When it is determined that the accessory power supply is ON, the display control device 1 and the display control system 100 are started (step S2). When the display control system 100 is activated, each of the front camera 11 of the image pickup device 10, the image pickup device 10 such as the rear camera 12, the image recognition unit 15, the proximity sensor 16, the line-of-sight sensor 17, and the display device 30 is activated. When the display control device 1 is activated, the interface 2, the image information acquisition unit 3, the image information generation unit 4, the determination unit 5, the central arithmetic processing unit 6, the first storage unit 7, the second storage unit 8, and the interface Each of 9 is activated.

Subsequently, it is determined whether the vehicle Vm is traveling forward or backward (step S3). Here, if it is determined that the vehicle is not traveling forward, it is determined whether or not the vehicle is traveling backward (step S14).
Here, for example, a shift device (not shown) of the vehicle Vm is used to determine whether the vehicle is traveling forward or backward. Specifically, when the shift lever of the shift device is in the forward traveling position such as the drive range, it is determined that the forward traveling is in progress. On the contrary, when the shift lever is in the reverse traveling position in the reverse range, it is determined that the vehicle is traveling backward. In this case, since it is determined whether the vehicle is traveling forward or backward depending on the position of the shift lever, it is irrelevant to the determination whether or not the vehicle Vm is actually traveling.

If it is determined in step S14 that the vehicle is not traveling backward, it is determined whether or not to continue the activation of the display control device 1 (step S12). If it is determined to continue, the process returns to step S3. If it is determined not to continue, it is determined whether or not to turn off the accessory power supply (step S13). If it is determined that the accessory power supply is not turned off, the process returns to step S3. When it is determined that the accessory power supply is turned off, the display control method according to this embodiment ends, and the program execution ends.

On the other hand, in step S14, when it is determined that the vehicle Vm is traveling backward, as shown in FIG. 1, the image information PR in which the rear camera 12 of the imaging device 10 images the rear of the vehicle around the vehicle Vm is displayed. It is acquired by the image information acquisition unit 3 of the display control device 1 (step S15). The image information PR is acquired from the rear camera 12 to the image information acquisition unit 3 via the interface 2 and the common bus 20. Further, the image information PR is acquired as wide-angle image information at a predetermined frame rate as shown in FIGS. 4 (A) and 4 (B).
The image information PR acquired by the image information acquisition unit 3 is stored in the second storage unit 8 shown in FIG. 2 (step S16).

Based on the image information PR acquired by the image information acquisition unit 3, the first image information generation unit 41 shown in FIG. 2 is a part of the area of the image information PR as shown in FIG. 4 (B). The first image information PR1 corresponding to a certain first region is generated. The first image information PR1 is transmitted to the display device 30 via each of the common bus 20 and the interface 9, and is displayed as an image of the rear of the vehicle around the vehicle Vm as shown in FIG. 3 (A). It is displayed on the device 30 (step S17).

In the display control method and program according to the present embodiment, when the display control device 1 and the display control system 100 are started, the display control device 1 and the display control system 100 are always activated regardless of whether or not the vehicle is traveling backward in steps S3 and S14. The image information PR is acquired by the image information acquisition unit 3. Then, the image information PR is always stored in the second storage unit 8, and the first image information PR1 is constantly generated by the first image information generation unit 41 and displayed on the display device 30. .. That is, since the display device 30 corresponding to the rearview mirror is incorporated in the display control system 100 instead of the rearview mirror, the display device 30 is configured to always display the first image information PR1.

Subsequently, it is determined whether or not an obstacle such as another vehicle is approaching (step S18). The approach of the obstacle is determined by the determination unit 5 based on the recognition information from the image recognition unit 15 shown in FIG. 2 or the detection information from the approach sensor 16. In this embodiment, two types of methods, the image recognition unit 15 and the approach sensor 16, are used to improve the determination accuracy for the approach of an obstacle, but basically, the determination can be performed by either method. Is.
If it is determined that the obstacle is not approaching, the process proceeds to step S12.

On the other hand, when it is determined in step S18 that the obstacles are close to each other, the second image information generation unit 42 shown in FIG. 2 is as shown in FIG. 4 (B) based on the image information PR. , Generates the second image information PR2 corresponding to the second area which is a part of the image information PR area. The second image information PR2 is transmitted to the display device 30 via each of the common bus 20 and the interface 9, and as shown in FIG. 3B, the rear of the vehicle around the vehicle Vm is extended in the left-right direction. The image is displayed on the display device 30 as the captured image (step S19).
Here, since it is determined in step S18 that the obstacle is approaching the "person H" on the left side behind the vehicle Vm, the second image information PR2 expanded to the range where the obstacle is displayed is the second. It is generated by the image information generation unit 42 and displayed on the display device 30.

Further, at the same time as or before and after the generation of the second image information PR2, the identification information generation unit 43 shown in FIG. 2 provides an identification information IM for identifying the positional relationship of the second image information PR2 with respect to the first image information PR1. Will be generated. The identification information IM is transmitted to the display device 30 via each of the common bus 20 and the interface 9, and is displayed on the display device 30 as shown in FIG. 3 (B) (step S20).
As shown in FIGS. 3B and 4B, the identification information IM surrounds the first region of the image information PR, that is, the outline of the first image information PR1, and corresponds to the first image information PR1. It is displayed as mark information that visually emphasizes the area.

Subsequently, it is determined whether or not to cancel the display of the second image information PR2 on the display device 30, that is, whether or not to switch from the second image information PR2 to the display of the original first image information PR1 (step S21). .. The display switching unit 18 shown in FIG. 2 is used for this determination. In the display switching unit 18, the line-of-sight direction of the driver sitting in the driver's seat of the vehicle Vm is detected by the line-of-sight sensor 17, and based on this detection information, the driver displays the second image information on the display device 30. The determination unit 5 determines whether or not PR2 has been confirmed.
When it is determined in step S21 that the driver has confirmed the second image information PR2 displayed on the display device 30, the display of the second image information PR2 is canceled (step S22), and the first display device 30 is displayed. Image information PR1 is displayed. That is, the display of the second image information PR2 is switched to the display of the original first image information PR1. After that, the process shifts to step S12.

If it is determined in step S21 that the display of the second image information PR2 is not canceled, the process shifts to step S12. At this time, the second image information PR2 is switched to the original first image information PR1 after a certain period of time set to a longer switching time than the display cancellation in step S22 has elapsed. As a constant time, for example, several seconds to ten and several seconds are appropriate. When the vehicle Vm is no longer approached by another vehicle or the like, the second image information PR2 may be switched to the original first image information PR1.

Further, in step S3, when it is determined that the vehicle Vm is traveling forward, the image information PF that images the front of the vehicle around the vehicle Vm by the front camera 11 of the image pickup device 10 shown in FIG. 1 is displayed by the display control device 1. Is acquired by the image information acquisition unit 3 of (step S4). The image information PF is acquired from the front camera 11 to the image information acquisition unit 3 via the interface 2 and the common bus 20. Further, the image information PF is acquired as wide-angle image information at a predetermined frame rate in the same manner as the image information PR (see FIGS. 4 (A) and 4 (B)).
The image information PF acquired by the image information acquisition unit 3 is stored in the second storage unit 8 shown in FIG. 2 (step S5).

Based on the image information PF acquired by the image information acquisition unit 3, the first image information generation unit 41 shown in FIG. 2 is a part of the region of the image information PF, similarly to the first image information PR1. The first image information PF1 corresponding to one region is generated (see FIGS. 1 and 4 (B)). The first image information PF1 is transmitted to a display device (not shown) via each of the common bus 20 and the interface 9, and is displayed on the display device as an image of the front of the vehicle around the vehicle Vm (step S6. FIG. 3 (A)).

Here, in the display control method and program according to the present embodiment, the image information PF is always acquired regardless of whether or not the vehicle is traveling forward, as in the display of the first image information PR1 of the display device 30. The first image information PF1 is generated and displayed on the display device.

Subsequently, it is determined whether or not an obstacle is approaching (step S7). The approach of the obstacle is determined by the determination unit 5 based on the recognition information from the image recognition unit 15 shown in FIG. 2 or the detection information from the approach sensor 16.
If it is determined that the obstacle is not approaching, the process returns to step S3.

On the other hand, when it is determined in step S7 that the obstacles are close to each other, the second image information generation unit 42 shown in FIG. 2 is a part of the region of the image information PF based on the image information PF. The second image information PF2 corresponding to the second region is generated (see FIG. 4B). The second image information PF2 is transmitted to a display device (not shown) via each of the common bus 20 and the interface 9, and is displayed on the display device as an image captured by expanding the front of the vehicle around the vehicle Vm in the left-right direction. (Step S8; see FIG. 3 (B)).

Further, at the same time as or before and after the generation of the second image information PF2, the identification information generation unit 43 shown in FIG. 2 identifies the positional relationship of the second image information PF2 with respect to the first image information PF1. Information (see identification information IM shown in FIG. 3B) is generated. The identification information is transmitted to the display device via each of the common bus 20 and the interface 9, and is displayed on the display device (step S9).
Similar to the identification information IM shown in FIG. 3B, the identification information surrounds the first region of the image information PF, that is, the outline of the first image information PF1, and visually observes the region corresponding to the first image information PF1. It is displayed as information of the mark to be emphasized.

Subsequently, it is determined whether or not to cancel the display of the second image information PF2 on the display device, that is, whether or not to switch from the second image information PF2 to the display of the original first image information PF1 (step S10). The display switching unit 18 shown in FIG. 2 is used for this determination.
When it is determined in step S10 that the driver has confirmed the second image information PF2 displayed on the display device, the display of the second image information PF2 is canceled (step S11), and the original first image information PF2 is displayed on the display device. Image information PF1 is displayed. After that, the process shifts to step S12.

If it is determined in step S10 that the display of the second image information PF2 is not canceled, the display of the second image information PF2 is canceled after a certain period of time, and the process proceeds to step S12. When the vehicle Vm is no longer approached by another vehicle or the like, the second image information PR2 may be switched to the original first image information PR1.

Here, a display control method and a program of a specific area of the image information PF imaged by the front camera 11 and a specific area of the image information PR imaged by the rear camera 12 are described. The display control method and program of the specific area of the image information PWR captured by the right side camera 13 and the specific area of the image information PWL captured by the left side camera 14 shown in FIG. 1 are the same. The description of is omitted.

(Action effect)
As described above, the display control device 1 according to the present embodiment has an image information acquisition unit (acquisition unit) 3, a first image information generation unit 41, and a second image information generation, as shown in FIG. A unit 42 is provided.
The image information acquisition unit 3 acquires the image information PR in which the periphery of the vehicle Vm shown in FIG. 1, particularly the rear of the vehicle, is captured. The first image information generation unit 41 corresponds to the first region which is a part of the region of the image information PR, and generates the first image information PR1 to be displayed on the display device 30. The second image information generation unit 42 generates the second image information PR2 to be displayed on the display device 30 corresponding to the second area which is a part of the image information PR area and is different from the first area.

Here, as shown in FIG. 2, the display control device 1 further includes an identification information generation unit 43. The identification information generation unit 43 generates identification information IM for identifying the positional relationship between the first image information PR1 and the second image information PR2, and displays the identification information IM on the display device 30 as shown in FIG. 3B. Therefore, the display device 30 can identify the positional relationship between the first image information PR1 and the second image information PR2, which are images of the surroundings of the vehicle Vm and are different from each other. That is, the positional relationship of the second image information PR2 when the vehicle is not normally stopped with respect to the first image information PR1 when the vehicle is normally stopped, which is displayed on the display device 30, can be easily grasped by the driver at a glance.

Further, in the display control device 1, as shown in FIG. 4 (B), the second region includes at least a part of the first region. Therefore, as shown in FIG. 3 (B), the first image information PR1 The second image information PR2 including at least a part of the above can be generated. Here, with respect to the first image information PR1 (see FIG. 3A) displayed on the display device 30, the field of view behind the vehicle around the vehicle Vm is expanded in the left-right direction of the first image information PR1. 2 The image information PR2 can be displayed on the display device 30.
Then, as shown in FIGS. 3 (A) and 3 (B), the display control device 1 switches from the first image information PR1 to the second image information PR2, so that the display device 30 instantly switches the display. Can be done. As a result, if an obstacle approaches, the information can be instantly displayed on the display device 30, so that the obstacle can be avoided immediately.

Further, in the display control device 1, as shown in FIGS. 3B and 4B, the second image information PR2 displayed on the display device 30 here includes the first image information PR1 on one screen. Is generated as. Therefore, since the second image information PR2 is displayed on a large screen over the entire display unit 31 of the display device 30, the driver's visibility to the second image information PR2 can be improved.

Further, the display control device 1 includes a display switching unit (display switching means) 18 as shown in FIG. The display switching unit 18 determines the change in the line-of-sight direction based on the line-of-sight sensor 17 that detects the line-of-sight direction of the driver and the detection information of the line-of-sight sensor 17, and displays from the second image information PR2 to the first image information PR1. It is configured to include a determination unit 5 for switching the display of 30.
Therefore, the driver can automatically switch the display of the display device 30 to the first image information PR1 after confirming the second image information PR2 displayed on the display device 30.

Further, in the display control device 1, as shown in FIG. 3B, the identification information IM is used as mark information. The mark emphasizes the area corresponding to the first image information PR1 displayed on the display device 30. Therefore, the driver can identify the positional relationship of the second image information PR2 with respect to the first image information PR1 at a glance by looking at the mark identification information IM displayed on the display device 30.

Further, the display control device 1 includes a second storage unit (storage unit) 8 as shown in FIG. The second storage unit 8 stores the image information PR, the first image information PR1, the second image information PR2, and the identification information IM. Therefore, in the second storage unit 8, in addition to the image information PR that images the rear of the vehicle around the vehicle Vm, the first image information PR1, the second image information PR2, and the identification information IM displayed on the display device 30 are stored. Can be remembered.
For example, the first image information PR1, the second image information PR2, and the identification information IM displayed on the display device 30 after being stored in the second storage unit 8 can be retrieved. The extracted image information PR and the like can be used for driver management and evidence of a traffic accident.
explain in detail. For example, by making it possible to retrieve the image information PR stored in the second storage unit 8 after a traffic accident, the image information PR including the image information displayed on the display device 30 and capturing a wide range around the vehicle Vm can be obtained. Based on this, the situation at the time of the traffic accident can be confirmed. Further, by making it possible to retrieve the first image information PR1, the second image information PR2, and the identification information IM stored in the second storage unit 8, the image information displayed on the display device 30 at the time of the traffic accident can be confirmed. can do.

Further, the display control device 1 may include at least a second storage unit 8 that stores the image information PR. In the image information PR stored in the second storage unit 8, each of the first image information PR1 and the second image information PR2 can be specified. For example, when each of the first image information PR1 and the second image information PR2 is generated, an identifier is assigned to each of the first region and the second region of the image information PR, and the image information PR is stored in the second storage unit 8. It will be remembered. Therefore, each of the first image information PR1 and the second image information PR2 can be taken out from the image information PR stored in the second storage unit 8.

Further, the display control device 1 may include a second storage unit 8 that stores the first image information PR1 and the second image information PR2 displayed on the display device 30 shown in FIG. The first image information PR1 and the second image information PR2 are stored in a storage area or storage device different from the storage area or storage device in which the image information PR is stored. Therefore, the first image information PR1 and the second image information PR2 displayed on the display device 30 can be easily taken out from the second storage unit 8.

Further, in the display control device 1, as shown in FIG. 4A, a plurality of image information PRs are generated in a predetermined frame. Then, each of the first image information PR1 and the second image information PR2 is generated corresponding to each of the first region and the second region in the same frame of the image information PR. Therefore, since each of the first image information PR1 and the second image information PR2 is generated from the image information PR in one frame, the usage efficiency of the image information PR can be improved, and at the same timing with no time difference. Each of the first image information PR1 and the second image information PR2 can be generated.
If the display control device 1 or the display control system 100 according to the present embodiment constructs a drive recorder, a wide-angle image information PR is always acquired and stored in the second storage unit. In addition, a part of the image information PR is effectively used, and the first image information PR1 and the second image information PR2 behind the vehicle around the vehicle Vm, which are required by the driver, are displayed on the display device 30. Can be made to.

Further, the display control device 1 according to the present embodiment includes an image information acquisition unit 3 as shown in FIG. The image information acquisition unit 3 is the first image information PR1 in which a part of the vehicle rear around the vehicle Vm shown in FIG. 1 is imaged, and the first image information in which a part of the vehicle rear around the vehicle Vm is imaged. Each of the second image information PR2 different from PR1 is acquired.

Here, the display control device 1 further includes an identification information generation unit 43. As shown in FIG. 3B, the identification information generation unit 43 generates the identification information IM that identifies the positional relationship between the first image information PR1 and the second image information PR2. Then, the identification information generation unit 43 causes the display device 30 to display the identification information IM when the second image information PR2 is displayed on the display device 30 on which the first image information PR1 is displayed. Therefore, the display device 30 can identify the positional relationship between the first image information PR1 and the second image information PR2, which are images of the rear of the vehicle around the vehicle Vm.

Further, in the display control method according to the present embodiment, as shown in FIG. 5, first, image information PR that images the rear of the vehicle around the vehicle Vm is acquired (see FIG. 4 (A)). The first image information PR1 to be displayed on the display device 30 is generated corresponding to the first area which is a part of the image information PR area (see FIG. 4B). On the other hand, the second image information PR2 which is a part of the image information PR and corresponds to the second region different from the first region and is displayed on the display device 30 is generated (see FIG. 4B).

Here, the display control method further generates identification information IM for identifying the positional relationship between the first image information PR1 and the second image information PR2, and identifies the identification information IM on the display device 30 as shown in FIG. 3B. Display the information IM. Therefore, the display device 30 can identify the positional relationship between the first image information PR1 and the second image information PR2, which are images of the rear of the vehicle around the vehicle Vm.

Further, the program according to this embodiment includes an image information acquisition unit (acquisition unit) 3 shown in FIG. 2, a first image information generation unit 41, a second image information generation unit 42, and an identification information generation unit 43. The computer is made to execute the display control method of the display control device 1 provided with the above.
In this program, as shown in FIG. 5, the image information acquisition unit 3 acquires the image information PR that images the rear of the vehicle around the vehicle Vm shown in FIG. The first image information generation unit 41 corresponds to the first region which is a part of the region of the image information PR, and generates the first image information PR1 to be displayed on the display device 30 (see FIG. 4B). The second image information generation unit 42 generates the second image information PR2 to be displayed on the display device 30 corresponding to the second area which is a part of the image information PR area and is different from the first area (FIG. 4). See (B)).

Here, in the program, the identification information generation unit 43 further generates an identification information IM for identifying the positional relationship between the first image information PR1 and the second image information PR2, and causes the display device 30 to display the identification information IM ( See FIG. 3 (B)). Therefore, the display device 30 can identify the positional relationship between the first image information PR1 and the second image information PR2, which are images of the rear of the vehicle around the vehicle Vm.

The above-mentioned effects can be obtained when the display control device 1 and the display control system 100 shown in FIG. 2 display a specific area of the image information PR captured by the rear camera 12. In this embodiment, the same effect can be obtained when displaying a specific area of the image information PF imaged by the front camera 11. Further, the same effect is applied to each of the case where the specific area of the image information PWR captured by the right side camera 13 is displayed and the case where the specific area of the image information PWL imaged by the left side camera 14 is displayed. Is obtained.

(First modification)
The display control device 1, the display control system 100, the display control method, and the program according to the first modification of the first embodiment will be described with reference to FIG.
In addition, in the description of each modification after the first modification and each example after the second embodiment, the same component as each component described in the first embodiment or substantially the same component is used. The same reference numerals are given, and duplicate description is omitted.

In the display control device 1 (see FIG. 2) according to the first modification, the second image information PR2 generated by the second image information generation unit 42 is different from the second image information PR2 in the first embodiment. Here, even in the first modified example, the subsequent modified examples, and the second and subsequent embodiments, the display method based on the image information PR in which the rear camera 12 of the imaging device 10 images the rear of the vehicle around the vehicle Vm is mainly used. explain. The display method based on the image information PF captured by the front camera 11, the image information PWR captured by the right side camera 13, and the image information PWL captured by the left side camera 14 is a display method based on the image information PR. Since it is the same, the description thereof will be omitted.

More specifically, as shown in FIG. 6A, the display device 30 displays the first image information PR1 generated by the first image information generation unit 41 of the display control device 1. As shown in FIG. 6C, the first image information PR1 is generated corresponding to the first region which is a part of the region of the image information PR that images the rear of the vehicle around the vehicle Vm during normal driving. Will be done.
During non-normal driving, as shown in FIG. 6B, the second image information PR2 generated by the second image information generation unit 42 is displayed on the display device 30. As shown in FIG. 6C, the second image information PR2 is generated corresponding to the second region which is a part of the region of the image information PR. The second image information PR2 is image information obtained by enlarging a main part of the first region. The second image information PR2 is displayed on the display device 30 side by side with the first image information PR1 on the left side of the first image information PR1 whose display area is reduced.

Since the second image information PR2 is generated based on the main part of the first image information PR1, it is generated including the first image information PR1. Further, the main part of the first image information PR1 is specified by using the image recognition unit 15 or the approach sensor 16 and the determination unit 5 shown in FIG. Here, since another vehicle approaching from behind in the same lane as the lane in which the vehicle (own vehicle) Vm is traveling or in an adjacent lane is detected by the image recognition unit 15 or the approach sensor 16, the first image information PR1 The second image information PR2 is displayed side by side.

Then, as shown in FIG. 6B, the identification information IM for identifying the positional relationship between the first image information PR1 and the second image information PR2 is generated by the identification information generation unit 43 (see FIG. 2). It is displayed on the display device 30. The identification information IM is generated as information of a rectangular frame-shaped mark surrounding a main part of the first image information PR1, and is displayed on the display device 30 in an overlapping manner with the first image information PR1.

In the first modification, the components of the display control device 1, the display control system 100, the display control method, and the program are substantially the same as those in the first embodiment, except that the display method of the second image information PR2 is different. Therefore, the description here will be omitted.

As described above, in each of the display control device 1, the display control system 100, the display control method, and the program according to the first modification, the display control device 1, the display control system 100, and the display control method according to the first embodiment , It is possible to obtain the same effects as those obtained by each of the programs.

Further, in each of the display control device 1, the display control system 100, the display control method, and the program according to the first modification, as shown in FIG. 6B, the second image information PR is the first image information PR1. The main part of the image is enlarged and displayed on the display device 30 side by side with the first image information PR1. Therefore, it is possible to improve the visibility of other vehicles and the like by the driver. For example, as shown in FIG. 6B, safety can be improved during non-normal driving in which another vehicle approaches the vehicle Vm.

(Second modification)
The display control device 1, the display control system 100, the display control method, and the program according to the second modification of the first embodiment will be described with reference to FIG. 7.
In the display control device 1 (see FIG. 2) according to the second modification, the second image information PR2 generated by the second image information generation unit 42 is the second image in each of the first embodiment and the first modification. It is different from information PR2.

More specifically, as shown in FIG. 7A, the display device 30 is generated by the first image information generation unit 41 of the display control device 1 as in the first image information PR1 in the first modification. The first image information PR1 is displayed. As shown in FIG. 7C, the first image information PR1 is generated corresponding to the first region which is a part of the region of the image information PR that images the rear of the vehicle around the vehicle Vm during normal driving. Will be done.
During non-normal driving, as shown in FIG. 7B, the second image information PR2 generated by the second image information generation unit 42 is displayed on the display device 30. As shown in FIG. 7C, the second image information PR2 is generated corresponding to the second region which is a part of the region of the image information PR. The second image information PR2 is image information on the left side of the first region (the left side of the vehicle Vm). As shown in FIG. 7B, the first image information PR1 is reduced, and the second image information PR2 is displayed on the display device 30 alongside the first image information PR1 on the left side of the first image information PR1. ..

As shown in FIG. 7C, the second image information PR2 is generated based on the second region that does not overlap with the first region of the image information PR, and therefore does not include the first image information PR1. Has been generated. Further, the second region of the second image information PR2 is specified from the image information PR by using the image recognition unit 15 or the approach sensor 16 and the determination unit 5 shown in FIG.
Here, since another vehicle approaching (existing) in the lane on the left side of the lane of the vehicle Vm is detected by the image recognition unit 15 or the approach sensor 16, the second image information PR2 is the first image information PR1. It is displayed side by side on the left side of.

Then, as shown in FIG. 7B, the identification information IM for identifying the positional relationship between the first image information PR1 and the second image information PR2 is generated by the identification information generation unit 43 (see FIG. 2). It is displayed on the display device 30. The identification information IM is generated as information of a rectangular frame-shaped mark surrounding the periphery of the first image information PR1 and displayed on the display device 30.

In the second modification, the display method of the second image information PR2 is different, and the components of the display control device 1, the display control system 100, the display control method, and the program are the same as those in the first embodiment. The description here will be omitted.

As described above, in each of the display control device 1, the display control system 100, the display control method, and the program according to the second modification, the display control device 1, the display control system 100, and the display control method according to the first embodiment are used. , It is possible to obtain the same effects as those obtained by each of the programs.

Further, in each of the display control device 1, the display control system 100, the display control method, and the program according to the second modification, as shown in FIG. 7C, the second region in the image information PR is the first region. Not included. Therefore, since the second image information PR2 is generated without including the first image information PR1, the second image information PR2 can be generated independently of the generation of the first image information PR1.
For example, as shown in FIGS. 1 and 7B, the first image information PR1 that images the rear of the surroundings of the vehicle Vm and the rear side around the vehicle Vm that is independent of the first image information PR1. The captured second image information PR2 can be displayed on the display device 30.
Further, since the display control device 1 or the like switches from the first image information PR1 to the first image information PR1 and the second image information PR2, the display device 30 can instantly switch the display.

Further, in the display control device 1 and the like, as shown in FIGS. 7 (B) and 7 (C), the first image information PR1 is matched with the arrangement direction of the second region with respect to the first region of the image information PR. The second image information PR2 is displayed on the display device 30. Therefore, the positional relationship between the first region and the second region, which is an image of the surroundings of the vehicle Vm (see FIG. 1), and the positional relationship between the first image information PR1 and the second image information PR2 displayed on the display device 30. Can be matched. Specifically, as shown in FIG. 7B, the first image information on the right side of the display device 30 is matched with the positional relationship between the vehicle Vm and another vehicle approaching to the left side and the approaching direction. PR1 is displayed, and the second image information PR2 including an image of another vehicle is displayed on the left side. That is, the positional relationship of the landscape corresponding to the second region with respect to the landscape corresponding to the first region around the vehicle Vm, which the driver actually sees, is the second with respect to the first image information PR1 displayed on the display device 30. It can be matched with the positional relationship of the image information PR2. Therefore, the positional relationship of the second image information PR2 with respect to the first image information PR1 becomes easier to identify in the display device 30.

[Second Example]
The display control device 1, the display control system 100, the display control method, and the program according to the second embodiment of the present invention will be described with reference to FIGS. 8 to 10.

(Configuration of Display Control Device 1 and Display Control System 100)
As shown in FIG. 8, the display control device 1 according to the present embodiment includes an intermediate image information generation unit 44 as a component in the image information generation unit 4. Each component other than the intermediate image information generation unit 44 is the same as each component of the display control device 1 according to the first embodiment.
In the switching between the display of the first image information PR1 and the second image information PR2, the intermediate image information generation unit 44 receives the display device 30 between the display of the first image information PR1 and the display of the second image information PR2. Generates intermediate image information PRM to be displayed on. For the second image information PR2, the same image information as the second image information PR2 in the second modification of the first embodiment is used. Of course, the identification information IM (not shown) is displayed on the display device 30. As shown in FIG. 10, the intermediate image information PRM includes a third image information corresponding to a third region located between the first region and the second region in the region of the image information PR. ..

(Display control method and program for executing the method)
The display control method according to the present embodiment and the program for executing the method are basically the same as the display control method according to the first embodiment and the program for executing the method (see FIG. 5). .. The difference is that, as shown in FIG. 9, in the reverse running, the intermediate image information PRM is generated by the intermediate image information generation unit 44 between steps S18 and S19, and the intermediate image information PRM is displayed on the display device 30. The displayed step (step S25) is provided. That is, the display device 30 switches to the displayed first image information PR1 to display the intermediate image information PRM, and subsequently switches to the intermediate image information PRM to display the second image information PR2.

Similarly, in the forward traveling, the intermediate image information PFM is generated by the intermediate image information generation unit 44 between the steps S7 and S8, and the intermediate image information PFM is displayed on the display device 30.
Except for the generation of the intermediate image information PRM and the intermediate image information PFM and their respective display, the same steps as those of the display control method and the program according to the first embodiment shown in FIG. 5 are provided. Omit.

(Action effect)
As described above, in each of the display control device 1, the display control system 100, the display control method, and the program according to the second embodiment, the display control device 1 and the display control system according to the second modification of the first embodiment It is possible to obtain the same effects as those obtained by each of the 100, the display control method, and the program.

Further, the display control device 1 according to the present embodiment further includes an intermediate image information generation unit 44 as shown in FIG. The intermediate image information generation unit 44 switches between the display of the first image information PR1 and the display of the second image information PR2 between the display of the first image information PR1 and the display of the second image information PR2. Generates intermediate image information PRM to be displayed on. The intermediate image information PRM includes a third image information corresponding to a third region located between the first region and the second region in the region of the image information PR.
Therefore, in the display device 30, since the second image information PR2 is displayed from the display of the first image information PR1 through the display of the intermediate image information PRM, the display is switched gradually or stepwise.

Further, since the intermediate image information PRM includes the third image information corresponding to the third region located between the first region and the second region in the region of the image information PR, the first image information PR1 It is possible to easily grasp the switching direction of the second image information PR2.
For example, in switching from the first image information PR1 that images the rear of the vehicle around the vehicle Vm shown in FIG. 1 to the second image information PR2 that images the rear left side around the vehicle Vm, the rear and rear left sides The intermediate image information PRM including the third image information captured between the and is displayed. In this case, the driver can recognize the flow of switching the display of the first image information PR1, the intermediate image information PRM, and the second image information PR2 from the rear of the vehicle to the rear left side of the display device 30.

(First modification)
The display control device 1, the display control system 100, the display control method, and the program according to the first modification of the second embodiment will be described with reference to FIG. In this first modification, the second modification and the third modification described later, a modification of the display method of the intermediate image information PRM will be described.

In the display control device 1 and the display control system 100 according to the first modification, as shown in FIG. 11, the intermediate image information generation unit 44 has an intermediate image information PRM and a first intermediate different from the intermediate image information PRM. A plurality of intermediate image information with the image information PRM1 and the second intermediate image information PRM2 is generated.
The intermediate image information PRM is a third region located between the first region and the second region of the image information PR, similarly to the intermediate image information PRM generated by the intermediate image information generation unit 44 according to the second embodiment. It is generated including the third image information corresponding to.
The first intermediate image information PRM1 is generated including a part of the first image information PR1 corresponding to the first region, and here corresponds to the left half of the first region and the right half of the third region of the image information PR. Is generated. The second intermediate image information PRM2 is generated including a part of the second image information PR2 corresponding to the second region, and here, is generated corresponding to the left half of the third region and the right half of the second region. To.
In the display device 30, when switching from the display of the first image information PR1 to the display of the second image information PR2, the first intermediate image information PRM1, the intermediate image information PRM, and the second intermediate image information PRM2 are displayed in each order. To.
Here, the intermediate image information generation unit 44 generates one intermediate image information PRM, the first intermediate image information PRM1, and the second intermediate image information PRM2, respectively, and at least one of them is generated. Two or more may be generated.

In the first modification, the display control device 1, the display control system 100, the display control method, and the program are different, except that the intermediate image information PRM, the first intermediate image information, the second intermediate image information generation method, and the display method are different. The components of are the same as those in the second embodiment. Therefore, the description of the display control device 1 and the like will be omitted here.

As described above, in each of the display control device 1, the display control system 100, the display control method, and the program according to the first modification, the display control device 1, the display control system 100, and the display control method according to the second embodiment are used. , It is possible to obtain the same effects as those obtained by each of the programs.

Further, in each of the display control device 1, the display control system 100, the display control method, and the program according to the first modification, as shown in FIG. 11, a plurality of intermediate image information PRMs are provided by the intermediate image information generation unit 44. The first intermediate image information PRM1 and the second intermediate image information PRM2 are generated and displayed on the display device 30. Therefore, when switching from the first image information PR1 to the second image information PR2, the plurality of intermediate image information PRMs, the first intermediate image information PRM1, and the second intermediate image information PRM2 are included and flow in the switching direction. Since the image information is displayed, it is possible to make it easier to grasp the switching direction.

(Second modification)
The display control device 1, the display control system 100, the display control method, and the program according to the second modification of the second embodiment will be described with reference to FIG.

In the display control device 1 and the display control system 100 according to the second modification, as shown in FIG. 12, the intermediate image information generation unit 44 generates the third intermediate image information PRM3 displayed on the display device 30. The third intermediate image information PRM3 is the first image information PR1 corresponding to the first region of the image information PR region, the second image information PR2 corresponding to the second region, and the third image information corresponding to the third region. Each is included and generated. That is, the third intermediate image information PRM3 is generated as image information captured in a wide range including the first image information PR1, the intermediate image information PRM, and the second image information PR2. Further, since the third intermediate image information PRM3 includes each of the first image information PR1 and the second image information PR2, the amount of information is larger than the amount of information of the first image information PR1 or the second image information PR2. ing.

In the second modification, only the generation method and the display method of the third intermediate image information PRM3 are different, and the respective components of the display control device 1, the display control system 100, the display control method, and the program are different from those of the second embodiment. The same is true. Therefore, the description of the display control device 1 and the like will be omitted here.

As described above, in each of the display control device 1, the display control system 100, the display control method, and the program according to the second modification, the display control device 1, the display control system 100, and the display control method according to the second embodiment are used. , It is possible to obtain the same effects as those obtained by each of the programs.

Further, in each of the display control device 1, the display control system 100, the display control method, and the program according to the second modification, the intermediate image information generation unit 44 generates the third intermediate image information PRM3 as shown in FIG. Then, the third intermediate image information PRM3 is displayed on the display device 30. Therefore, when switching from the first image information PR1 to the second image information PR2, the third intermediate image information PRM3 captured in a wide range including the first image information PR1, the second image information PR2, and the intermediate image information PRM. Is displayed on the display device 30, so that the switching direction can be more easily grasped.

(Third modification example)
The display control device 1, the display control system 100, the display control method, and the program according to the third modification of the second embodiment will be described with reference to FIG.

In the display control device 1 and the display control system 100 according to the third modification, as shown in FIG. 13, the intermediate image information generation unit 44 includes the third intermediate image information PRM3, the fourth intermediate image information PRM4, and the third intermediate image information PRM4. 5 Intermediate image information PRM5 is generated. When switching from the first image information PR1 to the second image information PR2, the intermediate image information generation unit 44 displays the display device 30 with the fourth intermediate image information PRM4, the third intermediate image information PRM3, and the fifth intermediate image information PRM5, respectively. Are displayed in sequence.

The third intermediate image information PRM3 is the same as the third intermediate image information PRM3 according to the second modification shown in FIG. 12 described above.
The fourth intermediate image information PRM4 gradually includes a part of the third image information in the third region in the first image information PR1, and further, a part of the second image information PR2 up to one step before the third intermediate image information PRM3. Is formed by a plurality of intermediate image information PRM41 to PRM4n that are gradually included and generated. That is, the fourth intermediate image information PRM4 is generated as intermediate image information that is gradually expanded from the first image information PR1 to the third intermediate image information PRM3.
On the contrary, the fifth intermediate image information PRM5 gradually removes a part of the first image information PR1 and a part of the third image information from the third intermediate image information PRM3 to just before the second image information PR2. It is formed by a plurality of intermediate image information PRM511 to PRM5n generated. That is, the fifth intermediate image information PRM5 is generated as intermediate image information that is gradually reduced from the third intermediate image information PRM3 to the second image information PR2.

In the third modification, the components of the display control device 1, the display control system 100, the display control method, and the program are the same as those in the second embodiment except that the display method of the intermediate image information PRM is different. The description here will be omitted.

As described above, in each of the display control device 1, the display control system 100, the display control method, and the program according to the third modification, the display control device 1, the display control system 100, and the display control method according to the second embodiment are used. , It is possible to obtain the same effects as those obtained by each of the programs.

Further, in each of the display control device 1, the display control system 100, the display control method, and the program according to the third modification, as shown in FIG. 13, a plurality of third intermediate image information PRM3s are generated by the intermediate image information generation unit 44. , The fourth intermediate image information PRM4, and the fifth intermediate image information PRM5 are generated. The third intermediate image information PRM3 to the fifth intermediate image information PRM5 are displayed on the display device 30 by the intermediate image information generation unit 44. In addition, the fourth intermediate image information PRM4 is gradually expanded from the first image information PR1 to the third intermediate image information PRM3, and then converges from the third intermediate image information PRM3 to the second image information PR2. It will be reduced in stages. Therefore, when switching from the first image information PR1 to the second image information PR2, the fourth intermediate image information PRM4, the third intermediate image information PRM3, and the fifth intermediate image information PRM5 are displayed so as to flow in the switching direction. In addition, since the third intermediate image information PRM3 has an impact due to enlargement / reduction, it is possible to make it easier to grasp the switching direction.

[Third Example]
The display control device 1, the display control system 100, the display control method, and the program according to the third embodiment of the present invention will be described with reference to FIG.
In the identification information generation unit 43 (see FIGS. 2 and 8) of the display control device 1 according to the present embodiment, the identification information IM (1) is generated as shown in FIG. 14 (A), and the identification information IM (see FIG. 1) is displayed on the display device 30. The identification information IM (1) is information of a mark representing the positional relationship of the second image information PR2 with respect to the first image information PR1. In this embodiment, the identification information IM (1) represents a "vehicle figure" representing the rear of the vehicle around the vehicle (own vehicle) Vm and a "positional relationship of the second image information PR2 with respect to the first image information PR1". It is formed by combining "a figure indicating a direction" up and down. The identification information IM (1) is displayed overlapping with the first image information PR1 when the first image information PR1 during normal driving is displayed on the display device 30.

In the display of the second image information PR2 shown in FIG. 7 (B) described above, as shown in FIG. 14 (B), the identification information IM (2) in which the "figure indicating the direction" is transformed to the left is the identification information. It is generated by the generation unit 43, and the identification information IM (2) is displayed overlapping with the first image information PR1. The identification information IM (2) does not necessarily have to be duplicated and displayed on the first image information PR1, and may be duplicated and displayed on the second image information PR2.
Further, when another vehicle or the like approaches from the rear right side around the vehicle Vm, the identification information IM (3) in which the "figure indicating the direction" is transformed to the right side is displayed as shown in FIG. 14 (C). It is generated by the identification information generation unit 43. Although not shown, the identification information IM (3) is displayed overlapping with the first image information PR1.
Further, in the display of the second image information PR2 shown in FIG. 3 (B) described above, as shown in FIG. 14 (D), the identification information IM in which the base of the "figure indicating the direction" is enlarged and deformed. (4) is generated by the identification information generation unit 43. Although not shown, the identification information IM (4) is displayed overlapping with the first image information PR1.

In the third embodiment, only the forms of the identification information IM (1) to IM (4) are different, and each component of the display control device 1, the display control system 100, the display control method, and the program is the first embodiment. Or, since it is the same as the second embodiment, the description here will be omitted.

As described above, in each of the display control device 1, the display control system 100, the display control method, and the program according to the third embodiment, the display control device 1 and the display control system according to the first embodiment or the second embodiment It is possible to obtain the same effects as those obtained by each of the 100, the display control method, and the program.

[Fourth Example]
Each of the display control device 1, the display control system 100, the display control method, and the program according to the fourth embodiment of the present invention will be described with reference to FIG.
As shown in FIG. 15, in the display control device 1 and the display control system 100 according to the fourth embodiment, a plurality of frames of image information PR (1), PR (2), ... PR generated at a predetermined frame rate. Image information PR is generated by each of (n-1) and PR (n). Then, the first image information PR1 is generated corresponding to the image information of different frames of the image information PR, here, the first region which is a part of each region of the image information PR (1) and PR (2). .. Further, the second image information PR2 is generated corresponding to the second region which is a part of each region of the image information PR (3) to PR (n).

In the fourth embodiment, the components of the display control device 1, the display control system 100, the display control method, and the program are the first embodiment, except that the image information PR generated by the plurality of frames is used. It is the same as the example or the second embodiment. Therefore, the description here will be omitted.

In the display control device 1 according to the present embodiment, the image information PR is generated by the image information PRs (1) to PR (n) of a plurality of frames, and all of the image information PRs are the second storage unit 8 (see FIG. 2). Is remembered in. Temporarily, the first image information PR1 is generated from each of the image information PR (1) and PR (2), and the second image information PR2 is generated from each of the image information PR (3) to PR (n). Even in such a case, even if the generation of the first image information PR1 and the second image information PR2 spans different frames of the image information PR, the usage efficiency of the image information PR is not affected.
Further, even if there is a time difference in the generation of the first image information PR1 and the second image information PR2, the driver recognizes the frame difference when the predetermined frame rate is set to, for example, 30 FPS. Is difficult. Therefore, it can be considered that the first image information PR1 and the second image information PR2 are generated in substantially the same frame of the image information PR.

[Other Examples]
The present invention is not limited to the above examples, and can be variously modified without departing from the gist thereof.
For example, in the above embodiment, the display control system includes a line-of-sight sensor and a determination unit to form a display switching unit. The display control device and the display control system may be configured to display the "undo button" on the display device by duplicating the second image information. In this case, the display unit of the display device is composed of a touch panel, and when the driver touches the "undo button" displayed on the display unit, the display device switches from the display of the second image information to the display of the first image information. be able to.
Further, in the above embodiment, the imaging device is configured to include four cameras. The display control system includes a rear camera, or a front camera and a rear camera to form an image pickup device, and generates first image information and second image information based on the image information transmitted from the image pickup device. May be good.
Further, in the above embodiment, the imaging device is configured by a wide-angle camera. This wide-angle camera includes a panoramic camera that can capture images in a 360-degree range.

1 Display control device 2, 9 Interface 3 Image information acquisition unit (acquisition unit)
4 Image information generation unit 41 1st image information generation unit 42 2nd image information generation unit 43 Identification information generation unit 44 Intermediate image information generation unit 5 Judgment unit 6 Central arithmetic processing unit 7 1st storage unit 8 2nd storage unit 10 Imaging Device 15 Image recognition unit 16 Approach sensor 17 Line-of-sight sensor 18 Display switching unit (display switching means)
30 Display device 100 Display control system Vm Vehicle PF, PR, PWR, PWL Image information PF1, PR1 First image information PF2, PR2 Second image information IM, IM (1) to IM (4) Identification information PRM, PRM1 to PRM5 Intermediate image information

Claims (14)

An acquisition unit that acquires image information that captures the surroundings of the vehicle,
A first image information generation unit that corresponds to a first area that is a part of the image information area and generates the first image information to be displayed on the display device.
A second image information generation unit that is a part of the image information area and corresponds to a second area different from the first area and generates a second image information to be displayed on the display device.
An identification information generation unit that generates identification information for identifying the positional relationship between the first image information and the second image information and displays it on the display device.
Display control unit equipped with. The display control device according to claim 1, wherein the second region includes at least a part of the first region. The display control device according to claim 1, wherein the second region does not include the first region. In switching between the display of the first image information and the display of the second image information, intermediate image information to be displayed on the display device is generated between the display of the first image information and the display of the second image information. Further equipped with an intermediate image generator
According to claim 1 or 2, the intermediate image information includes a third image information corresponding to a third region located between the first region and the second region of the image information region. The display control device described. The display control device according to any one of claims 1 to 4, further comprising a display switching means for switching from the display of the second image information to the display of the first image information. The display control according to claim 1 or 3, wherein the second image information is displayed on the display device with respect to the first image information so as to match the arrangement direction of the second region with respect to the first region. apparatus. The identification information is information on a mark that emphasizes a region corresponding to the first image information displayed on the display device, or a mark that represents the positional relationship of the second image information with respect to the first image information. The display control device according to any one of claims 1 to 6. The display control device according to any one of claims 1 to 7, further comprising a storage unit for storing the image information, the first image information, the second image information, and the identification information. Further provided with at least a storage unit for storing the image information,
The display control device according to any one of claims 1 to 7, wherein each of the first image information and the second image information can be specified in the image information stored in the storage unit. The display control device according to any one of claims 1 to 7, further comprising a storage unit for storing the first image information and the second image information displayed on the display device. A plurality of the image information is generated at a predetermined frame rate,
Claims 1 to each of the first image information and the second image information are generated corresponding to each of the first region and the second region in the same frame or different frames of the image information. The display control device according to any one of 10. An acquisition unit that acquires each of a first image information in which a part of the periphery of the vehicle is imaged, and a second image information different from the first image information in which a part of the periphery of the vehicle is imaged.
When the identification information for identifying the positional relationship between the first image information and the second image information is generated and the second image information is displayed on the display device on which the first image information is displayed, the display device An identification information generation unit that displays the identification information on the
Display control unit equipped with. The process of acquiring image information of the surroundings of the vehicle and
A step of generating the first image information to be displayed on the display device corresponding to the first area which is a part of the image information area, and
A step of generating a second image information to be displayed on the display device, which corresponds to a second area that is a part of the image information area and is different from the first area.
A step of generating identification information for identifying the positional relationship between the first image information and the second image information and displaying it on the display device.
Display control method equipped with. A program for causing a computer to execute a display control method of a display control device including an acquisition unit, a first image information generation unit, a second image information generation unit, and an identification information generation unit.
The step of acquiring the image information in which the surroundings of the vehicle are captured by the acquisition unit, and
A step of generating the first image information to be displayed on the display device by the first image information generation unit corresponding to the first area which is a part of the image information area.
A step of generating a second image information to be displayed on the display device by the second image information generation unit corresponding to a second area which is a part of the image information area and different from the first area.
A step in which the identification information generation unit generates identification information for identifying the positional relationship between the first image information and the second image information and displays it on the display device.
A program that features.