WO2022176267A1 - 表示制御装置および表示制御方法 - Google Patents
表示制御装置および表示制御方法 Download PDFInfo
- Publication number
- WO2022176267A1 WO2022176267A1 PCT/JP2021/037777 JP2021037777W WO2022176267A1 WO 2022176267 A1 WO2022176267 A1 WO 2022176267A1 JP 2021037777 W JP2021037777 W JP 2021037777W WO 2022176267 A1 WO2022176267 A1 WO 2022176267A1
- Authority
- WO
- WIPO (PCT)
- Prior art keywords
- display
- area
- vehicle
- unit
- image
- Prior art date
Links
- 238000000034 method Methods 0.000 title claims abstract description 53
- 238000001514 detection method Methods 0.000 claims abstract description 60
- 238000007906 compression Methods 0.000 claims description 156
- 230000006835 compression Effects 0.000 claims description 155
- 238000010586 diagram Methods 0.000 description 30
- 230000004048 modification Effects 0.000 description 27
- 238000012986 modification Methods 0.000 description 27
- 230000005540 biological transmission Effects 0.000 description 16
- 238000004891 communication Methods 0.000 description 10
- 230000000694 effects Effects 0.000 description 7
- 230000007423 decrease Effects 0.000 description 6
- 230000002194 synthesizing effect Effects 0.000 description 6
- 230000006870 function Effects 0.000 description 5
- 239000004973 liquid crystal related substance Substances 0.000 description 3
- 230000003287 optical effect Effects 0.000 description 2
- 240000004050 Pentaglottis sempervirens Species 0.000 description 1
- 235000004522 Pentaglottis sempervirens Nutrition 0.000 description 1
- 230000033228 biological regulation Effects 0.000 description 1
- 210000005252 bulbus oculi Anatomy 0.000 description 1
- 238000005516 engineering process Methods 0.000 description 1
- 238000000605 extraction Methods 0.000 description 1
- 239000011521 glass Substances 0.000 description 1
- 230000001151 other effect Effects 0.000 description 1
Images
Classifications
-
- B—PERFORMING OPERATIONS; TRANSPORTING
- B60—VEHICLES IN GENERAL
- B60R—VEHICLES, VEHICLE FITTINGS, OR VEHICLE PARTS, NOT OTHERWISE PROVIDED FOR
- B60R1/00—Optical viewing arrangements; Real-time viewing arrangements for drivers or passengers using optical image capturing systems, e.g. cameras or video systems specially adapted for use in or on vehicles
- B60R1/20—Real-time viewing arrangements for drivers or passengers using optical image capturing systems, e.g. cameras or video systems specially adapted for use in or on vehicles
- B60R1/22—Real-time viewing arrangements for drivers or passengers using optical image capturing systems, e.g. cameras or video systems specially adapted for use in or on vehicles for viewing an area outside the vehicle, e.g. the exterior of the vehicle
- B60R1/23—Real-time viewing arrangements for drivers or passengers using optical image capturing systems, e.g. cameras or video systems specially adapted for use in or on vehicles for viewing an area outside the vehicle, e.g. the exterior of the vehicle with a predetermined field of view
- B60R1/27—Real-time viewing arrangements for drivers or passengers using optical image capturing systems, e.g. cameras or video systems specially adapted for use in or on vehicles for viewing an area outside the vehicle, e.g. the exterior of the vehicle with a predetermined field of view providing all-round vision, e.g. using omnidirectional cameras
-
- B—PERFORMING OPERATIONS; TRANSPORTING
- B60—VEHICLES IN GENERAL
- B60R—VEHICLES, VEHICLE FITTINGS, OR VEHICLE PARTS, NOT OTHERWISE PROVIDED FOR
- B60R1/00—Optical viewing arrangements; Real-time viewing arrangements for drivers or passengers using optical image capturing systems, e.g. cameras or video systems specially adapted for use in or on vehicles
-
- G—PHYSICS
- G08—SIGNALLING
- G08G—TRAFFIC CONTROL SYSTEMS
- G08G1/00—Traffic control systems for road vehicles
- G08G1/16—Anti-collision systems
-
- G—PHYSICS
- G09—EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
- G09G—ARRANGEMENTS OR CIRCUITS FOR CONTROL OF INDICATING DEVICES USING STATIC MEANS TO PRESENT VARIABLE INFORMATION
- G09G5/00—Control arrangements or circuits for visual indicators common to cathode-ray tube indicators and other visual indicators
-
- G—PHYSICS
- G09—EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
- G09G—ARRANGEMENTS OR CIRCUITS FOR CONTROL OF INDICATING DEVICES USING STATIC MEANS TO PRESENT VARIABLE INFORMATION
- G09G5/00—Control arrangements or circuits for visual indicators common to cathode-ray tube indicators and other visual indicators
- G09G5/36—Control arrangements or circuits for visual indicators common to cathode-ray tube indicators and other visual indicators characterised by the display of a graphic pattern, e.g. using an all-points-addressable [APA] memory
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N7/00—Television systems
- H04N7/18—Closed-circuit television [CCTV] systems, i.e. systems in which the video signal is not broadcast
-
- B—PERFORMING OPERATIONS; TRANSPORTING
- B60—VEHICLES IN GENERAL
- B60R—VEHICLES, VEHICLE FITTINGS, OR VEHICLE PARTS, NOT OTHERWISE PROVIDED FOR
- B60R2300/00—Details of viewing arrangements using cameras and displays, specially adapted for use in a vehicle
- B60R2300/20—Details of viewing arrangements using cameras and displays, specially adapted for use in a vehicle characterised by the type of display used
- B60R2300/202—Details of viewing arrangements using cameras and displays, specially adapted for use in a vehicle characterised by the type of display used displaying a blind spot scene on the vehicle part responsible for the blind spot
-
- B—PERFORMING OPERATIONS; TRANSPORTING
- B60—VEHICLES IN GENERAL
- B60R—VEHICLES, VEHICLE FITTINGS, OR VEHICLE PARTS, NOT OTHERWISE PROVIDED FOR
- B60R2300/00—Details of viewing arrangements using cameras and displays, specially adapted for use in a vehicle
- B60R2300/30—Details of viewing arrangements using cameras and displays, specially adapted for use in a vehicle characterised by the type of image processing
- B60R2300/302—Details of viewing arrangements using cameras and displays, specially adapted for use in a vehicle characterised by the type of image processing combining image information with GPS information or vehicle data, e.g. vehicle speed, gyro, steering angle data
-
- B—PERFORMING OPERATIONS; TRANSPORTING
- B60—VEHICLES IN GENERAL
- B60R—VEHICLES, VEHICLE FITTINGS, OR VEHICLE PARTS, NOT OTHERWISE PROVIDED FOR
- B60R2300/00—Details of viewing arrangements using cameras and displays, specially adapted for use in a vehicle
- B60R2300/80—Details of viewing arrangements using cameras and displays, specially adapted for use in a vehicle characterised by the intended use of the viewing arrangement
- B60R2300/804—Details of viewing arrangements using cameras and displays, specially adapted for use in a vehicle characterised by the intended use of the viewing arrangement for lane monitoring
Definitions
- the present disclosure relates to a display control device and a display control method.
- an increasing number of vehicles are equipped with an electronic mirror that captures the surroundings of the vehicle with a camera and displays the captured image on a display device.
- the surroundings of the own vehicle are, for example, the rear of the own vehicle.
- the image displayed on the electronic mirror may also have blind spots on the rear and lateral sides, as in the case of checking the rear using the optical mirror. Therefore, the driver is still required to directly see the vehicle in order to check the vehicle or the like existing on the rear side. Therefore, for example, when changing lanes, the driver tends to neglect the forward gaze.
- the area displaying the rear side of the vehicle has a high compression rate, so it may be difficult for the driver to see it visually. Therefore, when the driver makes a lane change or the like, there is a possibility that the driver may overlook the vehicle existing behind the vehicle.
- the present disclosure has been made in view of the above, and aims to make it easier to visually recognize a vehicle that exists on the rear side.
- the display control device of the present disclosure includes a first detection unit that detects the number of roads indicating the number of one or more roads including the road on which the vehicle travels, and the first detection unit detects a determination unit that determines processing conditions for areas other than the required display area indicating a predetermined display area in the captured image of the surroundings of the vehicle according to the number of roads determined by the determination unit; a display control unit that processes the captured image according to the processing conditions and controls display on a display device.
- FIG. 1 is a schematic diagram showing an example of a vehicle provided with a drive recorder unit according to the first embodiment.
- FIG. 2 is a block diagram illustrating an example of the configuration of the display control system according to the first embodiment; 3 is a functional block diagram illustrating an example of a functional configuration of a microcomputer of the drive recorder unit according to the first embodiment;
- FIG. 4 is a diagram showing an example of a rear image of the own vehicle according to the first embodiment.
- FIG. 5 is an image diagram showing an example of the essential display area determination process according to the first embodiment.
- FIG. 6 is an image diagram showing an example of a clipping region determination process according to the first embodiment.
- 7 is a diagram illustrating an example of a display image according to the first embodiment;
- FIG. 8 is an image diagram showing an example of a cutout region before compression when the compression rate is changed depending on the position within the compression region according to the first embodiment.
- 9 is a diagram illustrating an example of a display image according to the first embodiment;
- FIG. 10 is a flowchart illustrating an example of processing of the drive recorder unit according to the first embodiment;
- FIG. 11 is a functional block diagram showing an example of the functional configuration of a microcomputer of the drive recorder unit according to the second embodiment;
- FIG. 12 is a diagram showing an example of a rear image of the own vehicle according to the second embodiment.
- FIG. 13 is an image diagram showing an example of a clipping region determination process according to the second embodiment.
- FIG. 14 is a diagram illustrating an example of a display image according to the second embodiment;
- FIG. 14 is a diagram illustrating an example of a display image according to the second embodiment;
- FIG. 15 is an image diagram showing an example of a cutout region before compression when the compression ratio is changed depending on the position within the compression region according to the second embodiment.
- FIG. 16 is a diagram illustrating an example of a display image according to the second embodiment; 17 is a flowchart illustrating an example of processing of the drive recorder unit according to the second embodiment;
- FIG. 18 is a diagram showing an example of a rear image of the own vehicle according to Modification 3.
- FIG. 19A and 19B are diagrams illustrating an example of a display image according to Modification 3.
- FIG. FIG. 20 is a diagram showing an example of a display image according to modification 4. As shown in FIG.
- FIG. 1 is a schematic diagram showing an example of a vehicle 5 equipped with a drive recorder unit 10 according to the first embodiment.
- the vehicle 5 of the first embodiment includes a drive recorder unit 10, a rear camera 32, and a display device 25, for example.
- Vehicle 5 may include front camera 31 and display 45 .
- An example in which the vehicle 5 includes the front camera 31 and the display 45 will be described below.
- the front camera 31 is arranged on the windshield of the vehicle 5, for example.
- the front camera 31 images the outside of the vehicle 5 and generates a forward video signal.
- the front camera 31 images the front of the vehicle 5, for example.
- the forward video signal includes, for example, forward video information.
- the front image is, for example, an image of the front of the vehicle 5 captured by the front camera 31 .
- the rear camera 32 is arranged on the rear glass of the vehicle 5, for example.
- the rear camera 32 images the outside of the vehicle 5 and generates a rearward video signal.
- the rear camera 32 images the rear of the vehicle 5, for example.
- the rear camera 32 may be capable of wide-angle photography.
- the rear video signal includes, for example, rear video information.
- the rear image is, for example, an image of the rear of the vehicle 5 captured by the rear camera 32 capable of wide-angle shooting.
- the drive recorder unit 10 is housed in the console box of the vehicle 5, for example. Processing of the drive recorder unit 10 will be described later.
- the drive recorder unit 10 is an example of a display control device.
- the display device 25 displays the rear of the vehicle 5.
- the display device 25 displays an image behind the vehicle 5, for example.
- the display device 25 is, for example, a liquid crystal display.
- the display device 25 may be, for example, a mirror-type display device modeled after a mirror for checking the rear of the vehicle 5 .
- the display device 25 is, for example, an electronic mirror.
- the display device 25 displays a rear image that has undergone predetermined processing by an electronic control unit (ECU) formed integrally with the display device 25, for example.
- the display device 25 is an electronic mirror in the form of a rear-view mirror.
- the display device 25 is described as an electronic mirror in the form of a rear-view mirror.
- the display device 25 may be an electronic mirror, for example in the form of a door mirror or fender mirror.
- the display 45 displays information about the vehicle 5.
- the display 45 displays a forward image of the vehicle 5, for example.
- the display 45 is, for example, a liquid crystal display.
- the display 45 may be, for example, a panel-type liquid crystal display embedded in an instrument panel or the like.
- the display 45 may display images from other cameras (not shown) installed on the side of the vehicle 5 or inside the vehicle. Further, the display 45 may display an image obtained by synthesizing images of a plurality of cameras capturing the outside of the vehicle, including the front camera 31 and the rear camera 32 .
- a video obtained by synthesizing videos from a plurality of cameras is, for example, an omnidirectional bird's-eye view video.
- FIG. 2 is a block diagram showing an example of the configuration of the display control system 1 according to the first embodiment.
- the display control system 1 of the first embodiment includes a drive recorder unit 10, a display unit 20, and a rear camera 32.
- the display control system 1 of the first embodiment is configured to be mountable on the vehicle 5 described above, for example.
- Display control system 1 may include front camera 31 and display unit 40 . An example in which the display control system 1 includes the front camera 31 and the display unit 40 will be described below.
- the drive recorder unit 10 includes a microcomputer 11, a serializer 13m, and a deserializer 14m.
- the drive recorder unit 10 may comprise a serializer 13p and a deserializer 14p.
- An example in which the drive recorder unit 10 includes a serializer 13p and a deserializer 14p will be described below.
- the microcomputer 11 is, for example, a computer equipped with a CPU (Central Processing Unit), ROM (Read Only Memory), and RAM (Random Access Memory).
- the microcomputer 11 is configured as an SoC (System on Chip) including, for example, an image processor 11p and a controller 11c.
- the control unit 11c controls the image processor 11p.
- the microcomputer 11 can control the serializer 13m by sending a control signal SG3 to the serializer 13m. Further, the microcomputer 11 can control the deserializer 14m by transmitting a control signal SG4 to the deserializer 14m.
- the microcomputer 11 controls the serializer 13p by transmitting a control signal SG1 to the serializer 13p. Further, the microcomputer 11 controls the deserializer 14p by transmitting a control signal SG2 to the deserializer 14p. Specifically, the control unit 11c controls the serializer 13m, the deserializer 14m, the serializer 13p, and the deserializer 14p by transmitting respective control signals.
- the microcomputer 11 transmits the control signal SG4 to the deserializer 14m to receive the image signal SGr1 from the rear camera 32.
- the video signal SGr1 received by the deserializer 14m is, for example, a serialized video signal.
- the deserializer 14m Upon receiving the control signal SG4 from the microcomputer 11, the deserializer 14m receives the video signal SGr1 transmitted from the rear camera 32. The deserializer 14m transmits the video signal SGr1 to the microcomputer 11 and the serializer 13m. The deserializer 14m may convert the received video signal SGr1 into parallel data and then transmit the parallel data.
- the microcomputer 11 transmits the control signal SG2 to the deserializer 14p to receive the image signal SGf1 from the front camera 31.
- the video signal SGf1 received by the deserializer 14p is, for example, a serialized video signal.
- the deserializer 14p Upon receiving the control signal SG2 from the microcomputer 11, the deserializer 14p receives the video signal SGf1 transmitted from the front camera 31. The deserializer 14p transmits the video signal SGf1 to the microcomputer 11. FIG. The deserializer 14p may convert the received video signal SGf1 into parallel data and then transmit the parallel data.
- the microcomputer 11 receives the rear video signal generated by the rear camera 32 from the deserializer 14m as the video signal SGr1. Specifically, the image processor 11p receives the video signal SGr1 from the deserializer 14m.
- the image processor 11p performs video processing such as clipping processing and compression processing, which will be described later, on the video signal SGr1 to generate a video signal SGr2.
- the image signal SGr2 is a signal for displaying a rear image that has undergone image processing.
- the image processor 11p transmits the video signal SGr2 to the serializer 13m.
- the microcomputer 11 transmits the video signal SGr2 to the serializer 13m.
- the microcomputer 11 may convert the video signal SGr2 into parallel data and transmit the parallel data to the serializer 13m.
- the microcomputer 11 receives the front video signal generated by the front camera 31 from the deserializer 14p as the video signal SGf1. Specifically, the image processor 11p receives the video signal SGf1 from the deserializer 14p.
- the image processor 11p applies image processing such as color and contrast adjustment to the image signal SGf1 to generate the image signal SGf2.
- the image processor 11p transmits the video signal SGf2 and the video signal SGr2 to the serializer 13p.
- the microcomputer 11 transmits the video signal SGf2 and the video signal SGr2 to the serializer 13p.
- the microcomputer 11 may convert the video signal SGf2 and the video signal SGr2 into parallel data and transmit the parallel data to the serializer 13p.
- the serializer 13m Upon receiving the control signal SG3 from the microcomputer 11, the serializer 13m transmits the video signal SGr2 received from the microcomputer 11 to the display unit 20. For example, when the serializer 13m receives the video signal SGr2 converted into parallel data from the microcomputer 11, the serializer 13m may transmit the video signal SGr2 after converting it into serial data.
- the microcomputer 11 controls the serializer 13p to transmit the video signal SGf2 and the video signal SGr2 to the display unit 40 by transmitting the control signal SG1.
- the serializer 13p Upon receiving the control signal SG1 from the microcomputer 11, the serializer 13p transmits the video signal SGf2 and the video signal SGr2 received from the microcomputer 11 to the display unit 40. For example, when the serializer 13p receives the video signal SGf2 and the video signal SGr2 converted into parallel data from the microcomputer 11, it may convert the data into serial data and then transmit the video signal SGf2.
- Transmission of the control signal SG1 from the microcomputer 11 to the serializer 13p, transmission of the control signal SG2 to the deserializer 14p, transmission of the control signal SG3 to the serializer 13m, and transmission of the control signal SG4 to the deserializer 14m are performed, for example, by I2C (Inter-Integrated Circuit) format.
- MIPI Mobile Industry Processor Interface
- transmission of the video signal SGr1 from the rear camera 32 to the deserializer 14m, transmission of the video signal SGr2 from the serializer 13m to the display unit 20, transmission of the video signal SGf1 from the front camera 31 to the deserializer 14p, and transmission of the video signal SGf1 from the serializer 13p The transmission of the video signal SGf2 and the video signal SGr2 to the display unit 40 is performed, for example, in the FPD-Link III (Flat Panel Display-Link III) format.
- FPD-Link III Full Panel Display-Link III
- video transmissions may be performed by wired communication or by wireless communication.
- video transmission may be performed by wired communication using a coaxial cable.
- video transmission may be performed by wireless communication using Wi-Fi (registered trademark).
- the display unit 40 includes a display 45.
- the display unit 40 is configured as part of, for example, an in-vehicle infotainment (IVI) system.
- IVI in-vehicle infotainment
- the display unit 40 transmits the received video signal SGf2 and video signal SGr2 to the display 45 .
- the display 45 can display a forward image based on the received image signal SGf2. Also, the display 45 can display a rear image based on the received image signal SGr2.
- the display unit 20 includes a display device 25.
- the display unit 20 may include an ECU (Electronic Control Unit) 21 .
- ECU21 is a computer provided with CPU, ROM, and RAM, for example.
- the display unit 20 transmits the received video signal SGr2 to the ECU 21.
- the ECU 21 performs image processing on the image signal SGr2.
- Video processing is, for example, color and contrast adjustments made suitable for display on display device 25 .
- the video signal SGr2 subjected to video processing by the ECU 21 is transferred to the display device 25.
- the display device 25 displays a rear image, which is an image generated based on the image signal SGr2.
- FIG. 3 is a functional block diagram showing an example of the functional configuration of the microcomputer 11 of the drive recorder unit 10 according to the first embodiment.
- the microcomputer 11 of the drive recorder unit 10 expands the control program stored in the ROM of the microcomputer 11 into the RAM, and causes the CPU and the image processor 11p to operate, thereby obtaining the acquisition unit 111 shown in FIG.
- the detection unit 112, the first determination unit 113, the second determination unit 114, the generation unit 115, and the display control unit 116 are implemented as functional units.
- the acquisition unit 111 acquires a photographed image of an area around the own vehicle including the rear side of the own vehicle. In the present disclosure, "obtaining” also includes receiving transmitted information, signals, images, and the like. Specifically, the acquisition unit 111 acquires the rear image generated by the rear camera 32 . For example, the acquisition unit 111 acquires the video signal SGr1. Acquisition unit 111 also acquires a forward image generated by front camera 31 . For example, the acquisition unit 111 acquires the video signal SGf1.
- FIG. 4 is a diagram showing an example of a rear image of the own vehicle captured by the rear camera 32 according to the first embodiment.
- Vehicle A1, vehicle A2, lane B1, lane B2, and lane B3 are drawn in the rear image D shown in FIG.
- the rear image D is an image captured by the wide-angle rear camera 32 behind the vehicle traveling on the lane B2.
- the vehicle A1 is traveling in the same lane B2 as the own vehicle, and the vehicle A2 is traveling in the lane B3 on the left of the own vehicle.
- the first detection unit 112 detects the number of roads, which is one or more roads including the road on which the vehicle is traveling.
- the number of roads represents the total number of lanes on which vehicles travel and sidewalks on which pedestrians walk. In other words, roads include lanes and sidewalks.
- the first detection unit 112 detects the number of roads by detecting a lane change line, a boundary between a roadway and a sidewalk, or the like from the rear image acquired by the acquisition unit 111 .
- a rear image is an example of a captured image.
- the boundary between the roadway and the sidewalk is, for example, a curb.
- the first detection unit 112 detects that the number of roads is "3" because there are three lanes, lane B1, lane B2, and lane B3.
- the first detection unit 112 may not count the number of lanes for vehicles traveling in the opposite direction to the own vehicle as the number of roads.
- the lane for vehicles traveling in the opposite direction to the own vehicle may be referred to as an oncoming lane.
- the median strip or center line in the rear image is detected, and it is determined whether the lane is the oncoming lane from the positional relationship between the median strip or the center line and the lane. method. Further, for example, it may be determined whether or not the lane is the oncoming lane from the traveling direction of the vehicle traveling in the lane in the rear image.
- the positioning signal which is a signal indicating the position of the vehicle 5, transmitted from an artificial satellite in the sky
- information about the lane is acquired, and it is determined whether or not the lane is an oncoming lane.
- the first detection unit 112 detects the number of roads from the captured image acquired by the acquisition unit 111, but the first detection unit 112 detects the number of roads based on the reception result of the positioning signal. You may
- the first detection unit 112 may detect the number of roads by performing road-to-vehicle communication and acquiring information about roads.
- the first determination unit 113 determines the clipping area according to the number of roads detected by the first detection unit 112 .
- First decision unit 113 is an example of a decision unit.
- the clipping area is an area displayed on the display device 25 in the captured image. Determination of the clipping region is an example of processing conditions.
- the first determining unit 113 first determines a required display area indicating a predetermined area in the rear image acquired by the acquiring unit 111 .
- the essential display area is determined by first determination unit 113 according to predetermined conditions.
- the conditions for determining the mandatory display area can be freely set as long as they meet the provisions regarding the field of view of Regulation 46 (UN-R46: United Nations-Regulation 46) established by the United Nations.
- the provisions of UN-R46 regarding the field of view are: ⁇ The field of view shall be a flat horizontal part of the road at least 20m wide centered on the vertical longitudinal median plane of the vehicle and 60m behind the driver's eyeball point to the horizon. shall be visible.”
- FIG. 5 is an image diagram showing an example of the required display area determination process according to the first embodiment.
- the first determination unit 113 determines a predetermined area (the area within the black frame) in the rear image D as the required display area E.
- a predetermined area the area within the black frame
- the first determination unit 113 determines a clipping area including the essential display area E according to the number of roads detected by the first detection unit 112 . For example, the first determination unit 113 determines a cutout region centering on the essential display region E based on a table that associates the number of roads detected by the first detection unit 112 with the size of the cutout region.
- the number of roads is too large, there is a possibility that the cropped area will become too large. It may be arranged so that it does not become
- FIG. 6 is an image diagram showing an example of the clipping area determination process according to the first embodiment.
- the first determination unit 113 determines the size of the cutout region corresponding to the number of roads “3” detected by the first detection unit 112 .
- the first determining unit 113 determines a clipping area C centered on the essential display area E. As shown in FIG.
- the cut-out area C is composed of an essential display area E, a left area L located on the left side of the essential display area E on the image, and a right area R located on the right side of the essential display area E on the image.
- the second determination unit 114 determines processing conditions for areas other than the essential display area within the cropped area of the captured image of the surroundings of the vehicle, according to the number of roads detected by the first detection unit 112 .
- the area other than the essential display area in the cropped area of the captured image may be referred to as the compression target area.
- Second decision unit 114 is an example of a decision unit. Note that the second determination unit 114 may also function as the first determination unit 113 described above. Also, the first determining unit 113 may also function as the second determining unit 114 .
- the second determining unit 114 determines the compression ratio of the display in the vehicle width direction for the compression target area and within the clipping area according to the number of roads detected by the first detecting unit 112 .
- the areas to be compressed are the left area L and the right area R.
- the compression ratio of the display in the vehicle width direction refers to how much the photographed image is compressed in the vehicle width direction and displayed.
- the second determination unit 114 determines the compression rate of the compression target area within the clipped area based on a table that associates the number of roads detected by the first detection unit 112 with the compression rate.
- the second determination unit 114 determines the compression rate corresponding to the number of roads "3" detected by the first detection unit 112 as the compression rate of the left area L and the right area R.
- the second determining unit 114 determines to compress the left region L and the right region R by a factor of two in the vehicle width direction, for example.
- Generation unit 115 generates a display image to be displayed on a display device by processing the captured image according to the processing conditions determined by first determination unit 113 and second determination unit 114 .
- the generation unit 115 first cuts out the cutout region C determined by the first determination unit 113 from the rear image D. Next, the generation unit 115 performs processing for compressing the left region L and the right region R of the clipped region C according to the compression rate determined by the second determination unit 114, and generates a display image to be displayed on the display device 25. do. For example, the generation unit 115 performs a process of compressing the left region L and the right region R by a factor of two in the vehicle width direction.
- the display image here is, for example, an image displayed based on the video signal SGr2.
- the generation unit 115 performs image processing such as adjustment of color and contrast on the forward image acquired by the acquisition unit 111 to generate a display image.
- the display image here is, for example, an image displayed based on the video signal SGf2.
- the display control unit 116 processes the captured image according to the processing conditions determined by the first determination unit 113 and the second determination unit 114, and controls display on the display device. Specifically, the display control unit 116 controls the display device 25 to display the display image generated by the generation unit 115 . Further, the display control unit 116 performs control to display the display image generated by the generation unit 115 on the display 45 .
- FIG. 7 is an example of a display image displayed on the display device 25 according to the first embodiment.
- the display image W is composed of a left compressed area LP, a mandatory display area E, and a right compressed area RP.
- the essential display area E is displayed on the display device 25 by the display control unit 116 at the same scale as the rear image D.
- FIG. 7 is an example of a display image displayed on the display device 25 according to the first embodiment.
- the display image W is composed of a left compressed area LP, a mandatory display area E, and a right compressed area RP.
- the essential display area E is displayed on the display device 25 by the display control unit 116 at the same scale as the rear image D.
- the left compressed area LP is an area obtained by compressing the left area L of the cutout area C in FIG. 6 twice in the vehicle width direction.
- the right compressed region RP is a region obtained by compressing the right region R of the clipped region C of FIG. 6 by a factor of two in the vehicle width direction. 7 are drawn for convenience of explanation, and are not displayed in the display image W actually displayed on the display device 25. As shown in FIG.
- the second determining unit 114 determines that the compression target area of the cutout area C is uniformly compressed by a factor of two in the vehicle width direction. may For example, the second determining unit 114 may determine the compression rate so that the compression rate of the compressed region increases stepwise from the center of the clipped region C toward the outside.
- FIG. 8 is an image diagram showing an example of a cutout area before compression when the compression rate is changed according to the position within the compression area according to the first embodiment.
- the clipping area C is composed of a first left area L1, a second left area L2, an essential display area E, a first right area R1, and a second right area R2.
- the first detection unit 112 and the first determination unit 113 are assumed to perform the same processing as the processing described with reference to FIGS. 5 and 6 .
- the second determining unit 114 determines the compression rate and corresponding to the number of roads "3" detected by the first detecting unit 112. For example, second determining portion 114 compresses first left region L1 and first right region R1 by a factor of two in the vehicle width direction, and compresses second left region L2 and second right region R2 by four in the vehicle width direction. Decide to compress twice.
- the generation unit 115 cuts out the cutout region C according to the determination of the first determination unit 113 . Then, generation unit 115 doubles first left region L1 and first right region R1 of clipped region C in the vehicle width direction according to the compression ratio determined by second determination unit 114, 2 A display image W to be displayed on the display device 25 is generated by performing a process of compressing the right side region R2 by a factor of four in the vehicle width direction.
- the display control unit 116 displays the display image W generated by the generation unit 115 on the display device 25 .
- FIG. 9 is an example of a display image displayed on the display device 25 according to the first embodiment.
- the display image W is composed of a first left compressed area LP1, a second left compressed area LP2, an essential display area E, a first right compressed area RP1 and a second right compressed area RP2.
- the essential display area E is displayed on the display device 25 by the display control unit 116 at the same scale as the rear image D.
- the first left side compressed area LP1 is an area obtained by compressing the first left side area L1 of the cutout area C in FIG. 8 twice in the vehicle width direction.
- the second left side compressed area LP2 is an area obtained by compressing the second left side area L2 four times in the vehicle width direction.
- the first right side compressed region RP1 is a region obtained by compressing the first right side region R1 twice in the vehicle width direction.
- the second right side compressed region RP2 is a region obtained by compressing the second right side region R2 four times in the vehicle width direction. 9 are drawn for convenience of explanation, and are not displayed in the display image W actually displayed on the display device 25. As shown in FIG.
- the second determining unit 114 determines the compression rate of the captured image so that the compression rate in the vehicle width direction gradually increases from the inside to the outside of the own vehicle. can be displayed with a scale close to the rear image D, and a region far from the host vehicle can be displayed with a higher compression ratio. As a result, the display image W can be displayed without reducing the visibility of areas of high importance to the user while reducing blind spots.
- the second determining unit 114 may determine whether the compression rate is uniform or varies for each region according to the number of roads. For example, when the number of roads is 3 or less, the second determination unit 114 sets the compression ratio uniformly as shown in FIG. good.
- FIG. 10 is a flowchart showing an example of processing executed by the drive recorder unit 10 according to the first embodiment.
- the acquisition unit 111 acquires a rear image generated by the rear camera 32 as a captured image (step S1).
- the first detection unit 112 detects the number of roads based on the rear image acquired by the acquisition unit 111 (step S2).
- the first determination unit 113 determines the required display area for the rear image. Then, the first determining unit 113 determines a clipping area around the required display area according to the number of roads detected by the first detecting unit 112 (step S3).
- the second determining unit 114 determines the compression ratio of the compression target area in the cropped area according to the number of roads detected by the first detecting unit 112 (step S4).
- the generation unit 115 cuts out the cut-out region determined by the first determination unit 113 from the rear image. Then, according to the compression rate determined by the second determination unit 114, the generation unit 115 performs processing for compressing the compression target area in the cut-out area in the vehicle width direction, and generates a display screen for display on the display device 25. (Step S5).
- the display control unit 116 controls the display device 25 to display the display image generated by the generation unit 115 (step S6).
- the display control unit 116 determines whether or not to end the display of the display image (step S7). For example, the display control unit 116 determines to end the display when a predetermined time has passed since the power source such as the engine of the vehicle 5 was stopped.
- step S7: No If the display of the display image is not finished (step S7: No), the process proceeds to step S1. On the other hand, if the display of the display image is to end (step S7: Yes), the display control unit 116 ends this process.
- the drive recorder unit 10 according to the present embodiment displays the above-mentioned essential display area in the photographed image of the surroundings of the vehicle according to the number of roads indicating the number of roads including one or more roads on which the vehicle travels. Determine processing conditions for areas other than
- the second determining unit 114 determines the processing conditions so that the compression rate is increased in proportion to the number of roads. Therefore, if the number of roads is small, the compression ratio will be low. Therefore, it is possible to prevent a situation in which a photographed image is compressed at a high compression rate even though the number of roads is small, making it difficult to visually recognize a vehicle on the rear side. That is, according to the drive recorder unit 10 according to the present embodiment, it is possible to easily visually recognize a vehicle or the like existing on the rear side.
- the drive recorder unit 10 according to the second embodiment differs from the drive recorder unit 10 according to the first embodiment in that it includes a second detection section 117 as a functional section.
- the drive recorder unit 10 according to the second embodiment will be described below with reference to FIGS. 11 to 20.
- FIG. Configurations and operations that are the same as those described in the first embodiment will be omitted or simplified by using the same reference numerals.
- FIG. 11 is a functional block diagram showing an example of the functional configuration of the microcomputer 11 of the drive recorder unit 10 according to the second embodiment.
- the drive recorder unit 10 according to the second embodiment further includes a second detection section 117 in addition to the functional sections included in the drive recorder unit 10 according to the first embodiment.
- the second detection unit 117 detects the running position of the own vehicle.
- the second detection unit 117 is an example of a detection unit. Specifically, the second detection unit 117 detects the lane change line, the boundary between the roadway and the sidewalk, and the like from the rear image acquired by the acquisition unit 111, and detects the positional relationship in the rear image to determine whether the vehicle is running. Detect position.
- the second detection unit 117 detects the running position of the own vehicle from the captured image acquired by the acquisition unit 111. It is also possible to detect the running position of the own vehicle. Further, the second detection unit 117 may perform road-to-vehicle communication with equipment installed on the road, and detect the running position of the own vehicle based on the communication result or the like.
- the communication results include, for example, communication speed and signal strength.
- the second detection unit 117 may also function as the first detection unit 112 described above. Also, the first detection unit 112 may also function as the second detection unit 117 .
- FIG. 12 is a diagram showing an example of a rear image of the own vehicle captured by the rear camera 32 according to the second embodiment.
- Vehicle A1, vehicle A2, lane B1, lane B2, and lane B3 are drawn in the rear image D shown in FIG.
- the rear image D is an image captured by the wide-angle rear camera 32 behind the vehicle traveling on the lane B1.
- the vehicle A1 is traveling on the lane B1 like the own vehicle, and the vehicle A2 is traveling on the lane B3.
- the second detection unit 117 detects from the positional relationship among lanes B1, B2, and B3 in the rear image D that the vehicle is traveling in the "leftmost lane in the image.” detect.
- the leftmost lane on the image is lane B1.
- the first determination unit 113 determines the clipping area according to the number of roads detected by the first detection unit 112 and the traveling position of the own vehicle detected by the second detection unit 117 .
- the first determining unit 113 performs the same processing as in the first embodiment to determine the size of the clipping region. Next, the first determination unit 113 determines how to cut out the cut-out region according to the traveling position of the own vehicle detected by the second detection unit 117 .
- the first determining unit 113 determines how to cut out such that the left end of the required display area and the left end of the cut-out area match.
- FIG. 13 is an image diagram showing an example of the extraction region determination process according to the second embodiment.
- the first determining unit 113 determines that the traveling position of the host vehicle detected by the second detecting unit 117 is the “leftmost lane on the image”, and the left end of the essential display area E is displayed. and the left end of the clipping region C are determined.
- the cutout area C is composed of the required display area E and the compression target area O located on the right side of the required display area E on the video.
- the second determination unit 114 determines processing conditions for areas other than the essential display area in the captured image according to the number of roads detected by the first detection unit 112 and the traveling position of the own vehicle detected by the second detection unit 117. decide.
- the second determination unit 114 for example, based on a table that associates the number of roads detected by the first detection unit 112, the traveling position detected by the second detection unit 117, and the compression method including the compression rate, cuts out Determines the compression method for the compression target area in the area.
- the driving position is expressed numerically, for example, the leftmost lane or sidewalk that can be confirmed in the captured image is "1", and the left lane is "2".
- the compression method indicates, for example, the compression rate of the area on the left side of the mandatory display area and the compression rate of the area on the right side of the mandatory display area. In addition to this, the compression method may determine whether or not to change the compression rate in stages.
- the second determining unit 114 increases the compression rate of the left area of the mandatory display area and decreases the compression rate of the right area. It should be noted that the second determining unit 114 may determine the right or left compression rate to be "no display”. The display device 25 does not display the area for which the second determination unit 114 has determined that the compression rate is “no display”. Determining the compression ratio of the right or left area as "no display” can be rephrased as compressing the right or left area at an infinite compression ratio.
- the second determining unit 114 selects the compression method corresponding to the number of roads “3” detected by the first detection unit 112 and the travel position “1” detected by the second detection unit 117 as the compression target region. Determine the O compression method. For example, the second determining unit 114 determines that the left side of the mandatory display area E is not displayed, and that the right side of the mandatory display area E is doubled in the vehicle width direction. The travel position "1" is the leftmost lane on the video as described above.
- FIG. 14 is an example of a display image displayed on the display device 25 according to the second embodiment.
- the display image W is composed of a mandatory display area E and a compressed display area OP.
- the essential display area E is displayed on the display device 25 by the display control unit 116 at the same scale as the rear image D.
- FIG. 14 is an example of a display image displayed on the display device 25 according to the second embodiment.
- the display image W is composed of a mandatory display area E and a compressed display area OP.
- the essential display area E is displayed on the display device 25 by the display control unit 116 at the same scale as the rear image D.
- the compressed display area OP is an area obtained by compressing the compression target area O on the right side of the clipped area C in FIG. 13 by a factor of two in the vehicle width direction. 13 are drawn for convenience of explanation, and are not displayed in the display image W actually displayed on the display device 25. As shown in FIG.
- the second determining unit 114 uniformly compresses the compression target area of the cutout area C by a factor of two in the vehicle width direction. Compression ratios may differ. For example, the second determining unit 114 may determine the compression rate so that the compression rate of the compressed region increases stepwise from the center of the clipped region C toward the outside.
- FIG. 15 is an image diagram showing an example of a cutout area before compression when the compression ratio is changed according to the position within the compression area according to the second embodiment.
- the cutout area C is composed of a mandatory display area E, a first compression target area O1, and a second compression target area O2.
- the first detection unit 112, the second detection unit 117, and the first determination unit 113 perform the same processing as the processing described with reference to FIG.
- the second determination unit 114 determines the compression method corresponding to the number of roads "3" detected by the first detection unit 112 and the travel position "1" detected by the second detection unit 117. For example, the second determining unit 114 determines to compress the first compression target region O1 by a factor of two in the vehicle width direction, and to compress the second compression target region O2 by a factor of four in the vehicle width direction.
- the generation unit 115 cuts out the cutout region C according to the determination of the first determination unit 113 . Then, according to the compression method determined by the second determination unit 114, the generation unit 115 doubles the first compression target region O1 of the clipped region C in the vehicle width direction, and 4 times the second compression target region O2 in the vehicle width direction. A double compression process is performed to generate a display image W to be displayed on the display device 25 .
- the display control unit 116 displays the display image W generated by the generation unit 115 on the display device 25 .
- FIG. 16 is an example of a display image displayed on the display device 25.
- the display image W is composed of a mandatory display area E, a first compressed display area OP1, and a second compressed display area OP2.
- the essential display area E is displayed on the display device 25 by the display control unit 116 at the same scale as the rear image D.
- FIG. 16 is an example of a display image displayed on the display device 25.
- the display image W is composed of a mandatory display area E, a first compressed display area OP1, and a second compressed display area OP2.
- the essential display area E is displayed on the display device 25 by the display control unit 116 at the same scale as the rear image D.
- the first compressed display area OP1 is an area obtained by compressing the first compression target area O1 of the cutout area C of FIG. 15 twice in the vehicle width direction.
- the second compressed display area LP2 is an area obtained by compressing the second compression target area O2 four times in the vehicle width direction.
- a frame such as a black frame in FIG. 15 is drawn for convenience of explanation, and the frame is not displayed in the display image W actually displayed on the display device 25 .
- the second determination unit 114 may determine the compression method for each region according to the number of roads and the travel position. For example, when the number of roads is 3 or less, the second determination unit 114 sets the compression ratio uniformly as shown in FIG. good.
- the second determining unit 114 may change the compression method between the left side and the right side of the essential display area according to the travel position. For example, in the clipping region, if the right region of the required display region is larger than the left region, the second determining unit 114 determines the compression rate so that the compression rate of the right region is higher than that of the left region. may The second determining unit 114, for example, compresses the left area by a factor of two in the vehicle width direction, compresses an area on the right side that is close to the required display area by a factor of two in the vehicle width direction, and compresses the area on the right side by a factor of two in the vehicle width direction. It may be determined that an area far from the required display area is compressed four times in the vehicle width direction.
- FIG. 17 is a flowchart showing an example of processing executed by the drive recorder unit 10 according to the second embodiment.
- the acquisition unit 111 acquires the rearward image generated by the rear camera 32 as a captured image (step S11).
- the first detection unit 112 detects the number of roads based on the rear image acquired by the acquisition unit 111 (step S12).
- the second detection unit 117 detects the travel position based on the rear image acquired by the acquisition unit 111 (step S13).
- the first determination unit 113 determines the required display area for the rear image. Then, the first determination unit 113 determines the size of the clipping region and the clipping method according to the number of roads detected by the first detection unit 112 and the traveling position detected by the second detection unit 117 (step S14).
- the second determination unit 114 determines a compression method for the compression target area according to the number of roads and the traveling position detected by the first detection unit 112 (step S15).
- the generation unit 115 cuts out the cut-out region determined by the first determination unit 113 from the rear image. Then, according to the compression method determined by the second determination unit 114, the generation unit 115 performs processing for compressing the compression target area in the vehicle width direction, and generates a display screen for display on the display device 25 (step S16). .
- the display control unit 116 controls the display device 25 to display the display image generated by the generation unit 115 (step S17).
- the display control unit 116 determines whether or not to end the display of the display image (step S18). For example, the display control unit 116 determines to end the display when a predetermined time has passed since the power source such as the engine of the vehicle 5 was stopped.
- step S18: No If the display of the display image is not finished (step S18: No), the process proceeds to step S11. On the other hand, if the display of the display image is to end (step S18: Yes), the display control unit 116 ends this process.
- the drive recorder unit 10 according to the present embodiment determines processing conditions for areas other than the essential display area according to the travel position of the host vehicle.
- the second determination unit 114 increases the compression ratio of the left area of the mandatory display area, and increases the compression ratio of the right area. Decrease compression ratio. This is because when the own vehicle is traveling in the leftmost lane, there is no vehicle or the like on the left side of the own vehicle, so there is little need to pay attention to the left side of the own vehicle. On the other hand, since there is a possibility that a vehicle or the like exists on the right side of the own vehicle, it is highly necessary to pay attention.
- the drive recorder unit 10 can display only the highly important portion in a state of low compression rate that makes it easy to see. In other words, it is possible to make it easier to visually recognize a vehicle or the like existing on the rear side.
- the display control system 1 is configured by the drive recorder unit 10, the display unit 20, the front camera 31, the rear camera 32, and the display unit 40.
- the display control system 1 may be composed only of the display unit 20 and the rear camera 32 .
- the ECU 21 of the display unit 20 expands the control program stored in the ROM of the ECU 21 into the RAM and causes the CPU to operate, thereby realizing each functional unit.
- the ECU 21 implements, for example, an acquisition unit 111, a first detection unit 112, a first determination unit 113, a second determination unit 114, a generation unit 115, and a display control unit 116 included in the microcomputer 11 as functional units.
- Mode 2 In the first embodiment and the second embodiment described above, the form in which the compressed backward image is displayed on the display device 25 has been described. However, the display control unit 116 may perform control to display the compressed rear image on the display 45 . Further, the display control unit 116 may perform control to display the compressed rear image on a head-up display (HUD) or the like mounted on the vehicle 5 .
- HUD head-up display
- the generation unit 115 places an image of the front left side of the own vehicle cut out from the forward video on the left side of the compressed rear video, and an image of the front right side of the own vehicle cut out from the front video on the right side.
- a display image to be displayed on the display device 25 is generated by synthesizing the images.
- the generation unit 115 may detect a pedestrian or a bicycle from the front image, and generate a display image to be displayed on the display device 25 by synthesizing the front image with the rear image only when there is a pedestrian or bicycle. good. Further, the generation unit 115 may generate a display screen by synthesizing the rear image and the front image, with only the roadway as the display target for the rear image and only the sidewalk as the display target for the front image.
- the generation unit 115 generates a display image in which the rear image and the front image are synthesized, so that the user can obtain both rear and front information from one screen. This makes it easier for the user to visually recognize the surroundings of the own vehicle, thereby reducing the possibility of an accident occurring.
- Mode 4 In the above-described second embodiment, the mode in which the second determination unit 114 determines the compression method of the captured image based on the number of roads and the travel position has been described. However, in addition to these, the second determination unit 114 may determine the compression method based on the presence or absence of a vehicle or the like.
- the vehicle includes a two-wheeled vehicle.
- the second determining unit 114 of this modified example increases the compression ratio of areas where other vehicles and the like do not exist in the captured image.
- FIG. 18 is a diagram showing an example of a rear image of the own vehicle according to Modification 3.
- FIG. 18 In the example of FIG. 18, no vehicle exists in the area ON, and a vehicle A2 exists in the area OE.
- the second determining unit 114 increases the compression rate of the area ON and makes the compression rate of the area OE lower than that of the area ON.
- FIG. 19 is an example of a display image displayed on the display device 25 according to Modification 3.
- the display image W is composed of a mandatory display area E, a high compression area NP and a low compression area EP.
- the essential display area E is displayed on the display device 25 by the display control unit 116 at the same scale as the rear image D.
- FIG. 19 is an example of a display image displayed on the display device 25 according to Modification 3.
- the display image W is composed of a mandatory display area E, a high compression area NP and a low compression area EP.
- the essential display area E is displayed on the display device 25 by the display control unit 116 at the same scale as the rear image D.
- the high compression area NP is an area obtained by compressing the area ON of the cutout area C in FIG. 18 four times in the vehicle width direction.
- the low compression area EP is an area obtained by compressing the area OE of the clipped area C of FIG. 18 twice in the vehicle width direction. 19 are drawn for convenience of explanation, and are not displayed in the display image W actually displayed on the display device 25. As shown in FIG.
- the second determining unit 114 sets a high compression rate for areas where vehicles and the like do not exist, and a low compression rate for areas where vehicles and the like exist. Makes the target easier to see. Therefore, the drive recorder unit 10 of this modified example can make it easier to visually recognize a vehicle or the like existing on the rear side.
- the first determination unit 113 and the second determination unit 114 may determine the processing conditions for the captured image in conjunction with the user's operation of the direction indicator.
- the first determination unit 113 of this modified example determines the clipping area according to the user's operation. For example, the first determining unit 113 predetermines the size of the clipping region and the clipping method when the direction indicator points to the left, and the size and clipping method of the clipping region when the direction indicator points to the right. Then, the clipping area is determined according to the user's operation.
- the second determination unit 114 determines the compression rate of the compression target area in conjunction with the user's operation of the direction indicator. For example, the second determining unit 114 determines the processing condition so that the compression ratio of the area indicated by the direction indicator is low, with reference to the essential display area.
- the first determining unit 113 determines the size of the clipping region and the clipping method when the direction indicator points to the right. In this example, the first determining unit 113 determines the essential display area E and the right area R in FIG.
- the second determining unit 114 reduces the compression ratio of the side indicated by the direction indicator on the video.
- the second determining unit 114 decreases the compression ratio of the right area R in FIG. 7 and determines no compression.
- FIG. 20 is an example of a display image displayed on the display device 25 according to Modification 4.
- FIG. in the example of FIG. 20, the display image W is composed of a mandatory display area E and a right area R.
- the required display area E and the right area R are displayed on the display device 25 at the same scale as the rear image D by the display control unit 116 . 20 are drawn for convenience of explanation, and are not displayed in the display image W actually displayed on the display device 25.
- FIG. 20 is an example of a display image displayed on the display device 25 according to Modification 4.
- the display image W is composed of a mandatory display area E and a right area R.
- the required display area E and the right area R are displayed on the display device 25 at the same scale as the rear image D by the display control unit 116 . 20 are drawn for convenience of explanation, and are not displayed in the display image W actually displayed on the display device 25.
- the second determination unit 114 reduces the compression rate of the side indicated by the direction indicator on the image, so that, for example, when the user turns right or changes lanes to the right lane, the left rear becomes easier to see. That is, according to this modified example, it is possible to make it easier to visually recognize a vehicle or the like existing on the rear side.
- the first determination unit 113 and the second determination unit 114 may determine the processing conditions for the captured image in conjunction with the user's operation of the steering wheel.
- the first determination unit 113 of this modified example determines the clipping area according to the user's operation. For example, the first determining unit 113 determines in advance the size and method of clipping when the steering wheel is turned to the left and the size and method of clipping when the steering wheel is turned to the right. Determines the clipping area according to the operation of .
- whether or not the steering wheel is turned left or right is determined, for example, by whether or not the steering angle exceeds a threshold.
- the second determining unit 114 determines the compression rate of the compression target area in conjunction with the user's operation of the handle. For example, the second determining unit 114 determines the processing condition so that the compression ratio of the area on the side where the steering wheel is turned is low, with reference to the mandatory display area.
- the first determining unit 113 determines the size of the clipping region and the clipping method when the steering wheel is turned to the right. In this example, the first determining unit 113 determines the essential display area E and the right area R in FIG.
- the second determining unit 114 lowers the compression rate on the side of the image where the steering wheel is turned.
- the second determining unit 114 decreases the compression ratio of the right area R in FIG. 7 and determines no compression. Since the image of the display image is the same as that of Modification 4, illustration and description are omitted.
- the second determination unit 114 reduces the compression rate on the side where the steering wheel is turned on the image, so that, for example, when the user turns right or changes lanes to the right lane, the left rear Easier to see. That is, according to this modified example, it is possible to make it easier to visually recognize a vehicle or the like existing on the rear side.
- the first determination unit 113 and the second determination unit 114 may determine the processing conditions for the captured image in conjunction with the movement of the user's line of sight.
- the first determination unit 113 of this modified example determines the clipping region according to the movement of the user's line of sight. For example, the first determining unit 113 predetermines the size and method of clipping when the user looks to the left, and the size and method of clipping when the user looks to the right. Then, the clipping area is determined according to the movement of the user's line of sight.
- the movement of the user's line of sight is detected by, for example, providing a camera or the like capable of capturing the user in the vehicle 5 and analyzing the video captured by the camera.
- a user is, for example, a driver.
- the second determining unit 114 determines the compression rate of the compression target area in conjunction with the movement of the user's line of sight. For example, the second determination unit 114 determines the processing condition so that the compression rate of the area on the side where the line of sight is directed is low, with reference to the essential display area.
- the first determining unit 113 determines the size of the clipping region and the clipping method when the user turns his or her line of sight to the right. In this example, the first determining unit 113 determines the essential display area E and the right area R in FIG.
- the second determining unit 114 lowers the compression rate of the side of the image to which the user's line of sight is directed.
- the second determining unit 114 decreases the compression ratio of the right area R in FIG. 7 and determines no compression. Since the image of the display image is the same as that of Modification 4, illustration and description are omitted.
- the second determination unit 114 reduces the compression rate on the side of the image on which the user's line of sight is directed, so that, for example, when the user turns right or changes lanes to the right lane, the left rear becomes easier to see. That is, according to this modified example, it is possible to make it easier to visually recognize a vehicle or the like existing on the rear side.
- the first determination unit 113 and the second determination unit 114 may determine processing conditions for the captured image in conjunction with route guidance.
- the first determination unit 113 of this modified example determines the clipping area according to the route guidance. For example, the first determining unit 113 predetermines the size and the method of cutting out a region to be cut out when guiding a left turn, and the size and method of cutting out a region to be cut out in the case of guiding a right turn. Determine the clipping area.
- the route guidance for example, identifies the current position and direction of travel of the vehicle by analyzing the positioning signal, and guides the route to the destination.
- the second determining unit 114 determines the compression rate of the compression target area according to route guidance. For example, the second determining unit 114 determines the processing condition so that the compression ratio of the area indicated by the route guidance is low with the essential display area as a reference.
- the first determining unit 113 determines the size of the clipping region and the clipping method when the right turn is guided. In this example, the first determining unit 113 determines the essential display area E and the right area R in FIG.
- the second determining unit 114 reduces the compression ratio of the side indicated by route guidance on the video.
- the second determining unit 114 decreases the compression ratio of the right area R in FIG. 7 and determines no compression. Since the image of the display image is the same as that of Modification 4, illustration and description are omitted.
- the second determination unit 114 reduces the compression ratio of the side indicated by the route guidance on the video, so that the user can easily view the rear side of the image before operating the direction indicator. You can check your status. That is, according to this modified example, it is possible to make it easier to visually recognize a vehicle or the like existing on the rear side.
- the first determination unit 113 and the second determination unit 114 may determine processing conditions for the captured image according to the running speed of the own vehicle.
- the first determination unit 113 determines a predetermined area in the captured image as the clipping area regardless of the number of roads or travel position.
- the second determination unit 114 sets the compression rate of the compression target area to 0 when the running speed of the host vehicle is below a predetermined threshold value.
- a compression rate of 0 means no compression.
- the user can manually switch whether the first determination unit 113 and the second determination unit 114 perform the process of determining the processing conditions of the captured image based on the number of roads and the traveling position, or the above-described process. You may do so.
- the drive recorder unit 10 when there is little need to pay attention to the rear side of the vehicle, such as when the vehicle is stopped, a natural, uncompressed display image is displayed on the display device 25. It is possible to display As a result, it is possible to reduce situations in which the user feels uncomfortable with the displayed image.
- the first determination unit 113 and the second determination unit 114 may determine processing conditions for the captured image according to the vehicle-to-vehicle distance.
- the first determination unit 113 determines a predetermined area in the captured image as a cut-out area, regardless of the number of roads or travel position.
- the second determination unit 114 sets the compression rate of the compression target area to 0 when the inter-vehicle distance exceeds a predetermined threshold.
- a compression rate of 0 means no compression.
- the inter-vehicle distance between the vehicle and the other vehicle is calculated by analyzing the rear image D.
- the drive recorder unit 10 in situations where there is little need to pay attention to the rear and side directions, such as when the inter-vehicle distance exceeds a certain distance, a natural, uncompressed display image is displayed on the display device 25. It is possible to display As a result, it is possible to reduce situations in which the user feels uncomfortable with the displayed image.
- Modification 11 In the modification 3 described above, a mode in which the second determination unit 114 reduces the compression rate of the region in which the vehicle or the like exists has been described. However, the second determining unit 114 may reduce the compression ratio of the lane area where the entrance of the service area is present.
- the service area or the like includes, for example, a service area and a parking area.
- the second determining unit 114 of this modified example reduces the compression ratio of the lane area where the entrance of the service area or the like exists in the captured image.
- the lane where the entrance to the service area or the like exists may be detected by analyzing the captured image, or may be detected from the reception result of the positioning signal. Further, the second determining unit 114 may perform the above processing only when a certain period of time has passed since the driver started driving or took a previous break.
Landscapes
- Engineering & Computer Science (AREA)
- Multimedia (AREA)
- Mechanical Engineering (AREA)
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- Computer Hardware Design (AREA)
- Theoretical Computer Science (AREA)
- Signal Processing (AREA)
- Closed-Circuit Television Systems (AREA)
Abstract
Description
(車両の構成例)
図1は、第1実施形態にかかるドライブレコーダユニット10を備える車両5の一例を示す模式図である。図1に示すように、第1実施形態の車両5は、例えばドライブレコーダユニット10、リアカメラ32、および表示装置25を備える。車両5は、フロントカメラ31、およびディスプレイ45を備えてもよい。以下では、車両5がフロントカメラ31およびディスプレイ45を備える例について説明する。
図2は、第1実施形態にかかる表示制御システム1の構成の一例を示すブロック図である。
次に、図3を用いて、第1実施形態にかかるドライブレコーダユニット10の機能構成を説明する。図3は、第1実施形態にかかるドライブレコーダユニット10のマイコン11の機能構成の一例を示す機能ブロック図である。
次に、第1実施形態にかかるドライブレコーダユニット10が実行する処理について説明する。図10は、第1実施形態にかかるドライブレコーダユニット10が実行する処理の一例を示すフローチャートである。
次に、第1実施形態にかかるドライブレコーダユニット10の効果について説明する。本実施形態にかかるドライブレコーダユニット10は、自車両が走行する道路を含む1以上の道路の数を示す道路数に応じて、自車両の周囲を撮影した撮影画像のうち、上記の必須表示領域以外の領域の処理条件を決定する。
次に、第2実施形態にかかるドライブレコーダユニット10について説明する。
図11を用いて、第2実施形態にかかるドライブレコーダユニット10の機能構成を説明する。図11は、第2実施形態にかかるドライブレコーダユニット10のマイコン11の機能構成の一例を示す機能ブロック図である。
次に、第2実施形態にかかるドライブレコーダユニット10が実行する処理について説明する。図17は、第2実施形態にかかるドライブレコーダユニット10が実行する処理の一例を示すフローチャートである。
次に、第2実施形態にかかるドライブレコーダユニット10の効果について説明する。本実施形態にかかるドライブレコーダユニット10は、自車両の走行位置に応じて、上記の必須表示領域以外の領域の処理条件を決定する。
上述した第1実施形態および第2実施形態では、表示制御システム1が、ドライブレコーダユニット10、表示ユニット20、フロントカメラ31、リアカメラ32、およびディスプレイユニット40で構成される形態について説明した。しかし、表示制御システム1は、表示ユニット20およびリアカメラ32のみから構成されていてもよい。
上述した第1実施形態および第2実施形態では、圧縮処理を施した後方映像を表示装置25に表示する形態について説明した。しかし、表示制御部116は、圧縮処理を施した後方映像をディスプレイ45に表示させる制御を行ってもよい。また、表示制御部116は、圧縮処理を施した後方映像を、車両5に搭載したヘッドアップディスプレイ(HUD)等に表示させる制御を行ってもよい。
上述した第1実施形態および第2実施形態では、表示装置25に後方映像のみを表示する形態について説明した。しかし、表示装置25に前方映像を合成した映像を表示してもよい。
上述した第2実施形態では、第2決定部114が、道路数および走行位置に基づいて、撮影画像の圧縮方法を決定する形態について説明した。しかし、第2決定部114は、これらに加えて、車両等の有無に基づいて圧縮方法を決定してもよい。ここで、車両とは二輪車を含む。
第1決定部113および第2決定部114は、ユーザによる方向指示器の動作と連動して、撮影画像の処理条件を決定してもよい。
第1決定部113および第2決定部114は、ユーザによるハンドルの操作と連動して、撮影画像の処理条件を決定してもよい。
第1決定部113および第2決定部114は、ユーザの視線の動きと連動して、撮影画像の処理条件を決定してもよい。
第1決定部113および第2決定部114は、経路案内と連動して、撮影画像の処理条件を決定してもよい。
第1決定部113および第2決定部114は、自車両の走行速度に応じて、撮影画像の処理条件を決定してもよい。
第1決定部113および第2決定部114は、車間距離に応じて、撮影画像の処理条件を決定してもよい。
上述した変形例3では、第2決定部114が、車両等が存在する領域の圧縮率を低下させる形態について説明した。しかし、第2決定部114は、サービスエリア等の入り口が存在する車線の領域の圧縮率を低下させてもよい。ここで、サービスエリア等とは、例えばサービスエリアおよびパーキングエリアを含む。
5 車両
10 ドライブレコーダユニット
11 マイコン
20 表示ユニット
25 表示装置
31 フロントカメラ
32 リアカメラ
40 ディスプレイユニット
45 ディスプレイ
111 取得部
112 第1検知部
113 第1決定部
114 第2決定部
115 生成部
116 表示制御部
117 第2検知部
Claims (16)
- 自車両が走行する道路を含む1以上の道路の数を示す道路数を検知する第1検知部と、
前記第1検知部が検知した道路数に応じて、前記自車両の周囲を撮影した撮影画像のうち、予め定められた表示領域を示す必須表示領域以外の領域の処理条件を決定する決定部と、
前記決定部が決定した前記処理条件に従って前記撮影画像を処理し、表示装置に表示させる制御を行う表示制御部と、
を備える表示制御装置。 - 前記道路には、歩行者が歩く歩道および車両が走行する車線が含まれる、
請求項1に記載の表示制御装置。 - 前記自車両の走行位置を検知する第2検知部を更に備え、
前記決定部は、前記第2検知部が検知した前記道路数および前記自車両の走行位置に応じて、前記撮影画像のうち、前記必須表示領域以外の領域の前記処理条件を決定する、
請求項1または2に記載の表示制御装置。 - 前記決定部は、撮影画像に対して前記自車両の内側から外側へ向かって徐々に車幅方向の表示の圧縮率が高くなるように前記処理条件を決定する、
請求項3に記載の表示制御装置。 - 前記決定部は、前記撮影画像において、他の車両が存在しない領域の車幅方向の表示の圧縮率が高くなるように前記処理条件を決定する、
請求項3または4に記載の表示制御装置。 - 前記決定部は、ユーザによる方向指示器の操作と連動して、前記必須表示領域以外の領域の車幅方向における表示の圧縮率を含む前記処理条件を決定する、
請求項3から5の何れか1項に記載の表示制御装置。 - 前記決定部は、前記必須表示領域を基準として、前記方向指示器が指示する側に存在する領域の車幅方向における表示の圧縮率が低くなるように前記処理条件を決定する、
請求項6に記載の表示制御装置。 - 前記決定部は、ユーザによるハンドルの操作と連動して、前記必須表示領域以外の領域の車幅方向における表示の圧縮率を含む前記処理条件を決定する、
請求項3から7の何れか1項に記載の表示制御装置。 - 前記決定部は、前記必須表示領域を基準として、前記ハンドルが切られた側に存在する領域の車幅方向における表示の圧縮率が低くなるように前記処理条件を決定する、
請求項8に記載の表示制御装置。 - 前記決定部は、ユーザの視線の動きと連動して、前記必須表示領域以外の領域の車幅方向における表示の圧縮率を含む前記処理条件を決定する、
請求項3から9の何れか1項に記載の表示制御装置。 - 前記決定部は、前記必須表示領域を基準として、前記視線が向いた側に存在する領域の車幅方向における表示の圧縮率が低くなるように前記処理条件を決定する、
請求項10に記載の表示制御装置。 - 前記決定部は、経路案内に合わせて、前記必須表示領域以外の領域の車幅方向における表示の圧縮率を含む前記処理条件を決定する、
請求項3から11の何れか1項に記載の表示制御装置。 - 前記決定部は、前記必須表示領域を基準として、経路案内により指示される側に存在する領域の車幅方向における表示の圧縮率が低くなるように前記処理条件を決定する、
請求項12に記載の表示制御装置。 - 前記決定部は、前記自車両の走行速度が予め定めた閾値を下回った場合、車幅方向における表示の圧縮率が0になるように前記処理条件を決定する、
請求項3から13の何れか1項に記載の表示制御装置。 - 前記決定部は、車間距離が予め定めた閾値を超える場合、車幅方向における表示の圧縮率が0になるように前記処理条件を決定する、
請求項3から14の何れか1項に記載の表示制御装置。 - 表示制御装置による表示制御方法であって、
自車両が走行する道路を含む1以上の道路の数を示す道路数を検知する検知ステップと、
前記検知ステップで検知した道路数に応じて、前記自車両の周囲を撮影した撮影画像のうち、予め定められた表示領域を示す必須表示領域以外の領域の処理条件を決定する決定ステップと、
前記決定ステップで決定した前記処理条件に従って前記撮影画像を処理し、表示装置に表示させる制御を行う表示制御ステップと、
を含む表示制御方法。
Priority Applications (4)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
DE112021007108.4T DE112021007108T5 (de) | 2021-02-18 | 2021-10-12 | Anzeigesteuervorrichtung und Anzeigesteuerverfahren |
CN202180093993.XA CN116918320A (zh) | 2021-02-18 | 2021-10-12 | 显示控制装置和显示控制方法 |
JP2023500522A JPWO2022176267A1 (ja) | 2021-02-18 | 2021-10-12 | |
US18/225,516 US20230365064A1 (en) | 2021-02-18 | 2023-07-24 | Display control device and display control method |
Applications Claiming Priority (2)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
JP2021024671 | 2021-02-18 | ||
JP2021-024671 | 2021-02-18 |
Related Child Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
US18/225,516 Continuation US20230365064A1 (en) | 2021-02-18 | 2023-07-24 | Display control device and display control method |
Publications (1)
Publication Number | Publication Date |
---|---|
WO2022176267A1 true WO2022176267A1 (ja) | 2022-08-25 |
Family
ID=82931284
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
PCT/JP2021/037777 WO2022176267A1 (ja) | 2021-02-18 | 2021-10-12 | 表示制御装置および表示制御方法 |
Country Status (5)
Country | Link |
---|---|
US (1) | US20230365064A1 (ja) |
JP (1) | JPWO2022176267A1 (ja) |
CN (1) | CN116918320A (ja) |
DE (1) | DE112021007108T5 (ja) |
WO (1) | WO2022176267A1 (ja) |
Citations (7)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
JPH11150726A (ja) * | 1997-11-18 | 1999-06-02 | Toyota Motor Corp | 車両用動画像処理方法および車両用動画像処理装置 |
JP2001116567A (ja) * | 1999-10-20 | 2001-04-27 | Matsushita Electric Ind Co Ltd | 車載運転支援情報表示装置 |
JP2010095086A (ja) * | 2008-10-15 | 2010-04-30 | Nissan Motor Co Ltd | 車両用表示装置および表示方法 |
WO2010095206A1 (ja) * | 2009-02-20 | 2010-08-26 | パナソニック株式会社 | 画像圧縮装置、画像圧縮方法および車載画像記録装置 |
JP2011079338A (ja) * | 2008-01-31 | 2011-04-21 | Mitsubishi Electric Corp | ナビゲーション装置 |
JP2016048839A (ja) * | 2014-08-27 | 2016-04-07 | 株式会社小糸製作所 | 電子制御ユニットおよび車両用映像システム |
JP2018006936A (ja) * | 2016-06-30 | 2018-01-11 | マツダ株式会社 | 車両用表示装置 |
Family Cites Families (1)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
JP7188727B2 (ja) | 2018-02-20 | 2022-12-13 | 株式会社東海理化電機製作所 | 車両用視認装置 |
-
2021
- 2021-10-12 JP JP2023500522A patent/JPWO2022176267A1/ja active Pending
- 2021-10-12 CN CN202180093993.XA patent/CN116918320A/zh active Pending
- 2021-10-12 DE DE112021007108.4T patent/DE112021007108T5/de active Pending
- 2021-10-12 WO PCT/JP2021/037777 patent/WO2022176267A1/ja active Application Filing
-
2023
- 2023-07-24 US US18/225,516 patent/US20230365064A1/en active Pending
Patent Citations (7)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
JPH11150726A (ja) * | 1997-11-18 | 1999-06-02 | Toyota Motor Corp | 車両用動画像処理方法および車両用動画像処理装置 |
JP2001116567A (ja) * | 1999-10-20 | 2001-04-27 | Matsushita Electric Ind Co Ltd | 車載運転支援情報表示装置 |
JP2011079338A (ja) * | 2008-01-31 | 2011-04-21 | Mitsubishi Electric Corp | ナビゲーション装置 |
JP2010095086A (ja) * | 2008-10-15 | 2010-04-30 | Nissan Motor Co Ltd | 車両用表示装置および表示方法 |
WO2010095206A1 (ja) * | 2009-02-20 | 2010-08-26 | パナソニック株式会社 | 画像圧縮装置、画像圧縮方法および車載画像記録装置 |
JP2016048839A (ja) * | 2014-08-27 | 2016-04-07 | 株式会社小糸製作所 | 電子制御ユニットおよび車両用映像システム |
JP2018006936A (ja) * | 2016-06-30 | 2018-01-11 | マツダ株式会社 | 車両用表示装置 |
Also Published As
Publication number | Publication date |
---|---|
US20230365064A1 (en) | 2023-11-16 |
JPWO2022176267A1 (ja) | 2022-08-25 |
DE112021007108T5 (de) | 2024-01-25 |
CN116918320A (zh) | 2023-10-20 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
US8559675B2 (en) | Driving support device, driving support method, and program | |
US20180015879A1 (en) | Side-view mirror camera system for vehicle | |
US20120133738A1 (en) | Data Processing System and Method for Providing at Least One Driver Assistance Function | |
JP6935800B2 (ja) | 車両制御装置、車両制御方法、および移動体 | |
JP5169884B2 (ja) | ヘッドアップディスプレイ装置 | |
JP2010130646A (ja) | 車両周辺確認装置 | |
JP2010143411A (ja) | ヘッドアップディスプレイ装置 | |
EP4149809B1 (en) | Motor-vehicle driving assistance in low meteorological visibility conditions, in particular with fog | |
CN111469762B (zh) | 显示系统、行驶控制装置、显示控制方法以及存储介质 | |
CN111497745B (zh) | 显示系统、行驶控制装置、显示控制方法以及存储介质 | |
WO2022176267A1 (ja) | 表示制御装置および表示制御方法 | |
US11584299B2 (en) | Driver-assisting system for an industrial vehicle | |
JP2020161988A (ja) | 情報処理装置及び情報処理方法 | |
US20230271622A1 (en) | Intelligent head-up display | |
JP2017040773A (ja) | 頭部装着型表示装置 | |
JP7300624B2 (ja) | 電子ミラーカメラシステム | |
CN114078288A (zh) | 影像处理装置和影像处理系统 | |
JP2018087852A (ja) | 虚像表示装置 | |
US20190381936A1 (en) | Device for assisting night-time road navigation | |
WO2015115103A1 (ja) | 画像処理装置、カメラシステム、および画像処理方法 | |
JP6878109B2 (ja) | 画像表示装置 | |
JP2021022325A (ja) | 運転支援制御装置、運転支援システム、運転支援制御方法及びプログラム | |
CN109131083B (zh) | 外后视镜系统和应用于外后视镜系统的方法 | |
CN214929320U (zh) | 一种加强adas系统功能的流媒体后视镜 | |
JP2024138676A (ja) | 表示制御装置、表示制御方法およびプログラム |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
121 | Ep: the epo has been informed by wipo that ep was designated in this application |
Ref document number: 21926696 Country of ref document: EP Kind code of ref document: A1 |
|
ENP | Entry into the national phase |
Ref document number: 2023500522 Country of ref document: JP Kind code of ref document: A |
|
WWE | Wipo information: entry into national phase |
Ref document number: 202180093993.X Country of ref document: CN |
|
WWE | Wipo information: entry into national phase |
Ref document number: 112021007108 Country of ref document: DE |
|
122 | Ep: pct application non-entry in european phase |
Ref document number: 21926696 Country of ref document: EP Kind code of ref document: A1 |