JP7223958B2 - Control device and control method - Google Patents

Description

The present disclosure relates to control devices, control systems, and control methods.

In recent years, in a system that displays an image of the surroundings of a vehicle captured by an imaging device such as a CCD camera on a display device such as a liquid crystal display, the area displayed on the display device (for example, the visual field range) is changed to change the driver's view. Assisting driving operations has been studied (for example, Patent Literature 1).

JP-A-2006-131213

However, the driver may not be able to confirm the change in the area displayed on the display device.

Non-limiting embodiments of the present disclosure contribute to providing a control device, a control system, and a control method that allow the driver to confirm changes in the area displayed on the display device.

A control device according to an aspect of the present disclosure performs image processing on an image captured by a detection unit that detects an operation of a turn signal lever provided in a vehicle, and an imaging device provided in the vehicle. and a processing unit for displaying on a display device, wherein when the detection unit detects that the turn signal lever is operated to the left or right, the processing unit displays on the display device corresponding to the direction of the operation. switching processing for switching the area of the visual field range from a first area behind the direction of the operation to a second area including a third area adjacent to and laterally behind the first area; , the processing unit executes a first presentation process for informing a driver of the vehicle that the switching process is being executed.

A control system according to an aspect of the present disclosure includes a photographing device provided in a vehicle, a display device provided in the vehicle, and a turn signal lever provided in the vehicle for receiving an operation of a turn signal operation by a driver of the vehicle. and a control device, wherein the control device includes a detection unit that detects the operation of the turn signal lever, and a processing unit that performs image processing on the image captured by the image capturing device and displays the image on the display device. When the detection unit detects that the turn signal lever is operated to the left or right, the processing unit changes the area of the visual field range displayed on the display device corresponding to the direction of the operation to the direction of the operation. performing a switching process of switching from a rear first area to a second area including a third area positioned laterally rearward adjacent to the first area, wherein the processing unit performs the switching process; A first presentation process is executed to notify the driver of the vehicle that the vehicle has been set.

A control method according to an aspect of the present disclosure detects an operation of a turn signal lever provided in a vehicle, performs image processing on an image captured by an imaging device provided in the vehicle, and performs image processing on a display device provided in the vehicle. wherein, when an operation of the turn signal lever to the left or right is detected, the area of the visual field range displayed on the display device corresponding to the direction of the operation is shifted to the rear of the direction of the operation. to a second region including a third region located laterally and rearwardly adjacent to the first region from the first region of the A first presentation process is executed to notify the driver of the vehicle.

These generic or specific aspects may be realized by systems, methods, integrated circuits, computer programs, or recording media, and any of the systems, devices, methods, integrated circuits, computer programs and recording media may be implemented in any combination.

According to one aspect of the present disclosure, the driver can confirm the change in the area displayed on the display device.

Further advantages and advantages of one aspect of the present disclosure are apparent from the specification and drawings. Such advantages and/or advantages are provided by the several embodiments and features described in the specification and drawings, respectively, not necessarily all provided to obtain one or more of the same features. no.

1 is a block diagram showing a configuration example of a control system according to an embodiment of the present disclosure; FIG. A diagram showing an example of a visual field range expansion process according to an embodiment of the present disclosure A diagram showing an example of a visual field range expansion process according to an embodiment of the present disclosure A diagram showing a first example of visual guidance processing according to an embodiment of the present disclosure A diagram showing a second example of visual guidance processing according to an embodiment of the present disclosure A diagram showing a third example of visual guidance processing according to an embodiment of the present disclosure A diagram showing a fourth example of visual guidance processing according to an embodiment of the present disclosure A diagram showing a fifth example of visual guidance processing according to an embodiment of the present disclosure A diagram showing a sixth example of visual guidance processing according to an embodiment of the present disclosure A diagram showing a first example of animation of visual guidance processing according to an embodiment of the present disclosure A diagram showing a second example of animation of visual guidance processing according to an embodiment of the present disclosure A diagram showing a third example of animation of visual guidance processing according to an embodiment of the present disclosure FIG. 4 is a diagram showing an example of combination of effects according to an embodiment of the present disclosure; FIG. 4 is a diagram showing an example of the structure of a turn signal lever according to an embodiment of the present disclosure; FIG. 4 is a diagram showing an example of the relationship between the operation of the turn signal lever and the display on the right side display according to the embodiment of the present disclosure; A diagram showing an example of a change in the visual field range when a vehicle is traveling near a merging point. A diagram showing an example of an image captured by the right-side camera at a junction of roads Flowchart showing an example of display processing according to operation of a turn signal lever according to an embodiment of the present disclosure

Preferred embodiments of the present disclosure will be described in detail below with reference to the accompanying drawings. In the present specification and drawings, constituent elements having substantially the same functions are denoted by the same reference numerals, thereby omitting redundant description.

(one embodiment)
<Configuration example of control system>
FIG. 1 is a block diagram showing a configuration example of a control system 1 according to an embodiment of the present disclosure. A control system 1 shown in FIG. 1 is applied to a vehicle, for example, and assists the driver of the vehicle.

In the following description, "front", "rear", "left", and "right" indicate directions relative to the traveling direction of the vehicle. In other words, "front", "rear", "left", and "right" in the following description correspond to directions viewed from the driver seated in the driver's seat of the vehicle.

The control system 1 includes a controller (control device) 10, a left side camera 11, a right side camera 12, a blinker lever (turn signal lever, or may be referred to as a turn indicator lever or the like) 14, and a left side camera. A display 16 and a right side display 17 are included. Although illustration is omitted, the control system 1 may include various operation units, sensors, and a display unit mounted on the vehicle.

The left side camera 11 is, for example, a photographing device mounted at the position of the left side mirror. The photographing area of the left side camera 11 includes at least a left rear area and a left rear area of the vehicle. The left side camera 11 outputs captured images to the controller 10 . A mirrorless configuration in which the left side camera 11 replaces the left side mirror may be employed, or both the left side mirror and the left side camera 11 may be provided in the vehicle.

The right side camera 12 is, for example, a photographing device mounted at the position of the right side mirror. The imaging area of the right side camera 12 includes at least the right rear area and the right rear area of the vehicle. The right-side camera 12 outputs captured images to the controller 10 . A mirrorless configuration in which the right side camera 12 replaces the right side mirror may be employed, or both the right side mirror and the right side camera 12 may be provided in the vehicle.

The winker lever 14 is arranged, for example, in front of the steering wheel of the vehicle so that it can be tilted. The winker lever 14 receives a tilting operation from the driver. A turn signal lamp (which may also be referred to as a turn signal lamp, turn indicator lamp, or the like) operates according to the operation of the turn signal lever 14 . In addition, hereinafter, the click position of the winker lever 14 at which both the left and right winker lamps are not operated may be referred to as the "neutral position".

For example, the winker lever 14 is moved to the right click position by being rotated clockwise from the neutral position by a predetermined angle. Also, the winker lever 14 is moved to the left click position by being operated counterclockwise by a predetermined angle from the neutral position. When the winker lever 14 moves to the right click position, the right winker lamp blinks, and when the winker lever 14 moves to the left click position, the left winker lamp blinks. Further, when the right blinker lamp or the left blinker lamp flashes, that is, when the blinker is activated, a relay sound may be output in the vehicle compartment.

In the half-pressed state in which the winker lever 14 is lightly tilted, the winker lamp corresponding to the tilted direction blinks. When the button is further tilted from the half-pressed state and moved to the right or left click position, even if the turn signal lever 14 is released, the turn signal lamp corresponding to the tilted direction continues blinking. Further, for example, when the driver releases the half-pressed winker lever 14, the winker lever 14 moves to the neutral position and the blinker lamp stops blinking.

In the state where the winker lever 14 is moved to the right click position or the left click position (fully pressed state), when the steering wheel returns by a predetermined steering angle or more, or when the driver returns the winker lever 14 to the neutral position. In such a case, the driver's operation cancels the fully-pressed state of the turn signal lever 14, and the blinking of the turn signal lamp stops.

The left side display 16 is, for example, a display device provided at a position in front of and to the left of the driver's seat in the interior of the vehicle. On the display screen of the left side display 16, an image captured by the left side camera 11 and processed by the controller 10 is displayed. The left side display 16 may have an LED (Light Emitting Diode) 161 and a speaker 162 . The LED 161 corresponds to a light-emitting part that is controlled by the controller 10 to turn on, blink, or turn off. Speaker 162 is controlled by controller 10 .

The right side display 17 is, for example, a display device provided at a position in front of the driver's seat on the right side in the vehicle interior of the vehicle. An image captured by the right side camera 12 and processed by the controller 10 is displayed on the display screen of the right side display 17 . Right side display 17 may have LED 171 and speaker 172 . The LED 171 is controlled by the controller 10 to turn on, blink, or turn off. Speaker 172 is controlled by controller 10 .

In the following description, the left side display 16 and the right side display 17 may be referred to as "display" or "display device" without distinction. A display corresponds to at least one of the left side display 16 and the right side display 17 .

The controller 10 may be configured by an ECU (Electric Control Unit) or the like, for example. The ECU includes inputs, outputs, a processor, program memory and main memory.

The processor executes a program stored in the program memory using the main memory, processes various signals received through the input terminal, and outputs various signals through the output terminal.

For example, the controller 10 performs image processing on the image output from the left side camera 11 and controls the display on the left side display 16, and performs image processing on the image output from the right side camera 12 to display on the right side display. 17 is displayed. In addition, the controller 10 acquires information about the driver's operation, such as the driver's operation of the turn signal lever 14, or the driver's motion, and changes the processing for the image.

The controller 10 includes a detection section 101 and a processing section 102 . For example, the controller 10 functions as a detection unit 101, a processing unit 102, and the like as a result of a processor executing a program.

The detection unit 101 detects, for example, information about the operation of the driver or the action of the driver. As an example, the detection unit 101 detects the operating state of the turn signal lever 14 . The operating state of the winker lever 14 includes at least one of, for example, the position to which the winker lever 14 has moved, the angle at which the winker lever 14 is tilted, the torque applied to the winker lever 14, and the like. Further, when the winker lever 14 is provided with a pressure sensor, the operating state of the winker lever 14 may include the direction of the force received by the winker lever 14 (for example, the clockwise or counterclockwise direction).

Based on the detection result of the detection unit 101, the processing unit 102 processes the image output from the left side camera 11, controls the display on the left side display 16, and controls the image output from the right side camera 12. Processing is performed, and control for display on the right side display 17 is performed.

For example, when the detection unit 101 detects that the winker lever 14 is in the neutral position, the processing unit 102 causes the right side display 17 to display the image of the first area captured by the right side camera 12 .

When the first motion of the driver is detected by the detection unit 101, the processing unit 102 performs processing to change the area of the image displayed on the right side display 17 from the first area to the second area.

The first operation is, for example, an operation by the driver to tilt the turn signal lever 14 clockwise from the neutral position to move it to the right click position.

The first area is a rear right area of the vehicle, and the second area is a rear right area of the vehicle that is wider than the first area. For example, the second area includes a third area adjacent to the first area and located on the rear right side. When the first area is an area on the right rear of the vehicle and the second area is an area wider than the first area on the right rear of the vehicle, the process of changing from the first area to the second area is , may be regarded as processing for expanding the visual field range (hereinafter referred to as visual field range expansion processing). An example of the visual field range expansion process will be described later.

In the above description, the visual field range expansion processing in which the controller 10 causes the right side display 17 to display an image captured by the right side camera 12 has been described as an example. As with the right side display 17 , the controller 10 may also perform the visual field range expansion process when displaying an image captured by the left side camera 11 on the left side display 16 . In addition, in the viewing range expansion processing of the controller 10 when displaying on the left side display 16, the operation of the turn signal lever 14 is bilaterally symmetrical with the case of the right side display 17 described above.

In addition, in the following description, in consideration of left-right symmetry, either processing for display on the right side display 17 or processing for display on the left side display 16 will be described, and description of the other may be omitted. .

<Example of view range expansion processing>
2A and 2B are diagrams showing an example of the visual field range expansion process according to the present embodiment. 2A and 2B show display examples on the right side display 17. FIG.

FIG. 2A is a display example when the visual field range expansion process is not executed. When the visual field range expansion process is not executed, the right rear area (first area) of the vehicle is displayed on the right side display 17 .

FIG. 2B is a display example when the visual field range expansion process is being executed. When the visual field range expansion process is being performed, the right rear region (first region) of the vehicle shown inside the frame S and the right rear region of the first region shown outside the frame S are displayed. 3 are displayed on the right side display 17 .

In addition, although the frame S in FIG. 2B is indicated by a dashed line on the right side display 17 for convenience of explanation, it does not have to be displayed in practice.

In the visual field range expansion process, the processing unit 102 extracts an area to be displayed on the right side display 17 from the image captured by the right side camera 12, and adjusts the magnification of the extracted area. For example, in the visual field range expansion process, the display shown in FIG. 2A transitions to the display shown in FIG. 2B. In this case, for example, the processing unit 102 may immediately (without delay) transition the display.

In the following description, the display when the viewing range expansion process is not performed is described as the normal view display, and the display when the viewing range expansion process is performed is described as the expanded view display. there is something

In the visual field range expansion process, the image display magnification is reduced in order to expand the visual field range. By lowering the display magnification, the area displayed in the normal field of view appears smaller in the enlarged field of view display (see frame S in FIGS. 2A and 2B). For example, a vehicle running relatively close in the normal field of view display appears as if it has retreated far in the expanded field of view display. There is a possibility of misidentifying the situation of

The controller 10 in the present embodiment performs presentation processing to notify the driver that the visual field range expansion processing is being executed in order to prevent the driver from misunderstanding the surrounding conditions. For example, presentation processing for informing the driver that the visual field range expansion processing is being executed corresponds to visual guidance processing for guiding the driver's visual line. Therefore, in the following description, the description of "line-of-sight guidance processing" may be regarded as an example of "presentation processing."

For example, in the controller 10 , when the detection unit 101 detects the driver's second motion, the processing unit 102 performs visual guidance processing to guide the driver's visual line to the right side display 17 . The second action is a predetermined action performed when the driver operates the turn signal lever 14 to the right (or left). The predetermined operation is, for example, an operation in which the driver touches the left side (or right side) of the winker lever 14 in the neutral position and starts moving to the right click position (or left click position).

Note that the processing unit 102 may perform the visual field range expansion process after a predetermined time (for example, 0.1 seconds) after the detection unit 101 detects the second motion of the driver.

Considering each of left and right, when detection unit 101 detects that turn signal lever 14 is operated to the left or right, processing unit 102 changes the area of the visual field range displayed on the display corresponding to the direction of operation. view range expansion processing (sometimes referred to as switching processing) for switching from the rear region in the direction (left or right) to a region including a region located laterally rearward adjacent to the rear region. In addition, the processing unit 102 executes presentation processing (for example, first presentation processing) for notifying the driver that the visual field range expansion processing (switching processing) is being performed.

Next, an example of visual guidance processing will be described based on a display example to which visual guidance processing has been performed.

<Example of line-of-sight guidance processing (static effect)>
FIG. 3A is a diagram showing a first example of visual guidance processing according to the present embodiment. As shown in FIG. 3A, in the first example, the processing unit 102 performs visual guidance processing for causing the LED 171 provided on the right side display 17 to emit light (turn on).

FIG. 3B is a diagram illustrating a second example of visual guidance processing according to the present embodiment. As shown in FIG. 3B, in the second example, the processing unit 102 performs visual guidance processing for displaying the outer frame of the display area of the right side display 17 with high luminance.

FIG. 3C is a diagram showing a third example of visual guidance processing according to the present embodiment. In FIG. 3C, hatching indicates that the first area inside the frame S and the third area outside the frame S are different. As shown in FIG. 3C, in the third example, the processing unit 102 performs visual guidance processing that gives a first area inside the frame S and a third area outside the frame S different aspects. For example, the processing unit 102 provides a difference between the brightness of the first area and the brightness of the third area for display.

The method of providing the luminance difference is not particularly limited. For example, the brightness of the first area may be lower than the brightness of the third area, or the brightness of the first area may be higher than the brightness of the third area.

As an example, the brightness of the first area may be set lower than the reference value, and the brightness of the third area may be set to the reference value. For example, the reference value may be the brightness of the right side display 17 before performing the visual guidance process, or the brightness in the display of the normal visual field. In this case, since the brightness of the first area is low, the visibility of the first area can be lowered, and the perception of the distance to the following vehicle displayed in the first area can be hindered. By lowering the visibility of the display in the first area, it is possible to prevent the driver from erroneously recognizing an image in which the following vehicle is displayed small (an image in which the following vehicle appears far away).

As another example, the luminance of the first area may be set as a reference value, and the luminance of the third area may be set higher than the reference value. For example, the reference value may be the brightness of the right side display before performing the visual guidance process, or the brightness in the normal display state. In this case, since the brightness of the third area is higher than normal, the driver's line of sight can be guided more effectively.

FIG. 3D is a diagram showing a fourth example of visual guidance processing according to the present embodiment. As shown in FIG. 3D , in the fourth example, the processing unit 102 causes the portion of the outer periphery of the third region, excluding the outer periphery (frame S) of the first region, to be displayed with high luminance. Perform line-of-sight guidance processing.

Note that FIG. 3D shows an example in which, among the sides of the outer periphery of the third region, the side portion excluding the outer periphery (frame S) of the first region is displayed with high brightness. (or edge) is not limited to this. For example, all the outer peripheral sides of the third area may be displayed with high brightness, or the lower side and the right side of the third area may be displayed with high brightness.

In the example of FIG. 3D, it is possible to more effectively guide the driver's line of sight without hindering the driver's recognition of the image.

Also, in the above example, the line-of-sight guidance processing has been described as processing using the display of the display, but the line-of-sight guidance processing may be processing using voice, for example.

For example, the processing unit 102 may perform visual guidance processing for outputting sound from the speaker of the display on the side corresponding to the operation of the turn signal lever 14 (for example, the speaker 172 of the right side display 17 in the above example). In this case, the sound output from the speaker 172 may be a relay sound indicating a direction when the blinker is operated, or may be another warning sound or a voice message.

Further, the line-of-sight guidance processing may be a combination of the above-described processing using display on the display and processing using sound.

It should be noted that the above-described first to fourth examples are displays that have been processed to guide the line of sight of the driver, and can indicate to the driver that the visual field range expansion process is being executed. In other words, the line-of-sight guidance process described above may be regarded as a process for indicating to the driver that the visual field range expansion process is being executed. That is, the line-of-sight guidance process in the present embodiment may be a process of guiding the line of sight of the driver and a process of indicating to the driver that the visual field range expansion process is being executed.

The lighting of the LED 171 in the first example described above may guide the driver's line of sight and indicate that the visual field range expansion process is being performed.

Note that the above-described first to fourth examples are examples of visual guidance processing using video effects whose display does not change dynamically. Hereinafter, video effects whose display does not change dynamically may be referred to as static effects.

A static effect has a low degree of emphasis in the display area of the display, has no dynamic change in the mode of emphasis, and provides a relatively weak visual stimulus to the driver.

It should be noted that eye guidance processing may be applied in which the degree of emphasis is higher than that of the static effect, and an effect accompanied by a dynamic change in the mode of emphasis is applied. Effects that involve dynamic changes in the mode of emphasis are sometimes described as dynamic effects. An example of visual guidance processing that provides a dynamic effect will be described below.

<Example of line-of-sight guidance processing (dynamic effect)>
For example, in the first example, the processing unit 102 may cause the LED 171 to blink. Also, the processing unit 102 may periodically change the color of light emitted from the LED 171 .

For example, in the second example, the processing unit 102 may change the brightness of the outer frame of the display area of the right side display 17 over time, or may change the range and/or position of the brightness change range. may change over time.

In the third example, the processing unit 102 may change the magnitude of the luminance difference over time, or change the size and/or position of the area to which the luminance difference is applied over time. can be changed by

In the fourth example, the processing unit 102 may change the brightness of the outer frame of the display area of the right side display 17 over time, or may change the range and/or position of the brightness change range. may change over time.

For example, an example of dynamic display change based on the fourth example will be described.

FIG. 4 is a diagram showing a fifth example of visual guidance processing according to the present embodiment. FIG. 4 shows display patterns of pattern a and pattern b on the right side display 17 .

In pattern a, the outer periphery (frame S) of the first area is displayed with high luminance. In pattern b, of the sides of the outer circumference of the third area, the side portions excluding the outer circumference (frame S) of the first area are displayed with high luminance.

The processing unit 102 may perform visual guidance processing in which display of pattern a and display of pattern b are alternately repeated. In this case, the processing unit 102 may change the alternately repeating period according to the passage of time. For example, the processing unit 102 may gradually lengthen or shorten the cycle.

Note that FIG. 4 illustrates an example of dynamic change in which two display patterns are alternately displayed, but in dynamic display, three or more display patterns may be sequentially and periodically displayed.

By performing dynamic display in this way, the driver's attention can be attracted and the driver's line of sight can be more effectively guided to the display.

Note that when performing dynamic display, the processing unit 102 can guide the line of sight by the movement of the display, so the difference in luminance may be smaller than in the static display (for example, FIG. 3C). By reducing the luminance difference and dynamically changing the position and size of the area where the luminance difference is applied, the driver's line of sight is more effective while suppressing the visual stimulus to the driver. You can navigate to the display.

In addition, the dynamic display change may be linked with information regarding the operation of the vehicle. In the following, an example in which the display dynamically changes in conjunction with the information related to blinker operation will be described.

FIG. 5 is a diagram showing a sixth example of visual guidance processing according to the present embodiment. FIG. 5 shows a display example of the right side display 17 and a lamp La indicating blinker operation displayed on the instrument panel provided in front of the steering wheel of the vehicle.

A lamp La indicating the operation of the blinker blinks according to the operation of the blinker lever 14 by the driver. For example, the processing unit 102 performs a process of synchronizing the blinking period of the lamp La indicating blinker operation (the period of repeating lighting and extinguishing) with the period of dynamic change.

In the example of FIG. 5, the processing unit 102 provides a difference between the luminance of the first area and the luminance of the third area in the same manner as in FIG. No effect is given when the lamp La indicating the blinker operation is extinguished.

In the example of FIG. 5, an example was described in which the dynamic display change was interlocked with the blinking of the lamp La indicating the operation of the blinker. may be linked with For example, the period of the sound indicating the turn signal operation (relay sound) may be synchronized with the period of the dynamic display.

By linking the dynamic display change with the information about the operation of the vehicle, for example, the driver can intuitively understand that the display is changing in conjunction with the driver's operation. Therefore, it is possible to prevent the driver from misunderstanding the display on the display as, for example, another warning.

Note that the dynamic display change is not limited to the example in which the two displays shown in FIGS. 4 and 5 are alternately repeated. In the following, as an example of the line-of-sight guidance processing, an example in which animation processing that continuously and dynamically changes is performed will be described.

FIG. 6 is a diagram showing a first example of animation of visual guidance processing according to the present embodiment. FIG. 6 shows four display patterns, pattern c to pattern f, on the right side display 17 and arrows indicating an example of transitions between the patterns.

Pattern c is a display example when the visual field range expansion process is not executed. When the visual field range expansion process is not executed, the right rear area (first area) of the vehicle is displayed on the right side display 17 .

Pattern d is a first display example when the visual field range expansion process is executed. In pattern d, the brightness of the third area shown outside the frame S is set higher than the brightness of the area (first area) on the right rear side of the vehicle shown inside the frame S. FIG. In this case, the luminance boundary corresponds to the frame S. In FIG. 6, the fact that the luminance of the third area is set higher than the luminance of the first area is indicated by hatching the portion of the first area. The control may be such that the brightness of the third area is set higher than the reference value while the brightness remains at the reference value.

After the pattern d is displayed, an animation is performed in which the luminance boundary is expanded from the frame S toward the outer frame of the display area of the right side display 17 .

Pattern e is a second display example when the visual field range expansion process is executed. The luminance boundary of the pattern e extends toward the outer frame of the display area of the right side display 17 more than the luminance boundary of the pattern d.

Pattern f is a third display example when the visual field range expansion process is executed. The luminance boundary of the pattern f spreads toward the outer frame of the display area of the right side display 17 more than the luminance boundary of the pattern e.

After the pattern f is displayed, the right side display 17 returns to the display shown in the pattern d through the display in which the luminance boundary is removed, and again the luminance boundary is moved from the frame S to the display area of the right side display 17. Perform an animation that spreads toward the outer frame.

Note that FIG. 6 illustrates an example in which the visibility in the display area of the display is differentiated by providing a luminance difference, but the method of providing a visibility difference is not limited to the luminance difference. Another example of giving a difference in visibility within the display area will be described below.

FIG. 7 is a diagram showing a second example of animation of visual guidance processing according to the present embodiment. FIG. 7 shows four display patterns from pattern g to pattern j on the right side display 17 and arrows indicating an example of transitions between the patterns.

Pattern g is a display example when the visual field range expansion process is not executed. When the visual field range expansion process is not executed, the right rear area (first area) of the vehicle is displayed on the right side display 17 .

After the pattern g is displayed, the visual field range expansion process is executed to display the expanded visual field. In addition, the line-of-sight guidance processing for the display of the enlarged field of view is executed.

Pattern h is a first display example when visual guidance processing is being performed. In the pattern h, a translucent L-shaped band (corresponding to the hatched portion) is superimposed on the third area shown outside the frame S and displayed. In the area where the semi-transparent L-shaped band is superimposed, the display of the road surface and the like is seen through.

After the pattern h is displayed, an animation is performed in which the translucent L-shaped strip is narrowed toward the outer frame of the display area of the right side display 17 .

Pattern i is a second display example when visual guidance processing is being performed. The transflective L-shaped band of pattern i is narrower toward the outer frame of the display area of right side display 17 than pattern h.

Pattern j is a third display example when visual guidance processing is being performed. The transflective L-shaped strip of pattern j is narrower than pattern i toward the outer frame of the display area of right side display 17 .

After the pattern j is displayed, the right side display 17 returns to the display shown in pattern g after the display without the semi-transparent L-shaped band, and the semi-transparent L-shaped band is again framed. An animation of narrowing from S toward the outer frame of the display area of the right side display 17 is performed.

Note that FIGS. 6 and 7 have described examples of animations that give a difference in visibility within the display area of the display. In this example, since the animation does not hide the display in the display area, the driver can visually recognize the display of the enlarged field of view without delay.

Note that although FIGS. 6 and 7 illustrate an example of animation that gives a difference in visibility within the display area of the display, an animation that does not give a difference in visibility may be used. An example in which no difference in visibility is provided within the display area will be described below.

FIG. 8 is a diagram showing a third example of animation of visual guidance processing according to the present embodiment. FIG. 8 shows four display patterns from pattern k to pattern n on the right side display 17 and arrows indicating an example of transitions between the patterns.

Pattern k is a display example when the visual field range expansion process is not executed. When the visual field range expansion process is not executed, the right rear area (first area) of the vehicle is displayed on the right side display 17 .

After displaying the pattern k, the visual field range expansion process is executed to display the expanded visual field. In addition, the line-of-sight guidance processing for the display of the enlarged field of view is executed.

Pattern l is a first display example when visual guidance processing is being performed. In pattern l, a frame line is displayed in a frame S surrounding the right rear area (first area) of the vehicle. The frame line corresponds to a boundary line that divides the display area of the right side display 17 into two. The frame line is a line with high brightness and has a predetermined width. This frame line may be translucent so as not to hide the background, or it may be a dashed line instead of a solid line to reduce the extent to which the background is hidden. Also, for the frame line, a line with low luminance may be used instead of a line with high luminance.

After pattern l is displayed, an animation is performed in which the position of the frame line is expanded toward the outer frame of the display area of the right side display 17 .

Pattern m is a second display example when visual guidance processing is being performed. The position of the frame line of pattern m is wider toward the outer frame of the display area of right side display 17 than pattern l.

Pattern n is a third display example when visual guidance processing is being performed. The position of the frame line of pattern n is wider toward the outer frame of the display area of right side display 17 than pattern m.

After the display of pattern n, the right side display 17 returns to the display shown in pattern l after displaying the state in which the frame line matches the outer frame of the display area. Performs an animation that expands toward the outer frame of the display area of .

In FIG. 8, the animation does not affect the visibility in the display area of the display, and the animation does not hide the display in the display area. , can prevent oversight.

The processing unit 102 may perform visual guidance processing that periodically repeats the animation shown in FIG. 6, FIG. 7, or FIG. In this case, the processing unit 102 may change the cycle of repeating the animation over time. For example, the processing unit 102 may gradually lengthen or shorten the cycle.

In addition, the processing unit 102 may execute the cycle of repeating the animation in conjunction with the information regarding the operation of the vehicle.

For example, the processing unit 102 may synchronize the period of blinking of the lamp indicating the operation of the blinker (the period of repeating turning on and off) and the period of repeating the animation, or may synchronize the period of repeating the animation with the period of the sound indicating the operation of the blinker (relay sound). You may synchronize with the period which repeats an animation.

Note that the line-of-sight guidance processing may be a combination of two or more of the examples of static effects and/or examples of dynamic effects described above. An example of combination will be described with reference to FIG.

FIG. 9 is a diagram showing an example of combinations of effects in this embodiment. In FIG. 9, as in FIG. 3A, the LED 171 blinks, and in the same manner as in FIG. ) is displayed with high brightness.

For example, in the display shown in FIG. 9, blinking of the LED 171 and the region T may be synchronized or homogenized. For example, the color for blinking the LED 171 and the color of the area T may be set to the same color. Also, for example, the increase and decrease of the brightness of the region T and the increase and decrease of the brightness of the LED 171 may be synchronized.

The display shown in FIG. 9 can inform the driver that the destination of the driver's line of sight guided by the LED 171 is in the area T, so that the driver can be informed that the visual field range is being expanded. can be communicated more efficiently.

Note that instead of displaying the region T with high brightness, the other static effects described above may be applied, or dynamic effects (for example, any one or more of FIGS. 6 to 8) may be applied. good too.

<Stopping and changing the line-of-sight guidance process>
Next, an example of stopping and changing the visual guidance processing described above will be described. For example, the processing unit 102 may continue the line-of-sight guidance process until a predetermined condition is satisfied, and may stop when the condition is satisfied.

For example, the processing unit 102 may stop the visual guidance processing when a predetermined time has passed. Alternatively, the processing unit 102 may stop the line-of-sight guidance process when a predetermined operation is performed by the driver. Here, the predetermined operation includes, for example, an operation by the driver to rotate the steering wheel by a predetermined angle or more, or an operation by the driver to return the winker lever 14 to the neutral position.

In this way, the processing unit 102 stops the line-of-sight guidance process based on the elapsed time or the driver's operation, thereby shortening the duration of the line-of-sight guidance process.

Further, when the control system 1 described above includes a configuration for detecting the direction of the line of sight of the driver, the processing unit 102 may continue or stop the line of sight guidance processing according to the line of sight of the driver. .

For example, the processing unit 102 may continue the line-of-sight guidance processing until it is detected that the driver's line of sight is directed in the direction in which the right side display 17 is installed. Then, when it is detected that the driver's line of sight is directed toward the direction in which the right side display 17 is installed, the processing unit 102 may stop the line of sight guidance processing for the right side display 17 .

In this way, the processing unit 102 stops the line-of-sight guidance processing based on the line of sight of the driver, thereby shortening the duration of the line-of-sight guidance processing and suppressing the visual stimulus to the driver.

Note that if the control system 1 includes a configuration for detecting the direction of the line of sight of the driver, the processing unit 102 detects the line of sight of the driver even when the condition for starting the line of sight guidance processing is satisfied. Accordingly, it may be determined whether or not to start the line-of-sight guidance process.

For example, when it is detected that the line of sight of the driver is directed in the direction in which the right side display 17 is installed, the processing unit 102 does not need to start the line of sight guidance processing.

Further, when it is not detected that the driver's line of sight is directed in the direction in which the right side display 17 is installed, the processing unit 102 may start the line-of-sight guidance process. Then, when it is detected that the line of sight of the driver is directed in the direction in which the right side display 17 is installed after the visual guidance processing is started, the processing unit 102 may stop the visual guidance processing.

In this way, by determining whether or not to start the line-of-sight guidance process based on the line of sight of the driver, the line-of-sight guidance process can be started in a situation where the line-of-sight guidance process should be performed. It is possible to avoid starting the visual guidance process in good circumstances. As a result, for example, it is possible to prevent the driver from feeling annoyed when his/her eyes are already directed to the relevant display (the right side display 17 in the above description).

In the above description, an example has been described in which the visual line guidance process is continued or stopped depending on the time that has elapsed since the start of the visual line guidance process or the detected direction of the line of sight of the driver. For example, the line-of-sight guidance process may be changed according to the elapsed time after starting the line-of-sight guidance process or the detected direction of the line of sight of the driver.

As already explained, a static effect is one in which there is no dynamic change in the mode of emphasis in the display area of the display, and the visual stimulus given to the driver is relatively weak. On the other hand, the dynamic effect involves a dynamic change in the mode of emphasis in the display area of the display, and the visual stimulus given to the driver is relatively strong.

For example, the processing unit 102 executes visual guidance processing that applies a dynamic effect until the first predetermined time elapses, and performs visual guidance processing that applies a static effect after the first predetermined time elapses. You can switch. Also, the processing unit 102 may stop the line-of-sight guidance process after a second predetermined time longer than the first predetermined time has passed.

Further, when the control system 1 includes a configuration for detecting the direction of the line of sight of the driver, the processing unit 102 performs a process of applying a dynamic effect and a process of applying a static effect according to the detection result of the line of sight. may be changed.

While it is not detected that the line of sight of the driver is directed to the direction in which the right side display 17 is installed, the processing unit 102 executes the line of sight guidance processing that gives a dynamic effect, and the line of sight of the driver is directed to the right side. When it is detected that the display 17 is directed in the direction in which the display 17 is installed, the line-of-sight guidance process may be switched to give a static effect.

If the control system 1 includes a configuration for detecting the direction of the line of sight of the driver, for example, the controller 10 stops or changes the line-of-sight guidance process in accordance with the timing at which the direction of the line of sight of the driver is detected. you can

For example, the detection unit 101 calculates the reaction time from the timing at which the line-of-sight guidance process is started to the timing at which the driver's line of sight is directed in the direction in which the corresponding display is installed. Further, the detection unit 101 counts the number of visual field range expansion processes executed from the start of operation, and stores the visual field range expansion processes and reaction times in association with each other. The processing unit 102 estimates whether or not the visual field range expansion process has been recognized by the driver based on the number of visual field range expansion processes and the reaction time.

For example, if the reaction time is less than or equal to a predetermined value (for example, 0.3 seconds), it may be determined that the driver is not moving his or her line of sight as prompted by the line-of-sight guidance process. Then, if the visual field range expansion process associated with the reaction time that satisfies the condition of a predetermined value or less continues for a predetermined number of times (for example, three times) or more, it is determined that the driver has a habit of checking the display. you can Also, in this case, it may be determined that the driver is aware that the visual field range expansion process will be executed in conjunction with the operation of the turn signal lever 14 .

Based on such a determination, for example, the processing unit 102, when the visual field range expansion process associated with the reaction time satisfying the condition of being equal to or less than a predetermined value continues for a predetermined number of times or more, statically performs the process of giving a dynamic effect. It may be changed to a process that gives a similar effect. Alternatively, in this case, the processing unit 102 may not perform the line-of-sight guidance process regardless of the operation of the turn signal lever 14 . Alternatively, in this case, the processing unit 102 may turn on or turn off the LED instead of blinking it.

In this way, excessive or unnecessary visual guidance processing can be restricted by determining whether the driver has become accustomed to checking the display based on the reaction time. At this time, the controller 10 may store, in the storage unit or the like, the determination result that the driver has a habit of checking the display. Further, the condition for holding the determination result may be changed according to the mode of operation of the vehicle (for example, whether or not the driver who uses the vehicle changes). For example, when the vehicle is a route bus and there is a change of driver, holding of the determination result may be stopped. The timing to stop holding the determination result may be, for example, when the change of driver is recognized (for example, when the driver turns off the engine of the route bus). In addition, if the vehicle is a privately owned vehicle and there is no driver change, the determination result may be retained even after the engine is turned off. When the determination result is held, the controller 10 may execute the visual guidance process for a predetermined number of times after starting the engine each time, and may perform control such that the visual guidance process is not executed thereafter. If the driver is accustomed to checking the display, even if control is applied to avoid annoying the driver by not executing the line-of-sight guidance process or reducing the frequency of execution. good.

Note that the predetermined value (0.3 seconds in the above description) for the reaction time differs according to the age, sex, etc. of the person, and thus may be set according to the driver. Alternatively, the predetermined value for the reaction time may be set for each vehicle type in consideration of the characteristics and/or preferences of the assumed driver.

Note that the configuration for detecting the direction of the line of sight of the driver is not particularly limited. For example, the left side display 16 and the right side display 17 in the present embodiment are installed at positions close to conventional side mirrors so as not to give a sense of discomfort to the user (for example, the driver) of the vehicle. In this case, the left side display 16 and the right side display 17 are provided in a direction greatly different from the line of sight of the driver when he or she is checking the front. Therefore, the configuration for detecting the direction of the line of sight may be, for example, a configuration that specifies the azimuth angle in a two-dimensional plane while omitting the identification of the elevation angle among the azimuth angle and elevation angle in the three-dimensional space of the line of sight. Note that instead of the configuration for detecting the direction of the line of sight of the driver, a configuration for detecting the orientation of the face of the driver may be used.

In addition, the processing unit 102 may stop the visual guidance processing or change the visual guidance processing based on the operating state of the steering wheel by the driver.

For example, when the detection unit 101 detects that the steering angle of the steering wheel has reached or exceeded a predetermined value while visual guidance processing is being performed to provide a dynamic effect, the processing unit 102 stops the visual guidance processing. You can Alternatively, in this case, the processing unit 102 may change the line-of-sight guidance process that gives a dynamic effect to the line-of-sight guidance process that gives a static effect. For example, in this case, the processing unit 102 may change the LED from blinking to static lighting.

The case where the steering angle of the steering wheel becomes equal to or greater than a predetermined value corresponds to, for example, the case where the vehicle is turning left or right or changing lanes. It is required to pay attention to the direction to do. Stopping or changing the line-of-sight guidance process is a control for not guiding the driver's line of sight unnecessarily during this period.

Further, the processing unit 102 may stop the visual guidance processing or change the visual guidance processing based on the navigation information including the vehicle position information and the map information. For example, the detection unit 101 detects the position of the vehicle in the lane based on the navigation information, and the processing unit 102 may stop the visual guidance processing based on the detection result, or may stop the visual guidance processing. You can change it.

For example, when the detection unit 101 detects that the vehicle is approaching a lane marking or that the vehicle is crossing the lane marking in a state in which visual guidance processing that provides a dynamic effect is being executed, the processing unit 102 may stop the visual guidance process. Alternatively, in this case, the processing unit 102 may change the line-of-sight guidance process that gives a dynamic effect to the line-of-sight guidance process that gives a static effect. For example, in this case, the processing unit 102 may change the LED from blinking to static lighting.

Note that the visual field range expansion processing may be temporarily canceled, for example, based on the driver's operation or the like. For example, in a state in which the turn signal is activated, the expanded field of view and the normal field of view may be switched based on the driver's operation or the like. In such a case, the line-of-sight guidance processing for the initially displayed expanded field of view display and the line-of-sight guidance processing for the expanded field of view displayed again after the expanded field of view is changed to the normal field of view may be different. .

For example, the processing unit 102 may apply a dynamic effect once (for example, for one cycle) to the display of the enlarged field of view that is displayed again, and then stop the visual guidance processing. Alternatively, the processing unit 102 may perform visual guidance processing that provides a static effect. In that case, the processing unit 102 may statically turn on the LED without blinking it. Alternatively, control may be performed so that the gaze guidance process is not performed for the display of the expanded field of view after recovery from the temporary cancellation based on the driver's operation or the like.

Processing for temporarily canceling the visual field range expansion processing based on the driver's operation or the like will be described later.

In the present embodiment described above, the controller (control device) 10 includes a detection unit 101 that detects the operation of the turn signal lever 14 provided in the vehicle, and a camera (photographing device) provided in the vehicle. and a processing unit 102 that performs image processing and causes a display (display device) provided in the vehicle to display the image. Then, when the detection unit 101 detects that the turn signal lever 14 is operated to the left or right, the processing unit 102 changes the area of the visual field range displayed on the display corresponding to the operation direction (left or right) to the operation direction (left or right). A visual field range expansion process (switching process) is performed to switch from the area behind to the area including the area located laterally behind the area adjacent to the rear area. In addition, the processing unit 102 executes presentation processing (first presentation processing) for notifying the driver of the vehicle that the visual field range expansion processing (switching processing) is being performed.

With this configuration, even when the visual field range expansion process for changing the area displayed on the display (display device) is executed, by informing the driver of the vehicle that the visual field range expansion process is being executed. Since the driver can be made aware that the visual field range is being expanded, the driver can confirm the change in the area displayed on the display device. Therefore, for example, it is possible to avoid a situation in which the following vehicle erroneously recognizes that the change in the area displayed on the display has moved away.

For example, even if the configuration indicates that the display is changing by gradually changing the viewing range of the area displayed on the display (display device), the driver cannot confirm the gradual change. Otherwise, a situation may occur in which the following vehicle misunderstands that it has moved away. In addition, when the visual field range of the region is changed in stages, a time delay occurs before the visual field range is sufficiently expanded, and the driver's confirmation of safety is delayed.

In the configuration of the present embodiment, the line of sight of the driver can be guided to the display in order to inform the driver that the viewing range is being expanded. Changes can be identified and misleading situations can be avoided. In addition, the driver can confirm the change in the area displayed on the display device without changing the visual field range of the area step by step, so that it is possible to avoid delays in confirming safety.

In addition, in this configuration, for example, since the line-of-sight guidance process is executed in conjunction with the driver's operation such as the operation of the turn signal lever 14, it is possible to prevent the driver from mistakenly recognizing the line-of-sight guidance process as another warning. .

For example, as a configuration for guiding the line of sight, there is a configuration that blinks an LED installed near a side mirror or the like in the direction in which the object is approaching when an approaching object with a risk of collision is detected while the vehicle is running. In this configuration, in order to preferentially notify the driver that there is a risk of collision, the driver is provided with an optical stimulus that attracts the driver's eyes regardless of whether or not the driver feels abnormal.

For example, when the driver changes lanes while traveling in a lane in which there is a preceding vehicle near the front, the driver operates the turn signal lever 14 to indicate the intention of the lane change to the surroundings and to move ahead. After checking, check the rear and side rear.

In such a lane change situation, for example, if a configuration is applied in which an optical stimulus that makes the driver feel abnormal as described above is applied, the driver may feel annoyed by the optical stimulus.

On the other hand, according to the present embodiment, since the line-of-sight guidance processing is executed in conjunction with the driver's operation, the driver can intuitively understand the line-of-sight guidance processing without feeling that it is troublesome, and the driver can easily understand the line-of-sight guidance processing. Misidentification as a warning can be avoided.

For example, if the process of continuously enlarging or shrinking the outer frame of the display of the expanded field of view is performed on the display as a process to guide the line of sight, the expanded field of view is displayed until the process is completed. It may not be possible to check the whole, and it may take extra time.

In the present embodiment, in the line-of-sight guidance processing, the display of the enlarged field of view is displayed in the entire display area of the display, and the visibility is different in the enlarged field of view, or the camera image is not hidden, such as by providing a frame. I do. In this process, the camera image in the display area is not hidden, so the driver can visually recognize the display of the enlarged field of view without delay.

Further, for example, in the case of performing a process of displaying a normal field of view by obscuring a part of the expanded field of view as a process of guiding the line of sight by providing a difference in visibility, the expanded field of view and the normal field of view are displayed at the same magnification. Therefore, if the processing for making the image less noticeable is stopped, the entire enlarged field of view can be confirmed. However, this process uses a significantly smaller area compared to the size of the display area of the display when restricting a portion of the expanded field of view to display the normal field of view, so only a small image can be displayed. As a result, the image of the rear vehicle in the normal field of view that appears in the small image also becomes small, resulting in poor visibility.

Further, in the present embodiment, when the normal visual field is displayed, the magnification is increased for display, so that deterioration of the visibility of the normal visual field can be prevented. In addition, since the display is not hidden in the visual guidance processing, the driver can visually recognize the display of the enlarged field of view without delay.

(Variation of one embodiment)
<Cancellation processing for expanding the visual field range>
In the above example, when the detection unit 101 detects the first action of the driver, the processing unit 102 shifts the area of the image displayed on the right side display 17 from the first area to the second area. An example of the changing visual field range expansion processing has been described. Next, the visual field range expansion process and the process of changing the area of the image displayed on the right side display 17 from the second area to the first area are switched according to the operation or action of the driver. An example will be described. The process of changing from the second area to the first area may be regarded as the process of canceling the expansion of the visual field range (hereinafter referred to as canceling process).

FIG. 10 is a diagram showing an example of the structure of winker lever 14 in the present embodiment. FIG. 10 shows the relationship between the three positions where the winker lever 14 is fixed and the movable range of the winker lever 14 .

As described above, the winker lever 14 stops at any one of the neutral position, the right click position, and the left click position.

The tilting angle and/or torque of the winker lever 14 may be detected by a sensor and output to the controller 10 .

For example, when the winker lever 14 is pushed clockwise beyond the right click position, a spring mechanism (not shown) of the winker lever 14 operates to return the winker lever 14 to the right click position. Since the angle of the turn signal lever 14 is determined by the force applied by the driver and the repulsive force of the spring, the torque is detected from the angle. Note that the state in which the winker lever 14 is pushed more clockwise than the right-click position is sometimes referred to as a state in which it is pushed further clockwise.

Instead of detecting the angle, the position of the winker lever 14 and the torque directly detected by the pressure sensor of the winker lever 14 may be output to the controller 10 .

The detection unit 101 of the controller 10 estimates the intention of the driver based on information on the operation of the winker lever 14 (for example, at least one of the position, angle and torque of the winker lever 14). Here, the intention of the driver may be, for example, the intention of which area around the vehicle the driver wants to check.

For example, when the turn signal lever 14 is changed from the neutral position to the right click position, the detection unit 101 estimates that the driver wants to check the enlarged field of view on the rear right side.

Further, for example, when the angle of the turn signal lever 14 is further changed to a clockwise angle from the right click position and this state continues for a predetermined time or longer, the detection unit 101 detects that the driver is in the enlarged field of view on the right rear side. Assume that you want to cancel the display. In other words, in this case, the detection unit 101 estimates that the driver wants to check the area of the normal visual field on the rear right.

Here, the above-mentioned predetermined time may be 0.3 seconds, for example. 0.3 seconds corresponds to a human reaction time. For example, the reaction time from when a person feels a click at the right click position to when he/she stops pressing the turn signal lever 14 is about 0.3 seconds. In other words, when the angle of the turn signal lever 14 is changed further clockwise from the right click position and this state continues for 0.3 seconds or longer, the turn signal lever 14 is turned on after the person feels the click at the right click position. It is presumed that the action of pushing the lever 14 is performed intentionally.

Further, for example, when the winker lever 14 passes from the neutral position to the right-click position without stopping and then remains in a state of moving to a clockwise angle, the detection unit 101 detects that the driver blinks the winker lamp. Assume that you want to check the area of the normal visual field on the right rear in the state.

Then, for example, when the driver wants to check the area of the enlarged field of view on the rear right side, by releasing the hand from the turn signal lever 14, the turn signal lever 14 returns to the right click position, and the right rear display 17 shows the A region of expanded field of view (eg, the display shown in FIG. 2B) is displayed.

FIG. 11 is a diagram showing an example of the relationship between the operation of winker lever 14 and the display on right side display 17 in the present embodiment.

In FIG. 11, when the winker lever 14 is in the neutral position, the normal field of view similar to the example shown in FIG. 2A is displayed on the right side display 17. In FIG.

When the driver tilts the winker lever 14 to the right and the winker lever 14 moves from the neutral position to the right click position, an enlarged field of view similar to the example shown in FIG. 2B is displayed on the right side display 17 . In this state, if the driver returns the winker lever 14 to the neutral position, or if the winker lever 14 is returned to the neutral position by another operation of the driver (for example, steering wheel operation), the right side display 17 display returns to the normal field of view.

Further, when the driver fully pushes the turn signal lever 14 clockwise after the enlarged field of view is displayed, the normal field of view similar to the example shown in FIG. 17. In addition, when the driver releases the hand from the fully pressed state in the clockwise direction, the turn signal lever returns to the neutral position, and the display on the right side display 17 returns from the normal field of view to the enlarged field of view.

Also, when the driver tilts the turn signal lever 14 to the right and further pushes it clockwise, the display on the right side display 17 does not change to the enlarged field of view while the driver is pushing it clockwise. Maintain your vision. In addition, when the driver releases the hand from the fully pressed state in the clockwise direction, the turn signal lever returns to the neutral position, and the display on the right side display 17 returns from the normal field of view to the enlarged field of view.

In the above description, when the turn signal lever 14 is at the right click position, the enlarged field of view is displayed on the right side display 17, and when the turn signal lever 14 is fully pushed clockwise, the right side display An example in which the normal field of view is displayed in 17 has been described. In other words, the operation of moving to the right-click position corresponds to the operation for performing the visual field range expansion process, and the operation of fully pressing clockwise corresponds to the operation to cancel the visual field range expansion process.

However, the disclosure is not so limited. For example, when the turn signal lever 14 is at the right-click position, the normal field of view is displayed, and when the turn signal lever 14 is pushed clockwise from the right-click position, the enlarged field of view is displayed. good. In other words, the operation of deep pressing clockwise may correspond to the operation for performing the visual field range expansion process, and the operation of moving to the right click position may correspond to the operation to cancel the visual field range expansion process. .

For example, the user (driver) may be able to select the correspondence relationship between the operation of the winker lever 14 and the display processing of the display. For example, the driver selects one of two operations, that is, an operation of deep-pressing clockwise and an operation of moving to the right-click position, as an operation for expanding the visual field range, and selects the other operation. It may be selected as an operation for canceling the viewing range expansion process. This selection may be made, for example, via an operating unit such as a touch panel or buttons provided in the vehicle compartment.

In the above description, an example in which the operation for canceling the visual field range expansion processing is the operation of deep pressing in the clockwise direction or the operation of moving to the right-click position has been described. The present disclosure is not limited to this. For example, the process of canceling the viewing range expansion process may be executed according to information from various sensors provided in the vehicle.

For example, if a sensor that detects the position and/or movement of the driver's head is provided inside the vehicle, the controller 10 may cancel the visual field range expansion process according to the driver's head position. For example, when the detection unit 101 of the controller 10 detects that the driver shakes his head (or changes the position of his head), the processing unit 102 may cancel the visual field range expansion process. Specifically, when the driver moves his/her head toward the display during execution of the visual field range expansion process (while the expanded visual field is being displayed), the controller 10 causes the driver to execute the visual field range expansion process. It is also possible to assume that the user wants to check the rearward image portion that has become smaller due to , cancel the visual field range expansion processing, and enlarge the rearward image portion.

Further, when a pressure sensor is provided on the steering wheel, the controller 10 may cancel the visual field range expansion processing according to the driver's operation on the steering wheel. For example, when the detection unit 101 of the controller 10 detects that a force is applied to a predetermined position of the steering wheel, the processing unit 102 may cancel the visual field range expansion processing. As a result, for example, the driver can cancel the viewing range expansion processing by firmly gripping a predetermined position of the steering wheel or pressing a predetermined position.

10 and 11, an example has been described in which the visual field range expansion process or the process of canceling the visual field range expansion process is performed in accordance with the information on the operation of the turn signal lever 14. FIG. The present disclosure is not limited to this. For example, the controller 10 may perform processing for changing the direction of the displayed field of view according to the operation of the turn signal lever 14 .

For example, the controller 10 may change the direction of the field of view according to the torque of the turn signal lever 14 being pushed all the way down. For example, the detection unit 101 detects the torque of the full push of the turn signal lever 14, and the processing unit 102 adjusts the visual field range in the direction corresponding to the torque (or angle) of the full push of the turn signal lever 14 to the same magnification as the normal visual field. can be displayed with

FIG. 12 is a diagram showing an example of changing the visual field range when the vehicle is traveling near the merging point. FIG. 12 shows a bird's-eye view of a vehicle merging from the merging lane to the main lane at the merging point where the main lane and the lane in which the vehicle merging into the main lane intersects (hereinafter referred to as the merging lane). Then, the relationship between the operating state of the winker lever 14 and the visual field range displayed on the right side display 17 is shown.

In FIG. 12A, the driver does not operate the winker lever 14, that is, the winker lever 14 is in the neutral position, so the right side display 17 displays the normal field of view.

12A to 12B, the driver pushes the turn signal lever 14 to the right to signal that the vehicle is to merge into the right main lane, causing the right turn signal lamp to blink.

B in FIG. 12 corresponds to the case where the winker lever 14 is moved to the right click position. In this case, the enlarged field of view is displayed on the right side display 17 .

In FIGS. 12B to 12C, the driver pushes the turn signal lever 14 to the right (pushes it clockwise) in order to check the condition of the right main lane. The detection unit 101 detects the torque (or angle) of the full push of the winker lever 14 . The processing unit 102 changes the direction of the field of view according to the detected torque (or angle).

C in FIG. 12 corresponds to the case where the winker lever 14 is fully pushed clockwise from the right click position. In this case, on the right side display 17, the visual field range in the direction outside the normal visual field range (A in FIG. 12), which has been changed according to the torque (or angle) of the deep press, is displayed at the same magnification as the normal visual field. is displayed.

The processing unit 102 may cause the display to display a view range in a direction farther from the side of the vehicle as the torque of the deep push is greater.

In this manner, the controller 10 changes the direction of the field of view displayed on the display according to the torque (or angle) of the full push of the turn signal lever 14, so that the driver can efficiently check the surroundings of the vehicle. .

Note that the controller 10 may change the direction of the field of view to be displayed on the display according to the operation or motion of another driver instead of the torque (or angle) of the full push of the turn signal lever 14 .

For example, if a sensor for detecting the position of the driver's head or the direction of the line of sight is provided inside the vehicle, the controller 10 selects the direction of the field of view to be displayed on the display according to the position of the driver's head or the direction of the line of sight. You can change it. For example, when the detection unit 101 of the controller 10 detects the angle at which the driver shakes his head (or changes the position of his head, or changes the direction of his line of sight), the processing unit 102 detects the angle at which he shakes his head. to change the direction of the field of view displayed on the display. For example, the processing unit 102 may cause the display to display a visual field range in a direction farther from the side of the vehicle as the angle at which the head is shaken increases. When the driver checks the surroundings with the side mirrors, the range reflected in the side mirrors can be changed by changing the position of the driver's head. Even when the driver checks the surroundings using the display instead of the side mirrors, it can be said that it is natural for the driver that the controller 10 controls the visual range according to the change in the position of the head. Specifically, when the controller 10 detects that the driver has moved his or her head to the left, the controller 10 estimates that the driver wants to look in the right direction, and changes the direction of the displayed field of view to the right. Just do it. Alternatively, by detecting the direction of the driver's line of sight and gazing at the right side of the display, it is assumed that the driver wants to see the right side, and control is performed to change the direction of the displayed field of view to the right side. may

Further, when a pressure sensor is provided on the steering wheel, the controller 10 may change the direction of the field of view displayed on the display according to the driver's operation on the steering wheel. For example, when the detection unit 101 of the controller 10 detects that a force is applied at a predetermined position on the steering wheel, the processing unit 102 detects the direction of the field of view displayed on the display according to the magnitude of the force at the predetermined position. may be changed. For example, the processing unit 102 may cause the display to display a viewing range in a direction farther from the side of the vehicle as the force at the predetermined position is greater. Thereby, for example, the direction of the field of view shown on the display may be changed by the driver gripping or pressing a predetermined position on the steering wheel.

It should be noted that whether the function for changing the direction of the field of view (hereinafter sometimes referred to as the function of changing the direction of field of vision) according to the torque of the full push of the blinker lever 14 is enabled (whether to turn it on or off). ) may be configurable by the user (eg, the driver). Alternatively, whether or not to enable the viewing direction changing function may be set based on other information. Specifically, whether or not to enable the viewing direction changing function may be changed depending on the map information obtained by the navigation device and the position of the vehicle on the map.

For example, as shown in FIG. 12, a merging point corresponds to a place where it is more effective to use the viewing direction changing function for the driver to check the surrounding conditions.

For example, the processing unit 102 of the controller 10 determines whether the vehicle exists at a location (for example, a junction) where it is more effective to use the viewing direction change function based on navigation information including vehicle position information and map information. You can decide whether or not Then, the processing unit 102 may turn on the viewing direction changing function when the vehicle is present in a place where the viewing direction changing function is more effective.

In addition, when a parallel parked vehicle starts and merges into an adjacent lane, or when a vehicle parked in a parking lot starts and merges into a lane, the driver should check the surrounding conditions. Therefore, it is more effective if the viewing direction change function is used. For example, in this case, the vehicle merges into the lane while traveling at a low speed (for example, slowing down) from a stop, so the setting of the viewing direction changing function may be optimized according to the speed information of the vehicle.

For example, the processing unit 102 of the controller 10 may refer to the speed information of the vehicle and set the viewing direction change function to ON when the vehicle is stopped or slowing down. For example, when the speed of the vehicle is less than a predetermined value (for example, 5 km/h), the processing unit 102 sets the visual direction changing function to ON, and when the speed of the vehicle is equal to or higher than the predetermined value, the visual direction changing function is turned on. You can set it to off.

In addition, the processing unit 102 sets whether or not to enable the viewing direction change function based on vehicle speed information, navigation information, and information from a direction sensor (magnetic compass) that detects the attitude of the vehicle. good too.

For example, when a parallel parked vehicle starts and merges into an adjacent lane, or when a vehicle parked in a parking lot starts and merges into a lane, the direction of the vehicle is in the direction in which the lane extends. It may take a state of forming an angle of a predetermined angle or more. In that case, the processing unit 102 may turn on the viewing direction changing function when the vehicle travels at a low speed and the angle of the vehicle with respect to the lane is greater than or equal to a predetermined angle. The processing unit 102 determines whether the vehicle is traveling at a low speed, for example, by comparing the speed of the vehicle with a threshold value. The processing unit 102 also compares the direction in which the adjacent lane extends indicated by the navigation information and the direction of the vehicle indicated by the detection result of the direction sensor, thereby determining whether the angle of the vehicle with respect to the lane is greater than or equal to a predetermined angle.

As described above, by setting ON or OFF of the viewing direction changing function based on other information such as map information, the viewing direction changing function can be effectively used in situations where the viewing direction changing function should be used. can be done.

Since the viewing direction change function induces the user to look into the display, it is possible that the user will take their eyes off the front for a longer period of time. In addition, the view direction change function may interfere with confirmation of the normal view. Therefore, for example, it is desirable that the viewing direction changing function is not effective while the vehicle is traveling at a high speed. You can set it to off.

As described above, turning on or off the viewing direction changing function is set based on other information, so that the viewing direction changing function operates in situations where the viewing direction changing function is unnecessary (for example, while driving at high speed). can be prevented.

In the visual field direction changing function, an example of changing the visual field direction displayed on the display in accordance with the magnitude of the torque (or angle) when the turn signal lever 14 is pressed down has been described. may be determined based on

For example, at the confluence as shown in FIG. 12, the direction of the field of view may be determined based on the result of image processing.

For example, the detection unit 101 acquires navigation information indicating the current position of the vehicle and road conditions around the vehicle, and detects whether the vehicle is traveling near a junction.

When the vehicle is traveling near the merging point, the processing unit 102 changes the display according to the information on the operation of the turn signal lever 14 .

For example, the detection unit 101 of the controller 10 may detect the vanishing point (or point at infinity) of the lane, and change the visual field range according to the position of the detected vanishing point.

For example, the detection unit 101 detects a plurality of straight lines (or approximate straight lines) on the boundary line of one lane in the image captured by the left side camera 11 and/or the right side camera 12, and extends the detected straight lines rearward. do. The detection unit 101 determines a point at which the extended straight lines intersect as the vanishing point of the lane.

For example, when the vehicle is traveling near the merging point of a merging lane where the vehicle merges with the main line, the image includes the main lane and the merging lane. In this case, the detection unit 101 detects at least the vanishing point of the main lane.

Then, when the turn signal lever 14 is pushed all the way down, the processing unit 102 may display the field of view range in the direction of the vanishing point of the main lane extending in the direction corresponding to the direction of the full push at the same magnification as the normal field of view. .

FIG. 13 is a diagram showing an example of an image captured by the right-side camera 12 at a junction of roads. FIG. 13 includes a merging lane and a main lane extending to the right of the merging lane.

The detection unit 101 detects both the vanishing point of the merging lane and the vanishing point of the main lane from the image captured by the right side camera 12 . Then, when the turn signal lever 14 is fully pushed clockwise, the processing unit 102 may display the direction of the vanishing point of the main lane detected by the detection unit 101 at the same magnification as the normal field of view.

As described with reference to FIG. 13, at the meeting point, by changing the direction of the field of view according to the information of the operation of the turn signal lever 14 and/or the information of the vanishing point obtained from the image, It can support safety confirmation.

For example, when merging at a merging point, a sense of distance from vehicles traveling in the main lane is required for safety confirmation. Therefore, by switching between the enlarged field of view and the field of view in the direction in which the main lane can be confirmed according to the operation of the turn signal lever 14, effective display can be performed.

Note that the above-described visual field range expansion processing, processing for canceling the visual field range expansion processing, and processing based on the visual field direction changing function are not limited to the operation of the turn signal lever 14, and other operations by the driver or It may be performed in conjunction with other operations.

For example, when the detection unit 101 detects that the turn signal lever 14 has moved to the right-click position in a lane change situation, the processing unit 102 executes the visual field range expansion processing for the display on the right side display 17. do. When the detection unit 101 detects that the driver has pulled the steering wheel, the processing unit 102 cancels the visual field range expansion processing for the display on the right side display 17 . In this case, the action of the driver pulling the steering wheel may correspond to the action indicating the driver's intention to check the rear of the vehicle in detail. When the driver moves his/her head closer to the display in order to look into it, it pulls the steering wheel toward the driver's hand. natural and acceptable.

For example, when the detection unit 101 detects that the turn signal lever 14 has moved to the right-click position at the junction as shown in FIGS. to execute the visual field range expansion process. Then, when the detection unit 101 detects that the driver has pressed the steering wheel, the processing unit 102 changes the direction of the field of view displayed on the right side display 17 . For example, the processing unit 102 may change the direction away from the rear of the vehicle depending on the magnitude of the force applied to the steering wheel. Alternatively, the processing unit 102 may change the direction of the vanishing point to the outer side away from the rear of the vehicle. The outer vanishing point away from the rear of the vehicle corresponds to, for example, the vanishing point of the main lane in FIG. Further, in this case, the action of the driver pushing the steering wheel may correspond to the action indicating the driver's intention to check the main lane. The action of pulling the head backward is the opposite of the action of looking in, to obtain a wide field of view, and it is the action of pushing the steering wheel. It is a natural and acceptable means of controlling the viewing range.

Further, for example, when the detection unit 101 detects that the turn signal lever 14 has moved to the right click position in a lane change situation, the processing unit 102 performs visual field range expansion processing on the display on the right side display 17. to run. When the detection unit 101 detects that the driver's face has approached the right side display 17 , the processing unit 102 cancels the visual field range expansion processing for the display on the right side display 17 . In this case, the action of the driver bringing his/her face closer to the right side display 17 may correspond to the action indicating the driver's intention to check the rear of the vehicle in detail.

For example, when the detection unit 101 detects that the turn signal lever 14 has moved to the right-click position at the junction as shown in FIGS. to execute the visual field range expansion process. When the detection unit 101 detects that the driver has turned his or her head to the right at the position where the main line merges on the right side, the processing unit 102 changes the direction of the field of view to be displayed on the right side display 17. Change to the direction of the vanishing point of the main line. Alternatively, the processing unit 102 may change the direction of the field of view to be displayed according to the inclination of the driver's face detected by the detection unit 101 .

As described above, when the expanded visual field is displayed, the process of canceling the expansion of the visual field range can be executed while the blinker is in operation. can be grasped.

When changing lanes, it is effective to be able to check the side rear by displaying the enlarged field of view. For example, when changing lanes from the right lane to the middle lane on a three-lane road, there is a situation where another vehicle changes lanes from the left lane to the middle lane. In such a situation, the enlarged field of view display is effective because other vehicles in the left lane are not visible in the normal field of view.

In addition, there is a situation in which the driver has no choice but to stop the lane change by suddenly operating the steering wheel after discovering a rapidly approaching vehicle or a fallen object on the road while changing lanes. In such a situation, it is not preferable to continue the manual operation (for example, the operation of touching the blinker lever) for displaying the enlarged field of view.

In other words, it is desirable that the visual field range expansion processing continues even if the turn signal lever 14 is not touched while the turn signal is operating during lane change.

Further, for example, the Road Traffic Law requires that the blinker be operated from 3 seconds before the start of the lane change. There is a situation in which a vehicle rapidly approaching from behind appears within 3 seconds after the blinker is activated. In such a situation, it is desirable to reconfirm the rear and rear sides after about 3 seconds have passed since the blinker is operated and before starting the lane change.

In addition, since the normal visual field is the visual range in which the sense of distance to the following vehicle can be easily grasped, it is desirable to be able to change the visual field to the normal visual field when reconfirming the rear.

For example, if the process of canceling the expansion of the visual field range cannot be executed while the blinkers are operating, it may be necessary to temporarily stop the blinker operation in order to change to the normal visual field. However, the Road Traffic Law requires that the blinkers continue to operate until the lane change is completed. In addition, when the blinker operation is temporarily stopped, the drivers of the surrounding vehicles will judge that the lane change has been canceled. Therefore, once the blinker operation is stopped, after confirming the rear by the display of the normal field of view, if the blinker is activated again and the lane change is performed before 3 seconds have passed, it is a violation of the law and the lane change is prohibited. It may lead to accidental contact with surrounding vehicles that are considered abandoned.

In other words, it is desirable to switch between the display of the normal field of view for checking the rear and the display of the enlarged field of view for checking the rear side while maintaining the state that the turn signal is operating.

According to the above-described configuration, it is possible to switch between the display of the normal field of view for checking the rear and the display of the enlarged field of view for checking the rear side while maintaining the state that the turn signal is operating.

FIG. 14 is a flow chart showing an example of display processing according to the operation of the winker lever 14 in this embodiment. Note that the flowchart shown in FIG. 14 shows an example in which the controller 10 performs processing regarding the display on the right side display 17 . The flow chart for the processing of the display on the left side display 16 by the controller 10 is the same as in FIG. 14 except that the left and right directions are different.

Further, the flowchart shown in FIG. 14 shows an example in which the line-of-sight guidance processing is processing for lighting the LED 171 of the right side display 17 .

The detection unit 101 detects the neutral position of the winker lever 14 (S101).

The processing unit 102 causes the right side display 17 to display the normal field of view area, and controls the LED 171 to be in an off state (extinction state) (S102).

The detection unit 101 detects whether or not the winker lever 14 is in a state of being pressure-sensitive in a clockwise direction (S103). The clockwise pressure sensing state is a state in which the turn signal lever 14 is positioned between the neutral position and the right click position for less than a certain period of time (for example, 0.1 seconds), and is referred to as a half-pressed state. you can Alternatively, the clockwise pressure sensing state may be a state in which a force from the left side of the winker lever 14 is detected.

If the winker lever 14 is not pressure-sensitive clockwise (NO in S103), the process of S103 is executed.

If the winker lever 14 is in a state of being pressure-sensitive clockwise (YES in S103), the processing unit 102 causes the right side display 17 to display the normal field of view area, and turns on the LED 171 (lights up). ) (S104). The process of turning on the LED 171 in S104 corresponds to an example of the line-of-sight guidance process.

The detection unit 101 detects whether or not the winker lever 14 has moved to the right click position (S105).

If blinker lever 14 has not moved to the right click position (NO in S105), detection unit 101 detects whether pressure is being sensed clockwise (S106).

If the clockwise pressure is not sensed (NO in S106), the process of S102 is executed.

If the clockwise pressure is being sensed (YES in S106), the detection unit 101 detects whether or not this state has continued for a predetermined time (for example, 0.1 seconds) (S107).

If the clockwise pressure sensing state has not continued for a predetermined time (NO in S107), the flow proceeds to S104.

If the clockwise pressure sensing state continues for a predetermined time (YES in S107), the processing unit 102 causes the right side display 17 to display an expanded field of view, and turns on (lights) the LED 171 (S108). ). The process of displaying the enlarged field of view on the right side display 17 in S108 corresponds to an example of the field range expansion process, and the process of turning on the LED 171 corresponds to an example of the line of sight guidance process. Then, the process of S105 is executed.

When the winker lever 14 has moved to the right click position (YES in S105), the detection unit 101 determines whether or not to display the enlarged field of view on the right side display 17 (S109). For example, the detection unit 101 determines to display the enlarged field of view on the right side display 17 when the state of being pressed clockwise after moving to the right click position is less than a predetermined time (for example, 0.3 seconds). The detection unit 101 determines not to display the enlarged field of view on the right side display 17 when the state of being pushed clockwise after moving to the right click position is longer than a predetermined time (for example, 0.3 seconds).

When displaying the expanded field of view on the right side display 17 (YES in S109), the processing unit 102 displays the expanded field of view on the right side display 17 and turns on the LED 171 (lights up) (S110).

The detection unit 101 detects whether the winker lever 14 is in the neutral position (S111).

If winker lever 14 is in the neutral position (YES in S111), the process of S102 is executed.

If the winker lever 14 is not in the neutral position (NO in S111), that is, if the winker lever 14 is in the right click position, the detection unit 101 detects whether or not pressure is being sensed clockwise. (S112).

If the clockwise pressure is not sensed (NO in S112), the process of S110 is executed.

When the pressure is sensed clockwise (YES in S112), that is, when the right click position is fully pressed clockwise, the detection unit 101 detects that the state has been held for a predetermined time (for example, 0 .3 seconds) It is detected whether or not it has continued (S113).

If the clockwise pressure sensing state has not continued for a predetermined time (NO in S113), the process of S110 is executed.

If the clockwise pressure sensing state continues for a predetermined time (YES in S113), the processing unit 102 causes the right side display 17 to display the normal field of view, and turns off the LED 171 (turns off) (S114). ). The process of displaying the normal field of view in S114 corresponds to an example of the process of canceling the enlarged field of view displayed in S110. Then, the process of S111 is executed.

If the enlarged field of view is not displayed on the right side display 17 (NO in S109), the processing unit 102 displays the normal field of view on the right side display 17 and turns off the LED 171 (turns off) (S115).

The detection unit 101 detects whether the winker lever 14 is in the neutral position (S116).

If winker lever 14 is in the neutral position (YES in S116), the process of S102 is executed.

If the winker lever 14 is not in the neutral position (NO in S116), that is, if the winker lever 14 is in the right click position, the detection unit 101 detects whether or not pressure is being sensed clockwise. (S117).

If the clockwise pressure is being sensed (YES in S117), that is, if the winker lever 14 is fully pressed clockwise from the right click position, the process of S115 is executed.

If the clockwise pressure is not sensed (NO in S117), the detection unit 101 detects whether or not the state has continued for a predetermined time (for example, 0.1 seconds) (S118).

If the clockwise pressure has not been sensed for a predetermined period of time (YES in S118), the process of S110 is executed.

If the state in which clockwise pressure is not sensed has not continued for a predetermined period of time (NO in S118), processing unit 102 causes right side display 17 to display the normal field of view and turns off LED 171 (turns off LED 171). ) (S119). Then, the process of S116 is executed.

Next, two driving operation scenarios and an example of each process flow in the controller 10 will be described.

<First scenario of driving operation and flow of each process>
When the driver changes lanes to the lane on the right side of the traveling lane because the preceding vehicle is slow, the driver operates the winker lever 14 to the right click position to operate the right winker.

In this case, the detection unit 101 detects that the driver has touched the turn signal lever 14, and the processing unit 102 performs visual guidance processing of blinking the LED 171 of the right side display 17 based on the detection result.

The driver is guided by the flickering of the LED 171 and looks at the right side display 17 .

The processing unit 102 performs visual field range expansion processing for changing the display of the right side display 17 to display of an expanded visual field. Then, the processing unit 102 changes the blinking state of the LED 171 to the lighting state. In addition, the processing unit 102 performs processing indicating the expansion of the field of view, and gives a dynamic effect to the display of the expanded field of view.

After confirming the safety of the rear right side by the display of the enlarged field of view, the driver fully pushes the winker lever 14 clockwise from the right click position. The detection unit 101 detects that the winker lever 14 is fully pressed in the clockwise direction. Based on the detection result, the processing unit 102 cancels the expansion of the visual field range and displays the normal visual field on the right side display 17 . When displaying the normal field of view on the right side display 17, the processing unit 102 turns off the LED 171 and stops the dynamic effect for indicating the expanded field of view. In this state, the right winker is in an activated state (the winker lamp is blinking).

After confirming the safety of the rear right side by the display of the normal field of view, the driver releases the turn signal lever 14 and returns to the state of being fully pushed clockwise. The detection unit 101 detects that the turn signal lever 14 has been canceled and returned to the right click position. Based on the detection result, the processing unit 102 performs visual field range expansion processing for changing the display of the right side display 17 from the normal visual field to the expanded visual field display. In this case, the processing unit 102 lights up the LED 171 to give a static effect to indicate the expanded viewing range. In this state, the right winker is in an activated state.

The driver operates the steering wheel to initiate a lane change to the right lane. At this time, the right side display 17 is in a state where the expanded field of view is displayed, and the display of the expanded field of view is given a static effect. Moreover, the LED 171 is in a lighting state. In this case, the detection unit 101 may detect the steering angle of the steering wheel and the movement in the vehicle width direction.

When the driver determines that the lane change is completed, the driver returns the winker lever 14 to the neutral position, and the right winker stops. Detector 101 detects that turn signal lever 14 is in the neutral position. The processing unit 102 changes the display of the right side display 17 from the enlarged field of view to the normal field of view based on the detection result. Moreover, the processing unit 102 turns off the LED 171 based on the detection result.

<Second Scenario of Driving Operation and Process Flow>
The second scenario corresponds to, for example, a scenario in which the driver has already confirmed that there is no vehicle behind on the right side and wants to quickly change lanes.

When the driver changes lanes to the right lane of the lane in which the driver is driving because the vehicle being driven catches up with the preceding vehicle, the driver operates the turn signal lever 14 to operate the right turn signal. Let

When the driver has already confirmed that there is no vehicle on the right rear side and does not need to display the enlarged field of view on the right side display 17, the driver moves the turn signal lever 14 to the right click position to check the right rear side. Move at once (immediately) to the position where you pressed deeply clockwise.

The detection unit 101 detects that the driver has touched the turn signal lever 14 . The processing unit 102 performs visual guidance processing for turning on the LED 171 of the right side display 17 based on the detection result. The driver is guided by the lighting of the LED 171 and directs his/her gaze to the right side display 17 .

The detection unit 101 detects that the turn signal lever 14 is fully pressed in the clockwise direction within 0.1 seconds after it is detected that the driver has touched the turn signal lever 14 . Based on the detection result, the processing unit 102 immediately turns off the LED 171 that has been turned on. Further, the processing unit 102 skips the visual field range expansion processing and displays the normal visual field on the right side display 17 based on the detection result that the winker lever 14 is fully pressed in the clockwise direction. In this state, the right winker is in an activated state.

After confirming the safety of the rear right side by the display of the normal field of view, the driver releases the turn signal lever 14 and returns to the state of being fully pushed clockwise. The detection unit 101 detects that the turn signal lever 14 has been canceled and returned to the right click position. Based on the detection result, the processing unit 102 performs visual field range expansion processing for changing the display of the right side display 17 from the normal visual field to the expanded visual field display. In this case, the processing unit 102 lights up the LED 171 to give a static effect to indicate the expanded viewing range. In this state, the right winker is in an activated state. At this time, the driver can confirm the safety of the right side by displaying the enlarged field of view and decide whether to change lanes.

The driver operates the steering wheel to initiate a lane change to the right lane. At this time, the right side display 17 is in a state where the expanded field of view is displayed, and the display of the expanded field of view is given a static effect. Moreover, the LED 171 is in a lighting state. In this case, the detection unit 101 may detect the steering angle of the steering wheel and the movement in the vehicle width direction.

When the driver determines that the lane change is completed, the driver returns the winker lever 14 to the neutral position, and the right winker stops. Detector 101 detects that turn signal lever 14 is in the neutral position. The processing unit 102 changes the display of the right side display 17 from the enlarged field of view to the normal field of view based on the detection result. Moreover, the processing unit 102 turns off the LED 171 based on the detection result.

As described above, in the first scenario, the enlarged field of view is displayed on the right side display 17 in order for the driver to check the rear right side, and after the driver checks the rear right side, the field of view is changed to the normal field of view. In the second scenario, the display of the enlarged field of view on the right side display 17 is skipped because the driver puts off checking the rear right side. In this way, the controller 10 can perform display according to the driver's intention by operating the winker lever 14 based on the driver's intention of which area the driver wants to check.

Note that the notation "... section" in the radio section of the above embodiment may be "... circuitry", "... device", "... unit", or "... Other notations such as "module" may be substituted.

Also, the radio section, which is an example of each functional block used in the description of the above embodiments, is typically realized as an LSI, which is an integrated circuit. The integrated circuit may control each functional block used in the description of the above embodiments and may have inputs and outputs. These may be made into one chip individually, or may be made into one chip so as to include part or all of each functional block. Although LSI is used here, it may also be called IC, system LSI, super LSI, or ultra LSI depending on the degree of integration.

Also, the method of circuit integration is not limited to LSI, and may be implemented using a dedicated circuit or a general-purpose processor. An FPGA (Field Programmable Gate Array) that can be programmed after the LSI is manufactured, or a reconfigurable processor that can reconfigure connections and settings of circuit cells inside the LSI may be used.

Furthermore, if an integration technology that replaces the LSI emerges due to advances in semiconductor technology or another derived technology, it is of course possible to integrate the functional blocks using another technology. Application of biotechnology, etc. is possible.

Various embodiments have been described above with reference to the drawings, but it goes without saying that the present disclosure is not limited to such examples. It is obvious that a person skilled in the art can conceive of various modifications or modifications within the scope described in the claims, and these also belong to the technical scope of the present disclosure. Understood. Also, the components in the above embodiments may be combined arbitrarily without departing from the gist of the disclosure.

Although specific examples of the present disclosure have been described in detail above, they are merely examples and do not limit the scope of the claims. The technology described in the claims includes various modifications and changes of the specific examples illustrated above.

INDUSTRIAL APPLICABILITY The present disclosure is suitable for driving assistance of a vehicle.

1 control system 10 control device (controller)
11 left side camera 12 right side camera 14 winker lever 16 left side display 17 right side display 101 detection section 102 processing section 161, 171 LED
162, 172 speakers

Claims (11)

a detection unit that detects an operation of a turn signal lever provided in the vehicle;
a processing unit that performs image processing on an image captured by an image capturing device provided in the vehicle and displays the image on a display device provided in the vehicle;
with
When the detection unit detects that the turn signal lever is operated to the left or right, the processing unit changes the area of the visual field range displayed on the display device corresponding to the direction of the operation to the rear of the direction of the operation. performing switching processing for switching from the first region to a second region including a third region located laterally and rearwardly adjacent to the first region;
The processing unit executes a first presentation process for informing a driver of the vehicle that the switching process is being executed,
The first presentation processing includes processing for differentiating a display mode of the first region and a display mode of the third region of the display device,
The process of changing the display mode includes a process of lowering the visibility of the first area of the display device than the visibility of the third area,
Control device. The control device according to claim 1,
The first presentation processing includes dynamic effect processing that dynamically changes the boundary that changes the display mode toward the outer periphery of the display area of the display device .
controller . The control device according to claim 2,
The first presentation process synchronizes a cycle of repeating the dynamic effect with a cycle of a direction indication display that operates in response to operation of the blinker lever .
controller . a detection unit that detects an operation of a turn signal lever provided in the vehicle;
a processing unit that performs image processing on an image captured by an image capturing device provided in the vehicle and displays the image on a display device provided in the vehicle;
with
When the detection unit detects that the turn signal lever is operated to the left or right, the processing unit changes the area of the visual field range displayed on the display device corresponding to the direction of the operation to the rear of the direction of the operation. performing switching processing for switching from the first region to a second region including a third region located laterally and rearwardly adjacent to the first region;
The processing unit executes a first presentation process for informing a driver of the vehicle that the switching process is being executed,
The first presentation processing includes processing for superimposing a transparent band on the third region,
The first presentation processing includes dynamic effect processing that reduces the transparent band toward the outer periphery of the display area of the display device .
controller . a detection unit that detects an operation of a turn signal lever provided in the vehicle;
a processing unit that performs image processing on an image captured by an image capturing device provided in the vehicle and displays the image on a display device provided in the vehicle;
with
When the detection unit detects that the turn signal lever is operated to the left or right, the processing unit changes the area of the visual field range displayed on the display device corresponding to the direction of the operation to the rear of the direction of the operation. performing switching processing for switching from the first region to a second region including a third region located laterally and rearwardly adjacent to the first region;
The processing unit executes a first presentation process for informing a driver of the vehicle that the switching process is being executed,
The first presentation process superimposes a line or transparent band on a boundary between the first region and the third region, and displays the line or transparent band on the outer periphery of the display region of the display device. including dynamic effect processing that moves toward
controller . A control device according to claim 5,
The processing unit stops the first presentation process or changes the first presentation process to a second presentation process having a different display mode when a predetermined time has elapsed since the switching process was executed. ,
The second presentation process has a lower degree of visual stimulation than the first presentation process ,
controller . a detection unit that detects an operation of a turn signal lever provided in the vehicle;
a processing unit that performs image processing on an image captured by an image capturing device provided in the vehicle and displays the image on a display device provided in the vehicle;
with
When the detection unit detects that the turn signal lever is operated to the left or right, the processing unit changes the area of the visual field range displayed on the display device corresponding to the direction of the operation to the rear of the direction of the operation. performing switching processing for switching from the first region to a second region including a third region located laterally and rearwardly adjacent to the first region;
The processing unit executes a first presentation process for informing a driver of the vehicle that the switching process is being executed,
The detection unit detects a line of sight of the driver in the vehicle interior,
The processing unit stops the first presentation processing or performs the first presentation processing when the detection unit detects that the line of sight is directed toward the direction of the display device corresponding to the direction of the operation. is changed to a second presentation process with a different display mode,
The second presentation process provides a weak stimulus to the driver who has a lower level of visual stimulation than the first presentation process .
controller . Detects the operation of the turn signal lever provided on the vehicle,
Perform image processing on the image captured by the image capturing device provided in the vehicle and display it on the display device provided in the vehicle;
A control method comprising:
When an operation of the turn signal lever to the left or right is detected, the area of the visual field range displayed on the display device corresponding to the direction of operation is changed from the first area behind the direction of operation to the first area. Execute switching processing to switch to a second region including a third region located laterally and rearwardly adjacent to the region of
performing a first presentation process for informing a driver of the vehicle that the switching process is being performed;
The first presentation processing includes processing for differentiating a display mode of the first region and a display mode of the third region of the display device,
The process of changing the display mode includes a process of lowering the visibility of the first area of the display device than the visibility of the third area,
control method. Detects the operation of the turn signal lever provided on the vehicle,
Perform image processing on the image captured by the image capturing device provided in the vehicle and display it on the display device provided in the vehicle;
A control method comprising:
When an operation of the turn signal lever to the left or right is detected, the area of the visual field range displayed on the display device corresponding to the direction of operation is changed from the first area behind the direction of operation to the first area. Execute switching processing to switch to a second region including a third region located laterally and rearwardly adjacent to the region of
performing a first presentation process for informing a driver of the vehicle that the switching process is being performed;
The first presentation processing includes processing for superimposing a transparent band on the third region,
The first presentation processing includes dynamic effect processing that reduces the transparent band toward the outer periphery of the display area of the display device.
control method. Detects the operation of the turn signal lever provided on the vehicle,
Perform image processing on the image captured by the image capturing device provided in the vehicle and display it on the display device provided in the vehicle;
A control method comprising:
When an operation of the turn signal lever to the left or right is detected, the area of the visual field range displayed on the display device corresponding to the direction of operation is changed from the first area behind the direction of operation to the first area. Execute switching processing to switch to a second region including a third region located laterally and rearwardly adjacent to the region of
performing a first presentation process for informing a driver of the vehicle that the switching process is being performed;
The first presentation process superimposes a line or transparent band on a boundary between the first region and the third region, and displays the line or transparent band on the outer periphery of the display region of the display device. including dynamic effect processing that moves toward
control method. Detects the operation of the turn signal lever provided on the vehicle,
Perform image processing on the image captured by the image capturing device provided in the vehicle and display it on the display device provided in the vehicle;
A control method comprising:
When an operation of the turn signal lever to the left or right is detected, the area of the visual field range displayed on the display device corresponding to the direction of operation is changed from the first area behind the direction of operation to the first area. Execute switching processing to switch to a second region including a third region located laterally and rearwardly adjacent to the region of
performing a first presentation process for informing a driver of the vehicle that the switching process is being performed;
Detects the line of sight of the driver inside the vehicle,
When it is detected that the line of sight is directed in the direction of the display device corresponding to the direction of the operation, the first presentation process is stopped, or a second change to the presentation process of
The second presentation process provides a weak stimulus to the driver who has a lower level of visual stimulation than the first presentation process.
control method.

Images