JP2016199266A - Mirror device with display function and display switching method - Google Patents

Abstract

PROBLEM TO BE SOLVED: To provide a mirror device with display function and a display switching method which allow a user to intuitively perform an operation for switching functions and a display range without impairing safety.SOLUTION: A room mirror 1 with display function includes a display panel 30 and a half mirror 22 which display an image of a rear camera 51 of a vehicle. A motion sensor 40 performs motion detection in four directions. A switching control part 108 performs processing for switching to a display mode in a detection result of any of four directions detected by the motion sensor 40 when the room mirror 1 with display function functions as a mirror mode, and performs processing as a movement instruction of a display range with respect to each direction detected by the motion sensor 40 when the room mirror functions as the display mode. A display control part moves the display range and changes the displayed range when the detected motion detection is the movement instruction of the display range with respect to each direction.SELECTED DRAWING: Figure 4

Description

  The present invention relates to a mirror device with a display function having a reflection function and an image display function, and a display switching method.

  A room mirror that is attached to the interior of an automobile is provided with a display function. The display function displays an image of a camera that captures the rear of the car.

  Patent Document 1 discloses a room mirror that includes a monitor device on the back surface of a half mirror and displays a plurality of camera images simultaneously. Patent Document 2 discloses a room mirror that changes the display size of a captured image.

JP 2001-191858 A JP 2009-100180 A

  In the case of a room mirror with a display function using a half mirror, there are a reflection function by the half mirror and a display function for displaying a display image such as a liquid crystal display panel through the half mirror, and it is necessary to switch according to the purpose of the user There is also. In addition, unlike a normal room mirror, the range displayed on the room mirror with a display function can be changed by setting the cutout range of an image taken by the camera.

  Switching the function of the room mirror with a display function and the operation of the display range are often performed during driving of the automobile, and it is required that safety is not impaired. For this reason, it is desirable that these operations are not an independent operation system but a unified operation system. Furthermore, it is desirable that the user can operate intuitively while driving and there is no misperception of the operation.

  The present invention has been made to solve such a problem, and a mirror device with a display function and a display capable of intuitively performing function switching and display range operation without impairing safety. An object is to provide a switching method.

  To achieve the above object, a mirror device with a display function according to the present invention includes a display panel that displays an image of an imaging device that captures the back of a vehicle, a half mirror provided on a display surface of the display panel, The display function room mirror, the motion sensor for detecting motion, and the display function room mirror function as a room mirror using the mirror surface of the half mirror with the display of the display panel stopped. When the motion detection results in any of the directions detected by the motion sensor, a process for switching to a display function for executing display on the display panel is performed, and the room mirror with a display function is connected to the display panel. When executing the display function that is being displayed, the mode detected by the motion sensor The motion detection is processed as an instruction to move the display range for each direction. When the motion detection detected by the switching control unit and the motion sensor is an instruction to move the display range for each direction, the motion sensor detects And a display control unit that moves the display range based on the detected motion and changes the width of the displayed range.

  In the display switching method according to the present invention, a display panel that displays an image of an imaging device that captures the rear of a vehicle, and a room mirror with a display function that includes a half mirror provided on a display surface of the display panel, When the display of the panel is stopped and it functions as a room mirror using the mirror surface of the half mirror, the display panel can display the motion detection result in any direction detected by the motion sensor that performs motion detection. When the room mirror with a display function is executing a display function in which the display panel is displayed, the motion detection detected by the motion sensor is In addition to instructing to move the display range with respect to the direction, the mode detected by the motion sensor Based on tio emission detection, to vary the breadth of the range to be displayed.

  According to the present embodiment, it is possible to intuitively perform function switching and display range operation without sacrificing safety.

It is an external view of the room mirror with a display function concerning the present invention. It is sectional drawing of the room mirror with a display function which concerns on this invention. It is a conceptual diagram of the motion sensor used for the room mirror with a display function which concerns on this invention. It is a functional block diagram of a mirror device with a display function concerning a 1st embodiment of the present invention. It is the flowchart which showed the display switching method of the mirror apparatus with a display function which concerns on the 1st Embodiment of this invention. It is a conceptual diagram which shows the example of a shift of the display range which concerns on the 1st Embodiment of this invention. It is a functional block diagram of a mirror device with a display function concerning a 2nd embodiment of the present invention. It is a conceptual diagram which shows the example of the attachment position and imaging | photography range of the camera which concerns on the 2nd Embodiment of this invention. It is an external view of the room mirror with a display function which concerns on the 2nd Embodiment of this invention. It is sectional drawing of the room mirror with a display function which concerns on the 2nd Embodiment of this invention. It is the flowchart which showed the display switching method of the mirror apparatus with a display function which concerns on the 2nd Embodiment of this invention. It is a conceptual diagram which shows the example of a shift of the display range which concerns on the 2nd Embodiment of this invention. It is a conceptual diagram.

  Hereinafter, a first embodiment of the present invention will be described. FIG. 1 is an external view of a room mirror 1 with a display function according to the first embodiment of the present invention as viewed from the driver side who is a user. The display-equipped room mirror 1 is in the traveling direction of the vehicle as viewed from the user, as in a normal room mirror, and is generally mounted on the upper part of the windshield.

  The room mirror 1 with a display function includes a mirror surface 21 that reflects the back to the user, a cover 20 that covers the mirror surface 21 and functions as a housing, and a motion sensor 40 that is a sensor that receives a user operation. In the present embodiment, the motion sensor 40 is arranged at the upper center of the room mirror 1 with a display function. However, if the motion intended for the user's operation can be properly recognized without misrecognition, the arrangement location is not limited. You may arrange | position in the position away from the room mirror 1 with a display function.

  FIG. 2 is a view schematically showing a cross-sectional view taken along a-a ′ of the room mirror 1 with a display function shown in FIG. 1.

  As shown in FIG. 2, the mirror surface 21 is a surface formed by the half mirror 22. A liquid crystal panel 31 and a backlight 32 having substantially the same shape as the half mirror 22 are disposed inside the cover 20. The liquid crystal panel 31 and the backlight 32 constitute a display panel 30. The display panel 30 is a self-luminous display panel such as an organic EL (Electro Luminescence) panel instead of the combination of the liquid crystal panel 31 and the backlight 32 as long as the displayed image is formed by light emission. Also good. In FIG. 2, a power supply circuit for driving the display panel 30 is not shown.

  In the room mirror 1 with a display function shown in FIGS. 1 and 2, the backlight 32 is not turned on when the display panel 30 is not displaying. At this time, the half mirror 22 reflects most of the light incident on the mirror surface 21. For this reason, the room mirror 1 with a display function operates as a mirror mode in which the user confirms the rear by reflection of the mirror surface 21. In the room mirror 1 with a display function, the backlight 32 is turned on when the display panel 30 is displaying. At this time, the light emitted by the backlight 32 passes through the half mirror 22 via the liquid crystal panel 31. For this reason, the room mirror 1 with a display function operates as a display mode for displaying an image displayed on the display panel 30.

  FIG. 3 is a diagram conceptually showing the motion sensor 40 used by the room mirror 1 with a display function. The motion sensor 40 is a sensor in which a plurality of photodiodes are combined. When four photodiodes are combined, motion in four directions can be detected. The motion sensor 40 includes an upper direction detection photodiode 41U, a lower direction detection photodiode 41D, a left direction detection photodiode 41L, and a right direction detection photodiode 41R. The top, bottom, left, and right of each of these photodiodes are arranged to coincide with the top, bottom, left, and right of the room mirror 1 with a display function viewed from the user shown in FIG. The range in which the motion sensor 40 can detect an object is 0.1 m to 0.2 m in front of the motion sensor 40. In this embodiment, for convenience of explanation, description will be made by taking four directions of up, down, left, and right as an example. However, the four directions of up, down, left, and right are examples, and are not limited to these four directions. The number is not limited to four.

  FIG. 4 is a functional block diagram of the mirror device 10 with a display function according to the first embodiment. The mirror device 10 with a display function includes a display panel 30, a motion sensor 40, and a control unit 100 that processes various types of data. The control unit 100 includes a CPU (Central Processing Unit) that performs various data processing, a DSP (Digital Signal Processor), a memory, and the like. The control unit 100 may be built in the room mirror 1 with a display function, or may use a control function such as a navigation device or an in-vehicle computer.

  The control unit 100 includes an imaging control unit 102, a display control unit 104, a motion control unit 106, and a switching control unit 108 based on the function. Each function may be realized by a control function mounted on a single device, or may be realized by a control function mounted on a plurality of distributed devices.

  The imaging control unit 102 acquires video data captured by the rear camera 51 mounted in such a direction that the rear of the vehicle on which the mirror device 10 with a display function is mounted can be captured.

  The display control unit 104 performs processing for displaying the video data acquired by the imaging control unit 102 on the display panel 30. Specifically, the display control unit 104 cuts out video data in accordance with the shape of the display panel 30 and adjusts the luminance and color tone of the video.

  The motion control unit 106 acquires an output signal from the motion sensor 40 and detects the direction of the motion and the like. The motion control unit 106 analyzes the distribution of the peak value of the detected waveform when each of the four photodiodes included in the motion sensor 40 detects an object, and the object is positioned in front of the motion sensor 40 in any of up, down, left, and right directions. Detect whether it has passed in the direction. In addition, the motion control unit 106 can detect the reciprocation of the object in the vertical direction when the upward and downward object passages are detected continuously within a predetermined time. Similarly, when the left and right object passages are detected continuously within a predetermined time, the motion control unit 106 can detect the object as a left-right reciprocation.

  The motion control unit 106 always acquires the output value from each photodiode of the motion sensor 40 during a period in which motion is to be detected. The motion control unit 106 uses the output value Uout of the upward detection photodiode 41U, the output value Dout of the downward detection photodiode 41D, the output value Lout of the left detection photodiode 41L, and the output value Rout of the right detection photodiode 41R. get.

  For example, the motion control unit 106 determines the gesture direction from the peak waveforms of (Uout−Dout) / (Uout + Dout) and (Rout−Lout) / (Rout + Lout). For example, when a motion direction opposite to the determined motion direction is detected within a predetermined time set to 1 second to 2 seconds, for example, it is determined that the motion is a reciprocating motion.

  The switching control unit 108 controls the display control unit 104 based on the detection result of the motion control unit 106. Specifically, when the room mirror 1 with a display function is operating in the mirror mode, control is performed to switch to the display mode in the motion detection result in any of the four directions detected by the motion control unit 106. . Switching from the mirror mode to the display mode is switching from the state in which the video of the rear camera 51 is not displayed to the state in which it is displayed by the control of the display panel 30 by the display control unit 104. When the room mirror 1 with a display function is operating in the display mode, the motion detection in the four directions detected by the motion control unit 106 is processed as an instruction to move the display range with respect to the detected direction.

  Further, when the room mirror 1 with a display function is operating in the display mode, the switching control unit 108 performs a process of switching to the mirror mode by detecting the four-way reciprocating motion detected by the motion control unit 106.

  Next, a display switching method of the mirror device 10 with a display function according to the first embodiment will be described with reference to FIG.

  The switching control unit 108 determines whether or not the motion control unit 106 has detected motion in any direction (step S101). If no motion is detected in step S101 (step S101: No), the process returns to step S101. In step S101, when motion in any direction is detected (step S101: Yes), the switching control unit 108 operates in the mirror mode, whether the room mirror 1 with a display function is operating in the display mode. (Step S102). The determination in step S102 is made based on whether or not the display control unit 104 displays the video of the rear camera 51 on the display panel 30.

  In step S102, when it is determined that the camera is operating in the mirror mode instead of the display mode (step S102: No), the switching control unit 108 controls the display control unit 104 to display the rear camera 51 on the display panel 30. The video is displayed and changed to the display mode (step S103).

  When it is determined in step S102 that the display mode is operating (step S102: Yes), the switching control unit 108 determines whether or not the motion detected by the motion control unit 106 is a reciprocating motion ( Step S104). The reciprocating motion is a case where motion in the opposite direction is continuously detected within a preset time such as 1 to 2 seconds. For example, there is a case where an upward motion is detected and a downward motion is detected within one second. The same applies to the left-right direction.

  If it is determined in step S104 that the motion is a reciprocating motion (step S104: Yes), the switching control unit 108 changes the operation of the room mirror 1 with a display function to the mirror mode (step S105). If it is determined in step S104 that the motion is not a reciprocating motion (step S104: No), the switching control unit 108 controls the display control unit 104 to shift the display range in the direction of the detected motion (step S104). S106).

  FIG. 6 is a diagram conceptually illustrating a display range shift example in the process of step S106. The rear camera 51 is a camera that captures a wide range of the rear of the vehicle. In FIG. 6, the display range 501 is a range in which the display control unit 104 cuts out the shooting range 500 of the rear camera 51 taken by the rear camera 51 as display data of the display panel 30.

  FIG. 6A shows a display range 501 of the rear camera 51 in a normal state with respect to the shooting range 500 of the rear camera 51. FIG. 6B is an example when the process of step S106 is executed for the upward motion detection detected in step S101, and the display range 501 is displayed above FIG. 6A. The FIG. 6C is an example when the process of step S106 is executed for the downward motion detection detected in step S101, and the lower part of the display range 501 is displayed from FIG. 6A. The FIG. 6D is an example when the process of step S106 is executed for the left-direction motion detection detected in step S101, and the left side of the display range 501 is displayed from FIG. 6A. Is done. FIG. 6E is an example when the process of step S106 is executed for the motion detection in the right direction detected in step S101, and the right side of the display range 501 is displayed from FIG. 6A. Is done.

  The process of step S106 may shift a preset maximum shift amount by one motion detection, or a 1 / n shift amount of a preset maximum shift amount by one motion detection. The maximum shift amount may be detected by detecting motions in the same direction at most n times.

  With such a process, it is possible to intuitively perform function switching and display range operation with motion detection in only four directions using the motion sensor 40 without sacrificing safety.

  Next, a second embodiment of the present invention will be described. In the second embodiment, the description of the contents common to the first embodiment and the configuration and processing is omitted.

  The configuration of the mirror device 12 with a display function according to the second embodiment acquires video data taken by the left camera 52 and the right camera 53 as shown in FIG. 7 in addition to the rear camera 51. That is, the shooting control unit 103 acquires videos shot by the left camera 52 and the right camera 53 in addition to videos shot by the rear camera 51.

  The display control unit 105 performs processing for displaying the video data of the left camera 52 and the right camera 53 on the display panel 35 in addition to the video data of the rear camera 51 acquired by the imaging control unit 103. Specifically, each of the video data in accordance with the shape of the display panel 35 is cut, the brightness and color tone of the video are adjusted, and the respective video data are synthesized.

  FIG. 8 is a conceptual diagram illustrating an example of a camera mounting position and a shooting range from which the mirror device 12 with a display function according to the second embodiment acquires video data, and shows a mode in which the vehicle 200 is viewed from above. Yes. In FIG. 8, the arrow indicates the front of the vehicle 200, and the broken lines indicate the photographing ranges of the rear camera 51, the left side camera 52, and the right side camera 53. The rear camera 51 is the same as in the first embodiment, but is installed behind the vehicle 200 and captures the rear of the vehicle 200 over a wide range. The left-side camera 52 and the right-side camera 53 are installed on the left and right sides of the vehicle 200, respectively, and photograph the left and right rear of the vehicle 200. The installation positions of the left side camera 52 and the right side camera 53 are the positions of the door mirrors in the example of FIG. 8, but may be installed at other positions such as the left and right sides of the fender.

  FIG. 9 is an external view of the room mirror 2 with a display function used in the mirror device 12 with a display function according to the second embodiment as viewed from the driver side who is a user. The rear-view mirror with display function 2 is different from the rear-view mirror with display function 1 in that in addition to the video of the rear camera 51 in the display mode, the video of the left-side camera 52 and the right-side camera 53 is displayed.

  The broken lines shown on the mirror surface 21 of the room mirror 2 with a display function shown in FIG. 9 indicate the sections for displaying the images of the respective cameras, the left display section 60L for displaying the images of the left-side camera 52, and the rear camera. A central display section 60C for displaying 51 images and a right display section 60R for displaying images of the right-side camera 53 are shown.

  FIG. 10 is a diagram schematically showing a cross-sectional view taken along b-b ′ of the rearview mirror 2 with a display function shown in FIG. 9.

  As shown in FIG. 10, behind the liquid crystal panel 31, a left backlight 32L and a center backlight 32C that can be controlled to be lit independently in correspondence with the positions of the left display section 60L, the central display section 60C, and the right display section 60R. And a right backlight 32R. These backlights may be independent from each other, or one backlight may be in a lighting controllable state for each section. The display panel 35 includes a liquid crystal panel 31, a left backlight 32L, a central backlight 32C, and a right backlight 32R. Further, instead of the combination of the liquid crystal panel 31 and the left backlight 32L, the central backlight 32C and the right backlight 32R, a self-luminous display panel such as an organic EL (Electro Luminescence) panel in which display ON / OFF is controlled for each section It may be.

  Next, a display switching method of the mirror device 12 with a display function according to the second embodiment will be described with reference to FIG.

  In the second embodiment, the display mode is a state in which images of the rear camera 51, the left camera 52, and the right camera 53 are displayed in the left display section 60L, the central display section 60C, and the right display section 60R. is there. There are two patterns in the mirror mode. All displays are not performed in the first mirror mode. In the second mirror mode, display is performed in the left display section 60L and the right display section 60R, and no display is performed in the center display section 60C. When operating in the second mirror mode, the display control unit 105 does not display the portion corresponding to the central display section 60C of the liquid crystal panel 31 and turns off the central backlight 32C.

  In step S102, when it is determined that the operation is in the mirror mode instead of the display mode (step S102: No), the switching control unit 108 controls the display control unit 105 to control all the sections of the display panel 35. The video is displayed and changed to the display mode (step S203).

  If it is determined in step S104 that the motion is a reciprocating motion (step S104: Yes), the switching control unit 108 changes the operation of the room mirror 2 with a display function to the mirror mode (step S205). The mirror mode changed in step S205 may be the first mirror mode or the second mirror mode.

  If it is determined in step S104 that the motion is not a reciprocating motion (step S104: No), the switching control unit 108 controls the display control unit 105 to shift the display range in the direction of the detected motion (step S104). S206).

  When executing step S206, the display control unit 105 can take the following two types of shift processing. As the first shift process, only the video of the rear camera 51 displayed in the central display section 60C is shifted, and the left camera 52 and the right camera 53 displayed in the left display section 60L and the right display section 60R. This video is a process that does not shift. In the case of the first shift process, the images displayed in the left display section 60L and the right display section 60R do not need to be shifted because they correspond to the rear images viewed by the door mirror, and are displayed in the center display section 60C. Since the video corresponds to the video seen by the room mirror, it is shifted as necessary. By such processing, the user can intuitively perform the switching between the mirror mode and the display mode and the operation of the display range of the display target necessary in the display mode without impairing the safety.

  As the second shift process, in addition to the video of the rear camera 51 displayed in the center display section 60C, the left camera 52 and the right camera displayed in the left display section 60L and the right display section 60R. Similarly, the 53 images are shifted. In the case of the second shift processing, the same display shift can be performed even when the room mirror 2 with a display function cannot change the orientation mechanically. By such processing, the user can intuitively perform the switching between the mirror mode and the display mode and the operation of the display range of the display target in the display mode without impairing the safety.

  FIG. 12 is a diagram conceptually illustrating a display range shift example in the process of step S206. FIG. 12 shows an example of the second shift process. In FIG. 12, the display range 501 in the shooting range 500 of the rear camera 51 is a range in which the display control unit 105 cuts out the shooting range 500 of the rear camera 51 shot by the rear camera 51 as display data on the display panel 35. . Similarly, in FIG. 12, the display range 511 in the shooting range 510 of the left side camera 52 is the display range 511 of the left side camera 52 shot by the left side camera 52, and the display control unit 105 cuts off the display on the display panel 35. This is the range of data. In FIG. 12, the display range 521 in the shooting range 520 of the right side camera 53 is the display data of the display panel 35 that is cut out by the display control unit 105 from the shooting range 520 of the right side camera 53 taken by the right side camera 53. It is the range which is going.

  When the display control unit 105 performs the shift process in each direction, the display range 501 in the shooting range 500 of the rear camera 51, the display range 511 in the shooting range 510 of the left camera 52, and the shooting range 520 of the right camera 53 are displayed. The display range 521 is combined and displayed on the liquid crystal panel 31.

  The embodiment of the present invention can be variously modified without departing from the gist thereof. For example, in the first embodiment, the display range 501 in the shooting range 500 of the rear camera 51 displayed in the shift process of step S106 may be changed as compared with the display range before the shift. For example, when the display range 501 in the shooting range 500 of the rear camera 51 after the shift is narrower than that before the shift, the same effect as the zoom of the display range can be obtained. For this reason, it is possible to visually check the range in which the instruction to move the display range is given by motion detection. When the display range 501 in the shooting range 500 of the rear camera 51 after the shift is made wider than that before the shift, the display range can be widened. These processes may be set in advance, or may be determined by the time length of the peak waveform indicating the motion detected in step S101. Specifically, if the peak waveform indicating the motion detected in step S101 is less than 0.4 seconds as an example of the threshold value, the display range 501 in the shooting range 500 of the rear camera 51 after the shift is narrower than before the shift, If the time length is equal to or greater than the threshold and the upper limit is recognized as motion, the display range 501 in the shooting range 500 of the rear camera 51 after the shift is made wider than before the shift.

  When the same motion detection is applied to the second embodiment, when the time length of the peak waveform indicating the motion detected in step S101 is less than the threshold value, the display in the imaging range 510 of the left camera 52 corresponding to the motion detection direction. Either the range 511 or the display range 521 in the shooting range 520 of the right side camera 53 is cut out narrowly, and if it is equal to or larger than the threshold, it is cut out widely.

1, 2 Room mirror with display function 10, 12 Mirror device with display function 20 Cover 21 Mirror surface 22 Half mirror 30, 35 Display panel 31 Liquid crystal panel 32 Backlight 32L Left backlight 32R Right backlight 32C Central backlight 40 Motion sensor 41U Upward detection photodiode 41D Downward detection photodiode 41L Left detection photodiode 41R Right detection photodiode 51 Rear camera (imaging device)
52 Left-side camera (imaging device)
53 Right-side camera (imaging device)
60L Left display section 60C Central display section 60R Right display section 100 Control unit 102, 103 Shooting control unit 104, 105 Display control unit 106 Motion control unit 108 Switching control unit 200 Vehicle 500 Rear camera shooting range 501 In rear camera shooting range Display range 510 Left-side camera shooting range 511 Left-side camera shooting range 520 Right-side camera shooting range 521 Right-side camera shooting range

Claims (5)

A room mirror with a display function, comprising: a display panel that displays an image of an imaging device that captures the rear of the vehicle; and a half mirror provided on a display surface of the display panel;
A motion sensor for motion detection,
When the display function room mirror functions as a room mirror using the mirror surface of the half mirror when the display on the display panel is stopped, motion detection in any direction detected by the motion sensor Even in the result, the process of switching to the display function for executing the display of the display panel is performed, and when the room mirror with the display function is executing the display function for displaying the display panel, the motion is Motion detection detected by the sensor is processed as an instruction to move the display range with respect to each direction, a switching control unit,
When the motion detection detected by the motion sensor is an instruction to move the display range in each direction, the display range is moved based on the motion detection detected by the motion sensor, and the width of the displayed range is increased. Changing the display control unit;
A mirror device with a display function. When the motion detection detected by the motion sensor is an instruction to move the display range in each direction, the display control unit moves the display range and narrows the displayed range.
The mirror device with a display function according to claim 1. When the motion detection detected by the motion sensor is an instruction to move the display range in each direction, the display control unit moves the display range and widely changes the displayed range.
The mirror device with a display function according to claim 1. When the motion detection detected by the motion sensor is an instruction to move the display range in each direction, the display control unit moves the display range and the time length of the peak waveform of the motion detection waveform is less than a threshold value. Change the displayed range narrowly, and if it is above the threshold, change the displayed range widely.
The mirror device with a display function according to claim 1. A display panel that displays an image of an imaging device that captures the rear of a vehicle, and a room mirror with a display function that includes a half mirror provided on a display surface of the display panel. When functioning as a room mirror using a surface, in the motion detection result in any direction detected by the motion sensor that performs motion detection, switching to a display function for executing display on the display panel, When the room mirror with a display function is executing a display function in which display of the display panel is performed, the motion detection detected by the motion sensor gives an instruction to move the display range with respect to each direction, The displayed range is based on the motion detection detected by the motion sensor. Changing the size of, display switching method.

Images