JP2020042569A - Vehicle decoration image synthesizing apparatus - Google Patents

Abstract

To allow reduction of discomfort for appearance of a decoration object positioned in a vehicle when the inside of the vehicle is viewed from the outside of the vehicle.SOLUTION: A control unit displays a pseudo make-up image 21 on a side window 7 to virtually decorate, hide (make it difficult to see) or highlight an occupant inside a vehicle when viewing from the outside of the vehicle, thereby changing a view from the outside of the vehicle. Thus the occupant does not need to care about the surroundings (the outside of the vehicle) or less cares about it, and can concentrate on important operations such as driving.SELECTED DRAWING: Figure 8

Description

  The present invention relates to a decorative image synthesizing device for a vehicle.

  For example, when a female driver drives with makeup without makeup, there is a case where the driver feels ashamed when looking at the makeup from the surroundings.

JP-A-63-80692 JP 2006-113230 A JP 2008-213645 A

Patent Literature 1 discloses a makeup simulation apparatus that performs image processing on an image captured by a camera.
Patent Document 2 discloses a method of displaying an image such as an advertisement outside a vehicle.
Patent Literature 3 discloses that an image is superimposed and displayed on a scene outside the vehicle when viewed from the inside of the vehicle.

  By the way, when a female driver is driving without makeup (Suppin), there is a case where she feels ashamed if she can see the Suppin from the surroundings. In such a situation, if it is possible to make it look as if makeup is being applied, it is possible to concentrate on driving without worrying that makeup is not applied.

Further, when the hair is disordered, the same effect can be expected by making the hair look as if it is a neatly arranged hairstyle or as if wearing a hat.
In addition, when the user is riding in a fancy dress, by changing the appearance of the color or the like to make it look sober, it is possible to prevent attention (curious eyes) from surroundings (outside the vehicle).

  In this way, when things in the car and the occupant are viewed from the outside of the car, they are virtually decorated (decorated), concealed (make it hard to see), and highlighted to change the appearance from the outside of the car. It can be expected that it is not necessary to worry about the surroundings (outside the vehicle) or that the degree of concern is reduced, so that it becomes possible to concentrate on important work such as driving.

  However, according to Patent Document 1, a make-up image is displayed on the same display with respect to an image taken by a camera, and even if another person is looking at one's own face, one's own face is made up. It only affects the image displayed on the display.

Patent Document 2 discloses a method of displaying an image such as an advertisement outside a vehicle, but does not refer to superimposing and displaying an image such as an occupant in the vehicle.
Japanese Patent Application Laid-Open No. H11-163,897 discloses an image superimposed on a scene outside the vehicle when viewed from the inside of the vehicle, and does not mention image display when the inside of the vehicle is viewed from the outside of the vehicle.

  The present invention has been made in view of the above circumstances, and an object of the present invention is to provide a vehicular decorative image synthesizing apparatus that can reduce the uncomfortable feeling of a decoration object located inside a vehicle when the inside of the vehicle is visually recognized from outside the vehicle. It is in.

  According to the first aspect of the present invention, the first detection unit (15) detects the position and orientation of the decoration object (17) located in the vehicle, while the second detection unit (19) detects the decoration object from a person outside the vehicle. The gaze direction when the object (17) is visually recognized is detected. The decorative image combining section (20) combines a predetermined decorative image with a decorative object (17) visually recognized by a person outside the vehicle. This allows a person outside the vehicle to visually recognize the decoration object on which the decoration image has been synthesized, so that the appearance of the decoration object positioned inside the vehicle visually recognized from outside the vehicle can be reduced.

FIG. 2 is a block diagram schematically illustrating a configuration of a decorative image combining device according to the first embodiment. Vehicle top view Perspective view of vehicle Perspective view of human face Diagram showing the line of sight of people outside the vehicle Diagram showing the line of sight of the person in the vehicle Flow chart showing the operation of the control unit Diagram showing the result of combining a human face with a pseudo makeup image Diagram showing display parts of pseudo makeup image Diagram showing relationship between gaze direction, pseudo makeup image, and human face (part 1) FIG. 2 is a diagram showing a relationship between a gaze direction, a pseudo makeup image, and a human face (part 2). FIG. 14 is a diagram illustrating a result of synthesizing a human face and a pseudo makeup image in the second embodiment. The perspective view which shows the vehicle in 3rd Embodiment. FIG. 14 is a diagram illustrating a projection area of a projector according to a fourth embodiment.

  Hereinafter, a plurality of embodiments will be described with reference to the drawings. In several embodiments, functionally and / or structurally corresponding parts are provided with the same reference signs.

(1st Embodiment)
The first embodiment will be described with reference to FIGS.
As shown in FIG. 2, a driver seat 2, a passenger seat 3, and a rear seat 4 are arranged in the vehicle 1, and a driver seat door 5 and a passenger seat door 6 are provided beside the driver seat 2 and the passenger seat 3, respectively. Is provided. As shown in FIG. 3, a transmissive display 9 (shown by oblique lines in the figure) is provided in a predetermined area (or the entire surface) of each of the side windows 7 and 8 of the driver's seat door 5 and the passenger's seat door 6.

  The transmissive display 9 is composed of a color liquid crystal display, and can display a color image. When the image is not displayed, the background is transparent, while when the image is displayed, the background is seen through the image.

  When displaying an image, the visible light transmittance (color density) is adjusted while satisfying the visible light transmittance stipulated by safety laws and regulations, and the visible light transmittance is changed according to the surrounding brightness. You. That is, when the periphery is bright, the visible light transmittance is increased, and when the periphery is dark, the transmittance is reduced. This is because when a person outside the vehicle visually recognizes the occupant in the vehicle via the transmissive display 9, the brightness of the image is appropriately adjusted according to the brightness of the occupant to be visually recognized.

  As shown in FIG. 2, door mirrors 10 and 11 are mounted on the driver's seat door 5 and the passenger's seat door 6, and a vehicle side camera 12 is provided at an end of the door mirrors 10 and 11, respectively. The vehicle side camera 12 is for identifying an object (a person, a motorcycle, a vehicle, a building, or the like) existing in the left-right direction of the vehicle 1 by image recognition.

  A LiDAR (Light Detection and Ranging) 13 is installed on the ceiling above the driver's seat 2 and the passenger's seat 3. This LiDAR 13 is for detecting the type of object located on the side of the vehicle and its distance by laser scanning the side of the vehicle.

  A dashboard 14 is provided in front of the driver's seat 2 and the passenger's seat 3, and a DSM (Driver Status Monitor) 15 (corresponding to a first detection unit) is provided on the dashboard 14 at a position in front of the driver's seat 2. Are located. In addition, a solar radiation sensor 16 (corresponding to a brightness detecting unit) is disposed at a position in front of the passenger seat 3.

  The DSM 15 is mainly composed of a stereo camera. In addition to detecting the position of the driver's face 17 (corresponding to a decoration object) shown in FIG. The inclination angle α, the lateral angle β of the face with respect to the front of the vehicle, and the inclination angle γ of the face with respect to the vertical direction of the vehicle are detected. The DSM 15 is composed of a stereo camera in order to detect the position and posture of the occupant's head in a three-dimensional space. However, the DSM 15 has a distance sensor for detecting the distance between the monocular camera and the driver's face 17. May be combined. The solar radiation sensor 16 is for detecting the brightness inside the vehicle.

  As shown in FIG. 1, the decorative image synthesizing device 18 includes a DSM 15, a vehicle side camera 12, a LiDAR 13, a peripheral object specifying unit 19 (corresponding to a second detecting unit), a solar radiation sensor 16, a transmissive display 9, and a control unit 20 ( (Corresponding to a decorative image synthesizing unit).

  The peripheral object specifying unit 19 specifies a peripheral object existing around the vehicle 1 based on the image data from the vehicle side camera 12 and the distance measurement data from the LiDAR 13, and transmits the position data to the control unit 20. I do. The control unit 20 displays a decorative image on the transmissive display 9 based on signals from the DSM 15, the peripheral object specifying unit 19, and the solar radiation sensor 16 as described later.

  By the way, for example, when a female driver is driving with makeup without makeup, it may be embarrassing to see the makeup from the surroundings. In such a situation, a pseudo makeup image (hereinafter, referred to as a pseudo makeup image) is synthesized in the side windows 7, 8 incorporating the transmissive display 9 capable of displaying an image so as to overlap the face 17 of the female driver. By displaying, it is possible to make it look as if you are wearing makeup from outside the vehicle.

  In order to display the pseudo makeup image on the side windows 7 and 8 so as to overlap the driver's face 17 in this way, the position and attitude of the driver's face 17 and the line of sight from outside the vehicle are detected, and the person outside the vehicle is detected. By making the face visually recognized through the side windows 7 and 8 and the pseudo makeup image displayed in the side windows 7 and 8 overlap when viewed from the line of sight from the outside of the vehicle, as if wearing makeup It can be visually recognized.

  In this case, since the accuracy of the position at which the pseudo makeup image is displayed in the side windows 7 and 8 is important, it is necessary to accurately specify the relationship between the gaze position outside the vehicle and the driver's face 17. .

  Therefore, as shown in FIG. 5, when the surrounding object is a person (including an occupant of a motorcycle), the position of the person's face is detected, and the center position of both eyes and the center position between eyebrows are specified as the line-of-sight position. I do. For example, if the face cannot be detected because the face is covered with a mask or a person riding a motorcycle is wearing a helmet, the center position of the head or the entire helmet is used as the gaze position.

  As shown in FIG. 6, when the surrounding object is a vehicle, it is difficult to detect the face of the occupant. Therefore, the window frame 22 of the vehicle is detected and its center position (the position of the window frame 22) is detected. (Intersection of diagonal lines) is used as the line of sight. When a plurality of window frames 22 are detected, the center position of the window frame 22 closest to the occupant of the host vehicle is set as the line-of-sight position.

Next, the operation of the control unit 20 will be described.
As shown in FIG. 7, after acquiring the position, inclination, and orientation of the head of the occupant (driver) from the DSM image (S1), a person (a two-wheeled vehicle) The position of a peripheral object such as a vehicle or a vehicle is acquired (S2).

  Next, an object closest to the peripheral object is specified (S3). In other words, as described above, an object located closest to the occupant of the host vehicle is selected from the peripheral objects such as the face of the person outside the vehicle and the window of the vehicle acquired from the peripheral object specifying unit 19. If there are a plurality of objects selected in this way, the object is specified according to the priority (the priority of the human face is the highest).

  Next, a direction (hereinafter, referred to as a line-of-sight direction) from the specified object toward the head position of the occupant determined by the DSM 15 is calculated (S4). In other words, the line of sight of the person outside the vehicle is determined by the position of the face of the person outside the vehicle and the position of the head of the occupant (driver or passenger), and the position at which an image is displayed on the transmissive display 9 is determined from the line of sight. (S5).

  Next, a pseudo makeup image to be superimposed on the occupant's face is generated from the position and posture of the occupant's face acquired from the DSM 15 (S6), and the pseudo makeup image is displayed at a predetermined display position (S7).

  As shown in FIG. 8, the pseudo makeup image 21 (corresponding to a decorative image) is composed of a base color part A + blush part B + lipstick part C from the cheek to the chin. The occupant can arbitrarily set each part constituting the pseudo makeup image 21 and its color. For example, it can be set by calling a predetermined menu from a vehicle information screen (for example, a navigation screen) mounted on a center console (not shown). Further, as shown in FIG. 9, for example, it is possible to select whether or not to display each part and to select a color, such as not to display blush or lipstick.

  As described above, as shown in FIG. 10, the person outside the vehicle visually recognizes the occupant in the vehicle via the pseudo makeup image 21, so that the occupant's face is represented by the composite image in which the pseudo makeup image 21 overlaps. You will be visually recognizable, as if you were looking at a face with makeup.

  The control unit 20 changes the line-of-sight direction by detecting that the position or posture of the occupant's face has been changed by the DSM 15 or that the position (viewing position) of the person's face outside the vehicle has been moved by the peripheral object specifying unit 19. When it changes, the display position of the pseudo makeup image 21 in the side windows 7 and 8 is changed according to the change. That is, as shown in FIG. 11, the display position and size of the pseudo makeup image 21 on the transmissive display 9 are changed according to the change in the line of sight direction.

  Here, when the occupant moves his face violently during the display of the pseudo makeup image 21, it can be assumed that the processing time of the control unit 20 is not in time and the pseudo makeup image 21 is shifted from the face of the occupant. In order to avoid such inconveniences, for example, on the information display screen in the head-up display or the meter, an alert display saying "Do not move your face violently because a pseudo makeup image is being displayed" or display of a pseudo makeup image It is desirable to display an icon representing the inside.

  In the above description, the case where the line of sight is located outside the vehicle on the driver's seat side has been described. However, when the line of sight is located outside the vehicle on the passenger seat side, the driver's side window 8 is placed on the passenger side. A pseudo makeup image 21 corresponding to the face 17 is displayed.

According to such an embodiment, the following effects can be obtained.
The decorative image synthesizing device 18 displays the pseudo makeup image 21 on the side windows 7 and 8 to virtually modify (decorate) or conceal (make it hard to see) the occupant in the vehicle when viewed from outside the vehicle. Concentrate on important tasks such as driving by highlighting and changing the way you look from the outside of the vehicle, so that you do not need to worry about the surroundings (outside the vehicle) or to a lesser degree. Becomes possible.

  In particular, since a state that the user does not want to see from the outside of the vehicle is virtually displayed (decorated) or hidden (it is hard to see), privacy, a state that the user does not want to see, and an appearance can be protected.

(2nd Embodiment)
A second embodiment will be described with reference to FIG. The second embodiment is characterized in that it corresponds to a plurality of viewing directions.
In the first embodiment, it is possible to cope with one line of sight outside the vehicle, but when there are multiple directions of sight outside the vehicle, only the closest line of sight can be handled.

  Here, when it is considered that the heights in the plurality of line-of-sight directions are substantially the same, fluctuations in the viewing direction in the height direction can be ignored, so that only the plurality of line-of-sight directions in the left-right direction need to be handled. become.

  Thus, in order to correspond to the horizontal line of sight, as shown in FIG. 12, for example, a flesh-colored band-shaped image 23 (corresponding to a decorative image) is displayed in a simplified manner on the side windows 7 and 8. In this case, if a touch panel function is added to the transmissive display 9, the position designation of the band image 23 is reset by touching or dragging the transmissive display 9, or the band image 23 is pinched in and out. Adjustment of the display width can be easily reset.

According to such an embodiment, the following effects can be obtained.
The decorative image synthesizing device 18 synthesizes the band-shaped image 23 traversing the human face 17 as a decorative image on the face of the occupant, so that it is possible to cope with a case where a plurality of people exist around the own vehicle. The effect of making the state of the makeup (face) difficult to notice from outside the vehicle can be expected.

Since there is no need to update the display position in the horizontal direction, the processing load can be reduced.
Even if the band image 23 is slightly displaced, it does not significantly affect the visual recognition mode, so that the influence of the display displacement of the band image 23 can be suppressed.

(Third embodiment)
A third embodiment will be described with reference to FIG. The third embodiment is characterized in that a pseudo makeup image 21 and a band image 23 corresponding to the face of the occupant in the passenger seat 3 are displayed on the side window 8 of the passenger seat door 6.

  In each of the above embodiments, the pseudo makeup image 21 and the belt-shaped image 23 corresponding to the driver's face are displayed on the side window 8 of the passenger seat door 6, but when the occupant is sitting on the passenger seat 3, Then, a pseudo makeup image 21 and a strip image 23 corresponding to the face of the passenger in the passenger seat are displayed in the side window 8. In this case, the DSM 15 is installed corresponding to the passenger in the passenger seat.

  Further, the transmissive display 9 may be provided in the side window 25 of the rear seat door 24 to display the pseudo makeup image 21 corresponding to the face of the occupant in the rear seat. In this case, the DSM 15 is installed corresponding to the rear occupant.

  According to such an embodiment, the decorative image synthesizing device 18 provides the transmissive display 9 in the side window of the door corresponding to each occupant seat, and displays the pseudo makeup image 21 and the band image 23 corresponding to each occupant. In addition, it is possible to eliminate the worry that each occupant can see the suppin.

(Fourth embodiment)
A fourth embodiment will be described with reference to FIG. The fourth embodiment is characterized in that the pseudo makeup image 21 and the belt-shaped image 23 are directly projected on the face of the occupant from a projector.

  A projector 26 (corresponding to a projection unit) is installed at a location in front of the driver's seat in the vehicle. The projector 26 directly projects the pseudo makeup image 21 and the belt-shaped image 23 to the driver.

The control unit 20 detects the position of the face using the DSM 15 and projects the pseudo makeup image 21 and the band-shaped image 23 from the projector 26 onto the driver's face.
Here, the projector 26 projects the pseudo makeup image 21 and the belt-shaped image 23 while avoiding the driver's eyes. However, if light is erroneously projected to the driver's eyes, the driver is dazzled. It is desirable that the projection be performed on condition that sunglasses (protective glasses, goggles, etc.) are worn because there is a possibility of the possibility.

  The control unit 20 adjusts the brightness of the pseudo makeup image 21 and the band image 23 to be projected according to the brightness in the vehicle detected by the solar radiation sensor 16. Further, since it is difficult to visually recognize the occupant in the vehicle from outside the vehicle at night, the projection of the pseudo makeup image 21 and the band image 23 is not performed. In this case, when the interior of the vehicle is brightened by turning on the interior light, the projection of the pseudo makeup image 21 or the belt-shaped image 23 may be performed.

  According to such an embodiment, the decorative image synthesizing device 18 directly projects the pseudo makeup image 21 and the belt-shaped image 23 from the projector 26 onto the driver's face, so that it is not necessary to detect the direction of the line of sight from outside the vehicle. A configuration for detecting a peripheral object can be omitted.

(Other embodiments)
The transmissive display 9 may be provided on the front window of the vehicle to display the pseudo makeup image 21 or the band image 23 corresponding to the line of sight from the front.
A pseudo makeup image 21 or a band image 23 may be projected from the projector onto the side windows 7 and 8.

If the hair of the occupant is disturbed, a pseudo makeup image 21 may be displayed that makes it look as if it were a beautifully arranged hairstyle or that it looks as if it is wearing a hat.
When the occupant is riding in fancy clothing, the appearance of the clothing may be changed to make it look sober, and attention or curious eyes from the surroundings (outside the vehicle) may be prevented.

  Although the present disclosure has been described with reference to the embodiments, it is understood that the present disclosure is not limited to the embodiments and the structures. The present disclosure also encompasses various modifications and variations within an equivalent range. In addition, various combinations and forms, and other combinations and forms including only one element, more or less, are also included in the scope and spirit of the present disclosure.

In the drawing, 1 is a vehicle, 9 is a transmissive display, 15 is a DSM (first detection unit), 16 is a solar radiation sensor (brightness detection unit), 17 is a driver's face (decoration object), and 18 is a decoration image synthesis Apparatus, 19 is a peripheral object specifying unit (second detecting unit), 20 is a control unit (decorative image synthesizing unit), 21 is a pseudo makeup image (decorative image), 23 is a band image (decorative image), and 26 is a projector (projection) Part).

Claims (7)

A first detection unit (15) for detecting a position and a posture of the decoration object (17) located inside the vehicle (1);
A second detection unit (19) that detects a line of sight when a person outside the vehicle visually recognizes the decoration target;
A decoration image synthesizing unit (20) for synthesizing a predetermined decoration image with the decoration object visually recognized by a person outside the vehicle;
A decorative image synthesizing device for a vehicle, comprising:   The vehicle decoration image composition according to claim 1, wherein the decoration image composition unit is a transmissive display (9) that displays the decoration image on a window of a vehicle interposed when a person outside the vehicle visually recognizes the decoration target. apparatus.   The decorative image combining device for a vehicle according to claim 1, wherein the decorative image combining unit is a projecting unit (26) that directly projects the decorative image on the decoration target.   The vehicle decoration image composition device according to any one of claims 1 to 3, wherein the decoration image composition unit creates the decoration image so as to change a visual recognition mode of a part of the decoration object.   The vehicle decoration image composition device according to any one of claims 1 to 3, wherein the decoration image composition unit creates the decoration image so as to change a visual recognition mode of a region crossing the decoration object. A brightness detector (16) for detecting the brightness in the vehicle;
The vehicle decoration image synthesis device according to any one of claims 1 to 5, wherein the decoration image synthesis unit adjusts the brightness of the decoration image according to the brightness detected by the brightness detection unit. The decoration object is a face of an occupant,
The decorative image combining device for a vehicle according to any one of claims 1 to 6, wherein the decorative image combining unit combines the decorative image with an occupant's face.

Images