JP2019048601A - Display device - Google Patents

Abstract

To improve workability and convenience during making-up by a crewman; and to suppress dispersion of workmanship of make-up.SOLUTION: A display device includes a camera 11 arranged on a position facing to a crewman seated on a seat, for photographing the seated crewman, a display 12 arranged on the same position, for displaying a mirror image formed by inverting an image photographed by the camera 1, and a control device 20 for dividing in two, a screen of the display 12, displaying the mirror image on one screen S1, and displaying a sample image which is a sample of make-up on the other screen S2.SELECTED DRAWING: Figure 1

Description

  BACKGROUND OF THE INVENTION Field of the Invention The present invention relates to a display device suitable for use when a passenger such as a vehicle or an airplane performs a makeup operation.

  2. Description of the Related Art There has been known a vehicle sun visor equipped with a vanity mirror for checking appearance and makeup. A general vanity mirror is provided on the back of the sun visor, and is used with the sun visor lowered when performing a makeup operation (see Patent Document 1). In recent years, a vehicle sun visor has also been developed in which a lighting device is disposed around a vanity mirror so that the face of an occupant reflected in the mirror is brightly illuminated.

JP, 2017-071296, A

  By the way, when making up in the vehicle, when the vehicle is stopped (for example, at the time of stopping at the parking lot, at the time of waiting for traffic light, traffic stop, etc.) to prevent camera shake due to vibration while traveling. I often do makeup. For example, when the driver does makeup at the time of commuting, makeup will be completed little by little using a short time such as waiting for a signal or waiting for a crossing. For this reason, variations in makeup quality are likely to occur as compared with the case where makeup is completed at a stretch at home. In addition, such a subject may arise not only when a driver does makeup but for example, also when the passenger seated in a front passenger seat or a backseat does makeup. In addition, the same problem may occur when a passenger other than a vehicle (for example, a passenger such as a bullet train or an airplane) applies makeup.

  The display device of the present invention has been devised in view of such problems, and one of the objects is to improve the workability and convenience when an occupant is wearing makeup and to suppress variations in the makeup quality of makeup. . The present invention is not limited to this object, and it is an operation and effect derived from each configuration shown in the embodiments for carrying out the invention described later, and it is another object of the present invention to exert an operation and effect that can not be obtained by the prior art. is there.

  (1) The display device disclosed herein is disposed at a position facing the occupant seated on the seat, a camera for photographing the occupant seated, and disposed at the position, reversing the image captured by the camera A display for displaying the mirror image, and a control device for dividing the screen of the display into two and displaying the mirror image on one of the screens and displaying a sample image as a makeup sample on the other of the screens; Is equipped.

(2) It is preferable that the said display apparatus is provided with the touch panel provided in the surface of the said display. In this case, the control device may have a storage device for storing a plurality of the samples and display one of the plurality of samples as the sample image based on an input operation on the touch panel by the occupant. preferable.
(3) Preferably, when the control device detects the input operation on the one screen, the control device stores the mirror image at that point in the storage device as the sample.

(4) It is preferable that the control device has a reading device for reading information recorded in a recording medium, and stores an image included in the information in the storage device as the sample.
(5) The control device detects the cosmetic part of the occupant in the video taken by the camera, and the sizes of the cosmetic parts displayed on the one screen and the other screen are the same. It is preferable to zoom in to make

(6) It is preferable that the control device notifies the occupant of makeup quality by comparing the mirror image and the sample image.
(7) It is preferable that the above-mentioned position includes a surface facing the passenger compartment side at the time of use of the sun visor provided in the vehicle. In this case, preferably, the camera starts shooting when a cover covering the display is opened.

  (8) Moreover, it is preferable that the said surface includes the surface which faces the back of a seat back or a headrest. In this case, the control device is provided with a plurality of modes including a makeup mode for displaying the sample image, and preferably the control device switches the plurality of modes in accordance with a predetermined input operation.

  According to the disclosed display device, since the mirror image and the sample image are displayed side by side on the display, it is possible to refer to the sample without moving the face. For this reason, while being able to improve workability | operativity and convenience when a passenger carries out makeup, the dispersion | variation in the quality of makeup can be suppressed.

It is a perspective view of the sun visor to which the display concerning a embodiment was applied. It is a block diagram which shows the hardware constitutions of the display apparatus of FIG. It is a flowchart of display control implemented by the display apparatus of FIG. It is a rear elevation view of a headrest to which a display concerning another example was applied.

  A display device as an embodiment will be described with reference to the drawings. The embodiments shown below are merely illustrative, and there is no intention to exclude the application of various modifications and techniques that are not specified in the following embodiments. Each structure of this embodiment can be variously modified and implemented in the range which does not deviate from those meaning. Also, they can be selected as needed or can be combined as appropriate.

[1. Constitution]
As shown in FIG. 1, the display device of the present embodiment is applied to a sun visor 1 provided in a vehicle. The sun visor 1 is a sunshade for forming a shadow on the face of a driver or a passenger on the driver's seat so that sunsets and sunrises do not occur directly on the driver's and passenger's face. Arranged one by one (ie, a pair). Each sun visor 1 has a support shaft 16 formed by bending the shaft member in an L shape, and a light shielding plate 17 pivotally supported by the support shaft 16.

  The support shaft 16 has a function of supporting the light shielding plate 17 while changing the posture (position and inclination angle) of the light shielding plate 17 with respect to the vehicle body. Moreover, the metal fitting 18 for latching the support shaft 16 is provided in the ceiling surface of a vehicle interior. By hooking the support shaft 16 to the metal fitting 18, the plate surface of the light shielding plate 17 was erected along the ceiling (the storage posture, a state not used as a sunshade) and the plate surface of the light shielding plate 17 were erected vertically. The operation of swinging the sun visor 1 between the posture (the standing posture and the state used as a shade) is facilitated. In addition, when the support shaft 16 is removed from the bracket 18, an operation of swinging the sun visor 1 can be performed so that the plate surface of the light shielding plate 17 is in a posture along the side window.

  The display device according to the present embodiment includes a camera 11 that captures an occupant seated in a seat, a display 12 that displays a mirror image obtained by inverting an image captured by the camera 11, and an ECU 20 (Electronic Control Unit). . The camera 11 and the display 12 are disposed at positions facing the occupant seated on the seat of the vehicle. The camera 11 and the display 12 according to the present embodiment are fixed to a surface (hereinafter referred to as “rear surface”) facing the cabin side when the sun visor 1 is used. Further, in the display device of the present embodiment, the touch panel 13 is provided on the surface of the display 12.

  On the back surface of the sun visor 1, a slide-type cover 15 that covers the display 12 and the touch panel 13 is provided. The power switch of the camera 11 is interlocked with the opening and closing operation of the cover 15, and shooting is started when the cover 15 is opened. The display 12 is a display device that functions as a vanity mirror, and is, for example, a flat display such as a liquid crystal display or an organic EL display. The power switch of the display 12 is also interlocked with the opening and closing operation of the cover 15 and starts screen display when the cover 15 is opened.

  The touch panel 13 is an input device for detecting an input operation (touch, pinch, swipe, etc.) on the surface of the display 12. The mirror image displayed on the display 12 can be enlarged or reduced by touch operation on the touch panel 13 or pinch operation (pinch in, pinch out) or the like. The type of touch panel 13 is arbitrary, and, for example, a resistive film method, a capacitance method, an optical method, or the like is used. The power switch of the touch panel 13 is also interlocked with the opening and closing operation of the cover 15, and starts detection when the cover 15 is opened.

  The ECU 20 is an electronic control unit (computer) for controlling an image displayed on the display 12, and is incorporated in, for example, an instrument panel (not shown). The hardware configuration of the ECU 20 is illustrated in FIG. The ECU 20 incorporates a processor 21 (Central Processor Unit, central processing unit), a memory 22 (main memory, main storage device), an auxiliary storage device 23, an interface device 24, a recording medium drive 25, etc. Are communicably connected to each other. Each of these elements 21 to 25 operates by receiving power supply from an unshown power source (for example, an on-board battery, a button battery, etc.).

  The processor 21 is a central processing unit including a control unit (control circuit), an operation unit (operation circuit), a cache memory (register group), and the like. The memory 22 is a storage device in which programs and data during work are stored, and, for example, a ROM and a RAM are included therein. On the other hand, the auxiliary storage device 23 is a memory device in which data and firmware held for a long time than the memory 22 are stored, and includes, for example, a flash memory and a non-volatile memory.

  The interface device 24 is responsible for input and output (I / O) between the ECU 20 and the outside. The camera 11, the display 12, and the touch panel 13 are connected to the ECU 20. Information is exchanged with the various devices 11 to 13 via the interface device 24. Even when the ECU 20 can be connected to the in-vehicle network, the connection may be made via the interface device 24.

  The recording medium drive 25 is a reading device for reading information recorded and stored in a recording medium 27 (removable medium) such as an optical disk or a semiconductor memory. The program executed by the ECU 20 may be recorded and stored in, for example, the memory 22 or may be recorded and stored in the auxiliary storage device 23. Alternatively, the program may be recorded and stored on the recording medium 27, and the program written to the recording medium 27 may be read into the ECU 20 via the recording medium drive 25.

  The ECU 20 divides the screen of the display 12 into two and displays a mirror image on one screen S1 (hereinafter referred to as "first screen S1") and the other screen S2 (hereinafter referred to as "second screen S2"). Implement display control to display an image that is a sample of makeup. The display control is control for displaying side-by-side images of the face and the sample (hereinafter referred to as "sample image") when the occupant makeup in the vehicle, whereby the occupant follows the sample and performs makeup It is possible to

  The ECU 20 according to the present embodiment divides the display 12 so that the first screen S1 and the second screen S2 are aligned in the left-right direction, and displays a moving image (mirror image) captured by the camera 11 on the first screen S1. A still image (sample image) is displayed on the second screen S2. In the present embodiment, the first screen S1 is disposed on the right side of the display 12, and the second screen S2 is disposed on the left side of the display 12. As a result, when the cosmetic work is performed with the right hand, the sample image is not hidden with the right hand, and the workability is improved.

  In the memory 22 (storage device) of the present embodiment, a plurality of samples to be referred to when the occupant makeup is stored. Examples of the sample include, for example, the face of one's own face when finishing makeup and the face of a model of a makeup magazine. As a method for the ECU 20 to store (register) a sample, for example, when an input operation (for example, a touch operation) on the first screen S1 is detected when makeup is finished, a memory image as a mirror image at that time is stored. The method of storing in 22 is mentioned. Thereby, the face of the user is stored as a sample. Also, a method is available in which the information recorded and stored in the recording medium 27 is read by the recording medium drive 25 (reading device) and the image included in the information is stored in the memory 22 as a sample. In this way, faces other than one's own are stored as a sample.

  The ECU 20 according to the present embodiment causes one of the plurality of samples to be displayed on the second screen S2 as a sample image based on an input operation on the touch panel 13 by the occupant. The ECU 20 displays, for example, one sample on the second screen S2 of the display 12 with the opening of the cover 15, switches the sample to be displayed according to the swipe operation, and displays the sample displayed when the touch operation is performed. It may be determined as In addition, for example, the ECU 20 may display a plurality of samples side by side on the second screen S2 of the display 12 with the opening of the cover 15, and determine the sample operated as a touch image as a sample image.

  The ECU 20 according to the present embodiment detects the cosmetic part of the occupant in the mirror image, and enlarges and displays the cosmetic parts displayed on the first screen S1 and the second screen S2 so as to have the same size. As a method of detecting the makeup location, for example, a method of recognizing the face of the occupant and the makeup tool in the image taken by the camera 11 and detecting the contact position of the face of the occupant with the makeup tool as a "makeup location" , And a method of detecting an operation part in an image as a "make-up part". The recognition function of the face of the occupant and the makeup tool can be realized using a known image recognition method. The magnification for displaying the enlargement may be set in advance, or may be set according to the makeup location.

  In addition, when a predetermined input operation (for example, one touch operation on the first screen S1) is performed during the enlargement display, the ECU 20 ends the enlargement display and switches to the display with the magnification 1. In addition, when another input operation (for example, two consecutive touch operations on the first screen S1) is performed during the enlarged display, the reduced display (entire display) may include the entire face. Good.

  Furthermore, the ECU 20 according to the present embodiment compares the mirror image and the sample image, and informs the occupant of makeup quality (for example, foundation, density of color of cheek or lipstick, thickness of eyebrows or eyeline, etc.). . The ECU 20 may, for example, determine that the makeup has been completed when the display is switched to the entire display and perform comparison, or may perform the comparison when a predetermined input operation is performed. A well-known image recognition method is employable for these comparisons. In addition, the comparison result may be notified by voice or may be notified by blinking the target portion (the portion with poor quality) in the sample image.

[2. flowchart]
FIG. 3 is a flowchart for explaining the procedure of display control performed by the ECU 20. This flow is started when the cover 15 is opened and the power of the camera 11, the display 12 and the touch panel 13 is turned on. Note that the data of the image captured by the camera 11 is always transmitted to the ECU 20.

  First, a mirror image is displayed on the first screen S1 (step A1). Next, a sample image is determined based on a predetermined input operation by the occupant from among a plurality of samples displayed on the second screen S2 (step A2), and a mirror image is displayed at a magnification of 1 and a sample image in step A3. Display the entire (normal display). In step A4, it is determined whether or not a makeup location is detected, and the normal display is maintained until the makeup location is detected. On the other hand, when the makeup part is detected in step A4, the size of the makeup part displayed on the first screen S1 and the second screen S2 is enlarged and displayed so as to be the same (step A5).

  In step A6, it is determined whether or not an input operation for switching from the enlarged display to the entire display has been performed, and when there is an input operation, both the screens S1 and S2 are switched to the entire display (step A7). On the other hand, when there is no input operation, it is determined whether or not the input operation for ending the enlarged display is performed (step A8), and if there is an input operation, both screens S1 and S2 are switched to normal display (step A9) . If there is no input operation in step A8, the process returns to step A4, and the determination as to whether or not a makeup part has been detected is repeated. At this time, when the makeup part is changed (for example, when changing from the right eye to the left eye), the makeup part after change (in this case, the left eye) is enlarged and displayed (step A5).

  When the display is switched to the entire display or the normal display in step A7 or step A9, it is determined again in step A10 whether or not the makeup part is detected again. This is because, in general, when performing makeup, since detailed work is performed while checking the balance of the entire face and the left and right, the magnified display and the entire display (or the normal display) are often alternately repeated. is there. If a makeup point is detected in step A10, the process returns to step A5, and the makeup point at that time is enlarged and displayed (step A5).

  On the other hand, when the makeup part is not detected in step A10, there is a high possibility that the makeup is completed, so the process proceeds to step A11 to compare the makeup quality and to notify the occupant of the comparison result. Since there is a possibility that the occupant remakes makeup and performs fine adjustment by this notification, it is determined in step A12 whether or not the makeup part is detected again, and if it is detected, the process returns to step A5. On the other hand, if no makeup point is detected in step A12, it is determined that makeup has been completed, and it is determined whether or not an input operation for storing a sample of one's own face has been made within a predetermined time (step A13).

  If there is an input operation within a predetermined time, a mirror image at that time is stored as a sample in the memory 22 (step A14), and it is determined whether the cover 15 is closed (step A15). On the other hand, when it is determined in step A13 that there is no input operation within the predetermined time, step A14 is skipped and the determination of step A15 is performed. When the cover 15 remains open, the process returns to step A12, and when the cover 15 is closed, this flow is ended.

[3. Action, effect]
(1) According to the above display device, since the mirror image and the sample image are displayed side by side on the display 12, it is possible to refer to the sample without moving the face, and make up while comparing with the sample. Can. For this reason, while being able to improve workability | operativity and convenience when a passenger carries out makeup, the dispersion | variation in the quality of makeup can be suppressed.

  (2) The above-described display device is provided with the touch panel 13, and one of the plurality of samples is displayed on the second screen S2 as a sample image based on an input operation on the touch panel 13 by the occupant. For this reason, an optimal sample can be selected according to the situation (for example, attendance, date, etc.) when the occupant makes makeup, and the sample image is displayed, whereby the convenience can be further improved.

(3) In the display device described above, when an input operation on the first screen S1 is detected and the mirror image at that time is stored in the memory 22 as a sample, the input operation is performed when the occupant finishes makeup If so, the mirror image at that time can be stored as a sample. Therefore, it is possible to easily increase the number of samples and to improve the convenience.
(4) In addition, when the image included in the information recorded and stored in the recording medium 27 is stored in the memory 22 as a sample, faces other than itself, such as the face of a model of a makeup magazine, can be stored as a sample. Therefore, it is possible to increase the number of samples to be referred to, and to improve convenience.

(5) In the above display device, when the makeup portion displayed on the first screen S1 and the makeup portion displayed on the second screen S2 are enlarged so as to have the same size, when drawing an eyeline It is possible to improve the workability when performing detailed work such as attaching a mascara.
(6) Further, according to the display device described above, since the makeup quality is notified on the basis of the comparison result of the mirror image and the sample image, it is possible to further suppress the variation in the quality.

  (7) The display device described above is provided on the back surface of the sun visor 1 and shooting with the camera 11 is started when the cover 15 is opened, so that the workability can be improved. In addition, even when the driver is wearing makeup, it is possible to effectively make use of the small clearance time, for example, when waiting for a traffic light, waiting for crossing or traffic jam.

[4. Modified example]
Although the case where camera 11 and display 12 were provided in the back of sun visor 1 provided in vehicles was illustrated in the above-mentioned embodiment, the position in which camera 11 and display 12 are provided is opposite to the occupant seated in the seat. It is not limited to the sun visor 1 as long as the position is For example, in addition to or instead of the sun visor 1, as shown in FIG. 4, the camera 11 and the display 12 may be provided on the surface (rear surface) facing the rear of the headrest 9 of the vehicle. In this case, even when the passenger on the rear seat makes a makeup, the same effect as that of the above embodiment can be obtained. In addition, the display device described above may be provided on the rear surface of the seatback of a vehicle, or on the rear surface of a seatback such as an airplane or a train (for example, a bullet train) or a headrest.

  Moreover, it is preferable that the ECU 20 in this case is provided with a plurality of modes including a makeup mode in which a mirror image is displayed on the first screen S1 and a sample image is displayed on the second screen S2. As modes, for example, a mirror mode in which only the mirror image is displayed on the entire surface without dividing the display 12, a television mode in which a television image is displayed on the display 12, and an external input mode in which a video input from the outside is displayed on the display 12 Etc.

  In this case, the ECU 20 switches a plurality of modes in accordance with a predetermined input operation, and displays an image or an image corresponding to the mode on the display 12. As a result, the passenger sitting on the rear seat can improve convenience by watching the television or the DVD as well as for makeup. The predetermined input operation includes, for example, an input operation on the touch panel 13, a remote control operation, and an operation on a switch provided on the headrest 9.

  The display content of the display 12 described above is an example, and is not limited to the above. For example, when displaying a makeup part in an enlarged manner, only the first screen S1 may be enlarged. In addition, the input operation when switching between the enlarged display, the entire display, and the normal display may not be as described above, and the switching between the enlarged display and the entire display may be omitted. Further, the control of notifying and comparing the quality and the control of storing its own face may be omitted. The number of samples stored in the memory 22 may be one. In this case, the sample may be overwritten and saved.

  When the display 12 is provided on the sun visor 1, the cover 15 may not be slidable. Further, the cover 15 and the touch panel 13 may be omitted, and an operation switch or the like may be provided on the side of the display 12 so that power on / off, registration of own face, switching of enlarged display or whole display, etc. can be operated.

1 sun visor 9 headrest 11 camera 12 display 13 touch panel 20 ECU (control device)
22 Memory (storage device)
25 Recording medium drive (reader)
S1 first screen (one screen)
S2 second screen (the other screen)

Claims (8)

A camera disposed at a position facing an occupant seated on a seat and capturing an image of the occupant seated;
A display disposed at the position and displaying a mirror image obtained by inverting the image captured by the camera;
A control device for dividing the screen of the display into two and displaying the mirror image on one of the screens and displaying a sample image as a sample of makeup on the other of the screens; apparatus. A touch panel provided on the surface of the display;
The control device has a storage device for storing a plurality of the samples, and displays one of the plurality of samples as the sample image based on an input operation on the touch panel by the occupant. The display device according to claim 1. The display device according to claim 2, wherein the control device stores the mirror image at that time in the storage device as the sample when detecting the input operation on the one screen. 4. The display according to claim 2, wherein the control device has a reading device for reading information recorded on a recording medium, and stores an image included in the information in the storage device as the sample. apparatus. The control device detects a makeup location of the occupant in the image captured by the camera, and the sizes of the makeup location displayed on the one screen and the other screen are equal to each other. The display apparatus according to any one of claims 1 to 4, wherein the display is enlarged. The display device according to any one of claims 1 to 5, wherein the control device notifies the occupant of makeup quality by comparing the mirror image and the sample image. The position includes a surface facing the passenger compartment side when using a sun visor provided on the vehicle,
The display device according to any one of claims 1 to 6, wherein the camera starts shooting when a cover covering the display is opened. Said position includes the face facing the back of the seat back or the headrest,
The control device is provided with a plurality of modes including a makeup mode for displaying the sample image,
The display device according to any one of claims 1 to 7, wherein the control device switches the plurality of modes in accordance with a predetermined input operation.

Images