JP2020050199A - Vehicular user interface system - Google Patents

Abstract

To provide a new vehicular user interface system.SOLUTION: A vehicular user interface system includes: a display part 1 provided on an upper surface panel 11 of a vehicular console device 10; a projection element 3 for projecting an information screen (B, D, F, G) including operation information images (60, 62 to 66, 73, 75, 76, H1 to H5) and operating images (sw, sw1 to sw3, hb, 60 to 65, 73, 82) of a vehicular device to the display part 1; a detection element 4 for detecting motions of fingers f of a user on the display part 1; and a control element 5 for performing operation control of the vehicular device in accordance with the motions of the fingers f of the user detected by the detection element 4. The area of the display part 1 is one third or more of the area of the upper surface panel 11.SELECTED DRAWING: Figure 1

Description

  The present invention relates to a vehicle user interface system for a user to operate a vehicle device.

  The vehicle is equipped with various types of vehicle equipment represented by a car navigation system, an air conditioner, a car audio, and the like. Operation terminals for these vehicle devices are arranged in the vehicle interior, and the operation terminals are appropriately operated by occupants.

Conventionally, the operation terminal is generally provided directly on each vehicle device, or provided near each vehicle device. However, in recent years, a user interface system, that is, a system for interactively exchanging information between various devices and a user has been actively developed. The development of technology in line with this is desired.
In addition, the rise of various types of portable information terminals represented by smartphones and tablet terminals has made it possible to detect the movement of the user's fingertips and operate intuitively, similar to a touch screen type terminal, as an operation terminal for various devices. Things to do are beginning to be recognized. As for vehicular equipment, those that detect the movement of a user's fingertip have been proposed (for example, see Patent Literature 1 and Patent Literature 2).

JP 2009-190675 A JP 2016-29532 A

In recent years, the environment surrounding vehicles has reached a major turning point, such as the advent of automatic driving by artificial intelligence. Since a new use environment different from the conventional one is assumed for the vehicle user interface system, a new vehicle user interface system capable of coping with the new use environment is desired.
The present invention has been made in view of the above circumstances, and has as its object to provide a new vehicle user interface system.

The vehicle user interface system of the present invention that solves the above-mentioned problems,
A display unit provided on a top panel of the vehicle console device, a projection element for projecting an information screen including a driving information image and an operation image of the vehicle device on the display unit, and a user's fingertip on the display unit. A detection element for detecting movement, and a control element for controlling the operation of the vehicle device in accordance with the movement of the fingertip of the user detected by the detection element,
The area of the display unit is one-third or more of the area of the top panel, and is a user interface system for a vehicle.

  The vehicle user interface system of the present invention is a new vehicle user interface system.

FIG. 1 is an explanatory diagram schematically illustrating a vehicle user interface system according to a first embodiment. FIG. 2 is an explanatory diagram schematically showing a state in which car audio is driven and controlled by the vehicle user interface system of the first embodiment. FIG. 2 is an explanatory diagram schematically showing a state in which car audio is driven and controlled by the vehicle user interface system of the first embodiment. FIG. 2 is an explanatory diagram schematically showing a state in which car audio is driven and controlled by the vehicle user interface system of the first embodiment. FIG. 2 is an explanatory diagram schematically showing a state in which car audio is driven and controlled by the vehicle user interface system of the first embodiment. FIG. 4 is an explanatory diagram schematically illustrating a state in which the operation of the air conditioner is controlled by the vehicle user interface system of the first embodiment. FIG. 4 is an explanatory diagram schematically illustrating a state in which the operation of the air conditioner is controlled by the vehicle user interface system of the first embodiment. FIG. 4 is an explanatory diagram schematically illustrating a state in which the operation of the air conditioner is controlled by the vehicle user interface system of the first embodiment. FIG. 2 is an explanatory diagram schematically illustrating a state in which the car navigation system is being driven and controlled by the vehicle user interface system of the first embodiment. FIG. 2 is an explanatory diagram schematically illustrating a state in which the car navigation system is being driven and controlled by the vehicle user interface system of the first embodiment. FIG. 2 is an explanatory diagram schematically illustrating a state in which the car navigation system is being driven and controlled by the vehicle user interface system of the first embodiment. FIG. 2 is an explanatory diagram schematically illustrating a state in which the car navigation system is being driven and controlled by the vehicle user interface system of the first embodiment. FIG. 2 is an explanatory diagram schematically illustrating a state in which the car navigation system is being driven and controlled by the vehicle user interface system of the first embodiment. FIG. 2 is an explanatory diagram schematically illustrating a state in which the car navigation system is being driven and controlled by the vehicle user interface system of the first embodiment.

In the vehicle user interface system according to the present invention, the top panel of the vehicle console device is used as a display unit, and the projection element projects an information screen of the vehicle device on the display unit. When the user operates the operation image included in the information screen, the detection element detects the movement of the user's fingertip, and the control element controls the operation of the vehicle device according to the movement of the fingertip.
The information screen of the vehicle device described above includes a driving information image of the vehicle device, and the movement of the fingertip of the user operating the operation image includes information from the user. Therefore, the vehicle user interface system of the present invention can be said to exchange information bidirectionally between the vehicle equipment and the user.

  The vehicle user interface system of the present invention uses the upper panel of the vehicle console device as a display unit.

  For example, Patent Literature 1 mentioned above proposes a technique of projecting an operation switch image on a driver's retina. That is, the technique of Patent Document 1 uses a driver's retina as a display unit. According to this type of technology, an operation switch image can be displayed in a virtual reality (VR: Virtual Reality) manner. However, on the other hand, the operation switch image obstructs the field of view, and the user may feel troublesome.

  In addition, Patent Document 2 mentioned above proposes a technique of projecting a switch image on a palm of a user. That is, the technique of Patent Document 2 uses a palm of a user as a display unit. According to this kind of technology, the user actually moves his / her gaze and visually recognizes the switch image based on his / her own judgment. Therefore, the switch image does not obstruct the user's view. In addition, this type of display method is likely to be acceptable to users who prefer traditional or nostalgic operations.

However, on the other hand, by using the palm of the user's hand as the display unit, the user needs to keep his or her hand fixed while projecting the display unit, and is thus nervous.
Further, by using the palm of the user's hand as the display unit, the area of the display unit becomes very small, so that the switch image also becomes very small. As a result, the amount of information that can be inserted into the switch image is small, and the user is required to delicately move the fingertip to operate the switch image. Furthermore, there is also a problem that a sensor for detecting the movement of the fingertip requires a highly accurate sensing technique.

  In addition, it is conceivable to use a windshield, a side glass, an interior panel, or the like of the vehicle as the display unit. In these cases, however, the user needs to operate while raising his arm. If the user is in a relaxed state with the seat down, such as during automatic driving, it may be necessary to return the seat in order to perform the operation. Therefore, it is difficult to say that a vehicle user interface system having such a display unit is also excellent in usability.

  On the other hand, in the vehicle user interface system of the present invention, the upper panel of the vehicle console device is used as the display unit, and the information screen is projected on the upper panel. For this reason, the user moves his / her gaze on the information screen and actually visually recognizes the information screen. That is, the information screen in the vehicle user interface system of the present invention is displayed in augmented reality (AR: Augmented Reality). For this reason, the information screen does not obstruct the user's field of view, and the operation of the vehicle device using the information screen is also suitable for a user who likes a nostalgic operation.

  Further, the upper panel of the vehicle console device used as the display unit in the vehicle user interface system of the present invention has a relatively large area. In particular, in the vehicle user interface system of the present invention, the area of the display unit is sufficiently large, that is, 1/3 or more of the area of the top panel. For this reason, in the vehicle user interface system of the present invention, a lot of information can be put in the information screen. In addition, if the display unit is large, a large information screen can be projected on the display unit, so that the user can operate the operation image included in the information screen without any difficulty. In addition, a large display unit is advantageous in terms of detection accuracy.

  Further, the upper panel of the vehicle console device has been used as an armrest for an occupant sitting on a driver's seat or a passenger's seat. For this reason, the user can operate the operation image displayed on the upper panel while relaxing.

  As described above, the vehicle user interface system of the present invention is different from the conventional one in that a large information screen is displayed in an AR manner to provide the user with a pleasant operation feeling different from the conventional user interface system. It can be called a new vehicle user interface system.

  Hereinafter, each component of the vehicle user interface system of the present invention will be individually described.

  The vehicle user interface system of the present invention has a display unit, a projection element, a detection element, and a control element.

  The display unit includes at least a part of a top panel of the vehicle console device. The position of the display unit on the upper panel may be appropriately determined according to the positional relationship with the projection element that projects the information screen on the display unit. For example, when the projection element is arranged on the front side of the upper panel in the vehicle traveling direction, the front part of the upper panel may be used as the display unit. Alternatively, in the case where the projection element is provided behind the upper panel in the vehicle traveling direction, the rear portion of the upper panel may be used as the display unit.

  The area of the display unit is substantially the projected area of the information screen by the projection element. The area of the display unit in the vehicle user interface system of the present invention may be 以上 or more of the area of the upper panel as described above, but is preferably 以上 or more of the area of the upper panel. Is more preferably 3/5 or more, further preferably 2/3 or more, and particularly preferably 5/4 or more.

The instrument panel on the front side of the top panel in the vehicle traveling direction can secure a space for installing the projection element, and when placing the hand or arm on the top panel, the user's finger Since is naturally arranged on the front portion of the upper panel, it is preferable that the display section is constituted by the front portion of the upper panel. Of course, the upper panel may be used as an armrest.
Furthermore, an excellent tactile sensation may be imparted to the upper panel by, for example, forming the surface of the upper panel with a raised skin material or arranging a cushion material on the back side of the skin material. By doing so, the user can more comfortably operate the operation image by touching the information screen.

  The projection element is for projecting the information screen of the vehicle device on the display unit. The projection element is a projector having a display unit as a screen. For example, a known element such as a CRT projector or a liquid crystal projector may be used, and is not particularly limited. The light source of the projector is also not particularly limited, and various light sources such as a mercury lamp, LED, and laser diode can be used.

  Here, the vehicle equipment refers to all equipment mounted on the vehicle, and includes, for example, a car navigation system, an air conditioner, a car audio, a video display device such as a television and a DVD, and a vehicle communication system linked to a mobile phone. And the like.

The operation image included in the information screen is an image for controlling operation of one or more of these vehicle devices.
When driving and controlling a plurality of vehicle devices in the vehicle user interface system of the present invention, the operation image for controlling the operation of each vehicle device may be placed on the same screen in the information screen, but in a different hierarchy. It is preferable to put them on separate screens.

  Each operation image is represented by a different character, picture, photograph, color, animation, or the like so that the user can easily identify the operation image. Further, each operation image is stored in a control element to be described later in association with the driving control of the vehicle device corresponding to the operation image and a predetermined user's fingertip movement, and is stored as needed. Be called. In some cases, related operating images may be associated and called together at the same time.

  A specific example of the operation image will be described. For example, if the vehicle device is a car navigation system, the operation image is used to perform operations such as setting or canceling a destination in the car navigation system, selecting a traveling route, searching for facilities, and enlarging or reducing a map screen. Is exemplified.

  If the vehicle device is an air conditioner, examples of the operation image include images for performing operations such as temperature setting, air volume setting, wind direction setting, mode switching of cooling, heating, and the like in the air conditioner.

  If the vehicle device is a car audio, the operation image includes operations such as selecting an album, a playlist, an artist, a song, and creating, editing, playing, stopping, and adjusting the volume of the car audio. The image for the example is illustrated.

  If the vehicle device is a video display device, examples of the operation image include images for performing operations such as channel selection, content selection, language setting, playback, stop, and volume adjustment in the video display device. You.

  If the vehicle equipment is a vehicle communication system, the operation image includes operations such as synchronization with a mobile phone in the vehicle communication system, selection of an address book, start of a call, termination of a call, and editing of an address book. An image to perform is illustrated.

The information screen includes a driving information image of the vehicle device.
For example, if the vehicle equipment is a car navigation system, the driving information includes the current location, the destination, whether or not guidance is being performed, road information, and the like.
When the vehicle device is an air conditioner, the driving information includes a set temperature, an air volume, a temperature in a vehicle compartment, a temperature outside a vehicle, and the like.
If the vehicle device is a car audio, the driving information includes an album or a playlist being reproduced, an artist, a song, a volume, a song to be reproduced next, and the like.
If the vehicle device is a video display device, the driving information includes a broadcast station being received, content being received, content being played back, volume adjustment, and the like.
If the vehicle device is a vehicle communication system, the driving information includes a communication partner, a communication time, and the like.

  The driving information image included in the information screen is an image of such driving information. Each driving information image is also expressed by a different character, picture, photograph, color, animation, or the like. Each driving information image is stored in a control element described later in association with the driving control of the vehicle device corresponding to the driving information image and a predetermined movement of the user's fingertip, and is called up as necessary. . The driving information images related to each other, or the driving information image and the operation image related to each other, may be associated and called at the same time.

  The information screen may include all of the operation images and the driving information images on the same hierarchical screen, but preferably includes a plurality of hierarchically displayed screens.

  For example, if the vehicle device is a car navigation system, a screen including an operation image for selecting a destination and a navigation screen including driving information images such as a current location and a peripheral map are the same. It is preferable that the screens are not separate screens but are provided in different layers as separate screens.

  Note that, here, the operation image and the driving information image are not focused on different hierarchies, but the operating image and the driving information image may be displayed on the same screen in the same hierarchy as necessary. Further, the operation image and the driving information image may be integrated.

  Further, for example, when the vehicle device is a car audio, an operation image for selecting an album or a playlist and an operation image for playing, stopping, and adjusting the volume of the selected album or a playlist are referred to. It is preferable that the images are not integrated and the same image but are formed as separate images and placed on different screens and different layers.

  By the way, an operation terminal such as a switch or a controller of a vehicle device is generally in a tab shape. For this reason, the movement of the user's fingertip when actually operating the vehicle equipment is generally a movement of pushing, sliding, or rotating the tab.

  On the other hand, since the operation image is projected with a certain extent on the top panel, the movement of the user's fingertip on the operation image is not limited to a simple movement such as pushing or sliding. In addition, complicated movements can be tolerated. The complex movement here refers to a delicate or three-dimensional movement such as rubbing, stroking, tapping, or showing some hand sign, in addition to general movement in a touch screen type terminal such as a pinch or flick. May be included.

  For this reason, in the vehicle user interface system of the present invention, the movement of the fingertip of the user operating the operation image may be different from the actual operation of the vehicle device.

  As a specific example, a record player may be displayed as an information screen of car audio, and an album, a playlist, or the like, which has been selected in another hierarchy in advance, may be displayed as an analog record. Then, the movement of the fingertip of the user placing the record needle in the groove of the analog record by grasping the arm of the record player may be detected, and the car audio may be reproduced according to the movement of the fingertip.

Such movement of the fingertip of the user simulates the movement of the fingertip when playing an analog record on a record player, and the movement of the fingertip when playing the actual car audio, for example, pushing on a switch. It is completely different from the movement of the fingertip when turning off / on.
However, if the operation image is an image of a device that can be intuitively operated by the user, although different from the actual vehicle device, such as the above-described record player, the user can easily operate the vehicle device. .

  In the case where the display unit is provided at a place other than the top panel of the vehicle console device, the above-mentioned “movement of the fingertip of the user operating the operation image may be different from the actual movement of the fingertip of the vehicle device. It is possible to embody the "adopt" mode. For example, it is also possible to regard the upper surface of the table provided in the rear seat as a display unit and project the information screen of the record player or the like on the display unit. Alternatively, a part of the rear seat may be regarded as a display unit, and the information screen may be directly projected on the display unit.

From this viewpoint, the display unit in the vehicle user interface system of the present invention is not limited to the display unit provided on the upper panel of the vehicle console device, but may be regarded as being provided in the vehicle interior. That is, in this case, the vehicle user interface system of the present invention can be expressed as follows.
"A display unit provided in a vehicle interior, a projection element for projecting an information screen including a driving information image and an operation image of a vehicle device on the display unit, and a movement of a fingertip of a user on the display unit is detected. A detection element, and a control element that controls the operation of the vehicle device in accordance with the movement of the user's fingertip detected by the detection element,
The information screen is composed of a plurality of screens displayed in a hierarchy,
A user interface system for a vehicle, wherein at least one of the plurality of screens controls a driving state of the vehicle device by a movement of a fingertip of the user different from an actual operation of the vehicle device. "
Even when the display unit is provided in a place other than the upper panel of the vehicle console device, it is preferable that the area of the display unit is large. In this case, a preferable range of the area of the display portion includes a range of 100 cm ² or more, 120 cm ² or more, and 150 cm ² or more. Although there is no upper limit to the area of the display unit, it is realistic to set the area to which the user's fingertip moves. For example, 600 cm ² can be exemplified as the upper limit of the area of the display unit.

  The information screen in the vehicle user interface system of the present invention preferably includes an animation. In this case, the user can experience comfort, fun, relaxation, and the like by the information screen. The animation may be a driving information image or an operation image.

For example, in the case of the record player described above, by expressing the movement of the arm and the rotation of the analog record by animation, the user can experience an operational feeling as if the analog record were actually being reproduced.
For example, if the vehicle equipment is an air conditioner, the user can visually and intuitively enjoy the warmth and coolness by expressing the driving information such as the temperature in the cabin and the airflow of the conditioned air by animation. Can be.

  In the vehicle user interface system of the present invention, only one of the operation image and the driving information image in the information screen may be expressed by animation, or both may be expressed by animation.

  The projection element projects the above information screen on the display unit. For example, the projection element may be arranged on the instrument panel, may be arranged on the ceiling, or may be arranged in other places, but the information screen is hidden behind the user's shadow. It is preferable to dispose it at a position where it will not be stuck, and it is particularly preferable to dispose it on the instrument panel.

  The detection element detects a movement of a user's fingertip on the display unit. The detecting element may detect at least one of the position, the moving direction, the moving amount, and the moving speed of the fingertip of the user, and preferably detects a plurality of these. The detection element may only detect the movement of the fingertip of a specific finger of the user, but preferably detects the movement of the fingertips of a plurality of fingers. The detection element may simply detect the movement of the user's fingertip as image or coordinate information, or may analyze the movement of the user's fingertip by performing image analysis or the like. The analysis may be performed by a control element described later.

The detection element may detect the movement of the user's fingertip on the display unit by any method. For example, an infrared grid sensor, an image sensor using an image sensor such as a CMOS or a CCD, and the like are suitable as detection elements.
The detection element may be disposed at the same position as the projection element, but is preferably disposed on the ceiling in order to detect the movement of the user's fingertip with high accuracy.
Hereinafter, the movement of the user's fingertip on the display unit is referred to as operation information as necessary.

The control element controls the operation of the vehicle device according to the operation information detected by the detection element. Therefore, the control element is connected to the projection element, the detection element, and the vehicle equipment by wire or wirelessly.
As such a control element, an element that can function as a so-called computer or microcontroller may be used. Specifically, the control element may include a CPU, a memory, and other elements such as a hard disk drive as needed. As the control element, an engine control unit (so-called ECU) for a vehicle may be used, or a computer different from the ECU may be used.

  The vehicle user interface system of the present invention may include a sub display unit in addition to the display unit provided on the top panel. For example, a monitor for a car navigation system provided on an instrument panel can be given as the sub display unit. The information screen displayed on the sub-display unit may be exactly the same as the information screen displayed on the display unit, but is preferably at least partially different. Hereinafter, the information screen displayed on the sub-display unit is referred to as a second information screen in order to distinguish the information screen displayed on the sub-display unit from the information screen displayed on the display unit, as necessary. The information screen displayed on the display unit is called a first information screen.

Displaying the second information screen different from the first information screen on the sub display unit not only increases the amount of information that can be displayed, but also has the advantage that the information screen can be displayed in various ways. is there.
For example, the second information screen displayed on the sub-display unit and the first information screen displayed on the display unit are linked to each other, and the sub-display unit mainly displays the driving information image, and the display unit displays The operation image may be mainly displayed. Alternatively, only the driving information image may be displayed on the sub display unit, and the driving information image and the operation image may be displayed on the display unit.

Further, a part of the first information screen and a part of the second information screen may be shared. For example, at least one of the images constituting the first information screen and the second information screen is a moving image. When the moving image appears on the first information screen, it does not appear on the second information screen, and when it appears on the second information screen, it does not appear on the first information screen. To do. Then, it looks as if the moving image is moving between the first information screen and the second information screen. The moving image may be a driving information image or an operation image.
For example, taking the above-mentioned record player as an example, if the analog record displayed on the second information screen disappears from the second information screen and appears on the first information screen, the analog record is displayed in a sub-display. It appears to have moved from the display to the display. In this case, the analog record is a moving image.

  At this time, if the moving image, that is, the analog record moves in the sub-display unit toward the display unit and / or moves in the display unit from the sub-display unit side to the opposite side is displayed by animation, The moving image appears to actually move between the first information screen and the second information screen. By doing so, the user can recognize that the analog record exists, and the AR element of the information screen is strengthened.

  Hereinafter, the vehicle user interface system of the present invention will be described with reference to specific examples.

(Example 1)
The vehicle user interface system of the first embodiment is an example of controlling the operation of a car audio, an air conditioner, and a car navigation system as vehicle equipment.
FIG. 1 is an explanatory diagram schematically illustrating the vehicle user interface system according to the first embodiment. FIGS. 2 to 5 are explanatory diagrams schematically showing a state in which the car audio is driven and controlled by the vehicle user interface system of the first embodiment. Specifically, FIGS. 2 and 4 show a second information screen displayed on the sub display unit, and FIGS. 3 and 5 show a first information screen displayed on the display unit.
FIGS. 6 to 8 are explanatory diagrams schematically illustrating a state in which the operation of the air conditioner is controlled by the vehicle user interface system of the first embodiment. More specifically, FIG. 6 shows a second information screen displayed on the sub display unit, and FIGS. 7 and 8 show a first information screen displayed on the display unit.
FIG. 9 to FIG. 14 are explanatory diagrams schematically illustrating a state in which the operation of the car navigation system is controlled by the vehicle user interface system of the first embodiment. More specifically, FIGS. 9, 11 to 14 show a second information screen displayed on the sub-display unit, and FIG. 10 shows a first information screen displayed on the display unit.
Hereinafter, upper, lower, left, right, front, and rear refer to upper, lower, left, right, front, and rear shown in FIG. The front-back direction matches the vehicle traveling direction, the left-right direction matches the vehicle width direction, and the up-down direction matches the vertical direction.

  The vehicle user interface system according to the first embodiment includes a display unit 1, a sub display unit 2, a projection element 3, a detection element 4, and a control element 5.

  The display unit 1 is provided on an upper panel 11 of the vehicle console device 10. Specifically, the display unit 1 is configured by a front portion of the upper panel 11.

  The sub display unit 2 has a monitor screen for a car navigation system provided on the instrument panel 20. The sub display unit 2 is a touch panel.

  The projection element 3 is a laser projector using a laser diode as a light source, and is provided on the instrument panel 20. The projection element 3 is located on the front side of the display unit 1, that is, the upper panel 11 of the vehicle console device 10.

  The detection element 4 is an image sensor, and is arranged on a ceiling of a vehicle compartment. The detection element 4 captures an image of the display unit 1 from above, and transmits operation information based on the obtained image data to a control element 5 described below. The operation information is analyzed by the control element 5. In the vehicle user interface system according to the first embodiment, the fingertips of the user are identified one by one by the detection element 4, and the position of each fingertip is monitored over time. The amount of change in the position of each fingertip is sent to the control element 5 as operation information, and the control element 5 analyzes the type of operation performed on the operation image by the user based on the operation information. Note that the position where the sensing element 4 is provided may be any position at which the user's fingertip can be identified, and is not limited to the ceiling. The detection element 4 may be provided, for example, near the projection element 3 in the instrument panel 20. In this case, there is an advantage that the projection element 3 and the detection element 4 can be unitized and can be made compact.

  The control element 5 is a computer dedicated to the vehicle user interface system provided separately from the ECU or the like of the vehicle. The control element 5 is connected to the sub display unit 2, the projection element 3, and the detection element 4. The control element 5 is also connected to the ECU of the vehicle.

  In the vehicle, a car audio (not shown), an air conditioner (not shown), and a car navigation system (not shown) are provided in front of the instrument panel 20. In addition, a first air outlet 25, a second air outlet 26, and a third air outlet 27, which are air outlets of the air conditioner, are provided in the vehicle interior. These are all vehicle devices.

  Hereinafter, the operation control of the car audio by the vehicle user interface system of the first embodiment will be described.

  When the user gets on the vehicle and an occupant detection signal is transmitted from the ECU (not shown) to the control element 5, the control element 5 projects the first information screen B on the display unit 1 by the projection element 3. Further, the projection element 3 causes the sub-display unit 2 to display the second information screen A.

  The first information screen B displayed at this time is the home screen shown in FIG. The second information screen A displayed at this time is the home screen shown in FIG. Each of the first information screen B and the second information screen A has a plurality of images such as an operation start switch sw1 for a car audio, an operation start switch sw2 for an air conditioner, and an operation start switch sw3 for a car navigation system. Switch sw. These switches are operating images.

  As shown in FIG. 1, when the user places his hand over the first information screen B projected on the display unit 1, the detection element 4 detects that the user's fingertip f is on the display unit 1. Then, operation information corresponding to the movement of the user's fingertip f is transmitted to the control element 5. The control element 5 having received the operation information switches the images included in the first information screen B and the second information screen A according to the operation information, or switches the first information screen B and the second information screen The information screen A itself is switched to another screen having a different hierarchy.

For example, when the user traces the first information screen B shown in FIG. 3 with the fingertip f, each switch sw included in the first information screen B is switched so as to move in the direction in which the finger moves. For this reason, the user feels an operation feeling as if he or she is turning a wheel on which a plurality of switches sw are arranged.
Hereinafter, similarly, the movement of the user's fingertip f is detected by the detection element 4, the operation information transmitted by the detection element 4 is transmitted to the control element 5, and the control element 5 performs various operation controls according to the operation information. If necessary, the operation of the detection element 4 and the control element 5 will be omitted as needed.

  Further, as described above, since the sub-display unit 2 is a touch panel, the same operation can be performed by the user directly touching the sub-display unit 2. The operation of the sub display unit 2 by the user is omitted as appropriate.

  When the user touches the car audio operation start switch sw1 on the first information screen B, the second information screen C (FIG. 4) is displayed on the sub-display unit 2. The first information screen B projected on the display unit 1 is also switched to a first information screen C '(not shown) similar to the second information screen C. The first information screen C ′ projected on the display unit 1 is a screen having a different hierarchy from the first information screen B. Similarly, the second information screen C is also a screen having a different hierarchy from the second information screen A.

The first information screen C ′ and the second information screen C include a plurality of record jackets 60 as images. The record jacket 60 displays an album or a play list stored in the car audio or distributed to the car audio as an image imitating an actual record jacket. The record jacket 60 is both an operation image and a driving information image.
Hereinafter, the album or the play list is abbreviated as an album or the like as necessary.

  Further, the first information screen C ′ and the second information screen C (FIG. 4) include an operation wheel 61 that is an operation image. When the user traces the operation wheel 61 with a finger, the record jacket 60 displayed on the front in the first information screen C 'and the second information screen C is switched in turn.

  As described above, the record jacket 60 is also an operation image. When the user touches the record jacket 60 with a finger, the first information screen C ′ projected on the display unit 1 switches to the first information screen D (FIG. 5) imitating a record player, and The record jacket 60 displayed on the second information screen C (FIG. 4) is switched to an animation in which an analog record comes out of the record jacket 60.

The animation of the analog record coming out of the record jacket 60 on the second information screen C (FIG. 4) moves downward in the second information screen C and disappears from the second information screen C.
The analog record animation that has disappeared from the second information screen C then appears on the front end side of the first information screen D (FIG. 5), and moves from the front side to the rear side in the first information screen D. Then, the image is switched to the image of the analog record 63 which is not an animation, overlapping the turntable 62 of the record player.

  The first information screen D shown in FIG. 5 has, as an image, an arm 64 and a volume adjustment knob 65 in addition to the analog record 63 and the turntable 62 described above. These are all operation images and driving information images.

  When the user touches the arm 64, performs an operation of picking the arm 64 and placing the record needle in the groove of the analog record 63, the image of the analog record 63 is switched to an animation in which the analog record rotates, according to the movement of the fingertip, The selected album or the like is reproduced.

  At this time, the animation in which the analog record 63 rotates is reproduced slightly later than the movement of the user's fingertip f by grasping the arm 64 and placing the record needle in the groove of the analog record 63. Also, the album or the like is reproduced slightly after the reproduction of the animation. Since this time lag imitates the actual operation of the record player, the user can recognize that the analog record is actually being reproduced by the record player.

  When the user performs an operation of sliding the volume adjustment knob 65 with a finger, the volume of the car audio is changed according to the movement of the fingertip. When the user picks the arm 64 and removes the record needle from the groove of the analog record 63, the animation of the analog record rotating in accordance with the movement of the fingertip is switched to the stopped image of the analog record 63 and played. The current album or playlist stops.

  At this time, on the second information screen C, as shown in FIG. 4, a song 66 such as a selected album is displayed. By directly touching the second information screen C and selecting a specific tune, the user can directly select a tune to be reproduced by the car audio.

  Hereinafter, the operation control of the air conditioner by the vehicle user interface system of the first embodiment will be described.

  As shown in FIG. 5, the first information screen D has a home button hb. The home button hb is an operation image, and when the user touches the home button hb in the first information screen D, the second information screen C shown in FIG. 4 is shown in FIG. The screen is switched to the second information screen A, ie, the home screen, and the first information screen D shown in FIG. 5 is also switched to the first information screen B, ie, the home screen shown in FIG.

  When the user touches the air conditioner operation start switch sw2 on the first information screen B (FIG. 3), the first information screen F and FIG. 6 shown in FIG. 7 and FIG. The second information screen E shown is called. The first information screen B (FIG. 3) displayed on the display unit 1 switches to the first information screen F (FIG. 7 or FIG. 8). Further, the second information screen A (FIG. 2) displayed on the sub display unit 2 is switched to the second information screen E (FIG. 6). The first information screen F and the second information screen E are screens having different hierarchies from the first information screen B and the second information screen A, which are home screens.

The first information screen F shown in FIGS. 7 and 8 includes a driver seat position image 70, a console position image 71, a passenger seat position image 72, and a main operation image 73.
The driver's seat position image 70 simulates a steering wheel, and represents the first outlet 25 (FIG. 1) of the air outlet of the air conditioner, which is arranged near the driver's seat.
The console position image 71 simulates the vehicle console device 10, and represents the second air outlet 26 (FIG. 1) provided in the vehicle console device 10 among the air outlets of the air conditioner.
The passenger seat position image 72 simulates the instrument panel 20, and represents the third outlet 27 (FIG. 1) of the air outlet of the air conditioner, which is provided near the passenger seat.

  By touching any one of the driver's seat position image 70, the console position image 71, and the passenger seat position image 72 with a finger, the user can select one of the first outlet 25 to the third outlet 27 to be controlled. That is, for example, when the user touches the driver's seat position image 70, the control element 5 controls the operation of the first outlet 25 in accordance with the movement of the fingertip on the main operation image 73 described later.

The main operation image 73 has a ring shape. On the main operation image 73, that is, inside the ring, the set temperature 75 and the air volume 76 of the air conditioner are displayed as characters. The main operation image 73 is an animation. Specifically, when the air conditioner is performing the cooling operation, the main operation image 73 is switched to an animation that simulates the swaying cool wind of the cold color (FIG. 7). Further, when the air conditioner is performing the heating operation, the main operation image 73 is switched to an animation simulating warm air fluctuating (FIG. 8).
The main operation image 73 is an operation image and an operation information image, and the set temperature 75 and the air volume 76 of the air conditioner are operation information images.

  When the user traces the main operation image 73 from the left to the right with a fingertip, the air volume 76 of the air conditioner increases according to the movement of the fingertip. When the air volume 76 increases, the fluctuation in which the main operation image 73 displays an animation also increases. When the user traces the main operation image 73 from right to left with a fingertip, the air volume 76 of the air conditioner decreases according to the movement of the fingertip. When the air volume 76 decreases, the fluctuation of the main operation image 73 displayed as an animation also decreases.

  Further, when the user traces the main operation image 73 from the lower side to the upper side with a fingertip, the set temperature 75 of the air conditioner increases according to the movement of the fingertip. When the user traces the main operation image 73 from the upper side to the lower side with a fingertip, the set temperature 75 of the air conditioner decreases according to the movement of the fingertip.

  Hereinafter, the operation control of the car navigation system by the vehicle user interface system of the first embodiment will be described.

  The first information screen F shown in FIGS. 7 and 8 has a home button hb. When the user touches the home button hb in the first information screen F, the first information screen F is switched to the first information screen B shown in FIG. E switches to the second information screen A shown in FIG.

  When the user touches the operation start switch sw3 for the car navigation system on the first information screen B, the first information screen B (FIG. 3) displayed on the display unit 1 in response to the movement of the fingertip is changed to the first information screen B (FIG. 3). Screen G (FIG. 10). Further, the second information screen A (FIG. 2) displayed on the sub display unit 2 is switched to the second information screen H1 (FIG. 11).

The first information screen G shown in FIG. 10 and the second information screens H1 to H5 shown in FIGS. 9 and 11 to 14 correspond to the first information screen B shown in FIG. The information screen A is a screen having a different hierarchy.
The second information screens H1 to H5 are screens having different levels, and the second information screens H1 to H5 are also driving information images indicating the current location. Among them, the second information screen H1 shown in FIG. 11 is a two-dimensional map, and the second information screen H2 shown in FIG. 9 is a three-dimensional map. The second information screen H3 shown in FIG. 12 is a map of Japan, the second information screen H4 shown in FIG. 13 is a world map, and the second information screen H5 shown in FIG. 14 is a globe.

  The first information screen G shown in FIG. 10 includes a home button hb, a current location button 80, a compass 81, and a main operation image 82. The home button hb is the same as described above. The compass 81 always points north. The current location button 80 will be described later.

  The main operation image 82 has a ring shape with the inside partitioned by a grid. The main operation image 82 is an operation image.

  When the user holds one fingertip over the main operation image 82 (FIG. 10), a second information screen H1 (FIG. 11), which is a two-dimensional map, is displayed on the sub display unit 2, and the second information screen H1 is displayed. Your current location is displayed above. When the user traces the main operation image 82 with one fingertip, the display point of the two-dimensional map displayed on the second information screen H1 changes according to the movement of the user's fingertip f.

In addition, when the user holds the two fingertips over the main operation image 82 and performs a pinch-in operation to spread the two fingertips, the two-dimensional map shown on the second information screen H1 is displayed according to the movement of the fingertips. It is enlarged. At this time, the grid interval of the main operation image 82 becomes large.
When the user holds the two fingertips spread over the main operation image 82 and performs a pinch-out operation of attaching the two fingertips, the two-dimensional map shown on the second information screen H1 according to the movement of the fingertips Is reduced. At this time, the grid interval of the main operation image 82 becomes smaller.
Furthermore, when the user holds the two fingertips over the main operation image 82 and turns the two fingertips, the two-dimensional map shown on the second information screen H1 rotates according to the movement of the fingertips.
When the user touches the current location button 80, the current location is displayed on the second information screen H1 displayed on the sub display unit 2, and the two-dimensional map shown on the second information screen H1 is shown in FIG. Return to the reference size and reference rotation angle.

When the user holds the three fingertips over the main operation image 82, performs a long-press operation to stop the fingertips for a predetermined period of time, and then performs a flick operation to shift the fingertips, the sub-display unit according to the movement of the fingertips 2 is switched to the second information screen H2 which is a three-dimensional map.
When the user touches the current location button 80, the second information screen H2 displayed on the sub display unit 2 is switched to the second information screen H1 which is a two-dimensional map, and the current location is displayed on the second information screen H1. You.

  When the user holds the four fingertips over the main operation image 82 and performs a long press operation, the destination of the car navigation system is set at home.

When the user holds five fingertips over the main operation image 82, a second information screen H1, which is a two-dimensional map, is displayed on the sub-display unit 2. Then, when the user performs a pinch-in operation to spread the five fingertips, The second information screen H1 is a second information screen H3 (FIG. 12) which is a map of Japan, a second information screen H4 (FIG. 13) which is a world map, and a second information screen H5 which is a globe (FIG. 14). ).
When any of the second information screens H2 to H5 is displayed on the sub display unit 2, when the user touches the current location button 80, the display on the sub display unit 2 is a second information screen H1 that is a two-dimensional map. Switch to Further, the current location is displayed on the second information screen H1.

  The present invention is not limited to the embodiment described above and shown in the drawings, and can be implemented with appropriate modifications without departing from the scope of the invention. Each component shown in this specification including the embodiment can be arbitrarily extracted and combined for implementation.

The vehicle user interface system of the present invention can be expressed as follows.
[1]
The display unit 1 provided on the upper panel 11 of the vehicle console device 10, the operation information images (60, 62 to 65, 73, 75, 76, H1 to H5) and the operation images (sw, sw1) of the vehicle equipment , Sw3, hb, 60 to 65, 73, 82), a projection element 3 for projecting an information screen (B, D, F, G) on the display unit 1, and a user's fingertip f on the display unit 1. A detection element 4 for detecting a movement, and a control element 5 for controlling the operation of the vehicle device in accordance with the movement of the user's fingertip f detected by the detection element 4,
The user interface system for a vehicle, wherein an area of the display unit 1 is equal to or more than ３ of an area of the upper panel 11.
[2]
The vehicle user interface system according to [1], wherein the display unit 1 includes a front portion of the upper panel 11 in a vehicle traveling direction.
[3]
The information screen (B, D, F, G) is composed of a plurality of screens displayed in a hierarchy,
The vehicle according to [1] or [2], wherein in at least one of the plurality of screens, the operation of the vehicle device is controlled by a movement of the user's fingertip f different from an actual operation of the vehicle device. User interface system.
[4]
The vehicle user interface system according to any one of [1] to [3], wherein the information screen (B, D, F, G) includes an animation.
[5]
The control element 5 performs unique control on the vehicle device according to the movement of the user's fingertip f detected by the detection element 4 and the number of fingertips f indicated by the user. The vehicle user interface system according to any one of [1] to [4].
[6]
A sub-display unit 2 other than the display unit 1;
The sub display unit 2 displays second information screens (A, C, E, H1 to H5) different from the information screens (B, D, F, G) displayed on the display unit 1. The vehicle user interface system according to any one of [1] to [5].
[7]
The second information screen C displayed on the sub display unit 2 and the information screen D displayed on the display unit 1 are linked,
The moving image 60, which is at least one of the images constituting the information screen D and the second information screen C, does not appear on the second information screen C when it appears on the information screen D, The vehicle user interface system according to [6], wherein the information does not appear on the information screen D when it appears on the second information screen C.
[8]
The display unit 1 provided in the vehicle cabin, driving information images (60, 62 to 65, 73, 75, 76, H1 to H5) and operation images (sw, sw1 to sw3, hb, 60 to 60) of the vehicle equipment 65, 73, and 82), a projection element 3 for projecting an information screen (B, D, F, G) on the display unit 1, and a detection element 4 for detecting the movement of a user's fingertip f on the display unit 1. And a control element 5 for controlling the operation of the vehicle device in accordance with the movement of the user's fingertip f detected by the detection element 4,
The information screen (B, D, F, G) is composed of a plurality of screens displayed in a hierarchy,
A user interface system for a vehicle, wherein at least one of the plurality of screens controls a driving state of the vehicle device by a movement of a fingertip f of the user different from an actual operation of the vehicle device.
It should be noted that any one of the above [2] to [7] may be combined with the vehicle user interface system represented by [8], and it is particularly preferable to combine [6] and [7].

10: Vehicle console device 11: Upper panel 1: Display unit 60, 62 to 66, 73, 75, 76, H1 to H5: Driving information image sw, sw1 to sw3, hb, 60 to 66, 73, 82: Operation Images A to G, H1 to H5: Information screen 3: Projection element f: User's fingertip 4: Detecting element 5: Control element 2: Sub display unit B, D, F, G: First information screen A, C , E, H1 to H5: second information screen 60: moving image

Claims (9)

A display unit provided on a top panel of the vehicle console device, a projection element for projecting an information screen including a driving information image and an operation image of the vehicle device on the display unit, and a user's fingertip on the display unit. A detection element for detecting movement, and a control element for controlling the operation of the vehicle device in accordance with the movement of the fingertip of the user detected by the detection element,
The user interface system for a vehicle, wherein an area of the display unit is one third or more of an area of the upper panel.   The vehicle user interface system according to claim 1, wherein the display unit includes a front portion of the top panel in a vehicle traveling direction. The information screen is composed of a plurality of screens displayed in a hierarchy,
3. The vehicle user according to claim 1, wherein at least one of the plurality of screens controls operation of the vehicle device by a movement of a fingertip of the user different from an actual operation of the vehicle device. 4. Interface system.   The vehicle user interface system according to any one of claims 1 to 3, wherein the information screen includes an animation.   The control element performs a unique control on the vehicle device in accordance with the movement of the user's fingertip detected by the detection element and the number of fingertips indicated by the user. Item 5. A vehicle user interface system according to any one of Items 4. Having a sub-display unit other than the display unit,
The vehicle user interface system according to any one of claims 1 to 5, wherein the sub-display unit displays a second information screen different from the information screen displayed on the display unit. The second information screen displayed on the sub display unit and the information screen displayed on the display unit are interlocked,
The moving image, which is at least one of the images constituting the information screen and the second information screen, does not appear on the second information screen when appearing on the information screen, and the second information 7. The vehicle user interface system according to claim 6, wherein the user interface system does not appear on the information screen when it appears on the screen. A display unit provided in the vehicle interior, a projection element for projecting an information screen including a driving information image and an operation image of the vehicle equipment on the display unit, and a detection for detecting a movement of a fingertip of a user on the display unit Element, and a control element for controlling the operation of the vehicle device according to the movement of the user's fingertip detected by the detection element,
The information screen is composed of a plurality of screens displayed in a hierarchy,
A user interface system for a vehicle, wherein at least one of the plurality of screens controls a driving state of the vehicle device by a movement of a fingertip of the user different from an actual operation of the vehicle device. Having a sub-display unit other than the display unit,
The sub-display unit displays a second information screen different from the information screen displayed on the display unit,
The second information screen displayed on the sub display unit and the information screen displayed on the display unit are interlocked,
The moving image, which is at least one of the images constituting the information screen and the second information screen, does not appear on the second information screen when appearing on the information screen, and the second information 9. The vehicle user interface system according to claim 8, wherein the user interface system does not appear on the information screen when it appears on the screen.