WO2019163390A1

WO2019163390A1 - Menu display control device for vehicles, vehicle-mounted equipment operation system, and gui program

Info

Publication number: WO2019163390A1
Application number: PCT/JP2019/002296
Authority: WO
Inventors: 満清塚
Original assignee: 日本精機株式会社
Priority date: 2018-02-22
Filing date: 2019-01-24
Publication date: 2019-08-29
Also published as: DE112019000938T5; JP7235033B2; JPWO2019163390A1

Abstract

The present invention secures a user's field of view to the front, thereby contributing to safe driving. This menu display control device 300 for vehicles comprises: a display device 10 that projects display light onto a windshield and overlays the display light onto the real view to the front of the vehicle, thereby allowing the user to visually recognize the result; an operation input device 200 that has an annular operation surface; and a control device 20. The display control means (201) included in the control device 20 performs control so as to: change the display position of a pointer that designates, in response to a user operation that is based on the operation position information acquired by a positional information acquisition means (202), one of the menu items displayed on the display device; display, at a first luminance, one or more menu items assigned to a predetermined range of display area including the one menu item designated by the pointer; and display, at a second luminance that is lower than the first luminance, the menu items not assigned to the predetermined range of display area.

Description

VEHICLE MENU DISPLAY CONTROL DEVICE, IN-VEHICLE DEVICE OPERATION SYSTEM, AND GUI PROGRAM

The present invention relates to a vehicle menu display control device mounted on a vehicle such as an automobile, an in-vehicle device operation system, a GUI program, and the like.

GUI (graphical user interface) is a human interface that allows a computer to be operated intuitively using a pointing device such as a mouse. Conventionally, it is known to display a menu on a display device using a GUI so that a desired menu can be selected.

By the way, an in-vehicle device operation system in which an icon indicating a menu item of an in-vehicle device displayed on a display device such as a head-up display (HUD) can be selected with a pointing device by a user (vehicle driver, etc.) through a blind operation. Is described in, for example, Patent Document 1.

JP 2004-345549 A

The head-up display (HUD), for example, generates a display image such as an icon indicating a menu item by a liquid crystal display (LCD) that performs transmissive display using a backlight light source, and irradiates the windshield (front glass) as a virtual image. This is a display device that allows a user (vehicle driver or the like) to visually recognize this virtual image with a real scene in front of the vehicle.

For this reason, if the virtual image is highlighted by coloring or the like so that it can be easily identified by the user, the foreground part overlapping the virtual image becomes invisible, the field of view in front of the user is narrowed, and the visibility of the front real scene may be reduced. is assumed.

The present invention has been made paying attention to the above-described problems, and can ensure a visual field in front of the user and contribute to safe driving, a vehicle menu display control device, an in-vehicle device operation system, And to provide a GUI program.

Other objects of the present invention will become apparent to those skilled in the art by referring to the aspects and best embodiments exemplified below and the accompanying drawings.

Hereinafter, in order to easily understand the outline of the present invention, an embodiment according to the present invention is illustrated.

In the first aspect, the vehicle menu display control device comprises:
A vehicle menu, comprising: a display device that irradiates a windshield with a display light and causes the user to visually recognize the display light over a real scene in front of the vehicle; an operation input device having an annular operation surface; and a control device. A display control device,
The controller is
Menu items are assigned to the display device, each of which is divided into two fan-shaped display areas surrounded by two lines extending radially from the center of the circle and an arc between the two lines. Display control means for displaying a radial operation menu,
Position information acquisition means for acquiring operation position information sequentially generated according to the user's operation of tracing or touching the annular operation surface to designate one menu item included in the radial operation menu; With
The display control means includes
Changing the display position of the pointer that designates one of the menu items displayed on the display device according to the user's operation based on the operation position information acquired by the position information acquisition means;
One or more menu items assigned to a predetermined range of display area including one menu item designated by the pointer are displayed at a first luminance, and menu items not assigned to the predetermined range of display area are displayed. The display is controlled at a second luminance lower than the first luminance.

In the first aspect, the display control means changes the display position of the pointer that designates one of the menu items displayed on the display device in accordance with a user operation based on the operation position information acquired by the position information acquisition means. One or more menu items assigned to a predetermined range of display area including one menu item designated by the pointer is displayed with the first luminance, and menu items not assigned to the predetermined range of display area are displayed. Then, control is performed to display at a second luminance lower than the first luminance.

For this reason, for example, the first brightness is set to the brightness in the normal display state on the display device 10 and the second brightness is displayed with the brightness reduced to be lower than the brightness. The assigned menu item is displayed darker than the menu item assigned to the predetermined range of display area. Therefore, the user (such as a vehicle driver) can visually check the foreground in front of the vehicle in a portion that overlaps the display area outside the predetermined range, and all the display areas of the radial operation menu are displayed with the first luminance. Compared with the case where it is done, a forward visual field can be ensured, and as a result, it can contribute to safe driving. In particular, a display image showing menu items is generated by a liquid crystal display (LCD) or the like that performs transmissive display using a backlight light source, and is irradiated onto a windshield (front glass) as a virtual image. This is effective when a head-up display that is visually recognized by a user (a vehicle driver or the like) superimposed on a real scene is used as a display device.

In a second aspect dependent on the first aspect,
The display control means determines a rotation direction of the pointer based on the operation position information, and a menu assigned to the rotation direction based on the current display position of the pointer in the display area of the predetermined range. Control is performed to display items at the first brightness and to display menu items assigned in the reverse rotation direction at the second brightness.

In the second aspect, the display control means determines the rotation direction of the pointer based on the operation position information and is assigned to the rotation direction based on the current display position of the pointer in the predetermined range of display area. Control is performed to display the menu item with the first luminance and the menu item assigned in the reverse rotation direction with the second luminance. For this reason, for example, even if it is an area of a predetermined range to be displayed with normal luminance, by displaying the menu item assigned in the reverse rotation direction in a darkened manner, the area overlapping the foreground in front of the vehicle is reduced, Therefore, it is possible to secure a forward view and contribute to safe driving. It also has the effect of emphasizing menu items assigned in the rotation direction compared to menu items assigned in the reverse rotation direction, and allows the user to quickly and conspicuously recognize the menu item finally selected. it can.

In a third aspect subordinate to the first aspect,
The display control means includes
Of the radial operation menus displayed on the display device, the menu items assigned to the display area of the same range in the clockwise direction and the counterclockwise direction on the basis of the menu item specified by the stopped pointer are the first items. And control to display the menu items not assigned to the display area at the second brightness.

According to the third aspect, the display control means excludes the menu items assigned to the display area in the same range of clockwise and counterclockwise with reference to the menu item specified by the stopped pointer. For example, the user (driver or the like) can visually check the foreground in front of the portion of the vehicle that overlaps the menu item. Therefore, the front view can be secured as compared with the case where all the display areas of the radial operation menu are displayed with the first luminance, and as a result, the user (driver or the like) can contribute to safe driving.

In a fourth aspect dependent on the first aspect,
The display control means includes
In the radial operation menu displayed on the display device, when the menu item specified by the pointer has a hierarchical structure, a display area to which a menu item related to the specified menu item is assigned is the first area. Control is performed so that menu items not assigned to the display area are displayed at the second brightness.

In the fourth aspect, when the item specified by the pointer has a hierarchical structure in the radial operation menu, the display control unit performs control to display the menu item related to the specified menu item with the same luminance. Since the brightness in the hierarchical group is made uniform and the brightness is distinguished from other menu items, the user (driver or the like) can clearly recognize that they are in the same hierarchical group.

In the fifth aspect, the in-vehicle device operating system includes:
One or more in-vehicle devices,
A display device that irradiates the windshield with display light, and causes the user to visually recognize the display light over a real scene in front of the vehicle;
An operation input device having an annular operation surface;
Menu items are assigned to the display device, each of which is divided into a fan-shaped area divided by a circle, which is surrounded by two lines extending radially from the center of the circle and an arc between the two lines. Display control means for displaying a radial operation menu;
Position information acquisition means for acquiring operation position information sequentially generated according to the user's operation of tracing or touching the annular operation surface to specify one menu item included in the radial operation menu;
And a process execution means for performing an operation process of the in-vehicle device,
The display control means changes a display position of a pointer that designates one of the menu items displayed on the display device in accordance with an operation of the user based on the operation position information acquired by the position information acquisition means. One or more menu items assigned to a predetermined range area including one menu item designated by the pointer is displayed with a first luminance, and menu items not assigned to the predetermined range area are displayed. A control device that performs display control at a second brightness lower than the first brightness, and wherein the process execution means executes an operation process of the in-vehicle device corresponding to the menu item that is finally selected. Have.

According to the fifth aspect, it is possible to realize an in-vehicle device operation system that can secure a visual field in front of the user and contribute to safe driving.

In a sixth aspect, the GUI program is
A vehicle menu, comprising: a display device that irradiates a windshield with a display light and causes the user to visually recognize the display light over a real scene in front of the vehicle; an operation input device having an annular operation surface; and a control device. A GUI program executed by the control device of the display control device,
In the control device,
Menu items are assigned to the display device, each of which is divided into a fan-shaped area divided by a circle, which is surrounded by two lines extending radially from the center of the circle and an arc between the two lines. A first process for displaying a radial operation menu;
A second process of acquiring operation position information sequentially generated according to the user's operation of tracing or touching the annular operation surface to designate one menu item included in the radial operation menu; And execute
The first process includes
A process of changing a display position of a pointer that designates one of the menu items displayed on the display device in accordance with an operation of the user based on the operation position information acquired in the second process;
One or more menu items assigned to a predetermined range area including one menu item designated by the pointer is displayed at a first luminance, and the menu items not assigned to the predetermined range area are And a process for performing control to display at a second luminance lower than the first luminance.

According to the sixth aspect, the control device can sequentially read and execute the GUI program stored in the memory, thereby ensuring a visual field in front of the user (driver or the like) and contributing to safe driving. A vehicle menu display control device can be realized.

According to the present invention, it is possible to provide a vehicle menu display control device, an in-vehicle device operation system, and a GUI program which can secure a visual field in front of the user and contribute to safe driving.

Those skilled in the art will readily understand that the illustrated embodiment according to the present invention can be further modified without departing from the spirit of the present invention.

1 is an overall configuration diagram of an in-vehicle device operation system according to an embodiment of the present invention. It is a block diagram of the display apparatus used in a vehicle equipment operation system. It is a figure which shows the structural example of the radial operation menu in an initial display mode. It is a figure which shows the structural example of the radial operation menu in hierarchy display mode. It is a figure which shows the external appearance of the operation input apparatus used in a vehicle equipment operation system, (a) is a surface figure, (b) is sectional drawing. It is a block diagram of the menu display control apparatus for vehicles of embodiment of this invention. It is a flowchart which shows the procedure of vehicle equipment operation processing. It is a figure which shows the display transition of a menu item and a pointer. It is a flowchart which shows the procedure of the display switching process of a menu item. It is a figure which shows an example of the correspondence of the operation position in an operation input device and a radial operation menu, and the display form of a radial operation menu. It is a figure which shows the other example of the display form of a radial operation menu. It is a figure which shows the further another example of the display form of a radial operation menu.

The best mode described below is used for easy understanding of the present invention. Accordingly, those skilled in the art should note that the present invention is not unduly limited by the embodiments described below.

(Configuration of the embodiment)
Please refer to FIG. FIG. 1 is a diagram showing an overall configuration example of an in-vehicle device operation system 100 according to an embodiment of the present invention (hereinafter simply referred to as “this embodiment”).

As shown in FIG. 1, the in-vehicle device operation system 100 of the present embodiment includes a display device 10, a control device 20, an input / output I / F 30 (input / output interface), a signal I / F 40 (signal interface), For example, an operation input device 200 provided on the steering wheel 3 and operable by a user (here, a driver) with a finger (hand) is provided. In addition, the vehicle has an in-vehicle device 400 including an external communication unit 405 such as a vehicle ECU 401, a navigation (navigation) ECU 402, an audio ECU 403, an air conditioning ECU 404, and a communication device, and these are connected to an input / output I / F 30 via a bus (BUS). It is connected.

The display device 10 can display at least one of a real image and a virtual image. Here, for example, a HUD (head-up display) device that displays a virtual image is mounted, and a windshield (front) is provided by the HUD device. A virtual image is displayed in a virtual image display area 101 (glass) 2 (a virtual image displayable area indicated by a broken-line square in the figure).

In FIG. 1, a radial operation menu 500 (V) is displayed as a virtual image. Note that “(V)” of reference numeral 500 (V) indicates a virtual image. Here, the radial operation menu includes two lines extending radially from the center of the circle, and a fan-shaped area divided by a circle surrounded by an arc between the two lines. This is the menu format to which menu items are assigned.

Reference numeral 502 denotes a pointer 502 (in this case, clockwise or counterclockwise like a clock hand) whose position changes in accordance with the movement of the user's finger (hand) (detected by the operation input device 200). Move). This pointer 502 has a function of designating one of a plurality of menu items included in the radial operation menu 500 (V).

FIG. 2 shows an example of the internal configuration of the HUD device used as the display device 10 in the in-vehicle device operation system 100 of the present embodiment. The HUD device is mounted on a dashboard of a vehicle such as an automobile. The HUD device is a display device that irradiates the windshield with display light and causes the user to visually recognize the display light superimposed on the actual scene in front of the vehicle.

Specifically, as shown in FIG. 2, the HUD device emits display light N1 toward a windshield 310 that is an example of a projection member. A viewer (mainly driver E) receives the display light N1 reflected on the windshield 310, and can visually recognize the radial operation menu V1 displayed as a virtual image.

The HUD device includes a housing 110, a display device 121, an optical system 122, a drive unit 123, and a control unit 124.

The housing 110 is made of, for example, a black resin having a light shielding property, and has a box shape that accommodates each part of the HUD device. An opening is provided in a part of the housing 110, and the opening is covered with a translucent cover 111 through which the display light N1 is transmitted.

The display device 121 includes, for example, a TFT (Thin Film Transistor) liquid crystal panel and a light source (backlight) that illuminates the liquid crystal panel from behind, and a display object (radial operation menu 500 (V)) by light emitted from the light source. Is transparently displayed. The light source is composed of, for example, an LED (Light Emitting Diode), and the liquid crystal panel includes a liquid crystal cell, a polarizing plate, a colored transmission layer, and a diffusion plate. The liquid crystal panel is composed of a pair of polarizing filters or the like sandwiching the liquid crystal panel, and the amount of light is adjusted (dimmed) by changing the transmittance of display light under the control of the control device 20. Shall be able to.

The display device 121 is not limited to a TFT liquid crystal panel as long as it is a transmissive display device that emits display light under the control of the control unit 124, but is not limited to a TFT liquid crystal panel, DMD (Digital Micro Mirror Device) or LCOS (registered trademark: Liquid Crystal On Silicone). Or the like.

The optical system 122 includes, as an example, a screen, a plane mirror, a concave mirror as a reflecting mirror, and the like. The screen is a transmissive screen composed of a holographic diff user, a microlens array, a diffusion plate, and the like, and is installed on the optical path of the display light emitted from the display device 121. The plane mirror includes a flat base material made of synthetic resin or glass and a metal reflection film formed on one surface of the base material, and guides display light to the concave mirror. The concave mirror reflects the incident display light toward the windshield 310 while diffusing. The concave mirror includes a base material made of synthetic resin, glass, or the like, and a metal reflection film formed on one surface of the base material. The windshield 310 reflects the incident display light toward the direction of the driver E (eye box).

The driving unit 123 includes an actuator or a stepping motor, and transmits these driving forces to the optical system 122 (concave mirror) as a rotational force. The concave mirror rotates between the display position and the storage position about the rotation axis extending in the direction perpendicular to the paper surface by the operation of the driving unit 123.

The control unit 124 includes a CPU (Central Processing Unit) such as a microcomputer, and controls the display 121 and the driving unit 123. The control unit 124 displays a radial operation menu on the liquid crystal panel based on a command from the control device 20, and displays the display by controlling the magnitude of the voltage applied to the polarizing filter (PAM: Pulse Amplitude Modulation). The polarization angle of light is arbitrarily controlled in the range of 0 to 90 °, thereby controlling the transmittance (dimming rate) of display light. In addition, control is performed to rotate the concave mirror between the display position and the storage position through the drive unit 123.

Note that the display device 10 may be a display device such as a display panel provided in or on the instrument panel, or a combination of the HUD device and the display device.

Return the explanation to FIG. The in-vehicle device 400 (vehicle ECU 401, navigation ECU 402, audio ECU 403, air conditioning ECU 404, external communication unit (communication device) 405) sends external device information to the input / output I / F 30 via a bus (BUS).

Here, the vehicle ECU 401 can output the travel mode (ECO mode, SPORT mode), average fuel consumption, travelable distance (travelable distance), water temperature, oil temperature, and the like of the vehicle 1. Based on the information described above, the control device 20 indicates the travel mode of the vehicle 1 or displays an image (selection image) that allows the travel mode to be changed by being selected, or average fuel consumption, travelable distance (cruising range) Possible distance), water temperature, oil temperature, etc. When one item is selected, an item regarding detailed information regarding the vehicle 1 may be further displayed in the radial operation menu 500.

The navigation ECU 402 provides information on the direction of the next branch road and the distance to the branch road, facility information on recommended waypoints located near the route of the vehicle 1, and information such as time lost when passing through the information. Output is possible. The display control device (reference numeral 201 in FIG. 6) included in the control device 20 is based on the above information, for example, the direction of the next branch road, the distance to the branch road, the image for switching on / off the route guidance, the recommendation It is possible to display at least one of facility information related to the waypoints and an image for setting the waypoints as a menu.

The audio ECU 403 can output information on recommended music. Based on the information described above, the control device 20 can display recommended music (audio) information and an image for selecting music as a menu.

The air conditioning ECU 404 can output information on the current air conditioning state. Based on the information described above, the control device 20 can display information related to the current air conditioning state and an image that allows the air conditioning state to be changed.

The external communication unit 405 can output information from the outside of the vehicle 1 such as an incoming call state and mail reception information. Based on the information described above, the control device 20 can display, as a menu, information indicating that there is an incoming call, information indicating that a mail has been received, an image that can be used to receive a telephone call or read a voice by voice. .

Details of the radial operation menu 500 (V) displayed on the display device 10 will be described below with reference to FIGS. As described above, the radial operation menu 500 (V) is a fan that divides a circle and is surrounded by two lines extending radially from the center of the circle and an arc between the two lines. This is a menu format in which menu items are assigned to each shape area. In the following description, the control device 20 acquires or searches for information related to the control state of the in-vehicle device 400, and uses the acquired or searched information as an image for each of the fan-shaped components constituting the radial operation menu 500 (V). The icon image assigned in the area will be described as a menu item J, and the designated image K whose position changes according to the movement of the user's finger (hand) (detected by the operation input device 200) will be described as a pointer 502. .

Menu item J is an image having a display area partitioned into fan-shaped areas, and as an initial display mode, for example, as shown in FIG. In the in-vehicle device operation system 100 of the present embodiment, as the menu item J indicating an icon image, a hierarchical menu item J1, a processing menu item J2, and a display menu item J3 are displayed.

The hierarchy menu item J1 is an image displayed in a display area in which the type (for example, “AIR CONTROL”) of the operated in-vehicle device 400 and information indicating the control state (for example, the set temperature “28 ° C.”) are partitioned. By selecting this hierarchical menu item J1 by operating the operation input device 200, it is possible to shift to a hierarchical display mode in which a new menu item J related to the selected hierarchical menu item J1 is displayed. .

The transition to the hierarchical display mode will be specifically described. For example, when the hierarchical menu item J1 related to the air conditioning ECU 404 is selected by operating the operation input device 200, the display of the display device 10 shifts from the initial display mode of FIG. 3 to the hierarchical display mode of FIG.

As the menu item J displayed in the hierarchical display mode, as shown in FIG. 4, the processing menu item J2 related to the air volume and direction of the air conditioner related to the air conditioning ECU 404, the hierarchical menu item J1 related to temperature setting, and the display are restored. A return image J4 or the like is displayed (hierarchical display mode).

By selecting the processing menu item J2 relating to the air volume and the wind direction, the air volume and direction of the air conditioner can be changed, and by selecting the hierarchical menu item J1 relating to the temperature setting, it is possible to shift to the hierarchical display mode relating to the temperature setting. it can. Further, the display can be returned to the original initial display mode (the state shown in FIG. 3) by selecting the return image J4.

Further, an annular decoration image H that is decorated so as to surround the menu item J is displayed around the menu item J. When the display of the menu item J changes, the control device 20 changes the color of the decoration image H. The display mode such as the shape is changed. Specifically, when the display mode shifts (when the initial display mode shifts to the hierarchical display mode), the decoration image H can be changed from the decoration image Ha (FIG. 3) to the decoration image Hb (FIG. 4). it can.

The process menu item J2 is an image displaying items for controlling the in-vehicle device 400 (for example, “ABS” in FIG. 3), setting values (for example, the airflow value “1” controlled by the air conditioning ECU 404 in FIG. 4), and the like. By selecting this processing menu item J2 by operating the operation input device 200, it is possible to cause the in-vehicle device 400 to execute various processes according to the displayed items and setting values. Specifically, for example, by selecting “TCS” or the like with the operation input device 200, the vehicle ECU 401 can be caused to execute an on / off process of the TCS function.

Note that the selected processing menu item J2 is displayed in the display mode J2a in which the color or shape has changed so as to indicate that it has been selected, and allows the user to recognize that it has been selected.

The display menu item J3 is an image in which vehicle information (for example, water temperature, oil temperature) input from the vehicle ECU 401 is displayed in a partitioned display area, and is an image for transmitting information to the user. By selecting the display menu item J3 by operating the operation input device 200, it is possible to display detailed information of the displayed information. Further, the selected display menu item J3 may be hidden by selecting the display menu item J3 by operating the operation input device 200.

Information displayed in the display area partitioned by the display menu item J3 includes information related to various sensor information (for example, water temperature, oil temperature, etc.) output from the vehicle ECU 401, various settings of the vehicle 1 (for example, ABS, Information related to function on / off such as TCS and ECS, travel modes such as ECO mode and SPORT mode), information related to navigation information output from navigation ECU 402 (for example, arrival time, distance to target point, turn-by-turn, etc.) , Information indicating the playback time of the audio ECU 403, the song title, information indicating the settings of the air conditioning ECU 404 (for example, temperature setting, air volume, wind direction, etc.), information indicating the control state of the external device connected to the external communication unit 405 (for example, The information acquired / searched by the control device 20 from the in-vehicle device 400 such as the presence / absence of an incoming call and the content of an email)The display in the menu item J is updated with information acquired / searched by the control device 20 from the in-vehicle device 400 continuously or intermittently.

Further, the menu item J may be an image based on information generated by the control device 20 itself as well as an image related to information acquired / searched by the control device 20 from the in-vehicle device 400. Specifically, for example, when the control device 20 has a timekeeping function, a stopwatch image may be displayed as the menu item J. When the display device 10 has a timekeeping function, the control device 20 may execute the timekeeping function of the display device 10 to display a stopwatch image as the menu item J on the display device 10.

The pointer 502 (K) is an image indicating a pointer that specifies the menu item J by extending toward the menu item J with the center P of the circle as a base point, and corresponds to the movement of the operation position C of the operation input device 200 described later. Thus, the designated position D is smoothly changed and the designated menu item J is switched. A user (driver or the like) can confirm the menu item J designated by the operation of the operation input device 200 by visually recognizing the pointer 502 (K). The pointer 502 (K) indicates the cursor designation image Ka that highlights the outline of the menu item J designated by the operation of the operation input device 200 or the operation position C of the operation input device 200 from the outside of the menu item J. The pointer designation image Kb to be designated may be substituted, or these indication methods may be combined.

Next, the configuration of the operation input device 200 will be described with reference to FIG. FIG. 5A is a diagram showing an external appearance of the operation input device 200, and FIG. 5B is a diagram showing a cross-sectional structure taken along line bb in FIG. 5A. Here, description will be made assuming that the operation input device 200 is used to select a menu item in the radial operation menu 500 (V) shown in FIG.

As shown in FIG. 5A, the operation input device 200 is arranged on the steering wheel 3, and is an annular operation for detecting the position (operation position C) of the user's finger (here, for example, the thumb). A position detection unit 210 and a determination operation detection unit that is provided integrally with the operation position detection unit 210 and detects that a selection (determination) has been made by the user by pressing the operation position detection unit 210 with a thumb. 220 and a return switch 230 used when performing return processing.

The operation position detection unit 210 has a plurality of sensor electrodes (sensor sheets, which will be described later) arranged at equal intervals, for example, in the direction from 0:00 to 23:00 on an annular operation surface. By detecting a change in capacitance for each sensor electrode by touching the user, the user's operation position C (for example, the position of the ring from 0 o'clock to 23 o'clock) can be detected. Further, when the user performs an operation of tracing a predetermined locus clockwise or counterclockwise on the operation surface of the ring, the locus can be detected as operation position information. In the above example, the operation input device 200 is operated with a finger (hand), but other body parts of the user may be used.

Specifically, the operation input device 200 is a touch sensor that detects a position where the user's thumb or the like touches the operation surface (operation position C). For example, as illustrated in FIG. The sensor sheet 212 and the spacer 213 are provided. When the user performs an operation of touching the operation surface with a thumb or the like (hereinafter referred to as a touch operation) or an operation of tracing a predetermined locus (hereinafter referred to as a gesture operation), the operation input device 200 is operated by the user. When the position (operation position C) where the thumb or the like touches the operation surface of the ring is detected and the selection (determination) is made by the user, the selection (determination) is detected. For example, the selection (determination) is performed. A signal (selection signal, in other words, a selection (determination) detection signal) indicating that it has been done is output.

The surface cover 211 in the operation input device 200 is formed in a sheet shape with a light-shielding insulating material such as synthetic resin, and the three-dimensional shape of the convex cross section is continuous along the circumference of a circle centered on the center point Q. Convex part (convex area) 211a (area with a radial pattern in FIG. 5B) and a relatively flat flat part (flat area) connected to the convex part (convex area) 211a 211b. The convex portion (convex region) 211a has a mountain-shaped cross section (convex cross section), and the mountain (convex shape) is long in the direction toward the center point Q (inside) and short in the opposite direction. It has an outline (ridge line). The peaks (convex shape) are continuously provided along the circumference of a circle having the center point Q as the center, thereby forming a convex portion (convex region) 211a.

Further, as shown in FIG. 5B, a sensor sheet 212 is provided under the convex portion (convex region) 211a of the surface cover 211, and the operation position described above is determined by the portion including these. A detection unit 210 is configured. For example, the user recognizes the slope of the convex portion (convex region) 211a in the longitudinal direction (the direction toward the center point Q, in other words, the inner direction) with the tactile sensation of the finger, thereby operating position detection unit 210. The approximate position of the finger on the top can be recognized, and the operation input device 200 can be operated without looking at the operation input device 200.

In other words, blind operation is possible. In addition, although the case where the above-mentioned convex part (convex area) 211a is not provided can be assumed, even in this case, the user places the position of the hand (finger) along the circumference of the circle centered on the center point Q. When moved, the user can perceive the trajectory of the hand (finger) that he / she has moved (the trace of the temporal transition of the position where the finger or the like has touched the operation surface of the touch sensor). You can get an idea of where the position of is located on the circumference of the circle. Therefore, even in this case, a blind operation is possible.

The sensor sheet 212 is disposed along the circumference of a circle centered on the center point Q at least on the back surface side of the front cover 211 corresponding to the convex portion (convex region) 211a, and indicates the operation position C of the user's finger. It detects and outputs information (operation position information or a signal indicating the operation position) related to the operation position C of the user's finger or the like to the control device 20. The sensor sheet 212 is formed into the same shape as the surface cover 211 by being integrally formed with the surface cover 211 by drawing, for example (see FIG. 5B).

By being integrally molded in this way, the surface cover 211 and the sensor sheet 212 become like a single sheet, and the step shape of the convex portion (convex area) 211a is bent by the single sheet. It is composed of parts (raised parts). In addition, the back surface of the front cover 211 and the surface of the sensor sheet 212 come into contact with each other by being integrally molded in this way. Thereby, the detection part of the sensor sheet 212 is arrange | positioned corresponding to the level | step difference shape of the surface cover 211. FIG. Thus, since the detection part of the sensor sheet 212 is arrange | positioned corresponding to the level | step difference shape of the surface cover 211, the movement of a user's finger | toe etc. has a step shape, such as a convex part (convex area | region) 211a. Even if it is performed above, for example, the control device 20 can detect the position of the user's finger.

The spacer 213 is located on the back side of the sensor sheet 212 and is formed in accordance with the shape of the integrally formed front cover 211 and sensor sheet 212. When the front cover 211 is pressed from the front side by a user's finger or the like. It is a member that holds the above shape.

A plurality (three in the example of FIG. 5B) of determination operation detection units 220 are provided on the back side of the operation position detection unit 210. The determination operation detection unit 220 is electrically connected to the control device 20, and the user presses the operation surface of the operation position detection unit 210 (the convex portion (convex region) 211 a of the surface cover 211) (hereinafter, referred to as “operation”). When the pressing operation is performed, the determination operation detection unit 220 is pressed, thereby detecting that selection (determination) has been performed by the user, and a signal (selection signal, in other words, indicating that selection (determination) has been performed) (Selection (determination) detection signal) is output. The output selection (determination) detection signal is sent to the control device 20. Based on the selection (decision) detection signal sent, the control device 20 determines, for example, which menu item of a plurality of menu items J included in the radial operation menu 500 (V) is selected, and An image indicating the menu item J corresponding to the selection is generated and displayed on the display device 10. Thereby, the display of the operation menu is switched according to the content of the selected item.

The return switch 230 is a switch at a position away from the operation position detection unit 210 and the determination operation detection unit 220. When the user depresses the operation surface of the return switch 230 (in other words, a depressing operation is performed), a return signal is transmitted to the control device 20. Based on the return signal from the return switch 230, the control device 20 returns the display of the radial operation menu 500 (V) to an image showing the most recent past menu item J. In other words, switching to the previous display is performed.

Next, a more specific configuration of the vehicle menu display control device 300 (particularly, the control device 20 of FIG. 1) of the present embodiment will be described with reference to FIG. Here, the vehicle menu display control device refers to a configuration including the display device 10 and the operation input device 200 with the control device 20 as a core. In FIG. 6, the same reference numerals are shown for portions common to FIG. 1. The control device 20 is configured by a peripheral LSI (Large Scale Integration) including a CPU such as a microcomputer and a memory in terms of hardware, and functionally, as illustrated in FIG. 6, the display control unit 201 (display A control unit), a position information acquisition unit 202 (position information acquisition unit), and a process execution unit 203 (process execution unit).

The display control unit 201 causes the display device 10 to display the radial operation menu 500 (V). For example, the display control unit 201 reads usable menu items J from a menu file prepared and stored in the storage unit 204 in advance, assigns (combines) the arrangement of a plurality of menu items J, and is necessary. By incorporating such information, a radial operation menu 500 (V) composed of a plurality of menu items is generated, and similarly written in an image RAM area allocated to a partial area of the storage unit 204. The necessary information includes flag information indicating whether or not the arranged menu item has a hierarchical structure. The display control unit 201 reads a radial operation menu (display data) generated from the image RAM area in synchronization with the display timing of the display device 10 (display device 121) and displays it on the display device 10.

In addition to displaying the radial operation menu 500 (V) on the display device 10, the display control unit 201 displays the display device according to the locus of the user's operation (gesture operation) based on the operation position information acquired by the position information acquisition unit 202. It functions as a display control means for changing the display position of the pointer 502 that designates one of the menu items displayed on the screen. In addition, the display control unit 201 displays one or more menu items assigned to a predetermined range display area including one menu item designated by the pointer 502 with a first luminance, and displays the predetermined range display area. It also functions as a display control means for performing control to display the unassigned menu item with the second luminance lower than the first luminance.

The display control unit 201 performs control to change the display position of the pointer 502 that designates one of the menu items displayed on the display device 10 according to the user's operation trajectory (gesture operation). Here, the relative angle of rotation operation by the user (θQ in FIG. 10A) based on the center of the annular operation surface of the operation position detection unit 210 in the operation input device 200 is displayed on the display device 10. The relative angle (θP in FIG. 10B) with the designated position of the pointer 502 with the center of the circle of the radial operation menu 500 as a base point substantially matches.

Note that the menu item assigned to the display area within a predetermined range is, for example, a moving direction (rotation) when the user needs to perform a gesture operation that rotates by 60 degrees in order to switch the menu item J by the pointer 502. Means a menu item assigned to a display area in the range of 60 degrees in the direction). The display control unit 201 uses an angle (center angle) formed by a line segment connecting the center of the circle and the touch position with respect to a reference line segment extending in the radial direction through the center of the circle in the radial operation menu 500 (V). ) Can be calculated to obtain an area within a predetermined range.

Further, the first luminance is, for example, the brightness in the normal display state, and the brightness in the normal display state is changed and set by the brightness setting value of the display device set by default when the vehicle travels or by the user. Brightness value. The second luminance means luminance obtained by dimming control in which light is dimmed at a predetermined dimming rate so as to be darker than the brightness in the normal display state. Here, the predetermined dimming rate is, for example, 20%. Therefore, for example, the display control unit 201 sets the first luminance to the brightness in the normal display state displayed on the display device 10 and sets the second luminance to be lower than the brightness (for example, in the normal display state). By performing dimming control (20% dimming from brightness), the menu item J allocated outside the display area of the predetermined range is dimmed darker than the menu item J allocated to the display area of the predetermined range. To display. For example, the display control unit 201 performs PAM control of the magnitude of the voltage applied to the display device 10 (the display device 121 (liquid crystal panel) of the HUD device in FIG. 2) so that the polarization angle of the display light is 0 to 90 °. The dimming control described above can be performed by controlling the transmittance (the dimming rate) of display light by arbitrarily controlling within the range.

The display control unit 201 determines the rotation direction of the pointer 502 based on the operation position information, and the menu item J assigned to the rotation direction based on the current display position of the pointer 502 in the display area of the predetermined range. May be displayed with the first luminance, and the menu item J assigned in the reverse rotation direction may be displayed with the second luminance. In this case, even if it is an area of a predetermined range to be displayed with normal brightness, the menu item assigned in the reverse rotation direction is displayed with a relatively dark dimming, so that an area overlapping the foreground in front of the vehicle can be obtained. This reduces the amount of forward vision.

In addition, the display control unit 201 uses the same range of clockwise and counterclockwise rotations based on the menu item J specified by the stopped pointer 502 in the radial operation menu 500 (V) displayed on the display device 10. The menu item J assigned to the display area is displayed with the first luminance, and the dimming control is performed to display the menu item J not assigned to the display area with the second luminance. Also good. In this case, menu items other than the menu items assigned to the display area in the same clockwise and counterclockwise range based on the menu item specified by the stopped pointer 502 are, for example, darkly dimmed. By being displayed, a user (a vehicle driver or the like) can visually confirm the foreground in front of the vehicle in a portion overlapping the menu item.

In addition, when the menu item J designated by the pointer 502 has a hierarchical structure in the radial operation menu 500 (V) displayed on the display device 10, the display control unit 201 designates a related menu item as a designated hierarchy. You may control to display with the same brightness | luminance as menu item J1. In this case, since the related menu items are displayed with the same brightness, the brightness within the hierarchy group is made uniform so that the user (driver, etc.) can clearly recognize that it is the same hierarchy group. Can do.

The position information acquisition unit 202 uses the operation input device 200 to select one menu item J included in the radial operation menu 500 (V), and selects an arbitrary point on the ring displayed on the display device 10. It functions as position information acquisition means for acquiring operation position information generated in response to a user's operation of touching or tracing.

The process execution unit 203 functions as a process execution unit that executes an operation process of the in-vehicle device 400 corresponding to the menu item J that is finally selected. For example, when the user selects the menu item J shown in FIG. 3 by operating the operation input device 200, the determination operation detection unit 220 detects that the selection (determination) has been made by the user, and selects By outputting a signal indicating that (determination) has been made, it is possible to cause the in-vehicle device 400 to execute various processes in accordance with the displayed menu item J or setting value. For example, when “TCS” or the like is selected by the operation input device 200, the vehicle ECU 401 can be made to perform an on / off process of the TCS function.

The storage unit 204 is mounted with a semiconductor storage element such as a static RAM, a dynamic RAM, or a flash RAM. The semiconductor storage element is used when generating the GUI program, image data, and radial operation menu of this embodiment. A work area and an image RAM area that is a copy of the virtual image displayable area 101 indicated by a broken-line square in FIG. 1 are allocated and stored.

Note that the display control unit 201, the position information acquisition unit 202, and the processing execution unit 203 described above are all sequentially executed by a CPU such as a microcomputer built in the control device 20 by using a GUI program stored in a partial area of the storage unit 204. It is assumed that each function is realized by executing the reading.

(Operation of the embodiment)
Hereinafter, the in-vehicle device operation processing by the in-vehicle device operation system 100 according to the present embodiment will be described with reference to FIGS. FIG. 7 is a flowchart for explaining the in-vehicle device operation processing of the in-vehicle device operation system 100 according to the present embodiment, and FIG. 8 shows each menu item J in the radial operation menu 500 (V) displayed on the display device 10. It is a figure which shows the display transition of the pointer 502. FIG.

The in-vehicle device operation system 100 of the present embodiment starts operation based on the start of the vehicle 1. As the vehicle 1 is started, the control device 20 reads out the image data from the storage unit 204 and generates a radial operation menu 500 (V) (step S <b> 101), and generates the generated radial operation menu 500 for the display device 10. The image signal (V) is output. Each menu item J of the radial operation menu 500 (V) displayed after the vehicle 1 is started is the same as the menu item J displayed on the display device 10 when the previous vehicle 1 stops.

The information image regarding the control state of the in-vehicle device 400 displayed in the menu item J is displayed based on information acquired / searched from the in-vehicle device 400 by the control device 40 after the vehicle 1 is started. Based on the image signal of the radial operation menu 500 (V) output from the control device 20, the display device 10 forms a fan-shaped region based on the center P of the circle as shown in FIG. Menu item J having a plurality of assigned display areas is displayed as an initial menu (step S102).

Note that the display mode when the vehicle 1 is activated is not the hierarchical display mode of the specific hierarchical menu item J1, but the initial display mode in which the menu item J related to the in-vehicle device 400 is displayed. When the display is started with the start of the vehicle 1, the control device 20 reads the image data from the storage unit 204, first displays the decoration image H and the pointer 502 (K), and then displays the pointer 502 ( K) may be erased, and at the same time, a start-up effect such as displaying menu item J may be performed.

Next, the control device 20 acquires the position signal (operation position C) of the user's finger from the operation input device 200 (step S103), and the pointer 502 (K) designates the menu item J corresponding to the operation position C. In this manner, an image signal of the pointer 502 (K) is generated and output to the display device 10. Based on the image signal of the pointer 502 (K) output from the control device 20, the display device 10 touches the operation position detection unit 210 (annular operation surface) as shown in FIG. The pointer 502 (K) is displayed so as to indicate the indicated position D on the display device 10 corresponding to the selected position (step S104).

Here, when the user performs a gesture operation for moving the operation position C on the annular operation surface of the operation input device 200 (operation position detection unit 210), it corresponds to the movement of the operation position C based on the gesture operation. Then, as shown in FIG. 8C, the indicated position D of the pointer 502 (K) also changes. Here, the fact that the operation position C based on the gesture operation on the operation position detection unit 210 corresponds to the instruction position D of the pointer 502 (K) corresponds to the annular operation surface of the operation position detection unit 210 in the operation input device 200. The relative angle of the rotation operation by the user with the center Q as the base point and the specified position of the pointer 502 (K) with the center P of the circle of the radial operation menu 500 (V) displayed on the display device 10 as the base point Means that they substantially match.

Next, when the control device 20 captures a determination signal from the operation input device 200 (determination operation detection unit 220) (step S105 “YES”), the operation position information is captured via the position information acquisition unit 202 together with the determination signal. Then, the menu item J corresponding to the operation position information is selected. Next, the control device 20 determines whether or not there is a lower hierarchical menu item J1 associated with the selected menu item J (step S105). Here, when it is determined that there is no hierarchical menu item J1 (step S105). S106 "NO"), it is determined that the selection is the final selection, the execution control corresponding to the menu item J is performed, and the display of the initial menu is returned (step S108).

On the other hand, if it is determined that there is a lower-level menu item J1 (step S106 “Y”), the control device 20 causes the display device 10 to display the lower-level menu item J1 ( Next-level menu item) is displayed (step S107). When the menu item J1 in the lower hierarchy is selected (for example, when the menu item J1 related to the air conditioner is selected), the menu items related to the selected hierarchy menu item J1 are displayed as shown in FIG. Switch to the new hierarchical display mode.

In FIG. 8D, which is the hierarchical display mode, as the menu item J of the radial operation menu 500 (V), the processing menu item J2 for determining the air volume, the processing menu item J2 for determining the air direction, and the set temperature are set. And a return menu J4 for returning the display to the previous state. The user can select the menu item J by changing the operation position C of the operation input device 200 and pressing the determination operation detection unit 220 “Push”.

FIG. 8D shows a state where the processing menu item J2 indicating the air volume “3” and a predetermined wind direction is selected by the pressing operation “Push” of the operation input device 200 (decision operation detecting unit 220). Here, when the process menu item J2 is selected, the control device 20 executes the process of the in-vehicle device 400 (air conditioning ECU 404) under the selected condition. Note that the selected processing menu item J2 may be displayed in the display mode J2a in which the color or shape has changed so as to indicate that it has been selected, and the user may be made aware of the selection.

Next, the operation of the vehicle menu display control apparatus 300 according to this embodiment will be described in detail with reference to FIGS. FIG. 9 is a flowchart showing a procedure of menu item display switching processing by the control device 20 (GUI program), and FIG. 10 is an operation position on the operation input device 200, which is meant to supplement the description of the flowchart of FIG. FIG. 11 and FIG. 12 are diagrams showing examples of the relative positional correspondence between the menu and the radial operation menu 500 (V) and an example of the display form thereof. FIGS. 11 and 12 show other display forms of the radial operation menu 500 (V). It is the figure which showed the example of.

In the flowchart of FIG. 9, first, the control device 20 touches an annular operation surface (operation position detection unit 210) or performs a gesture from the operation input device 200 in accordance with a user operation. Position information is acquired (step S201). The operation position information is acquired by the position information acquisition unit 202 in the control device 20, and the position information acquisition unit 202 passes the acquired operation position information to the display control unit 201.

The display control unit 201 determines whether or not the pointer 502 is moving (rotating due to the user's gesture operation) from the operation position information acquired by the position information acquisition unit 202 (step S202). Whether or not the pointer 502 is moving can be determined by comparing the operation position information acquired at the present time with the position information acquired immediately before. If the pointer 502 is moving (“YES” in step S202), the display control unit 201 further moves the direction of the pointer 502 (the user operates the operation ring of the operation input device 200 to select a menu item). In order to perform the operation of tracing the surface, it is determined (synonymous with the rotation direction) (step S203). In the determination of the traveling direction (rotation direction), the display control unit 201 calculates a central angle that is an angle formed by a radial line segment connecting the center of the annular operation surface of the operation position detection unit 210 and the touch position, This is realized by obtaining the locus of the user operation based on the difference from the center angle of the touch position before the movement, and calculating whether the pointer 502 is rotating clockwise or counterclockwise based on the locus.

The display control unit 201 that has determined the advancing direction (rotation direction) of the pointer 502 changes the display position of the pointer 502 according to the locus of the user operation. That is, the display control unit 201 calculates the center angle according to the rotation operation on the annular operation surface of the operation position detection unit 210 in the operation input device 200, and calculates the difference from the center angle of the previous touch position. The locus of the user operation is obtained, and the display position of the pointer corresponding to the center angle is changed. At this time, the relative angle (θQ in FIG. 10 described later) starting from the center Q of the annular operation surface of the operation position detection unit 210 is the circle of the radial operation menu 500 (V) displayed on the display device 10. The relative angle (θP of θP described later) with the designated position of the pointer 502 with the center P as the base point substantially matches.

Subsequently, the display control unit 201 displays, for example, the menu item J assigned to the display area of a predetermined range including one menu item designated by the pointer 502 with the brightness in the normal display state, and the predetermined range. The dimming control is performed to display the menu item J not assigned to the display area at a brightness reduced by 20% from the brightness of the normal display state (step S204). The light attenuation rate is arbitrary. Further, the display area of the predetermined range means, for example, a range of 50 degrees in the rotation direction and 10 degrees in the reverse rotation direction, and the angle of the display area is also arbitrary.

On the other hand, in the pointer moving determination process (step S202), when the pointer 502 is not moving (stopped) (step S202 “NO”), the display control unit 201 displays the menu specified by the stopped pointer 502. Based on the item J, control is performed to display the menu item J assigned to the display area on both sides (the same range in the clockwise and counterclockwise directions) with the brightness of the normal display state, and is included in the display area. The menu item assigned to the non-display area is displayed darker than normal brightness, for example, dimmed to 20% brightness (step S205).

For example, as shown in FIG. 2, the dimming control for dimming the brightness is performed when the display device 10 (HUD) includes the display device 121 on which the liquid crystal panel is mounted. Realized by PAM driving the magnitude of the voltage applied to the filter and arbitrarily controlling the polarization angle of the display light in the range of 0 to 90 ° (controlling the transmittance (dimming rate) of the display light) Can do.

9 will be supplementarily described with reference to FIG. 10 for the processing of steps S201 to S205 in the flowchart of FIG. FIG. 10 shows the correspondence between the operation position on the operation input device 200 (the operation position detection unit 210 having an annular operation surface) and the display position of the pointer 502 displayed on the display device 10. It is the figure which showed an example of the display form of the relationship and the radial operation menu 500 (V) displayed on the display apparatus.

In FIG. 10A, reference numeral 210 denotes an annular convex portion (convex region) corresponding to the annular operation position detection unit 210 in the operation input device 200, as described above with reference to FIG. ing. Reference numeral 220 denotes a position on the annular convex portion (convex region) of the annular determining operation detection unit 220 in the operation input device 200. Here, it corresponds to the menu item A of the radial operation menu.

In FIG. 10B, the radial operation menu 500 (V) is displayed in the area of a circle of 12 sectors having the same shape and size within the circle centered on P, for example, menu item A, menu. Item B, menu item C, menu item D... Are assigned, and each image corresponding to each menu item J is displayed. A pointer 502 (K1, K2, K3) used for designating one menu item included in the radial operation menu 500 (V) is displayed superimposed on the radial operation menu 500 (V). Here, K1 to K3 indicate the movement trajectory of the pointer display during the menu item switching process (K1 → K2 → K3), K1 is before the menu item switching operation, and K2 is in the middle of the menu item switching operation ( K3 indicates the stop position of the pointer 502 after the menu item switching operation.

10B, the pointer 502 (K1) is at the position of the menu item D, and the menu item D indicates, for example, the set temperature. In this state, when the air volume switching is to be set to, for example, “AUTO” indicated by the menu item A, the user sets the specified position of the operation input device 200 as indicated by the symbol C in FIG. An operation of rotating 90 ° counterclockwise from the position of D to the position of menu item A is required.

Therefore, the user performs a counterclockwise rotation operation with the center Q of the annular operation surface of the operation position detection unit 210 in the operation input device 200 as a base point, and the display control unit 201 receives the rotation operation. The display position of the pointer 502 is sequentially updated corresponding to the operation locus (C) (K1 → K2 → K3). This is because the display control unit 201 rewrites the contents of the image RAM allocated to a partial area of the storage unit 204, and the pointer 502 displayed on the radial operation menu 500 (V) of the display device 10 is displayed. This is realized by updating the display. However, when the display control unit 201 updates the display position of the pointer 502, if the position of the moving pointer K2 is used as a reference, the center Q of the annular operation surface in the operation position detection unit 210 of the operation input device 200 is determined. The relative angle θQ as the base point and the relative angle (θP) between the designated position of the pointer K2 with the center P of the circle of the radial operation menu 500 (V) displayed on the display device 10 as a base point substantially coincide. It is necessary.

Here, in the radial operation menu 500 (V) displayed on the display device 10, the range that the user needs to recognize is the range of the display area from the menu item A to the menu item D. Therefore, the display control unit 201 determines the advancing direction (rotation direction) of the pointer 502 (K1), and if the pointer 502 (K1) is moving, the pointer is based on the pointer 502 (K2) being moved. Menu items assigned to a display area range (α11 and α12) of, for example, 50 ° in the rotation direction (counterclockwise) 502 (K2), for example, 50 °, and in the reverse direction (clockwise), for example, are normally displayed. The display is controlled with brightness in the state, and the menu item assigned to the display area (β1) not included in the display area is reduced to 20% of the brightness in the normal display state. And display.

The angles of the display area ranges α11, α12, and β are arbitrary, for example, the sum of α11 and α12 may be 45 °, β may be 15 °, and the like. In this case, the visibility of the foreground in front of the vehicle improves as the angle indicated by β increases.

On the other hand, when the pointer 502 is stopped, the display control unit 201 uses the menu item D specified by the stopped pointer 502 (K1) as a reference on both sides (the same range in the clockwise and counterclockwise directions). The menu item D and the menu item E assigned to the display area (α21 and α22) are controlled to display at the brightness in the normal display state, and assigned to the display area (β2) not included in the display area The displayed menu item is dimmed to a brightness of, for example, 20% of the brightness in the normal display state and displayed.

For this reason, the user (a vehicle driver or the like) overlaps the display region β1 or β2 displayed with the brightness in the dark state (second luminance) at a predetermined dimming rate than the brightness in the normal display state. Compared to the case where the foreground in front of the vehicle is visually confirmed and all the display areas of the radial operation menu 500 (V) are displayed with the brightness (first luminance) in the normal display state, As a result, the user can contribute to safe driving.

In the display form of the radial operation menu 500 (V) shown in FIG. 10B, the first brightness is set to the brightness in the normal display state, and the second brightness is reduced so as to be darker than the brightness. The menu item assigned to the display area (β1 or β2) outside the predetermined range is darker than the menu item assigned to the display area (α11 and α12 or α21 and α22) within the predetermined range. In the above-described example, the display area (α11 and α12 or α21 and α22) displayed at the first luminance is further subdivided to display a further forward visual field. Can be secured. FIG. 11 shows an example of a display form of the radial operation menu 500 (V) for this purpose.

In the display form shown in FIG. 11, when the pointer 502 designates the menu item A, the menu items A, B, and C assigned to the display area α3 in the rotation direction are based on the moving pointer 502 (K2). Is displayed with the brightness in the normal display state, and the menu item D assigned to the display area β3 in the reverse rotation direction is displayed with the brightness reduced by 20% of the brightness in the normal display state. The dimming control for dimming is performed by the display control unit 201 as in the display mode shown in FIG.

Note that, according to the display form of the radial operation menu 500 (V) shown in FIG. 11, the menu item A, menu item B, and menu item C assigned to the display area α3 in the rotation direction of the pointer 502 are in the normal display state. The menu item D assigned to the display area β3 in the reverse rotation direction is displayed with the brightness in the normal display state reduced by 20%, but the display area ranges α3 and β3 are displayed. This angle is arbitrary, and the visibility of the foreground in front of the vehicle improves as the angle indicated by β3 increases.

According to this display form, even in a predetermined range area displayed at normal brightness, the menu item assigned in the reverse rotation direction is displayed in a dimmed state, thereby overlapping the foreground in front of the vehicle. The area is reduced, the front vision can be secured correspondingly, and it can further contribute to safe driving. It also has the effect of emphasizing menu items assigned in the rotation direction compared to menu items assigned in the reverse rotation direction, and allows the user to quickly and conspicuously recognize the menu item finally selected. it can.

Return the explanation to the flowchart of FIG. The radial operation menu 500 (V) displayed on the display device 10 has, for example, a hierarchical structure. If there is a lower-level menu item associated with one selected menu item, the lower-level hierarchy is displayed. The menu items are displayed in sequence. When a menu item having no lower hierarchy is selected, information indicating the content of the finally selected menu item is sent from the display control unit 201 to the process execution unit 203.

For this reason, when the display control unit 201 acquires a determination signal output from the operation input device 200 (determination operation detection unit 220) ("YES" in step S206), the operation position information is acquired via the position information acquisition unit 202. And select a menu item corresponding to the operation position information. Here, it is determined whether or not there is a lower menu item (hierarchical menu item) associated with the selected menu item (step S207). If it is determined that there is no lower-level menu item (“NO” in step S207), it means that the selection is final selection, and the process execution unit 203 performs execution control corresponding to the menu item (step S207). At the same time, the display control unit 201 returns the display device 10 to the initial menu display.

Whether or not the selected menu item has a hierarchical structure is generated for each menu item constituting the radial operation menu 500 (V) included in the information indicating the content of the finally selected menu item. It is determined by referring to the flag information.

On the other hand, if it is determined that “there is a hierarchical menu item” (step S207 “YES”), the display control unit 201 displays the menu item associated with the designated hierarchical menu item on the display device 10, but this At this time, control is performed to display the menu item related to the hierarchical menu item designated by the pointer 502 with the same luminance (step S209). Here, when the menu item specified by the pointer 502 has a hierarchical structure, the display area to which the menu item related to the specified menu item is assigned is displayed with brightness in the normal display state, and the display area is displayed. Menu items not assigned to are dimmed and displayed.

FIG. 12 shows another example of the display form of the radial operation menu 500 (V). Here, a configuration example of the radial operation menu 500 (V) in the hierarchical display mode is shown. Here, if the pointer 501 (K) designates the menu item “3” indicating the air volume, the display control apparatus 201 includes the menu item “3” and includes the menu item “1” indicating the other air volumes. The range (α4) of the display area in which “2” and “AUTO” are displayed is displayed, for example, with the brightness in the normal display state, and the menu area other than the air volume is assigned. (Β4) is reduced by 20% and displayed. When any of the menu items indicating the wind direction is designated by the pointer 501 (K), the range of the display area to which the menu item indicating the wind direction is assigned is displayed with the brightness in the normal state, and other than the wind direction. The range of the display area to which the menu item is assigned is displayed after being reduced by 20%. As a result, the luminance within the hierarchical group is made uniform, and the hierarchical menu items are displayed separately from others, so that the user (driver or the like) can clearly recognize that they are the same hierarchical group. be able to.

In the display mode of the radial operation menu 500 (V) shown in FIGS. 10, 11, and 12, the display area of the menu item assigned in the vicinity of the designated menu item is displayed in the normal display state where light is not dimmed. Only the example in which the brightness and the display area to which other menu items are assigned is displayed after being reduced by 20% has been described. However, the light reduction rate is not limited and is arbitrary.

(Effect of embodiment)
As described above, according to the vehicle menu display control device 300 of the present embodiment, the display control unit 201 displays on the display device 10 in accordance with a user operation based on the operation position information acquired by the position information acquisition unit 202. The display position of the pointer 502 that designates one of the menu items that have been designated is changed, and one or more menu items that are assigned to a display area within a predetermined range including the one menu item designated by the pointer 502 are first Control is performed so that menu items that are not assigned to a predetermined display area are displayed at a second brightness lower than the first brightness.

For this reason, for example, the display control unit 201 sets the first brightness to the brightness in the normal display state and the second brightness to the brightness that is dimmed so as to be darker than the brightness. 10, menu items assigned to areas outside the predetermined range are displayed darker than menu items assigned to the predetermined range. Therefore, the user (vehicle driver or the like) can visually check the foreground in front of the vehicle that overlaps outside the predetermined range, and all the display areas of the radial operation menu 500 (V) are in the normal display state. Compared to the case where the brightness is displayed, the front view can be secured, and as a result, the user can contribute to safe driving. In particular, a display image such as an icon indicating a menu item is generated by a liquid crystal display (LCD) that performs transmissive display using a backlight light source, and the windshield (front glass) is irradiated as a virtual image. When a head-up display that is visually recognized by a user (a vehicle driver or the like) superimposed on a real scene in front of is used as a display device, a particularly suitable effect is obtained.

Further, according to the vehicle menu display control apparatus 300 of the present embodiment, the display control unit 201 determines the rotation direction of the pointer based on the operation position information, and displays the pointer at the present time in a predetermined range of display area. Based on the position, control is performed to display the menu item assigned in the rotation direction with the first luminance and the menu item assigned in the reverse rotation direction with the second luminance. For this reason, for example, even in an area of a predetermined range that is displayed with the brightness in the normal display state, the menu items assigned in the reverse rotation direction are displayed in a relatively dark dimmed state, so that The area overlapping with the foreground is reduced, and the front vision can be secured correspondingly, thereby further contributing to safe driving. It also has the effect of emphasizing menu items assigned in the rotation direction compared to menu items assigned in the reverse rotation direction, and allows the user to quickly and conspicuously recognize the menu item finally selected. it can.

Further, according to the vehicle menu display control apparatus 300 of the present embodiment, the display control unit 201 displays the display area in the same range in the clockwise direction and the counterclockwise direction based on the menu item specified by the stopped pointer 502. For example, by performing control to display other menu items other than the menu item assigned to, for example, in a dimmed display, the user (driver or the like) can move the foreground in front of the vehicle in a portion overlapping the menu item. Can be visually confirmed. Therefore, a front view can be secured as compared with the case where all the display areas of the radial operation menu 500 (V) are displayed with the brightness in the normal display state. As a result, the user (driver or the like) can perform safe driving. Can contribute.

Further, according to the vehicle menu display control apparatus 300 of the present embodiment, the display control unit 201 specifies the specified menu when the item specified by the pointer 501 has a hierarchical structure in the radial operation menu 500 (V). Since the menu item related to the item is displayed with the same brightness, the brightness within the hierarchical group is made uniform and the brightness is displayed separately from other menu items, so that it is displayed to the user (driver, etc.) , It can be clearly recognized that they are the same hierarchical group.

Moreover, according to the in-vehicle device operation system 100 of the present embodiment, it is possible to secure a visual field in front of the user and contribute to safe driving.

Moreover, according to the GUI program of this embodiment, the control apparatus 20 reads the GUI program memorize | stored in the memory | storage part 204 sequentially, and secures the visual field ahead of a user (driver | operator etc.) and is safe. The vehicle menu display control device 300 that can contribute to driving can be realized.

In the present specification, the term “vehicle” is broadly interpreted as a term indicating a “vehicle” such as an automobile, a train, an airplane, a ship, and a fence. Thus, it shall be interpreted in a broad sense.

The present invention is not limited to the above-described exemplary embodiments, and those skilled in the art will be able to easily modify the above-described exemplary embodiments to the extent included in the claims. .

The present invention is applicable to an in-vehicle device operation system 100 operated by a user in order to operate an in-vehicle device mounted on a vehicle.

DESCRIPTION OF SYMBOLS 10 ... Display apparatus, 20 ... Control apparatus, 100 ... In-vehicle apparatus operation system, 201 ... Display control part (display control means), 202 ... Position information acquisition part (position information acquisition means) , 203 ... processing execution unit (processing execution means), 204 ... storage unit, 300 ... vehicle menu display control device, 500 (V) ... radial operation menu, 502 ... pointer

Claims

A vehicle menu, comprising: a display device that irradiates a windshield with a display light and causes the user to visually recognize the display light over a real scene in front of the vehicle; an operation input device having an annular operation surface; and a control device. A display control device,
The controller is
Menu items are assigned to the display device, each of which is divided into two fan-shaped display areas surrounded by two lines extending radially from the center of the circle and an arc between the two lines. Display control means for displaying a radial operation menu,
Position information acquisition means for acquiring operation position information sequentially generated according to the user's operation of tracing or touching the annular operation surface to designate one menu item included in the radial operation menu; With
The display control means includes
Changing the display position of the pointer that designates one of the menu items displayed on the display device according to the user's operation based on the operation position information acquired by the position information acquisition means;
One or more menu items assigned to a predetermined range of display area including one menu item designated by the pointer are displayed at a first luminance, and menu items not assigned to the predetermined range of display area are displayed. A vehicle menu display control device for performing display control at a second luminance lower than the first luminance.
The display control means includes
The direction of rotation of the pointer is determined based on the operation position information, and the menu item assigned to the direction of rotation is selected based on the current display position of the pointer in the display area of the predetermined range. 2. The vehicle menu display control device according to claim 1, wherein a control is performed to display the menu item displayed in the luminance and the menu item assigned in the reverse rotation direction in the second luminance. 3.
The display control means includes
Of the radial operation menus displayed on the display device, the menu items assigned to the display area of the same range in the clockwise direction and the counterclockwise direction on the basis of the menu item specified by the stopped pointer are the first items. 2. The vehicle menu display control device according to claim 1, wherein control is performed to display at a second brightness and menu items not assigned to the display area are displayed at the second brightness. 3.
The display control means includes
In the radial operation menu displayed on the display device, when the menu item specified by the pointer has a hierarchical structure, a display area to which a menu item related to the specified menu item is assigned is the first area. 2. The vehicle menu display control device according to claim 1, wherein control is performed to display menu items not assigned to the display area with the second brightness.
One or more in-vehicle devices,
A display device that irradiates the windshield with display light, and causes the user to visually recognize the display light over a real scene in front of the vehicle;
An operation input device having an annular operation surface;
Menu items are assigned to the display device, each of which is divided into two fan-shaped display areas surrounded by two lines extending radially from the center of the circle and an arc between the two lines. Display control means for displaying a radial operation menu,
Position information acquisition means for acquiring operation position information sequentially generated according to the user's operation of tracing or touching the annular operation surface to specify one menu item included in the radial operation menu;
And a process execution means for performing an operation process of the in-vehicle device,
The display control means changes a display position of a pointer that designates one of the menu items displayed on the display device in accordance with an operation of the user based on the operation position information acquired by the position information acquisition means. One or more menu items assigned to a predetermined range of display area including one menu item designated by the pointer is displayed at a first luminance, and a menu not assigned to the predetermined range of display area is displayed. A control device that performs control to display an item at a second brightness lower than the first brightness, and wherein the process execution means executes an operation process of the in-vehicle device corresponding to the menu item that is finally selected; ,
An in-vehicle device operation system characterized by comprising:
A vehicle menu, comprising: a display device that irradiates a windshield with a display light and causes the user to visually recognize the display light over a real scene in front of the vehicle; an operation input device having an annular operation surface; and a control device. A GUI program executed by the control device of the display control device,
In the display device,
A radial operation menu in which menu items are respectively assigned to a fan-shaped display area divided by two circles surrounded by two lines extending radially from the center of the circle and an arc between the two lines. A first process to be displayed;
A second process of acquiring operation position information sequentially generated according to the user's operation of tracing or touching the annular operation surface to designate one menu item included in the radial operation menu; And execute
The first process includes
A process of changing a display position of a pointer that designates one of the menu items displayed on the display device in accordance with an operation of the user based on the operation position information acquired in the second process;
One or more menu items assigned to a predetermined range of display area including one menu item designated by the pointer are displayed at a first luminance, and menu items not assigned to the predetermined range of display area are displayed. And a process of performing control to display at a second luminance lower than the first luminance.