WO2019146704A1

WO2019146704A1 - Operation menu display control device for vehicle, vehicle-mounted device operation system, and gui program

Info

Publication number: WO2019146704A1
Application number: PCT/JP2019/002292
Authority: WO
Inventors: 貴生人川手
Original assignee: 日本精機株式会社
Priority date: 2018-01-25
Filing date: 2019-01-24
Publication date: 2019-08-01

Abstract

This invention enables efficiently selecting a desired operation item by removing the burdensomeness of when a user makes a final selection of an operation item in a n^thlevel operation menu (n being a natural number greater than or equal to 3) and then returns to the first level and re-selects the same operation items as selected most recently. This operation menu display control device for a vehicle comprises an operation menu image generation unit 22 which generates an image of an operation menu, and a display processing unit 22 which performs display processing of the image. After a final selection in an nth level operation menu has been made, if one operation item contained in a first level operation menu is selected and the selected operation item is the same as the operation item selected in the first level operation menu most recently, then the operation menu image generation unit 22 generates an image of the nth level operation menu, omitting generation of images of the second through (n-1)st level operation menus.

Description

Vehicle operation menu display control device, in-vehicle device operation system, and GUI program

The present invention relates to, for example, a vehicle operation menu display control device mounted on a vehicle such as an automobile, an in-vehicle device operation system, a GUI program, and the like.

A GUI (Graphical User Interface) is a type of human interface technology that makes it possible to intuitively operate a computer using a pointing device such as a mouse, and conventionally displays a menu with a hierarchical structure using a GUI. It is known to be able to efficiently select desired items from among a large number of items.

About the vehicle-mounted apparatus operation system which enabled blind operation using GUI, it describes in patent document 1, for example.

JP 2004-345549 A

A driver driving a vehicle by holding a steering wheel (e.g. a steering wheel) preferably intuitively operates a pointing device (selection device) for the vehicle with a blind touch while gazing forward, and selects a menu image It is necessary to display and select items in a very short time. Therefore, for example, compared with the case of selecting an item using a mouse on a desktop personal computer, it is unavoidable that the accuracy or the operation speed of the pointing device (selection device) is inferior. Therefore, it is desirable to prevent redundant operation as much as possible when operating the in-vehicle device.

Here, the inventor of the present invention has recognized that, for example, redundant operation occurs when the following item selection is performed.

For example, when selecting an operation item included in the operation menu of the in-vehicle device having a hierarchical structure, for example, the item "B" is selected from the large items A, B, C in the operation menu of the first layer, Select the item “α” from the middle items α, β and γ in the operation menu of the second hierarchy, and select the item “λ” from the small items θ, λ and μ in the operation menu of the third hierarchy (First selection) It is assumed that this is the final selection, and the display screen returns to the display screen of the operation menu of the first hierarchy. Here, the user notices that, for example, he should have selected “μ” instead of the small item “λ”, and when trying to make the correct setting, select the large item “B” again, and then select the middle item "Α" is selected, and then the small item "μ" is selected (the second selection is made), and in the second selection, the same hierarchy as in the first selection Have to go through the transition.

As another example, for example, although the items θ, λ, μ, and “NEXT (items for displaying the next item)” exist as small items of the operation menu of the third hierarchy, this item It is possible that the user overlooked "NEXT" and selected "μ" for the time being. Also in this case, in the second selection, the operation menu of the third hierarchy is displayed following the same process as in the first selection, and then the small item “NEXT” is selected, and the fourth hierarchy is selected. The operation menu is displayed to continue the selection.

As still another example, for example, one small item is selected from the operation menu of the third hierarchy by the operation of the pointing device of the blind touch, but at this time, the user (for example, the driver driving the vehicle) ) May be looking forward, and it may not be clear what the selected item is, and it may be possible to re-select from the beginning once more to eliminate anxiety.

In each of the above examples, the final selection is performed with the hierarchy deepened, and the process returns to the first hierarchy, where the user reselects the same item as the item selected in the immediate past. The second selection is common in that it has to go through the same hierarchy transition as in the first selection. In other words, when the user resets the item, the problem arises that the user is forced to sequentially perform the same operation as the previous one (perform redundant operation).

In Patent Document 1 mentioned above, this problem is not mentioned at all, and there is no suggestion on the countermeasure.

In the present invention, after the user has finally determined the operation item of the operation menu of the n-th hierarchy (n is a natural number of 3 or more), the m-th hierarchy (m is a natural number of n-2 or less) is returned to It is an object of the present invention to eliminate redundancy in the case where the same operation item as the operation item selected in the above is re-selected and to enable efficient selection of a desired operation item.

Other objects of the present invention will become apparent to those skilled in the art by referring to the following exemplified aspects and best embodiments, as well as the attached drawings.

In the following, in order to facilitate an understanding of the summary of the invention, an embodiment according to the invention is illustrated.

In the first aspect, the vehicle operation menu display control device includes:
A vehicle operation menu display control device having a hierarchical structure and controlling display of an operation menu including a plurality of operation items in an image of one layer,
An operation menu image generation unit that generates an image of the operation menu;
A display processing unit that performs display processing of the generated image of the operation menu;
Have
The operation menu image generation unit
One operation item included in the operation menu of the n-th hierarchy (n is a natural number of 3 or more) is selected by the selection signal, and the operation menu of the (n + 1) -th hierarchy associated with the operation item does not exist. If the selection is the final selection, an image of the operation menu of the m-th hierarchy (m is a natural number of n-2 or less) is generated,
After the generation, one operation item included in the operation menu of the m-th hierarchy is selected, and the selected operation item is the same as the operation item selected in the operation menu of the m-th hierarchy in the immediate past. In this case, the generation of the image of the operation menu of the (m + 1) th layer to the (n-1) th layer is omitted, and the image of the operation menu of the nth layer is generated.

In the first mode, the last selection is made in the operation menu of the n-th hierarchy, and after the display of the operation menu returns to the operation menu of the m-th hierarchy (for example, the initial menu of the first hierarchy), the last past selection is made When the same item as is selected, image generation (and display thereof) of the (m + 1) th to (n-1) th layer operation menus is omitted, and an image of the nth layer operation menu is generated. Is displayed. In other words, a shortcut from the mth layer to the nth layer is implemented.

Therefore, in the case where the user redisplays the hierarchy menu of the nth hierarchy and tries to select an item different from the item selected in the last past, etc., the user reaches the operation menu of the nth hierarchy. There is no need to perform the conventional redundant operation of displaying and selecting the operation menu of each hierarchy. In other words, since the operation menu image including the target operation item can be displayed directly (and intuitively) and the item can be selected, quick and efficient item selection becomes possible.

In a second aspect dependent on the first aspect,
The operation menu image generation unit
The selection of the operation item which is the same as the operation item selected in the operation menu of the first hierarchy in the immediate past, which is performed after generating the image of the operation menu of the first hierarchy, is in the nth hierarchy The generation of the image of the operation menu of the (m + 1) th layer to the (n-1) th layer is omitted only when it is performed in a predetermined period which is within a predetermined time from the timing of the final selection. The image of the operation menu may be generated.

In the second aspect, selection is performed only within the predetermined period (within a predetermined time from the timing of the last selection) from the most recent past selection (final selection) for the same item as the most recently selected item. , The shortcut from the m-th hierarchy to the n-th hierarchy (transition for shortcut) is performed, and if outside the predetermined period, as usual, the operation menu of the (m + 1) -th to (n-1) -th hierarchy The image generation is performed sequentially.

If the reselection is performed within a predetermined period (predetermined time), the reselection is associated with the previous final selection (for example, for the user to change the result of the previous final selection) It is likely to be a reselection, or, for example, a reselection to dispel concerns about the last choice of memory, and in this case, the item for which the user is aiming is the last choice. There is a high possibility that it is included in the n-th hierarchy which is the hierarchy in which Therefore, the shortcut from the m-th layer to the n-th layer is effective.

However, if reselection is performed after a predetermined time has elapsed from the timing of the previous final selection (it is performed outside the predetermined period), the reselection is independent of the previous final selection, and independent reselection (In other words, it is a choice that can not be inferred based on the content of the previous final choice). Therefore, performing the above-mentioned shortcut in this case is also disadvantageous for the user. In this case, as usual, the image of the operation menu of the (m + 1) -th to (n-1) -th layers. Implement the generation of As a result, the shortcut is performed only when the shortcut from the (m + 1) -th layer to the n-th layer is likely to be effective. In other words, the possibility of inconvenience caused by the shortcut can be reduced.

In a third aspect dependent on the first aspect,
The operation menu image generation unit
Prior to the process of generating the image of the operation menu of the nth layer, omitting the generation of the image of the operation menu of the (m + 1) th layer to the (n-1) th layer,
Do you want to make a first selection to select an operation item of the operation menu of the n-th hierarchy for which the final selection has been made or do you want to make a second selection to select an operation item of an operation menu of a hierarchy other than the n-th hierarchy? Generating a user intention confirmation image including first and second intention confirmation items corresponding to the first and second selections, to make the user select
Only when the user selects the first intention confirmation item, the generation of the image of the operation menu of the (m + 1) -th to (n-1) -th layers is omitted, and the n-th hierarchy is selected. An image of the operation menu may be generated.

In the third aspect, before performing the shortcut from the first hierarchy to the n-th hierarchy, the user generates and displays a user intention confirmation image and selects the operation item of the operation menu of the n-th hierarchy to the user The user's intention can be confirmed by having the user select whether he / she wants to make the first selection or the second selection to select the operation item of the operation menu of the hierarchy other than the n-th hierarchy. Therefore, it is possible to reliably avoid the inconvenience caused by the shortcut (the operation menu of the hierarchy desired by the user is skipped and not displayed).

In a fourth aspect dependent on any one of the first to third aspects,
The operation menu image generation unit
When generating an image of the operation menu of the n-th hierarchy, it is included in the operation menu of at least one of the normal operation menu item and the (m + 1) th to (n-1) -th hierarchies which are upper hierarchies. The image of the operation menu of the n-th hierarchy may be generated including the shortcut item which is the operation item other than the one operation item selected in the last past.

In the fourth aspect, at least one operation item included in the operation menu of the upper hierarchy (for example, the immediately preceding (n-1) hierarchy) is included as an item for shortcut in the operation menu of the nth hierarchy deep. When a shortcut (shortcut from the first hierarchy to the n-th hierarchy) which does not conform to the user's intention is performed, the user selects the item for the shortcut, thereby omitting the operation of returning to the upper hierarchy, There is a possibility that the target item can be selected immediately, which can be one of the measures in the case where the unintended shortcut (shortcut from the first hierarchy to the n-th hierarchy) is performed. .

In a fifth aspect dependent on any one of the first to third aspects,
The operation menu image generation unit
A final selection determining unit that determines whether or not the final selection is performed;
It is determined whether the operation item selected in the operation menu of the m-th hierarchy is the same as the operation item selected in the operation menu of the m-th hierarchy in the most recent past An identity determination unit with selection,
Based on each determination result of the final selection determination unit and the identity determination unit with the latest past selection in the m-th layer, it is determined which operation menu image is to be generated.
Or
It is determined whether or not the intention confirmation image of the user is to be generated based on each determination result of the final selection determination unit and an identity determination unit with the latest selection in the m-th hierarchy, A control processing unit that determines which hierarchical operation menu image is to be generated, based on the user's selection performed after the generation of the intention confirmation image of
An image generation processing unit that generates an operation menu image based on the determination of the control processing unit;
May be included.

In the fifth aspect, an example of the configuration of the operation menu image generation unit is shown. In this aspect, the operation menu image generation unit includes a final selection determination unit, an identity determination unit with the latest selection in the first hierarchy, the final selection determination unit, a control processing unit, and an image generation process. Parts and is comprised. These can be realized, for example, using functional blocks constructed by a computer operating according to a GUI (Graphical User Interface) program.

In a sixth aspect dependent on any one of the first to fifth aspects,
The image of the operation menu generated by the operation menu image generation unit has an origin, and is also an image of a radial menu in which the display area of the operation menu is divided by a plurality of radial straight lines extending outward from the origin. Good.

In the sixth aspect, a radial menu format is adopted as a display format of the operation menu. In the radial menu, a large number of items can be compactly arranged in a well-balanced manner by subdividing the circle (for example, dividing it into a fan-shaped or wedge-shaped area). In recent years, it has become possible, for example, for the driver (user) of a vehicle to control, for example, the operation of an electric appliance or a hot water supply device at home while driving the vehicle by utilizing the IOT (the Internet of Things) In the future, the number of items displayed in the menu is expected to increase more and more. The display format using the radial menu is considered to expand the place of utilization in the future.

In a seventh aspect, the in-vehicle device operating system
The vehicle operation menu display control device according to any one of the first to sixth aspects;
A display device that displays an operation menu based on the generated image of the operation menu;
A selection device that generates a selection signal for selecting one of a plurality of operation items included in the operation menu according to a selection operation of a user of the vehicle;
A process execution device that executes an operation process of an in-vehicle device corresponding to the operation item finally selected by the user;
Have.

According to the seventh aspect, it is possible to realize, for example, an on-vehicle apparatus operation system in which a driver or the like who is driving a vehicle can comfortably operate the on-vehicle apparatus by the blind operation.

In an eighth aspect, a GUI (Graphical User Interface) program includes a computer, an operation menu image generation unit according to any one of claims 1 to 6, and display processing of an image of the generated operation menu. And a display processing unit for operating the vehicle.

According to the eighth aspect, display control of the operation menu suitable for display for a vehicle can be realized with a simple configuration using a software program.

Those skilled in the art will readily understand that the illustrated embodiments of the present invention can be further modified without departing from the spirit of the present invention.

FIG. 1 is a diagram showing an example of the configuration of an in-vehicle device operation system. FIG. 2A is a view showing the appearance of a selection device (a pointing device used in a vehicle-mounted device operation system), and FIG. 2B is a view showing a cross-sectional structure along line AA in FIG. It is. FIG. 3A is a view showing a more specific configuration example of the control device and the operation menu display control device for a vehicle (display control device) in the in-vehicle device operation system of FIG. 1 and FIG. FIG. 3C is a view showing an example of the configuration of an operation menu image generation unit, and FIG. 3C is a view showing an example of the configuration of a display device. FIGS. 4A to 4F are diagrams showing an example of display transition in an operation item menu having a hierarchical structure of n layers (here, n = 3), and FIGS. 4G to 4G. 4 (J) is a figure which shows the other example of the transition of a display. FIGS. 5A to 5J are diagrams showing yet another example of display transition in an operation item menu having a hierarchical structure of n layers (here, n = 3). FIG. 6 is a flowchart showing an example of the main procedure of the display control process (vehicle operation menu display control process). FIG. 7A is a diagram showing an example of an operation menu of the first hierarchy (upper hierarchy) in the radial operation menu, and FIG. 7B is a diagram showing an example of an operation menu of the second hierarchy. FIG. 8A shows an example of the operation menu of the third layer in the radial operation menu, and FIG. 8B shows another example of the operation menu of the third layer. FIG. 9 is a diagram showing an example (radial menu format) of the user intention confirmation image.

The preferred embodiments described below are used to easily understand the present invention. Accordingly, one of ordinary skill in the art should note that the present invention is not unduly limited by the embodiments described below.

Please refer to FIG. FIG. 1 is a diagram showing an example of the overall configuration of the in-vehicle device operation system.

The in-vehicle device operation system includes a display device 10, an input / output interface (input / output I / F) 20, a control device 20 (described later, but a display control device (symbol 21 in FIG. 5), and a process execution device (FIG. 5). 26), the signal interface (signal I / F) 40, 50, and the steering wheel (steering wheel) 3, and the user (here, the driver) has a finger (hand) Selection device (input device) 200 that can be operated by the user, the gaze detection unit 301 that detects the gaze of the user, and the voice detection unit 302 (these are examples of selecting menu items without using the selection device 200, for example). Used as the external device (in-vehicle device) 400 of the control device 20, various ECUs (in-vehicle ECU 401, navigation (navigation) ECU 402, audio ECU 4 3, the air conditioning ECU404, wherein the external communication unit (communication devices) 405, which have a and that) is connected to the input-output I / F30 through the bus BUS.

The display device 10 can display at least one of a real image and a virtual image. Here, for example, it is assumed that a HUD (head-up display) device for displaying a virtual image is mounted. A virtual image is displayed in a virtual image displayable area 101 (shown by a dashed square in the figure) 2 of the glass etc.).

In FIG. 1, a radial menu (radial operation menu) 500 (V) as a virtual image is displayed. In addition, "(V)" of code | symbol 500 (V) has shown that it is a virtual image.

Reference numeral 502 denotes a pointer whose position changes according to the movement of the user's finger (hand) (in this case, it moves clockwise or counterclockwise like a clock hand). ). The pointer has a function of pointing (specifying) one of a plurality of items (operation items) included in the radial menu (radial operation menu) 500 (V).

The display device 10 may be configured to include a display such as a display panel provided in or on the instrument panel.

In the display processing of the radial menu 500 (V), various types of information input from the external device (in-vehicle device) 400 can be used as needed.

The external device (in-vehicle device) 400 (in-vehicle ECU 401, navigation ECU 402, audio ECU 403, air conditioner ECU 404, external communication unit (communication device) 405) sends external device information to the input / output I / F 30 via the bus BUS. .

Here, the on-vehicle (vehicle) ECU 401 can output the traveling mode (ECO mode, SPORT mode) of the vehicle 1, the average fuel consumption, the travelable distance (travelable distance), the water temperature, the oil temperature and the like. The display control device (symbol 21 in FIG. 2) included in the control device 20 indicates the traveling mode of the vehicle 1 based on the above information, or an image (selectable image) that enables the traveling mode to be changed by being selected. To display the average fuel consumption, the travelable distance (travelable distance), the water temperature, the oil temperature, etc. When one item is selected, an item regarding detailed information on the vehicle 1 may be further displayed in the radial menu 500.

The navigation ECU 402 information on the direction of the next branch and the distance to the branch, facility information on a recommended passing site located in the vicinity of the route of the vehicle 1, and information such as time lost when passing through this. It is possible to output. The display control device (symbol 21 in FIG. 2) included in the control device 10 is, for example, an image that switches the direction of the next branch path and the distance to the branch path, and turns on / off the route guidance, At least one of facility information related to the via point of the image, an image for setting the via point, and the like can be displayed as a menu.

The audio ECU 403 can output information about recommended music and the like. The display control device (symbol 21 in FIG. 2) included in the control device 10 can display information related to recommended music (audio) and an image for selecting music as a menu based on the above information.

The air conditioning ECU 404 can output information and the like regarding the current air conditioning state. The display control device (symbol 21 in FIG. 2) included in the control device 10 can display information related to the current air conditioning state or an image that enables the air conditioning state to be changed, based on the above information.

The external communication unit 405 can output information from the outside of the vehicle 1 such as an incoming state and mail reception information. Based on the above information, the display control device (symbol 21 in FIG. 2) included in the control device 10 is information indicating that there is an incoming call and that there is an e-mail reception, receiving a call or reading e-mail by voice. Can be displayed as a menu.

Next, FIG. 2 will be referred to. FIG. 2A is a view showing the appearance of a selection device (a pointing device used in a vehicle-mounted device operation system), and FIG. 2B is a view showing a cross-sectional structure along line AA in FIG. It is.

Here, it is assumed that the selection device (sometimes referred to as an input device or an operation device) 200 is used to select an item in the radial menu 500 shown in FIG.

As shown in FIG. 2A, the selection device (pointing device) 200 is disposed on the steering wheel 3, and the position of the user's finger (here, for example, a thumb) (in other words, the operation position C) Operation position detection unit 210 for detecting the movement position detection unit 210 and the operation position detection unit 210, and the operation position detection unit 210 is pressed by the thumb to detect that the user has made a selection (decision). It has a determination operation detection unit 220 and a return switch 230 used when performing return processing.

In the above example, the operation of the selection device 200 is performed with a finger (hand), but another body part of the user may be used.

The selection device 200 is a touch sensor that detects a position (operation position C) at which the user's thumb or the like touches the operation surface, and as illustrated in FIG. 2B, the surface cover 211, the sensor sheet 212, and the spacer And 213. When the user performs an operation (hereinafter referred to as a touch operation) touching the operation surface with a thumb or the like (hereinafter referred to as a touch operation) or a tracing operation (hereinafter referred to as a gesture operation), the selection device 200 The position (operation position C) at which the thumb or the like touches the operation surface is detected, and when a selection (decision) is made by the user, the selection (decision) is detected, for example, the selection (decision) is made Is output (in other words, a selection (decision) detection signal).

The surface cover 211 in the selection device 200 is formed in a sheet shape by a light shielding insulating material such as a synthetic resin, and the three-dimensional shape of the convex cross section is continuously along the circumference of a circle centered on the central point Q. A relatively flat part (flat area) 211b connected to the formed convex part (convex area) 211a (an area having a radial pattern in FIG. 5A) and the convex part (convex area) 211a And. The convex portion (convex area) 211a has a mountain-shaped cross section (convex cross section), and the mountain (convex shape) is long in the direction (inward) toward the central point Q and short in the opposite direction, which is the outer side. It has an outline (edge line). The peaks (convex shape) are continuously provided along the circumference of a circle centered on the central point Q, whereby a convex portion (convex area) 211 a is configured. Further, as described in FIG. 5B, the sensor sheet 212 is provided under the convex portion (convex area) 211a in the surface cover 211, and the above-described operation position detection is performed by a portion including these. The unit 210 is configured. The user, for example, operates the operation position detection unit 210 by recognizing the slope in the longitudinal direction (the direction toward the center point Q, in other words, the inward direction) of the convex portion (convex area) 211a described above by the tactile sensation of a finger. The approximate position of the finger at the top can be recognized and the selection device 200 can be operated without looking at the selection device 200. In other words, blind operation is possible. In addition, although the case where the above-mentioned convex part (convex area) 211a is not provided may be assumed, also in this case, the user places the position of the hand (finger) along the circumference of a circle centered on the central point Q. When moved, the user can perceive the locus of the hand (finger) he / she moved (a trace of the temporal change of the position at which the finger or the like touches the operation surface of the touch sensor). You can get an idea of where you are on the circle's circumference. Therefore, even in this case, blind operation is possible.

The sensor sheet 212 is disposed along the circumference of a circle centered on the central point Q at least on the back surface side of the surface cover 211 corresponding to the convex portion (convex area) 211a, and the operation position C of the user's finger is It detects and outputs information (information on the operation position or a signal indicating the operation position) regarding the operation position C of the user's finger or the like to the control device 20 (display control device 21). The sensor sheet 212 is processed into the same shape as the surface cover 211, for example, by being integrally formed with the surface cover 211 by drawing (see FIG. 5B). By integrally molding in this manner, the surface cover 211 and the sensor sheet 212 become like a sheet, and the step shape of the above-mentioned convex part (convex area) 211 a is the bending of the sheet. It will be composed of parts (the raised parts). Further, by integrally molding in this manner, the back surface of the surface cover 211 abuts on the surface of the sensor sheet 212. Thus, the detection portion of the sensor sheet 212 is disposed corresponding to the step shape of the front cover 211. As described above, since the detection portion of the sensor sheet 212 is arranged corresponding to the step shape of the surface cover 211, the operation surface of the user's finger or the like has a step shape such as a convex portion (convex area) 211a. Even if performed above, for example, the display control device 21 can detect the position of the user's finger.

The spacer 213 is located on the back surface side of the sensor sheet 212 and is formed in accordance with the shape of the integrally formed surface cover 211 and the sensor sheet 212, and when the surface cover 211 is pressed from the front side by the user's finger or the like. , It is a member holding the above-mentioned shape.

A plurality (five in the example of FIG. 2B) of the determination operation detection units 220 are provided on the back surface side of the operation position detection unit 210. The determination operation detection unit 220 is electrically connected to the control device 20 (including the display control device 21), and the user operates the operation surface of the operation position detection unit 210 (convex portion (convex area) of the surface cover 211) When an operation to press 211 a (hereinafter referred to as a press operation) is performed, the decision operation detection unit 220 is pressed, whereby it is detected that the user has made a selection (decision) and the selection (decision) has been made. A signal (a selection (decision) detection signal) indicating. The output selection (decision) detection signal is sent to the control device 20 (including the display control device 21). The display control device 21 determines which of a plurality of items included in the radial menu 500 has been selected, for example, based on the selection (decision) detection signal sent, and an operation menu corresponding to the selection. An image is generated and displayed on the display device 10. Thus, the display of the operation menu is switched according to the content of the selected item.

The return switch 230 is a switch located at a distance from the operation position detection unit 210 and the determination operation detection unit 220. When the user presses the operation surface of the return switch 230 (in other words, the pressing operation is performed), a return signal is transmitted to the display control device 21 in the control device 20. The display control device 21 returns the display of the radial menu 500 to the latest past operation menu image based on the return signal from the return switch 230. In other words, switching to the immediately preceding display is performed.

Next, FIG. 3 will be referred to. FIG. 3A is a view showing a more specific configuration example of the control device and the operation menu display control device for a vehicle (display control device) in the in-vehicle device operation system of FIG. 1 and FIG. FIG. 3C is a view showing an example of the configuration of an operation menu image generation unit, and FIG. 3C is a view showing an example of the configuration of a display device.

In FIG. 3A, the control device 20 has a display control device (vehicle operation menu display control device) 21 and a process execution device 26, and, if necessary, a storage device (not shown), The operation routine file 27 is stored.

The display control device (vehicle operation menu display control device) 21 has an operation menu image generation unit 22 and an operation menu display processing unit 24 and, if necessary, in a storage device (not shown). A menu file 25 is stored.

Each configuration of the control device 20 described above is, for example, a CPU or MPU (computer: not shown) according to a GUI (Graphical User Interface) program installed in an OS (Operating System) etc. stored in a storage device (not shown) Can be realized by operating.

The operation menu image generation unit 22 in the display control device (vehicle operation menu display control device) 21 generates an operation menu image. For example, by taking out (read out) usable ones from a plurality of menu files 25 prepared in advance and incorporating necessary information in image synthesis, an image of a menu (operation menu) including a plurality of operation items is obtained. Generate However, the present invention is not limited to this, and a plurality of items are arranged according to an array stored in advance in a storage unit (not shown) or an array defined by a program stored in a storage unit (not shown) An image of a menu (operation menu) may be generated by image combining of items, or an image may be generated by rendering. The generated image is temporarily stored in an image RAM (not shown) or the like.

The display control device (vehicle operation menu display control device) 21 is an image using information from the external device 400 (in-vehicle ECU 401, navigation ECU 402, audio ECU 403, air conditioning ECU 404, external communication unit (communication device) 405). Alternatively, without using the information, an image may be generated based only on image data stored in advance in a storage unit (not shown). Thereby, for example, an image (original image) which is the source of the radial menu 500 (V) shown in FIG. 1 can be generated.

Specifically, the display control device (vehicle operation menu display control device) 21 has a hierarchical structure and controls the display of an operation menu in which a plurality of operation items are included in an image of one layer, As described above, the operation menu image generation unit 22 generates an image of the operation menu, and the operation menu display processing unit 24 performs display processing of the generated image of the operation menu.

Operation menu image generation unit 22 is finally selected in the operation menu of the n-th hierarchy (n is a natural number of 3 or more), and the display of the operation menu is the operation menu of the m-th (m is a natural number of n-2) hierarchy In the example of m = 1, after returning to the initial menu of the first hierarchy, if the same item as the most recent past selection is selected, the (m + 1) (in the example of m = 1, the second) to The image generation (and its display) of the operation menu of the (n−1) -th layer is omitted, and the image of the operation menu of the n-th layer is generated. In addition, the operation menu image generation unit 22 can also include at least one item included in the menu of the upper hierarchy in the operation menu of the n-th hierarchy as an item for shortcut. These points will be described later.

The operation menu display processing unit 24 in FIG. 3A reads out the generated image (image data) from an image RAM (not shown) or the like, adjusts the data format, and adds information necessary for display. The image data obtained as a result is sent to the display device 10.

The displayed vehicle operation menu has a hierarchical structure, and when there is a lower hierarchy menu associated with one selected item, the lower hierarchy menus are sequentially displayed. When an item having no lower hierarchy is selected, for example, information indicating the content of the finally selected item is sent from the operation menu image generation unit 22 to the processing execution device 26. The process execution unit 26 refers to the operation routine file 27, for example, to acquire data indicating the specific content of the process to be executed (however, this operation may not be necessary), and the acquired data is , To the external device (in-vehicle device) 400 via the input / output I / F 30 and the bus BUS. This causes the process associated with the item selected by the user to be performed.

Next, FIG. 3B will be referred to. As shown in FIG. 3B, the operation menu image generation unit 22 includes a final selection determination unit 600, a control processing unit 610, a timer 620, a selection history storage unit 630, and an image generation processing unit 640. Have. Here, the selection history storage unit 630 includes an identity determination unit (hereinafter, may be simply referred to as an identity determination unit) 632 with the latest selection in the m-th hierarchy.

The final selection determination unit 600 determines whether the selection of the item made by the user is the final selection.

In addition, the sameness judging unit 632 included in the selection history storage unit 630 with the latest past selection in the m-th hierarchy determines that the operation item selected in the operation menu in the m-th hierarchy is the most recent in the past. It is determined whether it is the same as the operation item selected in the operation menu of the m hierarchy.

The control processing unit 610 generates an operation menu image of which layer based on each determination result of the final selection determination unit 600 and the identity determination unit 632 with the latest selection in the first hierarchy, for example For example, based on the determination results of the final selection determination unit 600 and the identity determination unit 632 with the most recent past selection in the first layer, the user's intention confirmation image (described later) If the user's intention confirmation image is generated, it is determined which hierarchical operation menu image is to be generated based on the user's selection made after the generation. It is also good.

As a specific example, the control processing unit 610 included in the operation menu image generation unit 22 selects (current selection) an operation item that is the same as the operation item selected in the operation menu of the m-th hierarchy in the most recent past. Is omitted from the generation of the image of the operation menu of the (m + 1) th layer to the (n-1) th layer only when the) is performed in a predetermined period which is within a predetermined time from the timing of final selection in the nth layer It can be decided (in other words, by shortcut) to generate an image of the operation menu of the nth hierarchy.

The image generation processing unit 640 generates an operation menu image based on the determination of the control processing unit 610.

Next, FIG. 2C will be referred to. As shown in FIG. 2C, the display device 10 can include at least one of a HUD device 500 that displays an image of a virtual image and a display 600 that displays an image of a real image. The HUD device 500 includes a light source 502. For example, the light intensity of the light source 502 is modulated in pixel units based on image data to display an image on a screen (not shown). The display light of the image is projected onto the windshield (a member having the property of transmitting a part of light and reflecting a part) 1 via a projection optical system (not shown), For example, the radial menu 500 (V) shown in FIG. 1 is displayed.

Next, FIG. 4 will be referred to. FIGS. 4A to 4F are diagrams showing an example of display transition in an operation item menu having a hierarchical structure of n layers (here, n = 3), and FIGS. 4G to 4G. 4 (J) is a figure which shows the other example of the transition of a display.

First, examples of FIGS. 4A to 4C will be described. As shown in FIG. 4A, in the image of the operation menu of the first hierarchy which is the highest hierarchy, the display area of the entire menu has a predetermined outer shape (here, a vertically-long rectangle) This outline is maintained even in the hierarchy of (1), and two operation items "A" and "B" are displayed in the display area of the entire menu. In FIG. 4A, it is assumed that the operation item "B" is selected.

As a result, the operation menu changes to the second hierarchy, and three operation items of “C”, “D”, and “E” are displayed as shown in FIG. 4 (B). Here, it is assumed that the operation item "C" is selected.

As a result, the operation menu changes to the third hierarchy, and four operation items of “F”, “G”, “H”, and “I” are displayed as shown in FIG. 4C. Here, the operation item "G" is selected, and this is the final selection, and the processing associated with the operation item "G" is executed, and the display of the operation menu returns to the display of the first hierarchy ((1) Fig. 4 (E)).

In FIG. 4E, for example, the user selects the last past selection again in a predetermined period that is within a predetermined time from when the operation item “G” in FIG. 4C is selected (final selection). In this case, it is assumed that the same item (here, item “B”) as the selection in FIG. 4 (A) is selected.

In this case, the second selection is the selection associated with the previous last selection (e.g., one to be re-operated to correct the content of the last selection, or it is unclear what the content of the last selection was And the (m + 1) -th layer (here, so that the user does not have to perform redundant operations). Then, the operation menu of the n-th hierarchy (here, the third hierarchy), which is the hierarchy for which the last selection is made, is displayed with the second hierarchy) omitted (see FIG. 4F). In other words, a shortcut from the m-th hierarchy (here m = 1) to the n-th hierarchy (here n = 3) is implemented.

Next, examples of FIG. 4 (G) to FIG. 4 (J) will be described. In this example, before performing the shortcut from the mth layer to the nth layer, the user generates and displays a user intention confirmation image and selects the operation item of the operation menu of the nth layer to the user. The user's intention can be confirmed by having the user select whether he / she wants to select 1 or select the second selection to select the operation item of the operation menu of the hierarchy other than the n-th hierarchy. Therefore, it is possible to reliably avoid the inconvenience caused by the shortcut (the operation menu of the hierarchy desired by the user is skipped and not displayed).

FIG. 4 (G) is the same as FIG. 4 (E). FIG. 4H shows an example of the user intention confirmation image. In the example of FIG. 4 (H), the item "final selection item G" (first selection item: this is an item for confirming whether or not to make a selection related to the final selection item G)) And the item "other" (second selection item: this is an item for confirming whether or not to make a selection unrelated to the final selection) are displayed at the same time. By having the user select one, it is possible to prevent an unintended shortcut from being performed.

In FIG. 4 (H), when the user selects the item (first selection item) “final selection item G”, the operation menu to be displayed is the n-th one as shown in FIG. 4 (I). It changes to the display of a hierarchy (here, n = 3). In addition, when the user selects the item “other” (second selection item), the operation menu displayed is the (m + 1) -th hierarchy (here, m as shown in FIG. 4J). It changes to the display of = 1).

Next, FIG. 5 will be referred to. FIGS. 5A to 5J are diagrams showing yet another example of display transition in an operation item menu having a hierarchical structure of n layers (here, n = 3).

In FIG. 5A, the operation item B is selected. In addition, the code | symbol ZN1 in FIG. 5 (A) is a display area (it has the outline of a circle | round | yen) of the selected operation item B. FIG. In FIG. 5B, a display area ZN2 (having the same shape, the same size, and the same position) corresponding to the display area ZN1 of FIG. 5A is divided into three, upper side, lower left side, lower right side Three fan-shaped areas on the side are formed. In the upper area, an item B which is a “selection history item” indicating that the currently selected item is the operation item B is arranged, and in each of the lower left and lower right areas, the second hierarchy of Items “α” and “β” which are operation items of (intrinsic) are arranged. Further, adjacent to the area ZN2, the letter A is enclosed by a broken line circle in the item A (FIG. 5B) which is the first shortcut item (described as the item 1 for SC). The same applies in the following. In FIG. 5B, the operation item "β" is selected.

Similarly, even in FIG. 5C, the area ZN3 corresponding to the area ZN2 is divided into three, the item β indicating the selection history is arranged in the upper fan-shaped area, and the fan-shaped area in the lower left side is An item α, which is a second shortcut item (item 2 for SC), is arranged, and an item θ, which is a normal (intrinsic) item of the third hierarchy, is arranged in a sector on the lower right side. Further, a normal (intrinsic) item μ is disposed adjacent to the lower side of the area ZN3. In FIG. 5C, it is assumed that the operation item “θ” is selected, which is the final selection, and the display of the operation menu automatically returns to the display of the first hierarchy (FIG. 5E).

In FIG. 5E, for example, when the operation item "B" is selected as in FIG. 5A within a predetermined time from the final selection, the display of the operation menu of the second hierarchy is omitted, The operation menu of the third hierarchy is displayed (FIG. 5 (F): first shortcut SC1).

Here, if the previous final selection (selection of the item “θ”) is an error and the user selects the item “μ”, the first shortcut SC1 will be successful, for example, If the user wants to select the item “α” in the second hierarchy (FIG. 5 (B)), it means that the first shortcut SC1 has failed.

In the case of failure, normally, the user needs to press the return button (reference numeral 230 in FIG. 2) to return to the second hierarchy to select the target item “α”.

However, the second shortcut item (item 2 for SC) is included in the operation menu of the third hierarchy in FIG. 5 (F). Therefore, by selecting the second shortcut item (item 2 for SC) in FIG. 5G, the operation is omitted using the return button, and the display of the operation menu in FIG. It is possible to transit to the display of the third hierarchy when the item α is selected in the second hierarchy) (second shortcut SC2).

In other words, after the transition (first shortcut SC1) from FIG. 5 (E) to FIG. 5 (F), the transition from FIG. 5 (G) to FIG. 5 (H) (second time) By performing the shortcut SC2), an unprecedented dynamic and speedy selection is realized.

Thus, in the example of FIG. 5, at least the operation menu included in the upper hierarchy (for example, the (n-1) th hierarchy immediately before) is included in the operation menu of the nth hierarchy (here, n = 3). One operation item is included as a shortcut item. If a shortcut (m-th hierarchy (m = 1 here) to n-th hierarchy shortcut) that does not conform to the user's intention has been performed, the user selects an item for the shortcut to go to the upper hierarchy. There is a possibility that it is possible to immediately select the target item by omitting the return operation, which is a countermeasure against the case where a shortcut (shortcut from the m-th layer to the n-th layer) is not performed. It can be one.

Next, FIG. 6 will be referred to. FIG. 6 is a flowchart showing an example of the main procedure of the display control process (vehicle operation menu display control process). Here, it is assumed that display control of the type shown in FIG. 4 is performed.

First, the operation menu of the m-th hierarchy is displayed (step S1), and when an item is selected (step S2), the menu of the next lower hierarchy corresponding to the selected item (operation item) is generated and displayed (Step S3).

Subsequently, when an item is selected (step S4), it is determined whether or not the selection is the final selection (in other words, the presence or absence of the lower hierarchy associated with the item). In the case of N), the process returns to step S3, and in the case of final selection (in the case of Y in step S5), the process returns to the display of the operation menu of the m-th hierarchy (step S6).

Note that the display of the operation menu of the m-th hierarchy may be started immediately after the end of the final selection, may be started after a predetermined time has elapsed after the end, or the operation of the selection device by the user is detected It may be started by

After that, when the item is selected (step S7), it is then determined whether or not the selection is the same as the latest selection in the m-th hierarchy (and the selection in a predetermined period). (Step S8). If N in step S8, the process returns to step S3. If Y, the process proceeds to step S9.

In step S9, display the menu of the n-th hierarchy in which the last selection is made last (do not display the middle hierarchy), or do you want to select an item different from the item in the n-th hierarchy in which the last selection was made last, Display an image (user's confirmation image) to make the user select whether to select an item in the same hierarchy.

Next, FIG. 7 and FIG. 8 will be referred to. FIG. 7A is a diagram showing an example of an operation menu of the first hierarchy (upper hierarchy) in the radial operation menu, and FIG. 7B is a diagram showing an example of an operation menu of the second hierarchy. FIG. 8A shows an example of the operation menu of the third layer in the radial operation menu, and FIG. 8B shows another example of the operation menu of the third layer.

FIGS. 7A, 7B, and 8A show the hierarchical display format described above with reference to FIGS. 4A to 4F in the radial menu (radial operation menu). The example of the case of applying is shown. Further, FIG. 8B shows the hierarchical display format described earlier with reference to FIGS. 5A to 5H (in the menu of the lower hierarchy, the item displayed in the upper hierarchy is included as a shortcut item). 7 shows a specific example in which the display format is applied to a radial menu (radial operation menu).

The radial menu is a menu having an origin and a display area of the menu divided by a plurality of radial straight lines extending outward from the origin, and generally has a circular (or elliptical) outer shape.

In the radial menu, a large number of items can be arranged in a compact and balanced manner, for example, by dividing a circle (for example, dividing it into a sector or wedge-shaped area). In recent years, it has become possible for the driver (user) of the vehicle 1 to control the operation of, for example, home electric appliances and water heaters while driving the vehicle 1 by utilizing the IOT (the Internet of Things) In the future, the number of items displayed in the menu is expected to increase more and more. The display format using the radial menu is considered to expand the place of utilization in the future.

Also, as the number of items increases, the hierarchy of the display menu also deepens along with this, and there is a tendency for redundant operations to increase accordingly. According to the present embodiment, dynamic and speed not found in the prior art by the shortcut (in other words, the jump process omitting the intermediate hierarchy, and the jump process omitting the return by the item for shortcut adopted as necessary) It is possible to select items with a sense. Since the redundant operation is reduced, the user's psychological burden does not increase. Thus, a comfortable and practical radial operation menu for a vehicle is realized.

FIG. 7A is a display example of the top hierarchy (first hierarchy). One or a plurality of items (operation items) are allocated and arranged in each of four sector-shaped areas (central angle 90 °) obtained by dividing the circle of the outer shape into four. In the fan-shaped area (display area) ZN1 at the lower right, an item AIR CONTROL (air conditioning) (provided with information that the current inside temperature is 26 degrees is also added) 1 is disposed.

Adjacent to the item 1 "AIR CONTROL" (more precisely, adjacent in the clockwise direction), item 2 "SmartPhone", item 2-1 "TEL" , Item 2 "MAIL (mail)" is arranged.

Adjacent to these items (more precisely, in the clockwise direction), an item 3 "FUEL METER (fuel meter)" is arranged.

Also, adjacent to the item 3 (more precisely, in the clockwise direction), an item 4 "AUDIO" is arranged. This item 4 can also be viewed as being disposed adjacent to the item 1 “AIR CONTROL” (more precisely, adjacent in the counterclockwise direction).

Here, it is assumed that the item 1 "AIR CONTROL (air conditioning)" is selected. In FIG. 7A, the needle pointer 502 of the clock points to this item 1.

The menu image is switched as shown in FIG. 7 (B). The outer shape of the menu in FIG. 7B is a circle, the size is also the same, and since the display follows FIG. 7A, the user does not feel uncomfortable.

In FIG. 7 (B), normal (essentially) lower items (lower operation items) 1-1, 1-2, 1-3, 1-4, 1-5 related to “AIR CONTROL (air conditioning)” 1-6 and 1-7 are displayed.

In addition, the item 1 “AIR CONTROL (air conditioning)”, which is the item selected in FIG. 7A, has the same shape as the area ZN1 of the lower right sector (center angle 90 °) in FIG. 7A. In the area ZN2 of the same size (here, this area is divided into three and divided into upper, middle, and lower areas), specifically, it is arranged again in the upper area ( This corresponds to the selection history item indicating the selection history described above with reference to FIG. This item 1 has a function of clarifying that the item currently selected is "AIR CONTROL (air conditioning)" (in other words, showing a selection history).

Further, the area ZN2 in the lower right sector (center angle 90 °) in FIG. 7B (the same shape as the display area ZN1 of the item 1 in FIG. 6A with the same size (divided into three, In the middle and lower areas), in the middle and lower areas, the regular item 1-1 "REAR (air conditioning of the rear seat)", "FRONT (air conditioning of the front seat)" These regular items 1-1 and 1-2 are assumed to be frequently used, and these are the lower right in FIG. 7 (B). Since it is arranged in the fan-shaped (center angle 90 °) area, it is possible to select by moving the pointer 502 a little. In other words, if the selection in FIG. , The possibility of quickly selecting the next sub-item has been increased .

Further, in FIG. 7B, an item 2 “SmartPhone (smartphone)” and an item 4 “AUDIO (audio)” are arranged as the shortcut items described above.

As for "relative positional relationship in the arrangement direction", in FIG. 7B, item 4 (shortcut item) is on the upper side in the counterclockwise direction with respect to item 1 (selection history item), and item 2 ( The item for shortcut) is below the item 1 (selection history item) in the clockwise direction. This is the same as the relative positional relationship in the arrangement direction with respect to item 1 in item 4 in item (A) in FIG. Thus, the user does not feel uncomfortable.

As for the relative positional relationship of “adjacent”, the arrangement of the shortcut items may be adjacent to the selection history item (rule 1), and the display area of the item selected in the upper hierarchy (FIG. 7 (A It is sufficient if at least one of (Rule 2) which may be adjacent to a region (ZN2 in FIG. 7B) having the same shape and the same size as ZN1) in (a) is satisfied. In the example of FIG. 7B, both the

rules

1 and 2 are satisfied for the item 4 (AUDIO) which is the shortcut item, and the rule 2 is satisfied for the item 2 (SmartPhone) which is the shortcut item ( This rule is generally followed in the example of FIG. 8 (B)).

When comparing FIG. 7A and FIG. 7B, the relative positional relationship is substantially the same, and therefore the user does not feel uncomfortable.

In FIG. 7B, it is assumed that the normal item 1-1 "REAR (air conditioning of rear seat)" is selected. The menu image is switched as shown in FIG.

In FIG. 8A, items (icons) 1-1-1 to 1-1-7 for specifically setting the air conditioning temperature of the rear seat are provided, and an item (icon) 1-1-8 called NEXT is provided. , Item of return symbol (return icon) 1-1-9 is displayed.

Next, FIG. 8B will be referred to. In FIG. 8B, in correspondence with FIG. 7B, the items included in the menu of each of the first and second layers are arranged as shortcut items also in the third layer. Item 1-2 (FRONT) is an item for shortcut in the second hierarchy, and

items

2 and 4 are items for shortcut in the first hierarchy. Further, in the menu of the third hierarchy shown in FIG. 8B,

items

2, 3 and 5 in items 1-1-1 to 1-1-9 previously shown in FIG. 8A. Items except for are included. However, the arrangement of those items is different from that of FIG.

In FIG. 8B, in the area ZN3 corresponding to the area ZN1 in FIG. 7A, an item 1-1 “AIR CONTROL REAR (air conditioning of the rear seat)” as a selection history item is disposed. A shortcut item for the second hierarchy (shortcut icon) 1-2 is arranged adjacent in the clockwise direction, and next thereto, a shortcut item for the first hierarchy (shortcut icon) 2 is arranged, An item 1 for shortcut to the first hierarchy (shortcut icon) 4 is provided at a position adjacent in the counterclockwise direction with respect to the item 1-1 “AIR CONTROL REAR (air conditioning of the rear seat)” as a selection history item. It is done.

In general, the arrangement according to rule 1 and rule 2 described above is adopted. When FIG. 7 (A), FIG. 7 (B), and FIG. 8 (B) are compared, the arrangement of the upper hierarchy is followed about the arrangement of the shortcut icon, and the menu of FIG. 8 (B) is constructed. Users are less likely to feel uncomfortable.

As described above, the operation menu of the n-th hierarchy (here, n = 3 and the operation menu of FIG. 8 (B) corresponds), the operation of the upper hierarchy (for example, the immediately preceding (n-1) hierarchy) By including at least one operation item included in the menu (here, the item 1-2 “FRONT”) as a shortcut item, a shortcut (from the first hierarchy to the first hierarchy) that does not conform to the user's will If a shortcut to n layers has been performed, the user may select an item for the shortcut to omit an operation to return to the upper layer and may be able to immediately select the desired item ( For example, the transition from FIG. 5 (G) to FIG. 5 (H) described above is possible, and this is a shortcut (shortcut from the first layer to the n-th layer) which does not conform to the intention It is those that can become one of the measures of the case that had been done. In addition, the selection method of the item which uses a shortcut continuously is an example in the past, and a dynamic and speedy new selection mode will be realized.

Next, FIG. 9 is referred to. FIG. 9 is a diagram showing an example (radial menu format) of the user intention confirmation image. Item 1-8 is the first selection item described above (an item for confirming whether you want to make a selection related to the final selection item), and item 1-9 is the second item described above Items for selection (items for confirming whether or not to make a selection unrelated to the final selection). Each of the items 1-8 and 1-9 is disposed in each of semicircular areas (display areas) obtained by vertically dividing a circle into two equal parts. By having the user select one, it is possible to prevent an unintended shortcut from being performed.

Thus, according to the present invention, after the user (driver of vehicle 1 etc.) finalizes the operation items of the operation menu of the n-th hierarchy (n is a natural number of 3 or more), the user returns to the first hierarchy. The redundancy in the case where the same operation item as the most recently selected operation item is reselected is eliminated, and the desired operation item can be efficiently selected. Therefore, the convenience of menu selection is significantly improved.

The present invention is not limited to the above examples, and various modifications and applications are possible. For example, when the shortcut from the first hierarchy to the n-th hierarchy (jumping of the display screen) is performed, an icon for notifying the fact or the like may be included in the menu of the n-th hierarchy. Also, the fact may be notified by changing the display mode.

In the present specification, a vehicle is broadly interpreted as a term indicating "vehicle" such as a car, a train, an airplane, a ship or the like, and the term "menu" is also referred to as "a display including a plurality of options". As such, it shall be interpreted in a broad sense.

The invention is not limited to the above-described exemplary embodiments, and one of ordinary skill in the art could easily modify the above-described exemplary embodiments to the extent that they are included in the claims. .

10: display device 20: control device 21: display control device (operation menu display control device for vehicle) 22: operation menu image generation unit 24: operation menu display processing 26: processing execution device 30: input / output interface (input / output I / F) 40, 50: signal interface (signal I / F) 200: selection device (input device , Pointing device for vehicle), 500: radial menu, 502: pointer, 600: final selection determination unit, 610: control processing unit, 620: timer, 630: selection history storage Part 632: Identity determination part with the latest selection (final selection) in the first hierarchy, 640: Image generation processing part.

Claims

A vehicle operation menu display control device having a hierarchical structure and controlling display of an operation menu including a plurality of operation items in an image of one layer,
An operation menu image generation unit that generates an image of the operation menu;
A display processing unit that performs display processing of the generated image of the operation menu;
Have
The operation menu image generation unit
One operation item included in the operation menu of the n-th hierarchy (n is a natural number of 3 or more) is selected by the selection signal, and the operation menu of the (n + 1) -th hierarchy associated with the operation item does not exist. If the selection is the final selection, an image of the operation menu of the m-th hierarchy (m is a natural number of n-2 or less) is generated,
After the generation, one operation item included in the operation menu of the m-th hierarchy is selected, and the selected operation item is the same as the operation item selected in the operation menu of the m-th hierarchy in the immediate past. In the case where the operation menu of the (m + 1) th to (n-1) -th layers is omitted, the image of the operation menu of the n-th layer is generated.
A vehicle operation menu display control device characterized in that.
The operation menu image generation unit
The selection of the operation item which is the same as the operation item selected in the operation menu of the first hierarchy in the immediate past, which is performed after generating the image of the operation menu of the first hierarchy, is in the nth hierarchy The generation of the image of the operation menu of the (m + 1) th layer to the (n-1) th layer is omitted only when it is performed in a predetermined period which is within a predetermined time from the timing of the final selection. Generate an image of the operation menu of
The vehicle operation menu display control device according to claim 1, characterized in that:
The operation menu image generation unit
Prior to the process of generating the image of the operation menu of the nth layer, omitting the generation of the image of the operation menu of the (m + 1) th layer to the (n-1) th layer,
Do you want to make a first selection to select an operation item of the operation menu of the n-th hierarchy for which the final selection has been made or do you want to make a second selection to select an operation item of an operation menu of a hierarchy other than the n-th hierarchy? Generating a user intention confirmation image including first and second intention confirmation items corresponding to the first and second selections, to make the user select
Only when the user selects the first intention confirmation item, the generation of the image of the operation menu of the (m + 1) th to (n-1) th layers is omitted, and the nth hierarchy is selected. Generate an image of the operation menu,
The vehicle operation menu display control device according to claim 1, characterized in that:
The operation menu image generation unit
When generating an image of the operation menu of the n-th hierarchy, it is included in the operation menu of at least one of the normal operation menu item and the (m + 1) th to (n-1) -th hierarchies which are upper hierarchies. Generating an image of the operation menu of the n-th layer including an item for shortcut which is an operation item other than the one operation item selected in the last past,
The vehicle operation menu display control device according to any one of claims 1 to 3, characterized in that:
The operation menu image generation unit
A final selection determining unit that determines whether or not the final selection is performed;
It is determined whether the operation item selected in the operation menu of the m-th hierarchy is the same as the operation item selected in the operation menu of the m-th hierarchy in the most recent past An identity determination unit with selection,
Based on each determination result of the final selection determination unit and the identity determination unit with the latest past selection in the m-th layer, it is determined which operation menu image is to be generated.
Or
It is determined whether or not the intention confirmation image of the user is to be generated based on each determination result of the final selection determination unit and an identity determination unit with the latest selection in the m-th hierarchy, A control processing unit that determines which hierarchical operation menu image is to be generated, based on the user's selection performed after the generation of the intention confirmation image of
An image generation processing unit that generates an operation menu image based on the determination of the control processing unit;
The vehicle operation menu display control device according to any one of claims 1 to 3, further comprising:
The image of the operation menu generated by the operation menu image generation unit is an image of a radial menu in which the display area of the operation menu is divided by a plurality of radial straight lines having an origin and extending outward from the origin. The vehicle operation menu display control device according to any one of claims 1 to 5, characterized in that:
A vehicle operation menu display control device according to any one of claims 1 to 6.
A display device that displays an operation menu based on the generated image of the operation menu;
A selection device that generates a selection signal for selecting one of a plurality of operation items included in the operation menu according to a selection operation of a user of the vehicle;
A process execution device that executes an operation process of an in-vehicle device corresponding to the operation item finally selected by the user;
In-vehicle device operation system having.
An operation menu display control apparatus for a vehicle, comprising: an operation menu image generation unit according to any one of claims 1 to 6; and a display processing unit that performs display processing of an image of the generated operation menu. A GUI (Graphical User Interface) program to operate as.