WO2019146704A1 - Operation menu display control device for vehicle, vehicle-mounted device operation system, and gui program - Google Patents
Operation menu display control device for vehicle, vehicle-mounted device operation system, and gui program Download PDFInfo
- Publication number
- WO2019146704A1 WO2019146704A1 PCT/JP2019/002292 JP2019002292W WO2019146704A1 WO 2019146704 A1 WO2019146704 A1 WO 2019146704A1 JP 2019002292 W JP2019002292 W JP 2019002292W WO 2019146704 A1 WO2019146704 A1 WO 2019146704A1
- Authority
- WO
- WIPO (PCT)
- Prior art keywords
- operation menu
- item
- image
- hierarchy
- menu
- Prior art date
Links
Images
Classifications
-
- B—PERFORMING OPERATIONS; TRANSPORTING
- B60—VEHICLES IN GENERAL
- B60R—VEHICLES, VEHICLE FITTINGS, OR VEHICLE PARTS, NOT OTHERWISE PROVIDED FOR
- B60R11/00—Arrangements for holding or mounting articles, not otherwise provided for
- B60R11/02—Arrangements for holding or mounting articles, not otherwise provided for for radio sets, television sets, telephones, or the like; Arrangement of controls thereof
-
- B—PERFORMING OPERATIONS; TRANSPORTING
- B60—VEHICLES IN GENERAL
- B60R—VEHICLES, VEHICLE FITTINGS, OR VEHICLE PARTS, NOT OTHERWISE PROVIDED FOR
- B60R16/00—Electric or fluid circuits specially adapted for vehicles and not otherwise provided for; Arrangement of elements of electric or fluid circuits specially adapted for vehicles and not otherwise provided for
- B60R16/02—Electric or fluid circuits specially adapted for vehicles and not otherwise provided for; Arrangement of elements of electric or fluid circuits specially adapted for vehicles and not otherwise provided for electric constitutive elements
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/048—Interaction techniques based on graphical user interfaces [GUI]
- G06F3/0481—Interaction techniques based on graphical user interfaces [GUI] based on specific properties of the displayed interaction object or a metaphor-based environment, e.g. interaction with desktop elements like windows or icons, or assisted by a cursor's changing behaviour or appearance
- G06F3/0482—Interaction with lists of selectable items, e.g. menus
Definitions
- the present invention relates to, for example, a vehicle operation menu display control device mounted on a vehicle such as an automobile, an in-vehicle device operation system, a GUI program, and the like.
- a GUI Graphic User Interface
- a pointing device such as a mouse
- GUI Graphic User Interface
- a driver driving a vehicle by holding a steering wheel preferably intuitively operates a pointing device (selection device) for the vehicle with a blind touch while gazing forward, and selects a menu image
- a pointing device selection device
- the item “B” is selected from the large items A, B, C in the operation menu of the first layer, Select the item “ ⁇ ” from the middle items ⁇ , ⁇ and ⁇ in the operation menu of the second hierarchy, and select the item “ ⁇ ” from the small items ⁇ , ⁇ and ⁇ in the operation menu of the third hierarchy (First selection) It is assumed that this is the final selection, and the display screen returns to the display screen of the operation menu of the first hierarchy.
- the user notices that, for example, he should have selected “ ⁇ ” instead of the small item “ ⁇ ”, and when trying to make the correct setting, select the large item “B” again, and then select the middle item “ ⁇ ” is selected, and then the small item " ⁇ ” is selected (the second selection is made), and in the second selection, the same hierarchy as in the first selection Have to go through the transition.
- the items ⁇ , ⁇ , ⁇ , and “NEXT (items for displaying the next item)” exist as small items of the operation menu of the third hierarchy, this item It is possible that the user overlooked "NEXT” and selected " ⁇ " for the time being. Also in this case, in the second selection, the operation menu of the third hierarchy is displayed following the same process as in the first selection, and then the small item “NEXT” is selected, and the fourth hierarchy is selected. The operation menu is displayed to continue the selection.
- one small item is selected from the operation menu of the third hierarchy by the operation of the pointing device of the blind touch, but at this time, the user (for example, the driver driving the vehicle) ) May be looking forward, and it may not be clear what the selected item is, and it may be possible to re-select from the beginning once more to eliminate anxiety.
- the final selection is performed with the hierarchy deepened, and the process returns to the first hierarchy, where the user reselects the same item as the item selected in the immediate past.
- the second selection is common in that it has to go through the same hierarchy transition as in the first selection. In other words, when the user resets the item, the problem arises that the user is forced to sequentially perform the same operation as the previous one (perform redundant operation).
- Patent Document 1 mentioned above, this problem is not mentioned at all, and there is no suggestion on the countermeasure.
- the m-th hierarchy (m is a natural number of n-2 or less) is returned to It is an object of the present invention to eliminate redundancy in the case where the same operation item as the operation item selected in the above is re-selected and to enable efficient selection of a desired operation item.
- the vehicle operation menu display control device includes: A vehicle operation menu display control device having a hierarchical structure and controlling display of an operation menu including a plurality of operation items in an image of one layer, An operation menu image generation unit that generates an image of the operation menu; A display processing unit that performs display processing of the generated image of the operation menu; Have The operation menu image generation unit One operation item included in the operation menu of the n-th hierarchy (n is a natural number of 3 or more) is selected by the selection signal, and the operation menu of the (n + 1) -th hierarchy associated with the operation item does not exist.
- an image of the operation menu of the m-th hierarchy (m is a natural number of n-2 or less) is generated. After the generation, one operation item included in the operation menu of the m-th hierarchy is selected, and the selected operation item is the same as the operation item selected in the operation menu of the m-th hierarchy in the immediate past. In this case, the generation of the image of the operation menu of the (m + 1) th layer to the (n-1) th layer is omitted, and the image of the operation menu of the nth layer is generated.
- the last selection is made in the operation menu of the n-th hierarchy, and after the display of the operation menu returns to the operation menu of the m-th hierarchy (for example, the initial menu of the first hierarchy), the last past selection is made
- image generation (and display thereof) of the (m + 1) th to (n-1) th layer operation menus is omitted, and an image of the nth layer operation menu is generated. Is displayed. In other words, a shortcut from the mth layer to the nth layer is implemented.
- the user redisplays the hierarchy menu of the nth hierarchy and tries to select an item different from the item selected in the last past, etc., the user reaches the operation menu of the nth hierarchy.
- the operation menu image including the target operation item can be displayed directly (and intuitively) and the item can be selected, quick and efficient item selection becomes possible.
- the operation menu image generation unit The selection of the operation item which is the same as the operation item selected in the operation menu of the first hierarchy in the immediate past, which is performed after generating the image of the operation menu of the first hierarchy, is in the nth hierarchy.
- the generation of the image of the operation menu of the (m + 1) th layer to the (n-1) th layer is omitted only when it is performed in a predetermined period which is within a predetermined time from the timing of the final selection.
- the image of the operation menu may be generated.
- selection is performed only within the predetermined period (within a predetermined time from the timing of the last selection) from the most recent past selection (final selection) for the same item as the most recently selected item.
- the shortcut from the m-th hierarchy to the n-th hierarchy (transition for shortcut) is performed, and if outside the predetermined period, as usual, the operation menu of the (m + 1) -th to (n-1) -th hierarchy
- the image generation is performed sequentially.
- the reselection is associated with the previous final selection (for example, for the user to change the result of the previous final selection) It is likely to be a reselection, or, for example, a reselection to dispel concerns about the last choice of memory, and in this case, the item for which the user is aiming is the last choice.
- the shortcut from the m-th layer to the n-th layer is effective.
- the operation menu image generation unit Prior to the process of generating the image of the operation menu of the nth layer, omitting the generation of the image of the operation menu of the (m + 1) th layer to the (n-1) th layer, Do you want to make a first selection to select an operation item of the operation menu of the n-th hierarchy for which the final selection has been made or do you want to make a second selection to select an operation item of an operation menu of a hierarchy other than the n-th hierarchy?
- the user before performing the shortcut from the first hierarchy to the n-th hierarchy, the user generates and displays a user intention confirmation image and selects the operation item of the operation menu of the n-th hierarchy to the user
- the user's intention can be confirmed by having the user select whether he / she wants to make the first selection or the second selection to select the operation item of the operation menu of the hierarchy other than the n-th hierarchy. Therefore, it is possible to reliably avoid the inconvenience caused by the shortcut (the operation menu of the hierarchy desired by the user is skipped and not displayed).
- the operation menu image generation unit When generating an image of the operation menu of the n-th hierarchy, it is included in the operation menu of at least one of the normal operation menu item and the (m + 1) th to (n-1) -th hierarchies which are upper hierarchies.
- the image of the operation menu of the n-th hierarchy may be generated including the shortcut item which is the operation item other than the one operation item selected in the last past.
- At least one operation item included in the operation menu of the upper hierarchy (for example, the immediately preceding (n-1) hierarchy) is included as an item for shortcut in the operation menu of the nth hierarchy deep.
- a shortcut shortcut from the first hierarchy to the n-th hierarchy
- the user selects the item for the shortcut, thereby omitting the operation of returning to the upper hierarchy
- the target item can be selected immediately, which can be one of the measures in the case where the unintended shortcut (shortcut from the first hierarchy to the n-th hierarchy) is performed. .
- the operation menu image generation unit A final selection determining unit that determines whether or not the final selection is performed; It is determined whether the operation item selected in the operation menu of the m-th hierarchy is the same as the operation item selected in the operation menu of the m-th hierarchy in the most recent past An identity determination unit with selection, Based on each determination result of the final selection determination unit and the identity determination unit with the latest past selection in the m-th layer, it is determined which operation menu image is to be generated.
- a control processing unit that determines which hierarchical operation menu image is to be generated, based on the user's selection performed after the generation of the intention confirmation image of An image generation processing unit that generates an operation menu image based on the determination of the control processing unit; May be included.
- the operation menu image generation unit includes a final selection determination unit, an identity determination unit with the latest selection in the first hierarchy, the final selection determination unit, a control processing unit, and an image generation process. Parts and is comprised. These can be realized, for example, using functional blocks constructed by a computer operating according to a GUI (Graphical User Interface) program.
- GUI Graphic User Interface
- the image of the operation menu generated by the operation menu image generation unit has an origin, and is also an image of a radial menu in which the display area of the operation menu is divided by a plurality of radial straight lines extending outward from the origin. Good.
- a radial menu format is adopted as a display format of the operation menu.
- a large number of items can be compactly arranged in a well-balanced manner by subdividing the circle (for example, dividing it into a fan-shaped or wedge-shaped area).
- the driver (user) of a vehicle it has become possible, for example, for the driver (user) of a vehicle to control, for example, the operation of an electric appliance or a hot water supply device at home while driving the vehicle by utilizing the IOT (the Internet of Things)
- IOT the Internet of Things
- the display format using the radial menu is considered to expand the place of utilization in the future.
- the in-vehicle device operating system The vehicle operation menu display control device according to any one of the first to sixth aspects; A display device that displays an operation menu based on the generated image of the operation menu; A selection device that generates a selection signal for selecting one of a plurality of operation items included in the operation menu according to a selection operation of a user of the vehicle; A process execution device that executes an operation process of an in-vehicle device corresponding to the operation item finally selected by the user; Have.
- the seventh aspect it is possible to realize, for example, an on-vehicle apparatus operation system in which a driver or the like who is driving a vehicle can comfortably operate the on-vehicle apparatus by the blind operation.
- a GUI (Graphical User Interface) program includes a computer, an operation menu image generation unit according to any one of claims 1 to 6, and display processing of an image of the generated operation menu. And a display processing unit for operating the vehicle.
- display control of the operation menu suitable for display for a vehicle can be realized with a simple configuration using a software program.
- FIG. 1 is a diagram showing an example of the configuration of an in-vehicle device operation system.
- FIG. 2A is a view showing the appearance of a selection device (a pointing device used in a vehicle-mounted device operation system), and
- FIG. 2B is a view showing a cross-sectional structure along line AA in FIG. It is.
- FIG. 3A is a view showing a more specific configuration example of the control device and the operation menu display control device for a vehicle (display control device) in the in-vehicle device operation system of FIG. 1 and
- FIG. 3C is a view showing an example of the configuration of an operation menu image generation unit, and
- FIG. 3C is a view showing an example of the configuration of a display device.
- FIG. 6 is a flowchart showing an example of the main procedure of the display control process (vehicle operation menu display control process).
- FIG. 7A is a diagram showing an example of an operation menu of the first hierarchy (upper hierarchy) in the radial operation menu, and FIG.
- FIG. 7B is a diagram showing an example of an operation menu of the second hierarchy.
- FIG. 8A shows an example of the operation menu of the third layer in the radial operation menu
- FIG. 8B shows another example of the operation menu of the third layer.
- FIG. 9 is a diagram showing an example (radial menu format) of the user intention confirmation image.
- FIG. 1 is a diagram showing an example of the overall configuration of the in-vehicle device operation system.
- the in-vehicle device operation system includes a display device 10, an input / output interface (input / output I / F) 20, a control device 20 (described later, but a display control device (symbol 21 in FIG. 5), and a process execution device (FIG. 5). 26), the signal interface (signal I / F) 40, 50, and the steering wheel (steering wheel) 3, and the user (here, the driver) has a finger (hand) Selection device (input device) 200 that can be operated by the user, the gaze detection unit 301 that detects the gaze of the user, and the voice detection unit 302 (these are examples of selecting menu items without using the selection device 200, for example).
- the external device 400 of the control device Used as the external device (in-vehicle device) 400 of the control device 20, various ECUs (in-vehicle ECU 401, navigation (navigation) ECU 402, audio ECU 4 3, the air conditioning ECU404, wherein the external communication unit (communication devices) 405, which have a and that) is connected to the input-output I / F30 through the bus BUS.
- various ECUs in-vehicle ECU 401, navigation (navigation) ECU 402, audio ECU 4 3, the air conditioning ECU404, wherein the external communication unit (communication devices) 405, which have a and that) is connected to the input-output I / F30 through the bus BUS.
- the display device 10 can display at least one of a real image and a virtual image.
- a HUD (head-up display) device for displaying a virtual image is mounted.
- a virtual image is displayed in a virtual image displayable area 101 (shown by a dashed square in the figure) 2 of the glass etc.).
- a radial menu (radial operation menu) 500 (V) as a virtual image is displayed.
- symbol 500 (V) has shown that it is a virtual image.
- Reference numeral 502 denotes a pointer whose position changes according to the movement of the user's finger (hand) (in this case, it moves clockwise or counterclockwise like a clock hand). ).
- the pointer has a function of pointing (specifying) one of a plurality of items (operation items) included in the radial menu (radial operation menu) 500 (V).
- the display device 10 may be configured to include a display such as a display panel provided in or on the instrument panel.
- the external device (in-vehicle device) 400 sends external device information to the input / output I / F 30 via the bus BUS. .
- the on-vehicle (vehicle) ECU 401 can output the traveling mode (ECO mode, SPORT mode) of the vehicle 1, the average fuel consumption, the travelable distance (travelable distance), the water temperature, the oil temperature and the like.
- the display control device (symbol 21 in FIG. 2) included in the control device 20 indicates the traveling mode of the vehicle 1 based on the above information, or an image (selectable image) that enables the traveling mode to be changed by being selected.
- an item regarding detailed information on the vehicle 1 may be further displayed in the radial menu 500.
- the navigation ECU 402 information on the direction of the next branch and the distance to the branch, facility information on a recommended passing site located in the vicinity of the route of the vehicle 1, and information such as time lost when passing through this. It is possible to output.
- the display control device (symbol 21 in FIG. 2) included in the control device 10 is, for example, an image that switches the direction of the next branch path and the distance to the branch path, and turns on / off the route guidance, At least one of facility information related to the via point of the image, an image for setting the via point, and the like can be displayed as a menu.
- the audio ECU 403 can output information about recommended music and the like.
- the display control device (symbol 21 in FIG. 2) included in the control device 10 can display information related to recommended music (audio) and an image for selecting music as a menu based on the above information.
- the air conditioning ECU 404 can output information and the like regarding the current air conditioning state.
- the display control device (symbol 21 in FIG. 2) included in the control device 10 can display information related to the current air conditioning state or an image that enables the air conditioning state to be changed, based on the above information.
- the external communication unit 405 can output information from the outside of the vehicle 1 such as an incoming state and mail reception information.
- the display control device symbol 21 in FIG. 2 included in the control device 10 is information indicating that there is an incoming call and that there is an e-mail reception, receiving a call or reading e-mail by voice. Can be displayed as a menu.
- FIG. 2A is a view showing the appearance of a selection device (a pointing device used in a vehicle-mounted device operation system), and FIG. 2B is a view showing a cross-sectional structure along line AA in FIG. It is.
- a selection device a pointing device used in a vehicle-mounted device operation system
- FIG. 2B is a view showing a cross-sectional structure along line AA in FIG. It is.
- the selection device 200 (sometimes referred to as an input device or an operation device) 200 is used to select an item in the radial menu 500 shown in FIG.
- the selection device (pointing device) 200 is disposed on the steering wheel 3, and the position of the user's finger (here, for example, a thumb) (in other words, the operation position C) Operation position detection unit 210 for detecting the movement position detection unit 210 and the operation position detection unit 210, and the operation position detection unit 210 is pressed by the thumb to detect that the user has made a selection (decision). It has a determination operation detection unit 220 and a return switch 230 used when performing return processing.
- the operation of the selection device 200 is performed with a finger (hand), but another body part of the user may be used.
- the selection device 200 is a touch sensor that detects a position (operation position C) at which the user's thumb or the like touches the operation surface, and as illustrated in FIG. 2B, the surface cover 211, the sensor sheet 212, and the spacer And 213.
- a touch operation an operation touching the operation surface with a thumb or the like
- a tracing operation hereinafter referred to as a gesture operation
- the selection device 200 The position (operation position C) at which the thumb or the like touches the operation surface is detected, and when a selection (decision) is made by the user, the selection (decision) is detected, for example, the selection (decision) is made Is output (in other words, a selection (decision) detection signal).
- the surface cover 211 in the selection device 200 is formed in a sheet shape by a light shielding insulating material such as a synthetic resin, and the three-dimensional shape of the convex cross section is continuously along the circumference of a circle centered on the central point Q.
- the convex portion (convex area) 211a has a mountain-shaped cross section (convex cross section), and the mountain (convex shape) is long in the direction (inward) toward the central point Q and short in the opposite direction, which is the outer side.
- the unit 210 is configured.
- the user operates the operation position detection unit 210 by recognizing the slope in the longitudinal direction (the direction toward the center point Q, in other words, the inward direction) of the convex portion (convex area) 211a described above by the tactile sensation of a finger.
- the approximate position of the finger at the top can be recognized and the selection device 200 can be operated without looking at the selection device 200. In other words, blind operation is possible.
- the user places the position of the hand (finger) along the circumference of a circle centered on the central point Q. When moved, the user can perceive the locus of the hand (finger) he / she moved (a trace of the temporal change of the position at which the finger or the like touches the operation surface of the touch sensor). You can get an idea of where you are on the circle's circumference. Therefore, even in this case, blind operation is possible.
- the sensor sheet 212 is disposed along the circumference of a circle centered on the central point Q at least on the back surface side of the surface cover 211 corresponding to the convex portion (convex area) 211a, and the operation position C of the user's finger is It detects and outputs information (information on the operation position or a signal indicating the operation position) regarding the operation position C of the user's finger or the like to the control device 20 (display control device 21).
- the sensor sheet 212 is processed into the same shape as the surface cover 211, for example, by being integrally formed with the surface cover 211 by drawing (see FIG. 5B).
- the surface cover 211 and the sensor sheet 212 become like a sheet, and the step shape of the above-mentioned convex part (convex area) 211 a is the bending of the sheet. It will be composed of parts (the raised parts). Further, by integrally molding in this manner, the back surface of the surface cover 211 abuts on the surface of the sensor sheet 212. Thus, the detection portion of the sensor sheet 212 is disposed corresponding to the step shape of the front cover 211.
- the operation surface of the user's finger or the like has a step shape such as a convex portion (convex area) 211a. Even if performed above, for example, the display control device 21 can detect the position of the user's finger.
- the spacer 213 is located on the back surface side of the sensor sheet 212 and is formed in accordance with the shape of the integrally formed surface cover 211 and the sensor sheet 212, and when the surface cover 211 is pressed from the front side by the user's finger or the like. , It is a member holding the above-mentioned shape.
- a plurality (five in the example of FIG. 2B) of the determination operation detection units 220 are provided on the back surface side of the operation position detection unit 210.
- the determination operation detection unit 220 is electrically connected to the control device 20 (including the display control device 21), and the user operates the operation surface of the operation position detection unit 210 (convex portion (convex area) of the surface cover 211)
- a press operation When an operation to press 211 a (hereinafter referred to as a press operation) is performed, the decision operation detection unit 220 is pressed, whereby it is detected that the user has made a selection (decision) and the selection (decision) has been made.
- a signal (a selection (decision) detection signal) indicating.
- the output selection (decision) detection signal is sent to the control device 20 (including the display control device 21).
- the display control device 21 determines which of a plurality of items included in the radial menu 500 has been selected, for example, based on the selection (decision) detection signal sent, and an operation menu corresponding to the selection. An image is generated and displayed on the display device 10. Thus, the display of the operation menu is switched according to the content of the selected item.
- the return switch 230 is a switch located at a distance from the operation position detection unit 210 and the determination operation detection unit 220.
- a return signal is transmitted to the display control device 21 in the control device 20.
- the display control device 21 returns the display of the radial menu 500 to the latest past operation menu image based on the return signal from the return switch 230. In other words, switching to the immediately preceding display is performed.
- FIG. 3A is a view showing a more specific configuration example of the control device and the operation menu display control device for a vehicle (display control device) in the in-vehicle device operation system of FIG. 1 and FIG.
- FIG. 3C is a view showing an example of the configuration of an operation menu image generation unit, and FIG. 3C is a view showing an example of the configuration of a display device.
- control device 20 has a display control device (vehicle operation menu display control device) 21 and a process execution device 26, and, if necessary, a storage device (not shown), The operation routine file 27 is stored.
- the display control device (vehicle operation menu display control device) 21 has an operation menu image generation unit 22 and an operation menu display processing unit 24 and, if necessary, in a storage device (not shown). A menu file 25 is stored.
- Each configuration of the control device 20 described above is, for example, a CPU or MPU (computer: not shown) according to a GUI (Graphical User Interface) program installed in an OS (Operating System) etc. stored in a storage device (not shown) Can be realized by operating.
- GUI Graphic User Interface
- the operation menu image generation unit 22 in the display control device (vehicle operation menu display control device) 21 generates an operation menu image. For example, by taking out (read out) usable ones from a plurality of menu files 25 prepared in advance and incorporating necessary information in image synthesis, an image of a menu (operation menu) including a plurality of operation items is obtained. Generate However, the present invention is not limited to this, and a plurality of items are arranged according to an array stored in advance in a storage unit (not shown) or an array defined by a program stored in a storage unit (not shown) An image of a menu (operation menu) may be generated by image combining of items, or an image may be generated by rendering. The generated image is temporarily stored in an image RAM (not shown) or the like.
- the display control device (vehicle operation menu display control device) 21 is an image using information from the external device 400 (in-vehicle ECU 401, navigation ECU 402, audio ECU 403, air conditioning ECU 404, external communication unit (communication device) 405).
- an image may be generated based only on image data stored in advance in a storage unit (not shown). Thereby, for example, an image (original image) which is the source of the radial menu 500 (V) shown in FIG. 1 can be generated.
- the display control device (vehicle operation menu display control device) 21 has a hierarchical structure and controls the display of an operation menu in which a plurality of operation items are included in an image of one layer, As described above, the operation menu image generation unit 22 generates an image of the operation menu, and the operation menu display processing unit 24 performs display processing of the generated image of the operation menu.
- Operation menu image generation unit 22 is finally selected in the operation menu of the n-th hierarchy (n is a natural number of 3 or more), and the display of the operation menu is the operation menu of the m-th (m is a natural number of n-2) hierarchy
- the operation menu image generation unit 22 can also include at least one item included in the menu of the upper hierarchy in the operation menu of the n-th hierarchy as an item for shortcut. These points will be described later.
- the operation menu display processing unit 24 in FIG. 3A reads out the generated image (image data) from an image RAM (not shown) or the like, adjusts the data format, and adds information necessary for display.
- the image data obtained as a result is sent to the display device 10.
- the displayed vehicle operation menu has a hierarchical structure, and when there is a lower hierarchy menu associated with one selected item, the lower hierarchy menus are sequentially displayed.
- information indicating the content of the finally selected item is sent from the operation menu image generation unit 22 to the processing execution device 26.
- the process execution unit 26 refers to the operation routine file 27, for example, to acquire data indicating the specific content of the process to be executed (however, this operation may not be necessary), and the acquired data is , To the external device (in-vehicle device) 400 via the input / output I / F 30 and the bus BUS. This causes the process associated with the item selected by the user to be performed.
- the operation menu image generation unit 22 includes a final selection determination unit 600, a control processing unit 610, a timer 620, a selection history storage unit 630, and an image generation processing unit 640.
- the selection history storage unit 630 includes an identity determination unit (hereinafter, may be simply referred to as an identity determination unit) 632 with the latest selection in the m-th hierarchy.
- the final selection determination unit 600 determines whether the selection of the item made by the user is the final selection.
- the sameness judging unit 632 included in the selection history storage unit 630 with the latest past selection in the m-th hierarchy determines that the operation item selected in the operation menu in the m-th hierarchy is the most recent in the past. It is determined whether it is the same as the operation item selected in the operation menu of the m hierarchy.
- the control processing unit 610 generates an operation menu image of which layer based on each determination result of the final selection determination unit 600 and the identity determination unit 632 with the latest selection in the first hierarchy, for example For example, based on the determination results of the final selection determination unit 600 and the identity determination unit 632 with the most recent past selection in the first layer, the user's intention confirmation image (described later) If the user's intention confirmation image is generated, it is determined which hierarchical operation menu image is to be generated based on the user's selection made after the generation. It is also good.
- control processing unit 610 included in the operation menu image generation unit 22 selects (current selection) an operation item that is the same as the operation item selected in the operation menu of the m-th hierarchy in the most recent past. Is omitted from the generation of the image of the operation menu of the (m + 1) th layer to the (n-1) th layer only when the) is performed in a predetermined period which is within a predetermined time from the timing of final selection in the nth layer It can be decided (in other words, by shortcut) to generate an image of the operation menu of the nth hierarchy.
- the image generation processing unit 640 generates an operation menu image based on the determination of the control processing unit 610.
- the display device 10 can include at least one of a HUD device 500 that displays an image of a virtual image and a display 600 that displays an image of a real image.
- the HUD device 500 includes a light source 502.
- the light intensity of the light source 502 is modulated in pixel units based on image data to display an image on a screen (not shown).
- the display light of the image is projected onto the windshield (a member having the property of transmitting a part of light and reflecting a part) 1 via a projection optical system (not shown), For example, the radial menu 500 (V) shown in FIG. 1 is displayed.
- FIGS. 4A to 4C will be described.
- the display area of the entire menu has a predetermined outer shape (here, a vertically-long rectangle) This outline is maintained even in the hierarchy of (1), and two operation items "A" and "B" are displayed in the display area of the entire menu.
- FIG. 4A it is assumed that the operation item "B" is selected.
- the operation menu changes to the second hierarchy, and three operation items of “C”, “D”, and “E” are displayed as shown in FIG. 4 (B).
- the operation item "C” is selected.
- the operation menu changes to the third hierarchy, and four operation items of “F”, “G”, “H”, and “I” are displayed as shown in FIG. 4C.
- the operation item "G” is selected, and this is the final selection, and the processing associated with the operation item "G” is executed, and the display of the operation menu returns to the display of the first hierarchy ((1) Fig. 4 (E)).
- the user selects the last past selection again in a predetermined period that is within a predetermined time from when the operation item “G” in FIG. 4C is selected (final selection).
- final selection it is assumed that the same item (here, item “B”) as the selection in FIG. 4 (A) is selected.
- the second selection is the selection associated with the previous last selection (e.g., one to be re-operated to correct the content of the last selection, or it is unclear what the content of the last selection was And the (m + 1) -th layer (here, so that the user does not have to perform redundant operations).
- the operation menu of the n-th hierarchy (here, the third hierarchy), which is the hierarchy for which the last selection is made, is displayed with the second hierarchy) omitted (see FIG. 4F).
- the user redisplays the hierarchy menu of the nth hierarchy and tries to select an item different from the item selected in the last past, etc., the user reaches the operation menu of the nth hierarchy.
- the operation menu image including the target operation item can be displayed directly (and intuitively) and the item can be selected, quick and efficient item selection becomes possible.
- FIG. 4 (G) to FIG. 4 (J) examples of FIG. 4 (G) to FIG. 4 (J) will be described.
- the user before performing the shortcut from the mth layer to the nth layer, the user generates and displays a user intention confirmation image and selects the operation item of the operation menu of the nth layer to the user.
- the user's intention can be confirmed by having the user select whether he / she wants to select 1 or select the second selection to select the operation item of the operation menu of the hierarchy other than the n-th hierarchy. Therefore, it is possible to reliably avoid the inconvenience caused by the shortcut (the operation menu of the hierarchy desired by the user is skipped and not displayed).
- FIG. 4 (G) is the same as FIG. 4 (E).
- FIG. 4H shows an example of the user intention confirmation image.
- the item "final selection item G" first selection item: this is an item for confirming whether or not to make a selection related to the final selection item G)
- the item "other” second selection item: this is an item for confirming whether or not to make a selection unrelated to the final selection
- the operation item B is selected.
- symbol ZN1 in FIG. 5 (A) is a display area (it has the outline of a circle
- FIG. 5B a display area ZN2 (having the same shape, the same size, and the same position) corresponding to the display area ZN1 of FIG. 5A is divided into three, upper side, lower left side, lower right side Three fan-shaped areas on the side are formed.
- an item B which is a “selection history item” indicating that the currently selected item is the operation item B is arranged, and in each of the lower left and lower right areas, the second hierarchy of Items “ ⁇ ” and “ ⁇ ” which are operation items of (intrinsic) are arranged. Further, adjacent to the area ZN2, the letter A is enclosed by a broken line circle in the item A (FIG. 5B) which is the first shortcut item (described as the item 1 for SC). The same applies in the following. In FIG. 5B, the operation item " ⁇ " is selected.
- the area ZN3 corresponding to the area ZN2 is divided into three, the item ⁇ indicating the selection history is arranged in the upper fan-shaped area, and the fan-shaped area in the lower left side is An item ⁇ , which is a second shortcut item (item 2 for SC), is arranged, and an item ⁇ , which is a normal (intrinsic) item of the third hierarchy, is arranged in a sector on the lower right side. Further, a normal (intrinsic) item ⁇ is disposed adjacent to the lower side of the area ZN3.
- the operation item “ ⁇ ” is selected, which is the final selection, and the display of the operation menu automatically returns to the display of the first hierarchy (FIG. 5E).
- FIG. 5E for example, when the operation item "B" is selected as in FIG. 5A within a predetermined time from the final selection, the display of the operation menu of the second hierarchy is omitted, The operation menu of the third hierarchy is displayed (FIG. 5 (F): first shortcut SC1).
- the first shortcut SC1 will be successful, for example, If the user wants to select the item “ ⁇ ” in the second hierarchy (FIG. 5 (B)), it means that the first shortcut SC1 has failed.
- the user In the case of failure, normally, the user needs to press the return button (reference numeral 230 in FIG. 2) to return to the second hierarchy to select the target item “ ⁇ ”.
- the second shortcut item (item 2 for SC) is included in the operation menu of the third hierarchy in FIG. 5 (F). Therefore, by selecting the second shortcut item (item 2 for SC) in FIG. 5G, the operation is omitted using the return button, and the display of the operation menu in FIG. It is possible to transit to the display of the third hierarchy when the item ⁇ is selected in the second hierarchy) (second shortcut SC2).
- FIG. 6 is a flowchart showing an example of the main procedure of the display control process (vehicle operation menu display control process). Here, it is assumed that display control of the type shown in FIG. 4 is performed.
- step S1 the operation menu of the m-th hierarchy is displayed (step S1), and when an item is selected (step S2), the menu of the next lower hierarchy corresponding to the selected item (operation item) is generated and displayed (Step S3).
- step S4 when an item is selected (step S4), it is determined whether or not the selection is the final selection (in other words, the presence or absence of the lower hierarchy associated with the item). In the case of N), the process returns to step S3, and in the case of final selection (in the case of Y in step S5), the process returns to the display of the operation menu of the m-th hierarchy (step S6).
- the display of the operation menu of the m-th hierarchy may be started immediately after the end of the final selection, may be started after a predetermined time has elapsed after the end, or the operation of the selection device by the user is detected It may be started by
- step S7 when the item is selected (step S7), it is then determined whether or not the selection is the same as the latest selection in the m-th hierarchy (and the selection in a predetermined period). (Step S8). If N in step S8, the process returns to step S3. If Y, the process proceeds to step S9.
- step S9 display the menu of the n-th hierarchy in which the last selection is made last (do not display the middle hierarchy), or do you want to select an item different from the item in the n-th hierarchy in which the last selection was made last, Display an image (user's confirmation image) to make the user select whether to select an item in the same hierarchy.
- FIG. 7A is a diagram showing an example of an operation menu of the first hierarchy (upper hierarchy) in the radial operation menu
- FIG. 7B is a diagram showing an example of an operation menu of the second hierarchy
- FIG. 8A shows an example of the operation menu of the third layer in the radial operation menu
- FIG. 8B shows another example of the operation menu of the third layer.
- FIGS. 7A, 7B, and 8A show the hierarchical display format described above with reference to FIGS. 4A to 4F in the radial menu (radial operation menu).
- the example of the case of applying is shown.
- FIG. 8B shows the hierarchical display format described earlier with reference to FIGS. 5A to 5H (in the menu of the lower hierarchy, the item displayed in the upper hierarchy is included as a shortcut item).
- 7 shows a specific example in which the display format is applied to a radial menu (radial operation menu).
- the radial menu is a menu having an origin and a display area of the menu divided by a plurality of radial straight lines extending outward from the origin, and generally has a circular (or elliptical) outer shape.
- a large number of items can be arranged in a compact and balanced manner, for example, by dividing a circle (for example, dividing it into a sector or wedge-shaped area).
- the driver (user) of the vehicle 1 it has become possible for the driver (user) of the vehicle 1 to control the operation of, for example, home electric appliances and water heaters while driving the vehicle 1 by utilizing the IOT (the Internet of Things)
- IOT the Internet of Things
- the number of items displayed in the menu is expected to increase more and more.
- the display format using the radial menu is considered to expand the place of utilization in the future.
- the hierarchy of the display menu also deepens along with this, and there is a tendency for redundant operations to increase accordingly.
- dynamic and speed not found in the prior art by the shortcut in other words, the jump process omitting the intermediate hierarchy, and the jump process omitting the return by the item for shortcut adopted as necessary
- the redundant operation is reduced, the user's psychological burden does not increase.
- a comfortable and practical radial operation menu for a vehicle is realized.
- FIG. 7A is a display example of the top hierarchy (first hierarchy).
- One or a plurality of items (operation items) are allocated and arranged in each of four sector-shaped areas (central angle 90 °) obtained by dividing the circle of the outer shape into four.
- an item AIR CONTROL (air conditioning) (provided with information that the current inside temperature is 26 degrees is also added) 1 is disposed.
- an item 4 "AUDIO” is arranged adjacent to the item 3 (more precisely, in the clockwise direction).
- This item 4 can also be viewed as being disposed adjacent to the item 1 “AIR CONTROL” (more precisely, adjacent in the counterclockwise direction).
- the menu image is switched as shown in FIG. 7 (B).
- the outer shape of the menu in FIG. 7B is a circle, the size is also the same, and since the display follows FIG. 7A, the user does not feel uncomfortable.
- FIG. 7 (B) normal (essentially) lower items (lower operation items) 1-1, 1-2, 1-3, 1-4, 1-5 related to “AIR CONTROL (air conditioning)” 1-6 and 1-7 are displayed.
- the item 1 “AIR CONTROL (air conditioning)”, which is the item selected in FIG. 7A, has the same shape as the area ZN1 of the lower right sector (center angle 90 °) in FIG. 7A.
- the area ZN2 of the same size here, this area is divided into three and divided into upper, middle, and lower areas), specifically, it is arranged again in the upper area ( This corresponds to the selection history item indicating the selection history described above with reference to FIG.
- This item 1 has a function of clarifying that the item currently selected is "AIR CONTROL (air conditioning)" (in other words, showing a selection history).
- the area ZN2 in the lower right sector (center angle 90 °) in FIG. 7B (the same shape as the display area ZN1 of the item 1 in FIG. 6A with the same size (divided into three, In the middle and lower areas), in the middle and lower areas, the regular item 1-1 "REAR (air conditioning of the rear seat)", “FRONT (air conditioning of the front seat)”
- RRR air conditioning of the rear seat
- FRONT air conditioning of the front seat
- an item 2 “SmartPhone (smartphone)” and an item 4 “AUDIO (audio)” are arranged as the shortcut items described above.
- the arrangement of the shortcut items may be adjacent to the selection history item (rule 1), and the display area of the item selected in the upper hierarchy (FIG. 7 (A It is sufficient if at least one of (Rule 2) which may be adjacent to a region (ZN2 in FIG. 7B) having the same shape and the same size as ZN1) in (a) is satisfied.
- both the rules 1 and 2 are satisfied for the item 4 (AUDIO) which is the shortcut item, and the rule 2 is satisfied for the item 2 (SmartPhone) which is the shortcut item ( This rule is generally followed in the example of FIG. 8 (B)).
- items (icons) 1-1-1 to 1-1-7 for specifically setting the air conditioning temperature of the rear seat are provided, and an item (icon) 1-1-8 called NEXT is provided.
- Item of return symbol (return icon) 1-1-9 is displayed.
- FIG. 8B will be referred to.
- the items included in the menu of each of the first and second layers are arranged as shortcut items also in the third layer.
- Item 1-2 (FRONT) is an item for shortcut in the second hierarchy
- items 2 and 4 are items for shortcut in the first hierarchy.
- items 2, 3 and 5 in items 1-1-1 to 1-1-9 previously shown in FIG. 8A. Items except for are included. However, the arrangement of those items is different from that of FIG.
- an item 1-1 “AIR CONTROL REAR (air conditioning of the rear seat)” as a selection history item is disposed.
- a shortcut item for the second hierarchy (shortcut icon) 1-2 is arranged adjacent in the clockwise direction, and next thereto, a shortcut item for the first hierarchy (shortcut icon) 2 is arranged,
- An item 1 for shortcut to the first hierarchy (shortcut icon) 4 is provided at a position adjacent in the counterclockwise direction with respect to the item 1-1 “AIR CONTROL REAR (air conditioning of the rear seat)” as a selection history item. It is done.
- FIG. 7 (A), FIG. 7 (B), and FIG. 8 (B) are compared, the arrangement of the upper hierarchy is followed about the arrangement of the shortcut icon, and the menu of FIG. 8 (B) is constructed. Users are less likely to feel uncomfortable.
- the operation of the upper hierarchy for example, the immediately preceding (n-1) hierarchy
- at least one operation item included in the menu here, the item 1-2 “FRONT”
- a shortcut from the first hierarchy to the first hierarchy
- the user may select an item for the shortcut to omit an operation to return to the upper layer and may be able to immediately select the desired item ( For example, the transition from FIG. 5 (G) to FIG.
- FIG. 9 is a diagram showing an example (radial menu format) of the user intention confirmation image.
- Item 1-8 is the first selection item described above (an item for confirming whether you want to make a selection related to the final selection item), and item 1-9 is the second item described above Items for selection (items for confirming whether or not to make a selection unrelated to the final selection).
- Each of the items 1-8 and 1-9 is disposed in each of semicircular areas (display areas) obtained by vertically dividing a circle into two equal parts. By having the user select one, it is possible to prevent an unintended shortcut from being performed.
- the user (driver of vehicle 1 etc.) finalizes the operation items of the operation menu of the n-th hierarchy (n is a natural number of 3 or more)
- the user returns to the first hierarchy.
- the redundancy in the case where the same operation item as the most recently selected operation item is reselected is eliminated, and the desired operation item can be efficiently selected. Therefore, the convenience of menu selection is significantly improved.
- the present invention is not limited to the above examples, and various modifications and applications are possible.
- an icon for notifying the fact or the like may be included in the menu of the n-th hierarchy.
- the fact may be notified by changing the display mode.
- a vehicle is broadly interpreted as a term indicating "vehicle” such as a car, a train, an airplane, a ship or the like, and the term “menu” is also referred to as "a display including a plurality of options”. As such, it shall be interpreted in a broad sense.
- display device 20 control device 21: display control device (operation menu display control device for vehicle) 22: operation menu image generation unit 24: operation menu display processing 26: processing execution device 30: input / output interface (input / output I / F) 40, 50: signal interface (signal I / F) 200: selection device (input device , Pointing device for vehicle), 500: radial menu, 502: pointer, 600: final selection determination unit, 610: control processing unit, 620: timer, 630: selection history storage Part 632: Identity determination part with the latest selection (final selection) in the first hierarchy, 640: Image generation processing part.
Landscapes
- Engineering & Computer Science (AREA)
- Mechanical Engineering (AREA)
- General Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- Human Computer Interaction (AREA)
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- User Interface Of Digital Computer (AREA)
Abstract
This invention enables efficiently selecting a desired operation item by removing the burdensomeness of when a user makes a final selection of an operation item in a nth level operation menu (n being a natural number greater than or equal to 3) and then returns to the first level and re-selects the same operation items as selected most recently. This operation menu display control device for a vehicle comprises an operation menu image generation unit 22 which generates an image of an operation menu, and a display processing unit 22 which performs display processing of the image. After a final selection in an nth level operation menu has been made, if one operation item contained in a first level operation menu is selected and the selected operation item is the same as the operation item selected in the first level operation menu most recently, then the operation menu image generation unit 22 generates an image of the nth level operation menu, omitting generation of images of the second through (n-1)st level operation menus.
Description
本発明は、例えば自動車等の車両に搭載される車両用操作メニュー表示制御装置、車載機器操作システム、及びGUIプログラム等に関する。
The present invention relates to, for example, a vehicle operation menu display control device mounted on a vehicle such as an automobile, an in-vehicle device operation system, a GUI program, and the like.
GUI(グラフィカルユーザーインターフェース)は、マウスなどのポインティングデバイスを使用して、直感的にコンピュータを操作できるようにしたヒューマンインターフェース技術の一種であり、従来、GUIを用いて階層構造をもつメニューを表示し、多数の項目の中から所望の項目を効率的に選択できるようにすることが知られている。
A GUI (Graphical User Interface) is a type of human interface technology that makes it possible to intuitively operate a computer using a pointing device such as a mouse, and conventionally displays a menu with a hierarchical structure using a GUI. It is known to be able to efficiently select desired items from among a large number of items.
GUIを用いてブラインド操作を可能とした車載機器操作システムについては、例えば、特許文献1に記載されている。
About the vehicle-mounted apparatus operation system which enabled blind operation using GUI, it describes in patent document 1, for example.
ハンドル(例えばステアリングホイール)を握って車両を運転している運転者は、前方を注視しつつ、好ましくは、ブラインドタッチで車両用のポインティングデバイス(選択装置)を直観的に操作し、メニュー画像を表示させて、極めて短時間で項目を選択する必要がある。したがって、例えば、デスクトップパソコンでマウスを用いて項目を選択する場合と比較すると、その精度、あるいはポインティングデバイス(選択装置)の操作速度の点で劣るのは、やむを得ない。よって、車載機器の操作の際に、冗長な操作が、極力、生じないようにすることが望まれる。
A driver driving a vehicle by holding a steering wheel (e.g. a steering wheel) preferably intuitively operates a pointing device (selection device) for the vehicle with a blind touch while gazing forward, and selects a menu image It is necessary to display and select items in a very short time. Therefore, for example, compared with the case of selecting an item using a mouse on a desktop personal computer, it is unavoidable that the accuracy or the operation speed of the pointing device (selection device) is inferior. Therefore, it is desirable to prevent redundant operation as much as possible when operating the in-vehicle device.
ここで、本発明の発明者は、例えば、以下のような項目選択が行われる場合において、冗長な操作が生じることを認識した。
Here, the inventor of the present invention has recognized that, for example, redundant operation occurs when the following item selection is performed.
例えば、階層構造をもつ車載機器の操作メニューに含まれる操作項目を選択する場合に、例えば、第1階層の操作メニューで、大項目A、B、Cの中から項目「B」を選択し、第2階層の操作メニューで中項目α、β、γの中から項目「α」を選択し、第3階層の操作メニューで、小項目θ、λ、μの中から項目「λ」を選択し(第1回目の選択)、これが最終選択となって、表示画面が、第1階層の操作メニューの表示画面に戻ったとする。ここで、ユーザーが、例えば、小項目「λ」ではなく「μ」を選択するべきだったことに気が付き、正しい設定をしようとすると、再び大項目「B」を選択し、次に、中項目「α」を選択し、次に、小項目「μ」を選択すること(第2回目の選択をすること)になり、第2回目の選択においても、第1回目の選択の場合と同じ階層の遷移を経なければならない。
For example, when selecting an operation item included in the operation menu of the in-vehicle device having a hierarchical structure, for example, the item "B" is selected from the large items A, B, C in the operation menu of the first layer, Select the item “α” from the middle items α, β and γ in the operation menu of the second hierarchy, and select the item “λ” from the small items θ, λ and μ in the operation menu of the third hierarchy (First selection) It is assumed that this is the final selection, and the display screen returns to the display screen of the operation menu of the first hierarchy. Here, the user notices that, for example, he should have selected “μ” instead of the small item “λ”, and when trying to make the correct setting, select the large item “B” again, and then select the middle item "Α" is selected, and then the small item "μ" is selected (the second selection is made), and in the second selection, the same hierarchy as in the first selection Have to go through the transition.
他の例としては、例えば、第3階層の操作メニューの小項目として、θ、λ、μ、及び「NEXT(次の項目を表示するための項目)」があったにもかかわらず、この項目「NEXT」を見逃して、とりあえず、「μ」を選んでしまった、という場合も有り得る。この場合も、第2回目の選択にて、第1回目の選択の場合と同じ過程をたどって第3階層の操作メニューを表示し、そして、小項目「NEXT」を選択して、第4階層の操作メニューを表示して選択を続けていく、という操作が行われる。
As another example, for example, although the items θ, λ, μ, and “NEXT (items for displaying the next item)” exist as small items of the operation menu of the third hierarchy, this item It is possible that the user overlooked "NEXT" and selected "μ" for the time being. Also in this case, in the second selection, the operation menu of the third hierarchy is displayed following the same process as in the first selection, and then the small item “NEXT” is selected, and the fourth hierarchy is selected. The operation menu is displayed to continue the selection.
さらに他の例としては、例えば、第3階層の操作メニューの中から1つの小項目を、ブラインドタッチのポインティングデバイスの操作で選択したが、このとき、ユーザー(例えば、車両を運転中の運転者)が前方を注視しており、ふと、今、選択した項目が何であったかが、わからなくなってしまい、不安を払拭するべく、もう一度、最初から選択をやり直す、という場合があり得る。
As still another example, for example, one small item is selected from the operation menu of the third hierarchy by the operation of the pointing device of the blind touch, but at this time, the user (for example, the driver driving the vehicle) ) May be looking forward, and it may not be clear what the selected item is, and it may be possible to re-select from the beginning once more to eliminate anxiety.
上記の例は、いずれも、階層が深化した状態で最終選択が行われて、第1階層に戻り、ここで、ユーザーが、直近の過去で選択した項目と同じ項目を再度、選択したときに(第2回目の選択)、第1回目の選択の場合と同じ階層の遷移を経なければならない、という点で共通している。言い換えれば、ユーザーが項目の再設定を行う場合に、前回と同じ操作を順次、行うこと(冗長的な操作をすること)を強いられる、という問題が生じる、ということである。
In each of the above examples, the final selection is performed with the hierarchy deepened, and the process returns to the first hierarchy, where the user reselects the same item as the item selected in the immediate past. The second selection is common in that it has to go through the same hierarchy transition as in the first selection. In other words, when the user resets the item, the problem arises that the user is forced to sequentially perform the same operation as the previous one (perform redundant operation).
上記の特許文献1では、この問題については何ら言及されておらず、その対策についての示唆もない。
In Patent Document 1 mentioned above, this problem is not mentioned at all, and there is no suggestion on the countermeasure.
本発明は、ユーザーが、第n階層(nは3以上の自然数)の操作メニューの操作項目を最終決定した後、第m階層(mはn-2以下の自然数)に戻って、直近の過去にて選択した操作項目と同じ操作項目を再選択した場合における冗長性を排し、所望の操作項目を効率的に選択できるようにすることを目的とする。
In the present invention, after the user has finally determined the operation item of the operation menu of the n-th hierarchy (n is a natural number of 3 or more), the m-th hierarchy (m is a natural number of n-2 or less) is returned to It is an object of the present invention to eliminate redundancy in the case where the same operation item as the operation item selected in the above is re-selected and to enable efficient selection of a desired operation item.
本発明の他の目的は、以下に例示する態様及び最良の実施形態、並びに添付の図面を参照することによって、当業者に明らかになるであろう。
Other objects of the present invention will become apparent to those skilled in the art by referring to the following exemplified aspects and best embodiments, as well as the attached drawings.
以下に、本発明の概要を容易に理解するために、本発明に従う態様を例示する。
In the following, in order to facilitate an understanding of the summary of the invention, an embodiment according to the invention is illustrated.
第1の態様において、車両用操作メニュー表示制御装置は、
階層構造を有すると共に、1つの階層の画像に複数の操作項目が含まれる操作メニューの表示を制御する車両用操作メニュー表示制御装置であって、
前記操作メニューの画像を生成する操作メニュー画像生成部と、
生成された操作メニューの画像の表示処理を行う表示処理部と、
を有し、
前記操作メニュー画像生成部は、
前記選択信号によって第n階層(nは3以上の自然数)の操作メニューに含まれる1つの操作項目が選択され、その操作項目に関連付けられた第(n+1)階層の操作メニューが存在しないことで、前記選択が最終選択であった場合、第m階層(mはn-2以下の自然数)の操作メニューの画像を生成し、
その生成の後、前記第m階層の操作メニューに含まれる1つの操作項目が選択され、その選択された操作項目が、直近の過去において、第m階層の操作メニューで選択された操作項目と同じであった場合には、第(m+1)階層乃至第(n-1)階層の操作メニューの画像の生成を省略して、第n階層の操作メニューの画像を生成する。 In the first aspect, the vehicle operation menu display control device includes:
A vehicle operation menu display control device having a hierarchical structure and controlling display of an operation menu including a plurality of operation items in an image of one layer,
An operation menu image generation unit that generates an image of the operation menu;
A display processing unit that performs display processing of the generated image of the operation menu;
Have
The operation menu image generation unit
One operation item included in the operation menu of the n-th hierarchy (n is a natural number of 3 or more) is selected by the selection signal, and the operation menu of the (n + 1) -th hierarchy associated with the operation item does not exist. If the selection is the final selection, an image of the operation menu of the m-th hierarchy (m is a natural number of n-2 or less) is generated,
After the generation, one operation item included in the operation menu of the m-th hierarchy is selected, and the selected operation item is the same as the operation item selected in the operation menu of the m-th hierarchy in the immediate past. In this case, the generation of the image of the operation menu of the (m + 1) th layer to the (n-1) th layer is omitted, and the image of the operation menu of the nth layer is generated.
階層構造を有すると共に、1つの階層の画像に複数の操作項目が含まれる操作メニューの表示を制御する車両用操作メニュー表示制御装置であって、
前記操作メニューの画像を生成する操作メニュー画像生成部と、
生成された操作メニューの画像の表示処理を行う表示処理部と、
を有し、
前記操作メニュー画像生成部は、
前記選択信号によって第n階層(nは3以上の自然数)の操作メニューに含まれる1つの操作項目が選択され、その操作項目に関連付けられた第(n+1)階層の操作メニューが存在しないことで、前記選択が最終選択であった場合、第m階層(mはn-2以下の自然数)の操作メニューの画像を生成し、
その生成の後、前記第m階層の操作メニューに含まれる1つの操作項目が選択され、その選択された操作項目が、直近の過去において、第m階層の操作メニューで選択された操作項目と同じであった場合には、第(m+1)階層乃至第(n-1)階層の操作メニューの画像の生成を省略して、第n階層の操作メニューの画像を生成する。 In the first aspect, the vehicle operation menu display control device includes:
A vehicle operation menu display control device having a hierarchical structure and controlling display of an operation menu including a plurality of operation items in an image of one layer,
An operation menu image generation unit that generates an image of the operation menu;
A display processing unit that performs display processing of the generated image of the operation menu;
Have
The operation menu image generation unit
One operation item included in the operation menu of the n-th hierarchy (n is a natural number of 3 or more) is selected by the selection signal, and the operation menu of the (n + 1) -th hierarchy associated with the operation item does not exist. If the selection is the final selection, an image of the operation menu of the m-th hierarchy (m is a natural number of n-2 or less) is generated,
After the generation, one operation item included in the operation menu of the m-th hierarchy is selected, and the selected operation item is the same as the operation item selected in the operation menu of the m-th hierarchy in the immediate past. In this case, the generation of the image of the operation menu of the (m + 1) th layer to the (n-1) th layer is omitted, and the image of the operation menu of the nth layer is generated.
第1の態様では、第n階層の操作メニューにて最終選択がなされ、操作メニューの表示が第m階層の操作メニュー(例えば、第1階層の初期メニュー)に復帰した後、直近の過去の選択と同一の項目が選択されると、第(m+1)~第(n-1)階層の操作メニューの画像生成(およびその表示)が省略されて、第n階層の操作メニューの画像が生成されて表示される。言い換えれば、第m階層から第n階層へのショートカットが実施される。
In the first mode, the last selection is made in the operation menu of the n-th hierarchy, and after the display of the operation menu returns to the operation menu of the m-th hierarchy (for example, the initial menu of the first hierarchy), the last past selection is made When the same item as is selected, image generation (and display thereof) of the (m + 1) th to (n-1) th layer operation menus is omitted, and an image of the nth layer operation menu is generated. Is displayed. In other words, a shortcut from the mth layer to the nth layer is implemented.
よって、ユーザーが、第n階層の階層メニューを再表示させて、直近の過去に選択した項目とは異なる項目を選択しようとする場合等において、ユーザーは、第n階層の操作メニューに至るまでに、各階層の操作メニューを表示して選択をするという、従来の冗長な操作をする必要がない。言い換えれば、直接的(かつ直観的)に、目的とする操作項目を含む操作メニュー画像を表示させて、その項目を選択できることから、迅速で効率的な項目の選択が可能となる。
Therefore, in the case where the user redisplays the hierarchy menu of the nth hierarchy and tries to select an item different from the item selected in the last past, etc., the user reaches the operation menu of the nth hierarchy. There is no need to perform the conventional redundant operation of displaying and selecting the operation menu of each hierarchy. In other words, since the operation menu image including the target operation item can be displayed directly (and intuitively) and the item can be selected, quick and efficient item selection becomes possible.
第1の態様に従属する第2の態様において、
前記操作メニュー画像生成部は、
前記第1階層の操作メニューの画像を生成した後に行われる、直近の過去において、第1階層の操作メニューで選択された操作項目と同じである操作項目についての前記選択が、前記第n階層における前記最終選択のタイミングから所定時間内である所定期間において行われる場合にのみ、前記第(m+1)階層乃至第(n-1)階層の操作メニューの画像の生成を省略して、前記第n階層の操作メニューの画像を生成してもよい。 In a second aspect dependent on the first aspect,
The operation menu image generation unit
The selection of the operation item which is the same as the operation item selected in the operation menu of the first hierarchy in the immediate past, which is performed after generating the image of the operation menu of the first hierarchy, is in the nth hierarchy The generation of the image of the operation menu of the (m + 1) th layer to the (n-1) th layer is omitted only when it is performed in a predetermined period which is within a predetermined time from the timing of the final selection. The image of the operation menu may be generated.
前記操作メニュー画像生成部は、
前記第1階層の操作メニューの画像を生成した後に行われる、直近の過去において、第1階層の操作メニューで選択された操作項目と同じである操作項目についての前記選択が、前記第n階層における前記最終選択のタイミングから所定時間内である所定期間において行われる場合にのみ、前記第(m+1)階層乃至第(n-1)階層の操作メニューの画像の生成を省略して、前記第n階層の操作メニューの画像を生成してもよい。 In a second aspect dependent on the first aspect,
The operation menu image generation unit
The selection of the operation item which is the same as the operation item selected in the operation menu of the first hierarchy in the immediate past, which is performed after generating the image of the operation menu of the first hierarchy, is in the nth hierarchy The generation of the image of the operation menu of the (m + 1) th layer to the (n-1) th layer is omitted only when it is performed in a predetermined period which is within a predetermined time from the timing of the final selection. The image of the operation menu may be generated.
第2の態様では、直近の過去に選択した項目と同じ項目について選択が、その直近の過去の選択(最終選択)から所定期間内(最終選択のタイミングから所定時間内)に行われる場合にのみ、第m階層から第n階層へのショートカット(近道のための遷移)を実施し、所定期間外である場合は、通常どおり、第(m+1)階層乃至第(n-1)階層の操作メニューの画像の生成を、順次、実施する。
In the second aspect, selection is performed only within the predetermined period (within a predetermined time from the timing of the last selection) from the most recent past selection (final selection) for the same item as the most recently selected item. , The shortcut from the m-th hierarchy to the n-th hierarchy (transition for shortcut) is performed, and if outside the predetermined period, as usual, the operation menu of the (m + 1) -th to (n-1) -th hierarchy The image generation is performed sequentially.
再選択が所定期間(所定時間)内に行われる場合は、その再選択は、先の最終選択に関連したものである(例えば、ユーザーが、先の最終選択の結果を変更しようとして行うための再選択である、また例えば、記憶があやふやな先の最終選択についての不安感を払拭するための再選択である)可能性が高く、この場合、ユーザーが目的とする項目は、先の最終選択が行われた階層である第n階層に含まれている可能性が高い。よって、上記の第m階層から第n階層へのショートカットが有効である。
If the reselection is performed within a predetermined period (predetermined time), the reselection is associated with the previous final selection (for example, for the user to change the result of the previous final selection) It is likely to be a reselection, or, for example, a reselection to dispel concerns about the last choice of memory, and in this case, the item for which the user is aiming is the last choice. There is a high possibility that it is included in the n-th hierarchy which is the hierarchy in which Therefore, the shortcut from the m-th layer to the n-th layer is effective.
しかし、再選択が、先の最終選択のタイミングから所定時間経過した後に行われる(所定期間外に行われる)場合は、その再選択は、先の最終選択とは無関係で、別個独立の再選択(言い換えれば、先の最終選択の内容に基づいて推測することができない選択である)可能性が高い。よって、この場合にも上記のショートカットを行うことは、かえってユーザーの不利益になることから、この場合には、通常どおり、第(m+1)階層乃至第(n-1)階層の操作メニューの画像の生成を、順次、実施する。これによって、第(m+1)階層から第n階層へのショートカットが有効である可能性が高い場合にのみ、そのショートカットが行われることになる。言い換えれば、そのショートカットによって不都合が生じる可能性を低減することができる。
However, if reselection is performed after a predetermined time has elapsed from the timing of the previous final selection (it is performed outside the predetermined period), the reselection is independent of the previous final selection, and independent reselection (In other words, it is a choice that can not be inferred based on the content of the previous final choice). Therefore, performing the above-mentioned shortcut in this case is also disadvantageous for the user. In this case, as usual, the image of the operation menu of the (m + 1) -th to (n-1) -th layers. Implement the generation of As a result, the shortcut is performed only when the shortcut from the (m + 1) -th layer to the n-th layer is likely to be effective. In other words, the possibility of inconvenience caused by the shortcut can be reduced.
第1の態様に従属する第3の態様において、
前記操作メニュー画像生成部は、
前記第(m+1)階層乃至第(n-1)階層の操作メニューの画像の生成を省略して、第n階層の操作メニューの画像を生成する処理に先立ち、
前記最終選択がなされた前記第n階層の操作メニューの操作項目を選択する第1の選択をしたいのか、前記第n階層以外の階層の操作メニューの操作項目を選択する第2の選択をしたいのかをユーザーに選ばせるための、前記第1、第2の各選択に対応する第1、第2の意思確認用項目を含むユーザー意思確認画像を生成し、
前記ユーザーが、前記第1の意思確認用項目を選択した場合にのみ、前記第(m+1)階層乃至第(n-1)階層の操作メニューの画像の生成を省略して、前記第n階層の操作メニューの画像を生成してもよい。 In a third aspect dependent on the first aspect,
The operation menu image generation unit
Prior to the process of generating the image of the operation menu of the nth layer, omitting the generation of the image of the operation menu of the (m + 1) th layer to the (n-1) th layer,
Do you want to make a first selection to select an operation item of the operation menu of the n-th hierarchy for which the final selection has been made or do you want to make a second selection to select an operation item of an operation menu of a hierarchy other than the n-th hierarchy? Generating a user intention confirmation image including first and second intention confirmation items corresponding to the first and second selections, to make the user select
Only when the user selects the first intention confirmation item, the generation of the image of the operation menu of the (m + 1) -th to (n-1) -th layers is omitted, and the n-th hierarchy is selected. An image of the operation menu may be generated.
前記操作メニュー画像生成部は、
前記第(m+1)階層乃至第(n-1)階層の操作メニューの画像の生成を省略して、第n階層の操作メニューの画像を生成する処理に先立ち、
前記最終選択がなされた前記第n階層の操作メニューの操作項目を選択する第1の選択をしたいのか、前記第n階層以外の階層の操作メニューの操作項目を選択する第2の選択をしたいのかをユーザーに選ばせるための、前記第1、第2の各選択に対応する第1、第2の意思確認用項目を含むユーザー意思確認画像を生成し、
前記ユーザーが、前記第1の意思確認用項目を選択した場合にのみ、前記第(m+1)階層乃至第(n-1)階層の操作メニューの画像の生成を省略して、前記第n階層の操作メニューの画像を生成してもよい。 In a third aspect dependent on the first aspect,
The operation menu image generation unit
Prior to the process of generating the image of the operation menu of the nth layer, omitting the generation of the image of the operation menu of the (m + 1) th layer to the (n-1) th layer,
Do you want to make a first selection to select an operation item of the operation menu of the n-th hierarchy for which the final selection has been made or do you want to make a second selection to select an operation item of an operation menu of a hierarchy other than the n-th hierarchy? Generating a user intention confirmation image including first and second intention confirmation items corresponding to the first and second selections, to make the user select
Only when the user selects the first intention confirmation item, the generation of the image of the operation menu of the (m + 1) -th to (n-1) -th layers is omitted, and the n-th hierarchy is selected. An image of the operation menu may be generated.
第3の態様では、第1階層から第n階層へのショートカットを実施する前に、ユーザーが、ユーザー意思確認画像を生成して表示し、ユーザーに、第n階層の操作メニューの操作項目を選択する第1の選択をしたいのか、第n階層以外の階層の操作メニューの操作項目を選択する第2の選択をしたいのかを、ユーザーに選ばせることで、ユーザーの意思を確認することができる。よって、ショートカットによって生じる不都合(ユーザーが望む階層の操作メニューがスキップされて表示されないこと)を、確実に回避することが可能となる。
In the third aspect, before performing the shortcut from the first hierarchy to the n-th hierarchy, the user generates and displays a user intention confirmation image and selects the operation item of the operation menu of the n-th hierarchy to the user The user's intention can be confirmed by having the user select whether he / she wants to make the first selection or the second selection to select the operation item of the operation menu of the hierarchy other than the n-th hierarchy. Therefore, it is possible to reliably avoid the inconvenience caused by the shortcut (the operation menu of the hierarchy desired by the user is skipped and not displayed).
第1乃至第3の何れか1つの態様に従属する第4の態様において、
前記操作メニュー画像生成部は、
前記第n階層の操作メニューの画像を生成する際、正規の操作メニュー項目と、上位階層である第(m+1)乃至第(n-1)階層のうちの少なくとも1つの階層の操作メニューに含まれていた、直近の過去に選択された1つの操作項目以外の操作項目であるショートカット用項目と、を含む、第n階層の操作メニューの画像を生成してもよい。 In a fourth aspect dependent on any one of the first to third aspects,
The operation menu image generation unit
When generating an image of the operation menu of the n-th hierarchy, it is included in the operation menu of at least one of the normal operation menu item and the (m + 1) th to (n-1) -th hierarchies which are upper hierarchies. The image of the operation menu of the n-th hierarchy may be generated including the shortcut item which is the operation item other than the one operation item selected in the last past.
前記操作メニュー画像生成部は、
前記第n階層の操作メニューの画像を生成する際、正規の操作メニュー項目と、上位階層である第(m+1)乃至第(n-1)階層のうちの少なくとも1つの階層の操作メニューに含まれていた、直近の過去に選択された1つの操作項目以外の操作項目であるショートカット用項目と、を含む、第n階層の操作メニューの画像を生成してもよい。 In a fourth aspect dependent on any one of the first to third aspects,
The operation menu image generation unit
When generating an image of the operation menu of the n-th hierarchy, it is included in the operation menu of at least one of the normal operation menu item and the (m + 1) th to (n-1) -th hierarchies which are upper hierarchies. The image of the operation menu of the n-th hierarchy may be generated including the shortcut item which is the operation item other than the one operation item selected in the last past.
第4の態様では、第n階層の操作メニューに、上位階層(例えば、直前の第(n-1)階層)の操作メニューに含まれていた少なくとも1つの操作項目をショートカット用項目として含ませておく。ユーザーの意に沿わないショートカット(第1階層から第n階層へのショートカット)が行われてしまった場合、ユーザーがそのショートカット用項目を選択することで、上位階層へと戻る操作を省略して、目的とする項目をただちに選択できる可能性があり、これは、意に沿わないショートカット(第1階層から第n階層へのショートカット)が行われてしまった場合の対策の1つとなり得るものである。
In the fourth aspect, at least one operation item included in the operation menu of the upper hierarchy (for example, the immediately preceding (n-1) hierarchy) is included as an item for shortcut in the operation menu of the nth hierarchy deep. When a shortcut (shortcut from the first hierarchy to the n-th hierarchy) which does not conform to the user's intention is performed, the user selects the item for the shortcut, thereby omitting the operation of returning to the upper hierarchy, There is a possibility that the target item can be selected immediately, which can be one of the measures in the case where the unintended shortcut (shortcut from the first hierarchy to the n-th hierarchy) is performed. .
第1乃至第3の何れか1つの態様に従属する第5の態様において、
前記操作メニュー画像生成部は、
前記最終選択であるか否かを判定する最終選択判定部と、
第m階層の操作メニューで選択された操作項目が、直近の過去において、第m階層の操作メニューで選択された操作項目と同じであったか否かを判定する、第m階層での直近の過去の選択との同一性判定部と、
前記最終選択判定部、及び前記第m階層での直近の過去の選択との同一性判定部の各判定結果に基づいて、どの階層の操作メニュー画像を生成させるかを決定する、
又は、
前記最終選択判定部、及び前記第m階層での直近の過去の選択との同一性判定部の各判定結果に基づいて、前記ユーザーの意思確認画像を生成させるか否かを決定し、前記ユーザーの意思確認画像を生成させた場合には、その生成の後に行われる前記ユーザーの選択に基づいて、どの階層の操作メニュー画像を生成させるかを決定する、制御処理部と、
前記制御処理部の決定に基づいて、操作メニュー画像の生成処理を行う画像生成処理部と、
を含んでもよい。 In a fifth aspect dependent on any one of the first to third aspects,
The operation menu image generation unit
A final selection determining unit that determines whether or not the final selection is performed;
It is determined whether the operation item selected in the operation menu of the m-th hierarchy is the same as the operation item selected in the operation menu of the m-th hierarchy in the most recent past An identity determination unit with selection,
Based on each determination result of the final selection determination unit and the identity determination unit with the latest past selection in the m-th layer, it is determined which operation menu image is to be generated.
Or
It is determined whether or not the intention confirmation image of the user is to be generated based on each determination result of the final selection determination unit and an identity determination unit with the latest selection in the m-th hierarchy, A control processing unit that determines which hierarchical operation menu image is to be generated, based on the user's selection performed after the generation of the intention confirmation image of
An image generation processing unit that generates an operation menu image based on the determination of the control processing unit;
May be included.
前記操作メニュー画像生成部は、
前記最終選択であるか否かを判定する最終選択判定部と、
第m階層の操作メニューで選択された操作項目が、直近の過去において、第m階層の操作メニューで選択された操作項目と同じであったか否かを判定する、第m階層での直近の過去の選択との同一性判定部と、
前記最終選択判定部、及び前記第m階層での直近の過去の選択との同一性判定部の各判定結果に基づいて、どの階層の操作メニュー画像を生成させるかを決定する、
又は、
前記最終選択判定部、及び前記第m階層での直近の過去の選択との同一性判定部の各判定結果に基づいて、前記ユーザーの意思確認画像を生成させるか否かを決定し、前記ユーザーの意思確認画像を生成させた場合には、その生成の後に行われる前記ユーザーの選択に基づいて、どの階層の操作メニュー画像を生成させるかを決定する、制御処理部と、
前記制御処理部の決定に基づいて、操作メニュー画像の生成処理を行う画像生成処理部と、
を含んでもよい。 In a fifth aspect dependent on any one of the first to third aspects,
The operation menu image generation unit
A final selection determining unit that determines whether or not the final selection is performed;
It is determined whether the operation item selected in the operation menu of the m-th hierarchy is the same as the operation item selected in the operation menu of the m-th hierarchy in the most recent past An identity determination unit with selection,
Based on each determination result of the final selection determination unit and the identity determination unit with the latest past selection in the m-th layer, it is determined which operation menu image is to be generated.
Or
It is determined whether or not the intention confirmation image of the user is to be generated based on each determination result of the final selection determination unit and an identity determination unit with the latest selection in the m-th hierarchy, A control processing unit that determines which hierarchical operation menu image is to be generated, based on the user's selection performed after the generation of the intention confirmation image of
An image generation processing unit that generates an operation menu image based on the determination of the control processing unit;
May be included.
第5の態様では、操作メニュー画像生成部の構成の一例を示されている。本態様では、操作メニュー画像生成部は、最終選択判定部と、第1階層での直近の過去の選択との同一性判定部と、前記最終選択判定部と、制御処理部と、画像生成処理部と、を含んで構成される。これらは、例えば、コンピュータが、GUI(グラフィカルユーザーインターフェース)プログラムに従って動作することで構築される機能ブロックを利用して実現することができる。
In the fifth aspect, an example of the configuration of the operation menu image generation unit is shown. In this aspect, the operation menu image generation unit includes a final selection determination unit, an identity determination unit with the latest selection in the first hierarchy, the final selection determination unit, a control processing unit, and an image generation process. Parts and is comprised. These can be realized, for example, using functional blocks constructed by a computer operating according to a GUI (Graphical User Interface) program.
第1乃至第5の何れか1つの態様に従属する第6の態様において、
前記操作メニュー画像生成部が生成する前記操作メニューの画像は、原点を有し、前記原点から外側に向かう複数の放射状の直線によって、操作メニューの表示領域が区画されてなるラジアルメニューの画像としてもよい。 In a sixth aspect dependent on any one of the first to fifth aspects,
The image of the operation menu generated by the operation menu image generation unit has an origin, and is also an image of a radial menu in which the display area of the operation menu is divided by a plurality of radial straight lines extending outward from the origin. Good.
前記操作メニュー画像生成部が生成する前記操作メニューの画像は、原点を有し、前記原点から外側に向かう複数の放射状の直線によって、操作メニューの表示領域が区画されてなるラジアルメニューの画像としてもよい。 In a sixth aspect dependent on any one of the first to fifth aspects,
The image of the operation menu generated by the operation menu image generation unit has an origin, and is also an image of a radial menu in which the display area of the operation menu is divided by a plurality of radial straight lines extending outward from the origin. Good.
第6の態様では、操作メニューの表示形式として、ラジアルメニュー形式を採用する。ラジアルメニューは、円を細分化する(例えば、扇形や楔(くさび)形の領域に分割する)ことで、多数の項目を、コンパクトにバランスよく配置することができる。近年、IOT(物のインターネット)の活用によって、例えば、車両の運転者(ユーザー)が、車両を運転しながら、例えば、自宅の電気製品や給湯機器等の動作を制御することも可能となってきており、今後、メニューに表示する項目の数は、ますます増えるものと予測される。ラジアルメニューを利用した表示形式は、今後、活用の場が広がるものと考えられる。
In the sixth aspect, a radial menu format is adopted as a display format of the operation menu. In the radial menu, a large number of items can be compactly arranged in a well-balanced manner by subdividing the circle (for example, dividing it into a fan-shaped or wedge-shaped area). In recent years, it has become possible, for example, for the driver (user) of a vehicle to control, for example, the operation of an electric appliance or a hot water supply device at home while driving the vehicle by utilizing the IOT (the Internet of Things) In the future, the number of items displayed in the menu is expected to increase more and more. The display format using the radial menu is considered to expand the place of utilization in the future.
第7の態様において、車載機器操作システムは、
第1乃至第6の何れか1つの態様に記載の車両用操作メニュー表示制御装置と、
生成された操作メニューの画像に基づいて、操作メニューを表示する表示装置と、
前記操作メニューに含まれる複数の操作項目のうちの1つを選択するための選択信号を、車両のユーザーの選択動作に応じて発生させる選択装置と、
前記ユーザーによって最終選択された操作項目に対応する、車載機器の操作処理を実行する処理実行装置と、
を有する。 In a seventh aspect, the in-vehicle device operating system
The vehicle operation menu display control device according to any one of the first to sixth aspects;
A display device that displays an operation menu based on the generated image of the operation menu;
A selection device that generates a selection signal for selecting one of a plurality of operation items included in the operation menu according to a selection operation of a user of the vehicle;
A process execution device that executes an operation process of an in-vehicle device corresponding to the operation item finally selected by the user;
Have.
第1乃至第6の何れか1つの態様に記載の車両用操作メニュー表示制御装置と、
生成された操作メニューの画像に基づいて、操作メニューを表示する表示装置と、
前記操作メニューに含まれる複数の操作項目のうちの1つを選択するための選択信号を、車両のユーザーの選択動作に応じて発生させる選択装置と、
前記ユーザーによって最終選択された操作項目に対応する、車載機器の操作処理を実行する処理実行装置と、
を有する。 In a seventh aspect, the in-vehicle device operating system
The vehicle operation menu display control device according to any one of the first to sixth aspects;
A display device that displays an operation menu based on the generated image of the operation menu;
A selection device that generates a selection signal for selecting one of a plurality of operation items included in the operation menu according to a selection operation of a user of the vehicle;
A process execution device that executes an operation process of an in-vehicle device corresponding to the operation item finally selected by the user;
Have.
第7の態様によれば、例えば、車両を運転中の運転者等が、ブラインド操作で、快適に車載機器を操作可能な、車載機器操作システムを実現することができる。
According to the seventh aspect, it is possible to realize, for example, an on-vehicle apparatus operation system in which a driver or the like who is driving a vehicle can comfortably operate the on-vehicle apparatus by the blind operation.
第8の態様において、GUI(グラフィカルユーザーインターフェース)プログラムは、コンピュータを、請求項1乃至6の何れか1項に記載の、操作メニュー画像生成部と、生成された操作メニューの画像の表示処理を行う表示処理部と、を有する車両用操作メニュー表示制御装置として動作させる。
In an eighth aspect, a GUI (Graphical User Interface) program includes a computer, an operation menu image generation unit according to any one of claims 1 to 6, and display processing of an image of the generated operation menu. And a display processing unit for operating the vehicle.
第8の態様によれば、車両用表示に適した操作メニューの表示制御を、ソフトプログラムを用いて、簡易な構成にて実現することができる。
According to the eighth aspect, display control of the operation menu suitable for display for a vehicle can be realized with a simple configuration using a software program.
当業者は、例示した本発明に従う態様が、本発明の精神を逸脱することなく、さらに変更され得ることを容易に理解できるであろう。
Those skilled in the art will readily understand that the illustrated embodiments of the present invention can be further modified without departing from the spirit of the present invention.
以下に説明する最良の実施形態は、本発明を容易に理解するために用いられている。従って、当業者は、本発明が、以下に説明される実施形態によって不当に限定されないことを留意すべきである。
The preferred embodiments described below are used to easily understand the present invention. Accordingly, one of ordinary skill in the art should note that the present invention is not unduly limited by the embodiments described below.
図1を参照する。図1は、車載機器操作システムの全体の構成例を示す図である。
Please refer to FIG. FIG. 1 is a diagram showing an example of the overall configuration of the in-vehicle device operation system.
車載機器操作システムは、表示装置10と、入出力インターフェース(入出力I/F)20と、制御装置20(後述するが、表示制御装置(図5の符号21)と、処理実行装置(図5の符号26)と、を含んでいる)と、信号インターフェース(信号I/F)40、50と、ハンドル(ステアリングホイール)3に設けられ、ユーザー(ここでは運転者とする)が指(手)で操作可能な選択装置(入力装置)200と、ユーザーの視線を検出する視線検出部301及び音声検出部302(これらは、例えば、選択装置200を使用せずにメニューの項目を選択する場合に用いられる)と、制御装置20の外部機器(車載機器)400としての、各種のECU(車載ECU401、ナビ(ナビゲーション)ECU402、オーディオECU403、空調ECU404、外部通信部(通信機器)405を含み、これらはバスBUSを介して入出力I/F30に接続されている)と、を有する。
The in-vehicle device operation system includes a display device 10, an input / output interface (input / output I / F) 20, a control device 20 (described later, but a display control device (symbol 21 in FIG. 5), and a process execution device (FIG. 5). 26), the signal interface (signal I / F) 40, 50, and the steering wheel (steering wheel) 3, and the user (here, the driver) has a finger (hand) Selection device (input device) 200 that can be operated by the user, the gaze detection unit 301 that detects the gaze of the user, and the voice detection unit 302 (these are examples of selecting menu items without using the selection device 200, for example). Used as the external device (in-vehicle device) 400 of the control device 20, various ECUs (in-vehicle ECU 401, navigation (navigation) ECU 402, audio ECU 4 3, the air conditioning ECU404, wherein the external communication unit (communication devices) 405, which have a and that) is connected to the input-output I / F30 through the bus BUS.
表示装置10は、実像及び虚像の画像の少なくとも一方を表示可能であり、ここでは、例えば、虚像を表示するHUD(ヘッドアップディスプレイ)装置を搭載するものとし、このHUD装置によって、ウインドシールド(フロントガラス等)2の虚像表示可能領域101(図中、破線の四角で示される)内に虚像を表示する。
The display device 10 can display at least one of a real image and a virtual image. Here, for example, it is assumed that a HUD (head-up display) device for displaying a virtual image is mounted. A virtual image is displayed in a virtual image displayable area 101 (shown by a dashed square in the figure) 2 of the glass etc.).
図1では、虚像としてのラジアルメニュー(ラジアル操作メニュー)500(V)が表示されている。なお、符号500(V)の「(V)」は、虚像であることを示している。
In FIG. 1, a radial menu (radial operation menu) 500 (V) as a virtual image is displayed. In addition, "(V)" of code | symbol 500 (V) has shown that it is a virtual image.
また、符号502は、ユーザーの指(手)の動き(選択装置200が検出する)に応じて位置が変化するポインタ(ここでは、時計の針のように、時計回りあるいは反時計回りに移動する)である。このポインタは、ラジアルメニュー(ラジアル操作メニュー)500(V)に含まれる複数の項目(操作項目)のうちの1つをポイント(指定)する機能をもつ。
Reference numeral 502 denotes a pointer whose position changes according to the movement of the user's finger (hand) (in this case, it moves clockwise or counterclockwise like a clock hand). ). The pointer has a function of pointing (specifying) one of a plurality of items (operation items) included in the radial menu (radial operation menu) 500 (V).
なお、表示装置10は、インストルパネル内又はインストルパネル上に設けられる表示パネル等の表示器を含んで構成されてもよい。
The display device 10 may be configured to include a display such as a display panel provided in or on the instrument panel.
ラジアルメニュー500(V)の表示処理において、必要に応じて、外部機器(車載機器)400から入力される各種の情報を用いることができる。
In the display processing of the radial menu 500 (V), various types of information input from the external device (in-vehicle device) 400 can be used as needed.
なお、外部機器(車載機器)400(車載ECU401、ナビECU402、オーディオECU403、空調ECU404、外部通信部(通信機器)405)は、外部機器情報を、バスBUSを介して入出力I/F30に送る。
The external device (in-vehicle device) 400 (in-vehicle ECU 401, navigation ECU 402, audio ECU 403, air conditioner ECU 404, external communication unit (communication device) 405) sends external device information to the input / output I / F 30 via the bus BUS. .
ここで、車載(車両)ECU401は、車両1の走行モード(ECOモード、SPORTモード)、平均燃費、走行可能距離(航続可能距離)、水温、油温などを出力可能である。制御装置20に含まれる表示制御装置(図2の符号21)は、上記の情報に基づき、車両1の走行モードを示したり、選択されることで走行モードを変更可能とする画像(選択画像)を表示したり、平均燃費、走行可能距離(航続可能距離)、水温、油温等を表示したりする。1つの項目が選択された場合には、さらに、車両1に関する詳細情報に関する項目をラジアルメニュー500内に表示してもよい。
Here, the on-vehicle (vehicle) ECU 401 can output the traveling mode (ECO mode, SPORT mode) of the vehicle 1, the average fuel consumption, the travelable distance (travelable distance), the water temperature, the oil temperature and the like. The display control device (symbol 21 in FIG. 2) included in the control device 20 indicates the traveling mode of the vehicle 1 based on the above information, or an image (selectable image) that enables the traveling mode to be changed by being selected. To display the average fuel consumption, the travelable distance (travelable distance), the water temperature, the oil temperature, etc. When one item is selected, an item regarding detailed information on the vehicle 1 may be further displayed in the radial menu 500.
ナビECU402は、次の分岐路の方向及び分岐路までの距離に関する情報や、車両1の経路付近に位置するオススメの経由地に関する施設情報や、これを経由した場合にロスする時間などの情報を出力可能である。制御装置10に含まれる表示制御装置(図2の符号21)は、上記の情報に基づき、例えば、次の分岐路の方向及び分岐路までの距離、経路案内のオン/オフを切り替える画像、オススメの経由地に関する施設情報、及び経由地を設定する画像等の少なくとも1つをメニューとして表示することができる。
The navigation ECU 402 information on the direction of the next branch and the distance to the branch, facility information on a recommended passing site located in the vicinity of the route of the vehicle 1, and information such as time lost when passing through this. It is possible to output. The display control device (symbol 21 in FIG. 2) included in the control device 10 is, for example, an image that switches the direction of the next branch path and the distance to the branch path, and turns on / off the route guidance, At least one of facility information related to the via point of the image, an image for setting the via point, and the like can be displayed as a menu.
オーディオECU403は、オススメの音楽に関する情報などを出力可能である。制御装置10に含まれる表示制御装置(図2の符号21)は、上記の情報に基づき、オススメの音楽(オーディオ)に関する情報や、楽曲を選択するための画像をメニューとして表示することができる。
The audio ECU 403 can output information about recommended music and the like. The display control device (symbol 21 in FIG. 2) included in the control device 10 can display information related to recommended music (audio) and an image for selecting music as a menu based on the above information.
空調ECU404は、現在の空調状態に関する情報等を出力可能である。制御装置10に含まれる表示制御装置(図2の符号21)は、上記の情報に基づき、現在の空調状態に関する情報や、空調状態を変更可能とする画像を表示することができる。
The air conditioning ECU 404 can output information and the like regarding the current air conditioning state. The display control device (symbol 21 in FIG. 2) included in the control device 10 can display information related to the current air conditioning state or an image that enables the air conditioning state to be changed, based on the above information.
外部通信部405は、着信状態やメール受信情報など、車両1の外部からの情報を出力可能である。制御装置10に含まれる表示制御装置(図2の符号21)は、上記の情報に基づき、着信があること、メール受信があることを示す情報、電話を受話する又はメールを音声で読ませることが可能な画像等をメニューとして表示することができる。
The external communication unit 405 can output information from the outside of the vehicle 1 such as an incoming state and mail reception information. Based on the above information, the display control device (symbol 21 in FIG. 2) included in the control device 10 is information indicating that there is an incoming call and that there is an e-mail reception, receiving a call or reading e-mail by voice. Can be displayed as a menu.
次に、図2を参照する。図2(A)は、選択装置(車載機器操作システムに用いられるポインティングデバイス)の外観を示す図、図2(B)は、図2(A)におけるA-A線に沿う断面構造を示す図である。
Next, FIG. 2 will be referred to. FIG. 2A is a view showing the appearance of a selection device (a pointing device used in a vehicle-mounted device operation system), and FIG. 2B is a view showing a cross-sectional structure along line AA in FIG. It is.
ここでは、選択装置(入力装置、あるいは操作装置と称することもある)200が、図1において示したラジアルメニュー500における項目を選択することに用いられることを想定して説明する。
Here, it is assumed that the selection device (sometimes referred to as an input device or an operation device) 200 is used to select an item in the radial menu 500 shown in FIG.
図2(A)に示されるように、選択装置(ポインティングデバイス)200は、ステアリングホイール3に配設され、ユーザーの指(ここでは、例えば親指とする)の位置(言い換えれば、操作位置C)を検出する操作位置検出部210と、この操作位置検出部210と一体となって設けられ、操作位置検出部210が親指で押されることで、ユーザーによって選択(決定)がなされたことを検出する決定操作検出部220と、リターン処理を行うときに使用されるリターンスイッチ230と、を有する。
As shown in FIG. 2A, the selection device (pointing device) 200 is disposed on the steering wheel 3, and the position of the user's finger (here, for example, a thumb) (in other words, the operation position C) Operation position detection unit 210 for detecting the movement position detection unit 210 and the operation position detection unit 210, and the operation position detection unit 210 is pressed by the thumb to detect that the user has made a selection (decision). It has a determination operation detection unit 220 and a return switch 230 used when performing return processing.
なお、上記の例では、選択装置200の操作を指(手)で行っているが、ユーザーの、その他の身体部位を用いてもよい。
In the above example, the operation of the selection device 200 is performed with a finger (hand), but another body part of the user may be used.
選択装置200は、ユーザーの親指等が操作面に触れた位置(操作位置C)を検出するタッチセンサであり、図2(B)に示すように、表面カバー211と、センサシート212と、スペーサ213と、を備える。選択装置200は、ユーザーが、親指等でその操作面上を触れる操作(以下、タッチ操作という)あるいは所定の軌跡を描くようになぞる操作(以下、ジェスチャ操作という)を行った際に、ユーザーの親指等が操作面に触れている位置(操作位置C)を検出し、ユーザーによる選択(決定)がなされると、その選択(決定)を検出して、例えば、選択(決定)がなされたことを示す信号(言い換えれば、選択(決定)検出信号)を出力する。
The selection device 200 is a touch sensor that detects a position (operation position C) at which the user's thumb or the like touches the operation surface, and as illustrated in FIG. 2B, the surface cover 211, the sensor sheet 212, and the spacer And 213. When the user performs an operation (hereinafter referred to as a touch operation) touching the operation surface with a thumb or the like (hereinafter referred to as a touch operation) or a tracing operation (hereinafter referred to as a gesture operation), the selection device 200 The position (operation position C) at which the thumb or the like touches the operation surface is detected, and when a selection (decision) is made by the user, the selection (decision) is detected, for example, the selection (decision) is made Is output (in other words, a selection (decision) detection signal).
選択装置200における表面カバー211は、合成樹脂等の遮光性の絶縁材料によってシート状に形成され、凸状断面の立体形状が、中心点Qを中心とする円の円周に沿って連続的に形成された凸部(凸領域)211a(図5(A)において、放射状の模様が付された領域)と、凸部(凸領域)211aに連接する比較的平坦な平坦部(平坦領域)211bと、を有する。凸部(凸領域)211aは、山状の断面(凸状断面)を有し、その山(凸形状)は、中心点Qに向かう方向(内側)に長く、その反対方向である外側に短い輪郭線(稜線)を有する。その山(凸形状)が、中心点Qを中心とする円の円周に沿って、連続的に設けられることで凸部(凸領域)211aが構成される。また、図5(B)に記載されるように、表面カバー211における凸部(凸領域)211aの下には、センサシート212が設けられており、これらを含む部分によって、上記の操作位置検出部210が構成される。ユーザーは、例えば、上記の凸部(凸領域)211aの、長手方向(中心点Qに向かう方向であり、言い換えれば内側方向)の斜面を指の触感で認識することにより、操作位置検出部210上における指のおおよその位置を認識することができ、選択装置200を見なくても、選択装置200を操作することができる。言い換えれば、ブラインド操作が可能となる。なお、上記の凸部(凸領域)211aが設けられない場合も想定され得るが、この場合でも、ユーザーが、中心点Qを中心とした円の円周に沿って手(指)の位置を移動させた場合、ユーザーは、自身が移動させた手(指)の軌跡(指等がタッチセンサの操作面に接触した位置の時間的変遷の跡)を知覚できることから、ユーザーは、自身の手の位置が、円の円周上のおおよそどの位置にあるかの見当をつけることができる。したがって、この場合でも、ブラインド操作が可能である。
The surface cover 211 in the selection device 200 is formed in a sheet shape by a light shielding insulating material such as a synthetic resin, and the three-dimensional shape of the convex cross section is continuously along the circumference of a circle centered on the central point Q. A relatively flat part (flat area) 211b connected to the formed convex part (convex area) 211a (an area having a radial pattern in FIG. 5A) and the convex part (convex area) 211a And. The convex portion (convex area) 211a has a mountain-shaped cross section (convex cross section), and the mountain (convex shape) is long in the direction (inward) toward the central point Q and short in the opposite direction, which is the outer side. It has an outline (edge line). The peaks (convex shape) are continuously provided along the circumference of a circle centered on the central point Q, whereby a convex portion (convex area) 211 a is configured. Further, as described in FIG. 5B, the sensor sheet 212 is provided under the convex portion (convex area) 211a in the surface cover 211, and the above-described operation position detection is performed by a portion including these. The unit 210 is configured. The user, for example, operates the operation position detection unit 210 by recognizing the slope in the longitudinal direction (the direction toward the center point Q, in other words, the inward direction) of the convex portion (convex area) 211a described above by the tactile sensation of a finger. The approximate position of the finger at the top can be recognized and the selection device 200 can be operated without looking at the selection device 200. In other words, blind operation is possible. In addition, although the case where the above-mentioned convex part (convex area) 211a is not provided may be assumed, also in this case, the user places the position of the hand (finger) along the circumference of a circle centered on the central point Q. When moved, the user can perceive the locus of the hand (finger) he / she moved (a trace of the temporal change of the position at which the finger or the like touches the operation surface of the touch sensor). You can get an idea of where you are on the circle's circumference. Therefore, even in this case, blind operation is possible.
センサシート212は、少なくとも凸部(凸領域)211aに対応する表面カバー211の裏面側において、中心点Qを中心とする円の円周に沿って配設され、ユーザーの指の操作位置Cを検出して、制御装置20(表示制御装置21)に、ユーザーの指等の操作位置Cに関する情報(操作位置の情報、あるいは操作位置を示す信号)を出力する。センサシート212は、例えば、絞り加工により表面カバー211と一体成形されることで、表面カバー211と同様の形状に加工される(図5(B)参照)。このように一体成形されることで、表面カバー211とセンサシート212は、一枚のシートのようになり、上記の凸部(凸領域)211aの段差形状は、その一枚のシートの曲がった部分(盛り上がった部分)で構成されることになる。また、このように一体成形されることで、表面カバー211の裏面とセンサシート212の表面とが当接する。これにより、表面カバー211の段差形状に対応して、センサシート212の検出部が配置されることになる。このように表面カバー211の段差形状に対応してセンサシート212の検出部が配置されているため、ユーザーの指等の移動が、凸部(凸領域)211a等の段差形状を有した操作面上で行われるものであっても、例えば表示制御装置21が、ユーザーの指の位置を検出することが可能である。
The sensor sheet 212 is disposed along the circumference of a circle centered on the central point Q at least on the back surface side of the surface cover 211 corresponding to the convex portion (convex area) 211a, and the operation position C of the user's finger is It detects and outputs information (information on the operation position or a signal indicating the operation position) regarding the operation position C of the user's finger or the like to the control device 20 (display control device 21). The sensor sheet 212 is processed into the same shape as the surface cover 211, for example, by being integrally formed with the surface cover 211 by drawing (see FIG. 5B). By integrally molding in this manner, the surface cover 211 and the sensor sheet 212 become like a sheet, and the step shape of the above-mentioned convex part (convex area) 211 a is the bending of the sheet. It will be composed of parts (the raised parts). Further, by integrally molding in this manner, the back surface of the surface cover 211 abuts on the surface of the sensor sheet 212. Thus, the detection portion of the sensor sheet 212 is disposed corresponding to the step shape of the front cover 211. As described above, since the detection portion of the sensor sheet 212 is arranged corresponding to the step shape of the surface cover 211, the operation surface of the user's finger or the like has a step shape such as a convex portion (convex area) 211a. Even if performed above, for example, the display control device 21 can detect the position of the user's finger.
スペーサ213は、センサシート212の裏面側に位置し、一体成形された表面カバー211とセンサシート212の形状に合わせて形成され、ユーザーの指等によって、表面カバー211が表側から押圧された際に、上記の形状を保持する部材である。
The spacer 213 is located on the back surface side of the sensor sheet 212 and is formed in accordance with the shape of the integrally formed surface cover 211 and the sensor sheet 212, and when the surface cover 211 is pressed from the front side by the user's finger or the like. , It is a member holding the above-mentioned shape.
決定操作検出部220は、操作位置検出部210の裏面側に複数(図2(B)の例では5個)設けられる。決定操作検出部220は、制御装置20(表示制御装置21を含む)と電気的に接続されており、ユーザーが、操作位置検出部210の操作面(表面カバー211の凸部(凸領域))211aを押下する操作(以下、押下操作という)を行うと、決定操作検出部220が押され、これによって、ユーザーによって選択(決定)がなされたことが検出され、選択(決定)がなされたことを示す信号(選択(決定)検出信号)が出力される。出力された選択(決定)検出信号は、制御装置20(表示制御装置21を含む)に送られる。表示制御装置21は、送られてきた選択(決定)検出信号に基づき、例えば、ラジアルメニュー500に含まれる複数の項目のうちのどの項目が選択されたかを判定し、その選択に応じた操作メニュー画像を生成し、表示装置10に表示する。これによって、選択された項目の内容に応じて、操作メニューの表示が切り替えられる。
A plurality (five in the example of FIG. 2B) of the determination operation detection units 220 are provided on the back surface side of the operation position detection unit 210. The determination operation detection unit 220 is electrically connected to the control device 20 (including the display control device 21), and the user operates the operation surface of the operation position detection unit 210 (convex portion (convex area) of the surface cover 211) When an operation to press 211 a (hereinafter referred to as a press operation) is performed, the decision operation detection unit 220 is pressed, whereby it is detected that the user has made a selection (decision) and the selection (decision) has been made. A signal (a selection (decision) detection signal) indicating. The output selection (decision) detection signal is sent to the control device 20 (including the display control device 21). The display control device 21 determines which of a plurality of items included in the radial menu 500 has been selected, for example, based on the selection (decision) detection signal sent, and an operation menu corresponding to the selection. An image is generated and displayed on the display device 10. Thus, the display of the operation menu is switched according to the content of the selected item.
リターンスイッチ230は、操作位置検出部210及び決定操作検出部220とは離れた位置にあるスイッチである。ユーザーが、リターンスイッチ230の操作面を押下する(言い換えれば、押下操作がなされる)と、制御装置20内の表示制御装置21にリターン信号が送信される。表示制御装置21は、リターンスイッチ230からのリターン信号に基づき、ラジアルメニュー500の表示を、直近の過去の操作メニュー画像に戻す。言い換えれば、直前の表示への切り替えが行われる。
The return switch 230 is a switch located at a distance from the operation position detection unit 210 and the determination operation detection unit 220. When the user presses the operation surface of the return switch 230 (in other words, the pressing operation is performed), a return signal is transmitted to the display control device 21 in the control device 20. The display control device 21 returns the display of the radial menu 500 to the latest past operation menu image based on the return signal from the return switch 230. In other words, switching to the immediately preceding display is performed.
次に、図3を参照する。図3(A)は、図1の車載機器操作システムにおける、制御装置及び車両用操作メニュー表示制御装置(表示制御装置)の、より具体的な構成例を示す図、図3(B)は、操作メニュー画像生成部の構成例を示す図、図3(C)は、表示装置の構成例を示す図である。
Next, FIG. 3 will be referred to. FIG. 3A is a view showing a more specific configuration example of the control device and the operation menu display control device for a vehicle (display control device) in the in-vehicle device operation system of FIG. 1 and FIG. FIG. 3C is a view showing an example of the configuration of an operation menu image generation unit, and FIG. 3C is a view showing an example of the configuration of a display device.
図3(A)において、制御装置20は、表示制御装置(車両用操作メニュー表示制御装置)21と、処理実行装置26と、を有し、必要に応じて、記憶装置(不図示)に、動作ルーチンファイル27が記憶される。
In FIG. 3A, the control device 20 has a display control device (vehicle operation menu display control device) 21 and a process execution device 26, and, if necessary, a storage device (not shown), The operation routine file 27 is stored.
表示制御装置(車両用操作メニュー表示制御装置)21は、操作メニュー画像生成部22と、操作メニュー表示処理部24と、を有しており、必要に応じて、記憶装置(不図示)内にメニューファイル25が記憶される。
The display control device (vehicle operation menu display control device) 21 has an operation menu image generation unit 22 and an operation menu display processing unit 24 and, if necessary, in a storage device (not shown). A menu file 25 is stored.
上記の制御装置20の各構成は、例えば、記憶装置(不図示)に格納されているOS(オペレーティングシステム)等に搭載されるGUI(グラフィカルユーザーインターフェース)プログラムに従ってCPUやMPU(コンピュータ:不図示)が動作することで実現することができる。
Each configuration of the control device 20 described above is, for example, a CPU or MPU (computer: not shown) according to a GUI (Graphical User Interface) program installed in an OS (Operating System) etc. stored in a storage device (not shown) Can be realized by operating.
表示制御装置(車両用操作メニュー表示制御装置)21における操作メニュー画像生成部22は、操作メニュー画像を生成する。例えば、予め用意されている複数のメニューファイル25の中から使用可能なものを取り出し(読み出し)、必要な情報を画像合成で組み込むことで、複数の操作項目を含むメニュー(操作メニュー)の画像を生成する。但し、これに限定されるものではなく、記憶部(不図示)に予め記憶された配列、又は記憶部(不図示)に記憶されたプログラムにより定められた配列に従って、複数の項目を配置する(項目を画像合成する)ことで、メニュー(操作メニュー)の画像を生成してもよく、あるいは、レンダリングにより画像を生成してもよい。生成された画像は、画像RAM(不図示)等に、一旦、蓄積される。
The operation menu image generation unit 22 in the display control device (vehicle operation menu display control device) 21 generates an operation menu image. For example, by taking out (read out) usable ones from a plurality of menu files 25 prepared in advance and incorporating necessary information in image synthesis, an image of a menu (operation menu) including a plurality of operation items is obtained. Generate However, the present invention is not limited to this, and a plurality of items are arranged according to an array stored in advance in a storage unit (not shown) or an array defined by a program stored in a storage unit (not shown) An image of a menu (operation menu) may be generated by image combining of items, or an image may be generated by rendering. The generated image is temporarily stored in an image RAM (not shown) or the like.
なお、表示制御装置(車両用操作メニュー表示制御装置)21は、外部機器400(車載ECU401、ナビECU402、オーディオECU403、空調ECU404、外部通信部(通信機器)405)からの情報を使用して画像を生成することができ、あるいは、その情報を使用せずに、記憶部(不図示)に予め記憶された画像データのみに基づき画像を生成してもよい。これによって、例えば、図1で示したラジアルメニュー500(V)の元となる画像(元画像)を生成することができる。
The display control device (vehicle operation menu display control device) 21 is an image using information from the external device 400 (in-vehicle ECU 401, navigation ECU 402, audio ECU 403, air conditioning ECU 404, external communication unit (communication device) 405). Alternatively, without using the information, an image may be generated based only on image data stored in advance in a storage unit (not shown). Thereby, for example, an image (original image) which is the source of the radial menu 500 (V) shown in FIG. 1 can be generated.
表示制御装置(車両用操作メニュー表示制御装置)21は、具体的には、階層構造を有すると共に、1つの階層の画像に複数の操作項目が含まれる操作メニューの表示を制御するものであり、上述のとおり、操作メニューの画像を生成する操作メニュー画像生成部22と、生成された操作メニューの画像の表示処理を行う操作メニュー表示処理部24と、を有する。
Specifically, the display control device (vehicle operation menu display control device) 21 has a hierarchical structure and controls the display of an operation menu in which a plurality of operation items are included in an image of one layer, As described above, the operation menu image generation unit 22 generates an image of the operation menu, and the operation menu display processing unit 24 performs display processing of the generated image of the operation menu.
操作メニュー画像生成部22は、第n階層(nは3以上の自然数)の操作メニューにて最終選択がなされ、操作メニューの表示が第m(mはn-2の自然数)階層の操作メニュー(m=1の例では、第1階層の初期メニュー)に復帰した後、直近の過去の選択と同一の項目が選択されると、第(m+1)(m=1の例では、第2)~第(n-1)階層の操作メニューの画像生成(およびその表示)を省略して、第n階層の操作メニューの画像を生成する。また、操作メニュー画像生成部22は、第n階層の操作メニューに、上位階層のメニューに含まれていた少なくとも1つの項目をショートカット用項目として含ませることもできる。これらの点については、後述する。
Operation menu image generation unit 22 is finally selected in the operation menu of the n-th hierarchy (n is a natural number of 3 or more), and the display of the operation menu is the operation menu of the m-th (m is a natural number of n-2) hierarchy In the example of m = 1, after returning to the initial menu of the first hierarchy, if the same item as the most recent past selection is selected, the (m + 1) (in the example of m = 1, the second) to The image generation (and its display) of the operation menu of the (n−1) -th layer is omitted, and the image of the operation menu of the n-th layer is generated. In addition, the operation menu image generation unit 22 can also include at least one item included in the menu of the upper hierarchy in the operation menu of the n-th hierarchy as an item for shortcut. These points will be described later.
図3(A)における操作メニュー表示処理部24は、画像RAM(不図示)等から、生成された画像(画像データ)を読み出し、データ形式を整えたり、表示に必要な情報を付加したりし、その結果として得られた画像データを表示装置10に送る。
The operation menu display processing unit 24 in FIG. 3A reads out the generated image (image data) from an image RAM (not shown) or the like, adjusts the data format, and adds information necessary for display. The image data obtained as a result is sent to the display device 10.
表示される車両用操作メニューは、階層構造を有しており、選択された1つの項目に関連付けされた下位階層のメニューがある場合は、その下位階層のメニューが順次、表示される。下位階層のない項目が選択されると、例えば、操作メニュー画像生成部22から処理実行装置26に、最終的に選択された項目の内容を示す情報が送られる。処理実行装置26は、例えば、動作ルーチンファイル27を参照して、実行すべき処理の具体的な内容を示すデータを取得し(但し、この動作は不要な場合もあり得る)、取得したデータを、入出力I/F30及びバスBUSを経由して、外部機器(車載機器)400に送る。これによって、ユーザーによって選択された項目に関連付けられている処理が実行される。
The displayed vehicle operation menu has a hierarchical structure, and when there is a lower hierarchy menu associated with one selected item, the lower hierarchy menus are sequentially displayed. When an item having no lower hierarchy is selected, for example, information indicating the content of the finally selected item is sent from the operation menu image generation unit 22 to the processing execution device 26. The process execution unit 26 refers to the operation routine file 27, for example, to acquire data indicating the specific content of the process to be executed (however, this operation may not be necessary), and the acquired data is , To the external device (in-vehicle device) 400 via the input / output I / F 30 and the bus BUS. This causes the process associated with the item selected by the user to be performed.
次に、図3(B)を参照する。図3(B)に示されるように、操作メニュー画像生成部22は、最終選択判定部600と、制御処理部610と、タイマー620と、選択履歴記憶部630と、画像生成処理部640と、を有する。ここで、選択履歴記憶部630は、第m階層での直近の過去の選択との同一性判定部(以下、単に、同一性判定部と称する場合がある)632を含む。
Next, FIG. 3B will be referred to. As shown in FIG. 3B, the operation menu image generation unit 22 includes a final selection determination unit 600, a control processing unit 610, a timer 620, a selection history storage unit 630, and an image generation processing unit 640. Have. Here, the selection history storage unit 630 includes an identity determination unit (hereinafter, may be simply referred to as an identity determination unit) 632 with the latest selection in the m-th hierarchy.
最終選択判定部600は、ユーザーによって行われた項目の選択が、最終選択であるか否かを判定する。
The final selection determination unit 600 determines whether the selection of the item made by the user is the final selection.
また、選択履歴記憶部630に含まれる、第m階層での直近の過去の選択との同一性判定部632は、第m階層の操作メニューで選択された操作項目が、直近の過去において、第m階層の操作メニューで選択された操作項目と同じであったか否かを判定する。
In addition, the sameness judging unit 632 included in the selection history storage unit 630 with the latest past selection in the m-th hierarchy determines that the operation item selected in the operation menu in the m-th hierarchy is the most recent in the past. It is determined whether it is the same as the operation item selected in the operation menu of the m hierarchy.
制御処理部610は、例えば、最終選択判定部600、及び第1階層での直近の過去の選択との同一性判定部632の各判定結果に基づいて、どの階層の操作メニュー画像を生成させるかを決定してもよく、また例えば、最終選択判定部600、及び第1階層での直近の過去の選択との同一性判定部632の各判定結果に基づいて、ユーザーの意思確認画像(後述)を生成させるか否かを決定し、ユーザーの意思確認画像を生成させた場合には、その生成の後に行われるユーザーの選択に基づいて、どの階層の操作メニュー画像を生成させるかを決定してもよい。
The control processing unit 610 generates an operation menu image of which layer based on each determination result of the final selection determination unit 600 and the identity determination unit 632 with the latest selection in the first hierarchy, for example For example, based on the determination results of the final selection determination unit 600 and the identity determination unit 632 with the most recent past selection in the first layer, the user's intention confirmation image (described later) If the user's intention confirmation image is generated, it is determined which hierarchical operation menu image is to be generated based on the user's selection made after the generation. It is also good.
具体例としては、操作メニュー画像生成部22に含まれる制御処理部610は、直近の過去において、第m階層の操作メニューで選択された操作項目と同じである操作項目についての選択(現在の選択)が、第n階層における最終選択のタイミングから所定時間内である所定期間において行われる場合にのみ、第(m+1)階層乃至第(n-1)階層の操作メニューの画像の生成を省略して(言い換えれば、ショートカットして)、第n階層の操作メニューの画像を生成することを決定することができる。
As a specific example, the control processing unit 610 included in the operation menu image generation unit 22 selects (current selection) an operation item that is the same as the operation item selected in the operation menu of the m-th hierarchy in the most recent past. Is omitted from the generation of the image of the operation menu of the (m + 1) th layer to the (n-1) th layer only when the) is performed in a predetermined period which is within a predetermined time from the timing of final selection in the nth layer It can be decided (in other words, by shortcut) to generate an image of the operation menu of the nth hierarchy.
画像生成処理部640は、制御処理部610の決定に基づいて、操作メニュー画像の生成処理を行う。
The image generation processing unit 640 generates an operation menu image based on the determination of the control processing unit 610.
次に、図2(C)を参照する。図2(C)に示されるように、表示装置10は、虚像の画像を表示するHUD装置500、及び実像の画像を表示する表示器600の少なくとも一方を含むことができる。なお、HUD装置500は光源502を有しており、例えば、この光源502の光強度が、画像データに基づいて画素単位で変調されることで、スクリーン(不図示)上に画像が表示され、その画像の表示光が、投射光学系(不図示)を介して、図1のウインドシールド(光の一部を透過し、一部を反射する性質をもつ部材)1に投射されることで、例えば、図1で示したラジアルメニュー500(V)が表示される。
Next, FIG. 2C will be referred to. As shown in FIG. 2C, the display device 10 can include at least one of a HUD device 500 that displays an image of a virtual image and a display 600 that displays an image of a real image. The HUD device 500 includes a light source 502. For example, the light intensity of the light source 502 is modulated in pixel units based on image data to display an image on a screen (not shown). The display light of the image is projected onto the windshield (a member having the property of transmitting a part of light and reflecting a part) 1 via a projection optical system (not shown), For example, the radial menu 500 (V) shown in FIG. 1 is displayed.
次に、図4を参照する。図4(A)~図4(F)は、n層(ここではn=3とする)の階層構造を有する操作項目メニューにおける、表示の遷移の一例を示す図、図4(G)~図4(J)は、表示の遷移の他の例を示す図である。
Next, FIG. 4 will be referred to. FIGS. 4A to 4F are diagrams showing an example of display transition in an operation item menu having a hierarchical structure of n layers (here, n = 3), and FIGS. 4G to 4G. 4 (J) is a figure which shows the other example of the transition of a display.
まず、図4(A)~図4(C)の例について説明する。図4(A)に示すように、最上位の階層である第1階層の操作メニューの画像は、メニュー全体の表示領域は所定の外形(ここでは、縦長の長方形)を有し(なお、他の階層でも、この外形は維持されるものとする)、そのメニュー全体の表示領域中に、「A」、「B」の2つの操作項目が表示される。図4(A)では、操作項目「B」が選択されるものとする。
First, examples of FIGS. 4A to 4C will be described. As shown in FIG. 4A, in the image of the operation menu of the first hierarchy which is the highest hierarchy, the display area of the entire menu has a predetermined outer shape (here, a vertically-long rectangle) This outline is maintained even in the hierarchy of (1), and two operation items "A" and "B" are displayed in the display area of the entire menu. In FIG. 4A, it is assumed that the operation item "B" is selected.
これによって、操作メニューは第2階層に遷移し、図4(B)のように、「C」、「D」、「E」の3つの操作項目が表示される。ここでは、操作項目「C」が選択されるものとする。
As a result, the operation menu changes to the second hierarchy, and three operation items of “C”, “D”, and “E” are displayed as shown in FIG. 4 (B). Here, it is assumed that the operation item "C" is selected.
これによって、操作メニューは第3階層に遷移し、図4(C)のように、「F」、「G」、「H」、「I」の4つの操作項目が表示される。ここで、操作項目「G」が選択され、これが最終選択となって、操作項目「G」に関連付けられた処理が実行されると共に、操作メニューの表示は、第1階層の表示へと戻る(図4(E))。
As a result, the operation menu changes to the third hierarchy, and four operation items of “F”, “G”, “H”, and “I” are displayed as shown in FIG. 4C. Here, the operation item "G" is selected, and this is the final selection, and the processing associated with the operation item "G" is executed, and the display of the operation menu returns to the display of the first hierarchy ((1) Fig. 4 (E)).
図4(E)において、ユーザーが、例えば、図4(C)の操作項目「G」を選択(最終選択)した時点から所定時間内である所定期間において、再度、直近の過去の選択(ここでは、図4(A)における選択)と同一の項目(ここでは項目「B」)について選択したとする。
In FIG. 4E, for example, the user selects the last past selection again in a predetermined period that is within a predetermined time from when the operation item “G” in FIG. 4C is selected (final selection). In this case, it is assumed that the same item (here, item “B”) as the selection in FIG. 4 (A) is selected.
この場合、その2度目の選択は、直前の最終選択に関連する選択である(例えば、最終選択の内容を訂正しようとして再操作されるものである、あるいは、最終選択の内容が何であったかが不明であることによる不安感を払拭するために再操作されるものである等)という可能性が高いことから、ユーザーが冗長的な操作をしなくてもよいように、第(m+1)階層(ここでは第2階層)を省略して、直近の最終選択がなされた階層である第n階層(ここでは第3階層)の操作メニューが表示される(図4(F)参照)。言い換えれば、第m階層(ここでm=1)から第n階層(ここでn=3)へのショートカットが実施される。
In this case, the second selection is the selection associated with the previous last selection (e.g., one to be re-operated to correct the content of the last selection, or it is unclear what the content of the last selection was And the (m + 1) -th layer (here, so that the user does not have to perform redundant operations). Then, the operation menu of the n-th hierarchy (here, the third hierarchy), which is the hierarchy for which the last selection is made, is displayed with the second hierarchy) omitted (see FIG. 4F). In other words, a shortcut from the m-th hierarchy (here m = 1) to the n-th hierarchy (here n = 3) is implemented.
よって、ユーザーが、第n階層の階層メニューを再表示させて、直近の過去に選択した項目とは異なる項目を選択しようとする場合等において、ユーザーは、第n階層の操作メニューに至るまでに、各階層の操作メニューを表示して選択をするという、従来の冗長な操作をする必要がない。言い換えれば、直接的(かつ直観的)に、目的とする操作項目を含む操作メニュー画像を表示させて、その項目を選択できることから、迅速で効率的な項目の選択が可能となる。
Therefore, in the case where the user redisplays the hierarchy menu of the nth hierarchy and tries to select an item different from the item selected in the last past, etc., the user reaches the operation menu of the nth hierarchy. There is no need to perform the conventional redundant operation of displaying and selecting the operation menu of each hierarchy. In other words, since the operation menu image including the target operation item can be displayed directly (and intuitively) and the item can be selected, quick and efficient item selection becomes possible.
次に、図4(G)~図4(J)の例について説明する。この例では、第m階層から第n階層へのショートカットを実施する前に、ユーザーが、ユーザー意思確認画像を生成して表示し、ユーザーに、第n階層の操作メニューの操作項目を選択する第1の選択をしたいのか、第n階層以外の階層の操作メニューの操作項目を選択する第2の選択をしたいのかを、ユーザーに選ばせることで、ユーザーの意思を確認することができる。よって、ショートカットによって生じる不都合(ユーザーが望む階層の操作メニューがスキップされて表示されないこと)を、確実に回避することが可能となる。
Next, examples of FIG. 4 (G) to FIG. 4 (J) will be described. In this example, before performing the shortcut from the mth layer to the nth layer, the user generates and displays a user intention confirmation image and selects the operation item of the operation menu of the nth layer to the user. The user's intention can be confirmed by having the user select whether he / she wants to select 1 or select the second selection to select the operation item of the operation menu of the hierarchy other than the n-th hierarchy. Therefore, it is possible to reliably avoid the inconvenience caused by the shortcut (the operation menu of the hierarchy desired by the user is skipped and not displayed).
図4(G)は、図4(E)と同じである。図4(H)は、ユーザー意思確認画像の例を示している。図4(H)の例では、「最終選択項目G」という項目(第1の選択用項目:これは、最終選択項目Gに関連する選択を行いたいのかを確認するための項目である))と、「その他」という項目(第2の選択用項目:これは、最終選択とは関係のない選択を行いたいのかを確認するための項目である)とを、同時に表示している。ユーザー自身にいずれかを選択させることで、意に沿わないショートカットが行われることを防止することができる。
FIG. 4 (G) is the same as FIG. 4 (E). FIG. 4H shows an example of the user intention confirmation image. In the example of FIG. 4 (H), the item "final selection item G" (first selection item: this is an item for confirming whether or not to make a selection related to the final selection item G)) And the item "other" (second selection item: this is an item for confirming whether or not to make a selection unrelated to the final selection) are displayed at the same time. By having the user select one, it is possible to prevent an unintended shortcut from being performed.
図4(H)において、ユーザーが、「最終選択項目G」という項目(第1の選択用項目)を選択した場合は、表示される操作メニューは、図4(I)のように、第n階層(ここでは、n=3)の表示へと遷移する。また、ユーザーが、「その他」という項目(第2の選択用項目)を選択した場合は、表示される操作メニューは、図4(J)のように、第(m+1)階層(ここでは、m=1)の表示へと遷移する。
In FIG. 4 (H), when the user selects the item (first selection item) “final selection item G”, the operation menu to be displayed is the n-th one as shown in FIG. 4 (I). It changes to the display of a hierarchy (here, n = 3). In addition, when the user selects the item “other” (second selection item), the operation menu displayed is the (m + 1) -th hierarchy (here, m as shown in FIG. 4J). It changes to the display of = 1).
次に、図5を参照する。図5(A)~図5(J)は、n層(ここではn=3とする)の階層構造を有する操作項目メニューにおける、表示の遷移の、さらに他の例を示す図である。
Next, FIG. 5 will be referred to. FIGS. 5A to 5J are diagrams showing yet another example of display transition in an operation item menu having a hierarchical structure of n layers (here, n = 3).
図5(A)では、操作項目Bが選択される。なお、図5(A)における符号ZN1は、選択された操作項目Bの表示領域(円の外形をもつ)である。図5(B)では、図5(A)の、表示領域ZN1に相当する表示領域ZN2(同じ形状、同じサイズであり、かつ同じ位置にある)が3分割され、上側、左下側、右下側の3つの扇形の領域が形成される。上側の領域は、現在選択されているのが操作項目Bであることを示す「選択履歴項目」である項目Bが配置され、左下側、右下側の各領域には、第2階層の正規(本来)の操作項目である項目「α」、「β」が配置されている。また、領域ZN2に隣接して、第1のショートカット用項目(SC用項目1と記載されている)である項目A(図5(B)において、Aという文字を破線の丸で囲って示している。この点は以下同様である)が配置されている。図5(B)では、操作項目「β」が選択される。
In FIG. 5A, the operation item B is selected. In addition, the code | symbol ZN1 in FIG. 5 (A) is a display area (it has the outline of a circle | round | yen) of the selected operation item B. FIG. In FIG. 5B, a display area ZN2 (having the same shape, the same size, and the same position) corresponding to the display area ZN1 of FIG. 5A is divided into three, upper side, lower left side, lower right side Three fan-shaped areas on the side are formed. In the upper area, an item B which is a “selection history item” indicating that the currently selected item is the operation item B is arranged, and in each of the lower left and lower right areas, the second hierarchy of Items “α” and “β” which are operation items of (intrinsic) are arranged. Further, adjacent to the area ZN2, the letter A is enclosed by a broken line circle in the item A (FIG. 5B) which is the first shortcut item (described as the item 1 for SC). The same applies in the following. In FIG. 5B, the operation item "β" is selected.
図5(C)に置いても同様に、領域ZN2に相当する領域ZN3が3分割されており、上側の扇形の領域に選択履歴を示す項目βが配置され、左下側の扇形の領域に、第2のショートカット用項目(SC用項目2)である項目αが配置され、右下側の扇形の領域に、第3階層の正規(本来)の項目である項目θが配置されている。また、領域ZN3の下側に隣接して、正規(本来)の項目μが配置されている。図5(C)では、操作項目「θ」が選択されるものとし、これが最終選択となり、操作メニューの表示は、自動的に第1階層の表示に戻る(図5(E))。
Similarly, even in FIG. 5C, the area ZN3 corresponding to the area ZN2 is divided into three, the item β indicating the selection history is arranged in the upper fan-shaped area, and the fan-shaped area in the lower left side is An item α, which is a second shortcut item (item 2 for SC), is arranged, and an item θ, which is a normal (intrinsic) item of the third hierarchy, is arranged in a sector on the lower right side. Further, a normal (intrinsic) item μ is disposed adjacent to the lower side of the area ZN3. In FIG. 5C, it is assumed that the operation item “θ” is selected, which is the final selection, and the display of the operation menu automatically returns to the display of the first hierarchy (FIG. 5E).
図5(E)において、例えば、最終選択から所定時間内に、図5(A)と同様に操作項目「B」が選択された場合は、第2階層の操作メニューの表示が省略されて、第3階層の操作メニューが表示される(図5(F):第1回目のショートカットSC1)。
In FIG. 5E, for example, when the operation item "B" is selected as in FIG. 5A within a predetermined time from the final selection, the display of the operation menu of the second hierarchy is omitted, The operation menu of the third hierarchy is displayed (FIG. 5 (F): first shortcut SC1).
ここで、先の最終選択(項目「θ」の選択)が誤りであり、ユーザーが、項目「μ」を選択するのであれば、第1回目のショートカットSC1は成功したことになるが、例えば、ユーザーが、第2階層(図5(B))における項目「α」を選択したかったのであれば、第1回目のショートカットSC1は失敗であったということになる。
Here, if the previous final selection (selection of the item “θ”) is an error and the user selects the item “μ”, the first shortcut SC1 will be successful, for example, If the user wants to select the item “α” in the second hierarchy (FIG. 5 (B)), it means that the first shortcut SC1 has failed.
失敗の場合、通常ならば、ユーザーはリターンボタン(図2の符号230)を押して第2階層に戻って、目的とする項目「α」を選択する必要がある。
In the case of failure, normally, the user needs to press the return button (reference numeral 230 in FIG. 2) to return to the second hierarchy to select the target item “α”.
しかし、図5(F)における第3階層の操作メニューには、第2のショートカット用項目(SC用項目2)が含まれている。よって、図5(G)にて、第2のショートカット用項目(SC用項目2)を選択することで、リターンボタンを用いて操作を省いて、図5(H)の操作メニューの表示(第2階層で項目αを選択した場合の第3階層の表示)に遷移させることができる(第2回目のショートカットSC2)。
However, the second shortcut item (item 2 for SC) is included in the operation menu of the third hierarchy in FIG. 5 (F). Therefore, by selecting the second shortcut item (item 2 for SC) in FIG. 5G, the operation is omitted using the return button, and the display of the operation menu in FIG. It is possible to transit to the display of the third hierarchy when the item α is selected in the second hierarchy) (second shortcut SC2).
言い換えれば、図5(E)から図5(F)の遷移(第1回目のショートカットSC1)の後、連続して、図5(G)から図5(H)への遷移(第2回目のショートカットSC2)が行われることで、従来にない、ダイナミックで、かつスピード感のある選択が実現さ
れる。 In other words, after the transition (first shortcut SC1) from FIG. 5 (E) to FIG. 5 (F), the transition from FIG. 5 (G) to FIG. 5 (H) (second time) By performing the shortcut SC2), an unprecedented dynamic and speedy selection is realized.
れる。 In other words, after the transition (first shortcut SC1) from FIG. 5 (E) to FIG. 5 (F), the transition from FIG. 5 (G) to FIG. 5 (H) (second time) By performing the shortcut SC2), an unprecedented dynamic and speedy selection is realized.
このように、図5の例では、第n階層(ここでは、n=3)の操作メニューに、上位階層(例えば、直前の第(n-1)階層)の操作メニューに含まれていた少なくとも1つの操作項目をショートカット用項目として含ませておく。ユーザーの意に沿わないショートカット(第m階層(ここではm=1)から第n階層へのショートカット)が行われてしまった場合、ユーザーがそのショートカット用項目を選択することで、上位階層へと戻る操作を省略して、目的とする項目をただちに選択できる可能性があり、これは、意に沿わないショートカット(第m階層から第n階層へのショートカット)が行われてしまった場合の対策の1つとなり得るものである。
Thus, in the example of FIG. 5, at least the operation menu included in the upper hierarchy (for example, the (n-1) th hierarchy immediately before) is included in the operation menu of the nth hierarchy (here, n = 3). One operation item is included as a shortcut item. If a shortcut (m-th hierarchy (m = 1 here) to n-th hierarchy shortcut) that does not conform to the user's intention has been performed, the user selects an item for the shortcut to go to the upper hierarchy. There is a possibility that it is possible to immediately select the target item by omitting the return operation, which is a countermeasure against the case where a shortcut (shortcut from the m-th layer to the n-th layer) is not performed. It can be one.
次に、図6を参照する。図6は、表示制御処理(車両用操作メニュー表示制御処理)の主要な手順の一例を示すフローチャートである。ここでは、図4に示される形式の表示制御が行われる場合を想定する。
Next, FIG. 6 will be referred to. FIG. 6 is a flowchart showing an example of the main procedure of the display control process (vehicle operation menu display control process). Here, it is assumed that display control of the type shown in FIG. 4 is performed.
まず、第m階層の操作メニューを表示し(ステップS1)、項目が選択されると(ステップS2)、選択された項目(操作項目)に対応する、次の下位階層のメニューを生成して表示する(ステップS3)。
First, the operation menu of the m-th hierarchy is displayed (step S1), and when an item is selected (step S2), the menu of the next lower hierarchy corresponding to the selected item (operation item) is generated and displayed (Step S3).
続いて項目が選択されると(ステップS4)、その選択が最終選択であるか否か(言い換えれば、その項目に関連付けられた下位階層の有無)が判定され、最終選択でない場合(ステップS5でNの場合)は、ステップS3に戻り、最終選択である場合(ステップS5でYの場合)は、第m階層の操作メニューの表示に戻る(ステップS6)。
Subsequently, when an item is selected (step S4), it is determined whether or not the selection is the final selection (in other words, the presence or absence of the lower hierarchy associated with the item). In the case of N), the process returns to step S3, and in the case of final selection (in the case of Y in step S5), the process returns to the display of the operation menu of the m-th hierarchy (step S6).
なお、第m階層の操作メニューの表示は、最終選択の終了後すぐに開始されてもよく、終了後に所定時間経過してから開始されてもよく、又はユーザーによる選択装置の操作が検出されたことで開始されてもよい。
Note that the display of the operation menu of the m-th hierarchy may be started immediately after the end of the final selection, may be started after a predetermined time has elapsed after the end, or the operation of the selection device by the user is detected It may be started by
その後、項目の選択がなされると(ステップS7)、次に、第m階層での、直近の過去の選択と同一の選択(かつ、所定期間内での選択)であるか否かが判定される(ステップS8)。ステップS8でNの場合はステップS3に戻り、Yの場合は、ステップS9に移行する。
After that, when the item is selected (step S7), it is then determined whether or not the selection is the same as the latest selection in the m-th hierarchy (and the selection in a predetermined period). (Step S8). If N in step S8, the process returns to step S3. If Y, the process proceeds to step S9.
ステップS9では、直近の最終選択がなされた第n階層のメニューを表示(中間階層表示を省略)する、又は、直近の最終選択がなされた第n階層の項目とは異なる項目を選択したいのか、同じ階層の項目を選択したいのかをユーザーに選ばせるための画像(ユーザーの意思確認画像)を表示する。
In step S9, display the menu of the n-th hierarchy in which the last selection is made last (do not display the middle hierarchy), or do you want to select an item different from the item in the n-th hierarchy in which the last selection was made last, Display an image (user's confirmation image) to make the user select whether to select an item in the same hierarchy.
次に、図7、図8を参照する。図7(A)は、ラジアル操作メニューにおける、第1階層(最上位階層)の操作メニュー例を示す図、図7(B)は、第2階層の操作メニュー例を示す図である。図8(A)は、ラジアル操作メニューにおける、第3階層の操作メニュー例を示す図、図8(B)は、第3階層の操作メニューの他の例を示す図である。
Next, FIG. 7 and FIG. 8 will be referred to. FIG. 7A is a diagram showing an example of an operation menu of the first hierarchy (upper hierarchy) in the radial operation menu, and FIG. 7B is a diagram showing an example of an operation menu of the second hierarchy. FIG. 8A shows an example of the operation menu of the third layer in the radial operation menu, and FIG. 8B shows another example of the operation menu of the third layer.
図7(A)、図7(B)及び図8(A)は、先に図4(A)~図4(F)を用いて説明した階層表示形式を、ラジアルメニュー(ラジアル操作メニュー)に適用した場合の具体例を示している。また、図8(B)は、先に図5(A)~図5(H)を用いて説明した階層表示形式(下位階層のメニューに、上位階層で表示した項目をショートカット用項目として含ませておく表示形式)を、ラジアルメニュー(ラジアル操作メニュー)に適用した場合の具体例を示している。
FIGS. 7A, 7B, and 8A show the hierarchical display format described above with reference to FIGS. 4A to 4F in the radial menu (radial operation menu). The example of the case of applying is shown. Further, FIG. 8B shows the hierarchical display format described earlier with reference to FIGS. 5A to 5H (in the menu of the lower hierarchy, the item displayed in the upper hierarchy is included as a shortcut item). 7 shows a specific example in which the display format is applied to a radial menu (radial operation menu).
なお、ラジアルメニューとは、原点を有し、原点から外側に向かう複数の放射状の直線によって、メニューの表示領域が区画されてなるメニューであり、一般には、円(又は楕円)の外形を有する。
The radial menu is a menu having an origin and a display area of the menu divided by a plurality of radial straight lines extending outward from the origin, and generally has a circular (or elliptical) outer shape.
ラジアルメニューは、例えば円を細分化する(例えば、扇形や楔(くさび)形の領域に分割する)ことで、多数の項目を、コンパクトにバランスよく配置することができる。近年、IOT(物のインターネット)の活用によって、車両1の運転者(ユーザー)が、車両1を運転しながら、例えば、自宅の電気製品や給湯機器等の動作を制御することも可能となってきており、今後、メニューに表示する項目の数は、ますます増えるものと予測される。ラジアルメニューを利用した表示形式は、今後、活用の場が広がるものと考えられる。
In the radial menu, a large number of items can be arranged in a compact and balanced manner, for example, by dividing a circle (for example, dividing it into a sector or wedge-shaped area). In recent years, it has become possible for the driver (user) of the vehicle 1 to control the operation of, for example, home electric appliances and water heaters while driving the vehicle 1 by utilizing the IOT (the Internet of Things) In the future, the number of items displayed in the menu is expected to increase more and more. The display format using the radial menu is considered to expand the place of utilization in the future.
また、項目の数が増えれば、これに伴って表示メニューの階層も深化し、その分、冗長な操作も増える傾向がある。本実施形態によれば、ショートカット(言い換えれば、中間階層を省略したジャンプ処理、さらに、必要に応じて採用されるショートカット用項目による、リターンを省略したジャンプ処理)によって、従来にない、ダイナミックでスピード感のある項目選択が可能となる。冗長な操作が低減されることから、ユーザーの心理的な負担は増えない。よって、快適で実用的な、ラジアル形式の車両用操作メニューが実現される。
Also, as the number of items increases, the hierarchy of the display menu also deepens along with this, and there is a tendency for redundant operations to increase accordingly. According to the present embodiment, dynamic and speed not found in the prior art by the shortcut (in other words, the jump process omitting the intermediate hierarchy, and the jump process omitting the return by the item for shortcut adopted as necessary) It is possible to select items with a sense. Since the redundant operation is reduced, the user's psychological burden does not increase. Thus, a comfortable and practical radial operation menu for a vehicle is realized.
図7(A)は最上位階層(第1階層)の表示例である。外形の円が4分割されて得られる4つの扇形の領域(中心角90°)の各々に、1つ、あるいは複数の項目(操作項目)が割り当てられて配置されている。右下の扇形の領域(表示領域)ZN1には、AIR CONTROL(空調)という項目(但し、現在の車内温度が26度であるという情報も付加されている)1が配置されている。
FIG. 7A is a display example of the top hierarchy (first hierarchy). One or a plurality of items (operation items) are allocated and arranged in each of four sector-shaped areas (central angle 90 °) obtained by dividing the circle of the outer shape into four. In the fan-shaped area (display area) ZN1 at the lower right, an item AIR CONTROL (air conditioning) (provided with information that the current inside temperature is 26 degrees is also added) 1 is disposed.
「AIR CONTROL(空調)」という項目1に隣接して(より正確には、時計回り方向に隣接して)、「SmartPhone(スマートフォン)」という項目2、「TEL(電話)」という項目2-1、「MAIL(メール)」という項目2-2が配置されている。
Adjacent to the item 1 "AIR CONTROL" (more precisely, adjacent in the clockwise direction), item 2 "SmartPhone", item 2-1 "TEL" , Item 2 "MAIL (mail)" is arranged.
これらの項目に隣接して(より正確には、時計回り方向に隣接して)、「FUEL METER(燃料メータ)」という項目3が配置されている。
Adjacent to these items (more precisely, in the clockwise direction), an item 3 "FUEL METER (fuel meter)" is arranged.
また、項目3に隣接して(より正確には、時計回り方向に隣接して)、「AUDIO(オーディオ)」という項目4が配置される。この項目4は、「AIR CONTROL(空調)」という項目1に隣接して(より正確には、反時計回り方向に隣接して)配置されていると見ることもできる。
Also, adjacent to the item 3 (more precisely, in the clockwise direction), an item 4 "AUDIO" is arranged. This item 4 can also be viewed as being disposed adjacent to the item 1 “AIR CONTROL” (more precisely, adjacent in the counterclockwise direction).
ここでは、「AIR CONTROL(空調)」という項目1が選択されるものとする。図7(A)では、時計の針状のポインタ502は、この項目1を指している。
Here, it is assumed that the item 1 "AIR CONTROL (air conditioning)" is selected. In FIG. 7A, the needle pointer 502 of the clock points to this item 1.
メニュー画像は、図7(B)のように切り替わる。図7(B)のメニューの外形は円であり、大きさも同じであり、図7(A)を踏襲した表示となっているので、ユーザーに違和感が生じない。
The menu image is switched as shown in FIG. 7 (B). The outer shape of the menu in FIG. 7B is a circle, the size is also the same, and since the display follows FIG. 7A, the user does not feel uncomfortable.
図7(B)では、「AIR CONTROL(空調)」に関係する、正規(本来)の下位項目(下位操作項目)1-1、1-2、1-3、1-4、1-5、1-6、1-7が表示される。
In FIG. 7 (B), normal (essentially) lower items (lower operation items) 1-1, 1-2, 1-3, 1-4, 1-5 related to “AIR CONTROL (air conditioning)” 1-6 and 1-7 are displayed.
また、図7(A)で選択された項目である、「AIR CONTROL(空調)」という項目1が、図7(A)における右下の扇形(中心角90°)の領域ZN1と同じ形状で同じサイズの領域ZN2(ここでは、この領域が三分割されて、上、中、下の領域に区画されている)内において、具体的には、上の領域に、再度、配置されている(先に図5を用いて説明した、選択履歴を示す選択履歴項目に相当する)。この項目1は、現在、選択されている項目が「AIR CONTROL(空調)」であることを明確化する(言い換えれば、選択履歴を示す)機能を備えている。
In addition, the item 1 “AIR CONTROL (air conditioning)”, which is the item selected in FIG. 7A, has the same shape as the area ZN1 of the lower right sector (center angle 90 °) in FIG. 7A. In the area ZN2 of the same size (here, this area is divided into three and divided into upper, middle, and lower areas), specifically, it is arranged again in the upper area ( This corresponds to the selection history item indicating the selection history described above with reference to FIG. This item 1 has a function of clarifying that the item currently selected is "AIR CONTROL (air conditioning)" (in other words, showing a selection history).
また、図7(B)における右下の扇形(中心角90°)の領域ZN2(図6(A)における項目1の表示領域ZN1と同じ形状で同じサイズの領域(三分割されて、上、中、下の領域に区画されている)内において、中、下の各領域には、「REAR(後部座席の空調)」という正規の項目1-1、「FRONT(前部座席の空調)」という正規の項目1-2が配置されている。これらの正規の項目1-1、1-2は、使用頻度が高いと推定されるものであり、これらが、図7(B)における右下の扇形(中心角90°)の領域内に配置されていることから、ポインタ502を少し動かすだけで選択が可能である。言い換えれば、図7(A)における選択が成功であった場合には、次の下位項目を、迅速に選択できる可能性が高められている。
Further, the area ZN2 in the lower right sector (center angle 90 °) in FIG. 7B (the same shape as the display area ZN1 of the item 1 in FIG. 6A with the same size (divided into three, In the middle and lower areas), in the middle and lower areas, the regular item 1-1 "REAR (air conditioning of the rear seat)", "FRONT (air conditioning of the front seat)" These regular items 1-1 and 1-2 are assumed to be frequently used, and these are the lower right in FIG. 7 (B). Since it is arranged in the fan-shaped (center angle 90 °) area, it is possible to select by moving the pointer 502 a little. In other words, if the selection in FIG. , The possibility of quickly selecting the next sub-item has been increased .
また、図7(B)において、「SmartPhone(スマートフォン)」という項目2、「AUDIO(オーディオ)」という項目4が、先に説明したショートカット用項目として配置されている。
Further, in FIG. 7B, an item 2 “SmartPhone (smartphone)” and an item 4 “AUDIO (audio)” are arranged as the shortcut items described above.
「配置方向における相対位置関係」については、図7(B)において、項目4(ショートカット用項目)は、項目1(選択履歴項目)に対して、反時計回り方向における上側にあり、項目2(ショートカット用項目)は、項目1(選択履歴項目)に対して、時計回り方向における下側にある。これは、図7(A)における、項目4、項目2の、項目1に対する、配置方向における相対的位置関係と同じである。よって、ユーザーに、違和感を生じさせない。
As for "relative positional relationship in the arrangement direction", in FIG. 7B, item 4 (shortcut item) is on the upper side in the counterclockwise direction with respect to item 1 (selection history item), and item 2 ( The item for shortcut) is below the item 1 (selection history item) in the clockwise direction. This is the same as the relative positional relationship in the arrangement direction with respect to item 1 in item 4 in item (A) in FIG. Thus, the user does not feel uncomfortable.
また、「隣接」についての相対的位置関係については、ショートカット用項目の配置に関して、選択履歴項目に隣接させてもよく(規則1)、上位階層において選択された項目の表示領域(図7(A)のZN1)と同じ形状で同じサイズの領域(図7(B)のZN2)に隣接させてもよい(規則2)の、少なくとも一方が満足されればよい。図7(B)の例では、ショートカット用項目である項目4(AUDIO)については、規則1、2を共に満たし、ショートカット用項目である項目2(SmartPhone)については、規則2を満たしている(なお、この規則は、図8(B)の例においても、概ね踏襲されている)。
As for the relative positional relationship of “adjacent”, the arrangement of the shortcut items may be adjacent to the selection history item (rule 1), and the display area of the item selected in the upper hierarchy (FIG. 7 (A It is sufficient if at least one of (Rule 2) which may be adjacent to a region (ZN2 in FIG. 7B) having the same shape and the same size as ZN1) in (a) is satisfied. In the example of FIG. 7B, both the rules 1 and 2 are satisfied for the item 4 (AUDIO) which is the shortcut item, and the rule 2 is satisfied for the item 2 (SmartPhone) which is the shortcut item ( This rule is generally followed in the example of FIG. 8 (B)).
図7(A)、図7(B)を見比べると、相対的位置関係は略同じであり、よって、ユーザーに違和感を生じさせない。
When comparing FIG. 7A and FIG. 7B, the relative positional relationship is substantially the same, and therefore the user does not feel uncomfortable.
図7(B)では、「REAR(後部座席の空調)」という正規の項目1-1が選択されるものとする。メニュー画像は、図8(A)のように切り替わる。
In FIG. 7B, it is assumed that the normal item 1-1 "REAR (air conditioning of rear seat)" is selected. The menu image is switched as shown in FIG.
図8(A)では、後部座席の空調温度を具体的に設定する項目(アイコン)1-1-1乃至1-1-7が設けられ、また、NEXTという項目(アイコン)1-1-8、リターン記号の項目(リターンアイコン)1-1-9が表示される。
In FIG. 8A, items (icons) 1-1-1 to 1-1-7 for specifically setting the air conditioning temperature of the rear seat are provided, and an item (icon) 1-1-8 called NEXT is provided. , Item of return symbol (return icon) 1-1-9 is displayed.
次に、図8(B)を参照する。図8(B)では、図7(B)に対応させて、第3階層においても、第1、第2の各階層のメニューに含まれていた項目を、ショートカット用項目として配置している。項目1-2(FRONT)が、第2階層のショートカット用項目、項目2、4が、第1階層のショートカット用項目である。また、図8(B)に示される第3階層のメニューには、先に図8(A)に示した項目1-1-1乃至1-1-9の内の、項目2、3、5を除く項目が含まれている。但し、それらの項目の配置は、図8(A)とは異なっている。
Next, FIG. 8B will be referred to. In FIG. 8B, in correspondence with FIG. 7B, the items included in the menu of each of the first and second layers are arranged as shortcut items also in the third layer. Item 1-2 (FRONT) is an item for shortcut in the second hierarchy, and items 2 and 4 are items for shortcut in the first hierarchy. Further, in the menu of the third hierarchy shown in FIG. 8B, items 2, 3 and 5 in items 1-1-1 to 1-1-9 previously shown in FIG. 8A. Items except for are included. However, the arrangement of those items is different from that of FIG.
図8(B)において、図7(A)の領域ZN1に対応する領域ZN3内には、選択履歴項目としての「AIR CONTROL REAR(後部座席の空調)」という項目1-1が配置され、第2階層へのショートカット用項目(ショートカットアイコン)1-2が、時計回りの方向に隣接して配置され、その隣に、第1階層へのショートカット用項目(ショートカットアイコン)2が配置され、また、第1階層へのショートカット用項目(ショートカットアイコン)4は、選択履歴項目としての「AIR CONTROL REAR(後部座席の空調)」という項目1-1に対して、反時計回り方向に隣接する位置に設けられている。
In FIG. 8B, in the area ZN3 corresponding to the area ZN1 in FIG. 7A, an item 1-1 “AIR CONTROL REAR (air conditioning of the rear seat)” as a selection history item is disposed. A shortcut item for the second hierarchy (shortcut icon) 1-2 is arranged adjacent in the clockwise direction, and next thereto, a shortcut item for the first hierarchy (shortcut icon) 2 is arranged, An item 1 for shortcut to the first hierarchy (shortcut icon) 4 is provided at a position adjacent in the counterclockwise direction with respect to the item 1-1 “AIR CONTROL REAR (air conditioning of the rear seat)” as a selection history item. It is done.
概ね、先に記載した規則1、規則2に従った配置が採用されている。図7(A)、図7(B)と、図8(B)と、を見比べた場合、ショートカットアイコンの配置について、上位階層の配置が踏襲されて図8(B)のメニューが構成されていることから、ユーザーには、違和感を与える可能性が少ない。
In general, the arrangement according to rule 1 and rule 2 described above is adopted. When FIG. 7 (A), FIG. 7 (B), and FIG. 8 (B) are compared, the arrangement of the upper hierarchy is followed about the arrangement of the shortcut icon, and the menu of FIG. 8 (B) is constructed. Users are less likely to feel uncomfortable.
上述のとおり、第n階層の操作メニュー(ここではn=3であり、図8(B)の操作メニューが該当する)に、上位階層(例えば、直前の第(n-1)階層)の操作メニューに含まれていた少なくとも1つの操作項目(ここでは、「FRONT」という項目1-2)を、ショートカット用項目として含ませておくことで、ユーザーの意に沿わないショートカット(第1階層から第n階層へのショートカット)が行われてしまった場合、ユーザーがそのショートカット用項目を選択することで、上位階層へと戻る操作を省略して、目的とする項目をただちに選択できる可能性があり(例えば、先に説明した図5(G)から図5(H)への遷移が可能であり)、これは、意に沿わないショートカット(第1階層から第n階層へのショートカット)が行われてしまった場合の対策の1つとなり得るものである。なお、ショートカットを連続して使用する項目の選択手法は、従来に例がなく、ダイナミックでスピード感のある、新規な選択態様が実現されることになる。
As described above, the operation menu of the n-th hierarchy (here, n = 3 and the operation menu of FIG. 8 (B) corresponds), the operation of the upper hierarchy (for example, the immediately preceding (n-1) hierarchy) By including at least one operation item included in the menu (here, the item 1-2 “FRONT”) as a shortcut item, a shortcut (from the first hierarchy to the first hierarchy) that does not conform to the user's will If a shortcut to n layers has been performed, the user may select an item for the shortcut to omit an operation to return to the upper layer and may be able to immediately select the desired item ( For example, the transition from FIG. 5 (G) to FIG. 5 (H) described above is possible, and this is a shortcut (shortcut from the first layer to the n-th layer) which does not conform to the intention It is those that can become one of the measures of the case that had been done. In addition, the selection method of the item which uses a shortcut continuously is an example in the past, and a dynamic and speedy new selection mode will be realized.
次に、図9を参照する。図9は、ユーザー意思確認画像の一例(ラジアルメニュー形式)を示す図である。項目1-8が、先に説明した第1の選択用項目(最終選択項目に関連する選択を行いたいのかを確認するための項目)であり、項目1-9が、先に説明した第2の選択用項目(最終選択とは関係のない選択を行いたいのかを確認するための項目)である。各項目1-8、1-9は、円を縦に2等分して得られる半円の領域(表示領域)の各々に配置されている。ユーザー自身にいずれかを選択させることで、意に沿わないショートカットが行われることを防止することができる。
Next, FIG. 9 is referred to. FIG. 9 is a diagram showing an example (radial menu format) of the user intention confirmation image. Item 1-8 is the first selection item described above (an item for confirming whether you want to make a selection related to the final selection item), and item 1-9 is the second item described above Items for selection (items for confirming whether or not to make a selection unrelated to the final selection). Each of the items 1-8 and 1-9 is disposed in each of semicircular areas (display areas) obtained by vertically dividing a circle into two equal parts. By having the user select one, it is possible to prevent an unintended shortcut from being performed.
このように、本発明によれば、ユーザー(車両1の運転者等)が、第n階層(nは3以上の自然数)の操作メニューの操作項目を最終決定した後、第1階層に戻って、直近の過去にて選択した操作項目と同じ操作項目を再選択した場合における冗長性を排し、所望の操作項目を効率的に選択できるようになる。よって、メニュー選択の利便性が格段に向上する。
Thus, according to the present invention, after the user (driver of vehicle 1 etc.) finalizes the operation items of the operation menu of the n-th hierarchy (n is a natural number of 3 or more), the user returns to the first hierarchy. The redundancy in the case where the same operation item as the most recently selected operation item is reselected is eliminated, and the desired operation item can be efficiently selected. Therefore, the convenience of menu selection is significantly improved.
本発明は、上記の例に限定されるものではなく、種々、変形、応用が可能である。例えば、第1階層から第n階層へのショートカット(表示画面のジャンプ)が実施された場合、その事実の報知用のアイコン等を、第n階層のメニューに含ませてもよい。また、表示態様を変化させることで、その事実を報知してもよい。
The present invention is not limited to the above examples, and various modifications and applications are possible. For example, when the shortcut from the first hierarchy to the n-th hierarchy (jumping of the display screen) is performed, an icon for notifying the fact or the like may be included in the menu of the n-th hierarchy. Also, the fact may be notified by changing the display mode.
なお、本明細書において、車両とは、例えば自動車、電車、飛行機、船舶等の「乗り物」を示す用語として広義に解釈し、又、メニューという用語も、例えば「複数の選択肢を含む表示」というように、広義に解釈するものとする。
In the present specification, a vehicle is broadly interpreted as a term indicating "vehicle" such as a car, a train, an airplane, a ship or the like, and the term "menu" is also referred to as "a display including a plurality of options". As such, it shall be interpreted in a broad sense.
本発明は、上述の例示的な実施形態に限定されず、また、当業者は、上述の例示的な実施形態を特許請求の範囲に含まれる範囲まで、容易に変更することができるであろう。
The invention is not limited to the above-described exemplary embodiments, and one of ordinary skill in the art could easily modify the above-described exemplary embodiments to the extent that they are included in the claims. .
10・・・表示装置、20・・・制御装置、21・・・表示制御装置(車両用操作メニュー表示制御装置)、22・・・操作メニュー画像生成部、24・・・・操作メニュー表示処理部、26・・・処理実行装置、30・・・入出力インターフェース(入出力I/F)、40、50・・・・信号インターフェース(信号I/F)、200・・・選択装置(入力装置、車両用ポインティングデバイス)、500・・・ラジアルメニュー、502・・・ポインタ、600・・・最終選択判定部、610・・・制御処理部、620・・・タイマー、630・・・選択履歴記憶部、632・・・第1階層での、直近の過去の選択(最終選択)との同一性判定部、640・・・画像生成処理部。
10: display device 20: control device 21: display control device (operation menu display control device for vehicle) 22: operation menu image generation unit 24: operation menu display processing 26: processing execution device 30: input / output interface (input / output I / F) 40, 50: signal interface (signal I / F) 200: selection device (input device , Pointing device for vehicle), 500: radial menu, 502: pointer, 600: final selection determination unit, 610: control processing unit, 620: timer, 630: selection history storage Part 632: Identity determination part with the latest selection (final selection) in the first hierarchy, 640: Image generation processing part.
Claims (8)
- 階層構造を有すると共に、1つの階層の画像に複数の操作項目が含まれる操作メニューの表示を制御する車両用操作メニュー表示制御装置であって、
前記操作メニューの画像を生成する操作メニュー画像生成部と、
生成された操作メニューの画像の表示処理を行う表示処理部と、
を有し、
前記操作メニュー画像生成部は、
前記選択信号によって第n階層(nは3以上の自然数)の操作メニューに含まれる1つの操作項目が選択され、その操作項目に関連付けられた第(n+1)階層の操作メニューが存在しないことで、前記選択が最終選択であった場合、第m階層(mはn-2以下の自然数)の操作メニューの画像を生成し、
その生成の後、前記第m階層の操作メニューに含まれる1つの操作項目が選択され、その選択された操作項目が、直近の過去において、第m階層の操作メニューで選択された操作項目と同じであった場合には、第(m+1)階層乃至第(n-1)階層の操作メニューの画像の生成を省略して、第n階層の操作メニューの画像を生成する、
ことを特徴とする車両用操作メニュー表示制御装置。 A vehicle operation menu display control device having a hierarchical structure and controlling display of an operation menu including a plurality of operation items in an image of one layer,
An operation menu image generation unit that generates an image of the operation menu;
A display processing unit that performs display processing of the generated image of the operation menu;
Have
The operation menu image generation unit
One operation item included in the operation menu of the n-th hierarchy (n is a natural number of 3 or more) is selected by the selection signal, and the operation menu of the (n + 1) -th hierarchy associated with the operation item does not exist. If the selection is the final selection, an image of the operation menu of the m-th hierarchy (m is a natural number of n-2 or less) is generated,
After the generation, one operation item included in the operation menu of the m-th hierarchy is selected, and the selected operation item is the same as the operation item selected in the operation menu of the m-th hierarchy in the immediate past. In the case where the operation menu of the (m + 1) th to (n-1) -th layers is omitted, the image of the operation menu of the n-th layer is generated.
A vehicle operation menu display control device characterized in that. - 前記操作メニュー画像生成部は、
前記第1階層の操作メニューの画像を生成した後に行われる、直近の過去において、第1階層の操作メニューで選択された操作項目と同じである操作項目についての前記選択が、前記第n階層における前記最終選択のタイミングから所定時間内である所定期間において行われる場合にのみ、前記第(m+1)階層乃至第(n-1)階層の操作メニューの画像の生成を省略して、前記第n階層の操作メニューの画像を生成する、
ことを特徴とする、請求項1に記載の車両用操作メニュー表示制御装置。 The operation menu image generation unit
The selection of the operation item which is the same as the operation item selected in the operation menu of the first hierarchy in the immediate past, which is performed after generating the image of the operation menu of the first hierarchy, is in the nth hierarchy The generation of the image of the operation menu of the (m + 1) th layer to the (n-1) th layer is omitted only when it is performed in a predetermined period which is within a predetermined time from the timing of the final selection. Generate an image of the operation menu of
The vehicle operation menu display control device according to claim 1, characterized in that: - 前記操作メニュー画像生成部は、
前記第(m+1)階層乃至第(n-1)階層の操作メニューの画像の生成を省略して、第n階層の操作メニューの画像を生成する処理に先立ち、
前記最終選択がなされた前記第n階層の操作メニューの操作項目を選択する第1の選択をしたいのか、前記第n階層以外の階層の操作メニューの操作項目を選択する第2の選択をしたいのかをユーザーに選ばせるための、前記第1、第2の各選択に対応する第1、第2の意思確認用項目を含むユーザー意思確認画像を生成し、
前記ユーザーが、前記第1の意思確認用項目を選択した場合にのみ、前記(第m+1)階層乃至第(n-1)階層の操作メニューの画像の生成を省略して、前記第n階層の操作メニューの画像を生成する、
ことを特徴とする、請求項1に記載の車両用操作メニュー表示制御装置。 The operation menu image generation unit
Prior to the process of generating the image of the operation menu of the nth layer, omitting the generation of the image of the operation menu of the (m + 1) th layer to the (n-1) th layer,
Do you want to make a first selection to select an operation item of the operation menu of the n-th hierarchy for which the final selection has been made or do you want to make a second selection to select an operation item of an operation menu of a hierarchy other than the n-th hierarchy? Generating a user intention confirmation image including first and second intention confirmation items corresponding to the first and second selections, to make the user select
Only when the user selects the first intention confirmation item, the generation of the image of the operation menu of the (m + 1) th to (n-1) th layers is omitted, and the nth hierarchy is selected. Generate an image of the operation menu,
The vehicle operation menu display control device according to claim 1, characterized in that: - 前記操作メニュー画像生成部は、
前記第n階層の操作メニューの画像を生成する際、正規の操作メニュー項目と、上位階層である第(m+1)乃至第(n-1)階層のうちの少なくとも1つの階層の操作メニューに含まれていた、直近の過去に選択された1つの操作項目以外の操作項目であるショートカット用項目と、を含む、第n階層の操作メニューの画像を生成する、
ことを特徴とする、請求項1乃至3の何れか1項に記載の車両用操作メニュー表示制御
装置。 The operation menu image generation unit
When generating an image of the operation menu of the n-th hierarchy, it is included in the operation menu of at least one of the normal operation menu item and the (m + 1) th to (n-1) -th hierarchies which are upper hierarchies. Generating an image of the operation menu of the n-th layer including an item for shortcut which is an operation item other than the one operation item selected in the last past,
The vehicle operation menu display control device according to any one of claims 1 to 3, characterized in that: - 前記操作メニュー画像生成部は、
前記最終選択であるか否かを判定する最終選択判定部と、
第m階層の操作メニューで選択された操作項目が、直近の過去において、第m階層の操作メニューで選択された操作項目と同じであったか否かを判定する、第m階層での直近の過去の選択との同一性判定部と、
前記最終選択判定部、及び前記第m階層での直近の過去の選択との同一性判定部の各判定結果に基づいて、どの階層の操作メニュー画像を生成させるかを決定する、
又は、
前記最終選択判定部、及び前記第m階層での直近の過去の選択との同一性判定部の各判定結果に基づいて、前記ユーザーの意思確認画像を生成させるか否かを決定し、前記ユーザーの意思確認画像を生成させた場合には、その生成の後に行われる前記ユーザーの選択に基づいて、どの階層の操作メニュー画像を生成させるかを決定する、制御処理部と、
前記制御処理部の決定に基づいて、操作メニュー画像の生成処理を行う画像生成処理部と、
を含むことを特徴とする、請求項1乃至3の何れか1項に記載の車両用操作メニュー表示制御装置。 The operation menu image generation unit
A final selection determining unit that determines whether or not the final selection is performed;
It is determined whether the operation item selected in the operation menu of the m-th hierarchy is the same as the operation item selected in the operation menu of the m-th hierarchy in the most recent past An identity determination unit with selection,
Based on each determination result of the final selection determination unit and the identity determination unit with the latest past selection in the m-th layer, it is determined which operation menu image is to be generated.
Or
It is determined whether or not the intention confirmation image of the user is to be generated based on each determination result of the final selection determination unit and an identity determination unit with the latest selection in the m-th hierarchy, A control processing unit that determines which hierarchical operation menu image is to be generated, based on the user's selection performed after the generation of the intention confirmation image of
An image generation processing unit that generates an operation menu image based on the determination of the control processing unit;
The vehicle operation menu display control device according to any one of claims 1 to 3, further comprising: - 前記操作メニュー画像生成部が生成する前記操作メニューの画像は、原点を有し、前記原点から外側に向かう複数の放射状の直線によって、操作メニューの表示領域が区画されてなるラジアルメニューの画像である、ことを特徴とする、請求項1乃至5の何れか1項に記載の車両用操作メニュー表示制御装置。 The image of the operation menu generated by the operation menu image generation unit is an image of a radial menu in which the display area of the operation menu is divided by a plurality of radial straight lines having an origin and extending outward from the origin. The vehicle operation menu display control device according to any one of claims 1 to 5, characterized in that:
- 請求項1乃至6の何れか1項に記載の車両用操作メニュー表示制御装置と、
生成された操作メニューの画像に基づいて、操作メニューを表示する表示装置と、
前記操作メニューに含まれる複数の操作項目のうちの1つを選択するための選択信号を、車両のユーザーの選択動作に応じて発生させる選択装置と、
前記ユーザーによって最終選択された操作項目に対応する、車載機器の操作処理を実行する処理実行装置と、
を有する車載機器操作システム。 A vehicle operation menu display control device according to any one of claims 1 to 6.
A display device that displays an operation menu based on the generated image of the operation menu;
A selection device that generates a selection signal for selecting one of a plurality of operation items included in the operation menu according to a selection operation of a user of the vehicle;
A process execution device that executes an operation process of an in-vehicle device corresponding to the operation item finally selected by the user;
In-vehicle device operation system having. - コンピュータを、請求項1乃至6の何れか1項に記載の、操作メニュー画像生成部と、生成された操作メニューの画像の表示処理を行う表示処理部と、を有する車両用操作メニュー表示制御装置として動作させる、GUI(グラフィカルユーザーインターフェース)プログラム。 An operation menu display control apparatus for a vehicle, comprising: an operation menu image generation unit according to any one of claims 1 to 6; and a display processing unit that performs display processing of an image of the generated operation menu. A GUI (Graphical User Interface) program to operate as.
Applications Claiming Priority (2)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
JP2018010453 | 2018-01-25 | ||
JP2018-010453 | 2018-01-25 |
Publications (1)
Publication Number | Publication Date |
---|---|
WO2019146704A1 true WO2019146704A1 (en) | 2019-08-01 |
Family
ID=67395404
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
PCT/JP2019/002292 WO2019146704A1 (en) | 2018-01-25 | 2019-01-24 | Operation menu display control device for vehicle, vehicle-mounted device operation system, and gui program |
Country Status (1)
Country | Link |
---|---|
WO (1) | WO2019146704A1 (en) |
Citations (7)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
JPH05265682A (en) * | 1992-03-19 | 1993-10-15 | Fujitsu Ltd | Menu hierarchy changing system |
JPH07141137A (en) * | 1993-11-19 | 1995-06-02 | Casio Comput Co Ltd | Method for selecting menu |
JP2007183914A (en) * | 2005-12-29 | 2007-07-19 | Samsung Electronics Co Ltd | Content navigation method and content navigation apparatus therefor |
JP2007207186A (en) * | 2006-02-06 | 2007-08-16 | Denso Corp | Operation system |
JP2011138421A (en) * | 2009-12-29 | 2011-07-14 | Mic Ware:Kk | Apparatus and method for displaying map, and program |
JP2012086789A (en) * | 2010-10-22 | 2012-05-10 | Denso Corp | Operation input system for vehicles |
JP2015093550A (en) * | 2013-11-11 | 2015-05-18 | 日本精機株式会社 | On-vehicle equipment operation system and operation device |
-
2019
- 2019-01-24 WO PCT/JP2019/002292 patent/WO2019146704A1/en active Application Filing
Patent Citations (7)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
JPH05265682A (en) * | 1992-03-19 | 1993-10-15 | Fujitsu Ltd | Menu hierarchy changing system |
JPH07141137A (en) * | 1993-11-19 | 1995-06-02 | Casio Comput Co Ltd | Method for selecting menu |
JP2007183914A (en) * | 2005-12-29 | 2007-07-19 | Samsung Electronics Co Ltd | Content navigation method and content navigation apparatus therefor |
JP2007207186A (en) * | 2006-02-06 | 2007-08-16 | Denso Corp | Operation system |
JP2011138421A (en) * | 2009-12-29 | 2011-07-14 | Mic Ware:Kk | Apparatus and method for displaying map, and program |
JP2012086789A (en) * | 2010-10-22 | 2012-05-10 | Denso Corp | Operation input system for vehicles |
JP2015093550A (en) * | 2013-11-11 | 2015-05-18 | 日本精機株式会社 | On-vehicle equipment operation system and operation device |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
KR102416405B1 (en) | Vehicle-based multi-modal interface | |
JP5627290B2 (en) | Commander control switch for vehicle, system including the switch, and method of using the switch | |
US10628008B2 (en) | Information terminal controlling an operation of an application according to a user's operation received via a touch panel mounted on a display device | |
KR101721963B1 (en) | Controlling apparatus using touch input, vehicle comprising the same | |
JP6299162B2 (en) | In-vehicle device operation system and operation device | |
CN104731464A (en) | Multi-operating System And Method Using Touch Pad Of Operating System Of Vehicle | |
JP2011118857A (en) | User interface device for operations of multimedia system for vehicle | |
CN111497613A (en) | Vehicle interaction method and device | |
JP7137962B2 (en) | Switching device and control device | |
WO2019146704A1 (en) | Operation menu display control device for vehicle, vehicle-mounted device operation system, and gui program | |
JP7340150B2 (en) | Operation image display device, operation image display system, and operation image display program | |
CN111602102B (en) | Method and system for visual human-machine interaction | |
JP2017197015A (en) | On-board information processing system | |
JP2018010472A (en) | In-vehicle electronic equipment operation device and in-vehicle electronic equipment operation method | |
JP7235033B2 (en) | VEHICLE MENU DISPLAY CONTROL DEVICE, VEHICLE DEVICE OPERATION SYSTEM, AND GUI PROGRAM | |
WO2019146703A1 (en) | Operation menu display control device for vehicle, vehicle-mounted device operation system, and gui program | |
US20160011667A1 (en) | System and Method for Supporting Human Machine Interaction | |
JP7076069B2 (en) | Vehicle menu display control device, in-vehicle device operation system, and GUI program | |
KR102501913B1 (en) | Operating system, method for the operation of an operating system, and a vehicle with an operating system | |
JP7255584B2 (en) | VEHICLE MENU DISPLAY CONTROL DEVICE, VEHICLE DEVICE OPERATION SYSTEM, AND GUI PROGRAM | |
WO2019065616A1 (en) | Operation image display device and operation device | |
EP3736163B1 (en) | A contextual based user interface | |
JP6489253B2 (en) | Display device and in-vehicle device operation system | |
JP2019133329A (en) | Vehicle menu display control device, in-vehicle device operation system, and gui program | |
US20220129149A1 (en) | Control device, system, and program |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
121 | Ep: the epo has been informed by wipo that ep was designated in this application |
Ref document number: 19744250 Country of ref document: EP Kind code of ref document: A1 |
|
NENP | Non-entry into the national phase |
Ref country code: DE |
|
122 | Ep: pct application non-entry in european phase |
Ref document number: 19744250 Country of ref document: EP Kind code of ref document: A1 |
|
NENP | Non-entry into the national phase |
Ref country code: JP |