WO2019049310A1

WO2019049310A1 - User interface control device and menu screen display method

Info

Publication number: WO2019049310A1
Application number: PCT/JP2017/032463
Authority: WO
Inventors: 友広椎野; 下谷　光生; 小畑　直彦
Original assignee: 三菱電機株式会社
Priority date: 2017-09-08
Filing date: 2017-09-08
Publication date: 2019-03-14

Abstract

A user interface control device (10) is provided with: a display processing unit (11) for causing a touch panel (20) to display a menu screen that includes function buttons to be operated by a user; a menu screen control unit (12) for controlling the number and arrangement of the function buttons to be incorporated in the menu screen; and an operation recognition unit (13) for recognizing an operation inputted to the touch panel (20). The menu screen control unit (12) increases the number of function buttons to be incorporated in the menu screen when a first gesture operation is inputted to the touch panel (20), and decreases the number of function buttons to be incorporated in the menu screen when a second gesture operation is inputted to the touch panel (20).

Description

User interface control device and menu screen display method

The present invention relates to a user interface control device, and more particularly to a method of displaying a menu screen including function buttons operated by a user.

For example, information processing devices having a menu screen displayed on a display device, such as a smartphone or a navigation device, as a user interface are in widespread use. Generally, the menu screen is provided with function buttons for the user to select various functions.

With the multifunctionalization of information processing apparatuses, the number of function buttons incorporated into menu screens tends to increase. However, incorporating a large number of function buttons in one menu screen makes it difficult for the user to find the desired function button.

As a solution to this problem, there is a hierarchy of new screens by hierarchizing function buttons. In the hierarchical menu screen, when the user selects any function button on the menu screen, the menu screen is switched to another menu screen (submenu screen) in which the function buttons in the hierarchy below the selected function button are incorporated. In the hierarchical menu screen, since the number of function buttons incorporated in one menu screen can be reduced, the user can easily find a desired function button. However, since an operation for switching a plurality of menu screens is required, there is a problem that the number of operations increases.

Patent Document 1 below discloses an in-vehicle apparatus capable of switching between an applied operation mode for displaying a detailed menu screen and a basic operation mode for displaying a simple menu screen.

Japanese Patent Application Publication No. 2013-515309

As mentioned above, the greater the number of function buttons incorporated into one menu screen, the more difficult it is for the user to find the desired function button. If the menu screen is hierarchized, the number of function buttons incorporated in one menu screen can be reduced, but the operation time increases. Thus, the number of function buttons incorporated in one menu screen greatly affects the time for the user to find a desired function button. Since the preferred number of function buttons to be incorporated into the menu screen varies with the preference of the user, a technique that allows the user to adjust the number of function buttons is desired.

Although it is possible to switch between a detailed menu screen and a simple menu screen in the in-vehicle apparatus of Patent Document 1, the number of function buttons incorporated in each menu screen can not be adjusted by the user.

The present invention has been made to solve the problems as described above, and it is an object of the present invention to provide a user interface control device capable of adjusting the number of function buttons incorporated in a menu screen according to the user's preference. .

A user interface control device according to the present invention includes a display processing unit for causing a display device to display a menu screen incorporating at least one of a plurality of predetermined function buttons, and the number and arrangement of function buttons to be incorporated into the menu screen. And an operation recognition unit for recognizing an operation input to the operation input device, wherein the menu screen control unit receives a first predetermined gesture operation input to the operation input device. Then, the number of function buttons incorporated in the menu screen is increased, and the number of function buttons incorporated in the menu screen is reduced when a predetermined second gesture operation is input to the operation input device.

According to the user interface control device of the present invention, it is possible to provide a menu screen in which the number of function buttons according to the user's preference is arranged. As a result, it is possible to contribute to shortening of the time for the user to select a desired function button.

The objects, features, aspects, and advantages of the present invention will be more apparent from the following detailed description and the accompanying drawings.

It is a functional block diagram showing composition of an information processing system concerning an embodiment of the invention. It is a figure which shows the example of the hardware constitutions of a user interface control apparatus. It is a figure which shows the example of the hardware constitutions of a user interface control apparatus. It is a flowchart which shows operation | movement of the user interface control apparatus which concerns on embodiment of this invention. It is a figure which shows the specific example of the hierarchical structure of a function button. It is a figure which shows the hierarchical structure of the function button used for description of embodiment of this invention. It is a figure which shows the example of gesture operation. FIG. 7 is a diagram showing an example of change of the menu screen in the first embodiment. FIG. 7 is a diagram showing an example of change of the menu screen in the first embodiment. FIG. 7 is a diagram showing an example of change of the menu screen in the first embodiment. FIG. 7 is a diagram showing an example of change of the menu screen in the first embodiment. FIG. 7 is a diagram showing an example of change of the menu screen in the first embodiment. It is a figure which shows the example of the gesture operation which has direction. FIG. 17 is a diagram showing an example of change of the menu screen in the second embodiment. FIG. 18 is a diagram showing an example of change of the menu screen in the third embodiment. FIG. 18 is a diagram showing an example of change of the menu screen in the third embodiment. FIG. 18 is a diagram showing an example of change of the menu screen in the third embodiment. FIG. 18 is a diagram showing an example of change of the menu screen in the third embodiment. FIG. 18 is a diagram showing an example of change of the menu screen in the third embodiment. FIG. 21 is a diagram showing an example of change of the menu screen in the fourth embodiment. FIG. 21 is a diagram showing an example of change of the menu screen in the fifth embodiment. FIG. 21 is a functional block diagram showing a configuration of an information processing system in a sixth embodiment. FIG. 33 is a diagram showing an example of change of an initial menu screen in the sixth embodiment. FIG. 35 is a diagram showing an example of an initial menu screen in the seventh embodiment. FIG. 35 is a diagram showing an example of an initial menu screen in the seventh embodiment. FIG. 35 is a diagram showing an example of an initial menu screen in the seventh embodiment.

Embodiment 1
FIG. 1 is a functional block diagram showing the configuration of the information processing system 100 according to the first embodiment. As shown in FIG. 1, the information processing system 100 includes a user interface control device 10, a touch panel 20 and an information processing device 30.

As a specific example of the information processing system 100, for example, a smartphone, a navigation device, an audio display device, etc. can be considered. Although FIG. 1 shows the user interface control device 10, the touch panel 20, and the information processing device 30 as individual blocks, two or more of them may be integrally configured. For example, in the case where the information processing system 100 is a portable device such as a smartphone, the user interface control device 10, the touch panel 20, and the information processing device 30 are housed in one case to form an integral structure.

The touch panel 20 includes a display 21 for displaying an image, and an operation input device 22 disposed on the screen of the display 21. The display device 21 is configured of, for example, a liquid crystal display. The operation input device 22 is a touch sensor that detects the position (coordinates) at which the user has touched the screen of the display device 21. In the following description, the display device 21 and the operation input device 22 will be collectively referred to as the “touch panel 20”. For example, the image displayed on the display device 21 is referred to as “image displayed on the touch panel 20”, and the operation on the operation input device 22 is referred to as “operation on the touch panel 20”.

Although an example in which one touch panel 20 is configured by the display device 21 and the operation input device 22 is shown here, the display device 21 and the operation input device 22 may be separate devices. For example, when the information processing system 100 is an in-vehicle device, the display device 21 is disposed on the front panel or instrument panel of a vehicle that is easily visible to the driver, and the operation input device 22 is on the center console at hand of the driver. It is considered to be arranged. Further, the display device 21 may be a head-up display. The head-up display is a display device that displays an image on a windshield that the driver can see or a translucent screen called a "combiner", and can directly display the image in the driver's field of view.

The user interface control device 10 causes the touch panel 20 to function as a user interface of the information processing device 30. That is, the user interface control device 10 causes the touch panel 20 to display a menu screen for the user to select a function to be executed by the information processing device 30, an execution screen of each function of the information processing device 30, and the like. Further, the user interface control device 10 transmits the content of the user's operation input to the touch panel 20 to the information processing device 30. The information processing apparatus 30 executes various functions in accordance with the content of the operation.

As shown in FIG. 1, the user interface control device 10 includes a display processing unit 11, a menu screen control unit 12 and an operation recognition unit 13.

The display processing unit 11 generates an image signal for causing the touch panel 20 to display a menu screen of the information processing device 30 and an execution screen of each function. The menu screen of the information processing device 30 incorporates at least one of a plurality of predetermined function buttons.

The operation recognition unit 13 recognizes an operation performed by the user using the touch panel 20 based on the touch position of the user detected by the touch panel 20 (the operation input device 22). Information on the operation recognized by the operation recognition unit 13 is input to the menu screen control unit 12 and the information processing device 30.

When the display processing unit 11 causes the touch panel 20 to display a menu screen, the menu screen control unit 12 controls the number and arrangement of function buttons incorporated in the menu screen. Specifically, when the menu screen is displayed on the touch panel 20 and the menu screen control unit 12 receives a first gesture operation determined in advance on the touch panel 20, The number is increased, and the number of function buttons incorporated in the menu screen is reduced when the second predetermined gesture operation is input.

The menu screen control unit 12 includes a function button number control unit 121, a function button selection unit 122, and a function button arrangement unit 123. The function button number control unit 121 increases or decreases the number of function buttons (hereinafter referred to as the “function button number”) to be incorporated into the menu screen in accordance with the first gesture operation and the second gesture operation. The function button selection unit 122 selects the function buttons to be incorporated in the menu screen by the same number as the number of function buttons from among a plurality of predetermined function buttons. The function button arrangement unit 123 sets the arrangement on the menu screen for each of the function buttons selected by the function button selection unit 122.

The function button selection unit 122 may select any function button to be incorporated in the menu screen. For example, a method may be considered in which priority is given to each of the function buttons in advance, and the function button selection unit 122 selects as many function buttons as the number of function buttons from the one with the highest priority. In that case, the priority of each function button may be a fixed value or may be changed according to the use situation of the user. For example, it is conceivable to calculate the use frequency of each function button from the operation history of the user and to increase the priority of the function button with high use frequency. When the function buttons are hierarchized, high priority may be given to the function buttons belonging to the higher hierarchy.

In addition, since recording capacity of a user's operation history requires a certain amount of storage capacity, for example, the user interface control apparatus 10 is provided with a communication function with an external server, and the user's operation history is stored in the server May be In that case, the calculation of the frequency of use of each function button and the calculation of the priority may be performed by the server.

The function button arrangement unit 123 may set the arrangement of function buttons on the menu screen by any method. A specific example of the arrangement of function buttons will be described later.

2 and 3 each show an example of a hardware configuration of the user interface control device 10. Each element (display processing unit 11, menu screen control unit 12, and operation recognition unit 13) of the user interface control device 10 shown in FIG. 1 is realized by, for example, the processing circuit 50 shown in FIG. That is, the processing circuit 50 recognizes the display processing unit 11 that causes the display device 21 to display a menu screen in which at least one of the plurality of predetermined function buttons is incorporated, and the operation input to the operation input device 22. When the operation recognition unit 13 to be performed and the first predetermined gesture operation are input to the operation input device 22, the number of function buttons incorporated in the menu screen is increased, and the second predetermined gesture operation is input And a menu screen control unit 12 which reduces the number of function buttons incorporated in the menu screen when input to the device 22. A dedicated hardware may be applied to the processing circuit 50, and a processor (central processing unit (CPU: Central Processing Unit), processing unit, arithmetic unit, microprocessor, microprocessor, etc. that executes a program stored in the memory). A computer or DSP (also called Digital Signal Processor) may be applied.

When the processing circuit 50 is dedicated hardware, the processing circuit 50 may be, for example, a single circuit, a composite circuit, a programmed processor, a parallel programmed processor, an application specific integrated circuit (ASIC), an FPGA (field-programmable) This corresponds to Gate Array) or a combination thereof. Each function of each element of the user interface control apparatus 10 may be realized by a plurality of processing circuits, or those functions may be realized collectively by one processing circuit.

FIG. 3 shows the hardware configuration of the user interface control device 10 when the processing circuit 50 is configured using a processor. In this case, the function of each element of the user interface control device 10 is realized by a combination of software or the like (software, firmware, or software and firmware). Software and the like are described as a program and stored in the memory 52. The processor 51 as the processing circuit 50 reads out and executes a program stored in the memory 52 to realize the functions of the respective units. That is, the user interface control device 10 causes the display device 21 to display a menu screen incorporating at least one of a plurality of predetermined function buttons when executed by the processing circuit 50, and an operation input A process of recognizing an operation input to the device 22 and, when a predetermined first gesture operation is input to the touch panel 20 (the operation input device 22), the number of function buttons incorporated in the menu screen is increased, Processing for reducing the number of function buttons incorporated in the menu screen when the input second gesture operation is input to the touch panel 20 (operation input device 22); Memory 52 of FIG. In other words, it can be said that this program causes the computer to execute the procedure and method of the operation of each element of the user interface control device 10.

Here, the memory 52 is non-volatile or non-volatile such as, for example, random access memory (RAM), read only memory (ROM), flash memory, erasable programmable read only memory (EPROM), electrically erasable programmable read only memory (EEPROM). Volatile semiconductor memory, HDD (Hard Disk Drive), magnetic disk, flexible disk, optical disk, compact disk, mini disk, DVD (Digital Versatile Disc), its drive device, etc., or any storage medium used in the future May be

In the above, the structure by which the function of each element of the user interface control apparatus 10 is implement | achieved by either hardware, software, etc. was demonstrated. However, the present invention is not limited to this, and some elements of the user interface control apparatus 10 may be realized by dedicated hardware, and other elements may be realized by software or the like. For example, the function is realized by the processing circuit 50 as dedicated hardware for some elements, and the processing circuit 50 as the processor 51 reads a program stored in the memory 52 for other elements. It is possible to realize the function by executing it.

As described above, the user interface control device 10 can realize each of the functions described above by hardware, software, etc., or a combination thereof.

FIG. 4 is a flowchart showing the operation of the user interface control device 10. The operation of the user interface control device 10 will be described based on FIG.

When the information processing system 100 is activated, the display processing unit 11 of the user interface control device 10 causes the touch panel 20 to display a menu screen (step S1). Thereafter, the operation recognition unit 13 confirms whether the user's operation has been input to the touch panel 20 (step S2). While the user's operation is not input to the touch panel 20 (NO in step S2), step S2 is repeated.

When the user's operation is input to the touch panel 20 (YES in step S2), the operation recognition unit 13 confirms whether the operation is a predetermined first gesture operation (step S3). If the operation is the first gesture operation (YES in step S3), the function button number control unit 121 increases the number of function buttons, which is the number of function buttons incorporated in the menu screen (step S4).

If the operation input to the touch panel 20 is not the first gesture operation (NO in step S3), the operation recognition unit 13 confirms whether the operation is a predetermined second gesture operation ( Step S5). If the operation is the second gesture operation (YES in step S5), the function button number control unit 121 reduces the number of function buttons (step S6).

When the number of function buttons is changed in step S4 or step S6, the function button selection unit 122 selects a function button to be incorporated into the menu screen (step S7). Subsequently, the function button arrangement unit 123 sets the arrangement on the menu screen for each function button selected by the function button selection unit 122 (step S8). Thereafter, in order to display the menu screen after the number of function buttons has been changed on the touch panel 20, the process returns to step S1.

For example, when the user performs an operation to select any function button on the menu screen, or the operation input to the touch panel 20 is neither the first gesture operation nor the second gesture operation (Step The operation recognition unit 13 transmits the content of the operation to the information processing apparatus 30 (NO in S5) (step S9).

When the information processing apparatus 30 receives the content of the user's operation from the operation recognition unit 13, the information processing apparatus 30 executes a process according to the operation. Meanwhile, the user interface control device 10 performs processing in accordance with the control from the information processing device 30 (step S10). In step S10, for example, the display processing unit 11 causes the touch panel 20 to display an execution screen of the function of the information processing apparatus 30, and the operation recognition unit 13 displays the content of the operation performed by the user on the execution screen. The information is input to the information processing apparatus 30. Since the process of step S10 is not related to the present invention, the detailed description is omitted. When the process of step S10 ends, the process returns to step S1 to return the display on the touch panel 20 to the menu screen.

As described above, when the first gesture operation is performed on the menu screen displayed on the touch panel 20, the user interface control device 10 increases the number of function buttons incorporated in the menu screen, and the second gesture is performed. When the operation is performed, the number of function buttons incorporated in the menu screen is reduced. Therefore, the user can adjust the number of function buttons incorporated in the menu screen by performing a gesture operation on the menu screen. As a result, the user interface control device 10 can provide a menu screen on which the number of function buttons according to the user's preference is arranged. Therefore, it can contribute to shortening of the time for the user to select a desired function button.

Hereinafter, a specific example of the change of the menu screen according to the gesture operation of the user will be shown. Here, it is assumed that the plurality of function buttons that the user interface control apparatus 10 has as a candidate to be incorporated into the menu screen are predetermined by the information processing apparatus 30. Also, the plurality of function buttons are hierarchized.

For example, when the information processing system 100 is a navigation device, the plurality of function buttons are hierarchized as shown in FIG. In the example of FIG. 5, function buttons such as “map”, “media”, and “application” are defined as the function buttons of the first hierarchy which is the top hierarchy. Also, in the hierarchy below the function buttons of the first hierarchy, the function buttons of the second hierarchy are defined. In FIG. 5, for example, under the function button of “map”, function buttons such as “destination search”, “destination history”, and “registration place” are defined as function buttons of the second layer. Furthermore, a function button of the third layer may be defined in the layer under the function button of the second layer. In FIG. 5, for example, function buttons such as “genre search”, “name search”, and “address search” are defined as function buttons of the third hierarchy under the “destination search” function button.

In the following, for simplicity of explanation, as shown in FIG. 6, the function buttons belonging to the first hierarchy are denoted as “A”, “B”, “C”. The function buttons belonging to the second hierarchy are represented as “A-1”, “A-2”, “A-3”,. Furthermore, for example, function buttons belonging to the third layer under the function button "A-1" are represented as "A-1-1", "A-1-2", "A-1-3", ... .

The number of layers of function buttons is not limited to three, and may be two or more. The present invention is also applicable to a configuration in which the function buttons are not hierarchized (only one hierarchy).

In addition, although the first gesture operation and the second gesture operation may be respectively arbitrary gesture operations, in the present embodiment, the first gesture operation is a pinch in operation (hereinafter simply referred to as “pinch in”), the second The gesture operation of is defined as a pinch out operation (hereinafter simply referred to as "pinch out"). As shown in FIG. 7, pinch in is a gesture operation for reducing the distance between two fingers touched on the touch panel 20, and pinch out is a gesture operation for increasing the distance between two fingers touched on the touch panel 20. is there.

FIG. 8 shows an example of change of the menu screen displayed on the touch panel 20. As shown in FIG. When the user performs pinch-in (first gesture operation) on the touch panel 20 while the menu screen is displayed on the touch panel 20, the menu screen control unit 12 determines the number of function buttons to be incorporated in the menu screen (the number of function buttons Increase). Further, when the user performs pinch-out (second gesture operation) on the touch panel 20, the menu screen control unit 12 reduces the number of function buttons.

In the example of FIG. 8, when the number of function buttons is increased, the function button selection unit 122 maintains the function button already incorporated in the menu screen, and adds a function button newly incorporated in the menu screen. For example, as shown in the upper part of FIG. 8, when the function buttons A to D are displayed on the menu screen and the pinch-in is performed, the function button selection unit 122 selects the function buttons A to D already incorporated in the menu screen. In addition to the above, function buttons E to K to be newly incorporated are incorporated, and a menu screen as shown in the middle of FIG. 8 is obtained. Further, in the example of FIG. 8, the function button arrangement unit 123 reduces the size of each function button, and newly incorporates the function buttons E to K outside the function buttons A to D already incorporated in the menu screen. It is arranged. Thereby, a visual effect is obtained as if the entire menu screen is reduced.

Although FIG. 8 shows an example in which a plurality of function buttons are arranged in a matrix, the function buttons may be arranged in a honeycomb as shown in FIG. When a plurality of function buttons are arranged in a honeycomb shape, the function buttons are arranged to be shifted by 1⁄2 pitch, and an effect of reducing an erroneous pressing of the function button by the user can be expected.

Further, in FIG. 8, when the number of function buttons is increased, the function buttons newly incorporated in the menu screen belong to the same hierarchy (first hierarchy) as the function buttons already incorporated in the menu screen. However, as shown in FIG. 10, for example, the function buttons to be newly incorporated into the menu screen may belong to a lower layer (the second or third layer) than the function buttons already incorporated into the menu screen. . Also in this case, as shown in FIG. 11, a plurality of function buttons may be arranged in a honeycomb shape.

Further, in FIG. 11, the function button to be newly incorporated in the menu screen is disposed on the outer periphery of the function button already incorporated in the menu screen, but as in the lower part of FIG. A function button to be newly incorporated into the menu screen may be arranged so as to surround each of. In the lower part of FIG. 12, the function buttons A-1 to A-6 in the lower hierarchy are arranged to surround the function button A, and the function buttons B-1 to B in the lower hierarchy to surround the function button B. 6 are arranged, and the function buttons C-1 to C-6 in the lower hierarchy are arranged so as to surround the function button C. In this manner, the user can easily find the desired function button by dividing the area to be arranged for each function button category.

In the first embodiment, the first gesture operation is defined as pinch in and the second gesture operation is defined as pinch out, but the first gesture operation and the second gesture operation are not limited to them. For example, contrary to the above example, the first gesture operation may be pinched out and the second gesture operation may be pinched in.

In particular, when the first gesture operation and the second gesture operation are contradictory operations, the user can increase / decrease the number of function buttons with an intuitive gesture operation. For example, one of the first gesture operation and the second gesture operation may be a flick operation in a direction approaching the center of the menu screen, and the other may be a flick operation in a direction away from the center of the menu screen. For example, the first gesture operation may be a rotation operation in a first rotation direction, and the second gesture operation may be a rotation operation in a second rotation direction (a direction opposite to the first rotation direction).

In addition, the touch panel 20 may be capable of detecting a non-contact gesture operation (a gesture operation performed by the user without touching the touch panel 20). In that case, the first gesture operation and the second gesture operation may be non-contact gesture operations.

Second Embodiment
In the second embodiment, when the number-of-function-buttons control unit 121 increases the number of function buttons according to the first gesture operation, the function-button arrangement unit 123 selects the menu screen based on the direction of the first gesture operation. Set the layout of each function button embedded in. More specifically, the function button arrangement unit 123 sets, based on the direction of the first gesture operation, the positional relationship between the function button already incorporated in the menu screen and the function button to be newly incorporated.

The directions of pinch in and pinch out can be defined, for example, as shown in FIG. That is, rightward pinch-in can be defined as pinch-in in which only one of the two fingers touched on the touch panel 20 is slid in the right direction. In addition, the leftward pinch-in can be defined as a pinch-in in which only one of two fingers is slid in the left direction. Similarly, rightward pinch out can be defined as pinch out in which only one of two fingers is slid rightward. Further, leftward pinch out can be defined as pinch out in which only one of two fingers is slid leftward.

FIG. 14 is an example of change of the menu screen displayed on the touch panel 20 in the information processing system 100 of the second embodiment. As shown in FIG. 14, when leftward pinch-in is performed with the menu screen having the function buttons A to D displayed on the touch panel 20, the function buttons A to D are moved to the left, and a space (function buttons New function buttons E and F are added to the right of A to D). When a menu screen having function buttons A to D is displayed and the upward pinch-in is performed, the function buttons A to D are moved upward, and a vacant space (lower side of the function buttons A to D) New function buttons E and F are added to. Also, when the menu screen having the function buttons A to D is displayed, when the left upward pinch-in is performed, the function buttons A to D are moved to the upper left, and the vacant space (right side of the function buttons A to D and New function buttons E to H are added to the lower side).

As described above, according to the second embodiment, the user can specify the arrangement of function buttons to be added to the menu screen according to the direction of the first gesture operation.

Embodiment 3
In the third embodiment, when the number-of-function-buttons control unit 121 increases the number of function buttons in response to the first gesture operation, the function-button selection unit 122 generates a row for which function button the first gesture operation is performed. The function button to be newly incorporated into the menu screen is selected in consideration of whether it has been.

FIGS. 15 to 19 show examples of changes in the menu screen displayed on the touch panel 20 in the information processing system 100 according to the third embodiment.

In the example shown in FIG. 15, the function button selection unit 122 is a function button for incorporating a function button of a layer under the function button into the menu screen, instead of the function button for which the pinch-in (first gesture operation) has been performed. Choose as. At this time, the function button arrangement unit 123 arranges the function buttons of the layer below the function button at the position where the function button on which the pinch-in has been performed is arranged.

That is, as shown in FIG. 15, when the pinch-in is performed on the function button A, the function button selection unit 122 replaces the function button A with the function buttons A-1 and A in the lower hierarchy of the function button A. -2, A-3, A-4 are incorporated into the menu screen. At this time, the function button arrangement unit 123 arranges the function buttons A-1, A-2, A-3, A-4 at the position where the function button A is arranged (that is, the function button A Replace with button A-1, A-2, A-3, A-4).

Furthermore, when the pinch-in is performed on the function button A-1, the function button selection unit 122 replaces the function button A-1 with the function buttons A-1-1 in the hierarchy below the function button A-1. Install A-1-2, A-1-3, and A-1-4 into the menu screen. At this time, the function button arrangement unit 123 arranges the function buttons A-1-1, A-1-2, A-1-3 and A-1-4 at the position where the function button A-1 was arranged. (Ie, replace function button A-1 with function buttons A-1-1, A-1-2, A-1-3, A-1-4).

In addition, when pinch-in is performed across a plurality of function buttons, each of the plurality of function buttons for which the pinch-in has been performed may be replaced with the function button of the lower hierarchy. For example, as shown in FIG. 16, when pinch-in is performed across function buttons A and D, function button selection unit 122 substitutes function button A for a function button A- of a lower hierarchy of function button A. 1, A-2, A-3 and A-4 are incorporated in the menu screen, and in place of the function button D, the function buttons D-1, D-2, D-3 and D in the hierarchy below the function button D -4 is incorporated into the menu screen. At this time, the function button arrangement unit 123 arranges the function buttons A-1, A-2, A-3, A-4 at the position where the function button A was arranged, and the function button D is arranged. Position the function buttons D-1, D-2, D-3, D-4.

FIG. 17 shows an example in which the present embodiment is applied to a menu screen in which function buttons are arranged in a honeycomb shape. In the example of FIG. 17, when the pinch-in is performed on the function button A, the function button selection unit 122 adds the function buttons A-1 to A-6 in the hierarchy below the function button A in addition to the function button A. , Incorporate into the menu screen. At this time, the function button arrangement unit 123 arranges the function button A and the function buttons A-1 to A-6 at the position where the function button A is arranged. The function buttons A-1 to A-6 are arranged to surround the function button A.

In the example of FIGS. 15 to 17, the function button arranging unit 123 arranges the function buttons in the lower hierarchy of the function button at the position where the function button on which the first gesture operation has been performed has been arranged. That is, the area in which the function button on which the first gesture operation is performed is arranged is equal to the area in which the function button in the layer below the function button is arranged.

However, for example, as shown in FIG. 18, the function buttons in the hierarchy below the function button are arranged in an area larger than the area in which the function button on which the first gesture operation (pinch-in) was performed is arranged. You may That is, a part of the newly added function buttons (lower level function buttons) may be overlapped on the function buttons already incorporated in the menu screen. By doing so, the size of the newly added function button can be prevented from being excessively reduced, and operability can be improved. At this time, the other function buttons (the function buttons arranged under the newly added function button) may be invalidated.

FIG. 19 shows an example in which the method of arranging the function buttons shown in FIG. 18 is applied to a menu screen in which the function buttons are arranged in a honeycomb shape. In the example of FIG. 19, a shadow decoration is added to the newly added function button to indicate that the newly added function button is placed on top of the other function buttons ( Shadow decorations may be applied to the example of FIG.

Fourth Preferred Embodiment
In the fourth embodiment, the display processing unit 11 causes the touch panel 20 to display a plurality of windows and causes the windows to display menu screens. Further, the menu screen control unit 12 controls the menu screen as in the first to third embodiments in each window. That is, the function button number control unit 121 controls the number of function buttons of the menu screen in each window. Also, the function button selection unit 122 selects a function button to be incorporated into the menu screen in each window. Further, the function button arrangement unit 123 sets the arrangement of function buttons on the menu screen in each window.

An example of the change of the menu screen in the fourth embodiment is shown in FIG. In the example of FIG. 20, a window W1 for displaying a menu screen having a function button A and a window W2 for displaying a menu screen having a function button B are displayed on the touch panel 20. As shown in FIG. 20, when pinch-in (first gesture operation) is performed on the window W1, the number of function buttons on the menu screen in the window W1 increases, and when pinch-in is performed on the window W2, the window W2 is displayed. The number of function buttons on the menu screen increases. In addition, when a pinch out (second gesture operation) is performed on the window W1, the number of function buttons on the menu screen in the window W1 decreases, and when a pinch out is performed on the window W2, the menu screen in the window W2 The number of function buttons is reduced.

The Fifth Preferred Embodiment
Also in the fifth embodiment, the display processing unit 11 causes the touch panel 20 to display a plurality of windows, and causes the windows to respectively display menu screens. Further, the menu screen control unit 12 controls the menu screen as in the first to third embodiments in each window. However, in the fifth embodiment, the first gesture operation is an operation to increase the size of the window, and the second gesture operation is an operation to reduce the size of the window. Here, the first gesture operation is pinch out for each window, and the second gesture operation is pinch in for each window. Further, the function button number control unit 121 sets the number of function buttons incorporated in the menu screen in each window according to the size of each window.

An example of the change of the menu screen in the fifth embodiment is shown in FIG. In the example of FIG. 21, a window W1 for displaying a menu screen having function button A, a window W2 for displaying a menu screen having function button B, and a window W3 for displaying a menu screen having function button C on touch panel 20 And a window W4 for displaying a menu screen having the function button D is displayed.

As shown in FIG. 21, when a pinch out (first gesture operation) is performed on the window W1, the window W1 becomes large, and the number of function buttons on the menu screen in the window W1 increases accordingly. In addition, when pinch-in (second gesture operation) is performed on the window W1, the window W1 becomes smaller, and the number of function buttons on the menu screen in the window W1 decreases accordingly.

Embodiment 6
In the sixth embodiment, it is assumed that in the information processing system 100, as shown in FIG. 22, the display device 21 and the operation input device 22 of the information processing system 100 are configured as separate devices. Further, the function button number control unit 121 of the menu screen control unit 12 sets an initial value of the number of function buttons (the number of function buttons) incorporated in the menu screen according to the screen size of the display device 21.

As shown in FIG. 23, for example, when the user interface control device 10 is connected to the display device 21 which is a head-up display (HUD) having a small screen size, the function button number control unit 121 initially performs the function button number. Set the value to "4". Also, for example, when the user interface control device 10 is connected to the display device 21 which is a small screen monitor (screen size is larger than HUD), the function button number control unit 121 sets the initial value of the function button number Set to 12 ". Furthermore, for example, when the user interface control device 10 is connected to the display device 21 which is a large screen monitor, the function button number control unit 121 sets the initial value of the function button number to “48”.

According to the present embodiment, since the initial value of the number of function buttons incorporated in the menu screen is set according to the screen size of the display device 21, the display device 21 can When replacing, etc., the time and effort for the user to adjust the number of function buttons can be reduced, and the convenience is improved.

Seventh Embodiment
In the seventh embodiment, the function button number control unit 121 of the menu screen control unit 12 controls the number of function buttons to be incorporated in the menu screen according to the size of the display area of the menu screen in the display device 21 (or the touch panel 20). Set the initial value of the number of function buttons).

FIGS. 24 to 26 show examples of menu screens displayed on the display device 21 when the display device 21 is a display panel (meter panel) for displaying a meter of a vehicle. As shown in FIGS. 24 to 26, in the display device 21 as a meter panel, the user can change the number and size of meters to be displayed, and the size of the display area of the menu screen changes accordingly.

For example, as shown in FIG. 24, when the size of the display area of the menu screen in the display device 21 is small, the function button number control unit 121 sets the initial value of the function button number to “4”. Also, for example, when the user reduces the size of the meter as shown in FIG. 25 and the size of the display area of the menu screen increases, the function button number control unit 121 sets the initial value of the function button number to “8”. Do. Also, for example, when the user reduces the number of meters as shown in FIG. 26 and the size of the display area of the menu screen further expands, the function button number control unit 121 sets the initial value of the function button number to “12”. Do.

According to the present embodiment, the initial value of the number of function buttons to be incorporated into the menu screen is set according to the size of the display area of the menu screen in display 21. Therefore, when changing the size of the display area of the menu screen The time and effort for the user to adjust the number of function buttons can be reduced, and convenience is improved.

In the present invention, within the scope of the invention, each embodiment can be freely combined, or each embodiment can be appropriately modified or omitted.

Although the present invention has been described in detail, the above description is an exemplification in all aspects, and the present invention is not limited thereto. It is understood that countless variations not illustrated are conceivable without departing from the scope of the present invention.

100 information processing system 10 user interface control device 11 display processing unit 12 menu screen control unit 13 operation recognition unit 20 touch panel 21 display device 22 operation input device 121 function button number control unit 122 function button selection Part, 123 Function button placement part, 30 information processing devices, 50 processing circuits, 51 processors, 52 memories.

Claims

A display processing unit that causes a display device to display a menu screen in which at least one of a plurality of predetermined function buttons is incorporated;
A menu screen control unit for controlling the number and arrangement of function buttons incorporated in the menu screen;
An operation recognition unit that recognizes an operation input to the operation input device;
Equipped with
When the first predetermined gesture operation is input to the operation input device, the menu screen control unit increases the number of function buttons to be incorporated in the menu screen, and the second predetermined gesture operation is performed by the user. Decrease the number of function buttons to be incorporated into the menu screen when input to the operation input device,
User interface controller.
The menu screen control unit
A function button number control unit that increases or decreases the number of function buttons, which is the number of function buttons incorporated in the menu screen, according to the first gesture operation and the second gesture operation;
A function button selection unit for selecting function buttons to be incorporated in the menu screen by the same number as the number of the function buttons;
A function button arrangement unit configured to set the arrangement of the function button selected by the function button selection unit;
Equipped with
The user interface control device according to claim 1.
The function button selection unit adds a function button to be newly incorporated into the menu screen to a function button already incorporated in the menu screen, when the number of function buttons increases in response to the first gesture operation.
The user interface control device according to claim 2.
The plurality of function buttons are hierarchized,
The user interface control device according to claim 3, wherein the function button newly incorporated in the menu screen is a function button in a hierarchy below the function button already incorporated in the menu screen.
When the number of function buttons increases in response to the first gesture operation, the function button arrangement unit newly adds a function button already incorporated in the menu screen based on the direction of the first gesture operation. The user interface control device according to claim 3, wherein the positional relationship with the built-in function button is set.
The plurality of function buttons are hierarchized,
When the first gesture operation is performed on any of the function buttons:
The function button selection unit selects a function button of a layer under the function button, instead of the function button on which the first gesture operation has been performed.
The user interface control device according to claim 3.
The function button arranging unit arranges a function button of a layer under the function button at a position where the function button on which the first gesture operation has been performed is arranged.
The user interface control device according to claim 6.
The function button arranging unit arranges the function buttons of the layer under the function button in an area larger than the area in which the function button on which the first gesture operation has been performed is arranged.
The user interface control device according to claim 6.
9. The user interface control device according to claim 8, wherein when the lower layer function buttons are displayed on the menu screen, the other function buttons are disabled.
The display processing unit displays the menu screen in a window displayed on the display device.
The first gesture operation is an operation to increase the size of the window,
The second gesture operation is an operation to reduce the size of the window,
The user interface control device according to claim 1, wherein the menu screen control unit sets the number of function buttons to be incorporated in the menu screen according to the size of the window.
The user interface control according to claim 1, wherein the menu screen control unit sets an initial value of the number of function buttons to be incorporated in the menu screen according to the screen size of the display device or the size of the display area of the menu screen. apparatus.
The user interface control device according to claim 1, wherein the menu screen control unit arranges function buttons in a honeycomb shape on the menu screen.
The user interface control device according to claim 1, wherein the display device and the operation input device constitute one touch panel.
The user interface control device according to claim 1, wherein the first gesture operation is one of a pinch in operation and a pinch out operation, and the second gesture operation is the other.
The first gesture operation is one of a flick operation in the direction approaching the center of the menu screen and a flick operation in the direction away from the center of the menu screen, and the second gesture operation is the other. The user interface control device according to claim 1.
The first gesture operation is a rotation operation in a first rotation direction,
The second gesture operation is a rotation operation in a second rotation direction.
The user interface control device according to claim 1.
The first gesture operation and the second gesture operation include non-contact gestures.
The user interface control device according to claim 1.
A method of displaying a menu screen in a user interface control device, comprising:
The display processing unit of the user interface control device causes the display device to display a menu screen in which at least one of a plurality of predetermined function buttons is incorporated;
The operation recognition unit of the user interface control device recognizes an operation input to the operation input device,
When the first predetermined gesture operation is input to the operation input device, the menu screen control unit of the user interface control device increases the number of function buttons to be incorporated into the menu screen, and the second predetermined operation is performed. When the gesture operation of is input to the operation input device, the number of function buttons incorporated in the menu screen is reduced.
Menu screen display method.