WO2023100537A1

WO2023100537A1 - Control device, control method, and program

Info

Publication number: WO2023100537A1
Application number: PCT/JP2022/039665
Authority: WO
Inventors: 光雄折戸
Original assignee: 株式会社東海理化電機製作所
Priority date: 2021-12-01
Filing date: 2022-10-25
Publication date: 2023-06-08
Also published as: JP2023081430A

Abstract

[Problem] To enable suppression of deterioration in a feeling of use provided to a user. [Solution] Provided is a control device provided with a control unit for controlling a display, performed by a display device, of first selection candidates that respectively correspond to a plurality of functions along a direction that corresponds to a first axis, and controlling a display, performed by the display device, of second selection candidates that respectively correspond to a plurality of functions at positions moved from the positions of the first selection candidates in a direction that corresponds to a prescribed direction on a second axis different from the first axis. The control unit acquires, from an operation input device, a detection position of a finger of a user on the first axis and a movement direction of the finger that extends along the second axis, as detected by the operation input device provided separately from the display device, and selects a selection candidate that corresponds to the detection position and the movement direction from the first selection candidates and the second selection candidates.

Description

Control device, control method and program

The present invention relates to a control device, control method and program.

In recent years, there has been known a technique for displaying selection candidates on a screen that can be selected based on a user's operation. For example, a technique is disclosed in which the front operation surface of a double-sided touch panel is arranged on the front side of a steering wheel and the back operation surface of a double-sided touch panel is arranged on the back side of the steering wheel (see, for example, Patent Document 1). With this technology, when it is detected that a finger has entered the back operation surface, selection candidates that can be selected by operating the back operation surface are displayed.

Japanese Patent Application Laid-Open No. 2020-102066

However, it is required to suppress the deterioration of usability given to the user.

Therefore, the present invention has been made in view of the above problems, and an object of the present invention is to make it possible to suppress deterioration in usability given to the user.

In order to solve the above problems, according to an aspect of the present invention, display of first selection candidates corresponding to each of a plurality of functions along a direction corresponding to a first axis is controlled by a display device, The display of second selection candidates corresponding to each of a plurality of functions at positions moved from the position of the first selection candidate in a direction corresponding to a predetermined direction of a second axis different from the first axis. a control unit configured to control display by the device, wherein the control unit controls the detected position of the user's finger on the first axis detected by an operation input device provided separately from the display device; and a moving direction of the finger along two axes are obtained from the operation input device, and a selection candidate corresponding to the detected position and the moving direction is selected from the first selection candidate and the second selection candidate. A controller is provided to select.

In order to solve the above problems, according to another aspect of the present invention, display by a display device of first selection candidates corresponding to each of a plurality of functions along a direction corresponding to a first axis is controlled. In addition, second selection candidates corresponding to each of the plurality of functions are provided at positions moved from the position of the first selection candidate in a direction corresponding to a predetermined direction of a second axis different from the first axis. and a detected position of the user's finger on the first axis detected by an operation input device provided separately from the display device, and on the second axis obtaining from the operation input device the moving direction of the finger along the finger, and selecting a selection candidate according to the detected position and the moving direction from the first selection candidate and the second selection candidate. A control method is provided, comprising:

In order to solve the above problems, according to another aspect of the present invention, a computer is configured to display first selection candidates respectively corresponding to a plurality of functions along a direction corresponding to a first axis. A second axis corresponding to each of a plurality of functions is moved from the position of the first selection candidate in a direction corresponding to a predetermined direction of a second axis different from the first axis. a control unit for controlling display by the display device of the selection candidates of the user's finger on the first axis detected by an operation input device provided separately from the display device A detected position and a moving direction of the finger along the second axis are acquired from the operation input device, and the detected position and the moving direction are obtained from the first selection candidate and the second selection candidate. A program functioning as a control device is provided that selects a selection candidate according to.

As described above, according to the present invention, it is possible to suppress deterioration in usability given to the user.

It is a figure which shows the example of the appearance of the system which concerns on embodiment of this invention. FIG. 10 is a diagram for explaining an example of detection of a finger moving direction along the Y-axis; It is a figure which shows the functional structural example of a control apparatus. 4 is a flow chart showing an operation example of the control device according to the embodiment of the present invention;

Preferred embodiments of the present invention will be described in detail below with reference to the accompanying drawings. In the present specification and drawings, constituent elements having substantially the same functional configuration are denoted by the same reference numerals, thereby omitting redundant description.

<1. embodiment>
Details of embodiments of the present invention will be described.

(1.1. System configuration)
First, a configuration example of a system according to an embodiment of the present invention will be described with reference to FIG.

FIG. 1 is a diagram showing an example of the appearance of a system according to an embodiment of the present invention. As shown in FIG. 1, a system 1 according to an embodiment of the present invention includes an operation input device 10 and a display device 20. FIG. Note that the system 1 further includes a control device 30 (FIG. 3) as will be described later.

In the embodiment of the present invention, it is mainly assumed that the system 1 is installed inside the vehicle. In such a case, the user using the system 1 may be a user in the vehicle (for example, a driver, a person sitting in a front passenger seat, etc.). However, the place where the system 1 is installed is not limited to the interior of the vehicle.

Also, as shown in FIG. 1, in the embodiment of the present invention, it is assumed that the operation input device 10 and the display device 20 are provided separately. More specifically, in the embodiment of the present invention, unlike the configuration in which the operation input device 10 and the display device 20 are stacked (the configuration of a so-called touch panel), the operation input device 10 and the display device 20 are stacked. and separate configurations are employed.

Therefore, in the embodiment of the present invention, it is required to give the user a feeling that the operation on the operation input device 10 and the display by the display device 20 are linked.

(Display device 20)
The display device 20 displays various information under the control of the control device 30 (FIG. 3). Here, the type of display device 20 is not limited. For example, the display device 20 may be an LCD (Liquid Crystal Display), an organic EL (Electro-Luminescence) display, or a PDP (Plasma Display Panel).

Referring to FIG. 1, an example of displaying icons I1 to I8 is shown. Each of the icons I1 to I8 is an example of selection candidates. Therefore, some or all of the icons I1 to I8 displayed by the display device 20 may be replaced with selection candidates other than the icons. For example, a selection candidate may be any object that is displayed to be visually perceived by the user.

Icons I1, I3, I5, and I7 (first selection candidates) form an upper row of icons. On the other hand, icons I2, I4, I6, and I8 (second selection candidates) form the lower row of icons. Here, it is mainly assumed that the number of icons forming the upper row of icons is four, and the number of icons forming the lower row of icons is four. However, the number of icons forming each of the upper icon row and the lower icon row may be plural.

Icons I1 to I8 are icons corresponding to functions. Icons I1, I2, I7, and I8 are icons for adjusting detailed contents of functions (hereinafter also referred to as "function adjustment icons"). Each time one of these function adjustment icons is selected, the details of the function are adjusted. Icons I3 to I6 are icons for activating functions (hereinafter also referred to as "function activation icons"). Each time one of these feature activation icons is selected, the feature is activated or deactivated.

More specifically, the icon I1 is an icon corresponding to control to increase the audio volume. The icon I2 is an icon corresponding to control for decreasing the audio volume. Icon I3 is an icon corresponding to the cooling function and the dehumidification function. Icon I4 is an icon corresponding to the automatic setting function of the air conditioner.

Icon I5 is an icon that corresponds to the function (independent mode) of independently adjusting the set temperature on the driver's seat side and the front passenger's seat side. When this function is stopped, it switches to a function (interlocking mode) in which the set temperatures on the driver's side and passenger's side are interlocked. Icon I6 is an icon corresponding to a defroster function for removing fog from the windshield. The icon I7 is an icon corresponding to control for increasing the temperature, which is the reference for adjustment by the air conditioner. The icon I8 is an icon corresponding to the control of lowering the temperature that is the reference for adjustment by the air conditioner.

Note that the types of functions corresponding to the icons I1 to I8 are not limited to these examples. Also, in the example shown in FIG. 1, icons I1 to I8 are displayed superimposed on the map. However, the icons I1 to I8 may be displayed superimposed on display contents other than the map. Alternatively, the icons I1 to I8 may be displayed without being superimposed on other display contents.

(Operation input device 10)
The operation input device 10 includes an operation unit 110 that receives an operation input by a user's finger. The operation unit 110 has an operation surface 115 with which the user touches with a finger when inputting an operation. The operation surface 115 is provided with a sensor that detects the contact of the user's finger. As an example of such a sensor, an electrostatic sensor can be used, but the type of sensor is not particularly limited.

The operation unit 110 detects the position of the user's finger on the X axis (first axis) as the detection position. More specifically, the operation unit 110 detects the contact position of the user's finger on the operation surface 115 on the X axis as the detection position.

Furthermore, the operation unit 110 detects the moving direction of the user's finger along the Y axis (second axis). More specifically, the operation unit 110 detects the direction in which the user moves the finger along the Y-axis while touching the operation surface 115 as the finger movement direction. Here, an example of detection of the moving direction of the finger along the Y-axis will be described with reference to FIG.

FIG. 2 is a diagram for explaining an example of detection of the finger movement direction along the Y-axis. As shown in FIG. 2, display device 20 has display surface 215 . A screen is displayed on the display surface 215 . The operation unit 110 includes a tact switch 120a and a tact switch 120b.

For example, when the user moves the finger in the +Y direction while touching the operation surface 115, the operation unit 110 moves so that the direction of the operation surface 115 approaches the horizontal direction (that is, counterclockwise in FIG. 2). It rotates and the tact switch 120a is pressed. The operation unit 110 detects the movement of the finger in the +Y direction as the movement direction of the finger by detecting the pressing of the tact switch 120a.

On the other hand, when the user moves the finger in the -Y direction while touching the operation surface 115, the operation unit 110 is moved so that the direction of the operation surface 115 approaches the vertical direction (that is, clockwise in FIG. 2). It rotates and the tact switch 120b is pressed. The operation unit 110 detects the movement of the finger in the -Y direction as the movement direction of the finger by detecting the depression of the tactile switch 120b.

Note that the detection of the finger movement direction along the Y-axis is not limited to this example. For example, instead of tact switch 120a and tact switch 120b, other switches (eg, two contact rubber switches, etc.) may be used. Alternatively, a sensor capable of detecting a finger moved in the +Y direction and a sensor capable of detecting a finger moved in the -Y direction may be additionally provided. At this time, the operation unit 110 does not have to rotate with the movement of the finger. As an example of the sensor, an electrostatic sensor can be used, but the type of sensor is not particularly limited.

Return to Figure 1 and continue the explanation. The X-axis direction and the Y-axis direction are different directions. As shown in FIG. 1, the X and Y axes may be orthogonal. For example, as shown in FIG. 1 , the X-axis may be the longitudinal direction of the operating surface 115 and the Y-axis may be the lateral direction of the operating surface 115 . The Z-axis is orthogonal to both the X-axis and the Y-axis.

For example, the operation surface 115 may be a concave surface curved along the Y-axis. This makes it easier for the operation surface 115 to fit the pad of the finger, so that the usability during operation by the user and the detection accuracy of the contact position of the finger on the operation surface 115 can be improved. The operation input device 10 transmits the detected position of the user's finger on the X-axis to the control device 30 . Furthermore, the operation input device 10 transmits the direction of movement of the user's finger along the Y-axis to the control device 30 .

Here, as an example, it is mainly assumed that the user wants to activate the function corresponding to icon I3 or I4. At this time, as shown in FIG. 1, the user touches a position corresponding to icon I3 or icon I4 on the X-axis on operation surface 115 with a finger. Then, the user moves the finger in the +Y direction or the -Y direction along the Y-axis while touching the operation surface 115 with the finger.

The contact position of the finger on the operation surface 115 on the X-axis is acquired by the control device 30 via the operation input device 10 as a detection position. Also, the direction of movement of the finger along the Y-axis while touching the operation surface 115 is acquired by the control device 30 via the operation input device 10 . It should be noted that similar operations can be performed by the system 1 when an icon other than the icon I3 and the icon I4 is selected.

(control device 30)
Controller 30 may be implemented by a computer. The control device 30 is connected to the operation input device 10 wirelessly or by wire. Further, the control device 30 is connected to the display device 20 wirelessly or by wire. Note that the control device 30 may be integrated with the operation input device 10 or the display device 20 . A configuration example of the control device 30 will be described with reference to FIG.

FIG. 3 is a diagram showing an example of the functional configuration of the control device 30. As shown in FIG. As shown in FIG. 3 , the control device 30 includes an input section 310 , a control section 320 , a storage section 330 and an output section 340 .

(Input unit 310)
The input unit 310 functions as an input interface with the operation input device 10 . More specifically, the input unit 310 receives input of the detected position of the user's finger on the X-axis, which is transmitted from the operation input device 10 . The input unit 310 outputs the detected position of the user's finger on the X-axis to the control device 30 .

Furthermore, the input unit 310 receives an input of the moving direction of the user's finger along the Y-axis, which is transmitted from the operation input device 10 . The input unit 310 outputs the movement direction of the user's finger along the Y-axis to the control device 30 .

(control unit 320)
Control unit 320 includes a processor, and its functions can be realized by the processor executing a program stored in a memory. At this time, a computer-readable recording medium recording the program may also be provided. Alternatively, these blocks may be composed of dedicated hardware, or may be composed of a combination of multiple pieces of hardware.

For example, the control unit 320 acquires the detected position of the user's finger on the X-axis output from the input unit 310 . Control unit 320 outputs a control signal for controlling display by display device 20 to output unit 340 based on the detected position of the user's finger on the X axis. Details of such display control executed by the control unit 320 will be described later.

Furthermore, the control unit 320 acquires the moving direction of the user's finger along the Y-axis output from the input unit 310 . The control unit 320 outputs a control signal for controlling display by the display device 20 to the output unit 340 based on the moving direction of the user's finger along the Y-axis. Details of such display control executed by the control unit 320 will be described later.

(storage unit 330)
The storage unit 330 appropriately stores data necessary for computation by the processor. The storage unit 330 may be composed of a memory such as a RAM (Random Access Memory), a hard disk drive, or a flash memory.

(Output unit 340)
The output unit 340 functions as an output interface with the display device 20 . More specifically, the output section 340 outputs the control signal output from the control section 320 to the display device 20 . Thereby, the control of the display by the display device 20, which is executed by the control unit 320, can be realized.

(Details of control unit 320)
Next, details of the functions of the control unit 320 will be described with reference to FIG. As shown in FIG. 1, the controller 320 controls the display device 20 to display the upper row of icons (icons I1, I3, I5, I7). Furthermore, the control unit 320 controls the display device 20 so that the lower row of icons (icons I2, I4, I6, and I8) is displayed by the display device 20 .

More specifically, the control unit 320 controls the display device 20 so that the upper row of icons (icons I1, I3, I5, I7) is displayed along the direction corresponding to the X axis. Furthermore, the control unit 320 causes the lower row of icons (icons I2, I4, I6, I8) to move in a direction (here, the display device The display device 20 is controlled so that it is displayed at a position moved downward on the screen displayed by 20).

According to this configuration, not only the upper row of icons but also the lower row of icons are displayed, so it is possible to increase the number of displayed icons.

Furthermore, the direction of each of the upper icon row and the lower icon row corresponds to the X axis, which is the direction in which the finger detection position changes. Therefore, it is possible to give the user the feeling that the operation on the operation input device 10 and the display by the display device 20 are linked.

Furthermore, according to this configuration, the direction from the upper icon to the lower icon corresponds to the Y-axis, which is the finger movement direction detected by the operation unit 110 . Therefore, it is possible to give the user the feeling that the operation on the operation input device 10 and the display by the display device 20 are linked.

Giving the user the feeling that the operation on the operation input device 10 and the display by the display device 20 are linked in this way can lead to the effect of suppressing the deterioration of the user's feeling of use.

As an example, the direction corresponding to the X-axis should be the left-right direction of the screen, and the direction of the X-axis should match the left-right direction of the screen. As a result, the direction in which the finger detection position changes coincides with the direction in which the upper row of icons (or the lower row of icons) is displayed. It is possible to give the user a stronger sense of cooperation. In the example shown in FIG. 1, the right direction is the +X direction and the left direction is the -X direction.

Furthermore, the direction corresponding to the Y-axis is preferably the vertical direction of the screen, and the direction of the Y-axis is preferably the depth direction as seen from the user. As a result, the direction of the upper icon or the lower icon and the finger movement direction match with the position sandwiched between the upper icon and the lower icon. It is possible to give the user a stronger feeling that the display by 20 is linked. In the example shown in FIG. 1, the direction from front to back is the +Y direction, and the direction from back to front is the -Y direction.

When the user touches a position corresponding to the icon I3 or the icon I4 on the operation surface 115, the operation input device 10 detects the contact position of the user's finger on the X axis as the detection position of the finger on the X axis. 320 obtains the detected position of the finger on the X-axis. The control unit 320 controls display by the display device 20 of predetermined feedback information according to the detected position of the finger on the X-axis. This allows the user to grasp which icon the position corresponding to has been detected.

More specifically, the control unit 320 controls the icon I3 corresponding to the detected position in the upper row of icons (icons I1, I3, I5, I7) and the The display of the feedback information F1 by the display device 20 is controlled at a position sandwiched between the icon I4 corresponding to the detection position.

Note that FIG. 1 shows, as an example of the feedback information F1, a case where the feedback information is displayed with a higher luminance than the luminance of other places where the feedback information is not displayed. However, the feedback information F1 is not limited to such an example. For example, the feedback information F1 may be displayed in some manner different from the display at other locations where the feedback information F1 is not displayed.

When the user moves the finger along the Y-axis while touching the operation surface 115, the operation input device 10 detects the moving direction of the finger along the Y-axis (+Y direction or -Y direction). The direction of finger movement along the Y-axis is obtained by 320 . Control unit 320 selects an icon from icons I1 to I8 in accordance with the detection position and movement direction. Here, icon I3 or icon I4 is selected.

For example, when the direction of finger movement is the opposite direction (+Y direction) of the predetermined direction of the Y axis (−Y direction), the control unit 320 changes the upper row of icons (icons I1, I3, I5, I7). Among them, the icon I3 corresponding to the detected position is selected. On the other hand, when the moving direction of the finger is the predetermined direction of the Y-axis (-Y direction), the control unit 320 selects the icon corresponding to the detection position among the lower row of icons (icons I2, I4, I6, I8). Select I4.

The control unit 320 activates the function corresponding to the selected icon I3 or icon I4. For example, when the icon I3 is selected, the control unit 320 activates the cooling function and the dehumidifying function if the cooling function and the dehumidifying function are stopped. On the other hand, when the icon I3 is selected, the control unit 320 stops the cooling function and the dehumidifying function if the cooling function and the dehumidifying function are activated.

For example, when the icon I4 is selected, the control unit 320 activates the automatic setting function of the air conditioner if the automatic setting function of the air conditioner is stopped. On the other hand, when the icon I4 is selected, the control unit 320 stops the automatic setting function of the air conditioner when the automatic setting function of the air conditioner is activated.

The configuration example of the system 1 according to the embodiment of the present invention has been described above.

(1.2. Operation of the control device)
Next, an operation example of the control device 30 according to the embodiment of the present invention will be described with reference to FIG. 4 (also referring to FIGS. 1 to 3 as appropriate).

FIG. 4 is a flow chart showing an operation example of the control device 30 according to the embodiment of the present invention. First, the control unit 320 controls the display device 20 so that the upper row of icons (icons I1, I3, I5, I7) is displayed along the direction corresponding to the X axis. Furthermore, the control unit 320 controls the lower row of icons (icons I2, I4, I6, and I8) to be displayed at a position shifted downward from the upper row of icons on the screen displayed by the display device 20. It controls the display device 20 .

When the user touches the position corresponding to the icon on the operation surface 115 with the finger, the operation input device 10 detects the contact position of the user's finger on the X axis as the detection position of the finger on the X axis. Then, as shown in FIG. 4, the detected position of the finger on the X-axis is acquired by the controller 320 (S11).

The control unit 320 controls display by the display device 20 of predetermined feedback information according to the detected position of the finger on the X axis. More specifically, the control unit 320 detects an icon corresponding to the detection position in the upper row of icons (icons I1, I3, I5, I7), and detects an icon from the lower row of icons (icons I2, I4, I6, I8). The display by the display device 20 of the feedback information is controlled at the position sandwiched between the icon corresponding to the position.

When the user moves the finger along the Y-axis while touching the operation surface 115, the operation input device 10 detects the moving direction of the finger along the Y-axis (+Y direction or -Y direction). The direction of finger movement along the Y-axis is obtained by 320 . Control unit 320 selects an icon from icons I1 to I8 in accordance with the detection position and movement direction.

For example, when the moving direction of the finger is the +Y direction (“+Y direction” in S13), the control unit 320 selects the detected position from among the icon rows (icons I1, I3, I5, I7) corresponding to the +Y direction. The icon to be selected is selected (S14). On the other hand, when the finger movement direction is the -Y direction, the control unit 320 selects an icon corresponding to the detection position from among the icon rows (icons I2, I4, I6, I8) corresponding to the -Y direction ( S15).

The control unit 320 performs control corresponding to the function corresponding to the selected icon. For example, when the selected icon is the function adjustment icon, the control unit 320 performs control to adjust the detailed content of the function. Alternatively, when the selected icon is the function activation icon, control unit 320 activates or deactivates the function.

The operation example of the control device 30 according to the embodiment of the present invention has been described above.

(1.3. Effect)
Next, the effects of the embodiment of the present invention will be described. As described above, the control unit 320 controls the display device 20 so that the upper row of icons (icons I1, I3, I5, I7) is displayed along the direction corresponding to the X axis.

Furthermore, the control unit 320 causes the lower row of icons (icons I2, I4, I6, I8) to move in a direction (here, the display device The display device 20 is controlled so that it is displayed at a position moved downward on the screen displayed by 20).

<2. Supplement>
Although the preferred embodiments of the present invention have been described in detail above with reference to the accompanying drawings, the present invention is not limited to such examples. It is obvious that a person having ordinary knowledge in the technical field to which the present invention belongs can conceive of various modifications or modifications within the scope of the technical idea described in the claims. It is understood that these also belong to the technical scope of the present invention.

10: operation input device, 110: operation unit, 115: operation surface, 120: tact switch, 20: display device, 215: display surface, 30: control device, 310: input unit, 320: control unit, 330: storage unit , 340: output unit

Claims

controlling display by a display device of first selection candidates corresponding to each of a plurality of functions along a direction corresponding to a first axis, and a position of the first selection candidate that differs from the first axis; a control unit for controlling display by the display device of second selection candidates corresponding to each of a plurality of functions at a position moved in a direction corresponding to a predetermined direction of the second axis;
The control unit controls a detected position of the user's finger on the first axis and a moving direction of the finger along the second axis, which are detected by an operation input device provided separately from the display device. is obtained from the operation input device, and a selection candidate corresponding to the detected position and the moving direction is selected from the first selection candidate and the second selection candidate,
Control device.
The control unit controls display by the display device of predetermined feedback information corresponding to the detected position.
A control device according to claim 1 .
The control unit stores the feedback information at a position sandwiched between a selection candidate corresponding to the detection position among the first selection candidates and a selection candidate corresponding to the detection position among the second selection candidates. controlling display by the display device;
3. A control device according to claim 2.
The control unit selects a selection candidate corresponding to the detected position from among the first selection candidates when the moving direction is opposite to the predetermined direction.
A control device according to claim 1 .
The control unit selects a selection candidate corresponding to the detected position from among the second selection candidates when the moving direction is the predetermined direction.
A control device according to claim 1 .
The control unit activates a function corresponding to the selected selection candidate.
A control device according to claim 1 .
The control unit adjusts the detailed content of the function corresponding to the selected selection candidate.
A control device according to claim 1 .
controlling display by a display device of first selection candidates corresponding to each of a plurality of functions along a direction corresponding to a first axis, and a position of the first selection candidate that differs from the first axis; controlling display by the display device of second selection candidates corresponding to each of a plurality of functions at positions moved in a direction corresponding to a predetermined direction of the second axis;
The detection position of the user's finger on the first axis detected by an operation input device provided separately from the display device and the moving direction of the finger along the second axis are used as the operation input device. obtaining from an input device;
selecting a selection candidate according to the detection position and the movement direction from the first selection candidate and the second selection candidate;
control methods, including;
the computer,
controlling display by a display device of first selection candidates corresponding to each of a plurality of functions along a direction corresponding to a first axis, and different from the first axis from a position of the first selection candidate; a control unit for controlling display by the display device of second selection candidates corresponding to each of a plurality of functions at a position moved in a direction corresponding to a predetermined direction of the second axis;
The control unit controls a detected position of the user's finger on the first axis and a moving direction of the finger along the second axis, which are detected by an operation input device provided separately from the display device. is obtained from the operation input device, and a selection candidate corresponding to the detected position and the movement direction is selected from the first selection candidate and the second selection candidate,
A program that acts as a controller.