JP6014420B2 - Operation control device, operation control method, and program for operation control device - Google Patents

Description

  The present application belongs to the technical field of operation control devices, operation control methods, and programs for operation control devices. More specifically, the present invention belongs to a technical field of an operation control device, an operation control method, and an operation control device program for receiving an operation input from a user and controlling an operation target.

  An operation control device has been developed for operating electronic devices such as navigation while driving a vehicle as an example of a moving body. For example, Patent Document 1 below discloses a navigation / scrolling method in which a navigation screen is scrolled using a scroll switch of a steering wheel and a steering angle sensor.

JP 2001-66143 A

  However, since the technique described in Patent Document 1 only moves the navigation map in consideration of the steering angle, for example, the focus of the operation item on the screen such as the navigation screen is moved. Detailed operations on the operation items on the screen, such as specifying the operation item, are difficult, and it cannot be said that the user can easily input.

  Therefore, the present application has been made in view of the above problems, and an example of the problem is to provide an operation control device and the like that are easy for a user to input.

To solve the above problems, a first aspect of the present invention, the position information acquisition means for acquiring location information input surface of the input unit that receives an input from the User chromatography The is touched, to the attitude of the input section Angle information acquisition means for acquiring angle information; and contact speed calculation means for calculating a contact speed when the input surface is touched by the user, the position information, the angle information, and the contact speed . Based on this, an operation means for operating the operation target displayed on the display unit by the user is controlled .

According to a seventh aspect of the present invention, in the operation control method of the operation control device for controlling the operation means for the user to operate the operation target according to the plurality of operation items displayed on the display unit, the input from the user is received. A position information acquisition step of acquiring position information where the input surface of the input unit to be received is contacted; an angle information acquisition step of acquiring angle information regarding the posture of the input unit; and when the input surface is contacted by the user Control for controlling the operation means for the user to operate the operation target displayed on the display unit based on the contact speed calculation step for calculating the contact speed, the position information, the angle information, and the contact speed. And a step.

It is a block diagram which shows an example of schematic structure of the operation control apparatus which concerns on embodiment. It is a block diagram which shows an example of schematic structure of the operation control apparatus which concerns on an Example. It is a schematic diagram which shows an example of attachment of the operation control apparatus which concerns on an Example. It is a flowchart which shows an example of operation | movement of the operation control apparatus which concerns on an Example. It is a schematic diagram which shows an example of a user's finger | toe touching the input part of FIG. It is a schematic diagram which shows an example of the locus | trajectory which the user's finger touched the input part of FIG. It is a schematic diagram which shows an example in which the steering of FIG. 3 inclined. It is a schematic diagram which shows an example of the display of the operation item in the display part of FIG. It is a schematic diagram which shows an example of the display of the operation item in the display part of FIG. It is a schematic diagram which shows the modification of the shape of an operation item. It is a schematic diagram which shows the modification of the shape of an operation item. It is a schematic diagram which shows an example of the display of the operation item in the display part of FIG. It is a schematic diagram which shows an example of the display of the operation item in the display part of FIG. It is a schematic diagram which shows an example of the display of the operation item in the display part of FIG.

  An embodiment for carrying out the present application will be described with reference to FIG. FIG. 1 is a block diagram illustrating an example of a schematic configuration of the operation control apparatus according to the embodiment.

  As shown in FIG. 1, an operation control device 10 for controlling an operation means for a user to operate an operation object according to a plurality of operation items displayed on a display unit includes a position information acquisition means 10 a and an angle information acquisition means 10 b. And an operation item specifying means 10c.

  Here, examples of the operation target include a car navigation device, an air conditioner, an audio device, a telephone, a browser for browsing the Internet, and the like.

  In addition, as an example of the display unit, a display unit of a car navigation device including a liquid crystal display element or an EL (Electro Luminescence) element, a display unit of a dashboard part of a moving body such as a vehicle, a motorcycle, an aircraft, and a ship, a head-up Examples include a display (Head-Up Display). Further, as a head-up display system, it may be displayed on a windshield of a moving object or may be displayed on a spectacle lens worn by a user. The operation item displayed on the display unit is an object displayed on the display unit. As an example, an icon indicating an operation target, an operation content, an option, a button indicating up, down, confirmation, or the like, or , A key indicating a character or the like.

  Further, as an example of an operation unit that operates the operation target, an input unit (including an input unit) that receives information for operating the operation target, and an output unit that outputs information such as operation items for operating the operation target (Including the display unit).

  In this configuration, the position information acquisition unit 10a acquires position information in which the input surface of the input unit that receives input from the user is touched.

  Examples of the input unit of the operation control device 10 include a touch pad and a touch panel. Examples of the operation control device 10 include portable terminals such as portable wireless telephones and PDAs including personal computers and smartphones. Furthermore, an example of the input unit of the operation control apparatus 10 is an input unit for a screen of a mobile terminal.

  Further, as an example of the position information, information on the position such as coordinates in the input unit such as a contact point where the user's finger contacts the input unit, a contact surface, and a locus traced by the user's finger on the input unit can be given. Further, the operation control device 10 can be applied to in-vehicle devices such as car navigation, controllers for automobile devices, game machines, TV remote controllers, and the like.

  The angle information acquisition unit 10b acquires angle information related to the attitude of the input unit. Here, as an example of the angle information acquisition unit 10b, an inclination sensor or the like attached to the steering of the moving body can be cited. Examples of the tilt sensor include a sensor that captures a change in the liquid level due to the tilt, an acceleration sensor, a gyro sensor, and the like. Further, as an example of the angle information related to the attitude of the input unit, information on the steering angle of the moving body can be cited, and as an example of the angle, the rotational position of the steering wheel from the position of the straight traveling state of the moving body can be cited.

  The operation item specifying unit 10c specifies an operation item based on the position information acquired by the position information acquiring unit 10a and the angle information acquired by the angle information acquiring unit 10b. As an example of specifying the operation item, focus, selection, and the like of the operation item on the screen can be given. An example in which the operation item is focused is a state where the operation item can be distinguished from other operation items by highlighting the display of the operation item. Further, as an example of selection of the operation item, there is a state in which a process or the like indicated by the operation item is executed when the operation item is selected.

  As described above, according to the operation of the operation control apparatus 10 according to the embodiment, the position of the operation item of the display unit that the user sees and understands and the movement of the finger with respect to the input unit that the user is inputting. Since the operation item can be specified by associating the input unit with inclination in consideration of the inclination of the input unit, it is easy for the user to operate the operation item.

[1. Operation control device configuration and function overview]

  Next, specific examples corresponding to the above-described embodiment will be described with reference to FIGS. In addition, the Example described below is an Example at the time of applying this application with respect to the operation control apparatus attached to the vehicle etc. which are examples of a mobile body.

  As illustrated in FIG. 2, the operation control device 10 as an example of the operation control device 10 according to the embodiment includes an input unit 11 that receives input from a user and an operation that outputs an operation signal for operating the operation target 20. The signal output unit 12, the storage unit 13 that stores a program for controlling the operation control device 10, the communication unit 14 that transmits / receives data to / from the outside of the operation control device 10, and the tilt information of the input unit 11 are measured. An inclination sensor 15, a system control unit 16 for controlling the operation control device 10, and an input / output interface unit 17. The system control unit 16 and the input / output interface unit 17 are connected via a system bus 18.

  The operation control device 10 is connected to an operation target 20 such as a car navigation device, an air conditioner, an audio device, and a telephone via an operation signal output unit 12. Further, the operation control device 10 functions as a computer that processes information related to input from the user. The operation control device 10 outputs an operation signal to the operation target 20 based on the operation input received by the input unit 11.

  The input unit 11 is, for example, a touch pad having a position input function. The part of the position input function is configured by an element that realizes, for example, a capacitance method, a resistance film method, or the like. And the input part 11 acquires the positional information on the surface of the input part 11 which a user's finger | toe etc. contacted or adjoined by the position input function in the pixel unit of predetermined resolution. The input unit 11 may be a touch panel having a display function and a position input function.

  The operation signal output unit 12 has a function of an interface with each operation target 20. The operation signal output unit 12 is connected to each operation target 20 and outputs an operation signal to each operation target 20.

  The storage unit 13 is composed of, for example, a silicon disk drive. The storage unit 13 stores the setting state of the input unit 11 and stores various programs for controlling the operation control device 10. Examples of the various programs include an operating system, a program for processing position information acquired from the input unit 11, and the like. The various programs may be acquired via a network such as a wireless communication network, or may be recorded on a recording medium such as a CD (Compact Disc) or a DVD (Digital Versatile Disc) and the drive device It may be configured to be read through.

  The storage unit 13 stores default information such as the number of operation items to be displayed on the display unit, the size of the operation items, and the weight for each operation item as initial values.

  The communication unit 14 controls communication with the operation target 20, a device that measures travel-related information related to travel, such as the speed of the vehicle, the travel position of the vehicle, and the state of the gears of the vehicle. The operation control device 10 is connected to a device including an operation target via the communication unit 14. Further, when the operation control device 10 determines that the vehicle is in the traveling state based on the traveling related information, the operation unit 20 changes the state of the input unit 11 to the operation target 20 in order to prevent an operation unintended by the user to the operation target 20. A hold state in which no operation input is accepted may be used. Here, examples of the running state include a case where the speed of the vehicle is equal to or higher than a predetermined speed, a case where the gear is in a driving state, and the like. In addition, when a display unit that is not the display unit 21a of the car navigation device 21 such as a head-up display is used, the hold state may not be set.

  Examples of the tilt sensor 15 include a sensor that captures a change in the liquid level due to tilt, an acceleration sensor, a gyro sensor, and the like.

  The system control unit 16 includes, for example, a CPU (Central Processing Unit) 16a, a ROM (Read Only Memory) 16b, and a RAM (Random Access Memory) 16c. In the system control unit 16, the CPU 16 a reads out and executes various programs stored in the ROM 16 b, the RAM 16 c, and the storage unit 13. For example, the system control unit 16 executes a program for determining an input received by the input unit 11.

  The input / output interface unit 17 is an interface between each unit such as the input unit 11 and the system control unit 16.

  In addition, the operation control device 10 has an internal clock (not shown) for measuring the time when the finger touches the input unit 11.

  Next, as shown in FIG. 3, the input unit 11 of the operation control device 10 is attached to the front side of the steering 30 of the vehicle, which is an example of the moving body. The tilt sensor 15 is attached to the input unit 11 or the steering 30 so that the rotation angle of the steering 30 can be measured.

  The steering 30 includes a steering body 31 that is connected to a steering shaft (not shown), and a steering wheel 32 that has a ring shape and is a portion that is gripped by a user who drives the vehicle.

  The input unit 11 is attached to the steering wheel unit 32 side from the center on the front side of the steering body 31. That is, the input unit 11 is installed at a position where the user's thumb can touch the input unit 11 when the user grips the steering wheel unit 32. When the rotational position of the steering wheel portion 32 is a position where the vehicle is traveling straight, the input portion 11 is attached to the user's right hand side of the steering body portion 31 when the user sits in the driver's seat of the vehicle. The attachment position of the input unit 11 may be the user's left hand side or the center of the steering body 31.

  Next, as shown in FIG. 3, a car navigation device 21, an air conditioner 22, an audio device 23, and the like are installed in the vehicle as an example of the operation target 20. In addition, as an example of the operation target 20, a communication device (not shown) for connecting the user's portable wireless telephone with the short-range wireless communication standard so that the user can receive the portable wireless telephone is set. Yes. These operation objects 20 are connected to the operation signal output unit 12 and the communication unit 14 of the operation control device 10.

  The car navigation device 21 stores a display unit 21a including a touch panel, various sensors such as an acceleration sensor, a gyro sensor, and a GPS (Global Positioning System) sensor, a processing unit including a CPU, a RAM, a ROM, and the like, and information. It has a memory | storage part, a communication part which communicates with other apparatuses, such as the operation control apparatus 10, and an operation part for operating the car navigation apparatus 21. The car navigation device 21 may be connected to the Internet, and the display unit 21a may be configured to allow browsing of the Internet.

  The display unit 21a is a touch panel having a display function and a position input function. The display function part is constituted by, for example, a liquid crystal display element or an EL element. The part of the position input function is configured by an element that realizes, for example, a capacitance method, a resistance film method, or the like. When the display unit is a head-up display, the display unit includes a projecting unit and a screen unit (a windshield, a lens unit of spectacles, etc.) that displays an image projected from the projecting unit.

  In addition, a plurality of operation items i for operating the operation target 20 are displayed on the display unit 21a. The operation item i is, for example, an icon representing the operation content of the predetermined operation target 20.

  The air conditioner 22 has a compressor (not shown) and a blower (not shown) for blowing air conditioned in the vehicle, and controls the temperature and humidity inside the vehicle. The air outlet 22a of the air conditioner 22 is installed in the vehicle.

  The audio device 23 receives a CD or DVD playback, radio or television radio wave, outputs sound to a speaker, and outputs video to the display unit 21 a of the car navigation device 21.

[2. Operation of operation control unit]
(2.1 Operation example of operation control device)
The operation of the operation control apparatus according to the embodiment will be described with reference to FIGS.

  FIG. 4 is a flowchart illustrating an example of the operation of the operation control apparatus according to the first embodiment. FIG. 5 is a schematic diagram illustrating an example of how a user's finger touches the input unit. FIG. 6 is a schematic diagram illustrating an example of a locus in which a user's finger touches the input unit. FIG. 7 is a schematic diagram showing an example in which the steering is tilted. 8 and 9 are schematic diagrams illustrating an example of display of operation items on the display unit.

  As shown in FIG. 4, the operation control apparatus 10 displays an operation item (step S1). Specifically, the system control unit 16 transmits data related to the operation item i to the car navigation device 21 so that a plurality of operation items i such as initial settings are displayed on the display unit 21a. As shown in FIG. 3, the car navigation device 21 displays a plurality of operation items i on the display unit 21a. When the engine of the moving body is started and the operation control device 10 or the car navigation device 21 is activated, the system control unit 16 of the operation control device 10 defaults from the storage unit 13 regarding the operation item i displayed on the display unit 21a. Get information. Also, the default information includes information on the operation item being focused.

  In addition, after the process for performing the operation of the operation target corresponding to the selected operation item i is performed, the operation item before the selection is displayed, or a new operation item is displayed due to the selection. It may be displayed.

  Then, while looking at the operation item displayed on the display unit 21a, for example, by tracing or tapping the surface of the input unit 11 with a finger, the focus of the operation item is moved as an example of specifying the operation item. Or select an operation item.

  When a plurality of operation items i and the like are displayed overlapping the same pixel, the operation item i displayed in the foreground is set as a focus or selection target.

  Next, the operation control apparatus 10 acquires the touched position information in the input unit (step S2). Specifically, as illustrated in FIG. 5, as an example of the position information acquisition unit, the system control unit 16 of the operation control device 10 determines the x coordinate of the portion traced by the user's finger 5 on the surface of the input unit 11. And the position information of the y coordinate are acquired from the input unit 11. More specifically, as shown in FIG. 6, the system control unit 16 acquires, from the input unit 11, position information of the x coordinate and the y coordinate of the contact area C of the part in contact with the user's finger at a certain time. To do.

  Then, the system control unit 16 acquires the position information of the contact area C at a certain time interval and calculates the center coordinates of the contact area C, whereby the position information of the x coordinate and the y coordinate of the trajectory t of the contact area C is obtained. To get. The center coordinates of the contact area C are obtained by calculating the position of the center of gravity of the contact area C. Further, the locus of the point having the minimum value or the maximum value of the x coordinate value of the contact area C may be used.

  Then, the system control unit 16 stores the acquired time in the storage unit 13 or the RAM 16c in association with the acquired position information. When storing, not only the information of the entire trajectory t, but the start point and end point coordinates of the trajectory t, the maximum value and the minimum value of the x coordinate of the trajectory t, the maximum value and the minimum value of the y coordinate may be used.

  As described above, the operation control apparatus 10 functions as an example of a position information acquisition unit that acquires position information in which the input surface of the input unit that receives input from the user is touched.

Next, the operation control apparatus 10 calculates a contact speed and a contact angle (step S3). Specifically, the system control unit 16 determines the contact speed v and the contact angle θ1 from the position information (x1, y1) and acquisition time of the contact start point, and the position information (x2, y2) and acquisition time of the contact end point. Is calculated. For example, the system control unit 16 determines the contact time s (an example of contact time) that is touching the input unit,
Contact time s = calculation time of position information (x2, y2) −acquisition time of position information (x1, y1). The system control unit 16 sets the movement distance d to
Travel distance d = √ (a ² + b ² )
Calculate from Here, a = x2-x1 and b = y2-y1. Then, the system control unit 16 sets the contact speed v and the contact angle θ1 as
Contact speed v = d / s,
Contact angle θ1 = tan ⁻¹ (b / a)
Calculate from

  Note that the contact speed v may be calculated from the length of the trajectory t and the contact time s. The length of the trajectory t may be the length obtained by calculating the adjacent distance from the adjacent coordinates of the position information of the contact area C acquired at a certain time interval, and adding these.

  As described above, the operation control apparatus 10 functions as an example of a contact direction calculation unit that calculates a contact direction in contact with the position information. In addition, the operation control device 10 functions as an example of a contact speed calculation unit that calculates the contact speed from the position information and the contact time.

  Next, the operation control device 10 acquires steering tilt data (step S4). Specifically, as shown in FIG. 7, the system control unit 16 uses the tilt sensor 15 as an example of angle information related to the attitude of the input unit 11 to obtain data on the tilt angle θ2 of the steering wheel on which the input unit 11 is installed. get. As a method for obtaining the steering tilt, the system control unit 16 may obtain an inclination angle θ2 of the steering wheel 30 by performing image processing using an image obtained by photographing the steering wheel 30 with a camera.

  As described above, the operation control device 10 functions as an example of an angle information acquisition unit that acquires angle information related to the posture of the input unit.

  Next, the operation control apparatus 10 determines whether or not the focus of the operation item has been moved (step S5). Specifically, the system control unit 16 determines whether the focused object is selected or focused based on the contact time s and the contact moving distance d. For example, if the contact time s is less than 0.1 seconds, the selection of the operation item and the system control unit 16 determines, and if it is 0.1 seconds or more, the focus movement is determined. Or if the movement distance d of a contact is below a predetermined value, the system control part 16 will determine with selection of an operation item, and if the movement distance d is larger than a predetermined value, it will determine with a focus movement. Moreover, when the number of times of contact within a predetermined time is greater than or equal to a predetermined value, such as a double tap, the system control unit 16 may determine that the operation item is selected.

  In the case of focus movement (step S5; YES), the operation control device 10 specifies an operation item to be focused based on the contact speed, the contact angle, and the steering tilt angle (step S6). First, for example, as shown in FIG. 8, from the base point of the operation item i1 currently focused (for example, the center o or the barycentric pixel of the operation item i1), the direction related to the contact angle θ1 and the steering tilt angle θ2 ( For example, the system control unit 16 identifies the operation items i4 and i5 on the line L of [theta] 1+ [theta] 2) as the next focus candidate operation items.

  Then, the system control unit 16 sequentially subtracts a predetermined value from the value of the contact speed v calculated in step S3 in accordance with the pixels on the line L with the center o as the base point. For example, when passing a pixel outside the operation item i on the line L, the value n is subtracted for each pixel, and when passing a pixel within the operation item i on the line L, the pixel is subtracted by the value m. As described above, the system control unit 16 subtracts different values inside and outside the operation item i. The system control unit 16 subtracts from the center o of the operation item i1 to obtain a pixel that becomes v = np + mq (p is the number of pixels that have passed outside the operation item i, and q is the number of pixels that have passed through the operation item i). It will be. That is, as shown in FIG. 9, the point z of the pixel that is zeroed by subtraction is obtained. The value n is a weight for pixels outside the operation item i, and the value m is a weight for pixels within the operation item i.

  Then, the system control unit 16 specifies an operation item to be focused from a pixel that is subtracted from the value of the contact speed v and becomes zero.

  In the operation item i, when it is subtracted from the value of the contact speed v and becomes zero, the focus moves to the operation item i. For example, when the subtraction is zero within the operation item i4, the focus moves to the operation item i4, and when the subtraction is zero within the operation item i5, the focus moves to the operation item i5. The operation items i4 and i5 are examples of operation items in the vicinity of a distance corresponding to the contact speed value from the base point.

  When the contact speed v is subtracted from the value of the contact speed v outside the operation item i, the focus moves to the operation item i closer to the current focus operation item i1. For example, when the pixel between the operation item i4 and the operation item i5 is subtracted to zero, the focus moves to the operation item i4. Also, as shown in FIG. 9, when the subtraction is zero when the operation item i5 is exceeded, the focus moves to the operation item i5. The operation items i4 and i5 are examples of operation items in the vicinity of a distance corresponding to the contact speed value from the base point.

  If the subtraction reaches zero on the line L before going from the current focus operation item i1 to the next operation item i4, the focus is not moved. For example, when subtraction becomes zero within the operation item i1 or between the operation item i1 and the operation item i4, the focus does not move with the operation item i1.

  Note that the system control unit 16 sets the operation item i5 closest to the point z of the pixel that has become zero among the operation items i on the line L (operation near the distance corresponding to the contact speed value from the base point). An example of the item may be specified as the operation item i to be focused next.

  In addition to the center o of the operation item i1, a point inside the operation item i1 or a pixel near the operation item i1 may be used as a base point.

  As described above, the operation control apparatus 10 functions as an example of an operation item specifying unit that specifies an operation item based on the position information and the angle information. The operation control device 10 functions as an example of an operation item specifying unit that specifies the next operation item based on the contact direction and the angle information with the operation item already specified in the display unit as a base point. In addition, the operation control device 10 functions as an example of an operation item specifying unit that specifies an operation item based on the contact speed from operation items in a direction corresponding to the contact direction and the angle information from the base point. The operation control device 10 functions as an example of an operation item specifying unit that specifies an operation item in the vicinity of a distance corresponding to the value of the contact speed from the base point.

  Next, the operation control apparatus 10 moves the focus (step S7). Specifically, as shown in FIG. 9, the system control unit 16 returns the operation item i1 to a normal form that is not focused, for example, the color of the operation item i1 (for example, the color of the operation item i1). In the form of

  Next, the operation control apparatus 10 determines whether or not it is finished (step S8). For example, the system control unit 16 determines whether the operation control device 10 is powered on or off. When the power is ON (step S8; NO), the system control unit 16 returns to the process of step S2 and acquires position information. If the power is OFF (step S8; YES), the system control unit 16 ends the process.

  On the other hand, when the focus is not moved (step S5; NO), the focused operation item i is selected (step S9). Specifically, the system control unit 16 performs a process for performing an operation on the operation target corresponding to the operation item i1, assuming that the focused operation item i1 is selected by the user.

  If a new operation is required due to the selection, the system control unit 16 returns to step S1 and displays a new operation item.

  If a new operation is not required due to the selection, the system control unit 16 returns to step S1 and displays the operation item at the time of the selection.

  As described above, according to the operation according to the embodiment, in the operation control device 10 for controlling the operation means for the user to operate the operation target according to the plurality of operation items i displayed on the display unit 21a, To acquire position information where the input surface of the input unit 11 that receives the input is touched, acquire angle information (θ2) related to the posture of the input unit 11, and specify an operation item based on the position information and the angle information Thus, the position of the operation item i on the display unit 21a which the user sees and grasps and the movement of the finger 5 with respect to the input unit 11 input by the user can be changed to the user's sense in consideration of the inclination of the input unit 11. Since the operation item i can be specified by associating in a close manner, the user can easily operate the operation item i.

  Since the input unit 11 such as a touch pad is on the steering 30, the input unit 11 is not always horizontal. Therefore, by applying correction according to the tilt of the steering wheel 30, the user can determine the focus of the operation item i in the intended direction while viewing the display unit 21a without being aware of the tilt of the steering wheel 30. .

  Further, an operation item i as a UI (User Interface) created on the premise of the touch pad operation on the screen of the display unit 21a is operated without using a pointer such as a mouse while looking at the operation item i of the display unit 21a. The item i can be operated.

  Further, according to the embodiment, an application created for a smartphone or a tablet can be used without re-development into a mobile-only UI.

  With the spread of smartphones and tablets, it has become commonplace to operate by touching the screen directly without using a mouse or keyboard used in a PC (Personal Computer) or the like. Applications that are used in these devices can be freely installed by the user, and there is a need for the user to freely install the application in in-vehicle devices.

  On the other hand, in the case of a vehicle-mounted device, there are cases where it is desired to operate an application without releasing the hand as much as possible from the steering wheel 30 during driving. However, in order to operate the application, an operation of moving the focus and selecting an operation item such as an object is necessary, but the application is made on the assumption that the screen is directly touched. According to the embodiment, it is possible to realize the movement of the focus with respect to the operation item and the selection of the operation item by the operation on the input unit 11 of the steering wheel 30.

  In addition, the contact direction (for example, θ1) is calculated from the position information, and based on the contact direction and the angle information (for example, θ2) based on the operation item (for example, the operation item i1) already specified in the display unit 21a. When the next operation item (for example, operation item i5) is specified, the operation item i suitable for the user's sense can be specified by the contact direction input by the user, so that the user can easily operate the operation item i. Further, for example, the operation item i including the pixel on the line L of the angle (θ1 + θ2) can be narrowed down as a focus movement candidate based on the contact direction and the angle information.

  Also, the contact time s is acquired, the contact speed v is calculated from the position information and the contact time s, and the operation item (for example, the direction based on the contact direction (for example, θ1) and the angle information (for example, θ2) from the base point (for example, When an operation item (for example, operation item i5) is specified from the operation items i4 and i5) based on the contact speed v, the user feels according to the contact speed of the finger 5 when operating the input unit 11. Since the operation item i that has been found can be specified, the user can easily operate the operation item i. For example, by increasing the contact speed of the finger 5 in the operation with respect to the input unit 11, the focus is instantaneously moved to the operation item i that is farther away, and by reducing the contact speed of the finger 5, It can be used to specify. In addition, the focus can be changed intuitively by a single operation by adjusting the operation on the input unit 11 by the user.

  Further, when specifying an operation item in the vicinity of a distance corresponding to the value of the contact speed v from the base point (for example, the operation item i), a sense of distance corresponding to the contact speed of the finger 5 in the operation on the input unit 11 is input. This makes it easier for the user to operate the operation item i.

  The pixel of the image corresponding to the operation item is weighted, and sequentially subtracted from the value of the contact speed v according to the weight for the pixel in the direction corresponding to the contact direction and the angle information from the base point. When specifying an operation item near zero, the ease of focusing can be changed according to the operation item i.

(2.2 Modification of shape of operation item)
Next, a modified example of the shape of the operation item will be described with reference to FIGS. 10 and 11.
10 and 11 are schematic diagrams illustrating modifications of the shape of the operation item.

  As shown in FIGS. 10 and 11, when the shape of the operation item ii is not a rectangle, the rectangle ir or the polygon ip circumscribing the operation item ii may be regarded as the operation item i described above. Thus, the shape of the operation item ii itself can be handled in the same manner as the operation item i described above. Note that the shape of the operation item ii itself may be regarded as the operation item i described above. Thus, the present invention can be applied even if the operation item is not rectangular.

(2.3 Specific modification of focus destination)
Next, a specific modification of the focus movement destination will be described with reference to FIGS.
12 to 14 are schematic diagrams illustrating an example of display of operation items on the display unit.

  First, as a modification of the part for obtaining a pixel that becomes zero by subtracting from the value of the contact speed v, in the expression v = np + mq, as shown in FIG. 12, the value mi is set for each operation item i with respect to the value m. It may be changed (value m4 for operation item i4 on line L, value m5 for operation item i5). Note that the value mi (i = 1, 2, 3,...) Is an example of a weight for the pixel of the image corresponding to the operation item.

  The system control unit 16 subtracts from the center o of the operation item i1 to obtain a pixel where v = np + m4q4 + m5q5. Here, p is the number of pixels that have passed through the operation item i, q4 is the number of pixels that have passed through the operation item i4, and q5 is the number of pixels that have passed through the operation item i5.

  In this case, it becomes easy to focus on the operation item i having a high mi. In this way, the ease of focusing can be changed for each operation item i.

  Further, without using the values n and m, a pixel at a distance proportional to the value of the contact speed v is simply determined from the pixels on the line L from the center of the operation item i1 of the current focus. Good. For example, when the user quickly moves his / her finger at the input unit 11 with respect to a predetermined threshold speed, the operation item i away from the current focus operation item i1 is specified. Is slowly moved, the operation item i close to the operation item i1 of the current focus is specified.

  In this case, the focus destination is simply determined from the speed and inclination. When the user gets used to such an operation (when the user intuitively understands the direction and power adjustment), the user can easily move the focus to a predetermined place.

  As described above, the operation control device 10 functions as an example of an operation item weighting unit that weights the pixels of the image corresponding to the operation item. In addition, the operation control device 10 sequentially subtracts from the contact speed value according to the weight for the pixel in the direction corresponding to the contact direction and the angle information from the base point, and selects an operation item in the vicinity where the contact speed value becomes zero. It functions as an example of the operation item specifying means to be specified.

  Next, as illustrated in FIG. 13, the operation item i may be specified from the operation item i that is not limited to the line L but is in the range of the angle θ3 with the line L as the center. The system control unit 16 expands the specific target candidate into a fan shape, and sets the operation item i including the pixels in the frame as the next focus candidate. For example, the system control unit 16 determines a line that passes through the operation item i4 and the operation item i6 as a straight line that passes through the center o of the operation item i1 within the range of the angle θ3 with respect to the line L. The equation v = np + mq may be applied. Alternatively, the system control unit 16 may specify the operation item i from the operation item i in the range of the angle θ3 with respect to the line L based on the magnitude of the contact speed v with respect to a predetermined threshold.

  Furthermore, as shown in FIG. 13, the angle θ4 may be varied from 0 ° to θ3, for example, and the range expanded in a sector shape at the angle θ3 may be changed. Furthermore, the angle θ3 and the angle θ4 may be adjusted in association with the angle θ2, which is the tilt of the steering wheel 30. For example, when the steering wheel 30 is turned largely, the angle θ3 becomes large. When the steering wheel 30 is turned right, the angle θ4 approaches 0 °. When the steering wheel 30 is turned counterclockwise, the angle θ4 approaches the angle θ3.

  Further, as shown in FIG. 14, the operation item i may be specified from among the operation items i in the range of the width d <b> 1 with respect to the line L. The system control unit 16 expands the specific target candidate into a band shape, and sets the operation item i including the pixels included in the band as the next focus candidate.

  For example, the system control unit 16 determines a line that is in the range of the width d1 with respect to the line L, is parallel to the line L, and passes through the operation item i4 and the operation item i6. = Np + mq or the like may be applied. Alternatively, the system control unit 16 may specify the operation item i from the operation item i in the range of the width d1 with respect to the line L, based on the magnitude of the contact speed v with respect to a predetermined threshold.

  Furthermore, as shown in FIG. 14, d2 may be varied from 0 to d1, and the range expanded by the width of d1 may be shifted. Furthermore, d1 and d2 may be adjusted in association with θ2, which is the tilt of the steering wheel 30. For example, d1 may increase when the steering wheel 30 is turned large, d2 may approach zero when turned to the right, and d2 may approach d1 when turned to the left.

  As shown in FIG. 13 or FIG. 14, by using the angle θ3 and the width d1, the line L is widened and a small operation item i is easily identified.

  When the angles θ3 and θ4 and the widths d1 and d2 are adjusted in association with the angle θ2 of the steering wheel 30, the larger the angle θ2, the more the direction intended by the user than when the input unit 11 is horizontal. It is thought that it becomes difficult to move the focus to. However, the direction based on the contact direction (for example, θ1) and the angle information (for example, θ2) is changed to the angle so that the values of the angles θ3, θ4, the widths d1, d2, etc. are changed according to the angle θ2 of the steering wheel 30. In the case of having a width according to the information, it is possible to absorb the difference caused by turning the steering wheel 30, and the user can easily operate the operation item i. Further, by adjusting the angles θ3 and θ4 and the widths d1 and d2 according to the angle θ2 of the steering wheel 30, the region including the candidate operation item i to be identified can be changed.

  Note that the inclination θ2 of the steering wheel 30 may be subtracted from the angle θ1. In this case, the input can be made by the inclination of the trajectory of the finger 5 with respect to the horizontal regardless of the inclination of the steering wheel 30.

DESCRIPTION OF SYMBOLS 10: Operation control apparatus 10a: Position information acquisition means 10b: Angle information acquisition means 10c: Operation item specification means 11: Input part 15: Inclination sensor (angle information acquisition means)
16: System control unit (position information acquisition means, angle information acquisition means, operation item specification means)
20: Operation target 21: Car navigation (operation target)
21a: Display unit 22: Air conditioner (operation target)
23: Audio device (operation target)
i, i1, i2, i3, i4, i5, ii: operation items mi, m4, m5: value (weight)

Claims (8)

Position information acquisition means for acquiring the position information input surface of the input unit that receives an input from the User chromatography The is touched,
Angle information acquisition means for acquiring angle information related to the posture of the input unit;
Contact speed calculating means for calculating a contact speed when the input surface is touched by the user;
With
An operation control apparatus for controlling an operation means for the user to operate an operation target displayed on a display unit based on the position information, the angle information, and the contact speed . The operation control device according to claim 1,
An operation item specifying means for specifying at least one of the plurality of operation items displayed on the display unit;
A contact direction calculating means for calculating the contacted contact direction from the position information;
Based on the operation item already specified in the display unit based on the contact direction calculated by the contact direction calculation unit and the angle information acquired by the angle information acquisition unit, the operation item specifying unit An operation control device that identifies the operation item. The operation control device according to claim 2,
The operation item specifying means specifies the operation item based on the contact speed calculated by the contact speed calculation means from among the operation items in a direction corresponding to the contact direction and the angle information from the base point. An operation control device. In the operation control device according to claim 3,
The operation control device is characterized in that the operation item specifying means specifies the operation item in the vicinity of a distance corresponding to a value of the contact speed from the base point. The operation control device according to claim 4,
An operation item weighting unit that weights the pixels of the image corresponding to the operation item;
The operation item specifying means sequentially subtracts from the value of the contact speed according to the weight for the pixel in the direction according to the contact direction and the angle information from the base point, and near the value of the contact speed becomes zero. An operation control apparatus that identifies the operation item. In the operation control device according to any one of claims 3 to 5,
The operation control device according to claim 1, wherein a direction corresponding to the contact direction and the angle information has a width corresponding to the angle information. In the operation control method of the operation control device for controlling the operation means for the user to operate the operation target according to the plurality of operation items displayed on the display unit,
A position information acquisition step of acquiring position information in which the input surface of the input unit that receives input from the user is in contact;
An angle information acquisition step of acquiring angle information related to the posture of the input unit;
A contact speed calculating step of calculating a contact speed when the input surface is touched by the user;
A control step for controlling an operation means for the user to operate the operation target displayed on the display unit based on the position information, the angle information, and the contact speed ;
The operation control method characterized by including.   A program for an operation control device, which causes a computer to function as the operation control device according to any one of claims 1 to 6.