JP7037344B2 - Input control device, input device, operation target device, and program - Google Patents

Description

The present invention relates to an input control device, an input device, an operation target device, and a program.

Conventionally, in various electronic devices (for example, smartphones, mobile phones, tablet terminals, notebook computers, game machines, etc.) and vehicles such as automobiles, input devices (for example, fingertips) that can be contacted by an operating body (for example, fingertips) can be operated. Touch panels, touch pads, etc.) are used. With respect to such an input device, a technique has been devised in which a predetermined function is executed in response to a pressing operation on the operation surface.

For example, in Patent Document 1 below, when a pressing operation is performed on an operation surface of an operating member in a touch pad system, if the region where the pressing operation is performed is the first region, the first function (Left button function of mouse button) is executed, and if the area where the pressing operation is performed is the second area, the first function or the second function (right button function of the mouse button) is executed. The technology to do so is disclosed.

Japanese Unexamined Patent Publication No. 2016-45812

By the way, in recent years, the usage environment of an input device capable of a contact operation has been diversified, and along with this, it is required to be able to perform more functions by the contact operation. However, in the technique of Patent Document 1, since two different functions are executed according to the contact position of the operating body when the pressing operation is performed, the number of functions that can be executed by the contact operation is limited. , It is difficult to perform more functions by contact operation.

The input control device of one embodiment includes a calculation unit that calculates a value according to a distance between the plurality of operating bodies when a contact operation is performed by a plurality of operating bodies on the operation surface of the input device. A function execution control unit that controls the execution of a predetermined function based on the value calculated by the calculation unit is provided.

According to one embodiment, more functions can be performed by contacting the operation surface with the operating body.

It is external perspective view of the input device which concerns on one Embodiment. It is an exploded perspective view which shows the structure of the input device which concerns on one Embodiment. It is external perspective view of the notebook computer which concerns on one Embodiment. It is a block diagram which shows the functional structure of the input control device which concerns on one Embodiment. It is a flowchart which shows the procedure of the processing by the input control device which concerns on one Embodiment. It is a flowchart which shows the procedure of the discrimination processing by the input control device (discrimination part) which concerns on one Embodiment. It is a figure which shows an example of the pressing operation with respect to the operation panel which concerns on one Embodiment. It is a figure which shows the execution example of the expansion function by the input control device (function execution control unit) which concerns on one Embodiment. It is a figure which shows an example of the movement operation with respect to the operation panel which concerns on one Embodiment. It is a figure which shows the execution example of the movement function by the input control device (function execution control unit) which concerns on one Embodiment. It is a figure for demonstrating the modification of the calculation method by the input control device (calculation unit) which concerns on one Embodiment.

Hereinafter, one embodiment will be described with reference to the drawings.

(Configuration of Input Device 100)
FIG. 1 is an external perspective view of an input device 100 according to an embodiment. FIG. 2 is an exploded perspective view showing the configuration of the input device 100 according to the embodiment. In the following description, for convenience, the Z-axis direction (thickness direction of the input device 100) in the figure is the vertical direction, and the X-axis direction (longitudinal direction of the input device 100) in the figure is the horizontal direction, and Y in the figure. The axial direction (the short side direction of the input device 100) is the vertical direction.

The input device 100 shown in FIGS. 1 and 2 is an input device called a so-called “touch pad”, and is a device to be operated in various ways (for example, a notebook computer, an in-vehicle system, a smartphone, a tablet terminal, a mobile phone, a digital video camera, a game). It is an input device installed in a machine, etc.). The input device 100 includes an operation panel 110, and receives an input of the contact operation by performing a contact operation (movement operation, pressing operation, etc.) with a user's fingertip on the operation surface of the operation panel 110. It is possible.

Further, the input device 100 includes an actuator 120, and the actuator 120 vibrates the operation surface of the operation panel 110 in response to a user's contact operation (pressing operation) to provide feedback of the contact operation. It can be given tactilely to the user's fingertip or palm.

As shown in FIG. 2, the input device 100 includes a cover glass 111, an adhesive sheet 112, a printed circuit board 113, and a metal frame 140 in this order from the operation surface side (Z-axis positive side in the drawing), and these configurations are provided. It has a laminated structure in which members are laminated.

The cover glass 111, the adhesive sheet 112, and the printed circuit board 113 constitute the operation panel 110 described above. The cover glass 111, the adhesive sheet 112, and the printed circuit board 113 all have a substantially horizontally long rectangular shape in a plan view. The operation panel 110 is an example of an “operation unit”. In the present embodiment, the touch panel of the projection type capacitance method is used as the operation panel 110, but the touch panel is not limited to this, and other methods (for example, surface type capacitance method, resistance film method, infrared scanning method, etc. A touch panel of ultrasonic surface acoustic wave method, etc.) may be used.

The cover glass 111 is a thin flat plate-shaped member made of a relatively hard and transparent material. The cover glass 111 is provided on the foremost surface of the operation panel 110 mainly to protect the surface of the upper side (Z-axis positive side in the drawing) of the printed circuit board 113. That is, the surface on the upper side (the positive side of the Z axis in the drawing) of the cover glass 111 is the operation surface of the operation panel 110. As the cover glass 111, for example, a glass plate, a resin plate, or the like can be used.

The adhesive sheet 112 is a thin sheet-like member made of a transparent and adhesive material. The adhesive sheet 112 is arranged between the cover glass 111 and the printed circuit board 113, and the cover glass 111 and the printed circuit board 113 are bonded to each other.

The printed circuit board 113 is a thin plate-shaped member made of a relatively hard material. An electrostatic sensor 114 is provided on the upper surface (the positive side of the Z axis in the drawing) of the printed circuit board 113. The electrostatic sensor 114 detects the contact position of the user's fingertip or palm on the operation surface of the operation panel 110, and outputs a position detection signal indicating the contact position. Specifically, the electrostatic sensor 114 detects the capacitance of each coordinate on the operation surface of the operation panel 110, and outputs information indicating the capacitance of each coordinate as a position detection signal. The electrostatic sensor 114 is configured by providing a thin film-shaped electrode pattern (electrode pattern in the X-axis direction and electrode pattern in the Y-axis direction) on the surface of the upper side (the positive side of the Z axis in the drawing) of the printed circuit board 113. There is. As the electrode pattern, for example, one formed of ITO (Indium Tin Oxide), a metal film (for example, a composite material of silver, copper, aluminum and molybdenum) or the like can be used. An actuator 120 and a control circuit 122 are provided on the surface of the printed circuit board 113 on the back side (Z-axis negative side in the drawing).

The actuator 120 is an example of "tactile presentation means". The actuator 120 presents a tactile sensation to the user by generating vibration on the operation surface of the operation panel 110. Specifically, the actuator 120 vibrates itself when driven by the control circuit 122, and transmits this vibration to the operation surface of the operation panel 110 to generate vibration on the operation surface of the operation panel 110. As the actuator 120, for example, an electrostatic actuator, a piezoelectric actuator, an electromagnetic actuator, or the like can be used. The input device 100 of the present embodiment is provided with two actuators 120, but the present invention is not limited to this, and one or more actuators 120 may be provided for the input device 100.

The control circuit 122 controls input / output of various operation signals (for example, position detection signal, pressure detection signal, vibration control signal, etc.) with an external device (for example, the input control device 200 shown in FIG. 4). Further, the control circuit 122 controls the vibration of the actuator 120. For example, when the force sensor 130 detects a pressing force on the operation surface of the operation panel 110, the control circuit 122 outputs a drive signal to the actuator 120 to generate vibration in the actuator 120. Thereby, the user can feel the feedback for the pressing operation of the operation panel 110 by the fingertip or the palm. The control circuit 122 can also control the vibration of the actuator 120 based on the vibration control signal input from the external device. As the control circuit 122, for example, an IC (Integrated Circuit) can be used.

The metal frame 140 is provided on the back side (Z-axis negative side in the drawing) of the operation panel 110, and is a flat plate-shaped member formed by processing a thin metal plate. The metal frame 140 has a substantially horizontally long rectangular shape in a plan view. The metal frame 140 is a member that fixedly supports the operation panel 110 in a state where the operation panel 110 is laminated on the surface on the upper side thereof (the positive side of the Z axis in the drawing). The input device 100 is fixed to the housing or the like of the operation target device by a fixing means such as a screw in the metal frame 140.

A cushioning member 124 and a force sensor 130 are provided between the printed circuit board 113 at the bottom of the operation panel 110 and the metal frame 140.

The cushioning member 124 is bonded to both the printed circuit board 113 and the metal frame 140 between the printed circuit board 113 and the metal frame 140. The cushioning member 124 is a member that enables the operation panel 110 to move in the vertical direction by expanding and contracting in the vertical direction in response to a load applied from the operation panel 110. For example, when the operation panel 110 is pressed, the cushioning member 124 contracts in the vertical direction, so that the operation panel 110 sinks downward. Then, when the operation panel 110 is released from the pressing, the cushioning member 124 expands in the vertical direction due to its repulsive force, so that the operation panel 110 moves upward and the operation panel 110 returns to the original position. In the example shown in FIG. 2, two cushioning members 124 are provided side by side along the edges of both the left and right edges of the input device 100. In the example shown in FIG. 2, an elastic sheet made of an elastic material such as rubber, resin, or silicon is used as the cushioning member 124, but the present invention is not limited to this, and various springs or the like may be used as the cushioning member 124. can. Further, the material, shape, arrangement position, and number of arrangements of the cushioning member 124 are not limited to those shown in FIG.

The force sensor 130 is an example of "pressure detecting means". The force sensor 130 detects a pressing force on the operation surface of the operation panel 110, and outputs a pressure detection signal indicating a voltage value corresponding to the pressing force. The pressure detection signal output from the force sensor 130 is input to the control circuit 122 via the wiring formed on the FPC (Flexible Printed Circuits) 135 and the printed circuit board 113. In this embodiment, as the force sensor 130, a resistance type strain sensor is used in which conductive particles are dispersed in a binder and the resistance changes with a change in the distance between the conductive particles. Not limited to this, as the force sensor 130, for example, a piezoelectric (piezo) type sensor, a piezo resistance type sensor, or the like can be used. Further, instead of the force sensor 130, a switch that switches from the off state to the on state by applying a constant pressing force may be used.

(Appearance of the notebook computer 10 according to one embodiment)
FIG. 3 is an external perspective view of the notebook computer 10 according to the embodiment. The notebook computer 10 shown in FIG. 3 is an example of an “operation target device”. As shown in FIG. 3, the notebook computer 10 includes a housing 10A and a housing 10B that can be folded with each other. Further, the notebook computer 10 is provided with a display 12 on the inner surface of the housing 10A. Further, the notebook computer 10 is provided with an input device 100 on the inner surface of the housing 10B. Further, the notebook computer 10 includes an input control device 200 inside the housing 10B. The input control device 200 can control the execution of a predetermined function according to the distance between the plurality of operating bodies when the contact operation with the plurality of operating bodies is performed on the operation surface of the input device 100. It is a device.

In this embodiment, an example of applying the input device 100 and the input control device 200 to the notebook computer 10 will be described, but the present invention is not limited to this, and the input device 100 and the input control device 200 may be other operation target devices (for example,). , Smartphones, mobile phones, tablet terminals, game machines, in-vehicle systems, etc.). In this case, the input device 100 may be provided integrally with the housing of the operation target device, or may be provided separately from the housing of the operation target device. Further, the input control device 200 may have a part or all of its functions provided outside the input device 100, and a part or all of its functions may be provided inside the input device 100. It may be the one. Further, the input control device 200 may be realized by a dedicated device (for example, an IC or the like), or may be realized by a computer (for example, a CPU or the like) included in the operation target device.

(Functional configuration of input control device 200)
FIG. 4 is a block diagram showing a functional configuration of the input control device 200 according to the embodiment. As shown in FIG. 4, the input control device 200 includes a signal acquisition unit 201, a position detection unit 202, a calculation unit 203, a push pressure detection unit 204, a movement identification unit 205, a function execution control unit 206, and a vibration control unit 207. I have.

The signal acquisition unit 201 acquires various operation signals. For example, the signal acquisition unit 201 acquires a position detection signal output from the input device 100 (electrostatic sensor 114) indicating the contact position of the operating body in the contact operation of the input device 100. Further, for example, the signal acquisition unit 201 acquires a pressure detection signal indicating a pressing force on the operation surface of the operation panel 110 output from the input device 100 (force sensor 130).

The position detection unit 202 detects the contact position of the operating body in the contact operation with respect to the operation panel 110 based on the position detection signal acquired by the signal acquisition unit 201. For example, the position detection unit 202 obtains a plurality of coordinates (that is, a plurality of coordinates in contact with the operating body) having a capacitance equal to or higher than a predetermined threshold value based on the capacitance of each coordinate indicated by the position detection signal. Detected as the contact position of the operating body. Here, when the contact operation is performed by a plurality of operating bodies, the position detecting unit 202 detects the contact position of each of the plurality of operating bodies. For example, when the contact operation is performed by three fingers, the position detection unit 202 detects the contact position of each of the three fingers. Since the contact position of each finger actually has a certain range, for example, the position detection unit 202 applies the position of the center of gravity of each finger as the contact position of each finger. You may try to do it.

When a plurality of contact positions are detected by the position detection unit 202 (that is, when a contact operation is performed by a plurality of operating bodies), the calculation unit 203 is used between the plurality of operating bodies based on the plurality of contact positions. Calculate the value according to the distance of. For example, the calculation unit 203 calculates the outer peripheral distance of the figure formed by the contact positions of the plurality of operating bodies as a value corresponding to the distance between the plurality of operating bodies. To explain a specific example, for example, it is assumed that points A, B, and C are detected as contact positions of three fingers. In this case, the calculation unit 203 determines the outer peripheral distance of the triangle formed by points A, B, and C (that is, the distance between points A and B and the distance between points B and C). , The sum of the distances between points C and A) is calculated as a value according to the distances between the plurality of operating bodies.

The pressing force detecting unit 204 detects the pressing force in the contact operation with respect to the operation panel 110 based on the pressure detection signal acquired by the signal acquisition unit 201. Specifically, the pressing force detecting unit 204 can calculate the pressing force as the pressing force in the contact operation by converting the voltage value indicated by the pressure detection signal into the pressing force based on a predetermined conversion formula. can. The pressing force detection unit 204 may use the voltage value indicated by the pressure detection signal as it is as a value indicating the pressing force in the contact operation.

The movement specifying unit 205 specifies the moving direction and the moving amount of the operating body in the contact operation based on the contact positions (two or more contact positions detected in time series) detected by the position detecting unit 202. For example, the movement specifying unit 205 specifies the distance between the start point and the end point in the movement operation as the movement amount of the operating body. Further, for example, the movement specifying unit 205 specifies the vector direction from the start point to the end point in the movement operation as the movement direction of the operating body. When a plurality of contact positions are detected by the position detection unit 202 (that is, when a contact operation is performed by a plurality of operating bodies), the movement identification unit 205 may be, for example, a predetermined position based on the plurality of contact positions (that is, when the contact operation is performed by the plurality of operating bodies). For example, the positions of the centers of gravity of a plurality of contact positions) may be used as the start point and the end point.

The function execution control unit 206 controls the execution of a predetermined function based on the value calculated by the calculation unit 203 according to the distance between the plurality of operating bodies.

For example, when the calculation unit 203 calculates the outer peripheral distance of a figure formed by the contact positions of a plurality of operating bodies, the function execution control unit 206 controls the execution of a predetermined function based on the outer peripheral distance. ..

In this case, for example, the function execution control unit 206 executes the first predetermined function when the outer peripheral distance calculated by the calculation unit 203 is larger than the predetermined threshold value th2 (second predetermined threshold value). .. On the contrary, when the outer peripheral distance calculated by the calculation unit 203 is smaller than the predetermined threshold value th2, the function execution control unit 206 executes the second predetermined function.

The predetermined function executed by the control of the function execution control unit 206 may be any function possessed by the notebook computer 10, and is, for example, a function of a specific application possessed by the notebook computer 10, vibration by the actuator 120, or the like. .. In the present embodiment, the notebook computer 10 in which the "magnifying glass application" is installed is used as an example. In this way, when the notebook computer 10 has the "magnifying glass application", the first predetermined item is described above. As a function of, the reduction function of the "magnifying glass application" can be used, and as the second predetermined function, the magnifying function of the "magnifying glass application" can be used. As the first predetermined function, instead of the reduction function, a function of returning the magnifying glass of the "magnifying glass application" to the default magnifying glass (for example, "100%") may be used.

The association between the determination condition based on the value calculated by the calculation unit 203 and the predetermined function to be executed is stored in advance in a memory or the like provided in the input control device 200. Therefore, the function execution control unit 206 refers to the correspondence stored in the memory or the like, and is based on the value calculated by the calculation unit 203 (the value according to the distance between the plurality of operating bodies). , It is possible to determine a predetermined function to be executed.

The function execution control unit 206 controls the execution of a predetermined function after starting the application if the application required for executing the predetermined function is not started when the contact operation is performed by a plurality of operating bodies. can do. For example, when the function execution control unit 206 performs a contact operation by a plurality of operating bodies, if the "magnifying glass application" having the magnifying glass function and the magnifying glass function is not activated, the function execution control unit 206 uses the "magnifying glass application". After starting, it controls the execution of the enlargement function and the reduction function.

The function execution control unit 206 executes a predetermined function based on the value calculated by the calculation unit 203 according to the distance between the plurality of operating bodies and the pressing force detected by the pressing force detecting unit 204. Can be controlled. For example, in the present embodiment, when the pressing operation with three fingers is performed, the pressing force detected by the pressing force detecting unit 204 is larger than the predetermined threshold value th1 (first predetermined threshold value). The execution control unit 206 controls the execution of the enlargement function and the reduction function. On the other hand, when the pressing operation with three fingers is performed and the pressing force detected by the pressing force detecting unit 204 is equal to or less than the predetermined threshold value th1, the function execution control unit 206 has a function other than the enlargement function and the reduction function. Controls the execution of other predetermined functions (movement function, etc.).

The vibration control unit 207 outputs a vibration control signal for generating vibration to the input device 100 (actuator 120). The actuator 120 generates vibration on the operation surface of the operation panel 110 based on the vibration control signal output from the vibration control unit 207. For example, when a predetermined function executed by the control of the function execution control unit 206 includes vibration by the actuator 120, the vibration control unit 207 causes the actuator 120 in response to an instruction from the function execution control unit 206. By outputting the vibration control signal, vibration is generated in the actuator 120. The function execution control unit 206 can set the vibration characteristics (frequency and amplitude) generated in the actuator 120 to the characteristics corresponding to the contact operation with respect to the operation panel 110 by the vibration control signal. For example, when the contact operation with three fingers is performed, the function execution control unit 206 may cause the actuator 120 to generate vibration having characteristics different from those when the other contact operations are performed. In this case, the function execution control unit 206 may determine the characteristics of the vibration generated in the actuator 120 based on the value calculated by the calculation unit 203 according to the distance between the plurality of operating bodies.

Each function of the input control device 200 described above is, for example, a CPU (Central Processing) of a program stored in a memory (for example, ROM (Read Only Memory), RAM (Random Access Memory), etc.) in the input control device 200. It is realized by executing Unit) (computer).

This program may be provided together with the notebook computer 10 in a state of being installed in the notebook computer 10, or may be provided from the outside separately from the notebook computer 10 and installed in the notebook computer 10. .. In the latter case, these programs may be provided to the notebook computer 10 by an external storage medium (for example, USB memory, memory card, CD-ROM, etc.), and may be downloaded from a server on the network (for example, the Internet, etc.). By doing so, it may be provided to the notebook computer 10.

(Procedure of processing by the input control device 200)
FIG. 5 is a flowchart showing a processing procedure by the input control device 200 according to the embodiment. In the process shown in FIG. 5, for example, when the input device 100 performs a contact operation with respect to the operation surface and the position detection signal output from the input device 100 is input to the input control device 200, the input control is performed. Performed by device 200.

First, the signal acquisition unit 201 acquires various operation signals (position detection signal, pressure detection signal) input to the input control device 200 (step S501). Next, the position detection unit 202 detects the contact positions of the plurality of operating bodies in the contact operation with respect to the operation panel 110 based on the position detection signal acquired in step S501 (step S502). Here, while the operation on the operation panel 110 is continued, various operation signals (position detection signal and pressure detection signal) are repeatedly output from the input device 100, so that the signal acquisition unit 201 performs various operations each time. Get the signal. Further, the position detection unit 202 detects the contact position of the operating body each time.

Next, the calculation unit 203 calculates a value according to the distance between the plurality of operating bodies based on the contact positions of the plurality of operating bodies detected in step S502 (step S503). Here, the calculation unit 203 calculates the outer peripheral distance of the figure formed by the contact positions of the plurality of operating bodies as a value corresponding to the distance between the plurality of operating bodies. If the contact positions of the plurality of operating bodies are not detected in step S502, the calculation process of step S503 is unnecessary.

Next, the pressing force detecting unit 204 detects the pressing force by the plurality of operating bodies in the contact operation with respect to the operation panel 110 based on the pressure detecting signal acquired in step S501 (step S504). Further, the movement specifying unit 205 specifies the movement direction and the movement amount of the plurality of operating bodies in the contact operation based on the contact position (contact position detected twice or more in time series) in step S502 (the movement specifying unit 205). Step S505).

After that, the function execution control unit 206 detected the contact position of the plurality of operating bodies detected in step S502, the value according to the distance between the plurality of operating bodies calculated in step S503, and the value in step S504. A predetermined function to be executed is determined by executing a predetermined determination process based on the pressing force and the movement direction and movement amount specified in step S505 (step S506). The details of the discrimination process by the function execution control unit 206 will be described later with reference to FIG.

After that, the function execution control unit 206 controls the execution of the predetermined function determined in step S506 (step S507), and the input control device 200 ends a series of processes shown in FIG.

(Procedure of discrimination processing by function execution control unit 206)
FIG. 6 is a flowchart showing a procedure of discrimination processing by the input control device 200 (function execution control unit 206) according to the embodiment.

First, the function execution control unit 206 determines whether or not the contact operation with respect to the operation panel 110 is a contact operation with three fingers (step S601). For example, when the function execution control unit 206 detects three contact positions in step S502 of FIG. 5, it determines that the contact operation is performed by three fingers. If it is determined in step S601 that the operation is a contact operation with three fingers (step S601: Yes), the function execution control unit 206 proceeds to step S602. On the other hand, when it is determined in step S601 that "it is not a contact operation with three fingers" (step S601: No), the function execution control unit 206 ends a series of processes shown in FIG.

In step S602, the function execution control unit 206 determines whether or not the pressing force detected in step S504 of FIG. 5 is larger than the predetermined threshold value th1 (for example, “100 g”). When it is determined in step S602 that "the pressing force is larger than the predetermined threshold value th1" (step S602: Yes), the function execution control unit 206 proceeds to step S603. On the other hand, when it is determined in step S602 that "the pressing force is equal to or less than the predetermined threshold value th1" (step S602: No), the function execution control unit 206 proceeds to step S608.

Steps S603 to S607 are discrimination processes when a pressing operation with three fingers is performed.

In step S603, the function execution control unit 206 determines whether or not the "magnifying glass application" is activated in the notebook computer 10. If it is determined in step S603 that "the" magnifying glass application "is activated" (step S603: Yes), the function execution control unit 206 proceeds to step S605. On the other hand, when it is determined in step S603 that "the" magnifying glass application "has not been started" (step S603: No), the function execution control unit 206 activates the "magnifying glass application" (step S604). , Proceed to step S605.

In step S605, whether or not the outer peripheral distance of the figure formed by the contact positions of the plurality of operating bodies calculated by the function execution control unit 206 in step S503 of FIG. 5 is less than the second predetermined threshold value th2. To judge. When it is determined in step S605 that "the outer peripheral distance is less than the predetermined threshold value th2" (step S605: Yes), the function execution control unit 206 executes the magnifying function of the "magnifying glass application" (step S607). , The series of processes shown in FIG. 6 is completed. On the other hand, when it is determined in step S605 that "the outer peripheral distance is equal to or greater than a predetermined threshold value th2" (step S605: No), the function execution control unit 206 executes the reduction function of the "magnifying glass application" (step). S606), the series of processes shown in FIG. 6 is completed.

Steps S608 to S612 are discrimination processes when another contact operation with three fingers is performed.

In step S608, the function execution control unit 206 determines whether or not the "magnifying glass application" is activated in the notebook computer 10. If it is determined in step S608 that "the" magnifying glass application "is activated" (step S608: Yes), the function execution control unit 206 proceeds to step S609. On the other hand, when it is determined in step S608 that "the" magnifying glass application "has not been started" (step S608: No), the function execution control unit 206 ends a series of processes shown in FIG.

In step S609, the function execution control unit 206 determines whether or not the contact operation with three fingers is a movement operation. For example, when the movement amount specified in step S505 of FIG. 5 is equal to or greater than a predetermined threshold value th3 (for example, “1”), the function execution control unit 206 states that “a contact operation with three fingers is a movement operation”. to decide. When it is determined in step S609 that it is a "movement operation" (step S609: Yes), the function execution control unit 206 executes a function of moving the screen of the "magnifying glass application" (step S610), and FIG. The series of processing shown in is completed. On the other hand, if it is determined in step S609 that "it is not a movement operation" (step S609: No), the function execution control unit 206 proceeds to step S611.

In step S611, the function execution control unit 206 determines whether or not the contact operation with three fingers is a tap operation. For example, when the contact time of the three contact positions detected in step S502 of FIG. 5 is less than the predetermined threshold value th4 (for example, “0.5 seconds”), the function execution control unit 206 may use “three fingers”. The contact operation is a tap operation. " When it is determined in step S611 that the operation is "tap operation" (step S611: Yes), the function execution control unit 206 terminates the "magnifying glass application" (step S612), and a series of processes shown in FIG. To finish. On the other hand, when it is determined in step S611 that "it is not a tap operation" (step S611: No), the function execution control unit 206 ends a series of processes shown in FIG.

(Example of pressing operation on the operation panel 110)
FIG. 7 is a diagram showing an example of a pressing operation on the operation panel 110 according to the embodiment. 7 (a) and 7 (b) exemplify the contact positions of the three fingers when the operation panel 110 is pressed by the three fingers.

In the example shown in FIG. 7A, the position detection unit 202 detects P1, P2, and P3 as the contact positions of the three fingers, respectively. In the example shown in FIG. 7A, it is assumed that the pressing force detecting unit 204 detects a pressing force larger than the predetermined threshold value th1 as the pressing force on the operation panel 110. In this case, the calculation unit 203 uses the outer peripheral distance of the triangle formed by the contact positions P1, P2, and P3 (that is, the distance between P1 and P2, the distance between P2 and P3, and P3 and P1. The sum of the distances between the two) is calculated as a value according to the distances between the plurality of operating bodies. Here, it is assumed that the outer peripheral distance calculated by the calculation unit 203 is less than the predetermined threshold value th2. In this case, the function execution control unit 206 executes the reduction function of the "magnifying glass application" activated in the notebook computer 10. However, when the "magnifying glass application" is not started, the function execution control unit 206 executes the reduction function of the "magnifying glass application" after starting the "magnifying glass application". Here, for example, when the same pressing operation is repeatedly performed, the function execution control unit 206 may execute the reduction function of the "magnifying glass application" each time. Further, for example, when the operation panel 110 is pressed for a predetermined time or longer by the same pressing operation, the function execution control unit 206 continuously executes the reduction function of the "magnifying glass application". You may do so.

On the other hand, in the example shown in FIG. 7B, the position detection unit 202 detects P4, P5, and P6 as the contact positions of the three fingers, respectively. In the example shown in FIG. 7B, it is assumed that the pressing force detecting unit 204 has detected a pressing force larger than the predetermined threshold value th1 as the pressing force on the operation panel 110. In this case, the calculation unit 203 uses the outer peripheral distance of the triangle formed by the contact positions P4, P5, and P6 (that is, the distance between P4 and P5, the distance between P5 and P6, and P6 and P4. The sum of the distances between the two) is calculated as a value according to the distances between the plurality of operating bodies. Here, it is assumed that the outer peripheral distance calculated by the calculation unit 203 is equal to or higher than the predetermined threshold value th2. In this case, the function execution control unit 206 executes the magnifying function of the "magnifying glass application" activated in the notebook computer 10. However, when the "magnifying glass application" is not started, the function execution control unit 206 executes the magnifying function of the "magnifying glass application" after starting the "magnifying glass application". Here, for example, when the same pressing operation is repeatedly performed, the function execution control unit 206 may execute the magnifying function of the "magnifying glass application" each time. Further, for example, when the operation panel 110 is pressed for a predetermined time or longer by the same pressing operation, the function execution control unit 206 continuously executes the magnifying function of the "magnifying glass application". You may do so.

(Execution example of expansion function by input control device 200)
FIG. 8 is a diagram showing an execution example of an expansion function by the input control device 200 (function execution control unit 206) according to the embodiment. The display screen 800 shown in FIG. 8 is an example of a display screen displayed on the display 12 included in the notebook computer 10. For example, the display screen 800 is a so-called desktop screen in which a plurality of icons are displayed in a list. As shown in FIG. 8, the display screen 800 displays the display screen 810 of the "magnifying glass application" activated in the notebook computer 10. The display screen 810 can display an image of an area in the display screen 810 in an enlarged or reduced manner. For example, FIG. 8A shows a state in which the image of the area in the display screen 810 is not enlarged. Further, FIG. 8B shows a state in which the image of the area in the display screen 810 is enlarged. The notebook computer 10 of the present embodiment can enlarge and reduce the image of the area in the display screen 810 by pressing the operation panel 110 with three fingers. For example, as described with reference to FIG. 7A, the display is performed by performing a pressing operation with the three fingers so that the outer peripheral distance of the triangle formed by the contact position of the three fingers is less than the predetermined threshold value th2. The image of the area in the screen 810 can be enlarged. On the other hand, as described in FIG. 7B, the display is performed by performing a pressing operation with the three fingers so that the outer peripheral distance of the triangle formed by the contact position of the three fingers is equal to or more than the predetermined threshold value th2. The image of the area in the screen 810 can be reduced.

(Example of movement operation for the operation panel 110)
FIG. 9 is a diagram showing an example of a movement operation with respect to the operation panel 110 according to the embodiment. 9 (a) and 9 (b) exemplify the contact positions of the three fingers when the movement operation with the three fingers is performed with respect to the operation panel 110. FIG. 9A exemplifies the contact positions of the three fingers before the movement operation, and FIG. 9B exemplifies the contact positions of the three fingers after the movement operation.

In the example shown in FIG. 9A, the position detection unit 202 detects P1, P2, and P3 as the contact positions of the three fingers before the movement operation, respectively. Further, in the example shown in FIG. 9B, the position detection unit 202 detects P1', P2', and P3', respectively, as the contact positions of the three fingers after the movement operation. In the examples shown in FIGS. 9A and 9B, it is assumed that the pressing force detecting unit 204 detects a pressing force smaller than the predetermined threshold value th1 as the pressing force on the operation panel 110. ..

In this case, the movement specifying unit 205 has the contact positions P1, P2, P3 of the three fingers before the movement operation and the contact positions P1'of the three fingers after the movement operation detected by the position detection unit 202. Based on P2'and P3', the movement direction and the movement amount of the three fingers in the movement operation are specified. For example, the movement specifying unit 205 specifies the distance between the start point and the end point in the movement operation as the movement amount of the operating body. Further, for example, the movement specifying unit 205 specifies the vector direction from the start point to the end point in the movement operation as the movement direction of the operating body. In this case, for example, the movement specifying unit 205 may use the position of the center of gravity of the contact position of the three fingers as the start point and the end point.

Then, when the movement direction and the movement amount are specified by the movement identification unit 205, the function execution control unit 206 displays the "magnifying glass application" activated in the notebook computer 10 according to the movement direction and the movement amount. Perform the function of moving the screen.

(Execution example of the movement function by the input control device 200)
FIG. 10 is a diagram showing an execution example of a movement function by the input control device 200 (function execution control unit 206) according to the embodiment. FIG. 10A shows a state in which the display screen 810 is in the position before the movement, and the image in the area of the display screen 810 before the movement is enlarged. Further, FIG. 10B shows a state in which the inside of the display screen 810 is in the position after the movement, and the image in the area of the display screen 810 after the movement is enlarged. The notebook computer 10 of the present embodiment can move the display screen 810 on the display screen 800 by a three-finger movement operation with respect to the operation panel 110. For example, as described with reference to FIG. 9, by moving the three fingers while keeping the three fingers in contact with the operation panel, the display screen 810 is displayed according to the movement direction and the movement amount of the three fingers. Can be moved. As a result, the notebook computer 10 of the present embodiment can move the area for enlarging the image on the display screen 800 by an easy and intuitive contact operation with the operation panel 110.

As described above, when the input control device 200 of the present embodiment performs a contact operation by a plurality of operating bodies, the input control device 200 executes a predetermined function based on a value according to a distance between the plurality of operating bodies. Can be controlled. Thereby, according to the input control device 200 of the present embodiment, a plurality of functions can be assigned to the contact operation by the plurality of operating bodies according to the distance between the plurality of operating bodies. Therefore, according to the input control device 200 of the present embodiment, it is possible to perform more functions by contacting the operation surface with the operating body.

In particular, in the input control device 200 of the present embodiment, when the pressing force on the operation panel 110 is larger than the predetermined threshold value th1 (that is, when the pressing operation is performed), the pressing force on the operation panel 110 is the predetermined threshold value th1. It is possible to control the execution of different predetermined functions when it is smaller than (that is, when a non-pressing operation is performed). As a result, according to the input control device 200 of the present embodiment, a plurality of functions can be assigned to a contact operation by a plurality of operating bodies according to the operation type (whether or not it is a pressing operation). .. Therefore, according to the input control device 200 of the present embodiment, it is possible to perform more functions by contacting the operation surface with the operating body.

Further, the input control device 200 of the present embodiment has a function (for example, an enlargement function and a reduction function) executed by changing the distance between the plurality of operation bodies when performing a contact operation by the plurality of operation bodies. ) Can be switched. Therefore, for example, the user can switch and execute a plurality of different functions by an easy and intuitive operation.

Further, the input control device 200 of the present embodiment is such an application when an application having a predetermined function (for example, a "magnifying glass application") is not started when a contact operation is performed by a plurality of operating bodies. After activating, the execution of the predetermined function can be controlled. Therefore, for example, the user can start the application and execute a desired function by an easy and intuitive operation without separately performing a time-consuming operation for starting the application.

Although one embodiment of the present invention has been described in detail above, the present invention is not limited to these embodiments, and various modifications or modifications are made within the scope of the gist of the present invention described in the claims. It can be changed.

For example, in the above embodiment, the magnifying glass function and the magnifying glass function of the "magnifying glass application" are used as "predetermined functions" for controlling execution based on values according to distances between a plurality of operating bodies. The "predetermined function" is not limited to this. The "predetermined function" may be any function provided in the notebook computer 10, and for example, any of the functions (1) to (4) exemplified below may be used as the "predetermined function". May be good.

・ Function (1): Volume adjustment function ・ Function (2): Display brightness adjustment function ・ Function (3): Slide bar operation position adjustment function ・ Function (4): Enlargement / reduction function of other apps

When any one of the above functions (1) to (4) is used as a "predetermined function", the function execution control unit 206 has a volume, brightness, and slide according to the pressing force detected by the pressing force detecting unit 204. The bar or the adjustment speed of the enlargement ratio may be changed. For example, the function execution control unit 206 may control so that the adjustment speed of the volume, the brightness, the slide bar, or the enlargement ratio becomes faster as the pressing force detected by the pressing force detecting unit 204 increases. Further, for example, when the same pressing operation is repeatedly performed, the function execution control unit 206 may adjust the volume, the brightness, the slide bar, or the enlargement ratio each time. Further, for example, when the operation panel 110 is pressed for a predetermined time or longer by the same pressing operation, the function execution control unit 206 may be the volume, the luminance, the slide bar, or the function execution control unit 206. The enlargement ratio may be adjusted continuously.

Further, for example, in the above embodiment, the outer peripheral distance of the figure formed by the contact positions of the plurality of operating bodies is calculated as the "value according to the distance between the plurality of operating bodies". The "value according to the distance between a plurality of operating bodies" is not limited to this. The "value according to the distance between a plurality of operating bodies" is any information as long as it is calculated based on the distance between a plurality of operating bodies (at least, the distance between any two points). However, for example, FIG. 11 (a diagram for explaining a modification of the calculation method by the input control device 200 (calculation unit 203) according to one embodiment) and calculation examples (1) to (3) exemplified below may be used. ) May be used to calculate the "value according to the distance between a plurality of operating bodies".

-Calculation example (1): The maximum area of the area surrounded by the contact positions of a plurality of (3 or more) operating bodies. For example, as shown in FIG. 11A, when a contact operation is performed by three fingers and the contact positions P1, P2 and P3 of the three fingers are detected, the contact positions P1 of the three fingers are detected. The area of the triangle formed by P2 and P3 (the area of the shaded portion in FIG. 11A) may be used as the "value according to the distance between the plurality of operating bodies".

-Calculation example (2): For all combinations of two contact positions, the distances between the two contact positions are obtained, and the predetermined N distances are added up in descending order of distance. For example, as shown in FIG. 11B, when the contact operation is performed by four fingers and the contact positions P4, P5, P6, P7 of the four fingers are detected, all the combinations shown below are used. Find the distance between the two contact positions. Here, it is assumed that the distance between the two contact positions is obtained for each combination as follows.

・ Combination P4-P5: 12 mm
・ Combination P4-P6: 33mm
・ Combination P4-P7: 25mm
・ Combination P5-P6: 35mm
・ Combination P5-P7: 35mm
・ Combination P6-P7: 22mm
Then, for example, when the three distances are added up in the order of the longest distance, 35 + 35 + 25 = 95 mm. In this case, "95 mm" is "a value according to the distance between a plurality of operating bodies".

-Calculation example (3): Of a plurality of contact positions, the contact position at the lowest position is used as a reference position, the distance from the reference position is obtained for each of the other contact positions, and the longest distance is "multiple". It is used as a "value according to the distance between the operating bodies of." For example, as shown in FIG. 11C, when the contact operation is performed by four fingers and the contact positions P8, P9, P10, P11 of the four fingers are detected, the contact position at the lowest position is detected. P9 is the reference position. Then, the distance from the reference position P9 is obtained for each of the other contact positions P8, P10, and P11. Here, it is assumed that the distance from the reference position P9 to the other contact positions P8, P10, P11 is obtained as follows.

・ Distance from P9 to P8: 12mm
・ Distance from P9 to P10: 24mm
・ Distance from P9 to P11: 36mm
In this case, the longest distance, "36 mm", is the "value according to the distance between the plurality of operating bodies".

In the above calculation example (3), when there are a plurality of contact positions at the lowest position, for example, the distances from the other contact positions are calculated and calculated using these plurality of contact positions as reference positions. The longest distance among the distances may be used as "a value according to the distance between a plurality of operating bodies". Further, in the above calculation example (3), for example, among the plurality of contact positions, the contact position at the lowest position (for example, P9) is set as a reference position, and the reference position and a plurality of other contact positions (for example). , P8, P10, P11) may be used as a "value corresponding to the distance between a plurality of operating bodies".

Further, for example, in the above embodiment, an example of applying the present invention to an input device having no display panel is shown, but the present invention is not limited to this, and the present invention is limited to an input device having a display panel (for example, a touch panel or the like). It can also be applied to.

Further, for example, in the above embodiment, when the predetermined function to be executed is performed in two stages (when it is larger than the threshold value th2 and smaller than the threshold value th2) according to the "value according to the distance between the plurality of operating bodies". ), But not limited to this, even if the predetermined function to be executed is determined in three or more stages according to the "value according to the distance between a plurality of operating bodies". good.

Further, for example, in the above embodiment, the number of the plurality of operating bodies is mainly three, but the number is not limited to this, and the number of the plurality of operating bodies may be two or four or more.

10 Laptop computer (device to be operated)
12 Display 100 Input device 110 Operation panel (operation unit)
111 Cover glass 112 Adhesive sheet 113 Printed circuit board 114 Electrostatic sensor 120 Actuator (tactile presentation means)
122 Control circuit 124 Cushioning member 130 Force sensor (pressure detecting means)
135 FPC
140 Metal frame 200 Input control device 201 Signal acquisition unit 202 Position detection unit 203 Calculation unit 204 Push pressure detection unit 205 Movement identification unit 206 Function execution control unit 207 Vibration control unit

Claims (17)

When a contact operation is performed by a plurality of operating bodies on the operation surface of the input device, a calculation unit that calculates a value according to the distance between the plurality of operating bodies, and a calculation unit.
A function execution control unit that controls execution of a predetermined function based on the value calculated by the calculation unit is provided .
The calculation unit
For each of the combinations of the two contact positions in the contact positions of the plurality of operating bodies, the distance between the two contact positions is calculated, and among the calculated distances, a predetermined number of distances are obtained in descending order of distance. Is calculated as the above-mentioned value.
An input control device characterized by that. When a contact operation is performed by a plurality of operating bodies on the operation surface of the input device, a calculation unit that calculates a value according to the distance between the plurality of operating bodies, and a calculation unit.
With the function execution control unit that controls the execution of a predetermined function based on the value calculated by the calculation unit.
Equipped with
The calculation unit
With at least one of the contact positions of the plurality of operating bodies as the reference position, the distance between the reference position and each of the other contact positions is calculated, and the most of the calculated distances is the most. Calculate the long distance as the above value
An input control device characterized by that. Further, a pressing force detecting unit for detecting the pressing force in the contact operation is provided.
The function execution control unit is
The invention according to claim 1 or 2 , wherein the execution of the predetermined function is controlled based on the value calculated by the calculation unit and the pressing force detected by the pressing force detecting unit. Input control device. The function execution control unit is
When the pressing force detected by the pressing force detecting unit is larger than the first predetermined threshold value, the execution of the predetermined function is controlled based on the value calculated by the calculating unit. The input control device according to claim 3 . The function execution control unit is
The specified function to be performed is specified based on the value calculated by the calculation unit, and the specified function is specified based on the duration of the contact operation and at least one of the pressing force. The input control device according to claim 4 , wherein the adjustment amount of a predetermined function is controlled. The function execution control unit is
When the pressing force detected by the pressing force detecting unit is larger than the first predetermined threshold value, the expansion function of a predetermined application is performed as the predetermined function based on the value calculated by the calculating unit. The input control device according to claim 4 or 5 , wherein the operation of the reduction function is controlled. The function execution control unit is
When the value calculated by the calculation unit is larger than the second predetermined threshold value, the execution of one of the enlargement function and the reduction function is controlled.
The input control according to claim 6 , wherein when the value calculated by the calculation unit is smaller than the second predetermined threshold value, the execution of the other of the enlargement function and the reduction function is controlled. Device. The function execution control unit is
When the pressing force detected by the pressing force detecting unit is smaller than the first predetermined threshold value and the contact operation by the plurality of operating bodies is a moving operation, the execution of the moving function of the predetermined application. The input control device according to claim 6 or 7 , wherein the control device is used. The function execution control unit is
If the application required to execute the predetermined function is not started when the contact operation is performed by the plurality of operating bodies, it is possible to control the execution of the predetermined function after starting the application. The input control device according to any one of claims 1 to 8 , wherein the input control device is characterized. With more tactile presentation means
The input control according to any one of claims 1 to 9 , wherein the function execution control unit controls tactile presentation by the tactile presenting means based on the value calculated by the calculation unit. Device. The input control device according to any one of claims 1 to 10 , wherein the number of the plurality of operating bodies is 3 or more. An operation unit that has an operation surface and detects a contact operation by the operating body with respect to the operation surface.
When a contact operation is performed on the operation surface by a plurality of operating bodies, a calculation unit that calculates a value according to the distance between the plurality of operating bodies, and a calculation unit.
A function execution control unit that controls execution of a predetermined function based on the value calculated by the calculation unit is provided .
The calculation unit
For each of the combinations of the two contact positions in the contact positions of the plurality of operating bodies, the distance between the two contact positions is calculated, and among the calculated distances, a predetermined number of distances are obtained in descending order of distance. Is calculated as the above-mentioned value.
An input device characterized by that. An operation unit that has an operation surface and detects a contact operation by the operating body with respect to the operation surface.
When a contact operation is performed on the operation surface by a plurality of operating bodies, a calculation unit that calculates a value according to the distance between the plurality of operating bodies, and a calculation unit.
With the function execution control unit that controls the execution of a predetermined function based on the value calculated by the calculation unit.
Equipped with
The calculation unit
With at least one of the contact positions of the plurality of operating bodies as the reference position, the distance between the reference position and each of the other contact positions is calculated, and the most of the calculated distances is the most. An input device characterized in that a long distance is calculated as the above-mentioned value . An operation target device equipped with an input device and an input control device.
The input control device is
When a contact operation is performed by a plurality of operating bodies on the operation surface of the input device, a calculation unit that calculates a value according to the distance between the plurality of operating bodies, and a calculation unit.
A function execution control unit that controls execution of a predetermined function based on the value calculated by the calculation unit is provided .
The calculation unit
For each of the combinations of the two contact positions in the contact positions of the plurality of operating bodies, the distance between the two contact positions is calculated, and among the calculated distances, a predetermined number of distances are obtained in descending order of distance. Is calculated as the above-mentioned value.
The device to be operated, which is characterized by that. An operation target device equipped with an input device and an input control device.
The input control device is
When a contact operation is performed by a plurality of operating bodies on the operation surface of the input device, a calculation unit that calculates a value according to the distance between the plurality of operating bodies, and a calculation unit.
With the function execution control unit that controls the execution of a predetermined function based on the value calculated by the calculation unit.
Equipped with
The calculation unit
With at least one of the contact positions of the plurality of operating bodies as the reference position, the distance between the reference position and each of the other contact positions is calculated, and the most of the calculated distances is the most. Calculate the long distance as the above value
The device to be operated, which is characterized by that. Computer,
When a contact operation is performed by a plurality of operating bodies on the operation surface of the input device, a calculation unit that calculates a value according to the distance between the plurality of operating bodies, and a calculation unit.
Based on the value calculated by the calculation unit, it is made to function as a function execution control unit that controls the execution of a predetermined function .
The calculation unit
For each of the combinations of the two contact positions in the contact positions of the plurality of operating bodies, the distance between the two contact positions is calculated, and among the calculated distances, a predetermined number of distances are obtained in descending order of distance. Is calculated as the above-mentioned value.
Program for. Computer,
When a contact operation is performed by a plurality of operating bodies on the operation surface of the input device, a calculation unit that calculates a value according to the distance between the plurality of operating bodies, and a calculation unit.
A function execution control unit that controls the execution of a predetermined function based on the value calculated by the calculation unit.
To function as
The calculation unit
With at least one of the contact positions of the plurality of operating bodies as the reference position, the distance between the reference position and each of the other contact positions is calculated, and the most of the calculated distances is the most. Calculate the long distance as the above value
Program for.

Images