JP2015055955A - Operation notification device - Google Patents

Abstract

PROBLEM TO BE SOLVED: To provide an operation notification device capable of suppressing discomfort based on a notification consecutively performed.SOLUTION: An operation notification device 1 includes: a detection unit 11 that detects an operation performed on an operation surface 100; a vibration presentation unit 12 that gives such a notification that a trajectory 500 in a display screen 50 of a display 5 corresponding to an operation trajectory 101 of the operation detected by the detection unit 11 intersects with a virtual boundary 54 set based on an image displayed on the display screen 50; and a control unit 17 that controls the vibration presentation unit 12 so that the size of the notification gradually attenuates to predetermined size as consecutively performing the notification, when the trajectory 500 consecutively intersects with the virtual boundary 54.

Description

  The present invention relates to an operation notification device.

  As a conventional technique, a character input device including a touch panel that detects a contact operation, a control unit that displays a plurality of buttons each associated with a character on the touch panel, and a vibration unit that vibrates the touch panel is known. (For example, refer to Patent Document 1).

  The control unit of the character input device accepts as input a character corresponding to a button displayed at a position where a predetermined contact operation is detected, and changes the vibration operation on the touch panel by the vibration unit. The user can recognize whether a character has been input.

JP 2012-221179 A

  However, since the conventional character input device applies a constant vibration to the touch panel until a predetermined contact operation is detected, it is the same size whether it passes through one button or a plurality of buttons in succession. This may cause a user to feel uncomfortable.

  Therefore, the objective of this invention is providing the operation alerting device which can suppress the discomfort based on alerting | reporting performed continuously.

  One embodiment of the present invention is based on a detection unit that detects an operation performed on the operation surface, and a trajectory on the display screen of the display device corresponding to the trajectory of the operation detected by the detection unit is based on an image displayed on the display screen. And a notification unit for notifying that the virtual boundary set in advance is intersected, and when the locus continuously intersects with the virtual boundary, the notification size is attenuated to a predetermined size as the notification is performed. Thus, an operation notification device including a control unit that controls the notification unit is provided.

  ADVANTAGE OF THE INVENTION According to this invention, the discomfort based on the alert | report performed continuously can be suppressed.

FIG. 1A is a schematic diagram for explaining the configuration of the operation notification device according to the first embodiment, FIG. 1B is a block diagram of the operation notification device, and FIG. It is a block diagram which shows the connection relation of an alerting | reporting apparatus and an electronic device. FIG. 2A is an enlarged view for explaining vibrations presented by the operation notification device according to the first embodiment, and FIG. 2B is an image displayed on the display screen and vibrations presented. It is the schematic which shows these relationships. FIG. 3 is a flowchart for explaining the operation of the operation notification device according to the first embodiment. FIG. 4 is a schematic diagram illustrating a relationship between an image displayed on a display screen to which an operation notification device according to the second embodiment is connected and vibrations to be presented. FIG. 5 is a schematic diagram illustrating a relationship between an image displayed on a display screen to which an operation notification device according to a third embodiment is connected and vibrations to be presented. FIG. 6 is a schematic diagram illustrating a relationship between an image displayed on a display screen to which an operation notification device according to the fourth embodiment is connected and vibrations to be presented.

(Summary of embodiment)
The operation notification device according to the embodiment includes a detection unit that detects an operation performed on the operation surface, and a trajectory on the display screen of the display device corresponding to the trajectory of the operation detected by the detection unit is displayed on the display screen. An informing unit for informing that the virtual boundary set based on the image has intersected, and a size of which the notification is predetermined as the notification is performed when the locus continuously intersects with the virtual boundary. And a control unit that controls the notification unit so as to be attenuated.

  This operation notification device can suppress discomfort based on continuous notification. Specifically, the operation notification device includes a virtual boundary set based on an image displayed on the display screen of the display device, and a trajectory on the display screen corresponding to the trajectory of the operation performed on the detection unit. When continuously intersecting, the size of the notification is attenuated to a predetermined size as the notification is performed, so that the discomfort caused by the notification can be suppressed compared to the case where the notification of the same size is continuously performed. it can.

[First embodiment]
(Configuration of operation notification device 1)
FIG. 1A is a schematic diagram for explaining the configuration of the operation notification device according to the first embodiment, FIG. 1B is a block diagram of the operation notification device, and FIG. It is a block diagram which shows the connection relation of an alerting | reporting apparatus and an electronic device. Note that, in each drawing according to the embodiment described below, the ratio between figures may be different from the actual ratio. The arrows connecting the blocks mainly indicate the exchange of main signals and the like.

  For example, the operation notification device 1 is configured to be mounted on a vehicle and to operate an electromagnetically connected electronic device based on an operation performed on an operation surface. Further, the operation notification device 1 is such that an operation performed on a detection unit described later intersects with a virtual boundary set based on an image displayed on a display screen of a display device serving as a display unit of the electronic device. In the case of an operation, notification is made to allow the operator to recognize that the operation performed on the detection unit has crossed a virtual boundary. The operator can recognize the presence of the image by this notification.

  Note that the above-described electromagnetic connection is a connection using at least one of a connection by a conductor, a connection by light which is a kind of electromagnetic wave, and a connection by radio wave which is a kind of electromagnetic wave.

  In this embodiment, the notification is performed by adding vibration to the detection unit. The notification is not limited to vibration, but may be performed using at least one of sound, light, and vibration.

  As shown in FIGS. 1A to 1C, the operation notification device 1 includes a detection unit 11 that detects an operation performed on the operation surface 100, and an operation locus as an operation locus detected by the detection unit 11. The vibration presenting unit 12 serving as a notifying unit that notifies that the trajectory 500 on the display screen 50 of the display device 5 corresponding to 101 intersects the virtual boundary 54 set based on the image displayed on the display screen 50. And when the locus 500 continuously intersects the virtual boundary 54, the control unit 17 that controls the vibration presenting unit 12 so that the size of the notification is attenuated to a predetermined size as the notification is performed. In general, it is structured.

  The operation notification device 1 includes a storage unit 13, a clock signal generation unit 14, a count unit 15, and a communication unit 16.

  As shown in FIG. 1C, the operation notification device 1 includes a display device 5, a navigation device 6, an air conditioner 7, and a music playback device 8 via a vehicle LAN (Local Area Network) 4 mounted on the vehicle. Electromagnetically connected.

  This Embodiment demonstrates the case where the operation alerting apparatus 1 is connected to the navigation apparatus 6 as an electronic device. As shown in FIG. 1A, the navigation device 6 displays a 50 sound image 52 as a display image 51 on the display device 5. The 50 sound image 52 is a collection of icons displaying characters such as “A” to “N”. The operation notification device 1 is configured to display the selected character in the input field 53 included in the display image 51 by an operation via the detection unit 11.

The icon is an image displayed on the display screen 50 as various data and processing functions as pictures or characters. When the icon is selected and determined via the detection unit 11, the assigned command is transmitted to the electronic device. Can be processed. The assigned command is outputted to the electronic device as the operation information S ₆ to be described later.

(Configuration of the detection unit 11)
The detection unit 11 detects the position on the touched operation surface 100 by, for example, touching the operation surface 100 with a part of the operator's body (for example, a finger) or a conductive pen, and outputs a detection signal. It is a touchpad that outputs. The detection unit 11 is configured to be able to give instructions such as movement and selection of a cursor displayed on the display device 5, selection of an icon, determination, dragging, dropping, and the like.

  As the detection unit 11, for example, a touch pad such as a resistive film method, an infrared method, a SAW (Surface Acoustic Wave) method, a capacitance method, or the like can be used. The detection unit 11 of the present embodiment is assumed to be a capacitive touch pad as an example, and an operation with a finger will be described below. For example, the detection unit 11 is configured as a mutual capacitance type touch pad that detects a change in current inversely proportional to the distance between a detection electrode and a finger, which will be described later, when the finger approaches the operation surface 100.

  The detection unit 11 is a laminate including a substrate on which drive electrodes and detection electrodes described later are formed, and a protective layer that protects the substrate. The surface of this protective layer is the operation surface 100.

  The protective layer of the detection unit 11 is formed in a plate shape using PET (Polyethylene terephthalate) or glass. The detection unit 11 is disposed on the display device 5. Moreover, the detection part 11 is transparent so that the display screen 50 of the display apparatus 5 arrange | positioned below can be recognized.

  The detection unit 11 includes a plurality of drive electrodes 110 and a plurality of detection electrodes 112. The drive electrode 110 and the detection electrode 112 are electrically connected to a drive unit and a reading unit, which will be described later, via wiring that is electrically connected to the drive electrode 110 and the detection electrode 112, for example. In addition, the structure formed in a laminated body may be sufficient as a drive part and a reading part, for example, and the structure connected with the harness pulled out from the laminated body may be sufficient.

  The drive electrode 110 and the detection electrode 112 are formed using, for example, ITO (Indium Tin Oxide) called a transparent electrode.

  For example, as shown in FIG. 1B, the drive electrode 110 and the detection electrode 112 are arranged so as to intersect along the vertical direction and the horizontal direction of the paper surface. In the present embodiment, the horizontal direction in FIG. 1B is the x axis, the vertical direction is the y axis, and the upper left of the operation surface 100 is the origin.

  The drive electrodes 110 are arranged so as to be orthogonal to the y-axis. The drive electrode 110 is electrically connected to the drive unit 111. The detection electrodes 112 are arranged so as to be orthogonal to the x axis. The detection electrode 112 is electrically connected to the reading unit 113.

The drive electrodes 110 are arranged corresponding to the y-axis coordinates y ₁ to y ₅ . The detection electrodes 112 are arranged corresponding to the x-axis coordinates x ₁ to x ₅ .

  The drive electrodes 110 are insulated from each other. The detection electrodes 112 are insulated from each other. Further, the drive electrode 110 is insulated from the detection electrode 112.

The drive unit 111 is configured to generate drive signals S ₁₁ to S ₁₅ based on the drive signal S ₁ output from the control unit 17. The driving unit 111, a drive signal _{S 11} is supplied to the drive electrodes 110 of the _{y 1,} a drive signal _{S 12} is supplied to the drive electrodes 110 of the _{y 2,} the driving signal _{S 13} is supplied to the drive electrodes 110 _{y 3} , a drive signal _{S 14} is supplied to the drive electrodes 110 of the _{y 4,} and the driving signal _{S 15} is configured to supply to the driving electrodes 110 of the _{y 5.}

The reading unit 113 is configured to cycle through the connection between the detection electrode 112 of the detection electrode 112～X ₅ of _{x 1} based on the switching signal _{S 2} output from the control unit 17. Reading unit 113 reads the detection signal _{S 21} from the detection electrode 112 of the _{x 1,} reads the detection signal _{S 22} from the detection electrode 112 of the _{x 2,} reads the detection signal _{S 23} from the detection electrodes 112 _{x 3,} the _{x 4} It reads the detection signal _{S 24} from the detection electrode 112 is configured to read out the detection signal _{S 25} from the detection electrode 112 of the _{x 5.}

For example, the detection unit 11 drives the drive electrode 110 of y ₁ by the drive signal S ₁₁ output from the drive unit 111, and the reading unit 113 connects the detection electrode 112 of x _{1 to} the detection electrode 112 of x _5. The detection signal S ₂₁ to the detection signal S ₂₅ are read out by switching in order. Detector 11 performs driving in the order of the driving electrode 110 of the driving electrodes 110～Y ₅ of _{y 1,} each time the drive electrodes 110 are driven, the detection electrode 112 of the detection electrode 112～X ₅ of _{x 1} The detection signals S ₂₁ to S ₂₅ are read out to scan for one cycle.

(Configuration of vibration presenting unit 12)
The vibration presenting unit 12 is configured to add vibration to the detection unit 11 based on the vibration control signal S ₃ output from the control unit 17.

  The vibration presenting unit 12 is disposed, for example, on the back side of the detecting unit 11. Therefore, the vibration presenting unit 12 is configured to add vibration to the detection unit 11 in the normal direction of the operation surface 100 and in the direction opposite to the normal direction. Note that the vibration presenting unit 12 is disposed outside the display screen 50 of the display device 5. Accordingly, the detection unit 11 is configured to be larger than the display screen 50 to the extent that the vibration presenting unit 12 is disposed at least.

  For example, the vibration presenting unit 12 includes an actuator such as a voice coil motor or a piezoelectric element. Examples of the material for the piezoelectric element include lithium niobate, barium titanate, lead titanate, lead zirconate titanate (PZT), lead metaniobate, and polyvinylidene fluoride (PVDF). The vibration presenting unit 12 is formed, for example, by using the above material on one side of the metal plate, a single layer bimorph type in which a film formed using the above material is formed on both sides of the metal plate. Alternatively, the actuator may be a laminated unimorph type formed by laminating a plurality of films, or a laminated bimorph type actuator formed by laminating films formed using the above materials on both surfaces of a metal plate.

  The voice coil motor includes, for example, a winding (voice coil) and a magnet. The voice coil is configured to move linearly by a magnetic field formed by a magnet when a current is supplied to the winding.

  Human fingertips have sensory organs called Merkel cells that detect vibration, Meissner bodies, and Patini bodies. Among these, the sensory organ capable of detecting the smallest displacement is the pachini body. Since this Panic body can best detect vibration of about 200 Hz, the vibration generated by the vibration presenting apparatus 1 is assumed to be performed at about 200 Hz as an example.

(Configuration of storage unit 13)
As an example, the storage unit 13 includes a semiconductor memory. The storage unit 13 stores accumulated information 130, vibration patterns 131, and image information 132.

Storage information 130 is information time-sequentially storing the calculation information S ₄ that is output from the control unit 17. The vibration pattern 131 is information related to the vibration pattern of the vibration presenting unit 12.

  The image information 132 is information regarding the display image 51 displayed on the display screen 50 of the display device 5. Specifically, the image information 132 is information related to a virtual boundary 54 that is predetermined based on an icon included in the display image 51 that is a notification target.

(Configuration of clock signal generator 14)
The clock signal generation unit 14 is configured to generate a clock signal _Scl that serves as a reference for driving the operation notification device 1 and supply the clock signal _Scl to a necessary portion.

(Configuration of the counting unit 15)
The count unit 15 measures, for example, the notified number of times and stores the measured result as a count value 150. Counting unit 15 is configured to generate a count value 150 by counting a count signal S ₅ output from the control unit 17. This count value 150 is used to determine the size of the next notification.

(Configuration of communication unit 16)
The communication unit 16 is configured so that the operation notification device 1 communicates with an electronic device that is electromagnetically connected. The communication unit 16 is, for example, operation information S ₆ the control unit 17 generates is configured to output to the electronic device.

(Configuration of control unit 17)
The control unit 17 includes, for example, a CPU (Central Processing Unit) that performs operations and processing on acquired data according to a stored program, a RAM (Random Access Memory) that is a semiconductor memory, a ROM (Read Only Memory), and the like. Microcomputer. In this ROM, for example, a program for operating the control unit 17 is stored. For example, the RAM is used as a storage area for temporarily storing calculation results and the like. Further, the control unit 17 has a threshold 170 in the RAM or ROM.

The control unit 17 controls the driving unit 111 and the reading unit 113 so as to perform scanning based on the clock signal _Scl . Specifically, the control unit 17 generates the drive signal S ₁ based on the clock signal S _cl and outputs it to the drive unit 111, and also generates the switching signal S ₂ and outputs it to the reading unit 113. The detection unit 11 is configured to execute scanning.

Further, the control unit 17 compares the detection signal S _2n (n is an integer of 1 to 5) acquired from the reading unit 113 with the threshold value 170 in the order of acquisition, and detects the capacitance indicating the threshold value of 170 or more. If there is a signal _S2n , its coordinates are calculated. Control unit 17 generates the calculation information S ₄ based on the calculated result, thereby time-sequentially stored in the storage unit 13 as the storage information 130. As an example, the calculation of the coordinates is performed by a calculation method using a weighted average.

The control unit 17 is configured to calculate a trajectory 500 in which the operation trajectory 101 made on the operation surface 100 corresponds to the trajectory on the display screen 50 based on the accumulated information 130. The control unit 17 determines whether to perform notification by vibration based on the trajectory 500 and the image information 132 stored in the storage unit 13. Control unit 17, when performing notification by using the vibration, generates a vibration control signal S ₃ based on the vibration pattern 131 stored in the storage unit 13. Hereinafter, the vibration pattern 131 will be described.

(About vibration pattern 131)
FIG. 2A is an enlarged view for explaining vibrations presented by the operation notification device according to the first embodiment, and FIG. 2B is an image displayed on the display screen and vibrations presented. It is the schematic which shows these relationships. In FIG. 2B, the horizontal axis is the x-axis and the vertical axis is the z-axis, and the z-axis is an amplitude z that is the amount of movement of the operation surface 100 from the reference position. Also, x _{11 to} x ₂₁ are shown on the x axis, and these x _{11 to} x ₂₁ indicate the coordinates of the virtual boundary 54 on the x axis.

  Hereinafter, a case where the operator performs an operation of tracing the operation surface 100 along the x-axis will be described. However, an operation performed along the y-axis and an operation performed diagonally are also based on the vibration pattern 131. Notification is performed by vibration. That is, in FIGS. 2A and 2B, the virtual boundary 54 orthogonal to the x axis is illustrated, but the virtual boundary 54 is also set in the direction orthogonal to the y axis. In the following, the boundary between the icons is assumed to be common, but when the space between the icons is empty, a virtual boundary may be provided between the icons, or a virtual boundary around the icons may be provided. A simple boundary may be provided, and a plurality of virtual boundaries may be provided between the icons.

  The virtual boundary 54 is a boundary determined based on the display image 51 displayed on the display screen 50. This virtual boundary 54 allows the operator to recognize that the trajectory 500 on the display screen 50 corresponding to the operation trajectory 101 of the operation performed on the operation surface 100 has entered the icon, which is an image to which a function is assigned. Is set for.

  Specifically, for example, when the operator performs an operation while removing his / her line of sight from the display screen 50, it is conceivable that the operation is performed past the target icon. Therefore, the operation notification device 1 is configured to present vibration when the trajectory 500 intersects the virtual boundary 54. At that time, the operation notification device 1 presents vibration according to a predetermined vibration pattern 131.

  As shown in FIG. 2A, the operation surface 100 is operated so that the trajectory 500 on the display screen 50 intersects the “.” Icon 52 a and the “ro” icon 52 b of the 50 sound image 52. 2a, the boundary 54a of the "." Icon 52a on the left side, the boundary 54b of the "." Icon 52a and the "ro" icon 52b, and the right side of the "ro" icon 52b. Vibration is presented at the boundary 54c.

Vibrations to be presented at the boundary 54a, the maximum amplitude z ₁ becomes the coordinate x ₁₁ amplitude z is increased from the vicinity of the boundary 54a, attenuated like the rise of amplitude. The vibrations to be presented at the boundary 54b, the maximum amplitude z ₂ next in the coordinate x ₁₂ the amplitude z is increased from the vicinity of the boundary 54b, attenuated like the rise of amplitude. Furthermore vibrations presented at the boundary 54c is largest amplitude z ₃ next in the coordinate x ₁₃ the amplitude z is increased from the vicinity of the boundary 54c, attenuated like the rise of amplitude.

The amplitude z ₁ , the amplitude z _2, and the amplitude z ₃ are not the same amplitude but are regularly attenuated. Examples of the regular attenuation method include an exponential attenuation method and a method of attenuation with a certain tolerance. In this embodiment, a method of exponentially decaying will be described.

As an example, the exponentially damped method uses, as an example, the first reference vibration amplitude z ₁ , the n-th amplitude z _n (n is an integer of 2 or more), and α is a constant. Then, it is expressed as the following formula (1).
z _n = z ₁ × e ^(−αn) (1)
In this embodiment, as an example, as 75% of the amplitude z ₁ which is fifth amplitude z ₅ of oscillations presented to a reference, that is serving as a reference attenuation factor from the amplitude z ₁ is 25%, Α can be obtained by solving equation (1). Therefore, the difference a between the amplitude z ₁ and the amplitude z ₅ is determined by the attenuation rate.

The other amplitudes z ₂ to z ₄ can be obtained from the obtained α using Equation (1). The attenuation part 131a shown to Fig.2 (a) and (b) is a curve based on this Formula (1). Note that α at which the amplitude z _{5 at} n = 5 becomes 75% of the amplitude z ₁ is approximately 0.0575.

Therefore, the vibration pattern 131 includes an attenuation unit 131a in which the amplitude that is the magnitude of the vibration is attenuated to a predetermined magnitude, that is, the amplitude z ₁ is attenuated to an amplitude z _{5 that} is 75% of the amplitude z ₁ . It becomes a pattern. The method of attenuation from the reference amplitude z ₁ to amplitude z ₅ is a method using the above-described equation (1).

As a modified example, the exponential decay method may be a method using the following formula (2) in addition to the formula (1).
z _n = z ₁ (1 / β) ⁿ (2)
However, 0 <β
From equation (2), β at which the amplitude z _{5 at} n = 5 becomes 75% of the reference amplitude z ₁ is approximately 1.0592. Note that the method of exponentially attenuating the amplitude is not limited to the above formulas (1) and (2).

The vibration pattern 131, the amplitude to be presented to the fifth or later, a pattern comprising a constant amplitude portion 131b to be constant in amplitude z ₅ is an amplitude of a predetermined size.

When the operation traced in the order of the “.” Icon to the “O” icon at the bottom of the 50 sound image 52 is performed on the operation surface 100, as shown in FIG. A locus 500 is generated on the display screen 50. A virtual boundary 54 that intersects the trajectory 500 is a boundary 54 provided at coordinates x ₁₁ to ₂₁ as shown in FIG.

Therefore, for example, the vibration pattern 131 attenuates from the amplitude z ₁ to the amplitude z ₅ based on the attenuation unit 131 a from the boundary 54 of the coordinate x _{11 to} the boundary 54 of the coordinate x ₁₅ , and from the coordinate x ₁₅ to the coordinate x _21. , a constant amplitude _{z 5} based on constant-amplitude portion 131b.

  Here, the attenuation rate is determined so that it is difficult for the operator to recognize that the amplitude has attenuated. This attenuation rate may be determined by experiment as an example.

  The attenuation rate may be determined using Weber's law. The Weber's law is a law in which the ratio of ΔR / R is constant, where R is the intensity of the reference stimulus and ΔR is the discrimination threshold. The attenuation rate is determined based on this ratio.

  Therefore, as an example, the amplitude attenuation rate is preferably 30% or less, and more preferably 25% or less.

  Below, operation | movement of the operation alerting apparatus 1 which concerns on this Embodiment is demonstrated according to the flowchart of FIG.

(Operation)
When the power is turned on, the control unit 17 of the operation notification device 1 reads the detection signals S ₂₁ to S ₂₅ from the detection unit 11 based on the clock signal S _cl output from the clock signal generation unit 14. (S1). The control unit 17 outputs the drive signal S ₁ to the drive unit 111 and outputs the switching signal S ₂ to the reading unit 113.

The control unit 17 compares the acquired detection signals S ₂₁ to S ₂₅ with the threshold value 170 to determine whether or not an operation has been detected.

  When the operation is detected (S2: Yes), the control unit 17 calculates the coordinates at which the operation is detected, stores the calculation result in the storage unit 13 as the accumulation information 130, and stores the accumulation information 130 of the previous cycle. Read (S3).

  The control unit 17 compares the coordinates of the current cycle with the coordinates of the previous cycle to determine whether the coordinate has moved.

  When the control unit 17 determines that the coordinates are moving (S4: Yes), the coordinate 500 is moved based on the image information 132 stored in the storage unit 13, and thus the trajectory 500 and the virtual boundary 54 are displayed. And whether or not crossed.

  If the control unit 17 determines that the trajectory 500 and the virtual boundary 54 intersect (S5: Yes), the control unit 17 reads and confirms the count value 150 from the count unit 15 and reads the vibration pattern 131 from the storage unit 13. A vibration is presented (S6).

Specifically, the control unit 17 confirms the count value 150 to confirm the number of times the vibration is presented. As shown in FIG. 2B, since the vibration is attenuated exponentially until the fifth time and is constant at the same amplitude as that of the fifth time from the sixth time, it depends on the count value 150. A vibration control signal S ₃ is generated and output to the vibration presenting unit 12.

  The control unit 17 counts up the count value 150 (S7), and proceeds to step 1 to read out the next cycle.

  Here, in step 2, when the control unit 17 determines that no operation is detected in the cycle (S2: No), the control unit 17 controls the count unit 15 to reset the count value 150, indicating that no operation has been detected. The accumulated information 130 is stored in the storage unit 13 (S8).

If the control unit 17 determines in step 4 that the coordinate has not moved (S4: No), the control unit 17 determines whether the coordinate detected in the current cycle is on the icon and is on the icon. If (S9: Yes), the icon as the selected, generates and outputs the operation information _{S 6} for executing the function assigned to the icon (S10).

  In step 9, when the control unit 17 determines that the coordinates are not on the icon (S9: No), the control unit 17 proceeds to step 1 and reads out the next cycle.

  The operation notification device 1 continues this operation until the power is shut off.

(Effects of the first embodiment)
The operation notification device 1 according to the present embodiment can suppress discomfort based on continuously performed notification. Specifically, the operation notification device 1 corresponds to the virtual boundary 54 set based on the icon displayed on the display screen 50 of the display device 5 and the operation locus 101 of the operation performed on the detection unit 11. When the trajectory 500 on the display screen 50 continuously intersects, the vibration amplitude z ₁ is attenuated to a predetermined amplitude z ₅ as the notification vibration is presented. Compared with the case where it carries out to this, the discomfort by vibration can be suppressed.

More specifically, in the operation notification device 1, when an operator performs an operation such as tracing the operation surface 100 and straddling a plurality of virtual boundaries 54, stimulation by vibration is continuously applied to the finger. This continuous stimulation can cause discomfort to the operator. However, since the operation notification device 1 presents the vibration such that the vibration amplitude z ₁ is attenuated to the predetermined amplitude z ₅ as the vibration is presented based on the vibration pattern 131, discomfort due to the vibration is present. Can be suppressed.

  Further, since the amplitude is attenuated at an attenuation rate such that the operator cannot recognize a change from the magnitude of the vibration before being attenuated, the operation notification device 1 is caused by continuous vibration while suppressing a sense of incongruity of the operation. Discomfort can be suppressed.

  Furthermore, since the operation notification device 1 attenuates the amplitude while suppressing the uncomfortable feeling of the operation, the load on the actuator constituting the vibration presenting unit 12 is reduced compared to the case where the same vibration is continuously presented. Power consumption can be suppressed and generation of heat can be suppressed.

[Second Embodiment]
The second embodiment is different from the first embodiment in that the vibration pattern is attenuated in an arithmetic progression.

  FIG. 4 is a schematic diagram illustrating a relationship between an image displayed on a display screen to which an operation notification device according to the second embodiment is connected and vibrations to be presented. In the embodiment described below, parts having the same functions and configurations as those of the first embodiment are denoted by the same reference numerals as those of the first embodiment, and description thereof is omitted.

  As shown in FIG. 4, the operation notification device 1 according to the present embodiment has a vibration pattern 135 in which the amplitude is attenuated in an arithmetic progression up to a predetermined amplitude. As shown in FIG. 4, the vibration pattern 135 includes an attenuation unit 135 a that attenuates in an arithmetic progression and a constant amplitude unit 135 b that has a constant amplitude.

Specifically, the vibration pattern 135, amplitude _{z 2} coordinates _{x 12} is smaller by crossing b from the amplitude _{z 1} coordinate _{x 11.} Further, the amplitude z ₃ of the coordinate x ₁₃ is smaller than the amplitude z ₂ of the coordinate x _{12 by} the intersection b, that is, smaller than the amplitude z ₁ of the coordinate x _{11 by} the difference 2b. The amplitude z ₄ of the coordinate x ₁₄ is smaller than the amplitude z ₃ of the coordinate x _{13 by} an intersection b, that is, smaller than the amplitude z ₁ of the coordinate x _{11 by} a difference 3b. Amplitude _{z 5} of the coordinate _{x 15} is smaller by crossing b from the amplitude _{z 4} of the coordinate _{x 14,} i.e., is smaller by the difference 4b than the amplitude _{z 1} coordinate _{x 11.} Therefore attenuation unit 135a is attenuated based on the straight line connecting the vertex of the amplitude of the vibration to be presented in the coordinate x _{11 ~} coordinate x _15.

As described above, the difference 4b between the amplitude z ₁ and the amplitude z ₅ is based on the attenuation in a range that cannot be recognized by the operator.

The amplitude of the coordinate _{x 16} ~ coordinate _{x 21} is the same amplitude, that is, a constant amplitude as _{z 5} of the coordinate _{x 15.} Therefore constant amplitude portion 135b has a straight line connecting the amplitude vertices of the vibration to be presented in the coordinate x _{15 ~} coordinate x _21.

  As shown in FIG. 4, the operation notification device 1 presents vibration based on the vibration pattern 135 when the trajectory 500 on the display screen 50 intersects with a plurality of virtual boundaries 54.

(Effect of the second embodiment)
Since the operation notification device 1 according to the present embodiment attenuates the amplitude from the amplitude z ₁ in an arithmetic progression, it is easier to create the vibration pattern 135 as compared with a device that does not attenuate at a certain intersection. .

[Third Embodiment]
The third embodiment is different from the above-described embodiment in that the amplitude becomes constant for a predetermined period from the start of the presentation of vibration, and the attenuation of the amplitude starts from there.

  FIG. 5 is a schematic diagram illustrating a relationship between an image displayed on a display screen to which an operation notification device according to a third embodiment is connected and vibrations to be presented.

  As shown in FIG. 5, the operation notification device 1 according to the present embodiment includes a constant amplitude unit 136 a in which the amplitude is constant for a predetermined period from the start of vibration presentation, an attenuation unit 136 b in which the amplitude is attenuated, And a vibration pattern 136 having a constant amplitude portion 136c having a constant amplitude.

Constant amplitude portion 136a includes an amplitude _{z 1} coordinate _{x 11} serving as a starting vibration, then the amplitude _{z 2} coordinates _{x 12} vibration is presented that has the same amplitude.

Attenuation unit 136b is, for example, from the amplitude _{z 2} coordinates _{x 12} until the amplitude _{z 4} of the coordinate _{x 15,} is attenuated exponentially. As described above, the difference c between the amplitude z ₂ and the amplitude z ₄ is based on the attenuation in a range that cannot be recognized by the operator.

Constant amplitude portion 136c, for example, the amplitude of up coordinate _{x 15} ~ coordinate _{x 21} have the same as the amplitude _{z 4} of the coordinate _{x 15.}

  As shown in FIG. 5, the operation notification device 1 presents vibration based on the vibration pattern 136 when the trajectory 500 on the display screen 50 intersects with a plurality of virtual boundaries 54.

(Effect of the third embodiment)
Since the operation notification device 1 according to the present embodiment presents constant vibration for a predetermined period from the start of vibration presentation, it presents vibration continuously compared to the case where attenuation starts from the start of vibration presentation. When the number of times is small, discomfort caused by vibration can be further suppressed.

[Fourth Embodiment]
The fourth embodiment differs from the above-described embodiment in that the trajectory 500 on the display screen 50 corresponding to the operation trajectory 101 straddles rows or columns in the 50 sound image 52.

  FIG. 6 is a schematic diagram illustrating a relationship between an image displayed on a display screen to which an operation notification device according to the fourth embodiment is connected and vibrations to be presented.

  As shown in FIG. 6, the operation notification device 1 according to the present embodiment has a trajectory 500 corresponding to the operation trajectory 101 straddling a plurality of rows or columns of the 50 sound image 52 displayed on the display screen 50. When intersecting the virtual boundary 54, the vibration is presented without changing the vibration pattern due to the change of the row or the column.

  Note that the vibration pattern executed by the operation notification device 1 may be any of the vibration patterns described above.

(Effect of the fourth embodiment)
The operation notification device 1 according to the present embodiment is operated so as to intersect with the virtual boundary 54 arranged in one direction, and straddles the boundary intersecting with the virtual boundary 54 arranged in one direction. Even if the operation is performed, vibration is presented without changing the vibration pattern, and therefore, vibration with less discomfort can be presented as compared with the case where the vibration pattern is changed.

[Fifth Embodiment]
The fifth embodiment is different from the above-described embodiment in that the vibration pattern is switched depending on the operation speed.

  In the present embodiment, the control unit 17 is configured to calculate the operation speed based on the coordinates detected in the previous cycle and the coordinates detected in the current cycle.

  For example, the control unit 17 is configured such that the threshold 170 includes a speed threshold related to the speed of operation. For example, when the speed of the operation is smaller than the speed threshold, the control unit 17 determines that the trajectory 500 based on the operation has a small number of times of intersecting the virtual boundary 54 and vibrates without reducing the amplitude. Present. Further, when the operation speed is equal to or higher than the speed threshold, the control unit 17 determines that the trajectory 500 intersects the virtual boundary 54 many times and presents vibration according to the vibration pattern.

  As an example, the number of times of crossing is such that, when it is determined that the number of times of crossing is greater than the number of times of amplitude attenuation, which is inferred from the speed of operation, vibration is presented by a vibration pattern including an attenuation part. It may be decided. In other words, an operation speed at which the vibration is expected to reach not only the damping part but also the constant amplitude part may be determined as the speed threshold value. These are determined by experiment as an example.

(Effect of 5th Embodiment)
Since the operation notification device 1 according to the present embodiment changes the vibration pattern according to the speed of the operation, the vibration is generated despite the fact that the number of vibrations is small compared to the case where the vibration is presented regardless of the speed. Discomfort caused by attenuating can be suppressed.

  As a modification, in the above-described embodiment, the detection unit 11 is arranged so as to overlap the display screen 50 of the display device 5, but the present invention is not limited to this, and the display device 5 and the detection unit 11 are separated from each other. May be arranged.

  Specifically, when the operation notification device 1 is mounted on a vehicle, the display device 5 is disposed on the instrument panel, and the operation notification device 1 is disposed on the floor console located between the driver seat and the passenger seat. Also good.

  As another modification, in the above-described embodiment, the method that the operation notification device 1 notifies is vibration, but is not limited thereto, and notification is performed using at least one of sound, light, and vibration. It may be configured as follows.

  Specifically, the operation notification device 1 includes an output unit configured to include a speaker that outputs sound as a notification unit when performing notification by sound. The control unit 17 of the operation notification device 1 is configured to control the output unit so that the sound volume is attenuated to a predetermined volume as the sound is output.

  Moreover, the operation alerting | reporting apparatus 1 is provided with the light source part comprised including the light source which outputs light as a alerting | reporting part, when performing alerting | reporting by light. The control unit 17 of the operation notification device 1 is configured to control the light source unit such that at least one of light intensity and illuminance attenuates to a predetermined magnitude as light is output.

  Furthermore, the operation notification device 1 may be configured to perform notification using at least one of the color and brightness of the image displayed on the display device 5. Furthermore, the operation notification device 1 may perform notification in which at least one of sound, light, and vibration is combined.

  According to the operation notification device 1 of at least one embodiment described above, the virtual boundary 54 set based on the image displayed on the display screen 50 of the display device 5 and the operation performed on the detection unit 11. It is possible to notify the operator that the trajectory 500 on the display screen 50 corresponding to the operation trajectory 101 intersects and to recognize the image, and to suppress discomfort caused by the notification.

  As mentioned above, although some embodiment and modification of this invention were demonstrated, these embodiment and modification are only examples, and do not limit the invention based on a claim. These novel embodiments and modifications can be implemented in various other forms, and various omissions, replacements, changes, and the like can be made without departing from the scope of the present invention. In addition, not all combinations of features described in these embodiments and modifications are necessarily essential to the means for solving the problems of the invention. Furthermore, these embodiments and modifications are included in the scope and gist of the invention, and are included in the invention described in the claims and the equivalents thereof.

DESCRIPTION OF SYMBOLS 1 ... Operation notification apparatus, 4 ... Vehicle LAN, 5 ... Display apparatus, 6 ... Navigation apparatus, 7 ... Air-conditioning apparatus, 8 ... Music reproduction apparatus, 11 ... Detection part, 12 ... Vibration presentation part, 13 ... Memory | storage part, 14 ... Clock signal generating unit, 15 ... counting unit, 16 ... communication unit, 17 ... control unit, 50 ... display screen, 51 ... display image, 52 ... 50 sound image, 52a ... icon, 52b ... icon, 53 ... input field, 54 , 54a to 54c ... boundary, 100 ... operation surface, 101 ... operation locus, 110 ... drive electrode, 111 ... drive unit, 112 ... detection electrode, 113 ... reading unit, 130 ... accumulated information, 131 ... vibration pattern, 131a ... attenuation 131b ... constant amplitude part 132 ... image information 135 ... vibration pattern 135a ... attenuation part 135b ... constant amplitude part 136 ... vibration pattern 136a ... constant amplitude part 136b ... attenuation part 136c ... constant amplitude part, 150 ... count value, 170 ... threshold, 500 ... trace

Claims (5)

A detection unit for detecting an operation performed on the operation surface;
A notifying unit for notifying that a trajectory on the display screen of the display device corresponding to the trajectory of the operation detected by the detecting unit crosses a virtual boundary set based on the image displayed on the display screen; ,
When the trajectory continuously intersects the virtual boundary, a control unit that controls the notification unit so that the size of the notification is attenuated to a predetermined size as the notification is performed;
An operation notification device comprising: The control unit controls the notification unit to attenuate the size of the notification exponentially to the predetermined size;
The operation notification device according to claim 1. The control unit controls the notification unit to attenuate the size of the notification to a predetermined size with a certain tolerance,
The operation notification device according to claim 1. The control unit controls the notification unit to attenuate to the predetermined size after a period when the size of the notification becomes constant.
The operation notification device according to any one of claims 1 to 3. The predetermined size is such a size that an operator cannot recognize a change from the size of the notification before the operator is attenuated.
The operation notification device according to any one of claims 1 to 4.

Images