JP7253183B2 - controller and program - Google Patents

Description

The present invention relates to control devices and programs.

In recent years, technology has been developed that allows the user to perceive whether or not the operation has been detected and the strength of the operation by presenting feedback accompanied by various sensations (hereinafter referred to as sensory feedback) in response to the user's operation on the device. . For example, Patent Literature 1 discloses a technique of presenting tactile feedback by vibration in response to a user's touch operation.

JP 2010-287231 A

For example, according to tactile feedback as described in Patent Document 1, it is possible for the user to intuitively perceive that his or her touch operation is being detected by the device. However, there is still room for improvement in a method of presenting sensory feedback that is easier for the user to perceive and a method of presenting sensory feedback that evokes a predetermined impression in the user.

Therefore, the present invention has been made in view of the above problems, and an object of the present invention is to realize presentation of sensory feedback that allows a user to intuitively perceive a sense of determination related to an operation. , to provide a new and improved controller and program.

In order to solve the above problems, according to an aspect of the present invention, there is provided a control unit that controls presentation of sensory feedback in response to a user operation, the sensory feedback includes at least auditory feedback, and the control unit includes: A control device is provided that, when a user operation is detected, presents, as the auditory feedback, a processed sound obtained by processing a sound pressure level in a predetermined frequency band associated with a predetermined feedback sound source.

Further, the control unit controls the processed sound in which a sound pressure level in a first band, which is a low frequency band of at least the predetermined feedback sound source, is emphasized more than the original sound pressure level, or at least the sound pressure level of the predetermined feedback sound source. The processed sound in which the sound pressure level in the second band, which is a high frequency band, is reduced below the original sound pressure level may be presented as the auditory feedback.

Further, the control unit controls the processed sound in which the sound pressure level in a third band, which is a frequency band between the first band and the second band, is approximately the same as the original sound pressure level, It may be presented as auditory feedback as described above.

The first band may be a predetermined low frequency band including approximately 2 kHz, and the second band may be a predetermined high frequency band including approximately 12 kHz.

Further, the control unit presents the processed sound having a first peak component and a second peak component including a predetermined or more peak sound pressure as the auditory feedback, and the peak sound in the second peak component is presented as the auditory feedback. The pressure may be less than or equal to the peak sound pressure in the first peak component.

Further, the control unit causes the processed sound having the first peak component and the second peak component subsequent to the first peak component at predetermined intervals to be presented as the auditory feedback. good.

The sensory feedback may include haptic feedback, and the controller may present the auditory feedback and the haptic feedback together when the user's operation is detected.

Further, the user operation may include at least a pressing operation.

Further, in order to solve the above problems, according to another aspect of the present invention, there is provided a program for causing a computer to implement a function of presenting sensory feedback in response to a user operation, wherein the sensory feedback includes at least auditory feedback; A program is provided, characterized in that, when a user operation is detected, a processed sound obtained by processing a sound pressure level in a predetermined frequency band associated with a predetermined feedback sound source is presented as the auditory feedback.

In order to solve the above problems, according to an aspect of the present invention, a control unit is provided for controlling presentation of sensory feedback in response to a user operation, the sensory feedback includes at least auditory feedback, the control unit includes a predetermined A processed sound having a first peak component including the above peak sound pressure and a second peak component is presented as the auditory feedback, and the peak sound pressure at the second peak component is equal to the first peak component A control device is provided that is below the peak sound pressure at.

Further, in order to solve the above problems, according to another aspect of the present invention, there is provided a program for causing a computer to implement a function of presenting sensory feedback in response to a user operation, wherein the sensory feedback includes at least auditory feedback and a predetermined A processed sound having a first peak component including the above peak sound pressure and a second peak component is presented as the auditory feedback, and the peak sound pressure at the second peak component is equal to the first peak component There is provided a program characterized by being below the peak sound pressure at.

As described above, according to the present invention, it is possible to present sensory feedback that allows the user to intuitively perceive a sense of determination related to an operation.

It is a block diagram showing an example of functional composition of a control device concerning one embodiment of the present invention. FIG. 10 is a diagram showing an example of processing a feedback sound source focusing on frequency bands according to the same embodiment; FIG. 3 is a diagram showing user's evaluation of the sense of determination brought about by the processed sound processed as shown in FIG. 2 and the original feedback sound source according to the embodiment; FIG. 10 is a diagram showing an example of feedback sound source processing focused on the number and relationship of peak components according to the same embodiment; FIG. 4 is a diagram showing user's evaluation of a sense of determination brought about by processed sounds processed corresponding to patterns A to D shown in FIG. 3 according to the embodiment; It is a figure for demonstrating the color change of the icon with respect to pressing operation which concerns on the same embodiment. It is a figure which shows the user's evaluation with respect to the color change of the icon of three patterns based on the same embodiment.

Preferred embodiments of the present invention will be described in detail below with reference to the accompanying drawings. In the present specification and drawings, constituent elements having substantially the same functional configuration are denoted by the same reference numerals, thereby omitting redundant description.

<1. embodiment>
<<1.1. Overview＞＞
First, an outline of one embodiment of the present invention will be described. The control device 10 according to the present embodiment can be various devices that detect user operations (hereinafter referred to as user operations) and control the presentation of sensory feedback in response to user operations.

Here, the sensory feedback includes, for example, tactile feedback that appeals to the user's tactile sense using vibration, auditory feedback that appeals to the user's auditory sense using sound, and visual feedback that uses characters, images, and the like to appeal to the user's sense of sight. Including appealing visual feedback. Further, the tactile feedback may use temperature stimulation, pressure stimulation, electric stimulation, etc., in addition to vibration.

The control device 10 according to the present embodiment can make the user perceive whether or not the user's operation is detected, the strength, and the like by controlling the presentation of the above-described sensory feedback for the user's operation. Also, at this time, the control device 10 according to the present embodiment can evoke various impressions to the user by controlling presentation of sensory feedback having predetermined characteristics described later.

For example, as in the case of music, it is assumed that auditory feedback having a certain characteristic and auditory feedback having another characteristic give different impressions to the user. For example, the user has an impression that the auditory feedback having a certain characteristic gives a strong sense of determination in operation, and the auditory feedback having another characteristic gives an impression that the auditory feedback has a high-class feeling. expected to obtain. The difference in impressions as described above also applies to sensory feedback such as tactile feedback and visual feedback.

Therefore, the control device 10 according to the present embodiment aims to make the user recall a desired impression corresponding to the sensory feedback by controlling presentation of the sensory feedback having predetermined characteristics. The impression of the purpose includes, for example, a sense of determination of the operation.

The control device 10 according to the present embodiment can be various devices that control presentation of the sensory feedback described above in response to user operations. The control device 10 according to the present embodiment may be, for example, a car navigation device provided in a mobile object such as a vehicle, various controllers, switches, and the like. Moreover, the control device 10 according to the present embodiment is not limited to the above example, and can take various forms. The control device 10 according to the present embodiment may be realized, for example, as a keyboard, a mouse, or a knock-type pen that presents sensory feedback to user operations. A functional configuration example of the control device 10 according to the present embodiment will be described in detail below.

<<1.2. Functional Configuration Example of Control Device 10 >>
FIG. 1 is a block diagram showing a functional configuration example of a control device 10 according to this embodiment. As shown in FIG. 1 , the control device 10 according to this embodiment may include an operation unit 110 , a detection unit 120 , a control unit 130 , a tactile sense presentation unit 140 , a sound output unit 150 and a display unit 160 .

(Operation unit 110)
The operation unit 110 according to the present embodiment is a configuration to be operated by a user. The operation unit 110 according to this embodiment may be, for example, a touch panel, various switches, levers, dials, and the like. Therefore, user operations according to the present embodiment may include a wide variety of operations according to the characteristics of the operation unit 110 . User operations according to the present embodiment may include, for example, pressing operations (touch operations), sliding operations, rotating operations, and the like.

(Detection unit 120)
The detection unit 120 according to this embodiment detects user operations on the operation unit 110 . For example, when the operation unit 110 is realized as a touch panel, the detection unit 120 according to the present embodiment detects the user's operation based on changes in capacitance associated with the user's operation. A method of detecting a user operation by the detection unit 120 is appropriately designed according to the characteristics of the operation unit 110 .

(control unit 130)
The control unit 130 according to the present embodiment controls presentation of sensory feedback for user operations. As noted above, sensory feedback according to the present embodiments may include haptic feedback, auditory feedback, visual feedback, and the like. The details of the features of the sensory feedback according to this embodiment will be described separately later.

Also, the control unit 130 according to the present embodiment may control execution of various functions corresponding to user operations detected by the detection unit 120 .

The control unit 130 according to this embodiment is realized by, for example, one or two or more processors. Examples of processors include CPUs (Central Processing Units) and MCUs (Micro Controller Units).

(Tactile sense presentation unit 140)
The tactile sense presentation unit 140 according to the present embodiment presents tactile feedback to the user based on control by the control unit 130 . For example, when vibration is used for haptic feedback, the haptic presentation unit 140 may include an actuator such as an LRA (Linear Resonant Actuator), a piezo element, or an eccentric motor. Moreover, in the case of using hot/cold stimuli, pressure stimuli, electrical stimuli, or the like for tactile feedback, the tactile sense presentation unit 140 may include various devices that generate corresponding stimuli.

(Sound output unit 150)
The sound output unit 150 according to this embodiment presents auditory feedback to the user based on control by the control unit 130 . For this purpose, the sound output unit 150 according to this embodiment includes a speaker, an amplifier, and the like.

(Display unit 160)
The display unit 160 according to this embodiment presents visual feedback to the user based on control by the control unit 130 . For this reason, the display unit 160 according to this embodiment includes various display devices. Note that when the operation unit 110 is realized as a touch panel, the operation unit 110 and the display unit 160 may be integrally formed.

The functional configuration example of the control device 10 according to the present embodiment has been described above. Note that the above configuration described with reference to FIG. 1 is merely an example, and the functional configuration of the control device 10 according to the present embodiment is not limited to this example. For example, if visual feedback is not used as sensory feedback, the control device 10 does not necessarily have the display section 160 .

Further, for example, the control device 10 according to the present embodiment may be composed of the control section 130 and the communication section. In this case, the control unit 130 receives detection information related to user operations from the detection unit 120 via the communication unit, and remotely controls the tactile sense presentation unit 140, the sound output unit 150, and the display unit 160. can be done. The functional configuration of the control device 10 according to this embodiment can be flexibly modified according to specifications and operations.

<<1.3. Characteristics of sensory feedback>>
Next, the features of the sensory feedback according to this embodiment will be described in detail. As described above, the control device 10 according to the present embodiment presents sensory feedback having predetermined characteristics to the user, thereby making it possible for the user to recall a desired impression.

The control device 10 according to the present embodiment may, for example, present auditory feedback alone or together with tactile feedback that strongly evokes a sense of determination by the user.

In the present embodiment, in order to identify the characteristics of the auditory feedback that enable the above, the user's impression was examined when the processed sound obtained by processing the sound pressure level in the predetermined frequency band of the feedback sound source was used for the auditory feedback.

FIG. 2 is a diagram showing an example of feedback sound source processing focused on frequency bands according to the present embodiment. In FIG. 2, the horizontal axis indicates the frequency, and the vertical axis indicates the sound pressure level. In FIG. 2, a straight line indicates the relationship between the frequency and the sound pressure level of the original feedback sound source before processing, and a broken line indicates the relationship between the frequency and the sound pressure level of the processed sound after processing. .

In this embodiment, a predetermined low frequency band containing approximately 2 kHz of the original feedback sound source is a first band B1, a predetermined high frequency band containing approximately 12 kHz of the original feedback sound source is a second band B2, and a first A frequency band between the band B1 and the second band B2 is defined as a third band B3, and a processed sound obtained by processing the sound pressure levels in the first band B1 and the second band B3 is presented as auditory feedback. verified.

More specifically, as shown in the figure, the sound pressure level in the first band B1 is emphasized (for example, about +6 dB) from the sound pressure level of the original feedback sound source, and the sound pressure level in the second band B2 is increased. Processing was performed so that the sound pressure level of the original feedback sound source was reduced (for example, about -6 dB).

FIG. 3 is a diagram showing user's evaluation of the sense of determination brought about by the processed sound processed as shown in FIG. 2 and the original feedback sound source. Note that FIG. 3 shows an index of the impression of a sense of determination when the processed sound according to the present embodiment and the original feedback sound source (also referred to as the original sound source) are presented to the subject as auditory feedback in response to the user's operation. It is a diagram of

Referring to FIG. 3, when the processed sound in which the sound pressure level in the predetermined frequency band is processed as described above is used for auditory feedback, the decision sound increases more than when the original feedback sound source is used. It can be seen that the user recalls the impression of

Therefore, when the detection unit 120 detects a user operation, the control unit 130 according to the present embodiment outputs a processed sound in which the sound pressure level in a predetermined frequency band related to a predetermined feedback sound source is processed as auditory feedback. may be presented to the sound output unit 150 as .

More specifically, as shown in FIG. 2, the control unit 130 according to the present embodiment emphasizes the original sound pressure level in the first band B1, which is the low frequency band of the feedback sound source. The sound output unit 150 may be caused to present, as auditory feedback, the processed sound obtained by reducing the sound pressure level in the second band B2, which is the high frequency band of the feedback sound source, from the original sound pressure level.

At this time, the sound pressure level of the third band B3, which is the frequency band between the first band B1 and the second band B2, is approximately the same as the original sound pressure level, as shown in FIG. you can

By using the above-described processed sound for auditory feedback, as shown in FIG. 3, it is possible to make the user recall an impression of increased sense of determination compared to the original feedback sound source.

Further, the characteristics of the processed sound according to this embodiment are not limited to the above examples. A feature of the processed sound according to the present embodiment may be the number of peak components including a predetermined or more peak sound pressure or the relationship thereof. In this embodiment, in addition to processing the sound pressure level according to the frequency band described above, user verification was performed focusing on the number and relationship of peak components.

FIG. 4 is a diagram showing an example of feedback sound source processing focused on the number and relationship of peak components according to the present embodiment. FIG. 4 shows graphs of four different processed sound patterns A to D having different numbers and relationships of peak components. In each graph, the vertical axis corresponds to the sound pressure level, and the horizontal axis corresponds to time.

For example, the processed sound corresponding to pattern A includes two peak components each having a peak sound pressure (level) equal to or higher than a predetermined value, as indicated by the dashed circle. In the case of the processed sound corresponding to pattern A, the peak sound pressure of the preceding peak component and the peak sound pressure of the subsequent peak component are approximately the same.

In the case of the pattern B and the processed sound corresponding to the pattern, as in the case of the processed sound corresponding to the pattern A, two peak components including peak sound pressures equal to or higher than a predetermined value are included.

On the other hand, in the case of the processed sound corresponding to pattern B, unlike the processed sound corresponding to pattern A, the peak sound pressure of the subsequent peak component is higher than the peak sound pressure of the preceding peak component. .

In the case of the processed sound corresponding to pattern C, the peak sound pressure of the subsequent peak component is smaller than the peak sound pressure of the preceding peak component.

Further, in the case of the processed sound corresponding to pattern D, unlike the processed sounds corresponding to patterns A to C, only one peak component including a predetermined peak or more is included.

FIG. 5 is a diagram showing user's evaluation of the sense of determination brought about by the processed sounds processed corresponding to the patterns A to D shown in FIG. FIG. 3 is a diagram showing, as an auditory feedback for the subject, an impression of a sense of determination when processed sounds corresponding to patterns A to D are used as auditory feedback in response to a pressing operation (at the time of pressing) on the operation unit 110. FIG. be.

Referring to FIG. 5, when the processed sound processed corresponding to pattern A or pattern C is used for auditory feedback, the processed sound processed corresponding to pattern B or pattern D is used for auditory feedback. By comparison, it can be seen that the user recalls an impression with an increased sense of determination.

Therefore, when the detection unit 120 detects a user operation, the control unit 130 according to the present embodiment outputs a processed sound having a first peak component and a second peak component including a peak sound pressure equal to or higher than a predetermined value. , may be output to the sound output unit 150 as auditory feedback. At this time, the peak sound pressure of the second peak component may be less than or equal to the peak sound pressure of the first peak component.

More specifically, the control unit 130 according to the present embodiment outputs a processed sound having a first peak component and a second peak component subsequent to the first peak component at predetermined intervals as auditory feedback. You may make it output to the sound output part 150. FIG. The predetermined interval may be, for example, approximately 0.1 s.

By using the processed sound as described above for auditory feedback, it is possible to make the user recall an impression of a greater sense of determination. Note that the processing focused on the peak component and the processing focused on the frequency band described above may be performed at the same time. That is, the auditory feedback according to the present embodiment includes processing related to enhancement of the sound pressure level in the first band B1 and reduction of the sound pressure level in the second band B2, and processing related to the two peak components described above. may be used.

Further, when the detection unit 120 detects a user operation, the control unit 130 according to the present embodiment
Controls may be provided such that tactile and/or visual feedback is presented along with each auditory feedback as described above. According to such control, it is possible to make the user recall an impression of a greater sense of determination.

Furthermore, the impression that the sensory feedback according to the present embodiment evokes in the user is not limited to the sense of determination described above. By presenting sensory feedback having predetermined characteristics in response to user operations, the control unit 130 can make the user feel, for example, a feeling of luxury or comfort.

In this embodiment, in order to identify the characteristics of visual feedback that enables the above, the user's impression when using the color change when performing the pressing operation on the icon displayed on the display unit 160 as visual feedback is verified. bottom.

FIG. 6 is a diagram for explaining color change of an icon in response to a pressing operation according to the present embodiment. In the example shown in FIG. 6, the display unit 160 is formed integrally with the operation unit 110, which is a touch panel, and displays a plurality of icons I1 to I3 on the screen. Note that the upper part of FIG. 6 shows the states of the icons I1 to I3 when no pressing operation is performed by the user. In this case, the icons I1 to I3 may be displayed in substantially the same color as the background color, as shown.

On the other hand, when a pressing operation is performed by the user, the icons I1 to I3 present visual feedback by color change under the control of the control unit 130. FIG. For example, in the case of the example shown in the lower part of FIG. 5, the control unit 130 changes the color of the icon I1 to a color different from the background color based on the detection that the icon I1 has been pressed by the user. there is

In this embodiment, regarding the color change of the icon as described above, the combination of the color before change and the color after change is defined by three patterns of purple to pink, gray to blue, and blue to yellow. was presented as visual feedback for the pressing operation.

FIG. 7 is a diagram showing user's evaluation of three patterns of icon color changes according to the present embodiment. The left side of FIG. 7 is a diagram indexing the user's impression of luxury when the above three patterns of color change are presented as visual feedback in response to the pressing operation.

According to this, when the color of the icon is changed from purple to pink in response to the pressing operation, the user can recall a higher-class feeling than when the color is changed from gray to blue or from blue to yellow. Recognize.

On the right side of FIG. 7 is a diagram indexing the user's impression of comfort when the three patterns of color change are presented as visual feedback in response to the pressing operation.

According to this, when the color of the icon is changed from blue to yellow in response to the pressing operation, the user can recall a more comfortable feeling than when the color is changed from purple to pink or from gray to blue. Recognize.

For this reason, the control unit 130 according to the present embodiment provides visual feedback of a predetermined color change that defines the color before change and the color after change in response to the pressing operation, in order to remind the user of a desired impression. , may be displayed on the display unit 160 .

In addition, the control unit 130 according to the present embodiment presents the visual feedback as described above together with the auditory feedback described above, so that the user can be reminded of a sense of decisiveness as well as a sense of luxury and comfort. be.

In this way, the control unit 130 according to the present embodiment controls presentation of sensory feedback having predetermined characteristics, thereby making it possible for the user to recall a desired impression corresponding to the sensory feedback.

<2. Summary>
As described above, the control device 10 according to one embodiment of the present invention includes the control section 130 that controls presentation of sensory feedback in response to user operations. The sensory feedback may include at least auditory feedback. Further, when a user operation is detected, the control unit 130 according to an embodiment of the present invention presents, as auditory feedback, a processed sound in which the sound pressure level in a predetermined frequency band related to a predetermined feedback sound source is processed. is one of the features. According to such a configuration, it is possible to present sensory feedback that allows the user to intuitively perceive a sense of determination related to the operation.

Although the preferred embodiments of the present invention have been described in detail above with reference to the accompanying drawings, the present invention is not limited to such examples. It is obvious that a person having ordinary knowledge in the technical field to which the present invention belongs can conceive of various modifications or modifications within the scope of the technical idea described in the claims. It is understood that these also naturally belong to the technical scope of the present invention.

Also, the effects described herein are merely illustrative or exemplary, and are not limiting. In other words, the technology according to the present disclosure can produce other effects that are obvious to those skilled in the art from the description of this specification, in addition to or instead of the above effects.

In addition, it is also possible to create a program for making hardware such as a CPU, ROM, and RAM built into a computer exhibit functions equivalent to those of the configuration of the control device 10, and the program can be recorded and read by the computer. A non-transitory recording medium can also be provided.

10 control device 110 operation unit 120 detection unit 130 control unit 140 tactile sense presentation unit 150 sound output unit 160 display unit

Claims (7)

a controller that controls the presentation of sensory feedback in response to user manipulation;
with
the sensory feedback includes at least auditory feedback;
When the user's operation is detected, the control unit controls a processed sound whose sound pressure level is processed such that a part of frequency bands related to an arbitrary feedback sound source has a first peak component and a second peak component. is presented as the auditory feedback;
The peak sound pressure in the second peak component is less than or equal to the peak sound pressure in the first peak component,
Control device. The control unit controls at least the processed sound in which the sound pressure level in a first band, which is a low frequency band of the arbitrary feedback sound source, is emphasized more than the original sound pressure level, or at least the high frequency band of the arbitrary feedback sound source. Presenting the processed sound, in which the sound pressure level in the second band is lower than the original sound pressure level, as the auditory feedback;
A control device according to claim 1 . The control unit controls the processed sound having a sound pressure level in a third band, which is a frequency band between the first band and the second band, which is approximately the same as the original sound pressure level, to the auditory sound. be presented as feedback,
3. A control device according to claim 2. the first band is a predetermined low frequency band containing approximately 2 kHz;
wherein the second band is a predetermined high frequency band including approximately 12 kHz;
4. A control device according to claim 2 or 3. the sensory feedback includes haptic feedback;
The control unit presents both the auditory feedback and the haptic feedback when the user operation is detected.
A control device according to any one of claims 1 to 4 . The user operation includes at least a pressing operation,
A control device according to any one of claims 1 to 5 . A program that causes a computer to implement a function of presenting sensory feedback in response to user operations,
the sensory feedback includes at least auditory feedback;
When the user's operation is detected, a processed sound whose sound pressure level is processed such that a partial frequency band of an arbitrary feedback sound source has a first peak component and a second peak component is sent to the auditory feedback. be presented as
The peak sound pressure in the second peak component is less than or equal to the peak sound pressure in the first peak component,
A program characterized by

Images