JP2019186657A - Output device and output method - Google Patents

Abstract

To accurately vibrate an arbitrary position on a panel.SOLUTION: An output device according to an embodiment includes a panel, a plurality of vibration elements, and a control unit. The vibration elements are mounted at respectively different positions on the panel to vibrate the panel. The control unit individually controls the amplitude of the vibration elements and controls the peak position of the vibration of the panel to be an arbitrary position on the panel.SELECTED DRAWING: Figure 2

Description

  The present invention relates to an output device and an output method.

  Conventionally, there is an output device that outputs sound while virtually moving the position of a sound source in accordance with an image displayed on a panel. In such an output device, sound is output as if there is a sound source at an arbitrary position on the panel by individually controlling outputs of a plurality of speakers (see, for example, Patent Document 1).

JP 2005-110103 A

  However, in the prior art, since a speaker outside the panel is used as a sound source, it is impossible to accurately match the position on the panel where the sound source is desired and the position of the actual sound source. That is, in the prior art, an arbitrary position of the panel cannot be vibrated.

  The present invention has been made in view of the above, and an object of the present invention is to provide an output device and an output method capable of accurately vibrating an arbitrary position of a panel.

  In order to solve the above-described problems and achieve the object, an output device according to an embodiment includes a panel, a plurality of vibration elements, and a control unit. The vibration elements are attached to different positions of the panel and vibrate the panel. The control unit individually controls amplitudes of the plurality of vibration elements so that a vibration peak position in the panel is an arbitrary position of the panel.

  According to the present invention, an arbitrary position of the panel can be vibrated accurately.

FIG. 1A is a diagram showing an outline of an output method. FIG. 1B is a diagram illustrating a specific example of the attachment position of the vibration element. FIG. 2 is a block diagram of the output device. FIG. 3 is a diagram illustrating a configuration example of the panel. FIG. 4 is a diagram illustrating a specific example of the vibration mode. FIG. 5 is a diagram illustrating a specific example of control in the video mode. FIG. 6 is a diagram illustrating a specific example of control in the guidance mode. FIG. 7 is a diagram illustrating a specific example of control in the video / tactile mode. FIG. 8 is a flowchart illustrating a processing procedure executed by the output processing apparatus. FIG. 9 is a diagram illustrating a modification of the attachment position of the vibration element.

  Hereinafter, an output device and an output method according to embodiments will be described in detail with reference to the accompanying drawings. In addition, this invention is not limited by this embodiment.

  First, the outline of the output method according to the embodiment will be described with reference to FIGS. 1A and 1B. FIG. 1A is a diagram showing an outline of an output method. FIG. 1B is a diagram illustrating a specific example of the attachment position of the vibration element.

  As illustrated in FIG. 1A, the output device 1 according to the embodiment includes a control unit 2 and a panel 5. Further, as shown in FIG. 1B, the vibration elements 10 are arranged in a matrix on the back surface 5 b of the panel 5.

  The vibration element 10 vibrates the panel 5 by vibrating in the thickness direction of the panel 5 or the surface direction of the panel 5. The vibration of the vibration element 10 is individually controlled by the control unit 2 described above.

  That is, in the output method according to the embodiment, among the plurality of vibration elements 10 arranged in a matrix, some vibration elements 10 corresponding to the vibration peak positions in the panel 5 are vibrated.

  That is, in the output method according to the embodiment, the amplitude and vibration frequency of each vibration element 10 are individually controlled. Thereby, it becomes possible to generate sound accurately from an arbitrary position of the panel 5.

  Specifically, as illustrated in FIG. 1A, in the output method according to the embodiment, when the peak position P1 is vibrated, the vibration element 10 corresponding to the peak position P1, that is, a part of the back side of the peak position P1. The vibration element 10 is vibrated.

  Similarly, when vibrating the peak position P2, the vibrating element 10 on the back side of the peak position P2 is vibrated. Thereby, in the output method according to the embodiment, the peak position P1 and the peak position P2 can be selectively vibrated in the panel 5.

  That is, in the output method according to the embodiment, a sound source can be generated at an arbitrary position on the panel 5 by individually controlling the vibration elements 10. Further, by individually controlling the vibration element 10, it is possible to simultaneously output different sounds from the peak position P1 and the peak position P2.

  Thus, in the output method according to the embodiment, it is possible to arbitrarily control the vibration peak position in the panel 5 by individually controlling the plurality of vibration elements 10 that vibrate the panel 5.

  That is, according to the output method according to the embodiment, an arbitrary position of the panel 5 can be vibrated accurately. Although the details will be described later, in the output method according to the embodiment, it is possible to give a predetermined tactile sensation from the panel 5 to the user by vibrating not only the sound but also an arbitrary position of the panel 5. .

  Next, a configuration example of the output device 1 according to the embodiment will be described with reference to FIG. FIG. 2 is a block diagram of the output device 1. 2 also shows the host device 100.

  The host device 100 is a smartphone, a tablet terminal, a PDA (Personal Digital Assistant), a notebook PC (Personal Computer), a desktop PC, or the like. For example, the output device 1 functions as an image output unit, an audio output unit, and an input reception unit of the host device 100.

  For example, the higher-level device 100 outputs a vibration mode, which will be described later, in association with audio information, video information, and tactile information to the output device 1, and acquires an operation signal corresponding to a user operation from the output device 1.

  The sound information includes information on the position where the sound is generated on the panel 5, that is, information on the coordinates of the peak position, and a sound source frequency for generating sound at the peak position.

  The tactile information includes information regarding the coordinates of the peak position and a tactile frequency for giving a tactile sensation to the user at the peak position. For example, audio information and tactile information are information generated based on video information.

  That is, the host device 100 can designate a position where sound is generated from the panel 5 and a tactile sensation given to the user in accordance with the video displayed on the panel 5. Hereinafter, audio information and tactile information may be collectively referred to as vibration information.

  The output device 1 includes a control unit 2, a storage unit 3, a panel 5, and a plurality of vibration elements 10. The control unit 2 includes an acquisition unit 21, a detection unit 22, and a determination unit 23. The control unit 2 includes, for example, a computer having a central processing unit (CPU), a read only memory (ROM), a random access memory (RAM), a hard disk drive (HDD), an input / output port, and various circuits.

  The CPU of the computer functions as the acquisition unit 21, the detection unit 22, and the determination unit 23 of the control unit 2, for example, by reading and executing a program stored in the ROM.

  Further, at least some or all of the acquisition unit 21, the detection unit 22, and the determination unit 23 of the control unit 2 may be configured by hardware such as an ASIC (Application Specific Integrated Circuit) or an FPGA (Field Programmable Gate Array). it can.

  The storage unit 3 corresponds to, for example, a RAM or an HDD. The RAM and HDD can store frequency information 31 and information of various programs. Note that the output device 1 may acquire the above-described program and various types of information via another computer or a portable recording medium connected via a wired or wireless network.

  The panel 5 includes a display 51 and a touch sensor 52. FIG. 3 is a diagram illustrating a configuration example of the panel 5. As shown in FIG. 3, the panel 5 includes a display 51, a touch sensor 52, and a protective layer 53.

  The display 51 functions as a display unit that displays the video output from the host device 100 on the panel 5. For example, the display 51 can be a liquid crystal display or an organic EL. The touch sensor 52 is, for example, a capacitance type sensor, and outputs a voltage signal corresponding to the capacitance to the output device 1. Note that the touch sensor 52 may be a pressure-sensitive sensor that converts pressure into an electrical signal. The protective layer 53 is a thin film made of glass or resin, for example, and functions as an operation surface of the output device 1. The vibration elements 10 are attached to the protective layer 53 in a matrix.

  Returning to the description of FIG. 2, the acquisition unit 21 of the control unit 2 will be described. The acquisition unit 21 acquires vibration information and video information from the host device 100. For example, the acquisition unit 21 reproduces video information and causes the display 51 to display the video information. In addition, the acquisition unit 21 outputs vibration information to the determination unit 23.

  The detection unit 22 detects the operation position of the user's contact operation on the panel 5 based on the voltage signal output from the touch sensor 52. When the user performs a touch operation on the panel 5, the capacitance of the touch sensor 52 disposed at a position corresponding to the operation position of the user on the operation surface varies.

  The detection unit 22 can detect an arrangement position of the touch sensor 52 in which the electrostatic capacitance fluctuates as an operation position on the panel 5. When detecting the operation position, the detection unit 22 outputs operation information indicating the operation position to the host device 100 and the determination unit 23.

  The determination unit 23 individually determines the amplitude and vibration frequency of the vibration element 10. Then, the determination unit 23 generates a drive signal corresponding to the determined amplitude and vibration frequency and outputs the drive signal to the vibration element 10. Specifically, for example, the determination unit 23 vibrates the vibration element 10 in the vibration mode specified by the higher-level device 100.

  FIG. 4 is a diagram illustrating a specific example of the vibration mode. As shown in FIG. 4, the output device 1 has a video mode st1, a guidance mode st2, and a video / tactile mode st3. The video mode st <b> 1 is a mode in which sound is generated from an arbitrary position on the panel 5 in accordance with the video displayed on the display 51. That is, the video mode st1 is a mode in which the vibration element 10 is vibrated at the sound source frequency.

  The guidance mode st2 is a mode for guiding the operation position detected by the detection unit 22 to the target position on the panel 5. The video / tactile mode st3 is a mode in which, in addition to the video mode st1, a touch mode that gives the user a predetermined touch by vibrating the panel 5 is given. That is, the video / tactile mode st3 is a mode in which the vibration element 10 is vibrated at the sound source frequency and the tactile frequency.

  As described above, by controlling the vibration element 10 using the sound source frequency or the tactile frequency according to the vibration mode, the panel 5 can be used for various purposes.

  FIG. 5 is a diagram illustrating a specific example of control in the video mode st1. Here, a case where the specific image i serving as a sound generation source on the panel 5 is an airplane will be described. Hereinafter, the position of the vibrating element 10 to be vibrated is indicated by hatching.

  As shown in FIG. 5, for example, it is assumed that the specific image i has moved on the panel 5 from the upper right to the lower left. In such a case, in the video mode st1, the determination unit 23 first determines the vibration element 10 that vibrates so that the display position where the specific image i is displayed is the peak position.

  Specifically, the determination unit 23 determines the vibration element 10 that vibrates the vibration element 10 located behind the display position based on the coordinate information of the display position of the specific image i. Subsequently, the determination unit 23 determines the vibration frequency of the vibration element 10 so that the peak position vibrates at the frequency of the sound source that generates the sound output from the specific image i.

  Here, the coordinate information and the sound source frequency are, for example, information input from the higher-level device 100 as the audio information. For this reason, the determination part 23 will determine the vibration element 10 to vibrate based on audio | voice information, and the vibration frequency of this vibration element 10. FIG.

  In the example shown in the figure, the sound information is associated with, for example, a sound source frequency corresponding to the engine sound of the airplane from the specific image i. That is, in such a case, engine sound is generated from the specific image i.

  That is, the output device 1 can provide realistic content by generating sound from the specific image i. Further, the determination unit 23 controls the vibration element 10 so that the peak position changes following the movement of the specific image i.

  That is, the determination unit 23 appropriately changes the vibration element 10 that vibrates in accordance with the movement of the specific image i. Thereby, since the sound source sequentially changes as the specific image i moves, it is possible to provide more realistic content.

  Here, the specific image i has been described by taking an airplane as an example, but the specific image i is not limited to this and can be arbitrarily changed. For example, when the peak position is changed following the movement of the specific image i, for example, the vibration frequency and amplitude of the vibration element 10 may be controlled by reproducing the Doppler effect in a pseudo manner.

  Specifically, when producing a sound such that the specific image i leaves the user, the vibration frequency for the sound source is gradually lowered and the amplitude is gradually weakened. Further, when producing a sound such that the specific image i approaches the user, the sound source vibration frequency is gradually increased and the amplitude is gradually increased. As a result, it is possible to provide the user with more realistic content.

  Next, the guidance mode st2 shown in FIG. 4 will be described using FIG. FIG. 6 is a diagram illustrating a specific example of control in the guidance mode st2. Here, the case where the peak position is controlled so as to guide the user to the target position Tp of the panel 5 will be described.

  For example, it is assumed that an operation button or the like is displayed at the target position Tp, and the output device 1 acquires the coordinate information of the target position Tp from the host device 100.

  As illustrated in FIG. 6, for example, it is assumed that the user performs a touch operation on the panel 5. The contact position Cp of the contact operation can be detected by the detection unit 22 (see FIG. 2).

  When the determination unit 23 acquires the coordinate information of the contact position Cp from the detection unit 22, the determination unit 23 calculates the guide route R from the contact position Cp to the target position Tp. In the example shown in the figure, the guide route R is a straight line connecting the contact position Cp and the target position Tp.

  In such a case, the determination unit 23 determines the vibration element 10 so that the position adjacent to the contact position Cp in the guidance route R is the peak position. And the determination part 23 gives a tactile sensation to a user via the panel 5 by vibrating the vibration element 10.

  That is, the user can recognize from the vibration of the panel 5 that the target position Tp is in the direction in which the panel 5 vibrates. Then, when the user moves the contact position Cp toward the target position Tp, the determination unit 23 calculates the guide route R again so that the position adjacent to the contact position Cp in the guide route R becomes the peak position. The vibration element 10 is vibrated. In such a case, the vibration frequency and amplitude of the vibration element 10 are derived by simulation or the like and stored in the storage unit 3 as frequency information 31.

  In this manner, the output device 1 can operate the display button displayed at the target position Tp without controlling the peak position by controlling the peak position so as to guide to the target position Tp. It becomes. In particular, the guidance mode st2 is effective when the output device 1 is mounted on a vehicle.

  That is, the driver can perform a desired operation without viewing the panel 5. In the induction mode st2, the vibration element 10 may be vibrated at a sound source frequency that outputs sound from the peak position. In this case, for example, the tactile frequency and the sound source frequency may be the same vibration frequency or may be different vibration frequencies.

  In this case, when the tactile frequency and the sound source frequency are different, the tactile frequency and the sound source frequency may be alternately switched by the same vibration element 10, or the vibration element that vibrates at the tactile frequency. 10 and the vibration element 10 to vibrate at the frequency for the sound source may be determined and vibrated independently of each other.

  Next, the video / tactile mode st3 shown in FIG. 4 will be described with reference to FIG. FIG. 7 is a diagram illustrating a specific example of control in the video / tactile mode st3. Here, a case where a lion is displayed on the panel 5 will be described.

  In the video / tactile mode st3, the determination unit 23 determines the vibration element 10 so that the mouth of the lion is a sound source, that is, a peak position. And the determination part 23 vibrates the vibration element 10 with the frequency for sound sources corresponding to the cry of a lion.

  As a result, only the lion's mouth vibrates, and portions other than the lion's mouth do not vibrate. In such a case, when the user touches the lion displayed on the panel 5, only the mouth of the lion vibrates, so that the outline of the lion's mouth can be recognized through the vibration.

  At this time, for example, the determining unit 23 can vibrate at different vibration frequencies in the area A1 corresponding to the contour portion of the lion's mouth and the area A2 located inside the contour portion.

  For example, the area A1 is vibrated at the tactile frequency corresponding to the lips of the lion, and the sound corresponding to the crying is generated from the area A2 at the sound source vibration frequency.

  Here, the output device 1 can change the frictional force generated between the panel 5 and the user's finger by setting the tactile frequency to, for example, a high frequency. The output device 1 can give a rough tactile sensation or a smooth tactile sensation in accordance with the change in the frictional force.

  As described above, in the video / tactile mode st3, by providing the user with a combination of audio and tactile sense, it is possible not only to control the sound source according to the video but also to provide content including a predetermined tactile sense. It is. In other words, it is possible to provide more realistic content including tactile sensation.

  Here, in the video / tactile mode st <b> 3, the case where the sound and the tactile sense are given according to the video has been described, but only the tactile sense may be given. That is, the tactile mode may be provided independently.

  Next, a processing procedure executed by the output device 1 according to the embodiment will be described with reference to FIG. FIG. 8 is a flowchart showing a processing procedure executed by the output device 1. Such processing procedure is repeatedly executed by the control unit 2.

  As illustrated in FIG. 8, the acquisition unit 21 acquires vibration information including the audio information and the tactile information from the higher-level device 100 (step S101). Then, the determination part 23 determines the vibration element 10 to vibrate based on vibration information (step S102). In other words, it can be said that the process of step S102 is a process of determining the peak position.

  Next, the determination unit 23 determines the amplitude and vibration frequency of the vibration element 10 (step S103), applies a drive voltage corresponding to the amplitude and vibration frequency to the vibration element 10 (step S104), and The process ends.

  As described above, the output device 1 according to the embodiment includes the panel 5, the plurality of vibration elements 10, and the control unit 2. The plurality of vibration elements 10 are attached to different positions on the panel 5 and vibrate the panel 5. The control unit 2 individually controls the amplitudes of the plurality of vibration elements 10 and controls the vibration peak position in the panel 5 to be an arbitrary position in the panel 5. Therefore, according to the output device 1 which concerns on embodiment, the arbitrary positions of the panel 5 can be vibrated correctly.

  By the way, although embodiment mentioned above explained the case where output device 1 was a touch panel display, it is not limited to this. That is, the output device 1 may be any one of a speaker, a touch pad, and a touch panel display with a separate speaker.

  In the above-described embodiment, the case where the output device 1 generates the peak position at the designated position of the panel 5 from the higher-level device 100 has been described. However, the present invention is not limited to this.

  For example, the peak position may be determined by the output device 1. In such a case, the output device 1 may analyze the video, identify the specific image i that is the sound generation source, and control the vibration element 10 so that the specific image i is at the peak position. .

  For example, it is assumed that the user makes a videophone call using the output device 1. In such a case, the output device 1 detects the mouth of the speaker from the video transmitted by the videophone.

  That is, in such a case, the speaker's mouth is identified as the specific image i, and the vibration element 10 is determined so that the specific image i is at the peak position. Then, the vibration frequency of the vibration element 10 is determined so that the peak position becomes the vibration frequency corresponding to the speech voice of the videophone.

  As a result, the user can make a videophone call in a situation close to an actual conversation.

  The output device 1 can also generate a plurality of peak positions at the same time by controlling each vibration element 10 individually. For example, in such a case, the vibration frequencies at different peak positions can be individually controlled. In such a case, for example, it is possible to output different sounds from different peak positions, or to give different tactile sensations to the user at different peak positions.

  In the above-described embodiment, the case where the vibration elements 10 are attached to the back surface 5b of the panel 5 in a matrix is described (see FIG. 1B), but the present invention is not limited to this.

  That is, if at least four vibration elements 10 are attached to the panel 5, the peak position can be controlled. FIG. 9 is a diagram illustrating a modification of the attachment position of the vibration element 10.

  As shown in FIG. 9, the output device 1 </ b> B according to the modification has a total of four vibration elements 10 attached to the four corners of the back surface 5 b of the panel 5. In such a case, the output device 1 </ b> B can control the amplitude and vibration frequency of each vibration element 10 individually, so that the peak position can be set to an arbitrary position on the panel 5.

  Here, although the case where a total of four vibration elements 10 are attached to the four corners of the back surface 5b of the panel 5 is shown, the present invention is not limited to this, and five or more vibration elements 10 may be attached. Good.

  Further effects and modifications can be easily derived by those skilled in the art. Thus, the broader aspects of the present invention are not limited to the specific details and representative embodiments shown and described above. Accordingly, various modifications can be made without departing from the spirit or scope of the general inventive concept as defined by the appended claims and their equivalents.

DESCRIPTION OF SYMBOLS 1 Output device 2 Control part 5 Panel 10 Vibrating element 21 Acquisition part 22 Detection part 23 Determination part

Claims (8)

A panel,
A plurality of vibration elements attached to different positions of the panel and vibrating the panel;
An output device comprising: a control unit that individually controls amplitudes of the plurality of vibration elements and controls a peak position of vibration in the panel to be an arbitrary position of the panel. The controller is
The output device according to claim 1, wherein vibration frequencies of the plurality of vibration elements are individually controlled. The controller is
3. The output according to claim 2, wherein the vibration is controlled to vibrate the peak position at a frequency for a sound source that generates sound from the panel or a tactile frequency that gives a predetermined tactile sensation to the user from the panel. apparatus. A display unit for displaying an image on the panel;
The controller is
The plurality of vibration elements are controlled such that a display position of a specific image serving as a sound generation source among the images displayed on the display unit is the peak position. The output device according to any one of the above. The controller is
The output device according to claim 4, wherein the plurality of vibration elements are controlled so that the peak position changes following the movement of the display position. A detection unit that detects an operation position of a user's contact operation on the panel;
The controller is
The output device according to any one of claims 1 to 5, wherein the peak position is controlled so that the operation position detected by the detection unit is guided to a target position. The plurality of vibration elements are:
Arranged in a matrix on the back of the panel,
The controller is
The output device according to claim 1, wherein a part of the vibration elements corresponding to the peak position is vibrated. A plurality of vibration elements that are attached to different positions of the panel and vibrate the panel,
An output method comprising: a control step of individually controlling amplitudes of the plurality of vibration elements and controlling a peak position of vibration in the panel.

Images