JP2010282259A - Sound collection apparatus and image display apparatus - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To provide a sound collection apparatus provided with a user interface for setting a parameter value in a direction of sound to be collected, and a parameter value other than the direction, such as a sound volume, by a continuous operation, and to provide an image display apparatus provided with a user interface for setting intuitively a parameter value in a desired direction of an omnidirectional image, and a parameter value other than the direction, such as a zoom amount, using one input means. <P>SOLUTION: The sound collection apparatus includes: an input means, an operation recognition means, a parameter value generating means and a controller control means. The sound collection apparatus recognizes an operation such as "touch" and "tracing" input by at least one finger in the input means, by the operation recognition means, generates values for a direction parameter and other than the direction parameter, based on a recognition result, and transmits the parameter values to a sound collection means/an image display means. <P>COPYRIGHT: (C)2011,JPO&INPIT

Description

  The present invention relates to a sound collection device such as a hearing aid and a recording device, and an omnidirectional camera video display device. In particular, the present invention relates to a sound collection device and a video display device including a controller for controlling the directivity of the sound collection device or a controller for controlling the viewing direction of the video display device.

  Directional sound collection devices aimed at clearly collecting the target sound by increasing the microphone directivity in the direction of arrival of the target sound have been put into practical use as hearing aids and recording machines. These are devices used by general users, and are required to have an easy-to-understand user interface so that parameter values such as directivity and volume can be easily set.

  In addition, in a video display device that displays video shot by an omnidirectional camera, a function has been proposed in which a portion to be viewed is extracted from the omnidirectional video and viewed. These are supposed to be used as monitoring devices, but in that case, the user interface can be used to quickly set parameter values, such as immediately expanding the part of the omnidirectional camera image that the monitor is interested in. Is required. Needless to say, an easy-to-understand user interface is required even if it is intended for entertainment use not for business use but for general users.

  Patent Documents 1 and 2 disclose a sound collecting device including a user interface for designating directivity, and Patent Document 3 discloses a video display device including a user interface for designating a direction desired to be viewed from an omnidirectional video.

  As a directivity designation method in a conventional sound collecting device, a description will be given with reference to FIG. 57 based on a recording device (cassette tape recorder) disclosed in Patent Document 1 and a hearing aid operating means currently available on the market. This recording device includes sound collecting means 5705 having directivity, direction input means 5701 for inputting the direction of the sound collecting means 5705, and feedback presentation means 5704 for indicating the direction in which the sound is picked up. By pressing the button in the direction in which sound is to be collected among the four direction buttons as the direction input means 5701, the control means 5703 drives the sound collection means 5705 in that direction, and the direction is displayed by the feedback presentation means 5704. The sound collection parameters other than the directivity are set by means different from the direction input means 5701 like the volume input means 5702 in FIG. An example of the appearance of each input means is as shown in FIG.

Japanese Patent Laid-Open No. 58-9266 Japanese Patent Laid-Open No. 9-327097 Japanese Patent No. 4010444

  However, in the conventional sound collecting device, it is possible to specify the direction of the sound to be collected. However, in order to set a parameter value other than the direction such as the volume, an input unit for that purpose is separately provided like the volume input unit 5702. There is a need. Accordingly, since the operation for setting the direction and other parameter values spans different input means as shown in FIG. 58, the operation becomes discontinuous and is not intuitive.

  Further, in a conventional video display device, it is necessary to input a region number of a portion to be viewed with a keyboard while viewing an omnidirectional video to which a region number is assigned, or to place a cursor on a portion to be viewed with a pointing device. Operation while viewing an omnidirectional image is difficult, and input means for adjusting the zoom amount etc. is required separately, so the operation for setting the direction and other parameter values spans different input means Therefore, the operation becomes discontinuous and is not intuitive.

  The present invention solves the above-described problem, and includes a user interface capable of intuitively setting a parameter value in a direction of a voice to be collected and a parameter value other than the direction such as a volume with one input unit. The purpose is to provide a sound collecting device.

  Also provided is a video display device having a user interface capable of intuitively setting a parameter value in a desired direction in omnidirectional video and a parameter value other than the direction such as a zoom amount with a single input means. For other purposes.

  The sound collecting device according to the first aspect of the present invention includes sound collecting means for collecting sound in an arbitrary direction around the user, and a controller for controlling the sound collecting means, and the controller is input means for receiving input from the user. An operation recognition unit that recognizes an input obtained by the input unit as an operation, a parameter value generation unit that generates one or more parameter values from a recognition result obtained from the operation recognition unit, and one or more parameter values Controller control means for transmitting to the sound collection means.

  A second invention is an invention subordinate to the first invention, comprising feedback presentation means for presenting feedback to the user according to the user input, and the controller control means uses one or more parameter values. A feedback signal is generated, and the feedback presentation means presents feedback according to the feedback signal to the user.

  The third invention is an invention subordinate to the second invention, and the feedback is one of light, sound, vibration, or a combination thereof.

  4th invention is invention which is dependent on 1st-3rd invention, Comprising: An input means is provided with the input device which outputs the place which one or more fingers of the user touched as one or more coordinate values, The operation recognizing means recognizes one or more operations using time series information of one or more coordinate values obtained from the input means.

  A fifth invention is an invention subordinate to the fourth invention, and the input device is a touch pad or a touch panel.

  The sixth invention is an invention subordinate to the fourth to fifth inventions, and the operation is a “touch” in which the input device is touched with one finger for a period longer than the first reference time, and two input devices are touched. “Multi-touch” with a finger touching the input device for longer than the first reference time, “tap” with a single finger touching the input device for a shorter time than the first reference time, and a circle in the circular coordinate system with one finger touching the input device Either “circumferential slide” that traces in the circumferential direction, or “radial slide” that traces the input device in the radial direction of the circular coordinate system with one finger, and the recognition result depends on the type of operation and its type The amount of operation.

  The seventh invention is an invention dependent on the sixth invention, wherein the operation amount is the coordinate value of the point touched by one finger when the operation is “touch”, and the operation amount is “multi-touch”. Is the coordinate value of the two points touched by two fingers, the coordinate value of the point touched by one finger when the operation is “tap”, or the coordinate value of the start of tracing when the operation is “circumferential slide” If the operation is “radial slide”, the coordinate value at the start of the trace and the radial displacement are used.

  The eighth invention is an invention subordinate to the first to seventh inventions, wherein the parameter value generating means includes directivity parameter values set in the sound collection device based on the recognition result obtained from the operation recognition means. Then, at least one parameter value among the volume, pitch, and playback speed is generated.

  A ninth invention is an invention subordinate to the eighth invention, and any one of the directivity parameter value and the volume value / pitch / reproduction speed is based on an operation amount of “touch”. Is set.

  The tenth invention is an invention subordinate to the eighth invention, and any one of the directivity parameter value and the volume / pitch / reproduction speed parameter value is based on an operation amount of “tap”. Is set.

  The eleventh invention is an invention subordinate to the eighth invention, wherein the directivity parameter value is set based on the operation amount of the “touch” of the first operation, and the volume, pitch, and playback speed are set. One of the parameter values is set based on the operation amount of the second operation “multi-touch”.

  The twelfth invention is an invention subordinate to the eighth invention, wherein the directivity parameter value is set based on the operation amount of the “touch” of the first operation, and the volume, pitch, and playback speed are set. Any one of the parameter values is set based on the operation amount of the second and subsequent “tap” continuous operations.

  A thirteenth invention is an invention subordinate to the eighth invention, and any one of the directivity parameter value and the volume / pitch / playback speed parameter is an operation of “slide in the circumferential direction”. Set based on quantity.

  The fourteenth invention is an invention subordinate to the eighth invention, wherein any one of the directivity parameter value and the volume, pitch, and playback speed is an operation amount of “radial slide”. Is set based on

  The fifteenth invention is an invention subordinate to the eighth invention, wherein the directivity parameter value is set based on an operation amount of “circumferential slide” of the first operation, and the volume and pitch・ Any two parameter values of the playback speed are set based on the operation amount of “circumferential slide” of the first and subsequent operations, and the other is the “radial direction” of the second and subsequent operations. It is set based on the operation amount of “slide”.

  The sixteenth invention is an invention subordinate to the eighth invention, wherein the directivity parameter value is set based on the operation amount of the “radial slide” of the first operation, and the volume, pitch, and reproduction are set. One of the two parameter values of the speed is set based on the operation amount of the “radial slide” of the first and subsequent operations, and the other is the “circumferential slide” of the second and subsequent operations. Is set based on the operation amount.

  A seventeenth invention is an invention subordinate to the first to seventh inventions, wherein the parameter value generating means sets the directivity and the directional beam set in the sound collection device based on the recognition result obtained from the operation recognition means. At least one parameter value among the width parameter value and the volume, pitch, and playback speed is generated.

  The eighteenth invention is an invention subordinate to the seventeenth invention, and any one of the parameter values of directivity and directional beam width and the volume value, pitch, and reproduction speed is “multi-touch”. "Is set based on the operation amount.

  The nineteenth invention is an invention dependent on the seventeenth invention, wherein the parameter values of directivity and directional beam width are set based on the operation amount of “multi-touch” of the first operation, The parameter value of any one of the pitch and the playback speed is set based on the operation amount of the second and subsequent “tap” continuous operations.

  The twentieth invention is an invention subordinate to the seventeenth invention, and the parameter values of directivity and directional beam width are set based on an operation amount of “circumferential slide” of the first operation. The parameter value of any one of volume, pitch, and playback speed is set based on the operation amount of the “radial slide” of the second operation.

  The twenty-first invention is an invention dependent on the seventeenth invention, and the parameter values of directivity and directional beam width are set based on the operation amount of “circumferential slide” of the first operation. The parameter value of any one of volume, pitch, and playback speed is set based on the operation amount of the second and subsequent “tap” continuous operations.

  A twenty-second invention is an invention dependent on the seventeenth invention, wherein the parameter values of directivity and directional beam width are set based on an operation amount of “multi-touch” of the first operation, The parameter value of any one of the pitch and the playback speed is set based on the operation amount of “circumferential slide” of the second operation.

  The twenty-third invention is an invention subordinate to the seventeenth invention, wherein the parameter values of directivity and directional beam width are set based on an operation amount of “multi-touch” of the first operation, The parameter value of any one of the pitch and the playback speed is set based on the operation amount of the “radial slide” of the second operation.

  The twenty-fourth invention is an invention dependent on the seventeenth invention, wherein the parameter values of directivity and directional beam width are set based on an operation amount of “multi-touch” of the first operation,・ One of the two parameter values of pitch and playback speed is set based on the amount of “circumferential slide” in the second and subsequent operations, and the other is set in the second and subsequent operations. It is set based on the operation amount of “radial slide”.

  A twenty-fifth invention is an invention dependent on the tenth, twelfth, nineteenth, and twenty-first inventions, wherein the input device further detects pressure when the finger touches, and the operation is higher than a predetermined pressure value with the finger of the input device. Including “press” that is pressed by pressure value, and operation is “press”, the operation amount of the recognition result includes the coordinate value of the point touched by the finger and the pressure value that is pressed by the finger, and includes volume, pitch, and playback speed. Any one parameter value is set based on the operation amount of “press” instead of “tap”.

  A twenty-sixth invention is an invention dependent on the thirteenth, fifteenth, sixteenth, and twentieth inventions, wherein the input device further detects pressure when a finger touches, and the operation is performed by using the single finger for circular coordinates. Recognize when "circumferential slide confirmation" is performed and the input device is pushed at a pressure value higher than the specified pressure value with a finger at the point where tracing is completed. The resulting manipulated variable includes the starting coordinate value, displacement in the circumferential direction, and pressure value, and any one of the parameter values of volume, pitch, and playback speed is “circumferential slide” instead of “circumferential slide”. It is set based on the operation amount of “directional slide confirmation”.

  The twenty-seventh invention is an invention dependent on the fourteenth to sixteenth, twentieth, twenty-third, twenty-fourth, and twenty-fourth inventions, wherein the input device further detects pressure when a finger touches, and the operation is performed with one finger. Trace result in the radial direction of the circular coordinate system, including “Diameter slide confirmation” that pushes the input device with a finger at a pressure value higher than the specified pressure value at the point where the tracing is finished, and the recognition result when the operation is “Diameter slide confirmation” The operation amount includes the starting coordinate value, radial displacement, and pressure value, and any one of the volume, pitch, and playback speed parameter values is “radial slide confirmation” instead of “radial slide”. Is set based on the operation amount.

  A twenty-eighth aspect of the invention is an invention dependent on the tenth, twelfth, nineteenth, and twenty-first aspects of the invention, and the operation is a second reference time in that the operation of touching or tracing the input device with one finger is finished. If the operation is “hold” and the operation amount is “hold”, the operation amount of the recognition result includes the coordinate value and displacement of the point where the finger continues to be touched, and the volume, pitch, and playback speed. Any one parameter value is set based on an operation amount of “hold” instead of “tap”.

  A twenty-ninth invention is an invention dependent on the fourth invention, and the input means further includes a first azimuth sensor that detects the azimuth directed by the controller and sends the detected azimuth to the parameter value generation means.

  A thirtieth invention is an invention dependent on the fourth and 29th inventions, and the input device is a cylindrical touch pad or a touch panel.

  The thirty-first invention is an invention subordinate to the thirty-first invention, and the operation is “touch” in which the input device is touched with one finger for a time longer than the first reference time, and the input device is touched with one finger. “Tap” that is touched for a shorter period of time than the first reference time, “Cylindrical slide” that traces the input device in the cylindrical direction of the cylindrical coordinate system with one finger, and the input device that moves in the axial direction of the cylindrical coordinate system with one finger The result of recognition is the type of operation, the amount of operation corresponding to that type, and the direction information of the first direction sensor.

  A thirty-second invention is an invention dependent on the thirty-first invention, wherein the operation amount is the coordinate value of the point touched by one finger when the operation is “touch”, and when the operation is “tap” The coordinate value of the point touched by one finger, if the operation is "cylindrical slide", the coordinate value and cylindrical displacement at the start of tracing, and if the operation is "sliding in the axial direction", the coordinate value of the start of tracing and the axial direction Displacement.

  A thirty-third invention is an invention subordinate to the first to fourth and 29-32 inventions, wherein the parameter value generation means sets the directivity to be set in the sound collection device based on the recognition result obtained from the operation recognition means. In addition, at least one parameter value among the parameter value of the directional beam width and the volume, pitch, and reproduction speed is generated.

  A thirty-fourth invention is an invention subordinate to the thirty-third invention, wherein the parameter values of directivity and directional beam width are the orientations of the first orientation sensor while the first operation is “touch”. The parameter value is set based on the azimuth displacement of the information, and any one of the volume, pitch, and playback speed is set based on the operation amount of the “cylindrical slide” of the second operation.

  A thirty-fifth aspect of the invention is a subordinate invention of the thirty-third aspect, wherein the directional and directional beam width parameter values are the directions of the first direction sensor while the first operation is “touch”. It is set based on the azimuth displacement of the information, and any one parameter value among the volume, pitch, and playback speed is set based on the operation amount of the “axial slide” of the second operation.

  The thirty-sixth invention is an invention subordinate to the thirty-third invention, and the parameter values of directivity and directional beam width are the orientations of the first orientation sensor while the first operation is “touch”. It is set based on the azimuth displacement of information, and one of the two parameter values among volume, pitch, and playback speed is set based on the operation amount of the “cylindrical slide” of the second and subsequent operations. One is set based on the operation amount of the “axial slide” of the second and subsequent operations.

  A thirty-seventh aspect of the invention is an invention dependent on the fourth aspect of the invention, wherein the input means is directed to the first azimuth sensor that detects the azimuth to which the sound collecting device is directed and sends it to the parameter value generating means, and the controller. And a second azimuth sensor that detects the azimuth and sends it to the parameter value generation means.

  A thirty-eighth invention is an invention dependent on the fourth and thirty-seventh inventions, and the input device is a cylindrical touch pad or a touch panel, and detects pressure when a finger touches.

  The thirty-ninth invention is an invention dependent on the thirty-eighth invention, and the operation is “touch” in which the input device is touched with one finger for a time longer than the first reference time, and the input device is touched with one finger. “Tap” that is touched for a shorter time than the first reference time, “circumferential slide” that traces the input device in the circumferential direction of the cylindrical coordinate system with one finger, axis of the cylindrical coordinate system with one finger "Axial slide" that traces the direction, or "press" that pushes the input device with a finger at a pressure value higher than a predetermined pressure value, the recognition result is the type of operation and the operation amount according to the type, the first and It is direction information of the 2nd direction sensor.

  The 40th invention is an invention dependent on the 39th invention, wherein the operation amount is the coordinate value of the point touched by one finger when the operation is "touch", and when the operation is "tap" The coordinate value of the point touched by one finger, if the operation is "cylindrical slide", the coordinate value and cylindrical displacement at the start of tracing, and if the operation is "sliding in the axial direction", the coordinate value of the start of tracing and the axial direction When the displacement and the operation are “press”, the coordinate value of the point touched by the finger and the pressure value pressed by the finger.

  The forty-first invention is an invention dependent on the first to fourth and 37 to 40 inventions, wherein the parameter value generating means sets the directivity to be set in the sound collecting device based on the recognition result obtained from the operation recognizing means. And at least one parameter value of volume, pitch, and playback speed is generated.

  The forty-second invention is an invention dependent on the first to fourth and 39 to 43 inventions, wherein the directivity parameter value is determined by the operation amount of the “press” of the first operation and the first and second operation values. It is set based on the difference of the direction information obtained from the direction sensor, and any one parameter value among volume, pitch, and playback speed is set based on the operation amount of the “cylindrical slide” of the second operation. Is done.

  The forty-third invention is an invention subordinate to the forty-second invention, wherein the directivity parameter value is determined by the operation amount of the “press” of the first operation and the orientation obtained from the first and second orientation sensors. The parameter value is set based on the information difference, and any one of the volume, pitch, and playback speed is set based on the operation amount of the “sliding in the axial direction” of the second operation.

  The forty-fourth invention is an invention subordinate to the forty-second invention, wherein the directivity parameter value is obtained from an operation amount of “press” of the first operation and directions obtained from the first and second orientation sensors. One of the two parameter values of volume, pitch, and playback speed is set based on the operation amount of “cylindrical slide” of the second and subsequent operations. One is set based on the operation amount of the “radial slide” of the second and subsequent operations.

  The forty-fifth invention is an invention subordinate to the thirty-fourth to thirty-sixth and thirty-fourth to thirty-fourth inventions, and further, based on the operation amount of “tap”, among the volume, pitch, and playback speed, One of the remaining parameter values excluding the parameter value set by “radial slide” is set.

  The forty-sixth invention is an invention dependent on the first to fourth inventions, wherein the input device is a touch pad or a touch panel that outputs a coordinate value of an orthogonal coordinate system, and the operation is traced with one finger. When the operation is “slide” and the operation is “slide”, the operation amount of the recognition result is the coordinate value at the start of tracing and the coordinate value at the end of tracing, and the parameter value generation means is based on the operation amount of “slide” One of the directivity parameter value set for the sound collection device and the volume value, pitch, and playback speed is generated.

  The forty-seventh invention is an invention dependent on the forty-sixth invention, wherein the operation further includes a “hold” for touching the finger for a time longer than the second reference time in that the input device is traced with one finger. If the operation is “hold”, the operation amount of the recognition result includes the coordinate value of the point touched with the finger, and the parameter value generation means is set by “slide” based on the operation amount of “hold” One of the remaining parameter values excluding the parameter value to be set is set.

  The forty-eighth invention is an invention dependent on the forty-sixth invention, wherein the operation further includes a “tap” for touching the input device with one finger for a time shorter than the first reference time, and the operation is “tap”. In this case, the operation amount of the recognition result is the coordinate value of the point touched by one finger, and the parameter value generation means excludes the parameter value set by “slide” based on the operation amount of “tap”. One of the remaining parameter values is set.

  A video display device according to a forty-ninth aspect of the present invention includes video display means for displaying video in an arbitrary direction around the user, and a controller for controlling the video display means. The controller includes input means for receiving input from the user. , Parameter value generating means for generating one or more parameter values from the information obtained from the input means, and controller control means for transmitting the one or more parameter values to the video display means.

  The 50th invention is an invention dependent on the 49th invention, comprising feedback presenting means for presenting feedback to the user according to the user's input, wherein the controller control means uses one or more parameter values. A feedback signal is generated, and the feedback presentation means presents feedback according to the feedback signal to the user.

  The fifty-first invention is an invention dependent on the fifty-first invention, and the feedback is any of light, sound, vibration, or a combination thereof.

  A fifty-second invention is an invention dependent on the fifty-ninth to fifty-first inventions, and the input means includes an input device that outputs, as one coordinate value, a place touched by one finger of the user.

  A fifty-third invention is an invention dependent on the fifty-second invention, and the input device is a touch pad or a touch panel.

  The 54th invention is an invention subordinate to the 49th to 53rd inventions, wherein the parameter value generating means includes a parameter value in a direction set in the video display device based on a coordinate value obtained from the input means, and an enlargement magnification. -One of the parameter values of brightness, volume and contrast is generated.

  The 55th invention is an invention dependent on the 49th to 53rd inventions, wherein the input device further detects the pressure when the finger touches and outputs it as a pressure value, and the parameter value generating means is obtained from the input means. A parameter value in a direction to be set in the video display device is generated based on the coordinate value, and any one of the magnification value, the brightness volume, and the contrast is generated based on the pressure value.

  According to the first to sixteenth inventions, the directivity parameter value set in the sound collection device, the volume, etc. by continuously performing an operation of touching or tracing the controller with one or more fingers. Setting of at least one parameter value other than the direction can be intuitively performed by one input means.

  According to the seventeenth to twenty-fourth inventions, the directivity and directivity beam width parameters set in the sound collecting device by continuously performing an operation of touching or tracing the controller with one or more fingers. The value and at least one parameter value among the volume, pitch, and playback speed can be set intuitively by one input means.

  According to the twenty-fifth to twenty-seventh aspects, it is possible to set at least one parameter value among volume, pitch, and playback speed by further pressing the controller with a finger.

  According to the twenty-eighth aspect, at least one parameter value among volume, pitch, and playback speed can be set by continuing an operation of touching and tracing the controller with a finger. .

  According to the twenty-ninth to forty-fifth aspects, the directivity to be set in the sound collecting device according to the direction in which the controller is directed, or the parameter values of directivity and directional beam width are set, and the controller is touched / traced / pressed with a finger. By continuously performing the operation, at least one parameter value among the volume, pitch, and playback speed can be set intuitively with one input means.

  According to the forty-sixth to forty-eighth inventions, by continuously performing an operation such as touching / tracing the controller with a finger, at least one of the directivity parameter value and the volume / pitch / reproduction speed set in the sound collection device. One parameter value can be set intuitively by one input means and without worrying about the center point of the operation surface.

  According to the forty-ninth to forty-fifth aspects, by continuously performing an operation of touching the controller with a finger, or an operation of touching / pushing the controller, the parameter value of the direction to be viewed in the omnidirectional video and the magnification / brightness volume -Any one parameter value of contrast can be set intuitively by one input means.

The figure which shows the structure of the sound collection apparatus in Embodiment 1 of this invention. The figure which shows the external appearance of the controller in Embodiment 1 of this invention. The figure explaining the operation method and operation result of the controller in Embodiment 1 of this invention The figure which shows operation | movement of the operation recognition means of the controller in Embodiment 1 of this invention. The figure explaining the operation | movement of the process at the time of the operation recognition means of the controller in Embodiment 1 of this invention. The figure explaining the operation | movement of the process at the time of no input in the operation recognition means of the controller in Embodiment 1 of this invention. The figure which shows the feedback content which the controller in Embodiment 1 of this invention presents The figure explaining the operation method of the controller in Embodiment 2 of this invention The figure explaining the operation | movement of the process at the time of the operation recognition means of the controller in Embodiment 2 of this invention. The figure explaining operation | movement of the process at the time of no input in the operation recognition means of the controller in Embodiment 2 of this invention. The figure explaining the operation | movement of the multi-touch process in the parameter value production | generation means of the controller in Embodiment 2 of this invention. The figure which shows the feedback content which the controller in Embodiment 2 of this invention presents The figure which shows the feedback content which the controller in Embodiment 3 of this invention presents The figure explaining the operation | movement of the process at the time of the operation recognition means of the controller in Embodiment 4 of this invention. The figure explaining operation | movement of the process at the time of no input in the operation recognition means of the controller in Embodiment 4 of this invention. The figure which shows the feedback content which the controller in Embodiment 4 of this invention presents The figure explaining the operation | movement of the process at the time of the operation recognition means of the controller in Embodiment 5 of this invention. The figure explaining the operation | movement of the process at the time of no input in the operation recognition means of the controller in Embodiment 5 of this invention. The figure which shows the feedback content which the controller in Embodiment 5 of this invention shows. The figure explaining the operation method and operation result of the controller in Embodiment 6 of this invention The figure explaining the operation | movement of the process at the time of the operation recognition means of the controller in Embodiment 6 of this invention. The figure explaining the operation | movement of the process at the time of no input in the operation recognition means of the controller in Embodiment 6 of this invention. The figure which shows the feedback content which the controller in Embodiment 6 of this invention presents The figure explaining the operation method and operation result of the controller in Embodiment 7 of this invention The figure which shows the feedback content which the controller in Embodiment 7 of this invention presents The figure explaining the operation method and operation result of the controller in Embodiment 8 of this invention The figure explaining the operation | movement of the process at the time of the operation recognition means of the controller in Embodiment 8 of this invention. The figure explaining the operation | movement of the process at the time of no input in the operation recognition means of the controller in Embodiment 8 of this invention. The figure which shows the feedback content which the controller in Embodiment 8 of this invention shows. The figure explaining the operation | movement of the process at the time of the operation recognition means of the controller in Embodiment 9 of this invention. The figure explaining the operation | movement of the single touch process in the operation recognition means of the controller in Embodiment 9 of this invention. The figure explaining the operation | movement of the process at the time of no input in the operation recognition means of the controller in Embodiment 9 of this invention. The figure which shows the feedback content which the controller in Embodiment 9 of this invention shows. The figure which shows the external appearance of the controller in Embodiment 10 of this invention. The figure explaining the operation method and operation result of the controller in Embodiment 10 of this invention The figure explaining the operation | movement of the process at the time of the operation recognition means of the controller in Embodiment 10 of this invention. The figure explaining the operation | movement of the process at the time of no input in the operation recognition means of the controller in Embodiment 10 of this invention. The figure which shows the feedback content which the controller in Embodiment 10 of this invention shows. The figure which shows the external appearance of the controller in Embodiment 11 of this invention. The figure explaining the operation | movement of the process at the time of the operation recognition means of the controller in Embodiment 11 of this invention. The figure which shows the feedback content which the controller in Embodiment 11 of this invention shows The figure which shows the external appearance of the controller in Embodiment 12 of this invention. The figure explaining the operation | movement of the process at the time of the operation recognition means of the controller in Embodiment 12 of this invention. The figure explaining the operation | movement of the process at the time of no input in the operation recognition means of the controller in Embodiment 12 of this invention. The figure which shows the feedback content which the controller in Embodiment 12 of this invention shows. The figure which shows the structure of the sound collection apparatus in Embodiment 13 of this invention. The figure explaining the external appearance and operating method of the controller in Embodiment 13 of this invention The figure explaining the operation | movement of the process at the time of the operation recognition means of the controller in Embodiment 13 of this invention. The figure explaining the operation | movement of the process at the time of no input in the operation recognition means of the controller in Embodiment 13 of this invention. The figure which shows the feedback content which the controller in Embodiment 13 of this invention presents The figure which shows the external appearance of the video display apparatus in Embodiment 14 of this invention, and the operating method of a controller The figure which shows the structure of the video display apparatus in Embodiment 14 of this invention. The figure which shows operation | movement of the operation recognition means of the controller in Embodiment 14 of this invention. The figure which shows the relationship between the pressure concerning the input means of a controller, and the image magnification in the parameter value generation means of the controller in Embodiment 14 of this invention. The figure which shows the feedback content which the video display apparatus in Embodiment 14 of this invention shows. The figure which shows a response | compatibility with the display content in a direction display area | region, and a virtual cylindrical surface in the feedback content which the video display apparatus in Embodiment 14 of this invention shows. Diagram showing the configuration of a conventional recorder The figure which shows the external appearance of the input means of the recorder of a prior art example

  Hereinafter, embodiments of the present invention will be described with reference to the drawings.

(Embodiment 1)
The sound collection device of Embodiment 1 will be described. FIG. 1 is a block diagram of a sound collection device (a hearing aid and a controller) according to an embodiment of the present invention. The controller 100 according to the first embodiment includes an input unit 101, an operation recognition unit 102, a parameter value generation unit 103, a controller control unit 104, and a feedback presentation unit 105. The input unit 101 includes a transparent touch panel 106.

  FIG. 2 is a view showing the appearance of the controller 100. As shown in FIG. 2, the controller 100 is worn on the wrist, and is used so that the front of the controller 100 is aligned with the front of the user. As shown in FIG. 3A, the user sets the directivity direction of the hearing aid 107, which is the sound collection means, and the sound volume from the direction by touching the input means 101 of the controller 100 with a finger. As a result, as shown in FIG. 3B, the user can set the sound volume value for a sound having a predetermined directional beam width centered on a specified direction (θ direction in the figure), and the other range. Can be heard at normal volume. Since the directivity control technique and the volume control technique of the hearing aid 107 are not the main points of the present application, the description is omitted assuming that a known technique is used.

  The user performs input by touching the surface of the touch panel 106 of the input unit 101 with a finger. As shown in FIG. 3A, the input unit 101 outputs the coordinates of the contact point of the finger as a value (r, θ) in a circular coordinate system centered on the touch panel center point. The minimum value (circle center) of the radial direction coordinate value is r = 0, and the maximum value (circle outer edge) is R. θ is 0 in the forward direction and is in a range of −π <θ ≦ π (the unit is radians, the left side is positive toward the front, the right side is negative).

  The operation recognizing unit 102 determines how to touch the finger based on the value output from the input unit 101.

  The parameter value generating unit 103 generates a parameter value for adjusting the operation of the hearing aid based on the finger touch obtained by the operation recognizing unit 102.

  The controller control unit 104 transmits the parameter value generated by the parameter value generation unit 103 to the hearing aid 107 and outputs a feedback signal based on the parameter value to the feedback presentation unit 105.

  The feedback presentation unit 105 includes a display device such as an LED, a liquid crystal display, or an organic EL display, and is laid under the touch panel 106. The feedback presentation unit 105 displays the parameter value set by the user to the user based on the feedback signal obtained from the controller control unit 104.

  The operation recognition unit 102 will be described in detail with reference to FIGS. FIG. 4 is a diagram showing the operation of the operation recognition unit 102. When the operation recognizing unit 102 starts its operation, it checks whether or not a coordinate value is input from the input unit 101 to the input buffer in S401. Then, if it is input, the process proceeds to S402 and the input process is performed. If there is no input, the process proceeds to S403 and the non-input process is performed, and then the process returns to S401.

FIG. 5 is a diagram showing the input processing S402. First, in S501, it is checked whether 1 (a value indicating a touched state) is assigned to a variable S _touch indicating “whether or not it is already touched”. If the value of S _touch is 1, the process is terminated. If it is not 1, the process proceeds to S502. In S502, 1 is set in S _touch , a contact timer for measuring the contact time of the finger is started, and the process ends.

FIG. 6 is a diagram showing the no-input process S403. In S601, it is checked whether or not the value of S _touch is 1. This is for checking whether the finger is released from the touched state or whether the finger is released. If the value of S _touch is not 1, it means that the state where the finger is separated continues, and the processing is terminated as it is. When the value of S _touch is 1, the process proceeds to S602, where 0 (a value indicating a state where no touch is made) is set in S _touch , and the contact timer is stopped. Then, the process proceeds to S603.

In step S603, it is checked whether the time from when the contact timer is started to when it is stopped, that is, whether the contact time of the finger is smaller than a predetermined threshold value t _tap . If it is smaller than t _tap , the process proceeds to S604, where a recognition result indicating that the operation is a “tap” operation in which the finger is touched and released immediately is output to the parameter value generation unit 103, and the process is terminated. If greater than t _tap , the process proceeds to S605.

In S605, the recognition result “touch” and the coordinate values (r _n , θ _n ) immediately before the finger is released are output to the parameter value generation unit 103, and the process is terminated.

Next, processing in the parameter value generation unit 103 will be described. When receiving the recognition result “coordinate” and the coordinate value (r _n , θ _n ) from the operation recognition unit 102, the parameter value generation unit 103 uses θ _n as the parameter value representing directivity and r _n as the parameter value of the volume. / R is output to the controller control means 104. Here, r n _{= R} / 2 is a standard volume, a large volume closer to r _n a circle centered with respect to the sound that comes from the angle theta _n direction when the zero forward, low volume closer to the outer edge Can be set. When the parameter value generating unit 103 receives the recognition result “tap” from the operation recognizing unit 102, it is determined that the operation has been touched without the intention of the user, and the process is terminated without outputting anything.

  Upon receiving the directivity and volume parameter values from the parameter value generation unit 103, the controller control unit 104 transmits them to the hearing aid 107. At the same time, the controller control means 104 outputs a feedback signal corresponding to the parameter value to the feedback presentation means 105.

  FIG. 7 shows the contents presented by the feedback presenting means 105 to the user. Between the outermost edge (radius R) of the circle and the center of the circle, a circle 701 having a radius R / 2 indicating standard volume is drawn. FIG. 7A shows a screen of the feedback presenting means 105 when the coordinates (R / 4, −π / 2) are touched to increase the volume from the right side of the user. This means that the sound source from the right side is closer to the user (= the center of the circle) than the current position (= the position where the standard volume is output), and an arrow from the standard volume circle 701 is drawn to the center. The length of the arrow is the volume control value. In this example, the length of the arrow is R / 4, indicating that an intermediate value between the standard volume and the maximum volume is designated. FIG. 7B is a screen of the feedback presenting means 105 when the coordinates (3R / 4, −π / 4) are touched in order to decrease the sound volume from the diagonally right front of the user. This means that the sound source from 45 ° (= −π / 4) diagonally forward right is moved away from the user (= the center of the circle) from the current position (= the position where the standard volume is output), and the outermost edge from the standard volume circle 701. An arrow pointing to is drawn. The length of the arrow is the volume control value as in FIG. In this example, the length of the arrow is R / 4, indicating that an intermediate value between the standard volume and the minimum volume is designated.

  As described above, the user can set the directionality and volume of the directivity centered on the user of the hearing aid 107 by touching the input unit 101 of the controller 100 with a finger. Although the sound volume setting from the designated direction has been described as an example in the first embodiment, the parameter values that can be set in other directions are not limited to the sound volume, and may be the pitch or the playback speed. When the playback speed is set, if the controller 100 is for a hearing aid with a speech speed conversion function, the speed can be adjusted so that the sound can be heard slowly. If the controller 100 is for a playback device such as a voice recorder, the speed may be adjusted so that the sound can be heard quickly or slowly. In the first embodiment, no process is performed for the “tap” operation, but various parameter values may be set by “tap”.

(Embodiment 2)
Next, a sound collecting device according to the second embodiment will be described. The configuration is as shown in FIG. 1, and the appearance is as shown in FIG. As the input means 101 of the controller 100 according to the second embodiment, a touch panel 106 capable of inputting with a plurality of fingers (multi-touch) as shown in FIG. 8 is used. The user sets the listening range of the hearing aid 107 and the volume value of the range by touching the input means 101 of the controller 100 with two fingers. The hatched portion in FIG. 8 explains the set listening range, but does not represent a screen that is actually presented to the user. The directional beam width control technique of the hearing aid 107 is omitted because it uses a known technique.

The operation of the operation recognition unit 102 is as shown in FIG. The input process S402 and the no-input process S403 will be described in detail with reference to FIGS. FIG. 9 is a diagram showing the input processing S402 in the second embodiment. First, in S901, it is checked whether or not 0 (a value indicating a non-touched state) is substituted for a variable S _touch indicating a finger contact state. If the value of S _touch is not 0, the process proceeds to S903. If the value of S _touch is 0, to initiate contact timer goes to S902, the process proceeds to S903.

In step S903, it is determined whether the input value from the input unit 101 is based on two fingers or one finger. If it is based on two fingers, the process proceeds to S904, and if it is based on one finger, the process proceeds to S907. In S904, it is determined whether or not the value of S _touch is 1. When the value of S _touch is not 1, since the previous state is a contact state with two fingers or no contact, the process proceeds to S906 and 2 is assigned to S _touch and the process is terminated. . If the value of S _touch is 1, it means that the previous state was a contact state with one finger, and the process proceeds to S905, where the recognition result of “touch” and the previous coordinate value (r _n , θ _n ) is output to the parameter value generating means 103, the process proceeds to S906, and the process is terminated.

In S907, it is determined whether or not the value of S _touch is 2. When the value of S _touch is not 2, since the previous state is a contact state with one finger or no contact, the process proceeds to S 909 and 1 is assigned to S _touch and the process ends. . If the value of S _touch is 2, it means that the previous state was a contact state with two fingers, and the process proceeds to S908, where the recognition result of “multi-touch” and the coordinate values of the two previous points ( r1 _n , θ1 _n ), (r2 _n , θ2 _n ) are output to the parameter value generation unit 103, the process proceeds to S909, and the process ends.

FIG. 10 is a diagram showing the no-input time processing S403 in the second embodiment. In S1001, it is checked whether or not the value of S _touch is 0. If the value of S _touch is 0, it means that the finger is still away, and the process is terminated as it is. If the value of S _touch is not 0, the process proceeds to S1002, and the contact timer is stopped. Then, the process proceeds to S1003.

In S1003, it is checked whether or not the finger contact time is smaller than a predetermined threshold value t _tap . If it is smaller than t _tap , the process proceeds to S1004, where the recognition result “tap” is output to the parameter value generation means 103, the process proceeds to S1007, and 0 is assigned to S _touch , and the process ends. If the finger contact time is longer than t _tap , the process proceeds to S1005.

In S1005, it is checked whether or not the value of S _touch is 2. If the value of S _touch is 2, the process proceeds to S1006, where the recognition result of “multi-touch”, the coordinate values (r1 _n , θ1 _n ) and (r2 _n , θ2 _n ) of two points immediately before releasing the finger The value is output to the value generation unit 103, the process proceeds to S1007, and the process ends. When the value of S _touch is not 2, the process proceeds to S1008, the recognition result “touch” and the previous coordinate value (r _n , θ _n ) are output to the parameter value generating unit 103, and the process proceeds to S1007. The process is terminated.

Processing in the parameter value generation unit 103 will be described. In the second embodiment, the hearing range of the hearing aid 107 is set by the angle between the contact point of two fingers touching the input unit 101 and the center point of the input unit 101, and the two contact points The volume is specified by the radial coordinate value of the point closest to the center point. As for the listening range, if only two points are held, two angles formed by the center can be obtained. Therefore, in this Embodiment 2, the one smaller than π (180 °) can be set as the listening range. Let's say that. As with the first embodiment, the sound volume is the standard sound volume when the radial coordinate value is R / 2, and the sound volume increases as it approaches the center of the circle and decreases as it approaches the outer edge. When the recognition result “multi-touch” and the coordinate values of two points are received from the operation recognition unit 102, the parameter value generation unit performs the process shown in FIG. In FIG. 11, it is assumed that the angle portions θ1 _n and θ2 _n of the coordinate values of two points are always input from the operation input unit 102 so as to have a relationship of θ2 _n > θ1 _n .

In step S1101, it is determined whether the difference between θ2 _n and θ1 _n is smaller than π. If smaller than π, the process proceeds to S1102, and θ2 _n −θ1 _n is substituted for the directional beam width (= listening range) dθ, and θ1 _n + dθ / 2 is substituted for the variable dir indicating the direction of directivity. The process moves to S1104. If greater than π, the process proceeds to S1103, 2π− (θ2 _n −θ1 _n ) is substituted for dθ, θ1 _n −dθ / 2 is substituted for dir, and the process proceeds to S1104. Although not shown in this figure, if the difference between θ2 _n and θ1 _n is equal to π, the process is terminated as it is because the listening range is indefinite.

In S1104 to S1107, correction is performed when the value of dir does not fall between −π and π. In step S1104, it is determined whether the value of dir is larger than π. If greater than π, the process proceeds to S1105, and a value of 2π-dir is substituted into dir, and the process proceeds to S1108. If it is smaller than π, the process proceeds to S1106, and it is determined whether or not the value of dir is smaller than −π. If it is smaller than −π, the process proceeds to S1107, and the value 2π + dir is substituted into dir, and the process proceeds to S1108. In S1108, the calculated dir and dθ are the listening range parameter values, and the controller obtains the value min (r1 _n , r2 _n ) / R obtained by dividing the smaller one of the two radial coordinate values by R as the volume parameter value. Output to the control means 104.

  When the parameter value generation unit 103 receives the recognition result “touch” from the operation recognition unit 102, the parameter value generation unit 103 outputs a command to reset the parameter value setting of the hearing aid 107 to the controller control unit 104. Further, when the parameter value generation unit 103 receives the recognition result “tap” from the operation recognition unit 102, it is determined that the operation has been touched without the intention of the user, and the process ends without outputting anything. .

  When the controller control unit 104 receives the parameter values of the listening range and the volume from the parameter value generation unit 103, the controller control unit 104 transmits them to the hearing aid 107. At the same time, the controller control means 104 outputs a feedback signal corresponding to the parameter value to the feedback presentation means 105. When receiving a command for resetting the parameter value setting from the parameter value generating unit 103, the controller control unit 104 transmits a command for initializing the parameter value setting to the hearing aid 107. At the same time, the controller control means 104 outputs a signal for initializing the presentation content to the feedback presentation means 105.

  FIG. 12 shows the contents presented by the feedback presenting means 105 to the user. As in the first embodiment, a circle having a radius R / 2 indicating the standard volume is drawn between the outermost edge (radius R) of the circle and the center of the circle. This figure shows the coordinates (3R / 8, 0) with one finger and another one in order to increase the sound volume in the range from the user's front (θ = 0) to the right direction (θ = −π / 2). It is a screen of the feedback presentation means 105 when a coordinate (5R / 8, -π / 2) is touched with a finger. The portion of −π / 2 to 0 set as the listening range is colored and displayed as shown in the figure. Further, since the radial coordinate value of the point close to the center of the two points is 3R / 8, the setting is made so that the volume is increased inside the standard volume circle, that is, the volume. This draws an arrow from the standard volume circle toward the center. The length of the arrow is a volume control value, which in this example is R / 8, which is the difference between the standard volume circle R / 2 and the previously described coordinate value 3R / 8.

  As described above, the user can set the listening range of the hearing aid 107 and the volume value of the range by touching the input unit 101 of the controller 100 with two fingers. Although the sound volume setting of the designated listening range has been described as an example in the second embodiment, the parameter value that can be set outside the listening range is not limited to the volume, but may be the pitch or the playback speed.

(Embodiment 3)
Next, a sound collecting device according to the third embodiment will be described. The configuration is as shown in FIG. 1, and the appearance is as shown in FIG. The user sets the directionality of the hearing aid 107 and the sound volume from the direction by touching the input unit 101 of the controller 100 with a finger. As a result, the user can hear the sound in a range having a predetermined directional beam width centered on the designated direction at the set volume value. In the first embodiment, the direction of the sound and the volume value are set by the operation of touching with a finger. In the third embodiment, the direction is first designated by the circumferential coordinate θ of the point touched by one finger, Next, the volume value is designated by the angle (<π) formed by the two points touched by two fingers and the center point. Touching an area within the radius r _reset from the center of the input means 101 allows the parameter value to be reset. The operation of the operation recognition unit 102 is as shown in FIG. Further, the input process S402 is as shown in FIG. 9, and the no-input process S403 is as shown in FIG.

Processing in the parameter value generation unit 103 will be described. Upon receipt of the recognition result “touch” and the coordinate value (r _n , θ _n ) from the operation recognition unit 102, the parameter value generation unit 103 outputs θ _n as a parameter value representing directivity to the controller control unit 104. To do. However, if 0 <r _n <r _reset , the parameter value generation unit 103 outputs a command to reset the parameter value setting of the hearing aid 107 to the controller control unit 104. Next, when the recognition result “multi-touch” and the coordinate values (r1 _n , θ1 _n ) and (r2 _n , θ2 _n ) of two points are received from the operation recognition unit 102, the parameter value generation unit 103 sets the two points and the center point. Doo is the angle | to calculate the | θ1 _n -θ2 _n. However, if this angle exceeds π, 2π− | θ1 _n −θ2 _n | is calculated. A volume parameter value is generated from the magnitude of this calculation result. In other words, if the calculation result is 0 (actually, this angle cannot be 0 by the contact of two fingers, so if it is less than a predetermined threshold, it is assumed to be 0). A volume parameter value is generated such that the standard volume is at / 2 and the maximum volume is at π, and is output to the controller control means 104. When the parameter value generating unit 103 receives the recognition result “tap” from the operation recognizing unit 102, it is determined that the operation has been touched without the intention of the user, and the process is terminated without outputting anything.

  Upon receiving the directivity and volume parameter values from the parameter value generation unit 103, the controller control unit 104 transmits them to the hearing aid 107. At the same time, the controller control means 104 outputs a feedback signal corresponding to the parameter value to the feedback presentation means 105. When receiving a command for resetting the parameter value setting from the parameter value generating unit 103, the controller control unit 104 transmits a command for initializing the parameter value setting to the hearing aid 107. At the same time, the controller control means 104 outputs a signal for initializing the presentation contents to the feedback presentation means 105.

  FIG. 13 shows the contents presented by the feedback presenting means 105 to the user. In the third embodiment, the direction of directivity specified by the user is indicated by a sector, and the volume specified by the user is indicated by the radius of the sector. In the example of FIG. 13, a sector shape having θ = −π / 4 and a radius of 3R / 4 is displayed. This indicates that an intermediate value between the standard volume and the maximum volume is set for the sound right diagonally forward.

  As described above, the user first sets the direction of directivity by the operation of touching the input means 101 of the controller 100 according to the third embodiment with one finger, and then the volume value by the operation of touching with two fingers. Can be set. In the third embodiment, the sound volume designation in the designated direction has been described as an example. However, the parameter value that can be designated other than in the direction is not limited to the volume, and may be the pitch or the playback speed.

(Embodiment 4)
Next, a sound collecting device according to the fourth embodiment will be described. The configuration is as shown in FIG. 1, and the appearance is as shown in FIG. As illustrated in FIG. 3A, the user sets the directionality of the hearing aid 107 and the sound volume from the direction by touching the input unit 101 of the controller 100 with a finger. As a result, the user can hear the sound in a range having a predetermined directional beam width centered on the designated direction at the set volume value. Sound outside the specified range is suppressed. In the first embodiment, the direction of the sound and the volume value are set by touching with a finger, but in this fourth embodiment, the direction is designated by the circumferential coordinate θ of the first touched point and the finger is released. After that, the volume value is set by a short touching operation within a predetermined time (the touching location may be anywhere as long as the predetermined radius r _reset <r <R). Further, when a region within the radius r _reset from the center of the input means 101 is touched, the parameter value can be reset.

The operation of the operation recognition unit 102 is as shown in FIG. The input process S402 and the no-input process S403 will be described in detail with reference to FIGS. FIG. 14 shows an input-time process S402 in the fourth embodiment. First, in S1401, it is checked whether 1 is assigned to the variable S _touch indicating “whether or not already touched”. If the value of S _touch is 1, the process is terminated. If the value of S _touch is not 1, the process proceeds to S1402. In S1402, S _touch is set to 1, the contact timer is started, and the non-contact timer for measuring the time when the finger is not in contact is stopped, and the process proceeds to S1403. Non-contact time of the finger in S1403 is determine if a predetermined threshold value t _{input The} is smaller than that indicating whether the input is continued. If it is smaller than t _input , the process proceeds to S1404, a value 1 indicating that input is in progress is _input to the variable S _input indicating the input state, and the process is terminated. If it is larger than t _input , the process proceeds to S1405, a value 0 indicating that the input is not being performed is _input to the variable S _input indicating the input state, and the process ends.

FIG. 15 is a diagram illustrating the no-input-time process S403. In S1501, it is checked whether or not the value of S _touch is 1. If the value of S _touch is not 1, it means that the state where the finger is separated continues, and the processing is terminated as it is. If the value of S _touch is 1, the process proceeds to S1502, S _touch is set to 0, the contact timer is stopped, the non-contact timer is started, and the process proceeds to S1503.

In S1503, it is checked whether the time from when the contact timer is started to when it is stopped, that is, the contact time of the finger is smaller than a predetermined threshold value t _tap . If greater than t _tap , the process proceeds to S1504, where the recognition result “touch” and the coordinate values (r _n , θ _n ) immediately before the finger is released are output to the parameter value generation unit 103, and the process ends. If the finger contact time is shorter than t _tap , the process proceeds to S1505. In S1505, it is checked whether or not the value of the variable S _input indicating the input state is 1. If the value of S _input is 1, it is determined that the input is continued, the process proceeds to S1506, the recognition result “tap” is output to the parameter value generation means 103, and the process ends. When the value of S _input is 0, it is determined that the operation has been touched without the intention of the user, and nothing is output and the process is terminated.

Processing in the parameter value generation unit 103 will be described. Upon receipt of the recognition result “touch” and the coordinate value (r _n , θ _n ) from the operation recognition unit 102, the parameter value generation unit 103 outputs θ _n as a parameter value representing directivity to the controller control unit 104. To do. However, if 0 <r _n <r _reset , the parameter value generation unit 103 outputs a command to reset the parameter value setting of the hearing aid 107 to the controller control unit 104. When the parameter value generation unit 103 receives the recognition result “tap” from the operation recognition unit 102, it generates a volume parameter value to be sent to the hearing aid 107. Here, there are three volume parameter values of “small”, “standard”, and “large”. Every time the parameter value generating means 103 receives “tap”, the volume parameter value is cyclically generated in the order of “large” → “small” → “standard” → “large” → “small” →. To do.

  Upon receiving the directivity and volume parameter values from the parameter value generation unit 103, the controller control unit 104 transmits them to the hearing aid 107. At the same time, the controller control means 104 outputs a feedback signal corresponding to the parameter value to the feedback presentation means 105. When receiving a command for resetting the parameter value setting from the parameter value generating unit 103, the controller control unit 104 transmits a command for initializing the parameter value setting to the hearing aid 107. At the same time, the controller control means 104 outputs a signal for initializing the presentation contents to the feedback presentation means 105.

  FIG. 16 shows the contents presented by the feedback presenting means 105 to the user. In the feedback presentation means 105 in the fourth embodiment, the directivity designated by the user is indicated by a rectangle. The rectangle is divided into three areas, and the range values are indicated by the coloring of the areas. When only the area close to the outer edge is colored, the sound volume is “low”, when the middle area is colored, the sound volume is “standard”, and when the area from the center point is colored, the sound volume is “high”. The example of FIG. 16 shows that the volume “low” is set for the sound from the diagonally right front.

  As described above, the user can specify the directionality and volume of the directivity centered on the user of the hearing aid 107 by touching the input unit 101 of the controller 100 with a finger. Although the sound volume setting from the designated direction has been described as an example in the fourth embodiment, the parameter value that can be set other than the direction is not limited to the sound volume, but may be the pitch or the playback speed. In the fourth embodiment, the coordinate value at the time of the tap operation is not used, but the parameter value may be set using this coordinate value.

(Embodiment 5)
Next, the sound collection device of the fifth embodiment will be described. The configuration is as shown in FIG. 1, and the appearance is as shown in FIG. The user first sets the listening range of the hearing aid 107 by touching the input means 101 of the controller 100 according to the fifth embodiment with two fingers as shown in FIG. The volume value is set by a short touch operation with one finger within the time (the touch location may be anywhere as long as a predetermined radius r _reset <r <R). Further, when a region within the radius r _reset from the center of the input means 101 is touched, the parameter value can be reset.

The operation of the operation recognition unit 102 is as shown in FIG. The input process S402 and the no-input process S403 will be described in detail with reference to FIGS. FIG. 17 is a diagram showing the input processing S402 in the fifth embodiment. Since FIG. 17 has many parts in common with FIG. 9 described in the second embodiment, only parts different from FIG. 9 will be described. If the value of the variable S _touch indicating the contact state of the finger in S901 is not 0 (a value indicating a state of not being touched), the process proceeds to S903, which is the same as FIG. If the value of S _touch is 0, the process proceeds to S1701 instead of S902, the contact timer is started, the non-contact timer is stopped, and the process proceeds to S1403.

S1403 to S1405 are the same as those in FIG. 14 described in the fourth embodiment. Non-contact time of the finger in S1403 is determine if a predetermined threshold value t _{input The} is smaller than that indicating whether the input is continued. If it is smaller than t _input , the process proceeds to S1404, a value 1 indicating that input is in progress is _input to the variable S _input indicating the input state, and the process proceeds to S903. If it is larger than t _input , the process proceeds to S1405, a value 0 indicating that input is not being performed is _input to the variable S _input indicating the input state, and the process proceeds to S903.

FIG. 18 is a diagram showing a no-input-time process S403 in the fifth embodiment. Since FIG. 18 has many parts common to FIG. 10 described in the second embodiment, only parts different from FIG. 10 will be described. When the value of S _touch is not 0 in S1001, the process has shifted to S1002 in the second embodiment, but in the fifth embodiment, the process shifts to S1801 provided in place of S1002, the contact timer is stopped, and the non-contact timer is set. Start and go to S1003.

In the second embodiment, if the finger contact time is smaller than the predetermined threshold value t _tap in S1003, the process proceeds to S1004. In the fifth embodiment, the process proceeds to S1802, and the value of S _input is checked. If the value of S _input is 1, it is determined that the input is continued, the process proceeds to S1004, the recognition result “tap” is output to the parameter value generating means 103, and the process proceeds to S1007. If the value of S _input is 0, it is determined that the operation is not intended by the user but has been touched, and the process proceeds to S1007 without outputting anything.

Next, processing in the parameter value generation unit 103 will be described. In the fifth embodiment, when the input unit 101 is touched with two fingers, the parameter value generation unit 103 uses the angle formed between the two contact points and the center point of the input unit 101 as the listening range of the hearing aid 107. The parameter value is output to the controller control means 104. The method of calculating the listening range parameter value is the same as the content of FIG. 11 described in the second embodiment, and thus description thereof is omitted. When the input unit 101 is touched with one finger, the parameter value generated differs depending on the recognition result received from the operation recognition unit 102. Upon receiving the recognition result “coordinate” and the coordinate values (r _n , θ _n ) from the operation recognition unit 102, the parameter value generation unit 103 _resets the parameter value setting of the hearing aid 107 when 0 <r _n <r reset. To the controller control means 104. If 0 <r _n <r _reset is not satisfied, the parameter value generation unit 103 does not generate anything and ends the process. When the parameter value generation unit 103 receives the recognition result “tap” from the operation recognition unit 102, it generates a volume parameter value to be sent to the hearing aid 107. Here, there are three volume parameter values of “small”, “standard”, and “large”. Every time the parameter value generating means 103 receives “tap”, the volume parameter value is cyclically generated in the order of “large” → “small” → “standard” → “large” → “small” →. To do.

  When the controller control unit 104 receives the parameter values of the listening range / volume from the parameter value generation unit 103, the controller control unit 104 transmits them to the hearing aid 107 and outputs a feedback signal corresponding to the parameter value to the feedback presentation unit 105. When receiving a command for resetting the parameter value setting from the parameter value generating unit 103, the controller control unit 104 transmits a command for initializing the parameter value setting to the hearing aid 107. At the same time, the controller control means 104 outputs a signal for initializing the presentation contents to the feedback presentation means 105.

  FIG. 19 shows the content presented by the feedback presenting means 105 to the user. In the fifth embodiment, the listening range designated by the user is indicated by a sector, and the volume designated by the user is indicated by a colored portion in the sector. In the example of FIG. 19, the area is divided into three in the sector shape, and only the part close to the center is colored. This indicates that the volume is set to the value “low”. If the middle area is colored, the volume is set to “standard”, and if all three areas in the fan shape are colored, the volume is set to “high”.

  As described above, the user first sets the listening range of the hearing aid 107 by touching the input unit 101 of the controller 100 according to the fifth embodiment with two fingers as shown in FIG. 8, and then releases the two fingers. After that, the volume value can be set by a short touch with one finger within a predetermined time. Although the sound volume setting of the designated listening range has been described as an example in the fifth embodiment, the parameter value that can be set outside the listening range is not limited to the sound volume, and may be the pitch or the playback speed. In the fifth embodiment, the listening range of the hearing aid 107 is set by a “multi-touch” operation in which two fingers touch each other. However, the “circumferential slide” is performed by tracing the surface of the input unit 101 of the controller 100 with the finger in the circumferential direction. The listening range may be set by an operation. Furthermore, although the coordinate value at the time of the tap operation is not used in the fifth embodiment, the parameter value may be set using this coordinate value.

(Embodiment 6)
Next, a sound collecting device according to Embodiment 6 will be described. The configuration is as shown in FIG. 1, and the appearance is as shown in FIG. As shown in FIG. 20 (a), the user traces with the finger in the radial direction or the circumferential direction on the surface of the input means 101 of the controller 100 (sliding operation), thereby determining the directionality of the hearing aid 107 and the direction thereof. Specifies the amount of increase / decrease in the volume of sound and the amount of increase / decrease in pitch from that direction. Accordingly, as shown in FIG. 20 (b), the user can set the volume value and the pitch of the sound in a range having a predetermined directional beam width centered on the specified direction, The sound can be heard at normal volume and pitch.

The operation of the operation recognition unit 102 is as shown in FIG. The input process S402 and the no-input process S403 will be described in detail with reference to FIGS. FIG. 21 is a diagram showing an input-time process S402 in the sixth embodiment. First, in S2101, it is checked whether 1 (a value indicating a touched state) is substituted for a variable S _touch indicating “whether or not already touched”. If the value of S _touch is 1, the process proceeds to S2103. If the value of S _touch is not 1, the process proceeds to S2102. In step S2102, 1 is set in S _touch , a value indicating “direction undefined” is set in a variable S _input indicating whether the input is in the circumferential direction or the radial direction, and 0 is set in the radial displacement dr and the circumferential displacement dθ. Further, the coordinate value at this time is stored as a coordinate initial value (r ₀ , θ ₀ ). Further, a contact timer is started, and the process proceeds to S2103.

In S2103, the absolute value of the radial direction difference r _n −r ₀ between the coordinate initial value (r ₀ , θ ₀ ) and the coordinate value (r _n , θ _n ) input n-th after being touched | r _n It is checked whether or not −r ₀ | is larger than a threshold value r _th indicating whether or not it has moved in the radial direction. If the threshold value r _th is not exceeded, the process moves to S2110. If it exceeds the threshold value r _th , the process proceeds to S2104.

In S2104, it is determined whether or not a value indicating “radial direction” is set in S _input . If the “radial direction” has already been set, the process proceeds to S2105, where r _n −r ₀ is set as the radial displacement dr, and this process ends. If the "radial direction" is not set in the S _{input The,} sets the "radial direction" in the _{S input The} proceeds to S2106. Next, in S2107, it is checked whether or not a value is set for the circumferential displacement dθ. If no value is set for dθ, the process proceeds to S2105. If a value is set for dθ, it means that the input in the circumferential direction has already existed, so the flow shifts to S2108, the recognition result “circumferential direction slide”, θ ₀ , The circumferential displacement dθ is output to the parameter value generating unit 103. Further, the flow shifts to S2109, dθ is set to 0, and the flow shifts to S2105.

In S2110, the absolute value of the circumferential angle difference θ _n −θ ₀ between the initial coordinate value (r ₀ , θ ₀ ) and the nth coordinate value (r _n , θ _n ) input after touching | It is checked whether or not θ _n −θ ₀ | is larger than a threshold θ _th indicating whether or not it has moved in the circumferential direction. If the threshold value _θth is not exceeded, this process is terminated. If the threshold value _θth is exceeded, the flow shifts to S2111. However, when the movement from θ ₀ to θ _n crosses the rear (θ = π), the value of θ is discontinuous. In this case, the value of the angle difference is when θ ₀ > 0 and θ _n <0. is _{2π + (θ n -θ 0)} , θ 0 <0 cutlet theta _n> for _{0 -2π + (θ n -θ 0} ) is used.

In S2111, it is determined whether or not a value indicating “circumferential direction” is set in S _input . If the “circumferential direction” has already been set, the process proceeds to S2112 to set θ _n −θ ₀ (in the case of moving across θ = π) to the circumferential displacement dθ, and this The process ends. If the "circumferential direction" is not set to the S _input, to set the "circumferential direction" to the _{S input} goes to S2113. Next, in S2114, it is checked whether or not the radial displacement dr has a value. If no value is set for dr, the process proceeds to S2112. If a value is set for dr, it means that the radial direction input has already existed, so the process proceeds to S2115, the recognition result of “radial slide”, θ ₀ , radial displacement dr is output to the parameter value generation means 103. Further, the process proceeds to S2116, where dr is set to 0, and the process proceeds to S2112.

FIG. 22 is a diagram showing the no-input time process S403. In S2201, it is checked whether or not the value of S _touch is 1. If the value of S _touch is not 1, it means that the state where the finger is separated continues, and the processing is terminated as it is. If the value of S _touch is 1, the process proceeds to S2202, where S _touch is set to 0 and the contact timer is stopped. Then, the process proceeds to S2203.

In step S2203, it is checked whether the time from when the contact timer is started to when it is stopped, that is, whether the finger contact time is smaller than a predetermined threshold value t _tap . If it is smaller than t _tap , the process advances to step S2204 to output a recognition result indicating that the operation is a “tap” operation (an operation different from the touch operation) in which the finger is touched and released immediately to the parameter value generation unit 103, and the process ends. If the finger contact time is longer than t _tap , the process proceeds to S2205.

In step S2205, it is checked whether the radial displacement dr has a value. If no value is set for dr, the process proceeds to S2207. If a value is set for dr, then the flow shifts to S2206, where the recognition result of “radial slide”, θ ₀ and dr are output, and the processing ends. In S2207, it is checked whether or not the circumferential displacement dθ has a value. If no value is set for dθ, the process proceeds to S2209. If a value is set for dθ, the process proceeds to S2208 to output the recognition result “circumferential slide”, θ ₀ and dθ, and the process is terminated.

  In step S2209, the recognition result “touch” is output to the parameter value generation unit 103, and the process ends.

Processing in the parameter value generation unit 103 will be described. In the sixth embodiment, the volume increase / decrease amount is designated by a radial slide operation, and the sound pitch increase / decrease amount is designated by a circumferential slide operation. When receiving the recognition result “radial direction slide” and the radial displacement dr from the operation recognition unit 102, the parameter value generation unit 103 generates an increase / decrease value of the volume. In the sixth embodiment, the quotient obtained by dividing dr by −R / 4 is used as the amount of increase / decrease in volume, and if the quotient is positive, the volume is increased, and if the quotient is negative, the volume is decreased. In other words, the volume is increased by the sliding operation toward the center, and the volume is decreased by the sliding operation toward the outer edge. For example, it is assumed that sliding starts from (r ₀ , θ ₀ ) = (3R / 4, −π / 2) toward the center and the finger is released at (R / 8, −π / 2). In this case, dr is R / 8-3R / 4 = -5R / 8, and the quotient obtained by dividing this by -R / 4 is 2. Therefore, the volume of the sound from the direction of θ ₀ = −π / 2 is set. A parameter value that is increased by two levels is generated. Also, assume that sliding starts from (r ₀ , θ ₀ ) = (R / 4, −π / 4) toward the outer edge, and the finger is released at (5R / 8, −π / 4). In this case, dr is 5R / 8-R / 4 = 3R / 8, and the quotient obtained by dividing this by -R / 4 is -1, so the volume of the sound from the direction of θ ₀ = −π / 4 is set. A parameter value to be reduced by one step is generated.

Further, upon receiving the recognition result “circumferential slide” and the circumferential displacement dθ from the operation recognition unit 102, the parameter value generation unit 103 generates a pitch increase / decrease value. In the sixth embodiment, the quotient obtained by dividing the circumferential displacement dθ by −π / 4 is used as the amount of increase / decrease in the change in pitch, and if the quotient is positive, the pitch is high and the quotient is negative. Lower the pitch of the sound. In other words, the pitch is increased by a clockwise slide operation, and the pitch is decreased by a counterclockwise slide operation. For example, assume that sliding starts clockwise from (r ₀ , θ ₀ ) = (3R / 4, −π / 4), and the finger is released at (3R / 4, −3π / 4). In this case, dθ is −3π / 4 + π / 4 = −π / 2, and the quotient obtained by dividing this by −π / 4 is 2. Therefore, the voice height from the direction of θ ₀ = −π / 4 is obtained. A parameter value that is two steps higher is generated.

If either the radial slide operation or the circumferential slide operation is performed and the other slide operation is performed without releasing the finger at the place where the finger is stopped, the parameter value can be designated continuously. For example, slide the finger from (r ₀ , θ ₀ ) = (3R / 4, −π / 2) toward the center, stop the finger at (R / 2, −π / 2), and then counterclockwise from there It is assumed that the finger is slid and the finger is released at (R / 2, 0). In this case, since it is determined that the radial displacement dr = −R / 4 when it is determined that the slide has started in the circumferential direction from the point where the finger is first stopped (Yes in Step S2110), θ ₀ A parameter value that increases the volume of the sound from the direction of = −π / 2 by one step is generated. Next, when the finger is released, the circumferential movement distance dθ = π / 2, so that a parameter value that lowers the voice level from the direction of θ ₀ = −π / 2 is generated by two steps.

  When the parameter value generation unit 103 receives the recognition result “touch” from the operation recognition unit 102, the parameter value generation unit 103 outputs a command to reset the parameter value setting of the hearing aid 107 to the controller control unit 104. Further, when the parameter value generation unit 103 receives the recognition result “tap” from the operation recognition unit 102, it is determined that the operation has been touched without the intention of the user, and the process ends without outputting anything. .

  When the controller control unit 104 receives the parameter values of directivity, volume, and pitch from the parameter value generation unit 103, the controller control unit 104 transmits them to the hearing aid 107. At the same time, the controller control means 104 outputs a feedback signal corresponding to the parameter value to the feedback presentation means 105. When receiving a command for resetting the parameter value setting from the parameter value generating unit 103, the controller control unit 104 transmits a command for initializing the parameter value setting to the hearing aid 107. At the same time, the controller control means 104 outputs a signal for initializing the presentation contents to the feedback presentation means 105.

  FIG. 23 shows the contents presented by the feedback presenting means 105 to the user. In the feedback presenting means 105 according to the sixth embodiment, the directivity and sound volume setting values are represented by arrows directed toward the center or the outer edge, and the sound volume height setting values are represented by the number of sectors having a central angle of 45 °. When the arrow is directed toward the center, the sound volume is set to increase. When the arrow is directed to the outer edge, the sound volume is set to be decreased. The total length of the arrow is the range of the volume that can be set. In the example of FIG. 23, the user has set the volume up to the third level out of the maximum six levels with respect to the sound from the diagonally right front. Indicates. When an operation is performed to lower the volume, the arrow is displayed toward the outer edge. With regard to the pitch of the sound, the direction of the arrow was left unset, the sound increased when the sector increased on the right side (up to 4 steps), and the sound decreased when the sector increased on the left side (down to 4 steps). Indicates. In the example of FIG. 23, it is shown that the user has set the sound pitch lower by two steps with respect to the sound from the diagonally right front.

  As described above, the user sets the directivity direction, the volume, and the pitch of the hearing aid 107 centered on the input means 101 of the controller 100 by an operation of tracing with the finger in the radial direction or the circumferential direction. Can do. In the sixth embodiment, the sound volume and the sound pitch from the designated direction have been described as an example. However, the parameter values that can be set other than the direction are any of the sound volume, the sound pitch, and the playback speed. Or a combination of the two. In the sixth embodiment, any two parameter values among volume, pitch, and playback speed are set by recognizing both “circumferential slide” and “radial slide”. By recognizing only one of “circumferential slide” and “radial slide”, one of the parameter values of volume, pitch, and playback speed may be set.

(Embodiment 7)
Next, a sound collecting device according to the seventh embodiment will be described. The configuration is as shown in FIG. 1, and the appearance is as shown in FIG. The user sets the listening range of the hearing aid 107 by first tracing the surface of the input means 101 of the controller 100 with a finger in the circumferential direction and then tracing with the finger in the radial direction. FIG. 24A and FIG. 24B show an example of the result of setting to listen only to sounds in a specified range. It is also possible to perform an operation of suppressing only the sound in the specified range.

  The operation of the operation recognition unit 102 is as shown in FIG. Further, the input process S402 is as shown in FIG. 21, and the no-input process S403 is as shown in FIG.

Processing in the parameter value generation unit 103 will be described. When the recognition result of “circumferential slide”, θ _0, and circumferential displacement dθ are received from the operation recognition means 102, θ ₀ + dθ / 2 (where θ ₀ + dθ / 2> π is set as a parameter value indicating the direction of directivity). ), -2π is added, and if θ ₀ + dθ / 2 <−π, 2π is further added), and | dθ | is output to the controller control means 104 as a parameter value representing the directional beam width (= listening range) To do. When receiving the recognition result “radial slide” and the radial displacement dr from the operation recognition unit 102, the parameter value generation unit 103 sets the parameter value generation unit 103 when dr <0 (= radial movement toward the center). Generates a parameter value that leaves only the sound in the specified listening range. When dr> 0 (= radial movement toward the outer edge), the parameter value generation unit 103 generates a parameter value that suppresses only the sound in the designated listening range. For example, slide the finger counterclockwise from (r ₀ , θ ₀ ) = (3R / 4, −π / 2), stop the finger at (3R / 4, 0), and slide the finger toward the center from there Let us assume that the finger is released at (R / 2, 0). At this time, since −π / 2 to 0 is designated as the listening range, the directional beam width is | dθ | = | 0 − (− π / 2) | = π / 2, and the directivity direction is θ _0. A parameter value of + dθ / 2 = −π / 4 is generated. Further, since the radial movement is dr = R / 2-3R / 4 = −R / 4 <0, a parameter value for leaving only the sound in the designated listening range is generated.

  When the controller control means 104 receives from the parameter value generation means 103 the parameter values indicating whether the listening range and the sound are to be left or suppressed, the controller control means 104 transmits them to the hearing aid 107. At the same time, the controller control means 104 outputs a feedback signal corresponding to the parameter value to the feedback presentation means 105.

  FIG. 25 shows the contents presented by the feedback presentation means 105 to the user. FIG. 25A is a screen of the feedback presentation unit 105 when the range from the user's front (θ = 0) to the diagonally right rear (θ = −3π / 4) is set as the listening range. The part set as the listening range is colored and displayed as shown in the figure. FIG. 25B is a screen of the feedback presentation unit 105 when setting is made to suppress the sound in the range from the user's front (θ = 0) to the right diagonally rear (θ = −3π / 4). As shown in the figure, the portion other than the range to be suppressed (= the range in which the sound can be heard) is colored and displayed.

  Thus, the user first sets the listening range of the hearing aid 107 by tracing the finger in the circumferential direction on the surface of the input unit 101 of the controller 100. Next, by tracing with a finger in the radial direction, it is possible to specify whether only the sound in the range is heard or only the sound in the range is suppressed. In the seventh embodiment, only the sound in the designated range is set to be heard or suppressed, but the sound volume in the designated range may be set as in the other embodiments. . Further, instead of the volume, any one parameter value of the pitch and the playback speed may be set.

(Embodiment 8)
Next, a sound collecting device according to the eighth embodiment will be described. The configuration is as shown in FIG. 1, and the appearance is as shown in FIG. As shown in FIG. 26 (a), the user traces the finger in the radial direction on the surface of the input means 101 of the controller 100, and then continues to touch the finger without releasing the finger. Specifies the amount of increase or decrease in sound volume from the direction. As a result, as shown in FIG. 26B, the user can use the set volume value for sounds in a range having a predetermined directional beam width centered on a specified direction, and the normal sound for sounds in other ranges. You can listen by volume. The volume can be adjusted by adjusting the amount of increase / decrease depending on the finger tracing direction and the stop time. The minimum volume is designated as 0 level, the standard volume is designated as 3 levels, and the maximum volume is designated as 6 levels. The operation of the operation recognition unit 102 is as shown in FIG.

The operation of the operation recognition unit 102 is as shown in FIG. The input process S402 will be described with reference to FIG. First, in S2701, it is checked whether 1 is assigned to a variable S _touch indicating “whether or not already touched”. The value of S _touch is shifted to S2703 if it is _1, the value of the _{S touch} is shifted to the 1 unless the S2702. In S2702, S _touch is set to 1, variable S _command indicating “whether or not recognized as a command” is set to 0, radial displacement dr is set to 0, and directivity direction θ _dir is set to 0. To do. Further, the coordinate value at this time is stored as a coordinate initial value (r ₀ , θ ₀ ). Further, a contact timer is started, and the process proceeds to S2703.

In S2703, the absolute value | r _n −r ₀ | of the radial direction difference r _n −r ₀ between the coordinate initial value (r ₀ , θ ₀ ) and the coordinate value (r _n , θ _n ) currently touched by the finger. Is greater than a threshold value r _th indicating whether or not it has moved in the radial direction. If the threshold value r _th is not exceeded, the processing is completed. If the threshold value r _th is exceeded, the flow shifts to S2704.

In S2704, it is checked whether or not the value of S _command is 1 (a value indicating that the command is recognized). If the value of S _command is not 1, then the flow shifts to S2705. In S2705, 1 is set in S _command , r _n −r ₀ is set in dr, θ _n is set in θ _dir , a volume timer is started, and the process ends. If the value of S _command is 1 in S2704, the process proceeds to S2706.

In S2706, it is checked whether the value of the volume timer is greater than a predetermined threshold value t _volume . If it is larger than t _{volume, the} process proceeds to S2707, where the recognition result “hold”, dr and θ _dir are output to the parameter value generation means 103, the sound volume timer is temporarily stopped and then restarted, and the process is terminated. If it is larger than t _volume, the process is terminated as it is. By these processes, when the finger is slid to some extent, the sound volume is changed by one step, and when the finger is left still for a while, the sound volume can be changed by one step every predetermined time.

FIG. 28 is a diagram showing the no-input time process S403. In S2801, it is checked whether or not the value of S _touch is 1. If the value of S _touch is not 1, it means that the state where the finger is separated continues, and the processing is terminated as it is. When the value of S _touch is 1, the process proceeds to S2802, where 0 is set in S _touch , the contact timer is stopped, and the volume timer is stopped. Then, the flow shifts to S2803.

In S2803, it is checked whether the time from when the contact timer is started to when it is stopped, that is, whether the finger contact time is smaller than a predetermined threshold value t _tap . If it is smaller than t _tap , the process advances to step S2804 to output a recognition result indicating that the operation is a “tap” operation in which the finger is touched and released immediately to the parameter value generation unit 103, and the process is terminated. If the finger contact time is longer than t _tap , the process proceeds to S2805.

In S2805, it is checked whether or not the value of S _command is 1. If the value of S _command is 1, the process is terminated. When the value of S _command is not 1, the process proceeds to S 2806, where the recognition result “touch” and the immediately preceding coordinate value (r _n , θ _n ) are output to the parameter value generating unit 103, and the process ends.

Processing in the parameter value generation unit 103 will be described. When receiving the recognition result “hold” and the radial displacement dr and θ _dir from the operation recognition unit 102, the parameter value generation unit 103 generates a volume parameter value for the direction of θ _dir . When dr> 0 (= radial movement toward the outer edge), it is determined that the sound is to be moved away from the user, that is, the volume is to be reduced, and the volume value held internally is subtracted by 1 (however, the volume value has already been reduced) If is 0, the process is terminated as is). Conversely, if dr <0, it is determined that the volume is to be increased, and one volume value is added (however, if the volume value is already 6, the process ends as it is). Then, the value of θ _dir and the volume value are output to the controller control means 104, and the process ends.

When the recognition result “coordinate” and the coordinate value (r _n , θ _n ) are received from the operation recognition unit 102, the parameter value generation unit 103 _resets the parameter value setting of the hearing aid 107 if 0 <r _n <r reset. The command to be output is output to the controller control means 104, and the processing is terminated without doing anything else. If the recognition result “tap” is received, it is determined that the contact is not intended, and the process is terminated without doing anything.

  When the controller control unit 104 receives the direction and volume parameter values from the parameter value generation unit 103, the controller control unit 104 transmits them to the hearing aid 107 and outputs a feedback signal corresponding to the parameter value to the feedback presentation unit 105. When receiving a command for resetting the parameter value setting from the parameter value generating unit 103, the controller control unit 104 transmits a command for initializing the parameter value setting to the hearing aid 107. At the same time, the controller control means 104 outputs a signal for initializing the presentation contents to the feedback presentation means 105.

  FIG. 29 shows the contents presented by the feedback presenting means 105 to the user. A graphic showing the direction of directivity and volume specified by the user is drawn. This figure is divided into six areas and is colored sequentially from the center by the amount of the set volume value. In the example of FIG. 29, the sound volume is set to one level for the sound from diagonally right front (θ = −π / 4).

  As described above, the user traces with the finger in the radial direction on the surface of the input unit 101 of the controller 100 and then keeps touching without releasing the finger, whereby the directionality of the directivity centering on the user of the hearing aid 107 and the increase / decrease amount of the volume. Can be set. Although the sound volume setting in the designated direction has been described as an example in the eighth embodiment, the parameter value that can be set other than the direction is not limited to the sound volume, and may be a pitch or a reproduction speed.

(Embodiment 9)
Next, a sound collecting device according to the ninth embodiment will be described. The configuration is as shown in FIG. 1, and the appearance is as shown in FIG. The user first sets the listening range of the hearing aid 107 by touching the input means 101 of the controller 100 according to the ninth embodiment with two fingers as shown in FIG. Next, as shown in FIG. 20A, the volume increase / decrease amount of the designated listening range and the pitch increase / decrease amount are set by an operation of tracing with one finger in the radial direction or the circumferential direction. As a result, the user can hear the sound in the designated listening range at the set volume value and pitch, and the sound in the other range at the normal volume value and pitch.

The operation of the operation recognition unit 102 is as shown in FIG. The input process S402 and the no-input process S403 will be described in detail with reference to FIGS. FIG. 30 is a diagram showing the input processing S402 in the ninth embodiment. 30 has many parts in common with FIG. 9 described in the third embodiment, so only the parts different from FIG. 9 will be described. In step S903, it is determined whether the input value from the input unit 101 is from two fingers or one finger. Same is the point of transition to S907 as long as according to one finger, but the input value from the input unit 101 shifts to S906 regardless of the value of the previous state S _touch as long as with two fingers. That is, when the state transitions from one finger to two fingers, the recognition result “touch” is output in the third embodiment, but nothing is output in the ninth embodiment. This avoids the determination of “touch” when the user thinks that the user has touched two fingers at the same time but actually touches one finger first and then touches the other finger. Because. Further, at one point the current input at S907, and if the _{S touch} ≠ 2, is not shifted to S909 of the destination in the case of the third embodiment, the process ends after the transition to the single touch processing S3001 To do.

  FIG. 31 is a diagram showing the single touch process of S3001. Here, a slide operation determination by one finger and a radial displacement or a circumferential displacement are output. FIG. 31 is almost the same as FIG. 21 described in the sixth embodiment, except that S2102 is replaced with S3101. In S3101, the contact timer that was used in S2102 is not started. This is because this process has already been performed in S902 of FIG.

FIG. 32 is a diagram showing the no-input process S403 in the ninth embodiment. 32 has many parts in common with FIG. 10 described in the second embodiment, so only the parts different from FIG. If the value of S _touch is not 2 in S1005, the process proceeds to S1008 in the second embodiment. In the ninth embodiment, the presence or absence of a slide operation and the movement distance or the movement if there is a slide operation in S2205 to S2208. Outputs the movement angle. Since S2205 to S2208 are the same as those in FIG. 22 described in the sixth embodiment, description thereof will be omitted. If there is no slide operation in S2205 to S2208, the process proceeds to S1008.

  Processing in the parameter value generation unit 103 will be described. In the ninth embodiment, when the input unit 101 is touched with two fingers, the parameter value generation unit 103 sets the angle formed between the two contact points and the center point of the input unit 101 as the listening range of the hearing aid 107. The parameter value is output to the controller control means 104. The method for calculating the listening range parameter value is the same as that in FIG. 11 described in the second embodiment, and thus the description thereof is omitted. When the input unit 101 is touched with one finger, the parameter value generation unit 103 sets the volume increase / decrease amount by the radial slide operation, the pitch increase / decrease amount by the circumferential slide operation, and the parameter value by the touch operation. A command designating resetting of values is output to the controller control means 104. The tap is regarded as an unintended contact, and nothing is output and the process is terminated. The processing when the parameter value recognizing unit 103 receives an output related to an operation performed with one finger from the operation recognizing unit 102 is the same as the content described in the sixth embodiment, and thus the description thereof is omitted.

  When the controller control unit 104 receives the parameter values of directivity, volume, and pitch from the parameter value generation unit 103, the controller control unit 104 transmits them to the hearing aid 107. At the same time, the controller control means 104 outputs a feedback signal corresponding to the parameter value to the feedback presentation means 105. When receiving a command for resetting the parameter value setting from the parameter value generating unit 103, the controller control unit 104 transmits a command for initializing the parameter value setting to the hearing aid 107. At the same time, the controller control means 104 outputs a signal for initializing the presentation contents to the feedback presentation means 105.

  FIG. 33 shows the contents presented by the feedback presenting means 105 to the user. In the ninth embodiment, two concentric circles are presented, and a colored sector in the inner circle represents the listening range, and an arrow passing through the center of the sector represents the set value of the volume. When the arrow is directed toward the center, the sound volume is set to increase. When the arrow is directed to the outer edge, the sound volume is set to be decreased. The total length of the arrow is the width of the volume that can be set, and the area between the inner circle and the outer circle is for indicating the set value of the pitch of the sound, and is divided into eight areas starting from the arrow Is done. When the arrow direction is not set and the colored area increases to the right (clockwise direction), the sound is higher (up to 4 steps), and when it increases to the left (counterclockwise direction), the sound is lower (up to 4 steps). ) Indicates that it has been set. In the example of FIG. 33, the area indicated by the sector is set as the listening range, the volume is increased up to the third level out of the maximum six levels, and the user sets the pitch one level higher. Indicates that

  As described above, the user sets the listening range of the hearing aid 107 by touching the input unit 101 of the controller 100 with two fingers. Next, the volume increase / decrease amount and the pitch of the designated listening range can be designated by an operation of tracing with one finger in the radial direction or the circumferential direction. In the ninth embodiment, the setting of the sound volume and the sound pitch of the designated listening range has been described as an example. However, the parameter values that can be set outside the listening range are any of the volume, the sound pitch, and the playback speed. Or a combination of the two. In the ninth embodiment, any two parameter values among volume, pitch, and playback speed are set by recognizing both “circumferential slide” and “radial slide”. However, by recognizing only one of “circumferential slide” or “radial slide”, one of the parameter values of volume, pitch, and playback speed may be set. .

(Embodiment 10)
Next, a sound collecting device according to the tenth embodiment will be described. The configuration is as shown in FIG. FIG. 34 is a diagram showing the external appearance of the controller 100. As shown in FIG. 34, the controller 100 is attached to the wrist and used so that the front of the controller is aligned with the front of the user. As shown in FIG. 35 (a), the user traces the surface of the input means 101 of the controller 100 with a finger (slide operation), whereby the direction of the directivity of the hearing aid 107 and the increase / decrease amount of the sound volume from that direction. Set. As a result, as shown in FIG. 35 (b), the user uses the set volume value for sounds in a range having a predetermined directional beam width centered on a specified direction, and normal sounds for sounds in other ranges. You can listen by volume. However, the directions that can be set are within the range of -π / 2 to π / 2, where π / 2 is the left direction, 0 is the front direction, and -π / 2 is the right direction. As for the volume setting, the volume can be increased or decreased by one step with a single slide operation. The minimum volume is designated as 0 level, the standard volume is designated as 3 levels, and the maximum volume is designated as 6 levels. In the tenth embodiment, the direction and volume increase / decrease amount can be input without worrying about the center point of the input means 101 seen in the first embodiment.

  The input means 101 is a square transparent touch panel. As shown in FIG. 35A, the input unit 101 outputs the coordinates of the contact point of the finger as a value (x, y) in an orthogonal coordinate system with the origin at the lower right of the touch panel. The feedback presentation unit 105 includes a display device such as an LED, a liquid crystal display, or an organic EL display, and is laid under the touch panel. The feedback presentation unit 105 displays to the user what parameter values the user has set based on the parameter values obtained from the controller control unit 104.

The operation recognition unit 102 will be described. The operation of the operation recognition unit 102 is as shown in FIG. The input processing S402 will be described with reference to FIG. First, in S3601, it is checked whether 1 is assigned to a variable S _touch indicating “whether or not it is already touched”. If the value of S _touch is 1, the process proceeds to S3603. If the value of S _touch is not 1, the process proceeds to S3602. In S3602, 1 is set in S _touch and 0 is set in variable S _command indicating “whether or not recognized as a command”. Further, the coordinate value at this time is stored as a coordinate initial value (x ₀ , y ₀ ). Further, a contact timer is started, and the process proceeds to S3603.

In S3603, it is checked whether or not the value of S _command is 1 (a value indicating recognition as a command). If the value of S _command is 1, it means that the command has already been recognized, and the process ends. If the value of S _command is not 1, then the flow shifts to S3604. In S3604, it is checked whether or not the distance between the coordinate values (x _n , y _n ) currently in contact and (x ₀ , y ₀ ) is greater than the command input threshold value l _th . If this distance is greater than l _th , the process proceeds to S3605, S _command is set to 1, and the recognition result “slide” and the coordinate values (x _n , y _n ) and (x ₀ , y ₀ ) are parameter value generation means. To 103. If this distance is smaller than l _th , the process ends.

The no-input process S403 will be described with reference to FIG. In S3701, it is checked whether or not the value of S _touch is 1. If the value of S _touch is not 1, it means that the state where the finger is separated continues, and the processing is terminated as it is. If the value of S _touch is 1, the process proceeds to S 3702, 0 is set in S _touch , and the contact timer is stopped. Then, the flow shifts to S3703.

In S3703, it is checked whether the time from when the contact timer is started to when it is stopped, that is, whether the finger contact time is smaller than a predetermined threshold value t _tap . If it is smaller than t _tap , the process advances to S3704 to output a recognition result indicating that the operation is a “tap” operation in which the finger is touched and released immediately to the parameter value generating unit 103, and the process ends. If the finger contact time is longer than t _tap , the flow shifts to S3705.

In S3705, it is checked whether or not the value of S _command is 1. If the value of S _command is 1, the process is terminated. When the value of S _command is not 1, the recognition result of “touch” is output to the parameter value generation unit 103, and the process is terminated.

Processing in the parameter value generation unit 103 will be described. When the recognition result “slide” and the coordinate values (x _n , y _n ) and (x ₀ , y ₀ ) are received from the operation recognition unit 102, the parameter value generation unit 103 indicates the direction in which the user intends to specify the volume. Investigate. If the angle representing the direction is θ, θ = arctan (y _n −y ₀ ) / (x _n −x ₀ ) when x _n ≠ x ₀ ( _where −π / 2 <θ <π / 2). . If it does not do anything. Next, by examining the displacement in the x direction, it is examined whether the volume is increasing or decreasing. If x _n > x ₀ , the finger is moving away from the user, so it is determined that the sound is going away, that is, the volume is going to be decreased, and the volume value held internally is subtracted by 1 (however, already If the volume value is 0, the process is terminated as it is). If x _n <x ₀ , it is determined that the volume is going to be increased, and the volume value is incremented by 1 (however, if the volume value is already 6, the process is terminated as it is). Then, the value of θ and the volume value are output to the controller control means 104, and the process ends.

  When the parameter value generation unit 103 receives the recognition result “touch” from the operation recognition unit 102, the parameter value generation unit 103 outputs a command to reset the parameter value setting of the hearing aid 107 to the controller control unit 104. Further, when the parameter value generation unit 103 receives the recognition result “tap” from the operation recognition unit 102, it is determined that the operation has been touched without the intention of the user, and the process ends without outputting anything. .

  When the controller control unit 104 receives the direction / volume parameter values from the parameter value generation unit 103, the controller control unit 104 transmits them to the hearing aid 107 and outputs a feedback signal corresponding to the parameter value to the feedback presentation unit 105. When receiving a command for resetting the parameter value setting from the parameter value generating unit 103, the controller control unit 104 transmits a command for initializing the parameter value setting to the hearing aid 107. At the same time, the controller control means 104 outputs a signal for initializing the presentation contents to the feedback presentation means 105.

  FIG. 38 shows the content presented by the feedback presenting means 105 to the user. A semicircle centered on the user is displayed, and a graphic showing the directivity direction and volume specified by the user is drawn therein. This figure is divided into six areas and is colored sequentially from the center by the amount of the set volume value. In the example of FIG. 38, the sound volume is set to five levels with respect to the sound from diagonally right front (θ = −π / 4).

  As described above, the user traces the surface of the input unit 101 of the controller 100 with a finger (slide operation), so that the direction of the directivity centered on the user of the hearing aid 107 can be obtained without worrying about the center point of the input unit 100. , Volume increase / decrease amount can be set. In the tenth embodiment, the sound volume setting in the designated direction has been described as an example. However, the parameter value that can be set in any direction other than the direction is not limited to the sound volume, and is set to any one of the pitch and the playback speed. Also good. Further, the direction that can be designated can be switched from the front of the user to the rear (−π <θ <−π / 2 and π / 2 <θ ≦ π) by a predetermined operation. Further, the increase / decrease amount of the parameter value may be changed in accordance with the slid distance. Also, parameters that can be set by the “slide” operation among volume, pitch, and playback speed by “hold” operation that keeps touching the finger after the slide operation or “tap” operation that touches the input device with your finger and immediately releases it. Any one of the remaining two except for the value may be set.

(Embodiment 11)
Next, a sound collecting device according to the eleventh embodiment will be described. The configuration is as shown in FIG. The appearance will be described with reference to FIG. As shown in FIG. 39 (a), the controller 100 has a cylindrical casing and includes an input unit 101 and a feedback presentation unit 105 on the outer surface. The user attaches the controller 100 to the wrist by a predetermined method, specifies the directivity of the hearing aid 107 by touching the input means 101 with the hand standing with the back of the hand facing forward, and pushes the input means 101. Set the volume value. The directivity can be specified in a total of eight directions, ie, the front, rear, left and right with the user at the center, and the middle four directions. As a result, the user can hear the sound in a range having a predetermined directional beam width centered on the designated direction at the set volume value.

  The input unit 101 includes a touch pad 3901 instead of the touch panel 106. The touch pad 3901 in the eleventh embodiment can detect the pressure P when touching in addition to the finger contact point coordinates (r, θ) as shown in FIG. r is a distance from the lower end of the touch pad 3901 to the contact point when the controller 100 is operated. θ is 0 in the forward direction and is in a range of −π <θ ≦ π (positive toward the front, the left side is positive, and the right side is negative).

  The feedback presentation means 105 is divided into two parts, an upper part and a lower part, than the input means 101. In the upper part, eight LEDs indicating the direction of directivity set in the hearing aid 107 are arranged at equal intervals on the cylindrical surface. In the lower part, three LEDs indicating the volume value set in the hearing aid 107 are arranged on the palm side.

The operation of the operation recognition unit 102 is as shown in FIG. The no-input-time process S403 is as shown in FIG. The input process S402 will be described with reference to FIG. First, in S4001, it is checked whether 1 is assigned to the variable S _touch indicating “whether or not it is already touched”. If the value of S _touch is 1, the process proceeds to S4003. If the value of S _touch is not 1, the process proceeds to S4002, where S _touch is set to 1, a variable S _press indicating that the input unit 101 is being pressed, and a variable C _press indicating that the touch operation has been changed to a push operation. Is initialized with 0, the contact timer is started, and the flow proceeds to S4003.

In S4003, the pressure P of the input means 101 is detected, check if the predetermined threshold value _{P th} or greater is judged to be a pushing operation. If P is less than or equal to _{P th,} the process proceeds to S4004. In _S4004, the value of _{S press} finishes not 1 _processing, the processing proceeds to S4005 if the value of _{S press} 1 to end the process by substituting 0 into _{S press.} P is the greater than _{P th} shifts to S4006 in S4003.

In S4006, it is checked whether or not the value of S _press is 0. If the value of S _press is not 0, it means that the pressing operation has already been performed, and the process is ended as it is. If the value of S _press is 0, the process proceeds to S4007. In S4007, it is checked whether or not the value of C _press is 0. If the value of C _press is 0, it is determined that it is a timing for transition from the touch operation to the push-in operation, and the process proceeds to S4008 where the recognition result of “touch” and the coordinate value (r _n , θ immediately before the push-in operation are performed). _n ) is output to the parameter value generating means 103, and the process proceeds to S4009. If the value of C _press is not 0, the process proceeds to S4009 because it has already transitioned from a touch operation to a push-in operation. In step S4009, the recognition result “press” is output to the parameter value generation unit 103, 1 is set in S _press , and the process ends.

Through these processes, a touch operation is performed from the time of no input, and when released, a recognition result of “touch” and a coordinate value are output. When an operation of pushing in from a touch operation is performed, a recognition result of “touch” and a coordinate value are output, and then a recognition result of “press” is output. Each time the operation of pushing in again is repeated, a recognition result of “press” is output. When the contact time of the finger by the touch operation is shorter than the predetermined threshold value t _tap , a recognition result “tap” is output.

Next, processing in the parameter value generation unit 103 will be described. When the recognition result “touch” and the coordinate value (r _n , θ _n ) are received from the operation recognition unit 102, the parameter value generation unit 103 uses θ _n to generate a parameter value θ _p representing directivity. θ _p is one of −3π / 4, −π / 2, −π / 4, 0, π / 4, π / 2, 3π / 4, π, which is a value indicating eight directions, of which θ _Let θ _p be the closest value of _n . For example, consider the case theta _n is -3 [pi] / 16, but this value is between - [pi] / 4 0, close to the - [pi] / 4 than 0, the theta _p is - [pi] / 4 Assigned. The θ _p thus obtained is output to the controller control means 104. When the recognition result “press” is received from the operation recognition unit 102, the parameter value generation unit 103 generates a volume parameter value to be sent to the hearing aid 107. Here, there are three volume parameter values of “small”, “standard”, and “large”, and every time the parameter value generation means 103 receives “press”, “large” → “small” → “standard” → “large” It is assumed that the volume parameter value is cyclically generated such as “→“ small ”→. When the parameter value generation unit 103 receives the recognition result “tap” from the operation recognition unit 102, it outputs a command to reset the parameter value setting of the hearing aid 107 to the controller control unit 104.

  Upon receiving the directivity and volume parameter values from the parameter value generation unit 103, the controller control unit 104 transmits them to the hearing aid 107. At the same time, the controller control means 104 outputs a feedback signal corresponding to the parameter value to the feedback presentation means 105. When receiving a command for resetting the parameter value setting from the parameter value generating unit 103, the controller control unit 104 transmits a command for initializing the parameter value setting to the hearing aid 107. At the same time, the controller control means 104 outputs a signal for initializing the presentation contents to the feedback presentation means 105.

  In FIG. 41, the content which the feedback presentation means 105 presents to a user is shown. The LED above the input means 101 indicates the direction of directivity set in the hearing aid 107. The LED below the input means 101 indicates the volume value set in the hearing aid 107. Only the leftmost LED is lit at the minimum volume, the middle LED is lit at the standard volume, and all LEDs are lit at the maximum volume. . The example of FIG. 41 shows that the maximum volume is set for the sound from the diagonally right rear (−3π / 4).

  As described above, the user can specify the directivity of the hearing aid 107 by touching the input unit 101 of the controller 100, and can set the volume value by pressing the input unit 101. In the eleventh embodiment, the sound volume designation from the designated direction has been described as an example. However, the parameter value that can be designated is not limited to the volume, and may be the pitch or the playback speed. In addition, the operation recognition unit 102 according to the eleventh embodiment outputs only the recognition result of “press” in response to the operation of pushing the input unit 11. May be output at the same time, and the parameter value generation means 103 may generate a parameter value in an amount corresponding to the coordinate value and the pressure value. Further, instead of designating the directivity direction by the touch operation, the hearing aid 107 is operated by touching with two fingers as shown in the second embodiment or by sliding operation in the θ direction as shown in the seventh embodiment. You may make it designate the listening range.

(Embodiment 12)
Next, a sound collecting device according to the twelfth embodiment will be described. The configuration is as shown in FIG. FIG. 42 is a diagram showing the external appearance of the controller 100. As shown in FIG. 42, the controller 100 is worn on the wrist and is positioned so that the front of the controller and the front of the user are aligned. The parameter value is adjusted and the setting value is fixed by pushing the input means 101. The volume can be specified in six levels. The minimum volume is specified as 0 level, the standard volume is specified as 3 levels, and the maximum volume is specified as 6 levels. In addition, the level of the sound can be specified in a standard state, two levels in the direction of increasing sound, two levels in the direction of decreasing sound, and five levels in total. The playback speed can be specified in three levels: “standard”, “slightly slow”, and “slow”.

  The input unit 101 includes a touch pad 4205 instead of the touch panel 106. The touch pad 4205 according to the twelfth embodiment can detect the pressure P when touched in addition to the finger contact point coordinates (r, θ) as described in the first embodiment.

  The feedback presentation unit 105 includes a peripheral portion 4201 of the input unit 101, left and right side portions 4202 and 4203 of the input unit 101, and a lower part 4204 of the input unit 101. 4201 indicates the directionality of the directivity set in the hearing aid 107, 4202 indicates the sound volume from the set direction, 4203 indicates the sound pitch from the set direction, and 4204 indicates the sound reproduction speed. 4201 to 4204 are constituted by liquid crystal display elements.

The operation of the operation recognition unit 102 is as shown in FIG. The input processing S402 will be described with reference to FIG. First, in S4301, it is checked whether 1 is assigned to the variable S _touch indicating “whether or not it is already touched”. If the value of S _touch is 1, the process proceeds to S4306. If the value of S _touch is not 1, the flow proceeds to S4302, where 1 is set in S _touch and 0 is set in the radial displacement dr and the circumferential displacement dθ. Further, the coordinate value at this time is stored as a coordinate initial value (r ₀ , θ ₀ ). Further, the contact timer is started, the non-contact timer is ended, and the process proceeds to S4303. In S4303, it is checked whether or not the finger non-contact time is smaller than a predetermined threshold t _input indicating whether or not the input is continued. If it is smaller than t _input , the process proceeds to S4304, and a value 1 indicating that input is in progress is _input to the variable S _input indicating the input state, and the process proceeds to S4306. If it is larger than t _input , the process proceeds to S4305, a value 0 indicating that input is not being performed is _input to the variable S _input indicating the input state, and the process proceeds to S4306.

In S4306, the absolute value | r _n of the radial direction difference r _n −r ₀ between the coordinate initial value (r ₀ , θ ₀ ) and the coordinate value (r _n , θ _n ) input n-th after being touched. -r 0 _| is, determine if the threshold value r _th greater than indicates whether the moved radially. If the threshold value r _th is not exceeded, then the flow shifts to S4310. If the threshold value r _th is exceeded, the flow shifts to S4307. In S4307, r _n −r ₀ is set to the radial displacement dr, the recognition result “dr” and “dr” are output to the parameter value generating unit 103, and the process proceeds to S4308.

In S4308, the pressure P of the input means 101 is detected, check if the predetermined threshold value _{P th} or greater is judged to be a pushing operation. If P is equal to or less than _Pth , the process ends. P is shifted to S4309 is greater than P _th, and outputs a recognition result of "radial sliding Enter", the variable radial movement 0 is substituted for dr to initialize, to coordinate the initial value r ₀ the process is terminated by substituting the latest coordinate value r _n.

In S4310, the absolute value of the angular difference θ _n −θ _{0 in} the circumferential direction between the coordinate initial value (r ₀ , θ ₀ ) and the nth coordinate value (r _n , θ _n ) input after touching | It is checked whether θ _n −θ ₀ | is greater than a threshold value θ _th indicating whether or not it has moved in the circumferential direction. If you do not exceed the threshold value θ _th, the process proceeds to S4314. If it exceeds the threshold θ _th shifts to S4311. However, when the movement from θ ₀ to θ _n crosses the rear (θ = π), the value of θ is discontinuous. In this case, the value of the angle difference is when θ ₀ > 0 and θ _n <0. is _{2π + (θ n -θ 0)} , θ 0 <0 cutlet theta _n> for _{0 -2π + (θ n -θ 0} ) is used. In S 4311, θ _n −θ ₀ (however, the above-mentioned value when moving across θ = π) is set in the circumferential displacement dθ, and the recognition result “d. In response, the process proceeds to S4312.

In S4312, the pressure P of the input means 101 is detected, check if the predetermined threshold value _{P th} or greater is judged to be a pushing operation. If P is equal to or less than _Pth , the process ends. P is shifted to S4313 is greater than P _th, and outputs a recognition result of "circumferential sliding Enter", the variable in the circumferential direction movement substitutes 0 into dθ to initialize, coordinate initial value θ _The latest coordinate value θ _n is substituted for ₀ , and the process is terminated.

In S4314, the pressure P of the input means 101 is detected, check if the predetermined threshold value _{P th} or greater is judged to be a pushing operation. If P is equal to or less than _Pth , the process ends. P is shifted to S4315 is greater than _{P th,} and outputs the recognition result and the coordinates value at this time of "touch" the _{(r n,} θ _n) relative to the parameter value generation unit 103, coordinate initial value _{(r 0} , Θ ₀ ) is assigned the latest coordinate value (r _n , θ _n ), and the process is terminated.

The no-input process S403 will be described with reference to FIG. In S4401, it is checked whether or not the value of S _touch is 1. If the value of S _touch is not 1, it means that the state where the finger is separated continues, and the processing is terminated as it is. When the value of S _touch is 1, the process proceeds to S4402, where S _touch is set to 0, the contact timer is stopped, the non-contact timer is started, and the process proceeds to S4403.

In S4403, it is checked whether the time from when the contact timer is started to when it is stopped, that is, whether the finger contact time is smaller than a predetermined threshold value t _tap . If the finger contact time is longer than t _tap , the flow shifts to S4404. In S4404, after substituting 0 for dr and dθ, they are output to the parameter value generating means 103. As a result, when the parameter value is not confirmed by pressing the input means 101 in the input process S402, the parameter value is reset to the value immediately before the setting or immediately after performing the parameter value confirming operation when the finger is released. It becomes possible. If the finger contact time is shorter than t _tap , the flow shifts to S4405. In S4405, it is checked whether or not the value of the variable S _input indicating the input state is 1. When the value of S _input is 1, it is determined that the input is continued, the process proceeds to S4406, the recognition result of “tap” is output to the parameter value generation unit 103, and the process is terminated. When the value of S _input is 0, it is determined that the operation has been touched without the intention of the user, and nothing is output and the process is terminated.

  Processing in the parameter value generation unit 103 will be described. The parameter value generation means 103 manages the parameter values by a variable Vol for storing the volume parameter value, a variable Pitch for storing the pitch parameter value, and a variable Speed for storing the playback speed parameter value. Immediately after the power is turned on or immediately after the parameter value is reset by a user operation, Vol = 3, Pitch = 0, and Speed = 0.

Upon receipt of the recognition result “touch” and the coordinate value (r _n , θ _n ) from the operation recognition unit 102, the parameter value generation unit 103 outputs θ _n as a parameter value representing directivity to the controller control unit 104. To do. However, if 0 <r _n <r _reset , the parameter value generation unit 103 substitutes Vol = 3, Pitch = 0, and Speed = 0 to reset the parameter value setting of the hearing aid 107, and the controller control unit 104 Output to.

  Upon receiving the recognition result “radial slide” and the radial displacement dr from the operation recognition unit 102, the parameter value generation unit 103 generates an increase / decrease value of the volume (however, when directivity is not set by the “touch” operation) Is not generated). In the twelfth embodiment, the quotient obtained by dividing dr by −R / 4 is used as the amount of increase / decrease in volume, and if the quotient is positive, the volume is increased, and if the quotient is negative, the volume is decreased. In other words, the volume is increased by the sliding operation toward the center, and the volume is decreased by the sliding operation toward the outer edge. Then, a value obtained by adding the volume increase / decrease amount to Vol is output to the controller control means 104 as a volume parameter value (however, if the result of adding the volume increase / decrease amount is smaller than 0 or larger than 6, it is not output). When the recognition result “diameter direction confirmation” is received from the operation recognition unit 102, the volume parameter value is determined by substituting the value obtained by adding the volume increase / decrease amount to Vol.

  Also, upon receiving the recognition result “circumferential slide” and the circumferential displacement dθ from the operation recognition unit 102, the parameter value generation unit 103 generates a pitch increase / decrease value (however, directing by the “touch” operation). Not generated if sex is not set). In the twelfth embodiment, the quotient obtained by dividing the circumferential displacement dθ by −π / 4 is used as the increase / decrease amount of the sound pitch. If the quotient is positive, the pitch is high, and if the quotient is negative. Reduce the pitch of the sound. In other words, the pitch is increased by a clockwise slide operation, and the pitch is decreased by a counterclockwise slide operation. Then, a value obtained by adding the pitch increase / decrease amount to the pitch is output to the controller control means 104 as a pitch parameter value (however, the pitch increase / decrease amount is smaller than −2 or larger than 2). If it does, do not output). When the recognition result of “circumferential slide confirmation” is received from the operation recognition means 102, the value obtained by adding the pitch increase / decrease amount to the pitch is substituted into the pitch, so that the pitch parameter value is set. Determine.

  When the parameter value generating unit 103 receives the recognition result “tap” from the operation recognizing unit 102, the playback speed parameter value of the hearing aid 107 is generated (however, it is not generated when the directivity is not set by the “touch” operation). And output to the controller control means 104. Here, there are three playback speed parameter values: “standard”, “slightly slow”, and “slow”. Each time the parameter value generation unit 103 receives “tap”, the playback speed parameter value is cyclically generated in the order of “standard” → “slightly slow” → “slow” → “standard” →.

  When the controller control unit 104 receives the parameter values of directivity, volume, pitch, and playback speed from the parameter value generation unit 103, the controller control unit 104 transmits them to the hearing aid 107. At the same time, the controller control means 104 outputs a feedback signal corresponding to the parameter value to the feedback presentation means 105.

  FIG. 45 shows the contents presented by the feedback presenting means 105 to the user. In the peripheral portion 4201 of the input means 101, the direction of directivity set by the user is displayed as a circular arc shape colored as shown in FIG. The set volume is displayed on the left side 4202 of the input means 101. When there are few colored parts among six steps, the volume is small, and when there are many parts, the volume is large. In the standard volume state, the color is displayed up to the third level. The set sound pitch is displayed on the right side 4203 of the input means 101. Of the five levels, the center is in the standard state, and two levels can be set for the higher sound level and two levels for the lower sound level. The set playback speed is displayed in the lower part 4204 of the input means 101. The displayed content is either “standard”, “slightly slow”, or “slow”. The example of FIG. 36 shows that the sound volume is set to the fourth level, the pitch is one level higher, and the playback speed is set to “slightly slow” with respect to the sound from the diagonally left front (π / 4). .

  As described above, the user can touch the input unit 101 to adjust the parameter values such as the directivity, volume, pitch, and playback speed of the hearing aid 107 and push the input unit 101 to confirm the set value. In the twelfth embodiment, the volume is set by the radial slide operation, the pitch is set by the circumferential slide operation, and the playback speed is set by the tap operation. However, the combination of the operation and the parameter value is not necessarily described here. It is not limited to those described in. In the twelfth embodiment, the direction of directivity of the hearing aid 107 is specified. However, the slide operation in the circumferential direction as shown in the fourth embodiment or two as shown in the fifth embodiment. You may make it designate the listening range of the hearing aid 107 by operation to touch with a finger. In addition, the operation recognition unit 102 according to the twelfth embodiment outputs only the recognition result of “circumferential slide confirmation” or “radial slide confirmation” for the operation of pushing the input unit 11. The coordinate value at the beginning of the tracing and the displacement in the circumferential direction or the radial direction may be output at the same time, and the parameter value generation means 103 may generate the parameter value in an amount corresponding to the coordinate value and the displacement. Furthermore, as described in the eighth embodiment, the volume, pitch, and playback speed may be set by touching with two fingers. In the eighth embodiment, the coordinate value at the time of the tap operation is not used, but the parameter value may be set using this coordinate value.

(Embodiment 13)
Next, a sound collecting device according to the thirteenth embodiment will be described. The configuration is as shown in FIG. The difference from the configuration in the above-described embodiment is that the azimuth sensor 4601 is combined with the input unit 101. The direction obtained by the direction sensor 4601 is sent to the parameter value generation unit 103. Also, the direction sensor 4602 is combined with the hearing aid 107, and the direction obtained by the direction sensor 4602 is sent to the parameter value generation unit 103.

FIG. 47 is a diagram showing the external appearance of the controller 100. As shown in FIG. 47 (a), the controller 100 is worn on the wrist, and the controller 100 is directed as shown in FIG. 47 (b), and the input means 101 is touched and pushed. Next, by tracing with a finger, the volume of the sound from the direction in which the controller 100 is directed is set. The volume can be specified in six levels. The minimum volume is specified as 0 level, the standard volume is specified as 3 levels, and the maximum volume is specified as 6 levels. In addition, the direction referred to herein is a relative direction from the direction of the user's head and the hearing aid 107, as shown in FIG. 47 (b) φ _d. The feedback presentation unit 105 includes a left side portion 4701 of the input unit 101 and a right side portion 4702 of the input unit 101. Reference numeral 4701 denotes a sound volume set in the hearing aid 107, and 4702 denotes a display for indicating the set direction. 4701 and 4702 are constituted by LEDs. 4702 lights when the controller is directed around the set direction.

  The touch pad 4603 of the input means 101 can detect the pressure P at the time of touching in addition to the coordinates (r, θ) of the position touched by the finger as shown in FIG. r is a distance from the boundary line between the touch pads 4603 and 4701 to the contact point when the controller 100 is operated. However, in the thirteenth embodiment, the value of r is not used. As shown in FIG. 47 (a), θ is 0 at the top when the controller 100 is mounted, and is in a range of −π <θ ≦ π (a direction approaching the user is positive and a direction away from the user is negative).

The operation of the operation recognition unit 102 is as shown in FIG. The input processing S402 will be described with reference to FIG. First, in S4801, it is checked whether 1 is assigned to the variable S _touch indicating “whether or not already touched”. If the value of S _touch is 1, then the flow shifts to S4803. If the value of S _touch is not 1, then the flow shifts to S4802. In S4802, S _touch is set to 1, variable S _dir indicating “whether or not directivity is set” is set to 0, and circumferential displacement dθ is set to 0. Further, the coordinate value θ at this time is stored as the coordinate initial value θ ₀ .

In S4803, the absolute value | θ _n −θ ₀ | of the circumferential angle difference θ _n −θ ₀ between the initial coordinate value θ ₀ and the nth input coordinate value θ _n after the touch is determined as the circumference. It is checked whether or not it is larger than a threshold value _θth indicating whether or not it has moved in the direction. If you do not exceed the threshold value θ _th, the process proceeds to S4807. If it exceeds the threshold θ _th to migrate to the S4804. However, when the movement from θ ₀ to θ _n crosses the rear (θ = π), the value of θ is discontinuous. In this case, the value of the angle difference is when θ ₀ > 0 and θ _n <0. is _{2π + (θ n -θ 0)} , θ 0 <0 cutlet theta _n> for _{0 -2π + (θ n -θ 0} ) is used. In S4804, θ _n −θ ₀ (in the case of movement across θ = π) is set as the circumferential displacement dθ, dθ is output to the parameter value generation unit 103, and the process is terminated.

In S4805, the pressure P of the input means 101 is detected, check if the predetermined threshold value _{P th} or greater is judged to be a pushing operation. If P is equal to or less than _Pth , the process ends. P is shifted to S4806 is greater than _{P th,} and outputs a recognition result of "press" for the parameter value generation unit _103, and ends the processing by substituting 1 to _{S dir.}

The no-input process S403 will be described with reference to FIG. In S4901, it is checked whether or not the value of S _touch is 1. If the value of S _touch is not 1, it means that the state where the finger is separated continues, and the processing is terminated as it is. If the value of S _touch is 1, the process proceeds to S4902, the S _touch is set to 0, the contact timer is stopped, and the process proceeds to S4903.

In S4903, it is checked whether the time from when the contact timer is started until it is stopped, that is, whether the contact time of the finger is smaller than a predetermined threshold value t _tap . If the finger contact time is longer than t _tap , the flow shifts to S4904. In S4904, it is checked whether or not the value of S _dir is 1. If the value of S _dir is not 1, the process proceeds to S 4905, where the recognition result “touch” is output to the parameter value generation unit 103, and the process ends. If the value of S _dir is 1, the process proceeds to S4906, where the recognition result “volume confirmation” is output to the parameter value generation unit 103, and the process ends. If the contact time of the finger is shorter than t _{tap in} S4903, the process proceeds to S4907, and the recognition result “tap” is output to the parameter value generating unit 103, and the process is terminated.

  Processing in the parameter value generation unit 103 will be described. The parameter value generation unit 103 manages the parameter value using a variable Vol that stores the volume parameter value. The value of Vol is 3 immediately after the power is turned on or immediately after the parameter value is reset by a user operation.

Upon receiving the recognition result of “press” and the orientation of the controller from the operation recognition means 102, the parameter value generation means 103 determines the value of the orientation sensor 4601 (controller orientation) and the value of the orientation sensor 4602 (azimuth of the hearing aid 107). Then, the controller direction φ _d is determined, and is output to the controller control means 104 as a parameter value of the directivity direction. When the circumferential direction displacement dθ is received from the operation recognizing unit 102, the parameter value generating unit 103 generates an increase / decrease value of the volume (however, it is not generated when the direction of directivity is not fixed). In this thirteenth embodiment, the quotient obtained by dividing the circumferential displacement dθ by π / 8 is used as the amount of increase / decrease in volume, and if the quotient is positive, the volume is increased, and if the quotient is negative, the volume is decreased. In other words, the volume is increased by a forward slide operation, and the volume is decreased by a reverse slide operation. Then, a value obtained by adding the volume increase / decrease amount to Vol is output to the controller control means 104 as a volume parameter value (however, if the value of Vol has already reached 0 or 6, adding the volume increase / decrease amount also outputs Vol). If not) When receiving the recognition result “sound volume confirmation” from the operation recognition unit 102, the parameter value generation unit substitutes a value obtained by adding the volume increase / decrease amount to Vol. Upon receiving the recognition result “touch” from the operation recognition unit 102, the parameter value generation unit outputs a command to reset the directivity and volume to the controller control unit 104 in order to reset the volume setting set in the hearing aid 107. Substitute 3 for Vol. When the parameter value generating unit 103 receives the recognition result “tap” from the operation recognizing unit 102, it is determined that the operation has been touched without the intention of the user, and the process ends without outputting anything.

When receiving the directivity and volume parameter values from the parameter value generating unit 103, the controller control unit 104 transmits the parameter values to the hearing aid 107 and outputs a feedback signal corresponding to the parameter value to the feedback presentation unit 105. Thereafter, when the direction of the controller obtained from the orientation of the controller and the orientation of the hearing aid 107 becomes φ _d , a feedback signal for direction presentation is output to the feedback presentation means 105. When receiving a command for resetting the parameter value setting from the parameter value generating unit 103, the controller control unit 104 transmits a command for initializing the parameter value setting to the hearing aid 107. At the same time, the controller control means 104 outputs a signal for initializing the presentation contents to the feedback presentation means 105.

FIG. 50 shows the contents presented by the feedback presenting means 105 to the user. The set volume is displayed on the left side 4701 of the input means 101. When there are few colored parts among six steps, the volume is small, and when there are many parts, the volume is large. In the standard volume state, the color is displayed up to the third level. Right portion 4702 of the input unit 101, when the signal direction presented by the controller control unit 104 is input, that is turned only when the direction of the controller is phi _d. Thereby, when the user moves his / her arm to confirm the currently set directivity, it can be known that the direction of the controller when lit is the directivity direction.

  Thus, the user can set the directivity and volume parameter values of the hearing aid 107 by touching and pressing the input means 101 with a finger and then tracing with the finger. Although the sound volume setting from the designated direction has been described as an example in the thirteenth embodiment, the parameter value that can be set other than the direction is not limited to the sound volume, and may be a pitch or a playback speed. In the thirteenth embodiment, one of the parameter values of volume, pitch, and playback speed is set by the “cylindrical slide” operation. However, it is set by the “axial slide” operation. It may be. Further, by recognizing both “cylindrical slide” and “axial slide”, any two parameter values of volume, pitch, and playback speed may be set. Further, by recognizing the “tap” operation, one of the remaining parameter values excluding the parameter value set by “cylindrical slide” or “axial slide” may be set. In addition, the operation recognition unit 102 according to the thirteenth embodiment outputs only the recognition result “press” for the operation of pushing the input unit 11. May be output at the same time, and the parameter value generation means 103 may generate a parameter value in an amount corresponding to the coordinate value and the pressure value.

  Furthermore, in the thirteenth embodiment, both the controller 100 and the hearing aid 107 are provided with the orientation sensor, and the parameter value of the directivity is set using the relative direction thereof. And the listening range may be set according to the angular range when the user moves while touching the input means of the controller 100. In this case, there is an advantage that only one azimuth sensor is required. In this case, parameter values such as volume, pitch, and playback speed may be set by combining the operations of “cylindrical slide”, “axial slide”, “tap”, “press”, and “hold”. Good.

(Embodiment 14)
Next, a video display device according to the fourteenth embodiment will be described. As shown in FIG. 51, a video display device 5101 as a video display means has the shape of a head-mounted display, and has a function of reproducing video stored inside or outside. The video is obtained by projecting a moving image or a still image captured by the omnidirectional camera onto the virtual cylindrical surface 5102. The user can see an image in an arbitrary direction from the center of the cylinder by wearing the video display device 5101 on the head and touching the surface of the input means 101 of the controller 100 worn on the arm with a finger. The image can be enlarged (up to 5 times) by pressing the input unit 101 with a finger. The configuration of the controller 100 is as shown in FIG. 52 and the appearance is as shown in FIG. Visual feedback for the user's operation is performed by the video display device 5101.

  The input unit 101 includes a touch pad 5103. In addition to outputting the coordinates of the contact point of the finger as a value (r, θ) in the circular coordinate system, the touch pad 5103 can detect and output the pressure P at the time of contact.

  The operation recognition unit 102 will be described. The operation of the operation recognition unit 102 is as shown in FIG. When the operation recognizing unit 102 starts operation, it checks whether or not a coordinate value is input from the input unit 101 to the input buffer in S5301. If there is an input of coordinate values, the process proceeds to S5302, where the finger contact point coordinates (r, θ) and the pressure P at the time of contact are output to the parameter value generating unit 103, and the process returns to S5301. If no coordinate value is input, the process returns to S5301 again.

The parameter value generation unit 103 will be described. FIG. 54 shows the relationship between the value P received from the operation recognition unit 102 and the value of the variable Z representing the enlargement magnification. When the value of P is smaller than the predetermined threshold value P _low , the enlargement magnification remains the same magnification. In this case, the parameter value generation unit 103 outputs (L / 2, θ) as the center point coordinates of the display image and 1 to the controller control unit 104 as the value of the variable Z representing the enlargement magnification. Here, the center point coordinates of the display image are coordinates on the virtual cylindrical surface 5102 and are represented by (d, θ) as shown in FIG. d is a distance from the lower end of the virtual cylindrical surface, and its value is in a range from 0 to L. When the value of P is in the range from the predetermined threshold value P _low to the predetermined threshold value P _high , the pressure P and the magnification Z are in a linear relationship. In this case, the parameter value generation means 103 uses (rL / R, θ) as the center point coordinates of the display image and 1 + 4 (P−P _low ) / (P _high −P _low ) as the value of the enlargement magnification Z. It outputs to 104 (R is the radius of the input means 101). The closer the radial coordinate value r of the finger contact point is to the center, the lower the center coordinate of the display image is in the lower part of the virtual cylindrical surface 5102. The closer the value of r is to the outer edge, the virtual center coordinate of the display image is. It is the upper side of the cylindrical surface 5102. When the value of P is larger than a predetermined threshold value P _high , the enlargement magnification is 5 which is the upper limit. In this case, the parameter value generation unit 103 outputs (rL / R, θ) as the center point coordinates of the display image and 5 as the value of the enlargement magnification Z to the controller control unit 104.

  When the controller control unit 104 receives the center coordinate value and the enlargement magnification value of the display image from the parameter value generation unit 103 and receives the parameter value of the volume, the controller control unit 104 transmits them to the video display device 5101.

  The visual feedback for the user operation will be described. 5501 of FIG. 55 shows the screen displayed on the video display apparatus 5101. A video is displayed in the video display area 5502. As shown in FIG. 55, there are a direction display area 5503 and an enlargement magnification display area 5504 on the right side of the video display area 5502. The direction display area 5503 roughly indicates in which direction the image displayed in the video display area 5502 is centered on the user and which part of the omnidirectional image is displayed. An enlargement magnification display area 5504 shows the currently set enlargement magnification in a scale.

  FIG. 56 shows the display contents of the direction display area 5503 and the correspondence with the virtual cylindrical surface 5102. The direction display area 5503 includes two concentric circles, an arrow indicating the direction designated by the user, and an area 5601 indicating the image area currently displayed in the video display area 5502 on the virtual cylindrical surface 5102. When the enlargement magnification is 1, the region 5601 is drawn to the outer edge of the outer circle as shown in FIG. When the enlargement magnification is greater than 1 and less than or equal to 5, the region 5601 is drawn between the circumferences of two concentric circles (which may touch either circumference). The larger the area 5601 is, the closer the magnification is to 1, and the smaller the area 5601 is, the closer the magnification is to 5. As shown in FIG. 56 (b), the region 5601 is closer to the outer circumference, and the upper portion of the virtual cylindrical surface 5102 is enlarged. As shown in FIG. 56 (c), the region 5601 is closer to the center of the circle. A cylindrical surface 5102 indicates that the lower part is enlarged.

  As described above, by touching the surface of the input unit 101 of the controller 100 with a finger, it is possible to designate and view an arbitrary direction of the omnidirectional video, and to enlarge and view the image by pressing the input unit 101 with a finger. Can do. In the fourteenth embodiment, the enlargement factor of the image is described as an example of the parameter value that can be specified by pressing the input unit 101 with a finger. However, the parameter value that can be specified is not limited to the enlargement factor, but the brightness and contrast of the image. Also good. In the fourteenth embodiment, the parameter value of the enlargement magnification is set by the pressure with which the input unit 101 is pushed with the finger. However, the direction, the enlargement magnification, the brightness of the image, and the contrast are determined only by the coordinate value of the contact point of the finger. Any one of the parameter values may be set.

  The sound collection device according to the present invention is a parameter value of directivity and directional beam width set in the sound collection device by continuously performing an operation of touching or tracing the controller with one or more fingers. Since at least one parameter value among the volume, pitch, and playback speed can be set by one input means, it is useful as a sound collection device that excels in intuitive operation.

DESCRIPTION OF SYMBOLS 100 Controller 101 Input means 102 Operation recognition means 103 Parameter value generation means 104 Controller control means 105 Feedback presentation means 106 Touch panel 107 Hearing aid 5101 Video display device 5102 Virtual cylindrical surface 5501 Video display device screen 5502 Video display area 5503 Direction display area 5504 Enlargement magnification Indicated Area

Claims (55)

A sound collecting means for collecting sound in an arbitrary direction around the user, and a controller for controlling the sound collecting means,
The controller includes input means for receiving input from a user;
Operation recognition means for recognizing an input obtained by the input means as an operation;
Parameter value generation means for generating one or more parameter values from the recognition result obtained from the operation recognition means;
And a controller control means for transmitting the one or more parameter values to the sound collection means. A feedback presenting means for presenting feedback to the user according to the user input;
The controller control means generates a feedback signal using the one or more parameter values;
The sound collection device according to claim 1, wherein the feedback presentation unit presents feedback according to the feedback signal to a user. The sound collection device according to claim 2, wherein the feedback is any one of light, sound, vibration, or a combination thereof. The input means includes an input device that outputs a place touched by one or more fingers of the user as one or more coordinate values;
The sound collection device according to claim 1, wherein the operation recognizing unit recognizes one or more operations using time series information of one or more coordinate values obtained from the input unit. . The sound collection device according to claim 4, wherein the input device is a touch pad or a touch panel. The operation is
“Touch” touching the input device with one finger for longer than a first reference time;
“Multi-touch”, in which the input device is touched with two fingers for longer than the first reference time;
A “tap” that touches the input device with one finger for less than a first reference time;
“Circumferential slide” in which the input device is traced with one finger in the circumferential direction of the circular coordinate system;
“Radial slide” in which the input device is traced with one finger in the radial direction of the circular coordinate system;
Either
The sound collection device according to claim 4, wherein the recognition result is a type of the operation and an operation amount corresponding to the type. The operation amount is
If the operation is “touch”, the coordinate value of the point touched by one finger,
If the operation is “multi-touch”, the coordinate values of two points touched by two fingers,
If the operation is “tap”, the coordinate value of the point touched by one finger,
If the operation is “circumferential slide”, the coordinate value and the circumferential displacement at the start of tracing
When the operation is “radial slide”, the coordinate value and radial displacement at the start of tracing
The sound collecting device according to claim 6, wherein the sound collecting device is a sound collecting device. The parameter value generating unit is configured to obtain a directivity parameter value to be set for the sound collection device based on the recognition result obtained from the operation recognition unit, and at least one parameter value of volume, pitch, and playback speed. The sound collecting device according to claim 1, wherein the sound collecting device is generated. 9. The storage according to claim 8, wherein one of the directivity parameter value and the parameter value of volume, pitch, and playback speed is set based on an operation amount of the “touch”. Sound equipment. 9. The storage according to claim 8, wherein one of the directivity parameter value and the parameter value of volume, pitch, and playback speed is set based on an operation amount of the “tap”. Sound equipment. The directivity parameter value is set based on the operation amount of the “touch” of the first operation,
9. The sound collection according to claim 8, wherein any one of the volume, pitch, and playback speed is set based on an operation amount of the “multi-touch” of the second operation. machine. The directivity parameter value is set based on the operation amount of the “touch” of the first operation,
The parameter value of any one of volume, pitch, and playback speed is set based on an operation amount of the second and subsequent “tap” continuous operations. Sound equipment. 9. The directivity parameter value and any one of volume, pitch, and playback speed are set based on an operation amount of the “circumferential slide”. The sound collecting device described. 9. The directivity parameter value and any one of volume, pitch, and playback speed are set based on an operation amount of the "radial slide". Sound collection equipment. The directivity parameter value is set based on the operation amount of the “circumferential slide” of the first operation,
One of the two parameter values of volume, pitch, and playback speed is set based on the operation amount of the “circumferential slide” of the first and subsequent operations, and the other is the second and subsequent parameters. The sound collecting device according to claim 8, wherein the sound collecting device is set based on an operation amount of the "radial slide" of the operation. The directivity parameter value is set based on an operation amount of the “radial slide” of the first operation,
One of the two parameter values of volume, pitch, and playback speed is set based on the operation amount of the “radial slide” of the first and subsequent operations, and the other is the second and subsequent operations. The sound collecting device according to claim 8, wherein the sound collecting device is set based on an operation amount of the “circumferential slide”. The parameter value generating means is based on the recognition result obtained from the operation recognizing means, and includes at least a parameter value of directivity and directional beam width set in the sound collection device, and volume, pitch, and reproduction speed. The sound collecting device according to claim 1, wherein one parameter value is generated. The parameter value of the directivity and the directional beam width, and any one parameter value among volume, pitch, and playback speed are set based on the operation amount of the “multi-touch”. Item 18. The sound collecting device according to Item 17. The parameter values of the directivity and the directional beam width are set based on the operation amount of the “multi-touch” of the first operation,
The parameter value of any one of volume, pitch, and playback speed is set based on an operation amount of the second and subsequent “tap” continuous operations. Sound equipment. The parameter values of the directivity and the directional beam width are set based on the operation amount of the “circumferential slide” of the first operation,
The parameter value of any one of volume, pitch, and playback speed is set based on an operation amount of the “radial slide” of a second operation. Sound equipment. The parameter values of the directivity and the directional beam width are set based on the operation amount of the “circumferential slide” of the first operation,
The parameter value of any one of volume, pitch, and playback speed is set based on an operation amount of the second and subsequent “tap” continuous operations. Sound equipment. The parameter values of the directivity and the directional beam width are set based on the operation amount of the “multi-touch” of the first operation,
18. The parameter value of any one of volume, pitch, and playback speed is set based on an operation amount of the “circumferential slide” of a second operation. Sound collection equipment. The parameter values of the directivity and the directional beam width are set based on the operation amount of the “multi-touch” of the first operation,
The parameter value of any one of volume, pitch, and playback speed is set based on an operation amount of the “radial slide” of a second operation. Sound equipment. The parameter values of the directivity and the directional beam width are set based on the operation amount of the “multi-touch” of the first operation,
One of the two parameter values of volume, pitch, and playback speed is set based on the operation amount of the “circumferential slide” of the second and subsequent operations, and the other is the second and subsequent parameters. The sound collecting device according to claim 17, wherein the sound collecting device is set based on an operation amount of the "radial slide" of the operation. The input device further detects pressure when a finger touches,
The operation includes a “press” in which the input device is pushed with a finger at a pressure value higher than a predetermined pressure value,
When the operation is “press”, the operation amount of the recognition result includes the coordinate value of the point touched by the finger and the pressure value pressed by the finger,
The parameter value of any one of volume, pitch, and playback speed is set based on an operation amount of the “press” instead of the “tap”. 21. The sound collecting device according to 21. The input device further detects pressure when a finger touches,
The operation is performed by tracing the input device in the circumferential direction of the circular coordinate system with one finger, and pressing the input device with a finger at a pressure value higher than a predetermined pressure value when the tracing is finished. Including
When the operation is “circumferential slide confirmation”, the operation amount of the recognition result includes a coordinate value at the start of tracing, a circumferential displacement, and a pressure value,
The parameter value of any one of volume, pitch, and playback speed is set based on an operation amount of the “circumferential slide confirmation” instead of the “circumferential slide”. Item 13. The sound collecting device according to 13, 15, 16, 20-22, or 24. The input device further detects pressure when a finger touches,
The operation includes "diameter slide confirmation" in which the input device is traced in the radial direction of the circular coordinate system with one finger, and the input device is pushed with a finger at a pressure value higher than a predetermined pressure value at the point where the tracing is completed,
When the operation is “radial slide confirmation”, the operation amount of the recognition result includes a coordinate value at the start of tracing, a radial displacement, and a pressure value,
15. The parameter value of any one of volume, pitch, and playback speed is set based on an operation amount of the “radial slide confirmation” instead of the “radial slide”. ~ 16, 20, 23, 24. The operation further includes a “hold” that keeps touching the input device with a single finger for a longer period than the second reference time at the point where the operation or the tracing operation is finished.
When the operation is “hold”, the operation amount of the recognition result includes a coordinate value and a displacement of a point that is continuously touched with a finger,
The parameter value of any one of volume, pitch, and playback speed is set based on an operation amount of the “hold” instead of the “tap”. 21. The sound collecting device according to 21. 5. The sound collection device according to claim 4, wherein the input unit further includes a first direction sensor that detects a direction in which the controller is directed and sends the detected direction to the parameter value generation unit. 30. The sound collection device according to claim 4, 29, wherein the input device is a cylindrical touch pad or a touch panel. The operation is
“Touch” touching the input device with one finger for longer than a first reference time;
A “tap” that touches the input device with one finger for less than a first reference time;
“Cylindrical slide” in which the input device is traced with one finger in the cylindrical direction of the cylindrical coordinate system;
“Axial slide” in which the input device is traced with one finger in the axial direction of the cylindrical coordinate system;
Either
31. The sound collection device according to claim 30, wherein the recognition result is a type of the operation, an operation amount corresponding to the type, and direction information of the first direction sensor. The operation amount is
If the operation is “touch”, the coordinate value of the point touched by one finger,
If the operation is “tap”, the coordinate value of the point touched by one finger,
When the operation is “cylindrical slide”, the coordinate value at the start of tracing and the displacement in the cylindrical direction,
When the operation is “sliding in the axial direction”, the coordinate value and the axial displacement at the start of the tracing,
32. The sound collecting device according to claim 31, wherein the sound collecting device is a sound collecting device. The parameter value generating means is based on the recognition result obtained from the operation recognizing means, and includes at least a parameter value of directivity and directional beam width set in the sound collection device, and volume, pitch, and reproduction speed. The sound collecting device according to claim 1, wherein one parameter value is generated. The parameter values of the directivity and the directional beam width are set based on the azimuth displacement of the azimuth information of the first azimuth sensor while the first operation is the “touch”.
The parameter value of any one of volume, pitch, and playback speed is set based on an operation amount of the “cylindrical slide” of the second operation. Sound equipment. The parameter values of the directivity and the directional beam width are set based on the azimuth displacement of the azimuth information of the first azimuth sensor while the first operation is the “touch”.
The parameter value of any one of volume, pitch, and playback speed is set based on an operation amount of the “sliding in the axial direction” of the second operation. Sound equipment. The parameter values of the directivity and the directional beam width are set based on the azimuth displacement of the azimuth information of the first azimuth sensor while the first operation is the “touch”.
One of the two parameter values of volume, pitch, and playback speed is set based on the operation amount of the “cylindrical slide” of the second and subsequent operations, and the other parameter value of the second and subsequent operations. 34. The sound collecting device according to claim 33, wherein the sound collecting device is set based on an operation amount of the "axial slide". The input means detects the azimuth that the sound collection device is facing and sends it to the parameter value generation means; and the input means detects the azimuth that the controller faces and sends it to the parameter value generation means. The sound collection device according to claim 4, further comprising two azimuth sensors. 38. The sound collecting device according to claim 4, wherein the input device is a cylindrical touch pad or a touch panel, and detects pressure when a finger touches the input device. The operation is
“Touch” touching the input device with one finger for longer than a first reference time;
A “tap” that touches the input device with one finger for less than a first reference time;
“Circumferential slide” in which the input device is traced with one finger in the circumferential direction of the cylindrical coordinate system;
“Axial slide” in which the input device is traced with one finger in the axial direction of the cylindrical coordinate system;
“Pressing” the input device with a finger at a pressure value higher than a predetermined pressure
Either
39. The sound collection device according to claim 38, wherein the recognition result is a type of the operation, an operation amount corresponding to the type, and direction information of the first and second direction sensors. The operation amount is
If the operation is “touch”, the coordinate value of the point touched by one finger,
If the operation is “tap”, the coordinate value of the point touched by one finger,
When the operation is “cylindrical slide”, the coordinate value at the start of tracing and the displacement in the cylindrical direction,
When the operation is “sliding in the axial direction”, the coordinate value and the axial displacement at the start of the tracing,
40. The sound collecting device according to claim 39, wherein when the operation is “press”, the coordinate value of the point touched by the finger and the pressure value pushed by the finger are used. The parameter value generating unit is configured to obtain a directivity parameter value to be set for the sound collection device based on the recognition result obtained from the operation recognition unit, and at least one parameter value of volume, pitch, and playback speed. The sound collecting device according to claim 1, wherein the sound collecting device is generated. The directivity parameter value is set based on a difference between an operation amount of the “press” of the first operation and orientation information obtained from the first and second orientation sensors,
40. The parameter value of any one of volume, pitch, and playback speed is set based on the operation amount of the “cylindrical slide” of the second operation. The sound collection device according to ~ 43. The directivity parameter value is set based on a difference between an operation amount of the “press” of the first operation and orientation information obtained from the first and second orientation sensors,
The parameter value of any one of volume, pitch, and playback speed is set based on an operation amount of the “sliding in the axial direction” of a second operation. Sound equipment. The directivity parameter value is set based on a difference between an operation amount of the “press” of the first operation and orientation information obtained from the first and second orientation sensors,
One of the two parameter values of volume, pitch, and playback speed is set based on the operation amount of the “cylindrical slide” of the second and subsequent operations, and the other is the second and subsequent operations. 43. The sound collecting device according to claim 42, wherein the sound collecting device is set based on an operation amount of the "radial slide". Further, based on the operation amount of the “tap”, one of the remaining parameters excluding the parameter value set by the “cylindrical slide” or the “radial slide” among the volume, pitch, and playback speed 45. The sound collecting device according to claim 34, wherein a value is set. The input device is a touch pad or a touch panel that outputs coordinate values of an orthogonal coordinate system,
The operation is a “slide” in which the input device is traced with one finger,
When the operation is “slide”, the operation amount of the recognition result is a coordinate value at the start of tracing and a coordinate value at the end of tracing,
The parameter value generation means generates one of a directivity parameter value set for the sound collection device and a volume, pitch, and playback speed based on the operation amount of the “slide”. The sound collecting device according to claim 1, wherein: The operation further includes a “hold” in which the finger is touched for a period longer than a second reference time in that the input device has been traced with one finger.
When the operation is “hold”, the operation amount of the recognition result includes a coordinate value of a point that is continuously touched with a finger,
The parameter value generation unit sets one of the remaining parameter values excluding the parameter value set by the operation amount of the “slide” based on the operation amount of the “hold”. The sound collection device according to claim 46. The operation further includes a “tap” that touches the input device with one finger for a time shorter than the first reference time,
When the operation is “tap”, the operation amount of the recognition result is a coordinate value of a point touched by one finger,
The parameter value generation means sets one of the remaining parameter values excluding the parameter value set by the operation amount of the “slide” based on the operation amount of the “tap”. The sound collection device according to claim 46. Video display means for displaying video in any direction around the user, and a controller for controlling the video display means,
The controller includes input means for receiving input from a user;
Parameter value generating means for generating one or more parameter values from the information obtained from the input means;
A video display device comprising controller control means for transmitting the one or more parameter values to the video display means. A feedback presenting means for presenting feedback to the user according to the user input;
The controller control means generates a feedback signal using the one or more parameter values;
50. The video display device according to claim 49, wherein the feedback presentation unit presents feedback corresponding to the feedback signal to a user. 51. The sound collection device according to claim 50, wherein the feedback is one of light, sound, vibration, or a combination thereof. 52. The video display device according to claim 49, wherein the input unit includes an input device that outputs a place touched by one finger of the user as one coordinate value. 53. The video display device according to claim 52, wherein the input device is a touch pad or a touch panel. The parameter value generation unit generates a parameter value in a direction to be set in the video display device based on the coordinate value obtained from the input unit, and any one of a magnification value, brightness volume, and contrast. 54. The video display device according to claim 49, wherein: The input device further detects the pressure when the finger touches and outputs it as a pressure value,
The parameter value generating means generates a parameter value of a direction to be set in the video display device based on the coordinate value obtained from the input means,
54. The video display device according to claim 49, wherein any one of a parameter value among an enlargement magnification, a brightness volume, and a contrast is generated based on the pressure value.

Images