JP2014092990A - Information input device and voice output method therefor - Google Patents

Abstract

PROBLEM TO BE SOLVED: To provide an information input device capable of allowing a user to intuitively perceive operation contents of a pointing device by voice, and a voice output method therefor.SOLUTION: The information input device comprises: a pointing device having a touch surface and outputting a detection result corresponding to a user operation on the touch surface; stereophonic speaker outputting voice; and voice control means controlling the voice output from the stereophonic speaker on the basis of the detection result.

Description

  The present invention relates to an information input device and an audio output method thereof.

  In general, notebook computers use various pointing devices as input devices in addition to a keyboard and the like. These pointing devices are mainly used to move a pointer (mouse cursor) on the screen and perform processing related to the position of the pointer.

  Of these, the touchpad device detects the position of the capacitor consisting of a flat sensor and a human finger on the sensor surface as a weak change in capacitance, and traces the sensor surface. The locus of the finger is associated with the movement of the pointer on the screen. Some recent touch pad devices have a click function, a wheel function, and a multi-touch function.

  As described above, many touch pad devices have a large number of functions, and skill is required to use a plurality of functions. In the current touchpad device, for example, when the user clicks on the touchpad device, it is not possible to intuitively determine whether the user clicked correctly. In addition, when the user touches the touchpad during a keyboard operation and the user performs an unintentional click operation or when the user moves the pointer with the touchpad device, the user performs the click operation unintentionally. There is a case. That is, since the user cannot intuitively recognize the operation content with respect to the touchpad device, the user cannot immediately recognize whether the operation has been performed correctly or an erroneous operation.

WO2010 / 138288A2 JP-A-9-34392 JP 2003-6132 A

  The present invention has been made in view of the above, and an object of the present invention is to provide an information input device and an audio output method thereof that allow a user to intuitively recognize the operation content of a pointing device by voice.

  In order to solve the above-described problems and achieve the object, the present invention has a touch surface, a pointing device that outputs a detection result according to a user operation on the touch surface, a stereo speaker that outputs sound, Voice control means for controlling the voice output of the stereo speaker based on the detection result.

  Further, according to a preferred aspect of the present invention, it is desirable that the sound control means changes a sound volume output from the stereo speaker according to a position of the touch surface operated by the user.

  Further, according to a preferred aspect of the present invention, the pointing device has a left / right click function, and the voice control means is configured to perform a left click operation on the pointing device when the left click operation is performed. When a click sound is output from the speaker and a right click operation is performed with the pointing device, it is desirable to output a click sound from the right speaker of the stereo speaker.

  According to a preferred aspect of the present invention, it is desirable that the pointing device is a touch pad device.

  According to a preferred aspect of the present invention, it is desirable that the pointing device includes a pressure detection unit that detects a pressing force with respect to the touch surface.

  In order to solve the above-described problems and achieve the object, the present invention provides an audio input method for an information input device including a pointing device having a touch surface and a stereo speaker for outputting audio, wherein the pointing device includes: A step of outputting a detection result corresponding to a user operation on the touch surface; and a step of controlling sound output of the stereo speaker based on the detection result.

  According to the present invention, it is possible to provide an information input device that allows a user to intuitively recognize the operation content of a pointing device by voice.

FIG. 1 is a schematic external view of a notebook PC to which an information processing apparatus according to an embodiment is applied. FIG. 2 is a diagram illustrating a schematic hardware configuration example of the notebook PC of FIG. FIG. 3 is a schematic diagram illustrating a functional configuration related to the touchpad sound output process. FIG. 4 is a diagram for explaining an example of the relationship between the function setting area of the touchpad device and the signal levels of the left signal and the right signal. FIG. 5 is a diagram for explaining another example of the relationship between the function setting area of the touchpad device and the signal levels of the left signal and the right signal. FIG. 6 is a diagram for explaining another example of the relationship between the function setting area of the touchpad device and the signal levels of the left signal and the right signal.

(Embodiment)
Embodiments of an information input device and an audio output method according to the present invention will be described below in detail with reference to the drawings. Note that the present invention is not limited to the embodiments. In addition, constituent elements in the following embodiments include those that can be easily assumed by those skilled in the art or that are substantially the same.

  FIG. 1 is a schematic external view of a notebook PC to which an information input device according to an embodiment is applied. As shown in FIG. 1, the notebook PC 1 according to the present embodiment includes a main body side housing 2 and a display side housing 3 which are substantially rectangular parallelepipeds. The main body side housing 2 and the display side housing 3 are connected to each other by a pair of left and right connecting portions (hinge portions) 4a and 4b at the respective end portions, and the connecting portions 4a and 4b open and close these housings. Supports freely.

  The display-side housing 3 includes a display device 5 that displays various types of information in response to commands from the main body-side housing 2. The main body side housing 2 includes an input unit 6 having a keyboard 7 and a touch pad device 8 on the upper surface thereof. The main body side housing 2 includes a left speaker 9a and a right speaker 9b (stereo speakers) on the left and right sides of the keyboard 7 so that stereo sound can be output.

  The touch pad device 8 includes, for example, a capacitive touch pad and a pressure detection unit, and has a configuration capable of detecting the touch position (X, Y) and the touch pressure (P). The touch pad device 8 has various functions, such as a pointer movement function, a right click function, a left click function, and a wheel function.

  As described above, since the user cannot intuitively recognize the operation content with respect to the touch pad device, it is difficult to immediately recognize whether the operation has been performed correctly or an erroneous operation. Therefore, in the present embodiment, in the touch pad sound output process described later, the sound corresponding to the user operation content on the touch surface is output to the left speaker so that the user can intuitively recognize the operation content on the touch pad device 8. 9a and right speaker 9b.

  FIG. 2 is a diagram showing a schematic hardware configuration example of the notebook PC 1 of FIG. As shown in the figure, the notebook PC 1 includes a CPU 11, a ROM 12, a memory 13, an HDD (hard disk) 14, a graphics adapter 15, a display device 5, an input unit 6, a touch pad controller 16, a keyboard controller 17, a USB port 20, A battery 21, a DC-DC converter 22, an AC adapter 23, an audio device 25, and the like are provided, and each unit is connected directly or indirectly via a bus.

  The CPU 11 controls the notebook PC 1 as a whole by the OS 30 stored in the HDD 14 connected via the bus, and controls functions based on various programs stored in the HDD 14. The ROM 12 stores a BIOS (Basic Input / Output System: basic input / output system) 12a, data, and the like.

  The memory 13 includes a cache memory and a RAM, and is a writable memory that is used as a read area for an execution program of the CPU 11 and a work area for writing process data of the execution program.

  The HDD (hard disk) 14 is directed to an OS 30 for controlling the entire notebook PC 1, various drivers 31 for controlling hardware, a utility program 32 for extending the functions of the OS 30, and a specific task. It has a function of storing the application program 33 and the like.

  The OS 30 controls basic operations of the notebook PC 1, manages various resources, and transmits, for example, instructions generated by the application program 33 to the driver 31 and the BIOS 12a. Further, the OS 30 has a multitask function and a multiwindow function, and software such as an execution context of the application program 33 (a register set, a main memory image, a file handle, etc. used by a certain application program 33) and GUI parts. It also manages resources. As the OS 30, for example, Windows (registered trademark) XP, Windows (registered trademark) Vista, Windows (registered trademark) 7, Windows (registered trademark) 8, or the like can be used.

  The various drivers 31 are for operating the peripheral devices by hardware. For example, a display driver for displaying an image on the display device 5, a keyboard driver for operating the keyboard 7, and a touchpad device 8 are operated. A touch pad driver for operating the audio device 25, an audio driver for operating the audio device 25, and the like.

  The graphics adapter 15 is for converting drawing information into a video signal under the control of the CPU 11 and outputting the converted video signal to the display device 5. A graphics chip that converts information into a video signal and outputs it to the display device 5 is provided.

  The display device 5 is a liquid crystal display, an organic EL display, a plasma display, a CRT, or the like. The display device 5 is controlled by the CPU 11 and displays various types of information according to a video signal input from the graphics adapter 15.

  The keyboard controller 17 controls the operation of the keyboard 7 composed of various keys for inputting characters, commands and the like. The touch pad controller 16 controls the operation of the touch pad device 8 that moves a pointer on the screen and selects various menus.

  The AC adapter 23 is connected to a commercial power supply, converts an AC voltage into a DC voltage, and outputs the DC voltage to the DC-DC converter 22. The DC-DC converter 22 converts the DC voltage supplied from the AC adapter 23 into a predetermined voltage, supplies power to each unit, and charges the battery 21. The battery 21 is charged by the DC-DC converter 22 and supplies the charged voltage to each unit when the AC adapter 23 is not attached.

  The audio device 25 includes an audio controller 40, adders 41a and 41b, amplifiers 42a and 42b, a left speaker 9a, and a right speaker 9b. The audio controller 40 controls input / output of audio information handled by the system. The audio controller 40 inputs audio information from an audio driver executed by the CPU 11, generates an audio signal for sound output based on the audio information, and The audio signal is sent to the amplifiers 42a and 42b via the adders 41a and 41b.

  The amplifiers 42a and 42b amplify the power of the sound signal input from the audio controller 40, and output sound according to the sound signal from the left speaker 9a and the right speaker 9b. The amplification levels of the amplifiers 42a and 42b are controlled by a volume adjusting volume (not shown). The left and right speakers 9a and 9b are loudspeakers that output audio in an audible frequency band in accordance with the audio signals that have been power amplified by the amplifiers 42a and 42b.

  FIG. 3 is a schematic diagram illustrating a functional configuration related to the touchpad sound output process. The touch pad device 8 includes, for example, a capacitive touch pad 8a and a pressure detection unit 8b including a strain sensor, and the touch position (X, Y) and its touch pressure (P). Can be detected. The touch pad device 8 detects the touch position (X, Y) and the touch pressure (P), and outputs the detection result to the touch pad controller 16. In addition, since a well-known method can be used for the method of detecting the touch position (X, Y) and the touch pressure (P), detailed description thereof is omitted.

  The touch pad controller 16 outputs a left signal for adjusting the sound volume output from the left speaker 9a and the right speaker 9b based on the touch position (X, Y) and the touch pressure (P). The right signal for adjusting the sound volume is output to the adders 41a and 41b.

  The audio controller 40 outputs audio signals to the adders 41a and 41b, respectively. In the adder 41a, the audio signal is added to the left signal, amplified by the amplifier 42a, and then output from the left speaker 9a. Similarly, in the adder 41b, the audio signal is added to the right signal, amplified by the amplifier 42b, and then output from the right speaker 9b. As described above, the touch pad controller 16 can adjust the volume of the sound output from the left speaker 9a and the right speaker 9b by the left signal and the right signal.

  The touch pad controller 16 and the audio controller 40 described above function as sound control means.

  FIG. 4 is a diagram for explaining an example of the relationship between the function setting area of the touchpad device 8 and the signal levels of the left signal and the right signal. As shown in FIG. 4, on the touch surface 8a of the touch pad device 8, the function of the left mouse button is assigned to the left area 50a, and the function of the right mouse button is assigned to the right area 50b. The touch pad controller 16 determines that a left click operation has been performed when an operation (touch) exceeding a predetermined pressing pressure is detected in the region 50a. Similarly, the touch pad controller 16 determines that a right click operation has been performed when an operation (touch) greater than or equal to a predetermined pressing pressure is detected in the region 50b. Note that the pointer moving function is possible in the entire area of the touch surface 8a. The click function becomes effective when the operation is performed at a predetermined pressure or higher.

  When the left click operation is performed, the left signal is set to “H”, and when the right click operation is performed, the right signal is set to “H”. In normal times, the left signal and the right signal are set to “L”.

  The audio controller 40 outputs a click sound as an audio signal to the adders 41a and 41b. When a left click operation is performed, the touch pad controller 40 outputs a left signal of “H” to the adder 41a. As a result, a click sound is output from the left speaker 9a via the adder 41a.

  On the other hand, when a right click operation is performed, the touch pad controller 40 outputs a right signal of “H” to the adder 41b. As a result, a click sound is output from the right speaker 9b via the adder 41b.

  Thus, when the left click operation is performed, the click sound is output from the left speaker 9a, and when the right click operation is performed, the user outputs the click sound from the right speaker 9b. It is possible to easily detect that a click operation has been performed. Further, even when the user clicks by mistake, it is possible to easily detect that an erroneous operation has been performed by a click sound.

  Note that here, when a click operation is performed, a click sound is output. However, the type of sound is not limited to this, and other sound may be output, and the function Different sounds may be output for each setting area.

(Modification 1)
Depending on the position of the touch surface 8a to be operated, that is, depending on the position in the Y direction (up and down direction) and / or X direction (left and right direction) of the touch surface 8a to be operated, the left and right speakers 9a and 9b The output volume may be changed. FIG. 5 is a diagram for explaining another example of the relationship between the function setting area of the touch pad device 8 and the signal levels of the left signal and the right signal. FIG. 5 shows an example in which the signal levels of the left signal and the right signal are changed according to the operation position in the Y direction on the touch surface 8a.

  For example, as shown in FIG. 5, when a left click operation is performed in the region 50a, if an operation is performed in the upward direction (the Y coordinate value is large), the downward direction (the Y coordinate value). The level of the left signal may be increased as compared with a case where the operation is performed in a direction in which the left signal is small. In addition, when a right click operation is performed in the region 50b, if the operation is performed in the upward direction (the direction where the Y coordinate value is large), the operation is performed in the downward direction (the direction where the Y coordinate value is small). The level of the right signal may be increased as compared with the case where it is performed. Thereby, the user can intuitively recognize at which position in the Y-axis direction of the touch surface 8a of the touchpad device 8 the click operation is performed.

(Modification 2)
An example of the function area setting of the touch pad device 8 is not limited to the example of FIG. 4, and various modes are conceivable. FIG. 6 is a diagram for explaining another example of the relationship between the function setting area of the touch pad device 8 and the signal levels of the left signal and the right signal. FIG. 6 shows an example in which the signal levels of the left signal and the right signal are changed in accordance with the X direction (left-right direction) of the touch surface 8a.

  On the touch surface 8a of the touch pad device 8, the left function of the track pointer is in the upper left area 60a, the center function of the track pointer is in the upper upper area 60b, and the right function of the track pointer is in the upper right area 60c. The function of the left mouse button is assigned to the lower left area 60d, and the function of the right mouse button is assigned to the lower right area 60e.

  For example, as illustrated in FIG. 6, when an operation is performed in the left direction (the direction in which the X coordinate value is small) on the touch surface 8 a, the operation is performed in the right direction (the direction in which the X coordinate value is large). The level of the left signal may be increased as compared with the case where it is broken. In addition, when the operation is performed in the right direction (the direction in which the X coordinate value is large) on the touch surface 8a, compared to the case where the operation is performed in the left direction (the direction in which the X coordinate value is small). The right signal level may be increased. Thereby, the user can intuitively recognize at which position in the X direction of the touch surface 8a of the touch pad device 8 the operation is performed.

  Note that a plurality of functional area setting patterns of the touch pad device 8 may be prepared so that the user can select them. In addition, a plurality of audio output patterns may be prepared for the functional area set in the touch pad device 8 so that the user can select.

  As described above, according to the present embodiment, the touch pad device 8 that outputs a detection result corresponding to the user operation on the touch surface 8a, the left and right speakers 9a and 9b that output sound, and the detection result. In addition, since the sound control means for controlling the sound output of the left and right speakers 9a and 9b is provided, it is possible to make the user intuitively recognize the operation content with respect to the touch pad device by sound.

  Further, since the sound control means changes the volume of the sound output from the left and right speakers 9a and 9b according to the position of the touch surface 9a operated by the user, the user can select which touch surface of the touchpad device. It is possible to intuitively recognize whether the operation is performed at the position.

  Further, the touch pad device 8 has a left and right click function, and when the left click operation is performed on the touch pad device 8, the voice control unit outputs a click sound from the left speaker 9a and performs a right click operation. Since the click sound is output from the right speaker 9b, the user can intuitively recognize whether the left click or the right click has been performed.

  In the above-described embodiment, the notebook type PC has been described as the information processing apparatus. However, the present invention is not limited to this, and other information processing apparatuses such as a desktop type PC, a PDA, and a mobile phone may be used. Can be applied.

  The information input apparatus and the voice output method thereof according to the present invention can be widely applied when the operation of the pointing device having a touch surface is recognized by voice.

1 Notebook PC
2 Main Body Side Housing 3 Display Side Housing 4a, 4b Connecting Portion 5 Display Device 6 Input Portion 7 Keyboard 8 Touchpad Device 9a, 9b Speaker 11 CPU
12 ROM
12a BIOS
13 Memory 14 HDD (Hard Disk)
15 Graphics adapter 15a VRAM
16 Touchpad controller 17 Keyboard controller 20 USB port 21 Battery 22 DC-DC converter 23 AC adapter 30 OS
31 Driver 32 Utility program 33 Application program 40 Audio controller 41a, 41b Adder 42a, 42b Amplifier

Claims (6)

A pointing device that has a touch surface and outputs a detection result corresponding to a user operation on the touch surface;
Stereo speakers that output audio;
Audio control means for controlling the audio output of the stereo speaker based on the detection result;
An information input device comprising:   The information input device according to claim 1, wherein the voice control unit changes a volume of a voice output from the stereo speaker according to a position of the touch surface operated by the user. The pointing device has a left and right click function,
The voice control unit outputs a click sound from the left speaker of the stereo speaker when a left click operation is performed with the pointing device, and when the right click operation is performed with the pointing device, The information input device according to claim 1, wherein a click sound is output from a right speaker of the stereo speaker.   The information input device according to claim 1, wherein the pointing device is a touch pad device.   The information input apparatus according to claim 1, wherein the pointing device includes a pressure detection unit that detects a pressing force with respect to the touch surface. In an audio output method of an information input device comprising a pointing device having a touch surface and a stereo speaker for outputting audio,
The pointing device outputting a detection result corresponding to a user operation on the touch surface;
Audio control means for controlling the audio output of the stereo speaker based on the detection result;
An audio output method for an information input device, comprising:

Images