JP2018148276A - Audio output device and audio output method - Google Patents

Abstract

PROBLEM TO BE SOLVED: To make it easy to hear audio to be output regardless of a usage environment.SOLUTION: In a smartwatch, a control unit 1 identifies the degree of difficulty for a person carrying the smartwatch to hear the audio output from an audio output unit 8 and changes the audio by executing processing to add different harmonics to the audio to be output depending on the degree of difficulty. For example, when a fundamental tone f is 700 Hz, 2.1 KHz (triplet 3f), 2.8 kHz (4 harmonic 4f), 3.5 kHz (5 harmonic 5f) is added to the fundamental tone f.SELECTED DRAWING: Figure 1

Description

  The present invention relates to an audio output device and an audio output method for outputting a sound by adding its harmonics.

  In recent years, with the increase in wearable devices as small electronic devices, the importance of notifying by voice instead of a display has increased. When a user who carries this wearable device is notified by voice, since there is a large difference in ease of hearing depending on the usage environment such as noise, for example, as shown in Patent Document 1, a ring tone is generated according to the noise level. There is disclosed a technique for controlling the volume of sound. In addition, as shown in Patent Document 2, a technique is disclosed in which control is performed to add overtones according to the sound output in order to make the sound easy to hear.

JP 2002-171308 A JP 2008-216469 A

  However, in Patent Document 1 described above, considering the sound output in a public facility, a volume increase is restricted in the case of a mobile terminal, and thus a technique for simply controlling the sound volume is sufficient. It may not be possible. Further, Patent Document 2 is a technique for generating overtones, and does not consider the environment in which it is used.

  The subject of this invention is making it easy to hear the audio | voice to output irrespective of use environment.

In order to solve the above-described problems, the present invention
An audio output device including an audio output means,
A specifying means for specifying the degree of difficulty for a person carrying the device to hear the sound output by the sound output means;
According to the degree of difficulty specified by the specifying means, a sound changing means for changing the sound by performing processing to add different overtones to the sound output by the sound output means;
It is characterized by providing.

  ADVANTAGE OF THE INVENTION According to this invention, it can make it easy to hear the audio | voice to output irrespective of use environment.

The block diagram which showed the basic component of the smartwatch which is a watch-type wearable terminal. The external view which showed the usage example of the smart watch, and the figure which expanded and showed the part which mounted | wore the user's wrist with the smart watch. (1) to (3) are audio waveforms for explaining that the harmonics are added to the sound (fundamental tone) according to the degree of difficulty of the person (user) carrying the smartwatch listening. The figure shown schematically. (1)-(3) is the graph which illustrated conceptually the overtone structure from which the number of overtones to add differs according to the degree of difficulty of hearing. 7 is a flowchart for explaining overtone calibration processing that is started when a calibration request is made as pre-setting processing at the time of factory shipment or the like. The flowchart for demonstrating the audio | voice control process started by the interruption for every fixed time. 7 is a flowchart following the operation of FIG. FIG. 6 is a diagram for specifically explaining the overtone calibration process of FIG. 5. (1)-(3) are the graphs which illustrated notionally the harmonic overtone composition from which the number of overtones added differs according to the degree of difficulty of hearing similarly to FIG. The flowchart for demonstrating the audio | voice control process started by the interruption for every fixed time in 2nd Embodiment.

Hereinafter, embodiments of the present invention will be described in detail with reference to the drawings.
(First embodiment)
First, a first embodiment of the present invention will be described with reference to FIGS.
The present embodiment is applied to a watch-type wearable terminal called a smart watch, and FIG. 1 is a block diagram showing basic components of the smart watch.
In addition to the basic clock function of timekeeping and alarm function and the linkage function (communication function) with multi-function mobile phone (smartphone), the smart watch can be installed by installing various application programs. The control unit 1 is a core configuration that can execute various processes.

  The control unit 1 operates by supplying power from the power source unit (secondary battery) 2 and controls the overall operation of the smart watch in accordance with various programs stored in the storage unit 3. The unit 1 is provided with a CPU (Central Processing Unit) and a memory (not shown). The storage unit 3 includes, for example, a ROM, a flash memory, and the like, and stores programs and various applications for realizing the first embodiment in accordance with the operation procedure illustrated in FIGS. It has a program memory 3a, a work memory 3b for temporarily storing data such as flags, and the like. The storage unit 3 may include a removable portable memory (recording medium) such as an SD card or a USB memory, and is connected to a network via a communication function (not shown). The state may include a storage area on a predetermined server device side.

  Although not shown, the operation unit 4 includes a power key for turning on / off the power. The touch display unit 5 has a configuration in which a touch panel is stacked on a display such as a high-definition liquid crystal, and various software keys (icons, touch keys) are allocated and arranged, or a touch operation with a finger or the like is detected and the touch operation is performed. The operation signal corresponding to the is input. In the present embodiment, information related to the user (such as age group) is input from the touch display unit 5 in advance. The clock unit 6 constitutes a clocking function and an alarm function, and the clocking information is displayed on the touch display unit 5. The wireless communication unit 7 constitutes a Bluetooth (registered trademark) standard short-range wireless communication function or a wireless LAN (Local Area Network) function. For example, the wireless communication unit 7 transmits and receives data in cooperation with a smartphone (not shown). . In addition, although this embodiment showed the short-distance communication between smartphones, it is not restricted to this, You may make it perform wide area communication via wireless LAN and a communication network (public wireless communication network and the internet). Good.

  Although not shown, the audio output unit 8 has a configuration including a D / A (digital / analog) converter, an amplifier, a speaker, a volume adjuster, and the like, and generates and outputs various types of audio (messages or alarm sounds). The volume adjuster arbitrarily adjusts the volume (volume) of the sound according to a user operation, or adjusts according to an instruction from the control unit 1. When the output condition corresponding to the audio data is satisfied, that is, when the output timing of the audio data is reached, the control unit 1 sends the audio data to the audio output unit 8 to be generated and output. At that time, the sound output unit 8 outputs sound at a volume set in the volume adjuster.

  The voice input unit 9 constitutes a sound collecting unit having a microphone, an amplifier, an A / D, and the like. The control unit 1 acquires the voice input from the voice input unit 9 and records it in the storage unit 3 ( Recording) or acquiring and analyzing the voice input from the voice input unit 9 at the time of voice output to detect the noise level of the usage environment. When a predetermined sound (sweep sound) is output from the sound output unit 8, the control unit 1 acquires and analyzes the sweep sound via the sound input unit 9, and based on the analysis result, the sound output unit 8 speaker characteristics (frequency characteristics) are discriminated.

  The acceleration sensor 10 is a sensor such as a piezoresistive type or a capacitance detection type that detects acceleration applied to the smart watch (housing), and is configured to generate acceleration components in three orthogonal directions (X, Y, and Z directions). It is detected and given to the control unit 1. The entire smart watch is a substantially rectangular case, the short side direction of the case is the X axis direction, the long side direction of the case is the X axis direction, and the thickness direction of the case is the Z axis. The direction. The control unit 1 determines the posture and movement of the smart watch based on a signal indicating the acceleration output from the acceleration sensor 10. The posture indicates a posture such as a state where the front part of the smart watch is thin (downward state), and the movement indicates a vibration state transmitted to the smart watch, a movement state (movement speed and movement direction), and the vibration state. Based on the above, it can be determined whether the smartwatch is placed on a desk or the like, carried by the user, or jogging.

FIG. 2 is an external view showing an example of use of a smart watch, and is an enlarged view of a portion where the smart watch is attached to a user's wrist.
The example shown in the figure shows a runner who participated in a marathon competition wearing a smartwatch and running, and the front part of the smartwatch faces the outside of the runner because his arm is bent while driving. Even if a sound is generated and output from this smart watch, it is difficult for the runner to hear the sound. That is, as shown in the figure, a voice output unit (speaker) 8 is disposed together with a touch display unit 5 and a voice input unit (microphone) 9 on the front surface of the smart watch. Since the sound output unit 8 is turned, it is difficult to listen to the output sound from the sound output unit 8. In addition, ambient noise is high during traveling, and it is difficult to hear the output voice.

  As described above, depending on the use environment or use state of the smartwatch, it is difficult for the person (user) carrying it to hear the output sound. Therefore, in the first embodiment, when outputting the sound from the sound output unit 8, the control unit 1 detects the posture, vibration, and movement of the smartwatch based on the output of the acceleration sensor 10, or from the sound input unit 9. It is difficult to detect ambient noise based on the input voice and to acquire information (age group) related to the user input in advance from the touch display unit 5 to hear the output voice. I try to distinguish. That is, the control unit 1 comprehensively considers the posture, vibration, movement, noise, and age group of the smart watch so that a person (user) carrying the smart watch can listen to the output sound from the sound output unit 8. The degree of difficulty (hereinafter referred to as the degree of difficulty in hearing) is determined.

  For example, the greater the ambient noise, such as in a train, the greater the difficulty of listening. The more the smartwatch is facing downward or outward (sideways), the higher the degree of difficulty in listening. Also, the faster the moving speed, such as during a bicycle, the higher the degree of difficulty in listening. The greater the vibration, such as during jogging, the greater the difficulty of listening. Furthermore, the greater the change in the moving direction, such as when the arm is greatly shaken by jogging or the like, the higher the degree of difficulty in hearing. The higher the age group of the user, the higher the degree of difficulty in hearing. Here, out of each element (age group, noise, vibration, posture, movement), it may be determined comprehensively after weighting which element is important and the degree of difficulty in hearing. The method of discriminating is arbitrary. For example, the criteria for determining the ambient noise may be changed depending on whether it is an elderly group or a young group, and if the noise is large, without considering the elements of posture and movement, You may make it discriminate | determine that the degree of difficulty of hearing is high.

FIG. 3 is a diagram schematically showing an audio waveform for explaining that harmonics are added to the audio (fundamental tone) according to the degree of difficulty of hearing determined at the time of audio output.
FIG. 3A shows the original correct voice (fundamental tone). In general, sound includes harmonics in addition to fundamentals, but the example in FIG. 3 (1) is basically composed of only fundamentals in order to show that the harmonics are not actively added. The waveform is shown schematically, and the voice waveform is different from the actual one. FIG. 3 (2) schematically shows a harmonic waveform of harmonics that are positively added to the fundamental tone shown in FIG. 3 (1). The harmonics within the frequency band (2 KHz to 5 KHz) that are easy for humans to hear are shown. Show.

  FIG. 3 (3) schematically shows the sound waveform of the processed sound obtained by positively adding the harmonics shown in FIG. 3 (2) to the fundamental sound shown in FIG. 3 (1). Is a sound in which the waveform is distorted using overtones, and includes frequencies that are easily heard by the human ear. In addition, although the sound quality of the processed sound changes somewhat compared to the fundamental sound, for example, since it is output under the use environment such as during exercise, in order to place importance on being heard rather than a slight difference in sound quality, During exercise, this processed sound is output instead of the fundamental tone. As described above, according to the present embodiment, importance is attached to the fact that the output sound is heard by the user rather than a slight difference in sound quality in accordance with the degree of difficulty of hearing determined at the time of sound output.

FIG. 4 is a graph conceptually illustrating a harmonic structure in which the number of overtones to be added differs according to the degree of difficulty of hearing determined at the time of audio output.
Each graph in FIGS. 4 (1) to 4 (3) is such that the horizontal axis is associated with frequency and the vertical axis is associated with sound pressure (dB). FIG. 4 (1) shows the original correct sound (fundamental sound). This is conceptually shown, and basically shows that only the fundamental tone is output when outputting sound. Here, assuming that the fundamental tone is “f”, FIG. 4 (2) conceptually shows a state in which a harmonic (2f) obtained by doubling the frequency of the fundamental tone f is added to the fundamental tone. It shows that the sound including the fundamental tone f and the overtone 2f added thereto is output. Note that the sound pressure of the fundamental tone is lowered by adding harmonics, but the example shown in the figure shows a case where the sound pressure of the fundamental tone is lowered by about 1/2 of the sound pressure of the added harmonics. The overall volume including the sound volume is slightly larger (about 1/2 of the sound pressure of overtones) than in the case of FIG.

  FIG. 4 (3) shows a plurality of overtones in which the frequency of the fundamental tone f is an integral multiple, for example, a double overtone (2f), a triple overtone (3f), and a quadruple overtone (4f). FIG. 3 conceptually shows a state in which the sound is sequentially added to the fundamental sound, and indicates that when the sound is output, the fundamental sound f and the harmonics 2f, 3f, and 4f added thereto are output. Note that the sound pressure of the fundamental tone is lowered by adding overtones, but the sound pressure of each overtone is also lowered step by step as the number of overtones increases. The overall volume including the plurality of overtones is set to be slightly higher than in the case of FIG. As described above, the example of FIG. 4 shows a harmonic structure in which “one” harmonic is added to the fundamental sound and a harmonic structure in which “three” harmonics are added. In any harmonic structure, sound is output. This is decided according to the degree of difficulty of hearing.

  That is, as described above, in the present embodiment, when the degree of difficulty in hearing is determined by comprehensively considering the posture, vibration, movement, noise, and user age group of the smart watch, As the degree of difficulty, one of the three ranks (R1, R2, R3) is discriminated. The ranks R1, R2, and R3 are such that the degree of difficulty increases in the order of R1 <R2 <R3, and rank R1 indicates a case where the degree of difficulty of hearing is lower than a predetermined threshold L1 (when easy to hear), When the degree of difficulty is rank R1, basically only the fundamental tone is output as shown in FIG.

  Rank R2 indicates an intermediate case where the degree of difficulty is higher than the predetermined threshold L1 and lower than the predetermined threshold L2 (somewhat difficult to hear). When the degree of difficulty is rank R2, As shown in 4 (2), a sound including one overtone 2f in the fundamental tone f is output. Rank R3 is when the degree of difficulty is higher than a predetermined threshold L2 (when it is very difficult to hear), and when the degree of difficulty is rank R3, as shown in FIG. In addition, three overtones 2f, 3f, and 4f are sequentially included to output sound.

  Next, the operation concept of the smart watch in the first embodiment will be described with reference to the flowcharts shown in FIGS. Here, each function described in these flowcharts is stored in the form of a readable program code, and operations according to the program code are sequentially executed. Further, it is possible to sequentially execute the operation according to the above-described program code transmitted via a transmission medium such as a network. The same applies to other embodiments described later. In addition to the recording medium, an operation unique to the present embodiment can be executed using a program / data supplied externally via a transmission medium. FIG. 5 is a flowchart showing an outline of the operation of the characteristic part of the present embodiment in the entire operation of the smart watch. When the flow of FIG. 5 is exited, the main flow of the entire operation (not shown) Return to).

FIG. 5 is a flowchart for explaining overtone calibration processing executed as pre-setting processing at the time of factory shipment or the like, and is started when calibration is requested.
This harmonic overtone calibration process is a process for determining frequency characteristics when a speaker is mounted at the time of factory shipment, etc., and determining overtones in a frequency band to be added in accordance with the speaker characteristics. First, the control unit 1 checks whether there is a harmonic calibration request (step A1). Here, the time of requesting calibration is not limited to the time of factory shipment, but is either when the speaker is replaced or when an exterior cover (not shown) is attached. Note that when the exterior cover is attached to the housing, the frequency characteristics that reach the user's ears change, so a calibration request is also made at that time.

  When a predetermined operation is performed and harmonic calibration is requested (YES in step A1), the control unit 1 outputs a sweep sound of the entire band from the speaker of the audio output unit 8 (step A2). In this case, since the frequency band generally audible to humans is 20 Hz to 20 KHz, frequencies within this range are sequentially output as a sweep sound as time elapses. Then, the sweep sound is sequentially obtained and analyzed through the microphone of the voice input unit 9 (step A3), and the frequency characteristic of the speaker is determined for the frequency band where the sound is likely to be emitted as a speaker (step A4). ).

  Then, in accordance with the frequency characteristics of the speaker, overtones in a frequency band that increases the ratio to be added are determined (step A5). That is, for example, as shown in FIG. 8, in a human audible band “20 Hz to 20 KHz”, if the frequency band that is likely to produce sound as a speaker is “120 Hz to 4 KHz”, the frequency band “120 Hz to 4 KHz” of this speaker characteristic. Overtones of the band “2 KHz to 4 KHz” that overlap the frequency band “2 KHz to 5 KHz” that is easy for humans to hear are determined as overtones for the frequency band that increases the added ratio (overtones of frequency bands that are easy for humans to hear). The harmonics of the frequency band determined in this way are stored and held as information related to speaker characteristics in the storage unit 3 (step A6). In this embodiment, the harmonic overtone calibration process is performed in order to positively use overtones in a frequency band that is easy to hear among the overtones of the frequency band in which sound is likely to be output as a speaker.

FIG. 6 and FIG. 7 are flowcharts for explaining a voice control process started to be executed by interruption every predetermined time.
First, the control unit 1 checks whether or not the audio data output timing has been reached (step B1). If it is not the audio output timing (NO in step B1), the control unit 1 exits this flow, but if it is the audio output timing (step B1). The user's age group inputted in advance is read and acquired (step B2). The voice input from the microphone of the voice input unit 9 is analyzed to detect the level of ambient noise (step B3). Furthermore, based on the output of the acceleration sensor 10, the posture of the smart watch (step B4), the movement state (the direction of movement and the speed of movement) (step B5), and the magnitude of vibration (step B6) are detected. .

  The control unit 1 comprehensively determines the age group, noise, vibration, posture of the smart watch, and movement of the user, and determines the degree of difficulty of listening (ranks R1, R2, R3) ( Step B7). That is, the user is an elderly person, the surrounding noise is high, the vibration is intense as during exercise, the front part of the smartwatch is thin (downward), or the front part is facing outward. The degree of difficulty in hearing is determined by comprehensively judging whether the vehicle is in the horizontal state, the moving speed is fast, or the moving change is large.

  Then, in accordance with the degree of difficulty of listening, the process moves to a process of adding the overtone to the voice (fundamental tone) (steps B8 to B20 in FIG. 7). 9 (1) to 9 (3) are graphs conceptually illustrating overtone configurations in which the number of overtones to be added differs according to the degree of difficulty of listening, as in FIG. It emphasizes that the user can hear the output sound rather than a slight difference. If the rank is R1 when the degree of difficulty in hearing is lower than the predetermined threshold L1 (when it is easy to hear) (YES in step B8 in FIG. 7), the basic as shown in FIG. 9 (1). After the voice of only the fundamental tone f is output from the voice output unit 8 at the set volume (step B9), the flow is exited.

  Further, if the degree of difficulty is a medium level (a little difficult to hear) when the degree of difficulty is higher than the predetermined threshold L1 and lower than the predetermined threshold L2 (YES in step B10), the harmonic overtone calibration process described above is performed. The harmonics determined in step (the harmonics in the frequency band that increases the rate of addition: harmonics in the frequency band that are easy to hear) are acquired (step B11). Then, as shown in FIG. 9 (2), processing for adding one overtone to the fundamental tone is performed to change the sound (step B12). For example, as shown in the figure, if the fundamental tone f is 700 Hz, 2.1 KHz (third harmonic 3f) is added to the fundamental tone f. Then, the processed sound (sound obtained by adding overtones to the fundamental tone) is output from the sound output unit 8 at the set volume (step B13), and then the process is exited.

  If the degree of difficulty is higher than the predetermined threshold L2 (when it is very difficult to hear) rank R3 (NO in step B10), priority is given to control for changing the volume, and control for changing the volume. If it is insufficient, control is performed to change the output sound by another method (method of adding overtones). That is, it is checked whether the set volume is the maximum value (step B14). If the set volume is not the maximum volume (NO in step B14), the harmonics determined by the harmonic calibration process are acquired in the same manner as in rank R2 (step B14). B15) As shown in FIG. 9 (2), a process of changing one of the overtones to the fundamental tone is performed (step B16). Then, the processed sound (sound obtained by adding overtones to the fundamental tone) is output from the sound output unit 8 at the maximum volume (step B17). Thereafter, the process returns from this flow after performing the process of returning the set volume from the maximum value to the original value (step B18).

  On the other hand, in rank R3 (NO in step B10), if the set volume is the maximum value (YES in step B14), the harmonics determined in the above harmonic calibration process (harmonics in the frequency band in which the ratio to be added is increased: A harmonic overtone that is easy for humans to hear is acquired (step B19). Then, as shown in FIG. 9 (3), a process for changing the sound by performing processing to add the three overtones to the fundamental sound f is performed (step B20). For example, as shown in the figure, if the fundamental tone f is 700 Hz, 2.1 KHz (3rd harmonic 2f), 2.8 KHz (4th harmonic 4f), and 3.5 KHz (5th harmonic 5f) are added to the fundamental tone f. Then, after this processed sound (sound obtained by adding overtones to the fundamental tone) is output from the sound output unit 8 at the set volume (step B21), the process is exited.

  As described above, in the smart watch of the first embodiment, the control unit 1 specifies the degree of difficulty for the person carrying the smart watch to hear the voice output from the voice output unit 8, and this difficulty. Depending on the degree of sound, the sound is changed by adding different overtones to the output sound, so that the user can easily hear the output sound regardless of the usage environment. You can prevent missed and missed hearings.

  Since the control unit 1 changes the number of overtones to be added in accordance with the degree of difficulty in hearing, the controller 1 can output a sound with a specific sound quality as the degree of difficulty in hearing increases.

  Since the control unit 1 increases the ratio of adding harmonics in a frequency band that is easy to hear according to the degree of difficulty in hearing, the higher the degree of difficulty in hearing, the higher the degree of difficulty in hearing. Can be added.

The control unit 1 comprehensively determines the age group of the user input from the touch display unit 5, the posture detected by the output of the acceleration sensor 10, vibration, movement, and noise detected by the input from the voice input unit 9. Considering this, the degree of difficulty in hearing is determined, so that the degree of difficulty can be determined easily and accurately.

  Since the control unit 1 changes the sound to be output by different methods according to the degree of difficulty of listening, it can output different sounds according to the degree of difficulty.

  The control unit 1 gives priority to the control for changing the sound volume according to the degree of difficulty of listening, and performs control to change the output sound by another method when the control for changing the sound volume is insufficient. Therefore, priority can be given to volume control capable of maintaining sound quality.

  When the control for changing the sound volume is not sufficient, the control unit 1 changes the sound by performing a process of adding the overtone of the sound to the output sound as control for changing the sound to be output by another method. As a result, it is possible to perform control to change the sound quality when volume control is insufficient.

  Since the control unit 1 performs control for maximizing the volume and changes the sound by adding harmonics of the sound to the output sound, the sound having different sound quality is output at the maximum volume. Can be made easier to hear.

<Modification 1>
In the first embodiment described above, the number of overtones to be added is changed according to the degree of difficulty of listening. However, according to the degree of difficulty, an odd number of harmonics and an even number of overtones are used. The ratio may be changed. For example, if the degree of difficulty of listening is rank R2, many even harmonics are added so that the sound is calm like a flute of an instrument, and if rank R3, it is like a clarinet of an instrument. What is necessary is just to add many odd overtones so that it may become an active sound (sound to hear). Thus, if the ratio of odd harmonics and even harmonics is changed according to the degree of difficulty of hearing, the ease of hearing can be further enhanced. In this case, the number of even overtones may be initially increased, and the number of odd overtones may be increased gradually as the difficulty increases.

<Modification 2>
In the first embodiment described above, for example, as shown in FIG. 7, if the degree of difficulty in hearing is rank R2 (YES in step B10), the harmonics determined in the above harmonics calibration process (YES in step B10). Frequency band overtones to increase the ratio to be added: frequency band overtones that are easy for humans to hear) (step B11), and processing to add one overtone to the base tone to change the sound (Step B12), in the case of rank R2, it is not necessary to add a harmonic selected from the harmonics determined by the harmonic calibration process described above. For example, if the fundamental tone is 700 Hz, 2.1 KHz (third harmonic) may be added to the fundamental tone. As a result, the distinction between the sound output in the case of rank R1 and the sound output in the case of rank R2 becomes even clearer.

<Modification 3>
In the first embodiment described above, the degree of difficulty of being heard by a person is specified, but in addition to the person, the degree of difficulty of being heard by a pet (dog, cat, etc.) is specified. It may be. In this case, the human audible band is 20 Hz to 20 KHz, and the frequency band that humans can easily hear is 2 KHz to 5 KHz, while the audible band of the dog is 15 Hz to 60 KHz, the audible band of the cat is 45 Hz to 64 KHz, Since the frequency band in which a cat can easily hear is 250 Hz to 25 KHz, and is different from each other, it may be divided into voice for humans and voice for dogs and cats. That is, after outputting a sound including a harmonic overtone that is easy for humans to hear, a sound including a harmonic overtone for a dog or cat can be output. Moreover, you may make it select beforehand whether the audio | voice for people and the audio | voice for dogs and cats are output. In this way, not only a person but also a voice including a harmonic overtone that can be easily heard by dogs and cats may be output.

  In the first embodiment described above, three ranks (R1, R2, R3) are shown as the degree of difficulty of hearing. However, the rank is not limited to three ranks, and may be divided into four ranks, five ranks, and the like. . In this case, the number of overtones to be added (harmonic structure) may be increased according to the number of ranks. In this way, by increasing the degree of difficulty of hearing, finer control than in the case of three ranks becomes possible.

  In the first embodiment described above, the output sound is processed in the order of one overtone addition → one overtone addition * maximum volume → three overtone additions * maximum volume in accordance with the degree of difficulty of listening. * Maximum volume → addition of one overtone * Maximum volume → addition of three overtones * The control for changing the volume and the order of changing the sound by other methods may be changed in the order of maximum volume.

  In the first embodiment described above, the posture and movement (vibration state and movement state) of the smart watch are determined from the output result of the acceleration sensor 10, but a gyro sensor, a geomagnetic sensor, a GPS (Global Positioning System), etc. A posture, motion, direction, change, or the like may be detected using a sensor group including.

  In the first embodiment described above, the age group is input as the user's personal information. However, in the case of a hearing-impaired person, it is difficult to hear high sounds or low sounds. You may make it input as. The frequency band “2 KHz to 5 KHz” that can be easily heard by the person may be narrowed according to the way the hearing-impaired person hears, and the frequency band that is easier to hear can be changed.

(Second Embodiment)
A second embodiment of the present invention will be described below with reference to FIG.
In the first embodiment described above, depending on the degree of difficulty of listening, different overtones are added to the output sound to change the sound, but in the second embodiment, the sound is output. According to the length and number of times of the voice, different overtones are added to the voice to change the voice. Here, in both the embodiments, the same or the same names are denoted by the same reference numerals, the description thereof will be omitted, and the following description will focus on the features of the second embodiment. .

  In the second embodiment, the case where the “alarm time alarm function (fade-in function, snooze function)” is applied as “the length and number of times of sound to be output” is shown. In this case, with the fade-in function, instead of increasing the volume of the output sound (alarm sound) gradually according to the length of time of the sound (time elapsed), the overtone is added to the alarm sound as the time elapses. The alarm sound is changed by adding. Also, in the snooze function, instead of gradually increasing the volume of the output sound (alarm sound) according to the number of outputs, the alarm sound is changed by adding overtones to the alarm sound according to the number of outputs. doing.

FIG. 10 is a flowchart for explaining a voice control process started to be executed by interruption every predetermined time in the second embodiment.
First, the control unit 1 checks whether the control unit 1 has reached the output timing of the audio data, that is, whether the set time of the alarm alarm function (fade-in function, snooze function) has been reached (step C1), and the alarm If the set time has not been reached (NO in step C1), the process exits from this flow, but if the audio output timing has reached the alarm set time (YES in step C1), the voice data (alarm sound) is read and acquired. (Step C2).

  If the fade-in function is turned on as an alarm function, the alarm sound length (elapsed time) is measured. If the snooze function is turned on, the number of alarms is measured (step C3) is performed, and as a result, it is checked whether or not the measured value (length or number of times) is equal to or less than a predetermined threshold value a (length a1 or number of times a2) (step C4). That is, for example, in the case of the fade-in function, if the threshold a is length a1 = 3 seconds, it is checked whether 3 seconds have elapsed since the start of the alarm. In the case of the snooze function, the threshold a is If the number of times a2 = 1, it is checked whether it is the first alarm output timing.

  If 3 seconds have elapsed from the start of the alarm, or if it is the first alarm output timing (YES in step C4), the basic as shown in FIG. 4 (1) or FIG. 8 (1) Thus, an alarm sound having only a fundamental tone is output from the audio output unit 8 at a set volume (step C5). Then, it is checked whether an operation for stopping the sound has been performed (whether an alarm stop button (not shown) has been operated) (step C9). If the stop button has been operated (YES in step C9), this flow is started. If the stop button is not operated (NO in step C9), it is checked whether the voice data is finished (step C10). If the voice is not finished (NO in step C10), the process returns to the process of measuring the length or number of times of the alarm sound (step C3).

  Here, before 3 seconds from the start of the alarm, or if it is the second or later alarm output timing (NO in step C4), the measured value (length or number of times) is a predetermined threshold value b (length b1 or the number of times b2) or less (step C6). For example, in the case of the fade-in function, if the threshold value b is length b1 = 5 seconds, the elapsed time from the start of the alarm is between 3 seconds and 5 seconds, or in the case of the snooze function, the threshold value b is the number of times. If b2 = 2, it is checked whether it is the second alarm output timing.

  Now, if the elapsed time from the start of the alarm is between 3 seconds and 5 seconds or the second alarm output timing (YES in step C6), a person can hear like the voice shown in FIG. 8 (2). After processing to change the alarm sound by performing processing to add one overtone in an easy frequency band to the fundamental sound (step C7), this alarm sound is output from the audio output unit 8 at the set volume (step C8). . On the other hand, if the elapsed time from the start of the alarm has passed 5 seconds, or if it is the third or later alarm output timing (NO in step C6), a person can hear like the voice shown in FIG. 8 (3). After processing to add three overtones in an easy frequency band to the fundamental tone and changing the alarm sound (step C11), the alarm output is output from the audio output unit 8 at the set volume (step C8). . Thereafter, the process proceeds to step C9 for checking whether or not the alarm stop button is operated, and the above operation is repeated.

  As described above, in the second embodiment, according to the length and the number of times of the sound to be output, the sound is changed by adding different overtones to the sound, so that the sound that is easy to hear is output. It can be applied to the alarm function (fade-in function, snooze function), and the wake-up effect can be further enhanced.

  In the second embodiment described above, the case where the alarm is applied to the alarm function (fade-in function, snooze function) has been shown. You may make it apply.

  Also in the second embodiment described above, the number of overtones to be added is changed. However, the ratio between the odd overtones and the even overtones is changed according to the length and number of times of the sound to be output. May be.

  In addition to the above-described embodiments, the ratio of the odd harmonics and the even harmonics may be changed according to the type of sound to be output. For example, if the type of sound to be output is discriminated and the result is calm music, the ratio of the odd harmonics and even harmonics is changed so that the even harmonics increase, and it is as active as an alarm sound. If it is a sound, the ratio of the odd harmonics and the even harmonics may be changed so that the odd harmonics increase. This makes it possible to output a voice that is easy to hear according to the type of voice to be output.

  In each of the above-described embodiments, the case where the present invention is applied to a smart watch has been described. However, the present invention is not limited to this, and a personal computer, a PDA (personal portable information communication device), a tablet terminal device, a mobile phone such as a smartphone, and an electronic game It may be applied to a music player or the like.

  Further, the “apparatus” and “unit” shown in each of the above-described embodiments may be separated into a plurality of cases by function, and are not limited to a single case. In addition, each step described in the above-described flowchart is not limited to time-series processing, and a plurality of steps may be processed in parallel or separately.

The embodiment of the present invention has been described above. However, the present invention is not limited to this, and includes the invention described in the claims and the equivalent scope thereof.
Hereinafter, the invention described in the claims of the present application will be appended.
(Appendix)
(Claim 1)
The invention described in claim 1
An audio output device including an audio output means,
A specifying means for specifying the degree of difficulty for a person carrying the device to hear the sound output by the sound output means;
According to the degree of difficulty specified by the specifying means, a sound changing means for changing the sound by performing processing to add different overtones to the sound output by the sound output means;
It is characterized by providing.
(Claim 2)
The invention described in claim 2 is the audio output device according to claim 1,
The voice changing unit changes the number of overtones to be added according to the degree of difficulty specified by the specifying unit.
It is characterized by that.
(Claim 3)
The invention according to claim 3 is the audio output device according to claim 1 or 2,
The voice changing means increases a ratio of adding harmonics in a frequency band that is easy to hear according to the degree of difficulty specified by the specifying means.
It is characterized by that.
(Claim 4)
The invention according to claim 4 is the audio output device according to any one of claims 1 to 3,
The voice changing means changes a ratio of odd harmonics and even harmonics according to the degree of difficulty specified by the specifying means.
It is characterized by that.
(Claim 5)
The invention according to claim 5 is the audio output device according to any one of claims 1 to 4,
Information relating to the user of the device, first detection means for detecting at least one of the posture, movement status, and vibration state of the device, second detection means for detecting noise around the device, and An acquisition means for acquiring, further comprising at least one of the means;
The specifying means includes at least one of an attitude detected by the first detection means, a movement state, a vibration state, a noise detected by the second detection means, and information on a user acquired by the acquisition means. Based on one of them, identify the degree of difficulty in hearing,
It is characterized by that.
(Claim 6)
The invention described in claim 6
An audio output device including an audio output means,
A specifying means for specifying the degree of difficulty for a person carrying the device to hear the sound output by the sound output means;
Sound changing means for changing the sound output by the sound output means in a different manner according to the degree of difficulty specified by the specifying means;
It is characterized by providing.
(Claim 7)
The invention according to claim 7 is the audio output device according to claim 6,
The voice changing unit gives priority to control for changing the volume according to the degree of difficulty specified by the specifying unit, and when the control for changing the volume is not sufficient, the voice to be output is output to another method. To change the control with
It is characterized by that.
(Claim 8)
The invention according to claim 8 is the audio output device according to claim 6,
When the control for changing the sound volume is insufficient, the sound changing means performs a process of adding harmonics of the sound to the sound output by the sound output means as control for changing the sound to be output by another method. Change the voice,
It is characterized by that.
(Claim 9)
The invention according to claim 9 is the audio output device according to claim 6 or 7,
In addition to performing control for maximizing the volume, the sound changing means changes the sound by performing a process of adding harmonics of the sound to the sound output by the sound output means.
It is characterized by that.
(Claim 10)
The invention according to claim 10 is:
An audio output device including an audio output means,
A specifying means for specifying at least one of the length and number of times of the sound output by the sound output means;
A voice changing means for performing processing to add different harmonics to the voice according to at least one of the length and the number of times of the voice specified by the specifying means;
It is characterized by providing.
(Claim 11)
The invention according to claim 11
An audio output method in an audio output device including an audio output means,
A process for specifying the degree of difficulty for a person carrying the device to hear the sound output by the sound output means;
Depending on the degree of difficulty specified, a process of changing the sound by performing a process of adding different harmonics to the sound output by the sound output means;
It is characterized by including.
(Claim 12)
The invention according to claim 12
An audio output method in an audio output device including an audio output means,
A process for specifying the degree of difficulty for a person carrying the device to hear the sound output by the sound output means;
Depending on the degree of difficulty specified, a process for changing the sound output by the sound output means in a different manner;
It is characterized by including.
(Claim 13)
The invention according to claim 13
An audio output method in an audio output device including an audio output means,
A process for specifying at least one of the length and number of times of the sound output by the sound output means;
A process of changing the sound by performing a process of adding different overtones to the sound according to at least one of the length and number of times of the specified sound;
It is characterized by including.

DESCRIPTION OF SYMBOLS 1 Control part 3 Memory | storage part 3a Program memory 8 Voice output part 9 Voice input part 10 Acceleration sensor

Claims (13)

An audio output device including an audio output means,
A specifying means for specifying the degree of difficulty for a person carrying the device to hear the sound output by the sound output means;
According to the degree of difficulty specified by the specifying means, a sound changing means for changing the sound by performing processing to add different overtones to the sound output by the sound output means;
An audio output device comprising: The voice changing unit changes the number of overtones to be added according to the degree of difficulty specified by the specifying unit.
The audio output device according to claim 1. The voice changing means increases a ratio of adding harmonics in a frequency band that is easy to hear according to the degree of difficulty specified by the specifying means.
The audio output device according to claim 1, wherein the audio output device is an audio output device. The voice changing means changes a ratio of odd harmonics and even harmonics according to the degree of difficulty specified by the specifying means.
The audio output device according to claim 1, wherein the audio output device is an audio output device. Information relating to the user of the device, first detection means for detecting at least one of the posture, movement status, and vibration state of the device, second detection means for detecting noise around the device, and An acquisition means for acquiring, further comprising at least one of the means;
The specifying means includes at least one of an attitude detected by the first detection means, a movement state, a vibration state, a noise detected by the second detection means, and information on a user acquired by the acquisition means. Based on one of them, identify the degree of difficulty in hearing,
The sound output device according to claim 1, wherein the sound output device is a sound output device. An audio output device including an audio output means,
A specifying means for specifying the degree of difficulty for a person carrying the device to hear the sound output by the sound output means;
Sound changing means for changing the sound output by the sound output means in a different manner according to the degree of difficulty specified by the specifying means;
An audio output device comprising: The voice changing unit gives priority to control for changing the volume according to the degree of difficulty specified by the specifying unit, and when the control for changing the volume is not sufficient, the voice to be output is output to another method. To change the control with
The audio output device according to claim 6. When the control for changing the sound volume is insufficient, the sound changing means performs a process of adding harmonics of the sound to the sound output by the sound output means as control for changing the sound to be output by another method. Change the voice,
The audio output device according to claim 6. In addition to performing control for maximizing the volume, the sound changing means changes the sound by performing a process of adding harmonics of the sound to the sound output by the sound output means.
The audio output device according to claim 6 or 7, wherein An audio output device including an audio output means,
A specifying means for specifying at least one of the length and number of times of the sound output by the sound output means;
A voice changing means for performing processing to add different harmonics to the voice according to at least one of the length and the number of times of the voice specified by the specifying means;
An audio output device comprising: An audio output method in an audio output device including an audio output means,
A process for specifying the degree of difficulty for a person carrying the device to hear the sound output by the sound output means;
Depending on the degree of difficulty specified, a process of changing the sound by performing a process of adding different harmonics to the sound output by the sound output means;
An audio output method comprising: An audio output method in an audio output device including an audio output means,
A process for specifying the degree of difficulty for a person carrying the device to hear the sound output by the sound output means;
Depending on the degree of difficulty specified, a process for changing the sound output by the sound output means in a different manner;
An audio output method comprising: An audio output method in an audio output device including an audio output means,
A process for specifying at least one of the length and number of times of the sound output by the sound output means;
A process of changing the sound by performing a process of adding different overtones to the sound according to at least one of the length and number of times of the specified sound;
An audio output method comprising:

Images