JP2015082740A - Mobile information terminal and control method therefor - Google Patents

Abstract

PROBLEM TO BE SOLVED: To complement the voice output function of a voice output device by a mobile information terminal.SOLUTION: Based on a first voice signal (#5) representing an output sound of a voice output device (200) and a second voice signal (#7) representing a detection sound of a microphone (104), a mobile information terminal (100) estimates a sound volume ratio of the output sound included in the detection sound to the sound volume of the output sound. Based on the estimated sound volume ratio, the mobile information terminal (100) selects the sound volume of a voice represented by the first voice signal output from a speaker (109).

Description

  The present invention relates to a portable information terminal that operates in cooperation with an audio output device, and a control method thereof.

  Portable information terminals such as smartphones are widely used and their functions are diversified. For example, Patent Document 1 discloses a mobile phone that is equipped with a parametric speaker and provides a sound of sufficient volume only to a specific user.

  A portable information terminal that operates in cooperation with a television receiver (hereinafter abbreviated as “TV”) is also known. For example, Patent Document 2 discloses a mobile phone that reproduces a continuation of content that has been reproduced on a TV when it is more than a set communication distance away from a television receiver (hereinafter abbreviated as “TV”).

JP 2012-29102 A (published February 9, 2012) Japanese Patent Laying-Open No. 2005-175862 (released on June 30, 2005)

  A high-resolution large-screen TV can be viewed close or distant and has a wide video service area. However, if you set the TV volume for a viewer who is watching nearby, the volume is too low for a user who is watching far away. Conversely, if you set the volume for a viewer who is watching far away, The volume is too loud for viewers watching nearby. That is, there is a problem that it is not possible to provide sound with a sound volume just right for all viewers in the video service area.

  The present invention has been made in view of the above problems, and an object thereof is to realize a portable information terminal that complements the audio output function of an audio output device such as a TV.

  Note that the technique described in Patent Document 2 does not contribute to the solution of this problem. This is because the mobile phone described in Patent Document 2 only plays the same content as the content played on the TV when it goes out of the wireless service area (wider than the video service area). is there.

  In order to solve the above problems, a portable information terminal according to one aspect of the present invention is a portable information terminal that operates in cooperation with an audio output device, and represents an output sound output by the audio output device. Acquisition means for acquiring a first audio signal from the audio output device, the first audio signal, a second audio signal representing a detected sound detected by a microphone built in or connected to the portable information terminal, Based on the estimation means for estimating a volume ratio that is a ratio of the volume of the output sound included in the detected sound to the volume of the output sound output by the audio output device, and the volume estimated by the estimation means Selection means for selecting the volume of the voice represented by the first voice signal output from the speaker built in or connected to the portable information terminal based on the ratio.

  In order to solve the above problem, a control method for a portable information terminal according to one aspect of the present invention is a control method for a portable information terminal that operates in cooperation with an audio output device. An acquisition step of acquiring a first audio signal representing an output sound output from the device from the audio output device; a detection sound detected by the first audio signal and a microphone incorporated in or connected to the portable information terminal; An estimation step for estimating a volume ratio, which is a ratio of a volume of the output sound included in the detection sound, to a volume of the output sound output by the audio output device, based on a second audio signal representing Selecting a sound volume represented by the first sound signal output from a speaker built in or connected to the portable information terminal based on the sound volume ratio estimated in the estimating step. No , It is characterized in that.

  Note that the volume to be selected by the selection means may be two levels, or three or more levels. In addition, the volume to be selected by the selection unit may include 0 (a state in which no sound is output) or may not include 0. For example, when the volume to be selected by the selection unit has two levels and the volume to be selected by the selection unit includes 0, the selection unit determines the volume estimated by the estimation unit. Based on the ratio, it is selected whether or not to output the voice represented by the first voice signal from a speaker built in or connected to the portable information terminal.

  According to one embodiment of the present invention, the audio output function of the audio output device can be supplemented by the portable information terminal. In particular, since a configuration is employed in which the sound volume when outputting the same sound as the sound output from the sound output device from the portable information terminal is selected based on the sound volume ratio, a user in the vicinity of the sound output device can be selected. The sound provided to the user far away from the sound output device can be set to a good sound volume without causing a situation where the sound volume of the sound provided becomes excessive.

It is a functional block diagram which shows the structure of the audio | voice output apparatus which operate | moves in cooperation with the portable information terminal which concerns on one Embodiment of this invention, and this portable information terminal. It is a figure which shows an example of the state estimation table which the portable information terminal shown in FIG. 1 refers. FIG. 3 is a diagram for describing a specific example of processing for estimating a hearing level in the portable information terminal shown in FIG. 1. (A) is a waveform diagram of output sound output from the audio output device, a waveform diagram of audio represented by the first audio signal acquired by the portable information terminal from the audio output device, and a microphone of the portable information terminal detected It is a wave form diagram of a detection sound. . (B) is a functional block diagram which shows the structure of the estimation part with which a portable information terminal is provided. It is a conceptual diagram which shows the operation example of the portable information terminal shown in FIG. 3 is a flowchart for explaining a flow of processing performed by the portable information terminal shown in FIG. 1. It is a figure for demonstrating an example of the process in which the portable information terminal shown in FIG. 1 updates the state estimation table shown in FIG. (A) is a flowchart for demonstrating the flow of the process in which a portable information terminal updates a state estimation table. (B) has shown the state estimation table updated by the process shown to (a). FIG. 6 is a diagram for explaining another example of processing in which the portable information terminal shown in FIG. 1 updates the state estimation table shown in FIG. 2. (A) is a flowchart for demonstrating the flow of the process in which a portable information terminal updates a state estimation table. (B) has shown the state estimation table updated by the process shown to (a) of FIG.

Embodiment 1
Hereinafter, embodiments of the present invention will be described in detail with reference to the drawings.

(Configuration of portable information terminal and audio output device)
The configurations of the portable information terminal 100 and the audio output device 200 according to the present embodiment will be described with reference to FIG. FIG. 1 is a functional block diagram showing the configuration of each part of the portable information terminal 100 and the audio output device 200.

  The portable information terminal 100 operates in cooperation with the audio output device 200 previously paired for wireless communication. More specifically, the portable information terminal 100 outputs the same sound as the sound output from the sound output device 200. Thereby, the user holding the portable information terminal 100 is output from the voice output device 200 by listening to the voice output from the portable information terminal 100 even when the user is away from the voice output device 200. You can know the voice that is.

  In the present embodiment, a case where a smartphone is used as the portable information terminal 100 and a television receiver (also referred to as TV) is used as the audio output device 200 will be described. It is not intended to limit the invention. For example, instead of using a smartphone as the portable information terminal 100, a mobile phone, a laptop computer, a tablet terminal, or the like that can operate in cooperation with the audio output device 200 may be used. Further, as the audio output device 200, a radio capable of operating in cooperation with the portable information terminal 100 or a music player may be used instead of using the TV. Moreover, in this embodiment, although the portable information terminal 100 and the audio | voice output apparatus 200 shall communicate by Wi-Fi (trademark), this invention is not limited to this. You may employ | adopt the wireless communication according to other transmission systems, such as Bluetooth (trademark).

  As shown in FIG. 1, the portable information terminal 100 includes an antenna 101, a communication unit 102, an audio decoding unit 103, a microphone 104, a conversion unit 105, a memory 106, a selection unit 107, an audio output unit 108, a speaker 109, and an operation reception. Unit 110, update unit 111, and estimation unit 120. The function of each part of the portable information terminal 100 will be described as follows.

  The antenna 101 is a means for converting electromagnetic waves into electrical signals. In the present embodiment, the antenna 101 converts an electromagnetic wave transmitted from the audio output device 200 into an electrical signal (hereinafter also referred to as “received signal # 1”). Received signal # 1 generated by antenna 101 is supplied to communication section 102.

  The communication unit 102 demodulates the first audio data # 2 and the volume setting information # 3 from the reception signal # 1 supplied from the antenna 101. The first audio data # 2 is encoded audio data representing the output sound output from the audio output device 200. The volume setting information # 3 is information representing the volume setting (gain) of the output sound output from the audio output device 200. The demodulated first audio data # 2 is supplied to the audio decoding unit 103. Also, the demodulated volume setting information # 3 is supplied to the estimation unit 120.

  The communication unit 102 also functions as means for determining the radio wave reception level # 4, which is an index indicating the reception state of radio waves, based on the electromagnetic waves received by the antenna 101. The determined radio wave reception level # 4 is notified to the selection unit 107. The radio wave reception level # 4 can be determined by, for example, the radio wave intensity of the received radio wave or the error rate of the reception data included in the reception signal # 1. The communication unit 102 determines that the reception state of the radio wave is good when the radio wave intensity of the received radio wave is strong or the error rate of the received data is low, and the radio wave intensity of the received radio wave is weak, or When the error rate of received data is high, it is determined that the reception state of radio waves is not good. In the present embodiment, as the radio wave reception level # 4, indices classified into five stages A to E are used, and the radio wave reception level A indicates that the radio wave reception state is the best.

  The audio decoding unit 103 is means for decoding the first audio signal # 5 from the first audio data # 2. In the present embodiment, the audio decoding unit 103 decodes the first audio signal # 5 from the first audio data # 2 supplied from the communication unit 102. The decoded first audio signal # 5 is supplied to the audio output unit 108 and the estimation unit 120. In the present embodiment, the first audio signal # 5 decoded by the audio decoding unit 103 is a digital signal.

  As described above, the antenna 101 and the communication unit 102 obtain the first audio data # 2 from the audio output device 200, and the audio decoding unit 103 receives the first audio signal # 5 from the first audio data # 2. Is decrypted. That is, the antenna 101, the communication unit 102, and the audio decoding unit 103 function as an acquisition unit for acquiring from the audio output device a first audio signal representing an output sound output from the audio output device.

  The microphone 104 is a means for detecting sound around the portable information terminal 100. An analog signal # 6 representing the sound detected by the microphone 104 (hereinafter also referred to as “detected sound”) is supplied to the conversion unit 105. In the present embodiment, the microphone 104 is built in the portable information terminal 100. Since the microphone 104 is built in the portable information terminal 100, it is guaranteed that the detection sound detected by the microphone 104 is a sound around the portable information terminal 100. However, the microphone 104 may be a microphone (for example, an earphone microphone) connected to the portable information terminal 100 with a short cable or the like.

  The conversion unit 105 is a means for converting the analog signal supplied from the microphone 104 into a digital signal. In the present embodiment, the conversion unit 105 generates the second audio signal # 7 by converting the analog signal # 6 representing the detected sound detected by the microphone 104 into a digital signal. The generated second audio signal # 7 is supplied to the estimation unit 120.

  The estimation unit 120 includes a first sound signal # 5 representing an output sound output from the sound output device 200, volume setting information # 3 of the sound output device 200, and a second sound representing a detected sound detected by the microphone 104. This is means (estimating means) for estimating the audibility level of the output sound included in the detected sound based on the signal # 7. In the present embodiment, the estimation unit 120 includes the first audio signal # 5 supplied from the audio decoding unit 103, the volume setting information # 3 supplied from the communication unit 102, and the first audio signal # 5 supplied from the conversion unit 105. Based on the second audio signal # 7, the audibility level # 8 of the output sound included in the detected sound detected by the microphone 104 is estimated. The hearing level # 8 estimated by the estimation unit 120 is notified to the selection unit 107.

  Here, the “audibility level” is the ratio of the volume (sound pressure level) of the output sound included in the detected sound detected by the microphone 104 to the volume (sound pressure level) of the output sound output from the sound output device 200. It is an index to represent. In this embodiment, as the audibility level, indices classified into five stages of A to E are used, and the audibility level A indicates that the audibility level is the highest. The details of the operation of the estimation unit 120 will be described later with reference to another drawing.

  Based on the audibility level # 8 estimated by the estimation unit 120 and the radio wave reception level # 4 notified from the communication unit 102, the selection unit 107 displays the audio represented by the first audio signal # 5 on the portable information terminal. 100 is a means (selection means) for selecting a sound volume when output from the speaker 109 built in 100. In the present embodiment, the selection unit 107 selects (1) whether or not to output the sound represented by the first sound signal # 5 based on the audibility level # 8 and the radio wave reception level # 4, and ( 2) The output volume value # 11 to be referred to determine the volume when outputting the sound is determined.

  The selection of whether or not to output the sound represented by the first sound signal # 5 is executed as follows, for example. That is, the selection unit 107 first estimates the state value # 9 indicating the state of the portable information terminal 100 by referring to the state estimation table stored in the memory 106. Here, the state estimation table is a table in which a specific state value is associated with each pair of the radio wave reception level values A to E and the audibility level values A to E. In addition, a predetermined threshold value is stored in the memory 106, and the selection unit 107 compares the estimated state value # 9 with the threshold value. Then, the selection unit 107 selects that the sound represented by the first sound signal # 5 is output from the speaker 109 when the estimated state value # 9 is equal to or greater than a predetermined threshold value. When the selection unit 107 selects to output the sound represented by the first audio signal # 5 from the speaker 109, the selection unit 107 outputs the sound represented by the first audio data from the speaker 109 to the audio output unit 108. The output instruction # 10 indicating that is transmitted.

  Further, the determination of the output sound volume value is executed as follows, for example. That is, the selection unit 107 determines the output volume value # 11 by referring to the output volume value table as shown in Table 1. Here, the output volume value table is a table in which the above-described state value and output volume value are associated with each other, and is stored in the memory 106. The selection unit 107 transmits the output volume value # 11 corresponding to the state value determined by referring to the output volume value table stored in the memory 106 to the audio output unit 108.

なお、表１に示す出力音量値テーブルは、メモリ１０６に格納されている予め定められた閾値が「４」である場合の出力音量値テーブルを示しているが、これは本発明を限定するものではなく、予め定められた閾値が「３」、または「５」である場合に、選択部１０７は、表１に示した出力音量値テーブルとは異なる出力音量値テーブルをそれぞれ参照する構成としてもよい。また、後述する更新部１１１が予め定められた閾値を更新した場合には、更新部１１１は、閾値の更新に応じてメモリ１０６に格納されている出力音量値テーブルを更新するように構成してもよい。

The output volume value table shown in Table 1 shows the output volume value table when the predetermined threshold value stored in the memory 106 is “4”, but this limits the present invention. Instead, when the predetermined threshold is “3” or “5”, the selection unit 107 may refer to an output volume value table different from the output volume value table shown in Table 1. Good. Further, when the update unit 111 described later updates a predetermined threshold value, the update unit 111 is configured to update the output volume value table stored in the memory 106 in accordance with the update of the threshold value. Also good.

  The audio output unit 108 is a means for causing the speaker 109 to output the first audio signal supplied from the audio decoding unit 103 based on the instruction received from the selection unit 107. In the present embodiment, when the audio output unit 108 receives an output instruction # 10 indicating that the output is from the speaker 109 from the selection unit 107, the audio output unit 108 receives the first audio signal # 5 supplied from the audio decoding unit 103 to the speaker 109. input. At this time, the audio output unit 108 determines the volume of the audio output from the speaker 109 from the audio output device 200 volume setting value V2 obtained from the audio output device 200 together with the first audio signal # 5 and the selection unit 107. This is determined with reference to the acquired output volume value # 11. Specifically, the sound volume output from the speaker 109 is set by adding the output volume value # 11 acquired from the selection unit 107 to the volume setting value V2 acquired from the audio output device 200. When the change instruction # 13 indicating the change of the volume setting value V1 of the portable information terminal 100 is received from the operation receiving unit 110 described later, the audio output unit 108 decodes the audio based on the change instruction # 13. The volume of the first audio signal # 5 supplied from the unit 103 is changed.

  The speaker 109 is a means for outputting the sound indicated by the sound signal by converting the input sound signal into physical vibration. In the present embodiment, the speaker 109 vibrates the diaphragm included in the speaker 109 based on the first audio signal # 5 input from the audio output unit 108, whereby the first audio signal # 5 is The voice that represents is output.

  The operation reception unit 110 is a means for receiving an operation by a user. In the present embodiment, the operation reception unit 110 receives an operation # 12 instructing the user to change the volume setting value V1. When the operation reception unit 110 receives an operation # 12 indicating a change in the volume setting value V1, the operation reception unit 110 transmits a change instruction # 13 indicating a change in the volume setting value V1 to the audio output unit 108 and the update unit 111. Note that the operation # 12 received by the operation receiving unit 110 may be, for example, an operation of pressing a physical button included in the portable information terminal 100 or an operation of touching a button displayed on the touch panel. There may be.

  In response to a user operation instructing to change the sound volume setting value V1, the update unit 111 updates a state value in the state estimation table stored in the memory 106 or at least one of threshold values (update) Means). In the present embodiment, the updating unit 111 transmits an update instruction # 14 that instructs to update the state value in the state estimation table stored in the memory 106 based on the change instruction # 13 received from the operation receiving unit 110. . However, the present invention is not limited to this. That is, the update unit 111 only needs to update at least one of the state value and the threshold value in the state estimation table stored in the memory 106. Details of processing performed by the updating unit 111 will be described later with reference to different drawings.

  Next, the audio output device 200 that operates in cooperation with the portable information terminal 100 according to the present embodiment will be described. Note that, as described above, in this embodiment, a TV is used as the audio output device 200. The audio output device 200 and the portable information terminal 100 are paired in advance in order to operate in cooperation with each other. The audio output device 200 has a function of transmitting the first audio data # 2 representing the output sound output from the audio output device 200 to the portable information terminal 100.

  As shown in FIG. 1, an audio output device 200 includes an antenna 201, a tuner unit 202, an external input unit 203, an audio encoding unit 204, an audio output unit 205, a speaker 206, a communication unit 207, an antenna 208, a memory 209, and An operation reception unit 210 is provided. The function of each part of the audio output device 200 will be described as follows. Note that the audio output device 200 is a device that outputs audio based on either an audio signal included in a broadcast signal received by the antenna 201 or an audio signal acquired by the external input unit 203.

  The antenna 201 is a means for receiving a broadcast signal. In the present embodiment, the antenna 201 receives a broadcast signal # 15 transmitted through a satellite, terrestrial waves, or the like. The received broadcast signal # 15 is supplied to the tuner unit 202.

  The tuner unit 202 extracts the first audio signal # 5 from the broadcast signal # 15 supplied from the antenna 201. The extracted first audio signal # 5 is supplied to the audio encoding unit 204 and the audio output unit 205.

  The external input unit 203 is configured so that various external devices (recording media) such as a solid-state memory such as an HDD and an SD card, a disk device such as a BD (Blu-ray disc), DVD, and CD can be connected. The external input unit 203 acquires the input signal # 16 from these external devices. The external input unit 203 extracts the first audio signal # 5 from the acquired input signal # 16. The extracted first audio signal # 5 is supplied to the audio encoding unit 204 and the audio output unit 205.

  The audio encoding unit 204 generates the first audio data # 2 by encoding the first audio signal # 5 supplied from the tuner unit 202 or the external input unit 203. The generated first audio data # 2 is supplied to the communication unit 207.

  The audio output unit 205 inputs the first audio signal # 5 supplied from the tuner unit 202 or the external input unit 203 to the speaker 206. Further, when a change instruction # 19 indicating a change in the volume setting value V2 is received from an operation receiving unit 210 described later, the volume of the first audio signal # 5 is changed based on the change instruction # 19. . The first audio signal # 5 whose volume has been changed is input to the speaker 206.

  The speaker 206 outputs the sound represented by the first sound signal # 5 by vibrating the diaphragm included in the speaker 206 based on the first sound signal # 5 input from the sound output unit 205.

  The communication unit 207 is a means for generating a transmission signal # 17 that is transmitted via the antenna 208. In the present embodiment, the communication unit 207 generates a transmission signal # 17 including the first audio data # 2 representing the output sound output from the audio output device 200. Further, the transmission signal # 17 generated by the communication unit 207 includes volume setting information # 3 of the audio output device 200. The volume setting information # 3 is stored in the memory 209. The communication unit 207 refers to the memory 209 to generate the transmission signal # 17 including the volume setting information # 3. The transmission signal # 17 generated by the communication unit 207 is supplied to the antenna 208.

  The antenna 208 is a means for converting an electric signal into an electromagnetic wave. In the present embodiment, the antenna 208 converts the transmission signal # 17 supplied from the communication unit 207 into an electromagnetic wave.

  The operation reception unit 210 is a means for receiving an operation by a user. In the present embodiment, the operation receiving unit 210 receives an operation # 18 instructing the user to change the volume setting value V2. When the operation accepting unit 210 accepts an operation # 18 instructing to change the volume setting value V2, the operation accepting unit 210 transmits a change instruction # 19 indicating the change in the volume setting value V2 to the audio output unit 205. In the present embodiment, the operation received by the operation receiving unit 210 may be, for example, an operation of pressing a physical button included in the audio output device 200, or touch a button displayed on the touch panel. It may be an operation.

  The configurations of the portable information terminal 100 and the audio output device 200 according to the present embodiment have been described above. With the above configuration, the portable information terminal 100 and the audio output device 200 can operate in cooperation with each other.

  In FIG. 1, a common code # 5 is assigned to the first audio signal encoded by the audio output device 200 and the first audio signal decoded by the portable information terminal 100. This is because the first audio signal encoded in the audio output device 200 and the first audio signal decoded in the portable information terminal 100 ignore a bit error or the like generated in the encoding / decoding process. This is because it represents the same voice. The same applies to the code # 2 attached to the first audio data and the code # 3 attached to the volume setting information.

(Example of state estimation table)
Here, an example of the state estimation table will be described with reference to FIG. FIG. 2 is a diagram illustrating an example of a state estimation table referred to by the portable information terminal 100 according to the present embodiment. As shown in FIG. 2, the state estimation table is a table in which a specific state value is associated with each pair of radio wave reception level values A to E and auditory level values A to E. In the present embodiment, indices classified into 9 levels of 1 to 9 are used as state values. Hereinafter, a state where the radio wave reception level is “X” and the audibility level is “Y” is expressed as a state (X, Y). For example, in the present embodiment, the state value indicating the state (A, A) is “1”, and the state value indicating the state (E, E) is “9”. Therefore, as shown in FIG. 2, in the state estimation table, the state value “1” is stored in the cell indicating the state (A, A), and the state indicating the state (E, E) The value “9” is stored.

  In the present embodiment, the threshold value is “5”. Therefore, when the state estimated by the selection unit 107 is, for example, a state (A, B), a state (B, C), or the like, the state value falls below the threshold (1 to 4). Then, it is selected that the sound represented by the first sound signal # 5 is not output from the speaker 109. Similarly, when the state estimated by the selection unit 107 is, for example, a state (D, C), a state (C, E), or the like, the state value is equal to or greater than a threshold value (5 to 9). 107 selects to output from the speaker 109 the sound represented by the first sound signal # 5.

(Processing performed by the estimation unit 120)
Next, an example of processing performed by the estimation unit 120 included in the portable information terminal 100 will be described with reference to FIG. FIG. 3 is a conceptual diagram for explaining a specific example of processing in which the portable information terminal 100 according to the present embodiment estimates the audibility level. 3A is a waveform diagram of an output sound output from the audio output device 200, a waveform diagram of an audio represented by the first audio signal # 5 acquired by the portable information terminal 100 from the audio output device 200, and a mobile phone. The waveform figure of 2nd audio | voice signal # 7 which converted the detection sound which the microphone 104 of the type | mold information terminal 100 detected into the digital signal is shown. FIG. 3B is a functional block diagram illustrating a configuration of the estimation unit 120 included in the portable information terminal 100.

  As shown in FIG. 3A, the first audio signal # 5 acquired from the audio output device 200 by the portable information terminal 100 is delayed by the time ε with respect to the output sound output from the audio output device 200. ing. This time ε (hereinafter referred to as “delay time ε”) corresponds to the time required to wirelessly transmit the first audio data # 2 from the audio output device 200 to the portable information terminal 100. Therefore, the delay time ε is a value determined according to the wireless method between the portable information terminal 100 and the audio output device 200. Also, the audio output device 200 changes the volume of the audio signal to be output based on the volume setting information # 3, and outputs the audio represented by the audio signal whose volume has been changed. Therefore, as shown in FIG. 3A, the sound signal of the output sound output from the sound output device 200 is a sound obtained by multiplying the first sound signal # 5 without delay by the volume setting information # 3. Signal. In addition, the detection sound detected by the microphone 104 included in the portable information terminal 100 includes noise around the portable information terminal 100. Therefore, as shown in FIG. 3A, the second audio signal # 7 contains noise. The output sound output from the audio output device 200 is attenuated while propagating in space. Therefore, as shown in FIG. 3A, the volume of the first audio signal # 5 included in the second audio signal # 7 is attenuated.

  As illustrated in FIG. 3B, the estimation unit 120 includes a volume level correction unit 121, a delay correction unit 122, a noise removal processing unit 123, and a comparison unit 124. The function of each unit included in the estimation unit 120 will be described as follows.

  The volume level correcting unit 121 is a unit (volume correcting unit) for correcting the volume of the audio signal. In the present embodiment, the volume level correcting unit 121 determines the volume of the first audio signal # 5 supplied from the audio decoding unit 103 based on the volume setting information # 3 of the audio output device 200 supplied from the communication unit 102. To correct. More specifically, the volume level correcting unit 121 multiplies the first audio signal # 5 by the volume setting information # 3, so that the first audio signal # 5 supplied from the audio decoding unit 103 is The audio signal is corrected so as to be the same as the audio signal representing the output sound output from the audio output device 200. The volume level correcting unit 121 corrects the volume of the first audio signal # 5 as described above, and generates a third audio signal # 20. The generated third audio signal # 20 is supplied to the comparison unit 124.

  The delay correcting unit 122 is means (delay correcting means) for correcting a delay time between the first audio signal # 5 and the second audio signal # 7. More specifically, the delay correction unit 122 corrects the second audio signal # 7 supplied from the conversion unit 105 so as to be delayed by time ε. Therefore, the second audio signal # 21 corrected by the delay correcting unit 122 and the first audio signal # 5 are temporally synchronized (phase aligned) signals. The second audio signal # 21 corrected by the delay correction unit 122 is supplied to the noise removal processing unit 123.

  The noise removal processing unit 123 is a means (noise removal means) for removing noise included in the audio signal. In the present embodiment, the noise removal processing unit 123 generates the fourth audio signal # 22 by removing the noise included in the second audio signal # 21 corrected by the delay correction unit 122. The fourth audio signal # 22 generated by the noise removal processing unit 123 is supplied to the comparison unit 124. Note that the noise removal processing performed by the noise removal processing unit 123 can be realized by using, for example, a low-pass filter LPF (Low Path Filter).

  The comparison unit 124 is a means (calculation means) for calculating the ratio between the volume of the third audio signal # 20 and the volume of the fourth audio signal # 22. In the present embodiment, the comparison unit 124 estimates the audibility level described above by comparing the third audio signal # 20 and the fourth audio signal # 22.

  For example, the comparison unit 124 integrates the ratio of the instantaneous amplitude of the third audio signal # 20 and the instantaneous amplitude of the fourth audio signal # 22 over a certain period of time to thereby calculate the third audio signal # 20. The volume ratio between the sound volume represented by the sound volume represented by the fourth sound signal # 22 can be calculated.

  The comparison unit 124 assigns a hearing level according to the calculated volume ratio. For example, when the volume ratio is 80% or more and 100% or less, the audibility level is assigned as “A”. Similarly, when the volume ratio is 60% or more and less than 80%, the audibility level is “B”. When the volume ratio is 40% or more and less than 60%, the audibility level is “C”, and the volume ratio is 20%. As described above, the audibility level may be assigned as “D” when less than 60%, and the audibility level may be assigned as “E” when the volume ratio is 0% or more and less than 20%. The hearing level # 8 estimated by the above procedure is notified to the selection unit 107.

  Note that the operation of the estimation unit 120 when the portable information terminal 100 outputs the voice represented by the first voice signal # 5 acquired from the voice output device 200 is as follows, for example.

  That is, in this case, the detection sound detected by the microphone 104 includes the first sound signal # 5 output from the portable information terminal 100 in addition to the output sound output from the sound output device 200 and noise. The voice represented by is further included. In such a case, for example, the noise removal processing unit 123 removes noise included in the second audio signal # 7 supplied from the conversion unit 105, and the second audio signal # 7 includes the mobile phone. What is necessary is just to comprise so that 1st audio | voice signal # 5 which is the audio | voice which the type | mold information terminal 100 is outputting may be removed.

(Specific operation of portable information terminal)
Next, an operation example of the portable information terminal 100 will be described with reference to FIG. FIG. 4 is a conceptual diagram illustrating an operation example of the portable information terminal 100.

  In the example shown in FIG. 4, the user A of the portable information terminal 100a and the user B of the portable information terminal 100b are listening to the sound output from the sound output device 200. In the example shown in FIG. 4, it is assumed that the audio output device 200 is previously paired with each of the portable information terminals 100a and 100b.

  In the example illustrated in FIG. 4, a region R <b> 1 indicated by a broken line indicates a range (audible range) within which sound output from the speakers 206 a and 206 b of the audio output device 200 can reach. That is, the size of the region R1 can be changed with the change in the volume setting of the audio output device 200. In the example shown in FIG. 4, the region R2 indicated by a solid line is a range where electromagnetic waves transmitted from the audio output device 200 reach, that is, a range where communication between the portable information terminal 100 and the audio output device 200 is possible. (Hereinafter also referred to as “communicable range”).

  In the example shown in FIG. 4, the user A is viewing the audio output device 200 at a position P1 included in the region R1 and the region R2. At the position P1, since the sound output from the sound output device 200 reaches the user A, the state value estimated by the selection unit 107 of the portable information terminal 100a does not exceed the threshold value. Therefore, the portable information terminal 100a does not output the voice acquired from the voice output device 200.

  Here, consider a case where the user A moves to a position P2 that is not included in the region R1 and is included in the region R2. In the above case, the state value estimated by the selection unit 107 of the portable information terminal 100a indicates a value equal to or greater than the threshold value. Therefore, the portable information terminal 100a outputs the voice acquired from the voice output device 200. Further, the portable information terminal 100a uses the volume setting value V2 acquired from the audio output device 200 together with the first audio signal # 5 and the selection unit 107 to output the audio acquired from the audio output device 200. To determine the output volume value # 11 obtained from the above.

  Consider a case where user A moves from position P2 to position P1. In the above case, the state value estimated by the selection unit 107 of the portable information terminal 100a again falls below the threshold value. Therefore, the portable information terminal 100a does not output the voice acquired from the voice output device 200.

  Further, consider a case where the user A moves to a position not included in either the area R1 or the area R2 (that is, a position outside the area R2). In the above case, the portable information terminal 100 cannot operate in cooperation with the audio output device 200. That is, since the portable information terminal 100 cannot acquire the first audio signal # 5 from the audio output device 200, the portable information terminal 100 stops outputting audio.

  As described above, the portable information terminal 100 according to the present embodiment operates in cooperation with the audio output device 200, for example, according to a change in the surrounding environment accompanying the movement of the user of the portable information terminal 100. It is possible to select whether or not to output the same sound as the sound output from the sound output device 200. In addition, the portable information terminal 100 outputs the volume at the time of outputting the sound acquired from the sound output device 200, the volume setting value V2 acquired from the sound output device 200 together with the first sound signal # 5, and the selection unit 107. Can be determined with reference to the output volume value # 11 obtained from the above. In the example shown in FIG. 4, the case where the user of the portable information terminal 100 moves away from the audio output device 200 has been described, but the present invention is not limited to this. For example, when there is some kind of shielding between the audio output device 200 and the portable information terminal 100, or noise appears in the vicinity of the portable information terminal 100 in the region R1. It can be applied to any case.

(Processing flow of portable information terminals)
Next, the flow of processing performed by the portable information terminal 100 according to the present embodiment will be described with reference to FIG. FIG. 5 is a flowchart for explaining the flow of processing performed by the portable information terminal 100 according to the present embodiment.

  First, in step S <b> 101, the portable information terminal 100 starts communication with the audio output device 200. When the portable information terminal 100 confirms that the voice output device 200 is a voice output device previously paired with the portable information terminal 100, the portable information terminal 100 proceeds to the next step. In addition, it is preferable to process the process of the following steps S102-S105 in parallel.

  In step S102, the communication unit 102 determines the radio wave reception level # 4 based on the electromagnetic wave received by the antenna 101. The determined radio wave reception level # 4 is notified to the selection unit 107.

  In step S103, the communication unit 102 obtains first audio data # 2 that is encoded audio data from the reception signal # 1 supplied from the antenna 101 and represents the output sound output from the audio output device 200. Extract. The extracted first audio data # 2 is supplied to the audio decoding unit 103. The audio decoding unit 103 decodes the first audio signal # 5 from the first audio data # 2 supplied from the communication unit 102. The decoded first audio signal # 5 is supplied to the audio output unit 108 and the estimation unit 120.

  In step S104, the communication unit 102 extracts the volume setting information # 3 of the audio output device 200 from the reception signal # 1 supplied from the antenna 101. The extracted volume setting information # 3 is supplied to the estimation unit 120.

  In step S <b> 105, the microphone 104 detects sound around the portable information terminal 100. The analog signal # 6 representing the detection sound detected by the microphone 104 is supplied to the conversion unit 105. The conversion unit 105 generates the second audio signal # 7 by converting the analog signal # 6 representing the detection sound detected by the microphone 104 into a digital signal. The generated second audio signal # 7 is supplied to the estimation unit 120.

  Subsequently, in step S <b> 106, the estimation unit 120 is supplied from the first audio signal # 5 supplied from the audio decoding unit 103, volume setting information # 3 supplied from the communication unit 102, and the conversion unit 105. Based on the second audio signal # 7, the audibility level # 8 of the output sound included in the detected sound detected by the microphone 104 is estimated. The hearing level # 8 estimated by the estimation unit 120 is notified to the selection unit 107.

  Subsequently, in step S107, the selection unit 107 is stored in the memory 106 based on the audibility level # 8 notified from the estimation unit 120 and the radio wave reception level # 4 notified from the communication unit 102. The state value # 9 indicating the state of the portable information terminal 100 is estimated by referring to the estimation table.

  Subsequently, in step S108, the selection unit 107 determines whether or not the state value # 9 estimated in step S107 is greater than or equal to a predetermined threshold value. When it is determined that state value # 9 estimated in step S107 is greater than or equal to a predetermined threshold (YES in step S108), selection unit 107 selects the sound represented by first sound signal # 5. , The output from the speaker 109 is selected, and the process proceeds to step S109. When it is determined that state value # 9 estimated in step S107 is lower than a predetermined threshold (NO in step S108), selection unit 107 selects the voice represented by first voice signal # 5, It is selected not to output from the speaker 109, and the process proceeds to step S110.

  In step S109, the selection unit 107 transmits an output instruction # 10 indicating that the audio represented by the first audio signal # 5 is output from the speaker 109 to the audio output unit 108. Further, the selection unit 107 determines the output volume value # 11 by referring to the output volume value table shown in Table 1. The selection unit 107 transmits the output volume value # 11 corresponding to the state value determined by referring to the output volume value table to the audio output unit 108. When the audio output unit 108 receives from the selection unit 107 an output instruction # 10 indicating output from the speaker 109, the audio output unit 108 inputs the first audio signal # 5 supplied from the audio decoding unit 103 to the speaker 109. At this time, the audio output unit 108 sets the volume of the sound output from the speaker 109 by adding the output volume value # 11 acquired from the selection unit 107 to the volume setting value V2 acquired from the audio output device 200. . The speaker 109 outputs the sound represented by the first sound signal # 5 by vibrating the diaphragm included in the speaker 109 according to the first sound signal # 5 input from the sound output unit 108. When the speaker 109 starts outputting the sound represented by the first sound signal # 5, the portable information terminal 100 advances the process to step S110.

  Subsequently, in S110, the portable information terminal 100 determines whether or not the operation reception unit 110 has received an operation # 12 indicating a change in the volume setting value V1 by the user. When it is determined that operation accepting unit 110 has accepted operation # 12 indicating a change in volume setting value V1 by the user (YES in step S110), operation accepting unit 110 provides a change instruction indicating a change in volume setting value V1. # 13 is transmitted to the audio output unit 108 and the update unit 111. The audio output unit 108 changes the volume of the first audio signal # 5 supplied from the audio decoding unit 103 based on the change instruction # 13. The first audio signal # 5 whose volume has been changed is input to the speaker 109. The speaker 109 outputs the sound represented by the first sound signal # 5 input from the sound output unit 108. Thereafter, the portable information terminal 100 proceeds with the process to step S111. If it is determined that operation accepting unit 110 has not accepted operation # 12 indicating a change in volume setting value V1 by the user (NO in step S110), portable information terminal 100 performs the process in step S120. Proceed.

  In step S111, the updating unit 111 updates the state value in the state estimation table stored in the memory 106 based on the change instruction # 13 received from the operation receiving unit 110. Note that details of processing performed by the updating unit 111 in step S111 will be described later with reference to another drawing.

  Subsequently, in step S120, the portable information terminal 100 determines whether or not the own device is located in a communicable range with the audio output device. If it is determined that the own device is located in a communicable range with the audio output device (YES in step S120), portable information terminal 100 returns to the processing in steps S102 to S105. If it is determined that the own device is not located within the communicable range with the audio output device (NO in step S120), portable information terminal 100 outputs the audio represented by the first audio signal from speaker 109. And stop the process.

  Through the above procedure, the portable information terminal 100 according to the present embodiment determines whether or not to output the same sound as the sound output from the sound output device 200 according to the change in the surrounding environment of the portable information terminal 100. You can choose.

  In the present embodiment, the first audio signal # 5 and the second audio signal # 7 are acquired in step S103 and step S105, respectively, but the acquired audio signal starts to acquire audio. A sound signal from a certain time t0 to a time t1 when a predetermined time t (t> 0) has elapsed. This is because the audio signal to be acquired is a signal indicating a continuous value, and in order for the comparison unit 124 to compare the two audio signals, it is necessary to use an audio signal divided at an arbitrary unit time. In the above case, the communication unit 102 extracts the first audio data # 2 from time t0 to time t1 from the reception signal received by the antenna 101. The extracted first audio data # 2 is supplied to the audio decoding unit 103. The audio decoding unit 103 decodes the first audio signal # 5 from the first audio data # 2 supplied from the communication unit 102 from time t0 to time t1. The decoded first audio signal # 5, which is the first audio signal # 5 from time t0 to time t1, is stored in a buffer (not shown). Similarly, the microphone 104 detects sound around the portable information terminal 100 and from time t0 to time t1. The analog signal # 6 representing the detection sound detected by the microphone 104, which is the analog signal # 6 from time t0 to time t1, is supplied to the conversion unit 105. The converter 105 converts the analog signal # 6 from time t0 to time t1 into a digital signal, thereby generating a second audio signal # 7 from time t0 to time t1. The generated second audio signal # 7 from time t0 to time t1 is stored in a buffer (not shown). The estimation unit 120 may be configured to read from the buffer the first audio signal # 5 from time t0 to time t1 and the second audio signal # 7 from time t0 to time t1. Further, the communication unit 102 generates the first audio data # 2 from time t0 to time t1, and then generates the first audio data # 2 from time t1 to time t2 when a predetermined time t has elapsed. As described above, it is preferable that the audio data divided every predetermined time t is continuously generated.

(Processing performed by the update unit 111)
Below, an example of the process which the update part 111 with which the portable information terminal 100 which concerns on this embodiment is provided is demonstrated, referring FIG. FIG. 6 is a conceptual diagram for explaining an example of processing in which the portable information terminal 100 according to the present embodiment updates the state estimation table shown in FIG. FIG. 6A is a flowchart for explaining the flow of processing in which the portable information terminal updates the state estimation table, and shows the specific processing in step S111 in the flowchart shown in FIG. It is. FIG. 6B shows a state estimation table updated by the process shown in FIG.

  In the example illustrated in FIG. 6, the update unit 111 responds to the user operation # 12 instructing to increase the volume setting value V1 of the portable information terminal 100, and the audibility level # 8 estimated by the estimation unit 120 and the communication unit The state value # 9 corresponding to the radio wave reception level # 4 determined by 102 is updated so as to increase. Further, the update unit 111 is determined by the audibility level # 8 estimated by the estimation unit 120 and the acquisition unit in response to the user operation # 12 indicating that the volume setting value V1 of the portable information terminal 100 is decreased. The state value # 9 corresponding to the radio wave reception level # 4 is updated to be lowered.

  As shown in FIG. 6A, in step S112, the updating unit 111 is an instruction indicating that the change instruction # 13 transmitted from the operation receiving unit 110 in step S110 increases the volume setting value V1. It is determined whether or not. When it is determined that change instruction # 13 transmitted from operation accepting unit 110 in step S110 is an instruction to increase volume setting value V1 (YES in step S112), updating unit 111 performs step S113. Proceed to the process. If it is determined that change instruction # 13 received from operation accepting unit 110 in step S110 is not an instruction to increase volume setting value V1 (NO in step S112), updating unit 111 performs step The process proceeds to S114.

  In step S113, based on the change instruction # 13 received from the operation reception unit 110, the update unit 111 “+1” the state value stored in the corresponding cell in the state estimation table stored in the memory 106. In addition, the state estimation table is updated. Here, the “corresponding cell” is a cell indicating a state determined according to the radio wave reception level # 4 determined in step S102 shown in FIG. 5 and the audibility level # 8 estimated in step S106. Refers to that. More specifically, when the radio wave reception level determined in step S102 is "B" and the audibility level estimated in step S106 is "C", the cell indicating the state (B, C) It is. Therefore, in the state estimation table shown in FIG. 6B, the state value stored in the cell indicating the state (B, C) (the cell indicated by the dashed frame in FIG. 6B) is , “4” is updated to “5”. Further, since the state value stored in the corresponding cell updated in step S113 is equal to or greater than a predetermined threshold, the cell indicating the state (B, C) is a dot in FIG. The hatch is released. After updating the state estimation table, the update unit 111 proceeds to the process of step S114.

  Subsequently, in step S114, the updating unit 111 determines whether or not the change instruction # 13 transmitted from the operation receiving unit 110 in step S110 is an instruction indicating that the volume setting value V1 is to be decreased. When it is determined that change instruction # 13 transmitted from operation accepting unit 110 in step S110 is an instruction to decrease volume setting value V1 (YES in step S114), updating unit 111 performs step S115. Proceed to the process. If it is determined that change instruction # 13 received from operation accepting unit 110 in step S110 is not an instruction to decrease volume setting value V1 (NO in step S114), updating unit 111 is in the state The update process of the estimation table is terminated.

  In step S <b> 115, the updating unit 111 “−1” the state value stored in the corresponding cell in the state estimation table stored in the memory 106 based on the change instruction # 13 received from the operation receiving unit 110. Thus, the state estimation table is updated. For example, when the radio wave reception level determined in step S102 is “D” and the audibility level estimated in step S106 is “B”, the update unit 111 indicates the state (D, B). The state estimation table is updated so that the state value stored in the cell is “−1”. Therefore, in the state estimation table shown in FIG. 6B, the state value stored in the cell indicating the state (D, B) (the cell indicated by the dashed-dotted frame in FIG. 6B). Has been updated from “5” to “4”. Further, since the state value stored in the corresponding cell updated in step S115 is lower than a predetermined threshold, the cell indicating the state (D, B) is a dot hatch in FIG. It is shown in When the process of step S115 is completed, the update unit 111 ends the update process of the state estimation table.

  With the above procedure, the update unit 111 can update the state estimation table stored in the memory 106.

  Therefore, according to said structure, the portable information terminal 100 which concerns on this embodiment can update the state value in a state estimation table separately according to a user's desired volume setting value V1. In other words, the user changes the sound volume setting value V1 to change the sound volume setting value in the state estimation table stored in advance in the memory 106 of the portable information terminal 100 (preset in the device). It can be updated according to V1. Therefore, the portable information terminal 100 according to the present embodiment can output the same voice as the voice output by the voice output device without giving a sense of incongruity to the user.

  In addition, it is also possible to interchange the procedure of the process of step S112-step S113 and the process of step S114-step S115 in the flowchart shown to (a) of FIG. In the present embodiment, the updating unit 111 updates the state value stored in the corresponding cell in the state estimation table stored in the memory 106 to “+1” or “−1”. However, this does not limit the present invention. For example, the updating unit 111 “+2” or “−2” the state value stored in the corresponding cell according to the change amount of the volume setting value V1 of the operation # 12 received by the operation receiving unit 110. You may comprise as follows.

[Embodiment 2]
The following will describe another embodiment of the present invention. For convenience of explanation, members having the same functions as those described in the embodiment are given the same reference numerals, and descriptions thereof are omitted.

  The portable information terminal 100 according to the present embodiment differs from the portable information terminal 100 according to the first embodiment in the processing performed by the update unit 111.

  An example of processing performed by the update unit 111 included in the portable information terminal 100 according to the present embodiment will be described with reference to FIG. FIG. 7 is a conceptual diagram for explaining an example of processing performed by the update unit 111 included in the portable information terminal 100 according to the present embodiment. (A) of FIG. 7 is a flowchart for demonstrating the flow of the process which the update part 111 performs. FIG. 7B shows a state estimation table after the processing shown in FIG. 7A is performed.

  In the example illustrated in FIG. 7, the update unit 111 updates the portable information terminal 100 so as to increase a predetermined threshold in response to the user operation # 12 indicating that the volume setting value V1 of the portable information terminal 100 is increased. In response to user operation # 12 indicating that the volume setting value V1 of the terminal 100 is to be lowered, updating is performed so as to lower a predetermined threshold value. Further, the updating unit 111 may be configured to update the output volume value table stored in the memory 106 in accordance with an update of a predetermined threshold value. More specifically, for example, when the updating unit 111 updates the threshold value from “4” to “5”, the output corresponding to the state values “1” to “5” in the output volume value table. The volume value is set to “0”, and the output volume values associated with the state values “6”, “7”, “8”, and “9” are set to “1”, “2”, “3”, respectively. , And “4”. Further, when the threshold value is updated from “4” to “3”, the updating unit 111 sets the output volume value associated with the state values “1” to “3” to “0” in the output volume value table. And the output volume values associated with the state values “4”, “5”, “6”, “7”, “8”, and “9” are set to “1”, “2”, “ “3”, “4”, “5”, “6”.

  As shown in FIG. 7A, in step S112, the updating unit 111 is an instruction indicating that the change instruction # 13 transmitted from the operation receiving unit 110 in step S110 increases the volume setting value V1. It is determined whether or not. When it is determined that change instruction # 13 transmitted from operation accepting unit 110 in step S110 is an instruction to increase volume setting value V1 (YES in step S112), updating unit 111 performs step S116. Proceed to the process. If it is determined that change instruction # 13 received from operation accepting unit 110 in step S110 is not an instruction to increase volume setting value V1 (NO in step S112), updating unit 111 performs step The process proceeds to S114.

  In step S116, the updating unit 111 updates the threshold stored in the memory 106 to “+1” based on the change instruction # 13 received from the operation receiving unit 110. In FIG. 7B, the threshold value (indicated by the dashed-dotted frame) is updated from “5” to “6”. In addition, since the threshold value is updated to “6” in step S115, the cells (state (E, A), state (D, B), state (C, C), state where state value “5” is stored) are stored. (B, D) and a cell indicating each of the states (A, E) (indicated by a broken-line frame in FIG. 7B) are dot hatches to indicate that they are below the threshold value. It is shown in When the update unit 111 updates the threshold value, the update unit 111 proceeds to the process of step S114.

  Subsequently, in step S114, the updating unit 111 determines whether or not the change instruction # 13 transmitted from the operation receiving unit 110 in step S110 is an instruction indicating that the volume setting value V1 is to be decreased. When it is determined that change instruction # 13 transmitted from operation accepting unit 110 in step S110 is an instruction to decrease volume setting value V1 (YES in step S114), update unit 111 performs step S117. Proceed to the process. If it is determined that change instruction # 13 received from operation accepting unit 110 in step S110 is not an instruction to decrease volume setting value V1 (NO in step S114), updating unit 111 is in the state The update process of the estimation table is terminated.

  In step S117, the updating unit 111 updates the threshold stored in the memory 106 to “−1” based on the change instruction # 13 received from the operation receiving unit 110. Since the threshold value is updated to “5” in step S117, the cells (state (E, A), state (D, B), state (C, C), state (B , D), and a cell indicating each of the states (A, E) (indicated by a broken-line frame in FIG. 7B) indicate a value equal to or higher than the threshold value. Therefore, the state estimation table stored in the memory 106 transitions from the state estimation table shown in FIG. 7B to the state estimation table shown in FIG. When the process of step S115 is completed, the update unit 111 ends the update process of the state estimation table.

  With the above procedure, the updating unit 111 can update the threshold value stored in the memory 106.

  Therefore, according to said structure, the portable information terminal 100 which concerns on this embodiment can update a predetermined threshold value according to a user's desired volume setting value V1. In other words, the user can update the threshold value preset in the portable information terminal 100 (preset in the apparatus) according to the changed volume setting value V1 by changing the volume setting value V1. it can. Therefore, the portable information terminal 100 can output the same voice as the voice output by the voice output device without giving a sense of incongruity to the user.

  In addition, it is also possible to interchange the procedure of the process of step S112-step S116 and the process of step S114-step S117 in the flowchart shown to (a) of FIG. Further, in the present embodiment, the update unit 111 is configured to update the threshold value stored in the memory 106 so that the threshold value associated with the state estimation table is “+1” or “−1”. However, this does not limit the present invention. For example, the update unit 111 may be configured to set the threshold value to “+2” or “−2” in accordance with the change amount of the volume setting value V1 of the operation # 12 received by the operation receiving unit 110. .

[Embodiment 3]
The following will describe another embodiment of the present invention. For convenience of explanation, members having the same functions as those described in the embodiment are given the same reference numerals, and descriptions thereof are omitted.

  The portable information terminal 100 according to the present embodiment differs from the portable information terminal 100 according to other embodiments in the processing performed by the selection unit 107.

  In the present embodiment, the selection unit 107 does not use the radio wave reception level # 4 supplied from the communication unit 102, but based on only the audibility level # 8 supplied from the estimation unit 120, the state of the portable information terminal 100 The structure which estimates is adopted.

  Therefore, in the present embodiment, the state estimation table stored in the memory 106 is a table in which a specific state value is associated with each of the hearing level values A to E. That is, state values (1 to 5) are associated with the audibility levels (A to E). In the present embodiment, the threshold is set to “3”, for example.

  In the present embodiment, when the audibility level # 8 estimated by the estimation unit 120 is “A” or “B”, the associated state value is below the threshold (1-2), so the selection is performed. The unit 107 selects not to output the sound represented by the first sound signal # 5 from the speaker 109. Similarly, when the audibility level # 8 estimated by the estimation unit 120 is “C”, “D”, or “E”, the associated state value is equal to or greater than the threshold (3 to 5). Therefore, the selection unit 107 selects to output the sound represented by the first sound signal # 5 from the speaker 109. The selection unit 107 determines the output volume value # 11 by referring to the output volume value table as shown in Table 1.

  With the above configuration, the portable information terminal 100 according to the present embodiment can estimate the state of the portable information terminal 100 based only on the audibility level # 8 estimated by the estimation unit 120.

  Therefore, according to said structure, the portable information terminal 100 which concerns on this embodiment selects the volume at the time of outputting the audio | voice same as the audio | voice which the audio | voice output apparatus 200 outputs according to the surrounding environment of an own terminal. can do.

[Embodiment 4]
The following will describe another embodiment of the present invention. For convenience of explanation, members having the same functions as those described in the embodiment are given the same reference numerals, and descriptions thereof are omitted.

  The portable information terminal 100 according to the present embodiment differs from the portable information terminal 100 according to other embodiments in the processing performed by the estimation unit 120.

  In the portable information terminal 100 according to the present embodiment, the estimation unit 120 functions as a calculation unit that calculates the similarity between the first audio signal # 5 and the second audio signal # 7 using a cross-correlation function. Then, based on the calculated similarity, the audibility level of the output sound included in the detected sound is estimated.

  Specifically, the estimation unit 120 uses the cross-correlation function to obtain the first audio signal # 5 supplied from the audio decoding unit 103 and the second audio signal # 7 supplied from the conversion unit 105. The similarity is calculated.

  For example, when the calculated similarity is 100%, the output sound output from the audio output device 200 matches the detected sound detected by the microphone 104 of the portable information terminal 100. That is, it can be estimated that the output sound output from the audio output device 200 is in a state where the sound has sufficiently reached the user of the portable information terminal 100. For example, when the calculated similarity is 0%, the output sound output from the audio output device 200 and the detection sound detected by the microphone 104 of the portable information terminal 100 do not match. . That is, it can be estimated that the output sound output from the audio output device 200 has not reached the user of the portable information terminal 100. Shows the case. Furthermore, for example, when the calculated similarity is 50%, the output sound output from the audio output device 200 and the detection sound detected by the microphone 104 of the portable information terminal 100 partially match. Is the case. That is, it can be estimated that the output sound output from the audio output device 200 reaches the user of the portable information terminal 100, but the volume of the output sound is attenuated.

  The estimation unit 120 assigns a hearing level according to the calculated similarity. For example, when the similarity is 80% or more and 100% or less, the audibility level is assigned as “A”. Similarly, when the similarity is 60% or more and less than 80%, the audibility level is “B”, and when the similarity is 40% or more and less than 60%, the audibility level is “C” and the similarity is 20%. As described above, the audibility level may be assigned as “D” when it is less than 60%, and the audibility level may be assigned as “E” when the similarity is 0% or more and less than 20%.

  With the above configuration, the estimation unit 120 can estimate the audibility level # 8 according to the degree of similarity between the first audio signal # 5 and the second audio signal # 7.

  Therefore, according to said structure, the portable information terminal 100 which concerns on this embodiment can estimate the audibility level of the output sound contained in a detection sound more correctly.

[Example of software implementation]
The control block (especially the selection unit 107 and the estimation unit 120) of the portable information terminal 100 may be realized by a logic circuit (hardware) formed in an integrated circuit (IC chip) or the like, or a CPU (Central Processing Unit) ) May be implemented by software.

  In the latter case, the portable information terminal 100 includes a CPU that executes instructions of a program that is software that implements each function, and a ROM (Read Only Memory) in which the program and various data are recorded so as to be readable by a computer (or CPU). ) Or a storage device (these are referred to as “recording media”), a RAM (Random Access Memory) for expanding the program, and the like. And the objective of this invention is achieved when a computer (or CPU) reads the said program from the said recording medium and runs it. As the recording medium, a “non-temporary tangible medium” such as a tape, a disk, a card, a semiconductor memory, a programmable logic circuit, or the like can be used. The program may be supplied to the computer via an arbitrary transmission medium (such as a communication network or a broadcast wave) that can transmit the program. The present invention can also be realized in the form of a data signal embedded in a carrier wave in which the program is embodied by electronic transmission.

[Summary]
The portable information terminal 100 according to the first aspect of the present invention is a portable information terminal that operates in cooperation with the audio output device 200, and is a first audio signal (the first audio signal representing the output sound output by the audio output device). 1 audio signal # 5) is acquired from the audio output device (antenna 101, communication unit 102, audio decoding unit 103), the first audio signal, and the portable information terminal are incorporated in or connected to the portable information terminal. Based on the second sound signal (second sound signal # 7) representing the detected sound detected by the microphone (microphone 104), the detected sound with respect to the volume of the output sound output by the sound output device Based on the volume ratio estimated by the estimation means (estimation unit 120) for estimating the volume ratio (audibility level # 8) that is the volume ratio of the output sound included, the portable information terminal Built-in or connected The includes a speaker selection means for selecting the volume of the sound represented by the first audio signal output from the (speaker 109) (selection unit 108), the.

  According to the above configuration, the portable information terminal 100 has an audibility that indicates a volume ratio that is a ratio of the volume of the output sound included in the detected sound detected by the microphone 104 to the volume of the output sound output by the audio output device 200. Estimate the level. That is, the portable information terminal 100 can estimate the audibility level at the current location of the terminal, and can select the sound volume acquired from the audio output device based on the estimated audibility level.

  Therefore, according to said structure, the audio | voice output function of an audio | voice output apparatus can be supplemented with a portable information terminal. In particular, since a configuration is employed in which the sound volume when outputting the same sound as the sound output from the sound output device from the portable information terminal is selected based on the sound volume ratio, a user in the vicinity of the sound output device can be selected. The sound provided to the user far away from the sound output device can be set to a good sound volume without causing a situation where the sound volume of the sound provided becomes excessive.

  In the portable information terminal 100 according to the second aspect of the present invention, in the first aspect, the acquisition unit receives the first audio signal by receiving an electromagnetic wave including the first audio signal from the audio output device. In addition to obtaining, the radio wave reception level (radio wave reception level # 4) indicating the intensity of the received electromagnetic wave is determined, and the selection unit is determined by the acquisition unit in addition to the volume ratio estimated by the estimation unit. It is preferable to select a sound volume represented by the first sound signal output from the speaker by referring to the radio wave reception level.

  According to said structure, the portable information terminal 100 determines the radio wave reception level which shows the intensity | strength of the electromagnetic waves received when acquiring the 1st audio | voice signal from the audio | voice output apparatus 200. FIG. Further, the portable information terminal 100 can select the volume of the sound acquired from the sound output device based on the audibility level estimated by the estimation unit 120 and the radio wave reception level determined by the communication unit 102. .

  Therefore, according to the above configuration, the portable information terminal can more accurately estimate the surrounding environment of the portable information terminal, so that the voice output function of the voice output device is complemented by the portable information terminal. Can do.

  In the portable information terminal 100 according to the third aspect of the present invention, in the first or second aspect, the acquisition unit acquires the volume setting value V2 in the audio output device in addition to the first audio signal. And the estimation means delays the volume of the sound represented by the first sound signal based on the sound volume setting value (volume level correction unit 121) and the second sound signal. Thus, a delay correcting unit (delay correcting unit 122) for eliminating a delay of the first audio signal with respect to the second audio signal, and a noise removing unit (noise) for removing noise included in the second audio signal. And a calculating unit (comparison) for calculating a ratio between the volume of the first audio signal whose volume level is corrected and the volume of the second audio signal whose delay is corrected and noise-removed. It is preferable ,, which has a 124) and.

  According to the above configuration, the phase of the first audio signal # 20 whose volume level is corrected and the phase of the second audio signal # 22 whose delay is corrected and noise-removed can be synchronized. The comparison unit 124 calculates a ratio between the volume of the first audio signal # 20 whose volume level is corrected and the volume of the second audio signal # 22 whose delay is corrected and noise-removed. The estimation unit 120 can estimate the audibility level # 8 of the output sound included in the detection sound based on the calculation result by the comparison unit 124.

  Therefore, according to said structure, the audibility level of the output sound contained in a detection sound can be estimated more correctly.

  In portable information terminal 100 according to aspect 4 of the present invention, in aspect 2 or 3, the selection means associates a specific state value with each pair of a volume ratio value and a radio wave reception level value. The state estimation table is referred to, and the state value (state value # 9) corresponding to the pair consisting of the volume ratio estimated by the estimation unit and the radio wave reception level determined by the acquisition unit is specified, and It is preferable to select a sound volume corresponding to the estimated state value as the sound volume represented by the first sound signal output from the speaker.

  According to said structure, since the portable information terminal 100 can estimate the surrounding environment of the said portable information terminal more correctly, it can complement the audio | voice output function of an audio | voice output apparatus with a portable information terminal. it can.

  The portable information terminal 100 according to the fifth aspect of the present invention is the state value in the state estimation table in response to a user operation instructing to change the volume setting value V1 of the sound output from the speaker in the fourth aspect. Or an update means (update unit 111) for updating at least one of the predetermined threshold values.

  According to the above configuration, since the state value in the state estimation table or the predetermined threshold value can be updated according to the user's desired volume setting value V1, without giving the user a sense of incongruity. The voice output function of the voice output device can be supplemented by a portable information terminal.

  In the portable information terminal 100 according to Aspect 6 of the present invention, in the Aspect 5, the update means responds to a user operation instructing to increase the sound volume setting value V1 output from the speaker, and the state estimation Updating the state value of the table to a larger value, and updating the state value of the state estimation table to a smaller value in response to a user operation instructing to lower the volume setting value V1 of the sound output from the speaker; It is preferable.

  According to said structure, according to a user's desired volume setting value V1, the state value in a state estimation table can be updated separately. In other words, the user changes the sound volume setting value V1 to change the sound volume setting value in the state estimation table stored in advance in the memory 106 of the portable information terminal 100 (preset in the device). It can be updated according to V1.

  Therefore, according to said structure, the portable information terminal 100 can complement the audio | voice output function of an audio | voice output apparatus with a portable information terminal, without giving discomfort to a user.

  In the portable information terminal 100 according to Aspect 7 of the present invention, in the Aspect 5, the updating means is predetermined in response to a user operation instructing to increase the volume setting value V1 of the sound output from the speaker. The threshold value may be updated to a larger value, and the predetermined threshold value may be updated to a smaller value in response to a user operation instructing to lower the sound volume setting value V1 output from the speaker. .

  According to said structure, a predetermined threshold value can be updated according to a user's desired volume setting value V1. In other words, the user can update the threshold value preset in the portable information terminal 100 (preset in the apparatus) according to the changed volume setting value V1 by changing the volume setting value V1. it can.

  Therefore, the portable information terminal 100 can supplement the voice output function of the voice output device with the portable information terminal without giving a sense of incongruity to the user.

  In the portable information terminal 100 according to Aspect 8 of the present invention, in the Aspects 1 to 7, the selecting means outputs the voice represented by the first voice signal based on the volume ratio estimated by the estimating means. It is preferable to select whether to output from the speaker.

  According to said structure, the audio | voice output function of an audio | voice output apparatus can be supplemented with a portable information terminal. In particular, since it adopts a configuration that selects whether or not the same audio as the audio output from the audio output device is output from the portable information terminal based on the volume ratio, it is provided to users in the vicinity of the audio output device The sound provided to the user who is far away from the sound output device can be made to have a good sound volume without causing a situation that the sound volume of the sound is excessive.

  A portable information terminal 100 according to an aspect 9 of the present invention is a portable information terminal that operates in cooperation with the audio output device 200, and is a first audio signal (the first audio signal representing the output sound output by the audio output device). 1 audio signal # 5) is acquired from the audio output device (antenna 101, communication unit 102, audio decoding unit 103), the first audio signal, and the portable information terminal are incorporated in or connected to the portable information terminal. Calculating means (estimating unit 120) for calculating the correlation with the second sound signal (second sound signal # 7) representing the detected sound detected by the microphone (microphone 104), and the correlation calculated by the calculating means And a selection means (selection unit 107) for selecting the volume of the voice represented by the first voice signal output from the speaker built in or connected to the portable information terminal.

  According to said structure, the estimation part 120 can estimate hearing level # 8 according to the correlation with 1st audio | voice signal # 5 and 2nd audio | voice signal # 7.

  Therefore, according to said structure, the audibility level of the output sound contained in a detection sound can be estimated more correctly.

  A control method for a portable information terminal according to aspect 10 of the present invention is a control method for a portable information terminal that operates in cooperation with an audio output device, and is a first method that represents an output sound output by the audio output device. Based on an acquisition step of acquiring an audio signal from the audio output device, the first audio signal, and a second audio signal representing a detected sound detected by a microphone built in or connected to the portable information terminal. An estimation step for estimating a volume ratio that is a ratio of a volume of the output sound included in the detection sound to a volume of the output sound output by the audio output device, and a volume ratio estimated in the estimation step And a selection step of selecting a sound volume represented by the first sound signal output from a speaker built in or connected to the portable information terminal.

  According to said structure, there exists an effect similar to said portable information terminal.

  A control method for a portable information terminal according to an aspect 11 of the present invention is a control method for a portable information terminal that operates in cooperation with an audio output device, and is a first method that represents an output sound output by the audio output device. A correlation between an acquisition step of acquiring an audio signal from the audio output device, the first audio signal, and a second audio signal representing a detected sound detected by a microphone built in or connected to the portable information terminal. A calculation step for calculating, and a selection step for selecting the volume of the voice represented by the first audio signal output from a speaker built in or connected to the portable information terminal based on the correlation calculated in the calculation step And.

  According to said structure, there exists an effect similar to said portable information terminal.

  The portable information terminal according to each aspect of the present invention may be realized by a computer. In this case, the portable information terminal is made to operate on the computer by causing the computer to operate as each unit included in the portable information terminal. The control program for the portable information terminal to be realized and the computer-readable recording medium on which the control program is recorded also fall within the scope of the present invention.

[Additional Notes]
The present invention is not limited to the above-described embodiments, and various modifications are possible within the scope shown in the claims, and embodiments obtained by appropriately combining technical means disclosed in different embodiments. Is also included in the technical scope of the present invention. Furthermore, a new technical feature can be formed by combining the technical means disclosed in each embodiment.

  The present invention can be suitably used for a portable information terminal operating in cooperation with an audio output device.

100 portable information terminal 101 antenna (acquisition means)
102 Communication unit (acquisition means)
103 Audio decoding unit (acquisition means)
104 Microphone 105 Conversion unit 106 Memory 107 Selection unit (selection means)
108 audio output unit 109 speaker 110 operation reception unit 111 update unit (update means)
120 Estimating unit (estimating means, calculating means)
121 Volume level correction unit (volume correction means)
122 Delay correction section (delay correction means)
123 Noise removal processing unit (noise removal processing means)
124 comparison unit (calculation means)
DESCRIPTION OF SYMBOLS 200 Audio | voice output apparatus 201 Antenna 202 Tuner part 203 External input part 204 Audio | voice encoding part 205 Audio | voice output part 206 Speaker 207 Communication part 208 Antenna 209 Memory 210 Operation reception part

Claims (5)

A portable information terminal that operates in cooperation with an audio output device,
Obtaining means for obtaining a first audio signal representing an output sound output from the audio output device from the audio output device;
Based on the first audio signal and the second audio signal representing the detected sound detected by the microphone built in or connected to the portable information terminal, the volume of the output sound output by the audio output device Estimating means for estimating a volume ratio that is a ratio of volume of the output sound included in the detected sound;
Selecting means for selecting a sound volume represented by the first sound signal output from a speaker built in or connected to the portable information terminal based on the sound volume ratio estimated by the estimating means; ,
A portable information terminal characterized by that. The acquisition means acquires the first audio signal by receiving the electromagnetic wave including the first audio signal from the audio output device, determines a radio wave reception level indicating the intensity of the received electromagnetic wave,
The selection unit refers to the radio wave reception level determined by the acquisition unit in addition to the volume ratio estimated by the estimation unit, and thereby the volume of the voice represented by the first audio signal output from the speaker. Select
The portable information terminal according to claim 1. The acquisition means acquires a volume setting value in the audio output device in addition to the first audio signal,
The estimation means is
Sound volume correcting means for correcting the sound volume represented by the first sound signal based on the sound volume setting value;
Delay correcting means for eliminating a delay of the first audio signal with respect to the second audio signal by delaying the second audio signal;
Noise removing means for removing noise contained in the second audio signal;
Calculating means for calculating a ratio of the volume of the first audio signal whose volume level is corrected and the volume of the second audio signal whose delay is corrected and noise-removed;
The portable information terminal according to claim 1, wherein the portable information terminal is a portable information terminal.   The selection means refers to a state estimation table in which a specific state value is associated with each pair of a volume ratio value and a radio wave reception level value, and the volume ratio estimated by the estimation means and the acquisition means The state value corresponding to the pair consisting of the radio wave reception level determined by the above is specified, and the sound volume corresponding to the estimated state value is selected as the sound volume represented by the first sound signal output from the speaker. The portable information terminal according to claim 2 or 3, characterized by the above-mentioned. A method for controlling a portable information terminal operating in cooperation with an audio output device,
Obtaining a first audio signal representing an output sound output from the audio output device from the audio output device;
Based on the first audio signal and the second audio signal representing the detected sound detected by the microphone built in or connected to the portable information terminal, the volume of the output sound output by the audio output device An estimation step of estimating a volume ratio that is a ratio of volume of the output sound included in the detected sound;
Selecting a sound volume represented by the first sound signal output from a speaker built in or connected to the portable information terminal based on the sound volume ratio estimated in the estimating step. A method for controlling a portable information terminal.

Images