JP2014045416A - Portable terminal, voice control program, and voice control method - Google Patents

Abstract

PROBLEM TO BE SOLVED: To provide a portable terminal, a voice control program, and a voice control method capable of preventing a voice from being heard redundantly.SOLUTION: A mobile phone 10 comprises a processor 12 and when a user gives an instruction to execute the Internet speech program, starts Internet speech processing in accordance with the instruction from the processor. In a case where three or more persons perform the Internet speech, the processor detects distances to the other terminals. If detecting one of the other terminals positioned in the vicinity as a result of detecting the distances, in a case where a predetermined condition is satisfied, at least one of a microphone 20 and a speaker 26 is turned off. Similar processing is executed by each terminal participating in the speech session of the Internet speech. Consequently, the microphone of one terminal among the plural terminals positioned in the vicinity (including the mobile phone 10) is used and the speaker of the one terminal or the other terminal is used. It is possible to prevent a voice from being heard redundantly.

Description

  The present invention relates to a portable terminal, a voice control program, and a voice control method, and more particularly, to a portable terminal, a voice control program, and a voice control method used for, for example, an Internet call.

  An example of background art is disclosed in Patent Document 1. In the remote conference system of Patent Document 1, a plurality of conference rooms are provided at remote locations, and each conference room is provided with one conference terminal connected to the LAN.

Another example of the background art is disclosed in Patent Document 2. The conference system of Patent Document 2 is installed at each base and includes a conference terminal device. A plurality of microphones are connected to the conference terminal device, one microphone is selected from the plurality of microphones according to a selection algorithm included in the conference control program, and audio signals corresponding to microphones other than the selected microphone are ignored. . Accordingly, the number of input audio signals is limited to one, and the conference always proceeds based on the voice of one speaker at each site.
JP2007-60460A [H04M 3/56, H04R 3/00, H04R 1/40] JP 2006-211504 A [H04M 3/56, H04M 11/00, H04N 7/15]

  However, the conference systems of Patent Document 1 and Patent Document 2 install one conference terminal (conference terminal) at each point (base), and the Internet in which users who participate in the conference use mobile terminals respectively. It is not intended to be used for conferences over calls. Therefore, for example, when a plurality of users at a certain point meet with users at other points, when a plurality of users at a certain point are present in the vicinity, the plurality of users have their own mobile phones. It is necessary to turn off the microphone of the terminal, turn off the speaker (including reduction of the output level), or execute both of them. In other words, it is necessary to decide by discussion with other users whether to turn off the microphone or speaker of a mobile terminal or perform operations such as turning off the microphone or speaker each time an Internet call is made. Yes and troublesome.

  As described above, an operation such as turning off a microphone or a speaker is necessary because when one user out of a plurality of users in the vicinity speaks, the voice of the user is This is because it can be heard directly by other users in the vicinity and through the portable terminal of the other users. In this case, the voice of the uttered user can be heard by the user at another point (remote) through his / her portable terminal and the portable terminals of other users in the vicinity. Furthermore, when a user who exists at another point speaks, the voice of the user who exists at the other point is output from the speakers of the respective mobile terminals of the plurality of users who exist at the certain point. In other words, in the Internet call using the Internet or / and a telephone line network, the delay time due to communication differs for each portable terminal. For this reason, when a hands-free call is made, the same voice can be heard from the speakers of the respective mobile terminals with different times.

  In Patent Document 2, a microphone is selected in order to limit the number of input audio signals to one. However, since one conference terminal device is installed at each site, a microphone is temporarily installed. Even if a certain speaker's voice is detected by a plurality of microphones without making a selection, a plurality of voice signals are transmitted through the same route, so it is considered that the other party will not hear the voice redundantly. .

  Therefore, a main object of the present invention is to provide a novel portable terminal, voice control program, and voice control method.

  Another object of the present invention is to provide a portable terminal, a voice control program, and a voice control method that can prevent voices from being heard in duplicate.

  The present invention employs the following configuration in order to solve the above problems. The reference numerals in parentheses, supplementary explanations, and the like indicate the corresponding relationship with the embodiments described in order to help understanding of the present invention, and do not limit the present invention.

  A first aspect of the present invention is a portable terminal that transmits voice data corresponding to a user's voice input through a microphone to a network and outputs the other party's voice data received from the network from a speaker. When there is a distance detection unit that detects a distance to another terminal, and another terminal whose distance detected by the distance detection unit is less than the predetermined distance, when a predetermined condition is satisfied, at least one of a microphone and a speaker It is a portable terminal provided with the audio | voice control part which turns off.

  In the first aspect, the portable terminal (10) transmits voice data corresponding to the user's voice input through the microphone (20) to the network (52, 54), and the voice data of the other party received from the network. Is output from the speaker (26). A distance detection part (12, 14, 42, S51-S75) detects the distance with another terminal. The voice control unit turns off at least one of the microphone and the speaker when a predetermined condition is satisfied when there is another terminal whose distance detected by the distance detection unit is less than the predetermined distance. For example, the predetermined distance is a distance at which the voice of the user of the mobile terminal or the user of another terminal can be input from or directly heard from the microphone of the other terminal as well as the microphone of the own terminal, Moreover, it is the distance which the other party's audio | voice can hear from the speaker of not only the speaker of an own terminal but another terminal.

  According to the first aspect, when the distance to the other terminal is less than the predetermined distance and the predetermined condition is satisfied, at least one of the microphone and the speaker is turned off, so that it is possible to prevent the sound from being heard twice. can do.

  A second aspect is dependent on the first aspect, and the predetermined condition is at least a first condition for determining whether to turn off the speaker and a second condition for determining whether to turn off the microphone. Including one.

  In the second aspect, the predetermined condition includes a first condition (S5) for determining whether to turn off the speaker and a second condition (S21) for determining whether to turn off the microphone. For example, the first condition and the second condition may be different contents or the same contents.

  According to the second aspect, since at least one of the first condition and the second condition is set, at least one of the microphone and the speaker can be appropriately turned off according to the condition.

  The third aspect is dependent on the second aspect, and the first condition includes that the speaker is preset to be turned off.

  In the third embodiment, the first condition is that the speaker is preset to be turned off. For example, the user determines the terminal that turns off the speaker and the terminal that does not turn off by discussing with the other user in advance.

  According to the third aspect, it is not necessary to determine a terminal for turning off the speaker between users every time an internet call is made or to turn off the speaker each time. That is, troublesome operations can be reduced.

  A fourth aspect is dependent on the second aspect, and the first condition includes at least one of a speaker output level lower than that of the other terminal and participation in a call after the other terminal.

  In the fourth aspect, the first condition includes that the output level of the speaker is lower than that of the other terminal, that the speaker participates in a call (Internet call) later than the other terminal, or both. .

  Also in the fourth aspect, troublesome operations can be reduced as in the third aspect.

  A fifth aspect is dependent on the second aspect of the invention, and the second condition includes participation in a call later than other terminals.

  In the fifth aspect, the second condition includes participation in a call (Internet call) later than other terminals.

  According to the fifth aspect, since it is not necessary to determine a microphone to be turned off between users every time an Internet call is made or to turn off the microphone each time, troublesome operations can be reduced.

  A sixth aspect is dependent on the second aspect, further comprising an input level transmission / reception unit that transmits / receives an input level of the microphone to / from another terminal existing within a predetermined distance, and the second condition is It includes that the input level is lower than the input level of the microphone of another terminal existing within a predetermined distance.

  In the sixth aspect, the input level transmitting / receiving unit (12, 14, 38, S17, S19) transmits / receives the input level of the microphone to / from another terminal existing within a predetermined distance. The second condition includes that the input level of the microphone is lower than the input level of the microphone of another terminal existing within a predetermined distance. That is, the microphone with the highest input level is used among a plurality of terminals located in the vicinity.

  According to the 6th aspect, since the microphone with the highest input level is used, the voice of the user who exists near can also be inputted reliably.

  A seventh aspect is dependent on any of the first to sixth aspects, wherein the distance detection unit includes an ultrasonic transmission / reception unit that transmits / receives an ultrasonic signal including time information, and the distance detection unit includes ultrasonic transmission / reception. When the unit receives an ultrasonic signal from another terminal, the distance to the other terminal is calculated based on the time information included in the ultrasonic signal.

  In the seventh aspect, the distance detection unit includes an ultrasonic transmission / reception unit (12, 42, S59, S65), and the ultrasonic transmission / reception unit transmits an ultrasonic signal including time information to a terminal located nearby. Send and receive with. When the ultrasonic transmission / reception unit receives an ultrasonic signal from another terminal, the distance detection unit calculates a distance from the other terminal based on time information included in the ultrasonic signal. Specifically, the terminal obtains the difference (time) between the time information (transmission time) included in the received ultrasonic signal and the time when the ultrasonic signal is received, and multiplies the time by the sound speed, thereby Calculate (measure) the distance between them.

  According to the 7th aspect, the distance between terminals can be measured comparatively correctly by transmitting / receiving an ultrasonic signal.

  An eighth aspect is dependent on the seventh aspect, and the ultrasonic transmission / reception unit transmits / receives an ultrasonic signal when there is another terminal having the same base station or access point connected thereto.

  In the eighth aspect, the ultrasonic transmission / reception unit transmits / receives an ultrasonic signal when there is another terminal having the same base station or access point connected thereto. In other words, an approximate distance is captured, and an accurate distance is measured when it is close to a certain distance.

  According to the eighth aspect, since an accurate distance is measured step by step, it is necessary to transmit and receive an ultrasonic signal when other terminals are not located nearby when an approximate positional relationship is captured. There is no. That is, useless power consumption can be suppressed.

  A ninth aspect is a voice control program for a portable terminal that transmits voice data corresponding to a user's voice input through a microphone to a network and outputs the voice data of the other party received from the network from a speaker. In the case where there is a distance detection step for detecting the distance to the other terminal in the processor of the mobile terminal and another terminal whose distance detected in the distance detection step is less than the predetermined distance, when a predetermined condition is satisfied, An audio control program for executing an audio control step of turning off at least one of a microphone and a speaker.

  A tenth aspect is a computer voice control method of transmitting voice data corresponding to a user's voice input through a microphone to a network and outputting the voice data of the other party received from the network from a speaker. The computer (a) detects the distance to the other terminal, and (b) when there is another terminal whose distance detected in step (a) is less than the predetermined distance, when the predetermined condition is satisfied, An audio control method for turning off at least one of a microphone and a speaker.

  In the ninth and tenth aspects, as in the first aspect, it is possible to prevent the sound from being heard twice.

  According to the present invention, when the distance to the other terminal is less than the predetermined distance and the predetermined condition is satisfied, at least one of the microphone and the speaker is turned off, so that it is possible to prevent the sound from being heard twice. Can do.

  The above object, other objects, features, and advantages of the present invention will become more apparent from the following detailed description of embodiments with reference to the drawings.

FIG. 1 is a block diagram showing the electrical configuration of a mobile phone according to an embodiment of the present invention. FIG. 2 is a diagram showing an example of a system using the mobile phone shown in FIG. FIG. 3 is a diagram showing an example of the flow of voice data of the user A when the users A, B, and C have a conversation in the system shown in FIG. FIG. 4 is a diagram showing an example of the flow of voice data of the user B when the users A, B and C have a conversation in the system shown in FIG. FIG. 5 is a diagram showing an example of a memory map of the RAM shown in FIG. FIG. 6 is a flowchart showing a part of the Internet call processing of the processor shown in FIG. FIG. 7 is another part of the internet call processing of the processor shown in FIG. 1, and is a flowchart subsequent to FIG. FIG. 8 is a flowchart showing a part of the distance detection processing of the processor shown in FIG. FIG. 9 is another part of the distance detection process of the processor shown in FIG. 1, and is a flowchart subsequent to FIG. FIG. 10 is a diagram showing another example of the flow of voice data of the user A when the users A, B, and C have a conversation in the system shown in FIG.

  Referring to FIG. 1, a mobile phone 10 according to an embodiment of the present invention includes a processor 12, which includes a telephone line radio communication circuit 14, an A / D converter 18, and a D / A converter. 22, an input device 28, a display driver 30, a flash memory 34, a RAM 36, a short-range wireless communication circuit 38, an ultrasonic transmission / reception device 42, and the like are connected.

  The processor 12 is called a computer or CPU and controls the entire mobile phone 10. The processor 12 has a built-in RTC 12a, and the time (including date) is measured by the RTC 12a. All or part of the program stored in advance in the flash memory 34 is expanded (loaded) in the RAM 36 when used, and the processor 12 executes various processes in accordance with the program expanded in the RAM 36. At this time, the RAM 36 is used as a working area or a buffer area of the processor 12.

  The input device 28 includes hardware keys, and hardware key information (key data) operated by the user is input to the processor 12. Hereinafter, the operation by the hardware key is referred to as “key operation”.

  The input device 28 may include a touch panel and a touch panel control circuit. In such a case, coordinate data corresponding to the operation of the touch panel is input to the processor 12 from the touch panel control circuit. Hereinafter, the operation using the touch panel is referred to as “touch operation”.

  The telephone line wireless communication circuit 14 is, for example, a circuit for performing wireless communication in the CDMA system, and transmits and receives radio waves for voice communication, e-mail, Internet communication, and the like through the telephone line antenna 16. For example, when the user operates the input device 28 or the like to instruct a telephone call (calling), the telephone line wireless communication circuit 14 executes a telephone call process under the instruction of the processor 12, and the telephone line antenna. The telephone call signal is output via 16. The telephone call signal is transmitted to the other party's telephone through the telephone network 54 (see FIG. 2) including the base station. When an incoming call process is performed at the other party's telephone, a communicable state is established, and the processor 12 executes a call process.

  The normal call processing will be specifically described. First, the modulated voice signal transmitted from the other party's telephone is received by the telephone line antenna 16. Next, the received modulated audio signal is demodulated and decoded by the telephone line radio communication circuit 14. The received voice signal obtained by these processes is converted into a voice signal by the D / A converter 22 and then output from the receiver 24 or the speaker 26.

  However, the receiver 24 is used in a handset call in which the user holds the mobile phone 10 and makes a call while touching the ear or cheek. The speaker 26 is used in a hands-free call and has a higher sound pressure than the receiver 24. Received voice is output at level.

  On the other hand, the transmission voice signal captured through the microphone 20 is converted into voice data by the A / D converter 18 and then given to the processor 12. The audio data is subjected to encoding processing and modulation processing by the telephone line wireless communication circuit 14 under the instruction of the processor 12, and is output via the telephone line antenna 16. Therefore, the modulated voice signal is transmitted to the other party's telephone via the telephone line network 54.

  When a telephone call signal from the other party's telephone is received by the telephone line antenna 16, the telephone line wireless communication circuit 14 notifies the processor 12 of an incoming call (incoming call). In response to this, the processor 12 controls the display driver 30 to display the caller information (telephone number or the like) described in the incoming call notification on the display 32. In accordance with these processes, the processor 12 causes the speaker 26 to output a ring tone (sometimes called a ringing melody or a ringing voice). That is, the incoming operation is executed.

  When the user performs a response operation using a call key included in the input device 28 or a response button displayed on the display 32, the telephone line wireless communication circuit 14 performs a telephone call incoming process under the instruction of the processor 12. Execute. Further, a communicable state is established, and the processor 12 executes the above-described call processing.

  When the call end operation is performed using the end call key included in the input device 28 or the end call button displayed on the display 32 after shifting to the call ready state, the processor 12 causes the radio communication circuit 14 for the telephone line to be used. To transmit a call end signal to the other party. Then, after transmitting the call end signal, the processor 12 ends the call process. The processor 12 also terminates the call process when a call end signal is received from the other party first. Furthermore, the processor 12 also ends the call process when a call end signal is received from the telephone line network 54 regardless of the call partner.

  Note that the processor 12 controls the amplification factor (output level) of the amplifier connected to the D / A converter 22 in response to, for example, an operation for adjusting the volume by the user, so that the receiver 24 or the speaker The volume of the sound output from 26 can be adjusted.

  The display driver 52 controls display on the display 32 connected to the display driver 52 under the instruction of the processor 12. The display driver 52 includes a video memory that temporarily stores image data to be displayed. The display 32 is provided with a backlight having, for example, an LED as a light source, and the display driver 52 controls the brightness of the backlight and lighting / extinguishing according to an instruction from the processor 12.

  The short-range wireless communication circuit 38 is a circuit for performing Wi-Fi short-range wireless communication, to which the short-range wireless communication antenna 40 is connected. For example, the short-range wireless communication circuit 38 transmits and receives radio waves for voice calls, electronic mails, or Internet communication through the short-range wireless communication antenna 40. Wi-Fi (Wireless Fidelity) is certified by a predetermined certification authority for the interoperability between wireless devices using the IEEE 802.11 series of communication standards (IEEE 802.11a / b / g / n, etc.). It is a name that indicates that it has been done. That is, Wi-Fi is a method for short-range wireless communication, and the cellular phone 10 uses a Wi-Fi short-range wireless communication circuit 38. In Wi-Fi short-range wireless communication, short-range wireless communication can be established with a device functioning as an access point. Further, when the mobile phone 10 establishes short-range wireless communication with an access point, communication establishment information such as an SSID (Service Set Identifier) and a security key is required.

  The ultrasonic transmission / reception device 42 transmits / receives an ultrasonic signal including arbitrary information. In this embodiment, time information (hour minute second) is included in the ultrasonic signal.

  With the mobile phone 10 having such a configuration, it is possible to make an Internet call with another terminal via a communication network (network) such as the Internet 52 and / or the telephone line network 54 (see FIG. 2). Other terminals may be not only mobile phones 10 of the same type as the mobile phone 10, but also mobile phones provided by other telephone operators, PDAs capable of Internet calling, tablet computers, laptop computers, and the like. . That is, the function for executing normal call processing is not an essential component. In addition, when the distance between the terminals changes dynamically, at least one terminal may be a portable terminal, so that a stationary computer capable of Internet communication is used as another terminal. Also good. However, hereinafter, for the sake of simplicity, the case of making an Internet call using only the mobile phone 10 will be described.

  FIG. 2 shows an example of a system 50 for making an internet call. As shown in FIG. 2, the system 50 includes a communication network such as the Internet 52 and a telephone line network 54, and a plurality of mobile phones 10 are connected to the communication network. In the example shown in FIG. 2, a case where three mobile phones 10 (10a, 10b, 10c) are connected is shown. Good.

  Hereinafter, when it is necessary to distinguish each mobile phone 10, they will be referred to as mobile phones 10a, 10b, and 10c.

  The Internet 52 includes a plurality of access points, and the telephone line network 54 includes a plurality of base stations.

  In the example shown in FIG. 2, when the mobile phones 10a, 10b, and 10c start (execute) Internet call processing, and call sessions are established between the mobile phones 10a, 10b, and 10c, the mobile phones 10a, 10b, Users A, B, and C of 10c can make an internet call. In this case, audio data is transmitted and received via the Internet 52 between the mobile phone 10a and the mobile phone 10c. Audio data is transmitted and received between the mobile phone 10 a and the mobile phone 10 b via the Internet 52 and the telephone line network 54. Similarly, voice data is transmitted and received between the mobile phone 10 b and the mobile phone 10 c via the Internet 52 and the telephone line network 54. At this time, for example, in the cellular phones 10 a and 10 c, audio data is transmitted / received via the short-range wireless communication circuit 38 and the short-range wireless communication antenna 40. On the other hand, in the cellular phone 10b, voice data is transmitted and received through the telephone line wireless communication circuit 14 and the telephone line antenna 16.

  In such a case, (1) when the mobile phone 10a and the mobile phone 10c are located in the vicinity, that is, when the user A and the user C are close enough, when the user A speaks, the voice of the user A Can be heard directly by the user C and from the mobile phone 10a through the mobile phone 10c via the Internet 52. In this case, since the voice data of the user A that can be heard from the speaker 26 of the mobile phone 10c is transmitted and received via the Internet 52, the time difference between the voice of the user A and the voice of the user A that can be heard directly. Occurs. That is, the same utterance content is duplicated and heard by the user C at different times.

  (2) In this case, the audio data corresponding to the voice of the user A is transmitted from the mobile phone 10a to the mobile phone 10b, and also transmitted from the mobile phone 10c located in the vicinity to the mobile phone 10b. The The audio data transmitted from the mobile phone 10a and the audio data transmitted from the mobile phone 10c are usually transmitted through different paths. As described above, the voice data transmitted through different paths are hardly received at the same time by the mobile phone 10b, and therefore, the same utterance content can be heard by the user B at different times.

  (3) On the other hand, when the user B speaks, the voice data corresponding to the voice is received by each of the mobile phones 10a and 10c via the telephone network 54 and the Internet 52, and therefore the mobile phones 10a and 10c User B's voice is output from each. In this case as well, the voice of the user B is hardly output at the same time by the mobile phones 10a and 10c, and the voice of the user B is output from the mobile phones 10a and 10c at different times. Therefore, for example, when the mobile phones 10a and 10c are making a hands-free call, an echo may occur.

  Even when the user C speaks instead of the user A, a situation similar to the situation (1) to (3) may occur.

  In order to avoid the situation (1)-(3) above, for example, the microphone 20 is turned off or the speaker 26 is turned off while leaving one of the mobile phones 10 located in the vicinity. Or just turn it off. However, the mobile phone 10 that does not turn off the microphone 20 may be different from the mobile phone 10 that does not turn off the speaker 26.

  In the case of (1) above, for example, by turning off the speaker 26 of the mobile phone 10c, voice data corresponding to the voice of the user A is output from the mobile phone 10c as shown in FIG. It will not be done. For this reason, it is possible to prevent the user C from hearing the voice of the user A in duplicate.

  However, the same effect can be obtained by turning off the speaker 26 of the mobile phone 10a instead of the speaker 26 of the mobile phone 10c. Even in such a case, since the mobile phone 10a and the mobile phone 10c are located in the vicinity, the voice of the user A is input through the microphone 20 of the mobile phone 10c, and the corresponding voice data is transmitted to the mobile phone 10b. . In this embodiment, the speaker 26 is turned off, but the output level of the speaker 26 may be reduced (set) to 0 (mute).

  In the case of (2) above, for example, when the microphone 20 of the mobile phone 10c is turned off, as shown in FIG. 3B, the audio data corresponding to the voice of the user A becomes the mobile phone. Sent only from 10a. Therefore, it is possible to prevent the user B of the mobile phone 10b from hearing the user A's voice redundantly.

  However, the same effect can be obtained if the microphone 20 of the mobile phone 10a is turned off instead of the microphone 20 of the mobile phone 10c. Even in such a case, as described above, since the mobile phone 10a and the mobile phone 10c are located in the vicinity, the voice of the user A is input from the microphone 20 of the mobile phone 10c, and the corresponding voice data is the mobile phone. 10b. In this embodiment, the microphone 20 is turned off, but the processor 12 may ignore voice data input from the microphone 20 or voice data corresponding to the sound.

  Further, in the case of the above (3), for example, by turning off the speaker 26 of the mobile phone 10c, as shown in FIG. 4, the audio data corresponding to the voice of the user B becomes the speaker 26 of the mobile phone 10a. Is output from only. Therefore, it is possible to prevent the users A and C from hearing the user B's voice redundantly. In such a case, the occurrence of echo can be prevented.

  However, the same effect can be obtained by turning off the speaker 26 of the mobile phone 10a instead of the speaker 26 of the mobile phone 10c. Even in such a case, since the mobile phone 10a and the mobile phone 10c are located in the vicinity, audio data corresponding to the voice of the user B is output from the speaker 26 of the mobile phone 10c.

  As described above, in the mobile phone 10, when another (the other party) mobile phone 10 is located in the vicinity, by turning off the microphone 20 or the speaker 26 of the mobile phone 10 itself or the other mobile phone 10, the same audio is duplicated. Can be avoided.

  However, in the normal mobile phone 10, since the user manually sets the microphone 20 and the speaker 26 on / off, the microphone 20 of which mobile phone 10 and the users of the plurality of mobile phones 10 existing in the vicinity of each other. Whether to turn off the speaker 26 must be discussed each time, which is troublesome. This becomes more troublesome as the number of users who are present in the vicinity and are participating in the same Internet call (call session) increases. Also, the operation of turning off the microphone 20 and the speaker 26 is troublesome.

  Therefore, in this embodiment, the distance between the mobile telephones 10 used by each of a plurality of users participating in the Internet call is detected, and the mobile telephone that satisfies the predetermined condition when the distance is less than the predetermined distance. 10 microphones 20 and speakers 26 are turned off. However, the microphone 20 and the speaker 26 are turned on when the distance is greater than the predetermined distance after the distance is less than the predetermined distance. This is because the distance between the mobile phones 10 changes dynamically, and when the distance is more than a predetermined distance, the same content of voice is hardly heard.

  However, in this embodiment, the on / off of the microphone 20 and the speaker 26 is not controlled according to the individual situations (1) to (3), but the above (1) to (3). The microphone 20 and the speaker 26 are turned on / off so as to avoid all situations.

  In the following, it is assumed that the mobile phone 10 and another terminal (here, another mobile phone 10) participate in the same Internet call (call session). Therefore, even when simply “other terminals” or “other mobile phone 10” is shown, it means that the user is participating in the same Internet call (call session) as the mobile phone 10.

  Here, as described above, the predetermined distance is a distance (for example, 2 to 3 m) at which a voice can be heard in an overlapping manner, and is obtained empirically by experiments or the like. However, in the case of the above (2), it can be said that the distance is such that the voice is input repeatedly.

  The predetermined condition is a condition determined in advance by the developer of the mobile phone 10 or the like. The first condition for determining whether or not the speaker 26 is turned off and whether or not the microphone 20 is turned off are determined. For the second condition.

  In this embodiment, the first condition is that the user sets in advance that the speaker 26 is turned off. As described later, when turning off the speaker 26 is set, a flag (speaker off flag 304c: see FIG. 5) indicating that is turned on. However, the first condition may be a predetermined rule determined in advance. For example, the predetermined rule is that a telephone session (internet call) was later joined, or the output level of the speaker 26 is lower than the output level of the speaker 26 of another mobile phone 10. Therefore, for example, when one of the two predetermined rules is satisfied, it can be determined that the first condition is satisfied. For example, by using the speaker 26 having a high output level, it is possible to make it easy for a nearby user to hear the other party's voice.

  However, when the user sets in advance that the speaker 26 is to be turned off, the speaker 26 is turned off and the plurality of mobile phones 10 that turn off the speaker 26 through prior discussions with other users who make Internet calls. One mobile phone 10 that is not to be determined is determined. The same applies to the case where turning off the microphone 20 is set in advance.

  In this embodiment, the second condition is a predetermined rule determined in advance. Specifically, the predetermined rule is that the input level of the microphone 20 is lower than the input level of the microphone 20 of another mobile phone 10. This is because by using the microphone 20 having a high input level, it is possible to reliably input the voice of a nearby user. However, the predetermined rule may be that a call session (internet call) is joined later. Therefore, for example, when one of the two predetermined rules is satisfied, it can be determined that the second condition is satisfied. Further, the second condition may be that the user has set in advance that the microphone 20 is turned off.

  As described above, the mobile phone 10 of the user participating in the Internet call detects the distance from the mobile phone 10 of another user participating in the Internet call. In this embodiment, an approximate positional relationship is grasped with rough accuracy, and high-precision distance measurement is performed when the distance is close to a certain level. Specifically, the mobile phone 10 transmits the identification information (connection ID) of the base station or access point that it accesses (connects) to the other mobile phone 10 and is transmitted from the other mobile phone 10. A connection ID is received. However, the connection ID is a base station ID or SSID. In the mobile phone 10, when the connection IDs match, it is determined that the distance from the mobile phone 10 with the matching connection ID is closer than a certain distance. However, the distance determined to be close to a certain distance differs between the case where the base station IDs match and the case where the SSIDs match. This is because the range covered by the access point is about 50 m, whereas the range covered by the base station extends to several km.

  When there is another mobile phone 10 that is close to a certain distance, the mobile phone 10 measures the distance by transmitting and receiving an ultrasonic signal to and from the other mobile phone 10. For example, the mobile phone 10 transmits an ultrasonic signal including time information (current time at the time of transmission), and receives an ultrasonic signal including time information from another mobile phone 10. The cellular phone 10 detects time information (current time at transmission) included in the received ultrasonic signal, and calculates a difference (time) from the current time (current time at reception). Then, the distance from the other mobile phone 10 is calculated (measured) by multiplying the calculated time (sec) by the speed of sound (about 340 m / sec). When the distance is calculated, it is determined whether the distance is less than a predetermined distance. Then, when the calculated distance is less than the predetermined distance, it is determined that the other mobile phone 10 is located in the vicinity, that is, the user of the other mobile phone 10 is sufficiently close.

  Here, it is assumed that when there is another mobile phone 10 that is closer than a certain level, it is possible to receive an ultrasonic signal from the other mobile phone 10, but when the base station IDs match, In some cases, an ultrasonic signal cannot be received. This is because the range covered by the base station exceeds the reach of the ultrasonic signal. Thus, when the ultrasonic signal from the other mobile phone 10 is not received, it is determined that the mobile phone 10 and the other mobile phone 10 are not located in the vicinity.

  Further, since the ultrasonic signal is transmitted and received, the distance from the other mobile phone 10 can be detected (measured) relatively accurately.

  Furthermore, when the approximate positional relationship is captured, if another mobile phone 10 is not located nearby, it is not necessary to transmit / receive ultrasonic signals. That is, useless power consumption can be suppressed.

  FIG. 5 shows an example of the memory map 300 of the RAM 36 shown in FIG. As shown in FIG. 5, the RAM 36 includes a program storage area 302 and a data storage area 304. The program storage area 302 stores a control program for the mobile phone 10, and the control program includes a main processing program 302a, a communication program 302b, an Internet call program 302c, a distance detection program 302d, a voice control program 302e, and the like.

  The main processing program 302a is a program for processing the main routine of the mobile phone 10 of this embodiment. The communication program 302b is a program for making a call (execution of normal call processing) with another mobile phone 10 and a fixed phone, or communicating with another mobile phone 10 or a computer.

  The internet call program 302 c is an application program for executing an internet call with one or more other mobile phones 10. The distance detection program 302d is a program for detecting the distance from the mobile phone 10 of another user participating in the Internet call.

  The voice control program 302e is a program for controlling on / off of the microphone 20 and the speaker 26 of the mobile phone 10 according to the distance detected according to the distance detection program 302c and a predetermined condition.

  The program storage area 302 also stores programs for executing other functions (such as alarms, schedules, and e-mails) provided in the mobile phone 10 and arbitrary application programs.

  In the data storage area 304, a transmission / reception data buffer 304a is provided. The transmission / reception data buffer 340 temporarily stores data to be transmitted to the other mobile phone 10 or temporarily stores data received from the other mobile phone 10.

  The data storage area 304 stores distance data 304b. The distance data 304b is data in which the distance from another mobile phone 10 is associated with each other mobile phone 10. However, when the connection IDs do not match or when the ultrasonic signal cannot be received, the distance cannot be calculated. In this case, data indicating that measurement cannot be performed in association with the corresponding mobile phone 10 (for example, null) Data) is stored.

  Further, a speaker off flag 304c is provided in the data storage area 304. The speaker off flag 304c is a flag for determining whether or not to turn off the speaker 26 when another mobile phone 10 is located in the vicinity in an internet call, and is configured by a 1-bit register. When the speaker off flag 304c is on, a data value “1” is set in the register. On the other hand, when the speaker off flag 304c is off, the data value “0” is set in the register. As described above, when another mobile phone 10 is located in the vicinity, if the speaker off flag 304c is on, the speaker 26 is turned off. If the speaker off flag 304c is off, the speaker 26 is on. Remains.

  In the data recording area 304, other data necessary for executing the control program of the mobile phone 10 is stored, and other flags and timers (counters) necessary for executing the control program are provided.

  6 and 7 are flowcharts of the Internet call process of the processor 12 shown in FIG. When the user instructs execution of the Internet call program 302c and calls a partner to call or responds to a call from the partner to establish a call session, the processor 12 starts Internet call processing.

  Note that the user can set whether to use Wi-Fi. When it is set not to use Wi-Fi, the mobile phone 10 is connected to the Internet 52 via the telephone line network 54 using the telephone line wireless communication circuit 14. In addition, when it is set to use Wi-Fi, the mobile phone 10 searches for an access point using the short-range wireless communication circuit 38 and, as a result of the search, for example, an access having the strongest radio wave intensity. It is connected to the Internet 52 so as to access the point. However, even if it is set to use Wi-Fi, if there is no access point in the vicinity or if the radio wave intensity is extremely weak, the telephone line network 54 is not used without using Wi-Fi. It is connected to the Internet 52 via

  When the Internet call process is started and a call session is established, a list (participant list) describing identification information (terminal ID) for each of the other mobile phones 10 that have established the call session is provided for each mobile phone. 10 is managed. However, each mobile phone 10 notifies the other mobile phone 10 of its own terminal ID when establishing a call session. For example, the terminal ID is the MAC address of the telephone line wireless communication circuit 14 or the short-range wireless communication circuit 38 used for Internet calls. Further, when another mobile phone 10 participates in the communication session later or leaves the call session on the way, the participant list is updated.

  As shown in FIG. 6, when starting the Internet call process, the processor 12 determines whether or not a call is made by three or more people in step S1. Here, the processor 12 determines whether or not a call session has been established with two or more other mobile phones 10 by detecting the number of terminal IDs of the other mobile phones 10 that have established a call session.

  If “NO” in the step S1, that is, if not speaking by three or more people, the process proceeds to a step S7. On the other hand, if “YES” in the step S1, that is, if a call is made by three or more people, the distance is acquired in a step S3. Here, the distance data 304b stored in the data storage area 304 is acquired. As will be described later, when the internet call is started, the distance detection process with respect to the other mobile phone 10 is executed every predetermined time (for example, 2 to 5 seconds) separately from the internet call process. Is stored (updated).

  In the next step S5, it is determined whether there is another mobile phone 10 within a predetermined distance. That is, the processor 12 determines whether another mobile phone 10 is located in the vicinity. If “NO” in the step S5, that is, if there is no other mobile phone 10 within a predetermined distance, the speaker 26 is turned on in the step S7, the microphone 20 is turned on in the step S9, and the step of FIG. Proceed to S25. However, when the speaker 26 and the microphone 20 are already turned on, the processes of step S7 and step S9 are not executed.

  On the other hand, if “YES” in the step S5, that is, if there is another mobile phone 10 within a predetermined distance, it is determined whether or not the speaker off flag 304c is turned on in a step S11. If “NO” in the step S11, that is, if the speaker off flag 304c is turned off, the process proceeds to a step S15 shown in FIG. 7 as it is. On the other hand, if “YES” in the step S11, that is, if the speaker off flag 304c is turned on, the speaker 26 is turned off in a step S13, and then the process proceeds to the step S15.

  As shown in FIG. 7, in step S15, the input level of the microphone 20 is detected. Here, the processor 12 acquires the set value of the input level of the microphone 20. In the next step S17, the input level acquired in step S15 is transmitted. Specifically, the processor 12 transmits information on the set value of the input level to another mobile phone 10 in the vicinity. However, the setting value information of the input level may be transmitted from the short-range wireless communication circuit 38 or may be transmitted from the ultrasonic transmission / reception device 42.

  In the next step S19, it is determined whether or not an input level has been received from all other mobile phones 10 located in the vicinity. That is, the processor 12 determines whether or not the input level setting value information transmitted from all other mobile phones 10 located in the vicinity has been received.

  If “NO” in the step S19, that is, if there is another mobile phone 10 that has not received the input level, the process returns to the same step S19. On the other hand, if “YES” in the step S19, that is, if the input level is received from all other mobile phones 10 located in the vicinity, whether or not the detected input level is equal to or higher than the received input level in the step S21. Judging. That is, the processor 12 determines whether or not the input level set in the own device is equal to or higher than the input level set in the other mobile phone 10. However, when there are a plurality of other mobile phones 10 located in the vicinity, the processor 12 determines whether or not the input level of the own device is the maximum.

  If “YES” in the step S21, that is, if the detected input level is equal to or higher than the received input level, the process proceeds to a step S25 as it is. On the other hand, if “NO” in the step S21, that is, if the detected input level is lower than the received input level, the microphone 20 is turned off in a step S23, and the process proceeds to the step S25.

  In step S25, it is determined whether the call has ended. Here, the processor 12 determines whether the user has instructed to end the Internet call or whether all other users have ended the Internet call.

  If “NO” in the step S25, that is, if the call is not ended, the process returns to the step S1 shown in FIG. 6 as it is. Therefore, even if the microphone 20 or the speaker 26 is once turned off, if the number of people on the Internet call becomes two or the other mobile phone 10 is not located within a predetermined distance after that, the microphone 20 and the speaker 26 are turned on. That is, the microphone 20 and the speaker 26 are turned on / off according to the number of people and the distance that dynamically change, and the input and output of sound are appropriately controlled. On the other hand, if “YES” in the step S25, that is, if the call is ended, the Internet call process is ended.

  8 and 9 are flowcharts of distance detection processing of the processor 12 shown in FIG. As described above, when the Internet call process is started, the distance detection process is executed in parallel every predetermined time.

  As shown in FIG. 8, when the distance detection process is started, the processor 12 acquires the connection ID of the currently connected access point or base station in step S51. In the next step S53, the acquired connection ID is transmitted to all other mobile phones 10. At this time, when the mobile phone 10 is connected to the base station, the processor 12 transmits data including the connection ID from the telephone line wireless communication circuit 14 and the telephone line antenna 16. On the other hand, when the mobile phone 10 is connected to the access point, the processor 12 transmits data including the connection ID from the short-range wireless communication circuit 38 and the short-range wireless communication antenna 40. However, the data including the connection ID includes the terminal ID of the transmission source terminal (mobile phone 10) as header information.

  Subsequently, in step S55, it is determined whether or not the connection ID has been received from all the other mobile phones 10 with reference to the participant list. If “NO” in the step S55, that is, if another mobile phone 10 that has not received the connection ID remains, the process returns to the same step S55. On the other hand, if “YES” in the step S55, that is, if connection IDs are received from all other mobile telephones 10, there is a connection ID that matches the acquired connection ID in the received connection IDs in a step S57. Determine whether or not. That is, the processor 12 determines whether or not there is another mobile phone 10 that is accessing the same access point or base station as the access point or base station to which it is connected.

  If “YES” in the step S57, that is, if there is a connection ID that matches the acquired connection ID among the received connection IDs, the destination of the ultrasonic signal including the time information is not specified in the step S59. (Broadcast) and the process proceeds to step S63 shown in FIG. However, in step S59, the processor 12 acquires the current time (hour minute second) from the RTC 12a, and transmits an ultrasonic signal including time information about the current time from the ultrasonic transmission / reception device 42. However, the ultrasonic signal includes the terminal ID of the mobile phone 10 as header information.

  On the other hand, if “NO” in the step S57, that is, if all the received connection IDs do not match the acquired connection IDs, it is determined that there is no other mobile phone 10 located near a certain level, and the step S61. Thus, the distance data 304b describing the contents (null data) indicating that measurement cannot be performed for all other mobile phones 10 is stored, and the distance detection process is terminated as shown in FIG.

  As shown in FIG. 9, in step S63, a variable n is initialized (n = 1). Here, n is a variable for individually identifying other mobile phones 10 having the same connection ID. Accordingly, although not shown in the figure, numbers are assigned in order from “1” to each of the other mobile phones 10 having the same connection ID.

  In the next step S65, it is determined whether an ultrasonic signal of the terminal (mobile phone 10) indicated by the variable n has been received. As described above, since the terminal ID is included as header information in the ultrasonic signal, it is possible to easily know which mobile phone 10 has received the ultrasonic signal.

  If “YES” in the step S65, that is, if an ultrasonic signal of another mobile phone 10 indicated by the variable n is received, a distance is calculated in a step S67, and the calculated distance is associated with the mobile phone 10. And proceed to step S73. That is, in step S67, the distance data for the other mobile phone 10 indicated by the variable n in the distance data 304b is stored (updated).

  On the other hand, if “NO” in the step S65, that is, if the ultrasonic signal of the other mobile phone 10 indicated by the variable n is not received, whether or not a predetermined time (for example, 1 second) has passed in the step S69. Judging. For example, the processor 12 starts an internal timer when the reception processing of the ultrasonic signal of the other mobile phone 10 indicated by the variable n is started (when the processing of S65 is first started), and the count value It is determined whether or not the predetermined time has been exceeded.

  If “NO” in the step S69, that is, if the predetermined time has not elapsed, the process returns to the step S65 as it is. On the other hand, if “YES” in the step S69, that is, if a predetermined time has elapsed, it is determined that the other mobile phone 10 indicated by the variable n is not located at least in the vicinity, and the measurement is disabled in the step S71. The distance is stored and the process proceeds to step S73. That is, in step S71, the distance data for the mobile phone 10 indicated by the variable n in the distance data 304b is stored (updated) with contents indicating that measurement is not possible (null data).

  In step S73, it is determined whether or not the variable n has exceeded the number of other mobile phones 10 having the same connection ID. That is, the processor 12 determines whether or not the distances from all the other mobile phones 10 located near a certain distance are measured (detected).

  If “NO” in the step S73, that is, if the variable n is equal to or less than the number of other mobile phones 10 having the same connection ID, the variable n is incremented by 1 (n = n + 1) in a step S75, and the step S65 is performed. Return to. That is, the distance to the next other mobile phone 10 is detected. On the other hand, if “YES” in the step S73, if the variable n exceeds the number of other mobile phones 10 having the same connection ID, the distances to all other mobile phones 10 located near a certain distance are detected. And the distance detection process ends.

  According to this embodiment, when there are three or more participants in an Internet call, when two or more participants are present in the vicinity, the terminal used by the participants is located in the vicinity. By turning off the microphone and the speaker according to the above conditions, it is possible to prevent duplicate sounds from being heard.

  In this embodiment, in order to determine whether or not the terminals are located close to a certain distance, it is determined whether or not the connection IDs of the connected base stations and access points match. It is not necessary to be limited to. As another embodiment, the terminal may be equipped with a GPS function to directly detect the position and determine whether or not the terminal is close to a certain distance.

  In this embodiment, ultrasonic signals are transmitted and received in order to measure the distance between terminals located close to a certain distance. However, the present invention is not limited to this. For example, by providing Bluetooth (registered trademark) in the terminal, a radio signal may be transmitted and received using Bluetooth, and the distance may be measured (calculated) from the radio wave intensity when the radio signal is received.

  Further, in this embodiment, whether or not the first condition (S5) for determining whether or not to turn off the speaker 26 is satisfied in order to avoid all the situations (1) to (3) above, and Although it is determined whether or not the second condition (S21) for determining whether or not to turn off the microphone 20 is satisfied, the present invention is not limited to this. It may be determined whether one of the first condition and the second condition is satisfied. Even in this case, when the speaker 26 is turned off by satisfying the first condition, the situations (1) and (3) described above can be avoided. Alternatively, by satisfying the second condition, when the microphone 20 is turned off, the situation (2) described above can be avoided.

  Furthermore, in this embodiment, only audio data is transmitted / received, but video data may also be transmitted / received. A so-called video call (video chat) is also possible. In such a case, for example, the mobile phone includes a camera. However, in this embodiment, in order to prevent duplicate sounds from being heard, processing such as turning on / off the camera according to the distance is unnecessary.

  In this embodiment, the case where a mobile phone is used as an example of the mobile terminal has been described. However, the present invention is not limited to this. For example, a terminal such as a PDA, a tablet computer, or a laptop computer can be used.

  Furthermore, in this embodiment, in order to prevent the voice of the user existing in the vicinity from being duplicately transmitted from the own device and other mobile phones in the vicinity, one of a plurality of terminals located in the vicinity Although the microphones other than the one terminal are turned off, only the audio data from one terminal may be output from the speaker on the terminal side not located in the vicinity. However, in this case, it is necessary to selectively output audio data on the remotely located terminal side by notifying the remotely located terminal of the terminal ID of the terminal located nearby.

  For example, as shown in FIG. 10, when the mobile phones 10a and 10c are located in the vicinity, the mobile phone 10b is notified of the terminal IDs of the mobile phones 10a and 10c. Therefore, for example, when the user A of the mobile phone 10a speaks, the voice data corresponding to the voice is transmitted from the mobile phones 10a and 10c to the mobile phone 10b. In the mobile phone 10b, only the voice data from the mobile phone 10a ( Alternatively, only audio data from the mobile phone 10c is output.

  The program used in this embodiment may be stored in the HDD of the data distribution server and distributed to the mobile phone via the network. Further, the storage medium may be sold or distributed in a state where a plurality of programs are stored in a storage medium such as an optical disk such as a CD, a DVD, or a BD (Blue-Ray Disk), a USB memory, and a memory card. When the program downloaded through the server or storage medium described above is installed in a portable terminal having the same configuration as that of this embodiment, the same effect as this embodiment can be obtained.

  Further, the specific numerical values given in this embodiment are merely examples, and can be appropriately changed according to the specifications of the product to which the present invention is applied.

DESCRIPTION OF SYMBOLS 10 ... Mobile telephone 12 ... Processor 14 ... Radio | wireless communication circuit for telephone lines 20 ... Microphone 24 ... Receiver 26 ... Speaker 28 ... Input device 32 ... Display 36 ... RAM
38 ... Short-range wireless communication circuit 42 ... Ultrasonic transmitter / receiver 50 ... System 52 ... Internet 54 ... Telephone line network

Claims (10)

A mobile terminal that transmits voice data corresponding to a user's voice input through a microphone to a network, and outputs the voice data of the other party received from the network from a speaker.
A distance detector for detecting the distance to other terminals;
In the case where there is the other terminal whose distance detected by the distance detection unit is less than a predetermined distance, the portable terminal includes a voice control unit that turns off at least one of the microphone and the speaker when a predetermined condition is satisfied Terminal.   The portable terminal according to claim 1, wherein the predetermined condition includes at least one of a first condition for determining whether to turn off the speaker and a second condition for determining whether to turn off the microphone. .   The mobile terminal according to claim 2, wherein the first condition includes a preset setting to turn off the speaker.   The mobile terminal according to claim 2, wherein the first condition includes at least one of a speaker output level lower than that of the other terminal and participation in a call after the other terminal.   The mobile terminal according to claim 2, wherein the second condition includes participation in a call after the other terminal. An input level transmitting / receiving unit configured to transmit / receive the input level of the microphone to / from the other terminal existing within the predetermined distance;
The portable terminal according to claim 2, wherein the second condition includes that the input level of the microphone is lower than the input level of the microphone of the other terminal existing within the predetermined distance. The distance detection unit includes an ultrasonic transmission / reception unit that transmits and receives an ultrasonic signal including time information,
The distance detection unit calculates a distance from the other terminal based on time information included in the ultrasonic signal when the ultrasonic transmission / reception unit receives the ultrasonic signal from the other terminal. The mobile terminal according to any one of claims 1 to 6.   The mobile terminal according to claim 7, wherein the ultrasonic transmission / reception unit transmits / receives the ultrasonic signal when there is the other terminal having the same base station or access point connected thereto. A voice control program for a portable terminal that transmits voice data corresponding to a user's voice input through a microphone to a network, and outputs the voice data of the other party received from the network from a speaker.
In the processor of the portable terminal,
A distance detection step for detecting the distance to other terminals;
In the case where there is the other terminal whose distance detected in the distance detection step is less than a predetermined distance, an audio that causes an audio control step to turn off at least one of the microphone and the speaker when a predetermined condition is satisfied Control program. A voice control method for a computer, wherein voice data corresponding to a user's voice input through a microphone is transmitted to a network, and the voice data of the other party received from the network is output from a speaker.
The computer
(A) detecting a distance to another terminal; and (b) when there is the other terminal whose distance detected in step (a) is less than a predetermined distance, An audio control method for turning off at least one of a microphone and the speaker.

Images