JP4207701B2 - Call device, call method, and call system - Google Patents

Description

The present invention relates to a call device and a call method using a network such as the Internet, which enables a call in a high sound quality environment, and in addition to call voice, background music (BGM) or sound effects (Sound effect: SE) relates to the communication device and call method for transmitting and receiving.

  In Japanese Patent Application Laid-Open No. 2002-237873, the applicant of the present application is a digital mobile phone having a music data reproduction function, and when listening to music with an earphone, if there is an incoming call, it is superimposed on the music. Release the ringtone from the earphone, stop the music playback according to the operation of the on-hook / off-hook button, and make a call with the combination of the earphone and the external microphone according to the operation of the switch on the main unit, or A technique of switching whether to make a call using a combination of a speaker of a telephone body and a microphone is disclosed.

  In recent years, telephones using the Internet have become widespread. However, for example, when a personal computer is used as a communication device, a handset can be used by freeing both hands of a user in preparation for operations such as a keyboard and a mouse. In many cases, a headset including a headphone and a microphone is used instead of using a speaker and a microphone of the PC main body for preventing echoes.

  In particular, when a PC main body speaker and microphone are used, an echo canceller is required. If there is no echo canceller, the voice you pronounced will come back through the other party's speaker and the other party's microphone via communication, making it very difficult to speak. In particular, it becomes more and more difficult to make a stereo voice call.

JP 2002-237873 A

  By the way, when the technique disclosed in Patent Document 1 is used in an Internet telephone, a ring tone cannot be heard when the headset is inserted into the PC and separated from the ear. If you can't hear the ringtone even when you are away from the PC, you won't know if you get a call. Therefore, it is conceivable to reproduce the ringtone from both the headset and the speaker built in the PC. However, if the speaker is set so that sound can be heard even in the distance, and if you accidentally receive a call with a headset, you will receive a loud sound unintentionally, making it unusable for the user.

  The same is true for mobile phone devices. When the mobile phone is placed away from the mobile phone, it is set to a loud sound so that it can hear the ringtone.

Call device according to the present invention, in order to solve the above problems, to convert the communication device that performs two-way communication for voice dialog via the network, a transmission system, the voice picked up into an electrical signal sound First gain adjusting means for adjusting the gain by multiplying the audio signal from the converting means by a variable gain coefficient; first sound data storing means for storing sound data in units of files; and First decoding means for decoding sound data in units of files read from the sound data storage means, and second gain adjusting means for adjusting the gain by multiplying the decode output from the first decoding means by a variable gain coefficient Second sound data storage means for storing sound data in file units, and decoding of sound data in file units read from the second sound data storage means. Second decoding means, a third gain adjusting means for adjusting a gain by multiplying a decode output from the second decoding means by a variable gain coefficient, and a first gain from the first gain adjusting means. Combining means for combining the output, the second output from the second gain adjusting means, and the third output from the third gain adjusting means, and encoding means for encoding the combined output of the combining means; Transmitting means for transmitting the encoded output from the encoding means to the network, and as a receiving system, receiving means for receiving the encoded output transmitted from the transmitting means of another call device via the network; Received data decoding means for decoding encoded data received by the receiving means, and variable to decode output from the received data decoding means A fourth gain adjuster for adjusting the gain by multiplying the gain coefficient, the ringtone data storage means for storing ring tone data in file units, the variable gain coefficient data from the ring tone data storage means A fifth gain adjusting means for adjusting the gain by multiplication; a second combining means for combining the fourth output from the fourth gain adjusting means and the fifth output from the fifth gain adjusting means; And a headphone reproducing means for driving the headphones based on the output of the second synthesizing means; a sixth gain adjusting means for adjusting the gain by multiplying the data from the ring tone data storing means by a variable gain coefficient; Speaker reproducing means for driving the speaker based on the output of the sixth gain adjusting means.

Call method according to the present invention, in order to solve the above problems, in the call method for bidirectional communication for voice dialog via the network, converts a transmission system, the voice picked up into an electrical signal sound A first gain adjustment step of adjusting the gain by multiplying the audio signal from the conversion means by a variable gain coefficient, and a first read out and decoding of sound data stored in file units in the first sound data storage means. 1 decoding step, a second gain adjusting step for adjusting the gain by multiplying the decoded output from the first decoding step by a variable gain coefficient, and storing the file in the second sound data storage means in units of files. A second decoding step of reading out and decoding the sound data of the sound, and a gain adjustment by multiplying the decoding output from the second decoding means by a variable gain coefficient A first output from the first gain adjustment step, a second output from the second gain adjustment step, and a third output from the third gain adjustment step. A first synthesizing step, an encoding step for encoding the synthesized output of the first synthesizing step, and a transmitting step for transmitting the encoded output from the encoding means to the network. A receiving step for receiving an encoded output transmitted from another communication device, a received data decoding step for decoding the encoded data received in the receiving step, and a decode output from the received data decoding step. a fourth gain adjustment step of adjusting the gain is multiplied by a gain coefficient, stored on a file basis to the ring tone data storage means A fifth gain adjustment step of adjusting the gain multiplied by the variable gain coefficient ringtone ring tone data, first from the fourth output and the fifth gain adjustment step from the fourth gain adjustment step A second synthesizing step for synthesizing the output of No. 5, a headphone reproducing step for driving headphones based on the output of the second synthesizing step, and multiplying the data from the ring tone data storing means by a variable gain coefficient. comprising a sixth gain adjustment step of adjusting the gain, a speaker reproducing step of driving a speaker based on an output of the sixth gain adjustment step.

  According to the communication device of the present invention, the first gain adjustment means adjusts the gain by multiplying the data from the ring tone data storage means by a variable gain coefficient. The headphone reproducing means drives the headphones based on the output of the first gain adjusting means. The second gain adjustment means adjusts the gain by multiplying the data from the ring tone data storage means by a variable gain coefficient. The speaker reproducing means drives the speaker based on the output of the second gain adjusting means. Therefore, optimal volume adjustment can be performed with the headset and the speaker. It is also possible to increase only the ringtone of the speaker so that it can be heard from a distance.

  According to the calling method of the present invention, the first gain adjustment step adjusts the gain by multiplying the data from the ring tone data storage means by a variable gain coefficient. The headphone playback step drives the headphones based on the output of the first gain adjusting means. In the second gain adjustment step, the gain is adjusted by multiplying the data from the ring tone data storage means by a variable gain coefficient. The speaker reproduction process drives the speaker based on the output of the second gain adjustment process. Therefore, optimal volume adjustment can be performed with the headset and the speaker. It is also possible to increase only the ringtone of the speaker so that it can be heard from a distance.

  According to the calling system of the present invention, in the receiving system of the calling device, the first gain adjusting means adjusts the gain by multiplying the data from the ring tone data storing means by the variable gain coefficient. The headphone reproducing means drives the headphones based on the output of the first gain adjusting means. The second gain adjustment means adjusts the gain by multiplying the data from the ring tone data storage means by a variable gain coefficient. The speaker reproducing means drives the speaker based on the output of the second gain adjusting means. Therefore, optimal volume adjustment can be performed with the headset and the speaker. It is also possible to increase only the ringtone of the speaker so that it can be heard from a distance.

  Hereinafter, as a best mode for carrying out the present invention, a VoIP call system in accordance with an Internet telephone protocol called Voice over IP (VoIP) and a VoIP client used in the VoIP call system will be described. .

  First, an outline of the VoIP call system 1 will be described. This VoIP call system transmits and receives background music (BGM) or sound effect (SE) in addition to call voice between VoIP clients.

  As shown in FIG. 1, a VoIP client (Client) 2 is connected to the Internet 4 via, for example, a public line 3 and the like, and is interactively connected to another VoIP client 5 connected to the Internet 4 for voice conversation. Communicate. A VoIP server (Server) 6 is also connected to the Internet 4 and performs communication control based on VoIP. In this VoIP call system 1, a call between two parties of the VoIP client 2 and the VoIP client 5 is taken as an example, but the number of VoIP clients is not limited to two, and therefore there are two or more participants in the call system. Of course.

  The Internet 4 is a network environment that is spread all over the world by connecting a plurality of communication lines such as general public lines and information communication networks. Currently, broadband transmission is enabled by the widespread use of broadband and high-speed communication lines. The network is composed of communication lines of 500kbps or higher using optical fiber, asymmetric digital subscriber line, radio, etc.

  The VoIP server 6 is in the VoIP call system 1 and manages the contractor's IP address, authenticates, or controls communication. It consists of a computer such as a workstation. Of course, a server for billing processing and a server for processing management information such as the contractor's IP address may be provided separately.

  The VoIP client 2 is, for example, a personal computer (PC) to which a headset 7 including a microphone and a speaker or a microphone 7a and a headphone 7b is connected. The PC becomes the VoIP client 2 by executing the VoIP client program 2a realized by software. In the following, it is assumed that the VoIP client 2 makes a call to the VoIP client 5, that is, the VoIP client 2 transmits first and the VoIP client 5 receives. Of course, the VoIP client 5 is also composed of a PC that executes the VoIP client program 5a, and performs the same operation when it first becomes the transmission side.

  The VoIP client 2 on the transmission side is a background sound during a VoIP call, for example, music (Back ground music: BGM) that is a continuous sound for several minutes, for example, a sound effect (Sound effect) for several seconds. : SE) can be mixed into the call voice. The VoIP client 2 individually adjusts the volume level of the background sound and the sound effect as well as the call sound.

  Further, when the VoIP client 2 becomes the receiving side, the volume of the ringtone can be adjusted independently by the headset 7 and the speaker.

  Hereinafter, a configuration and operation in which the VoIP client 2 can individually adjust the volume level of the background sound and the sound effect, and a configuration and operation in which the volume of the ringtone can be independently adjusted by the headset 7 and the speaker will be described with reference to FIG. To do. The VoIP client 2 is configured such that the transmission system and the reception system are functionally described below by executing the VoIP client program 2a. First, in the transmission system 10, an electric signal based on a user's voice collected by the microphone 7 a and converted into an electric signal is captured by the microphone capture unit 11. The gain adjustment unit 12 multiplies the electrical signal based on the sound captured by the microphone capture unit 11 by a gain coefficient k1 that is a microphone volume level set by the user. The multiplication output of the gain adjusting unit 12 is supplied to the adding unit 13.

  In addition, the VoIP client 2 converts MP3 (MPEG-1 Audio Layer-III), MPEG4, or MPEG4 sound effects such as machine gun gunshots, thunders, applause sounds, laughter, etc., for example, into PCM data. A plurality of files are compressed in advance by a compression technique such as ATRAC (Adaptive Transform Acoustic Coding) and stored in the SE file storage unit 14 as SE data in file units. Examples of the SE file storage unit 14 include a hard disk drive (HDD), ROM, and magneto-optical disk as will be described later.

  In addition, the VoIP client 2 uses, for example, MP3, MPEG4, ATRAC, etc. after converting background sounds in units of several minutes, such as wave sounds, birdsongs, or music of various genres, into PCM data, for example. A plurality of files are stored in the BGM file storage unit 15 as BGM data in file units in advance by compression using a compression technique.

  When the SE file stored in the SE file storage unit 14 is selected as desired by the user, it is decoded by the decoding unit 17 while being read by the SE file reading unit 16 into a RAM (not shown), and becomes PCM data. The gain adjustment unit 18 multiplies the decoding output (PCM data) of the decoding unit 17 by a gain coefficient k2 that is an SE volume level set by the user. The multiplication output of the gain adjusting unit 18 is supplied to the adding unit 13.

  When the BGM file stored in the BGM file storage unit 15 is also selected as desired by the user, the BGM file reading unit 17 decodes the BGM file into a RAM (not shown) and decodes it into PCM data. The gain adjustment unit 21 multiplies the decoding output of the decoding unit 20 by a gain coefficient k3 that is a BGM volume level set by the user. The multiplication output of the gain adjusting unit 21 is supplied to the adding unit 13. The addition unit 13 adds the multiplication outputs of the three gain adjustment units 12, 18, and 21 while performing saturation processing, and supplies the addition output to the encoding unit 22.

  The encoding unit 22 compresses the addition output (PCM data) of the addition unit 13 to tens of kbps, for example, 64 kbps, using a compression technique such as MP3, MPEG4, or ATRAC. The compression technology such as MP3, MPEG4, or ATRAC performed by the encoding unit 22 is a high-efficiency acoustic compression coding / decoding technology applied to PCM audio data or the like employed in a CD. Therefore, the audio that has been packetized, transmitted over the Internet, and played back on the receiving side can be converted into two stereo channels and has high sound quality.

  This compressed data is supplied to an RTP packetizing unit 23 that packetizes the data according to a real-time transport protocol (RTP). The RTP packetizing unit 23 puts the compressed data into an RTP packet and further packetizes with UDP and IP. Details of packetization according to RTP will be described later. The packetized packet data is sent from the transmission processing unit 24 to the Internet.

  In the reception system 30, packet data transmitted from another VoIP client 5 via the Internet 4 is received by the reception processing unit 31. The packetized data received by the reception processing unit 31 is solved by the RTP depacketize unit 32. The de-jitter unit 33 corrects the arrival time based on the RTP time stamp and sequential number solved from the IP and UDP by the RTP depacketization unit 32.

  A packet loss compensator 34 compensates for packet loss based on the RTP time stamp and sequential number, and sends compensation data to the decoder 35. The decoding unit 35 decodes the compressed data subjected to arrival time correction and packet loss compensation into PCM data, and sends the PCM data to the gain adjusting unit 36. The gain adjusting unit 36 multiplies the PCM data by a gain coefficient k5 that is a playback volume level set by the user. The multiplication output of the gain adjusting unit 36 is sent to the adding unit 37. Further, in order to share the transmitted voice with the other party, the gain adjustment unit 38 multiplies the transmission voice data by a gain coefficient k4 that is a loopback volume level set by the user. The multiplication output of the gain adjustment unit 38 is also supplied to the addition unit 37.

  Further, the VoIP client 2 converts the ring tone (Ring Tone) into, for example, PCM data and then compresses it in advance using a compression technique such as MP3, MPEG4, or ATRAC, and the ring tone file storage unit as ring tone data for each file. 39 stores a plurality of files.

  The ring tone file from the ring tone file storage unit 39 is selected in advance according to the user's request, and is read into a RAM (not shown) by the ring tone reading unit 40 according to the timing of the incoming call, and is converted into PCM data by the decoding unit 41. Decoded. The decoded output of the decoding unit 41 is supplied to the gain adjustment unit 42 and the gain adjustment unit 43. The gain adjusting unit 42 multiplies the ring tone decoded output (PCM data) by a gain coefficient k6 that is a headphone ringing volume level set by the user, and supplies the result to the adding unit 37. The adder 37 adds the call voice as the multiplication output of the gain adjustment unit 36 and the PCM data of the own call sound as the multiplication output of the gain adjustment unit 38 to the mixing output (PCM data) such as background sound. The output is supplied to the headphone playback unit 44. The headphone reproducing unit 44 converts the added output into an analog signal, amplifies it, and supplies it to the headphone 7b. The headphones 7b generate the mixing output in the user's ear.

  In addition, the adding unit 37 receives the headphone call set by the user in the decoded output (PCM data) of the ring tone file read by the ring tone file reading unit 40 at the timing when a call is received from another VoIP client 5. The data multiplied by the gain coefficient k6, which is the volume level, is supplied to the headphone playback unit 44. The headphone reproducing unit 44 converts the ring tone data multiplied by the gain coefficient k6 into an analog signal and then supplies the analog signal to the headphone 7b. Therefore, the headphone 7b emits a ringtone of the headphone ringing volume level set by the user at the ear of the user at the timing when a call from another VoIP client 5 is received.

  The gain adjustment unit 43 multiplies the ring tone PCM data, which is the decoded output from the decoding unit 41, by a gain coefficient k7 which is a speaker ringing tone volume level set by the user, and supplies the result to the speaker reproduction unit 45. The speaker reproducing unit 45 converts the multiplication output into an analog signal, amplifies it, and supplies it to the speaker 46. The speaker 46 generates a ringtone having a speaker ringtone volume level set by the user for the speaker.

  Therefore, when the VoIP client 2 becomes the receiving side, the volume of the ringtone can be adjusted independently by the headset 7 and the speaker.

  Next, packetization and depacketization based on RTP will be described. RTP is a transport protocol for transmitting / receiving voice and moving images in real time in an IP network such as the Internet. It is recommended in RFC1889. RTP is located in the transport layer and is generally used with Real-time Control Protocol over User Datagram Protocol (UDP).

  As shown in FIG. 3, the RTP packet includes an IP header, a UDP header, an RTP header, and RTP data. The RTP header includes version information (Verasion: V), padding (Padding: P), presence / absence of extension header (extension: X), number of transmission sources (Contoributing source: CRSC), marker information (Marker: M), payload type (Payload Type: PT), sequence number (Sequence Number), RTP time stamp, synchronization transmission source (Sychronization Source: SSRC) identifier, and each field storing a contribution transmission source (Contoributeing source: CRSC) identifier is provided. .

  The RTP packetizing unit 23 in FIG. 2 packetizes the compressed data that is the output of the encoding unit 22 according to the RTP described above. The compressed data itself is included in the RTP payload portion shown in FIG. The RTP packet is sent from the transmission processing unit 24 to another VoIP client (for example, the VoIP client 5 in FIG. 1) via the Internet 4.

  In the reception system 30 of another VoIP client 5, the reception processing unit 31 receives the RTP packet. Here, the operation of the other VoIP client 5 will be described with reference to FIG. The RTP depacketizer 32 separates the RTP header and RTP data from the IP header and the UDP header. The sequence number and type stamp stored in the RTP header are sent to the de-jitter unit 33.

  The de-jitter unit 33 corrects the arrival time non-uniformity based on the sequence number and the type stamp. Since the RTP packet is transmitted by the Internet through which other data is transmitted, the RTP packet may be affected by the transmission, and the arrival times thereof are not equal. The communication interval may become uneven due to clogging or stretching on the time axis. Therefore, the de-jitter unit 33 corrects based on the sequence number and the type stamp so as to have equal intervals.

  The packet compensator 34 corrects the packet loss based on the sequence number and the type stamp. Since the RTP packet is transmitted / received via the Internet, the packet may be lost or may not be received. Therefore, the packet compensation unit 34 compensates for packet loss by using the same packet as the preceding or succeeding packet instead of the missing packet or setting the missing data to 0.

  Then, the decoding unit 35 decodes the mixing data such as the call sound and the background sound in which the arrival time is corrected and the packet loss is compensated, and converts it into PCM data.

  In the VoIP client 2 having such a functional configuration, by applying the present invention, a characteristic is that the volume level of the background sound as well as the call sound can be individually adjusted.

  The volume level of the call sound is adjusted by multiplying the audio data by a gain coefficient k1, which is a microphone volume level set by the user, in the gain adjustment unit 12. Further, the adjustment of the sound effect or the volume level of the BGM is performed by adjusting the gain coefficient k2 that is the SE volume level set by the user in each audio data by the gain adjustment unit 18 or the gain adjustment unit 21 or the gain coefficient that is the BGM volume level. This is done by multiplying k3.

  The call sound data, the sound effect, or the BGM audio data after the volume level is adjusted by each gain adjustment unit 12, gain adjustment unit 18, and gain adjustment unit 21 are synthesized by the addition unit 13, and are sent to the encoding unit 22. Are encoded by the RTP packetizing unit 23 and transmitted from the transmission processing unit 24 to the other VoIP client 5 of the other party.

  The other party's VoIP client 5 receives the RTP packet transmitted via the Internet 4 by the reception processing unit 31, depackets it by the RTP depacketization unit 32, corrects the arrival time interval by the dejitter unit 33, After the packet loss is compensated by the packet compensation unit 34, the decoding unit 35 decodes it to PCM data. The decoded audio data (PCM data) is multiplied by the gain adjustment unit 36 by the gain adjustment unit 36 by the receiving side user, and the call sound from the sender is mixed with BGM or SE. In this state, it can be heard through the headphones 44.

  The VoIP client 2 has the functions shown in FIG. 2 by executing software modules corresponding to the protocols of each layer based on the open system interconnection (OSI) architecture shown in FIG. To achieve.

  In FIG. 4, each layer will be described from the lower layer to the upper layer. First, functions as a physical layer include a universal serial bus (USB) camera driver, a USB audio driver, and various drivers. This layer matches the physical conditions of the transmission conditions of video data from the camera driver and audio data from the audio driver. Next, the function as the data link layer includes an operating system (OS). This is for executing error-free data transfer between adjacent nodes.

  As a function of the network layer, there is the Internet Protocol (IP). The network layer selects a communication path used for data transmission / reception and performs communication control such as flow control and quality control. IP, which is a connectionless packet transfer protocol that does not pursue reliability, leaves the reliability assurance function, flow control function, and error recovery function to the upper layers (transport layer and application layer).

  The functions as the transport layer include the Transport Control Protocol / User Datagram Protocol. In the transport layer, end-to-end transmission is performed using an IP address. Regardless of the type of network, flow control and sequence control are performed according to the required quality class. TCP has a reliability guarantee function, attaches a sequence number to each byte of transferred data, and retransmits data if a reception notification (ACK) is not sent from the receiving side. UDP provides a function for transmitting datagrams between applications. When streaming audio / video images using an IP network, a transport protocol such as TCP that retransmits when an error occurs cannot generally be used. TCP is a protocol for one-to-one communication, and information cannot be transmitted to a plurality of partners. Therefore, UDP is used for such applications.

  UDP is designed to allow application processes to transfer data to other application processes on a remote machine with minimal overhead. Therefore, the information entered in the UDP header is only the source port number, destination port number, data length, and checksum, and there is no field for entering the number indicating the order of packets in TCP. When the order of the packets is changed due to transmission through the network, processing for returning the order to the correct state cannot be performed. Also, there is no field for inputting time information such as a time stamp at the time of transmission in TCP or UDP.

  The function as the session layer includes a session initiation protocol (SIP) and a module required for the software for synthesizing the speech sound and BGM or SE, which is a main part of the present invention. On-hold tone generation, BGM synthesis, ring tone generation, codec, and RTP. The session layer controls information transfer. Manage conversation modes between applications and control conversation units. SIP is an application layer signaling protocol for establishing, changing and terminating multimedia sessions on an IP network. It is standardized by RFC3261.

  As a function as a presentation layer, there is VoIP call control. The presentation layer manages the expression format of information transmitted and received by the application, and performs data conversion and encryption.

  As a function as an application layer, there is a graphical user interface (GUI). In the application layer, the external specification of the communication function used in the user program is managed, and information is exchanged based thereon.

  Next, a hardware configuration of the VoIP client 2 that actually executes the software module will be described. FIG. 5 shows the configuration of the VoIP client 2. In FIG. 5, a CPU (Central Processing Unit) 51 is loaded into a RAM (Random Access Memory) 53 from various programs constituting the software module stored in a ROM (Read Only Memory) 52 or a storage unit 58. Various processes are executed in accordance with various programs constituting the software module. The RAM 53 also appropriately stores data necessary for the CPU 51 to execute various processes.

  The CPU 51, ROM 52 and RAM 53 are connected to each other via a bus 54. An input / output interface 55 is also connected to the bus 54. The input / output interface 55 includes an input unit 56 including a keyboard and a mouse, a display including a CRT and an LCD, an output unit 57 including headphones and speakers, a storage unit 58 including a hard disk, a modem, and a terminal. A communication unit 59 composed of an adapter or the like is connected. The microphone 7 a of the headset 7 is included in the input unit 56. The headphone 7 b is included in the output unit 57.

  The communication unit 59 performs communication processing via the Internet 4. Data provided from the CPU 51 is transmitted. The communication unit 59 outputs data received from the communication partner to the CPU 51, RAM 53, and storage unit 58. The storage unit 58 exchanges information with the CPU 51 to save and erase information. The communication unit 59 also performs analog signal or digital signal communication processing with other clients.

  A drive 60 is connected to the input / output interface 55 as necessary, and a magnetic disk 61, an optical disk 62, a magneto-optical disk 63, a semiconductor memory 64, or the like is appropriately mounted, and a computer program read from these is loaded. It is installed in the storage unit 58 as necessary.

  The storage unit 58 is, for example, an HDD, and constitutes the SE file storage unit 14, the BGM file storage unit 15, and the ring tone file storage unit 39 shown in FIG.

  The above hardware configuration shows the configuration of the VoIP clients 2 and 5 and also the configuration of the VoIP server 6 and a Web server described later.

  Next, GUI (Graphical Use Interface) displayed on the display constituting the output unit 57 will be described with reference to FIG. This GUI belongs to the application layer of the VoIP client. It is an interface for the user to visually operate the PC, and handles user's manual input information. From the upper part to the lower part, the GUI includes an application control unit 71, an information display unit 72, a dial unit 73, a headset volume unit 74, a speaker volume unit 75, a sound effect (SE) selection display unit 76, and an SE control unit 77. , A BGM selection display unit 78 and a BGM control unit 79 are provided.

  The application control unit 71 performs termination processing for the VoIP client application. The information display unit 72 displays dial numbers and partner information (busy, etc.). The dial unit 73 is a numeric keypad for dialing a VoIP partner. The headset volume unit 74 is for adjusting the volume output from the headphones 7 b of the headset 7. When the user moves the slider 74a to the left and right using the mouse, the gain coefficient k5 in the gain adjusting unit 36 is set. Moreover, you may use in order to adjust the volume of the ringtone output from the headphones 7b. In this case, the gain coefficient k6 in the gain adjustment unit 42 is set by the user moving the slider 74a left and right using the mouse.

  The speaker volume unit 75 is for adjusting the volume of the ringtone output from the speaker 46. When the user moves the slider 75a left and right using the mouse, the gain coefficient k7 in the gain adjusting unit 43 is set.

  The SE selection display unit 76 displays usable SE sound source data files (SE files stored in the SE file storage unit 14) to be selected by the user. For example, gunshot sound, thunder, applause sound, A sound effect such as cheers is displayed for the user to select. The SE control unit 77 causes the user using the play button 77b, the stop button 77c, and the slider 77a to play and stop sound effects and adjust the volume via an input unit such as a mouse.

  For example, it is assumed that the user selects a desired SE on the SE selection display unit 76 using the mouse, moves the slider 77a to an appropriate position, and clicks the play button 77b. Then, the decoding unit 17 decodes the desired SE file read by the SE file reading unit 16, and the gain adjustment unit 18 sets the gain coefficient k2 that is the SE volume level corresponding to the slider 77a to the PCM data of the SE file. And output to the adder 13. Thereby, the user can express feelings for the other party with various sound effects.

  The BGM selection display unit 78 displays usable BGM sound source data files to be selected by the user. The BGM control unit 70 causes the user using the playback button 79b, the stop button 79c, and the slider 79a to perform playback and stop of the BGM and volume adjustment via an input unit such as a mouse. For example, it is assumed that the user selects a desired BGM on the BGM selection display unit 78 using the mouse, moves the slider 79a to an appropriate position, and clicks the play button 79b. Then, the decoding unit 20 decodes the desired BGM file read by the BGM file reading unit 19, and the gain adjustment unit 21 sets the gain coefficient k3 that is the BGM volume level corresponding to the slider 79a to the PCM data of the BGM file. And output to the adder 13. Thereby, like SE, the user's mood and the atmosphere of the place can be communicated to the communication partner by the volume selected and adjusted by the user himself / herself.

  Accordingly, the VoIP client 2 can independently adjust the volume of the ringtone by the headset 7 and the speaker 46 by executing various programs constituting the software module.

It is a block diagram of a VoIP call system. It is a functional block diagram of a VoIP client. It is a format diagram of an RTP packet. It is a figure which shows the software module which a VoIP client performs. It is a hardware block diagram of PC used as a VoIP client. It is a figure which shows GUI displayed on the display part of a VoIP client.

Explanation of symbols

  1 VoIP system, 2,5 VoIP client, 4 Internet, 6 VoIP server, 7 headset, 12 gain adjustment unit, 13 synthesis unit, 14 SE file, 15 BGM file, 17 decoding unit, 18 gain adjustment unit, 21 gain adjustment Unit, 22 encoding, 36 gain adjusting unit, 42 gain adjusting unit, 43 gain adjusting unit

Claims (2)

In a communication device that performs two-way communication for voice conversation over a network,
As a transmission system,
First gain adjusting means for adjusting the gain by multiplying the audio signal from the audio converting means for converting the collected sound into an electric signal by a variable gain coefficient;
First sound data storage means for storing sound data in units of files;
First decoding means for decoding sound data in units of files read from the first sound data storage means;
Second gain adjusting means for adjusting the gain by multiplying the decode output from the first decoding means by a variable gain coefficient;
Second sound data storage means for storing sound data in file units;
Second decoding means for decoding sound data in units of files read from the second sound data storage means;
Third gain adjusting means for adjusting the gain by multiplying the decode output from the second decoding means by a variable gain coefficient;
Combining means for combining the first output from the first gain adjusting means, the second output from the second gain adjusting means, and the third output from the third gain adjusting means;
Encoding means for encoding the combined output of the combining means;
Transmission means for transmitting the encoded output from the encoding means to the network,
As a receiving system,
Receiving means for receiving the encoded output transmitted from the transmitting means of another telephone device via the network;
Received data decoding means for decoding the encoded data received by the receiving means;
A fourth gain adjusting means for adjusting the gain by multiplying the decoded output from the received data decoding means by a variable gain coefficient;
Ringtone data storage means for storing ringtone data in units of files;
Fifth gain adjusting means for adjusting the gain by multiplying the data from the ring tone data storing means by a variable gain coefficient;
Second combining means for combining the fourth output from the fourth gain adjusting means and the fifth output from the fifth gain adjusting means;
Headphones reproducing means for driving the headphones based on the output of the second synthesizing means ;
Sixth gain adjusting means for adjusting the gain by multiplying the data from the ring tone data storing means by a variable gain coefficient;
And a speaker reproducing means for driving the speaker based on the output of the sixth gain adjusting means. In a call method that performs two-way communication for voice conversation over a network,
As a transmission system,
A first gain adjustment step of adjusting the gain by multiplying the audio signal from the audio conversion means for converting the collected audio into an electric signal by a variable gain coefficient;
A first decoding step of reading out and decoding sound data stored in file units in the first sound data storage means;
A second gain adjustment step of adjusting the gain by multiplying the decode output from the first decoding step by a variable gain coefficient;
A second decoding step of reading out and decoding the sound data stored in units of files in the second sound data storage means;
A third gain adjustment step of adjusting the gain by multiplying the decode output from the second decoding means by a variable gain coefficient;
A first combining step of combining the first output from the first gain adjustment step, the second output from the second gain adjustment step, and the third output from the third gain adjustment step. When,
An encoding step for encoding the combined output of the first combining step;
A transmission step of transmitting the encoded output from the encoding means to the network,
As a receiving system,
A receiving step of receiving an encoded output transmitted from another communication device via the network;
A received data decoding step for decoding the encoded data received in the receiving step;
A fourth gain adjusting step of adjusting the gain by multiplying the decoded output from the received data decoding step by a variable gain coefficient;
A fifth gain adjustment step of adjusting the gain multiplied by the variable gain coefficient ringtone ringtone data stored in files in the ring tone data storage means,
A second combining step of combining the fourth output from the fourth gain adjustment step and the fifth output from the fifth gain adjustment step;
A headphone playback step of driving the headphones based on the output of the second synthesis step ;
A sixth gain adjustment step of adjusting the gain by multiplying the data from the ring tone data storage means by a variable gain coefficient;
And a speaker reproduction step of driving the speaker based on the output of the sixth gain adjustment step.

Images