JP2008236286A - Communication device and program - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To transmit and receive excellent voice data in response to an application, and to achieve a superior call recording. <P>SOLUTION: In a communication device having an IP telephone function, a call-recording terminal 100A and a call-opposite terminal 100B conduct a voice call through a packet switching network IN by an IP telephone function by a connection-less type communication using a connection-less type protocol such as a UDP. When such a voice call is recorded at the call-recording terminal 100A, the call-recording terminal 100A requires the addition of a connection type communication using a connection type protocol such as a TCP to the call-opposite terminal 100B in the connection type communication established for a call. The call-opposite terminal 100B transmits a transmitting voice to the call-recording terminal 100A even in the connection type communication. The call-recording terminal 100A synthesizes voice data transmitted by the connection type communication and voice data transmitted from the call-recording terminal 100A, and records a synthesized value as the recording data of the call recording. <P>COPYRIGHT: (C)2009,JPO&INPIT

Description

  The present invention relates to a communication device and a program, and more particularly, to a communication device and a program suitable for call recording.

  A mobile communication terminal such as a mobile phone is generally equipped with a function for recording a voice call related to a voice call function (for example, Patent Document 1).

  On the other hand, also in mobile communication, a method (so-called IP phone) for making a voice call by packet exchange via an IP network (IP: Internet Protocol) such as the Internet is being put into practical use.

  Since real-time performance is required for voice calls, it is common to use connectionless communication protocols such as RTP (Real-time Transmission Protocol) and UDP (User Datagram Protocol) in IP telephone systems. Is. Such a connectionless protocol achieves real-time performance by not guaranteeing reliability. For this reason, even if packet loss occurs, there is no retransmission processing that is performed by a connection-type protocol such as TCP (Transmission Control Protocol), so a silent part occurs in a voice call.

Here, when such a sound interruption occurs during a call, the conversation can be maintained by listening back to the caller, but if a packet loss occurs during call recording using the recording function as described above In other words, the recorded sound includes a silent part, and there is a disadvantage that the recorded content cannot be grasped when played back later.
JP-A-9-233160

  The present invention has been made in view of the above circumstances, and an object thereof is to provide a communication device and a program capable of transmitting and receiving good audio data according to usage.

In order to achieve the above object, a communication device according to the first aspect of the present invention provides:
In a communication device having an IP telephone function,
Voice communication means for performing voice communication of the IP telephone function using a connectionless protocol;
When the recording of voice communication by the voice communication means is instructed, voice data transmission using the collectionless protocol and voice data transmission using the connection protocol are transmitted to the counterpart device with which the voice communication means is communicating. Request means for requesting, and
Recording data generation means for generating recording data using voice data transmitted by the connection type protocol in response to a request by the request means;
Recording data storage means for storing the recording data generated by the recording data generation means;
It is characterized by providing.

In the communication device,
The recorded data storage means includes
A transmission buffer for temporarily storing transmission voice data from the communication device;
It is desirable to further include a reception buffer for temporarily storing received voice data transmitted from the counterpart apparatus using the connection-type protocol.
Preferably, the recording data generating means generates the recording data by synthesizing the transmission voice data temporarily stored in the transmission buffer and the reception voice data temporarily stored in the reception buffer.

  The communication device is preferably a mobile communication terminal.

In order to achieve the above object, a communication apparatus according to the second aspect of the present invention provides:
In a communication device having an IP telephone function,
A connectionless communication means for performing voice communication of the IP telephone function using a connectionless protocol;
A connection for transmitting voice data transmitted by the connectionless communication unit to the partner device using the connectionless protocol and a connection protocol in response to a request from the partner device with which the connectionless communication unit is communicating. Type communication means;
It is characterized by providing.

In the communication device,
The connection type communication means includes:
In response to a request transmitted when call recording is executed in the partner device, voice data transmission in the connection type protocol is started,
It is desirable that voice data transmission by the connection-type protocol is terminated in response to a request transmitted from the partner apparatus upon completion of the call recording.

  The communication device is preferably a mobile communication terminal.

In order to achieve the above object, a program according to the third aspect of the present invention is:
A computer that controls a communication device having an IP telephone function;
A function of performing voice communication of the IP telephone function using a connectionless protocol;
A function for requesting voice data transmission in the collectionless protocol and voice data transmission in the connection-type protocol to the counterpart device performing the voice communication in response to an instruction to record the voice communication; ,
A function of generating recording data using voice data transmitted by the connection-type protocol in response to the request;
A function to store the generated recording data in a storage device;
It is characterized by realizing.

In order to achieve the above object, a program according to the fourth aspect of the present invention is:
A computer that controls a communication device having an IP telephone function;
A function for performing voice communication of the IP telephone function using a connectionless protocol;
A function of transmitting voice data to be transmitted to the counterpart device in response to a request from the counterpart device performing the voice communication to the counterpart device using the connectionless protocol and a connection type protocol;
A program characterized by realizing.

  According to the present invention, good audio data can be obtained according to the application.

  Embodiments according to the present invention will be described with reference to the drawings. FIG. 1 is a diagram showing an audio communication system according to the present embodiment. In the present embodiment, it is assumed that voice communication (voice communication) is performed between mobile communication terminals by using an IP phone function using, for example, VoIP (Voice over Internet Protocol). In this case, in the present embodiment, a voice communication system 1 for communicating with a plurality of mobile communication terminals 100 as shown in FIG. 1 is configured.

  As shown in the figure, each mobile communication terminal 100 that performs IP telephone communication in the voice communication system 1 performs radio communication with a base station BS installed by a mobile communication provider. Each base station BS is connected to a mobile communication network MN (cellular network) by the mobile communication operator.

  Here, in this embodiment, SIP (Session Initiation Protocol) is used as a protocol (signaling protocol) for performing call control with the IP telephone function. In this case, as shown in FIG. 1, each mobile communication network MN is a packet switch that is an IP network such as the Internet via a call control device SS such as an SIP server having a proxy function, a redirect function, a registration function, and the like. By being connected to the network IN, call control for voice transmission via the packet switching network IN is performed.

  When the IP telephone function is realized using such SIP, each mobile communication terminal 100 functions as a so-called user agent (User Agent: UA). It is assumed that the IP telephone connection between the mobile communication terminals 100 is realized by the call control device SS relaying requests and responses from the mobile communication terminals 100 that are UAs.

  In such voice communication using an IP phone, voice transmission is usually performed using a connectionless protocol. In the present embodiment, in the Internet protocol group, IP (Internet Protocol) is used in the internetwork layer, UDP (User Datagram Protocol) is used in the transport layer, and RTP (Real-time Transmission Protocol: real-time data transfer) of the upper protocol of UDP. Protocol) is used for connectionless communication. In such connectionless communication, the real-time property required for voice communication is realized by not performing operations such as retransmission of lost packets to guarantee reliability.

  The configuration of the mobile communication terminal 100 according to the present embodiment will be described below with reference to the drawings. First, the hardware configuration of the mobile communication terminal 100 will be described with reference to FIG. As illustrated, the mobile communication terminal 100 includes a control unit 110, a communication control unit 120, an operation unit 130, a display unit 140, a voice processing unit 150, a storage unit 160, and the like.

  The control unit 110 includes, for example, a CPU (Central Processing Unit), a RAM (Random Access Memory) serving as a work area, and the like, and each unit of the mobile communication terminal 100 by executing a predetermined operation program. To control. That is, each component of the mobile communication terminal 100 is controlled by the control unit 110, and information transmission between the components is performed via the control unit 110.

  The communication control unit 120 includes, for example, a wireless communication device for mobile communication, and performs wireless communication with the base station BS by controlling radio wave transmission / reception by the antenna 121 for wireless communication with the base station BS. .

  The operation unit 130 includes buttons and keys configured on the outer surface of the mobile communication terminal 100 and is operated by the user of the mobile communication terminal 100. The input unit 150 includes an input circuit connected to each button, key, and the like, and generates an input signal according to a user operation and inputs the input signal to the control unit 110.

  Here, in this embodiment, it is assumed that IP telephone communication is performed between the two mobile communication terminals 100 shown in FIG. 1, but at least one of the mobile communication terminals 100 is configured to perform IP telephone communication. It is assumed that a call recording function (call recording function) is provided. In the present embodiment, the mobile communication terminal 100 having a call recording function is referred to as “call recording terminal 100A”, and the operation unit 130 of the call recording terminal 100A includes buttons for instructing the start and end of call recording. It shall be assumed.

  The other mobile communication terminal 100 that performs IP telephone communication with the call recording terminal 100A is hereinafter referred to as a “call partner terminal 100B”. In the following description, what is added with the reference sign “A” at the end of the reference sign indicates a configuration necessary for the mobile communication terminal 100 to function as the call recording terminal 100A, and the reference sign “B”. What is added indicates that the configuration is necessary for the mobile communication terminal 100 to function as the call partner terminal 100B. Also, those to which no symbol is added indicate that the configuration is common to both the call recording terminal 100A and the call partner terminal 100B.

  The display unit 140 is a display output device configured by, for example, a liquid crystal display device, and displays and outputs an image and the like under the control of the control unit 110.

  The voice processing unit 150 includes, for example, a voice input / output speaker 151, a microphone 152, a codec circuit, and the like, and performs voice processing related to the call function of the mobile communication terminal 100. In the case of the present embodiment, the digital voice data received by the IP telephone function is converted into an analog voice signal and output from the speaker 151, or the user's voice input from the microphone 152 is converted into digital voice data. Perform the transmission operation to send out.

  The storage unit 160 includes, for example, a storage device such as a ROM (Read Only Memory) or a flash memory, stores an operation program executed by the control unit 110, and stores various data necessary for realizing the present invention. Store. In the present embodiment, as shown in FIG. 2, a plurality of storage areas are configured in the storage unit 160, and predetermined data is stored in each storage area. As shown in the figure, the storage unit 160 includes storage areas such as a reception buffer area 161A, a transmission buffer area 162A, a transmission buffer area 162B, a recording data storage area 163A, and a program storage area 164.

  The reception buffer 161A is a buffer area for temporarily storing voice data (received voice data) received from the call partner terminal 100B while the call recording terminal 100A is executing the call recording function. As described above, in this embodiment, normal IP telephone communication is performed using the connectionless protocol. However, while the call recording terminal 100A is recording a call, the voice data transmitted using the connection protocol is used. Is received (details will be described later). For this reason, voice data received by the connection-type protocol is temporarily stored in the reception buffer area 161A as reception voice data.

  The transmission buffer area 162A is a buffer area for temporarily storing voice data (transmission voice data) transmitted from the call recording terminal 100A to the call partner terminal 100B while the call recording terminal 100A is executing the call recording function. is there.

  The transmission buffer area 162B is used for transmitting the voice data of the transmission voice transmitted by the communication partner terminal 100B by the connectionless communication while the call recording terminal 100A is recording the call by the connection communication. This is a buffer area for temporary storage.

  The recording data storage area 163A stores recording data obtained by combining the received voice data and the transmitted voice data temporarily stored in the reception buffer area 161A and the transmission buffer area 162A by the call recording terminal 100A. That is, by synthesizing the transmitted voice from the call recording terminal 100A and the received voice from the call partner terminal 100B, the voice data indicating the content of the call with the call partner terminal 100B is obtained and stored as the recording data of the call recording. Is done.

  The program storage area 164 is an area for storing a program executed by the control unit 110. The program storage area 164 stores basic software (so-called OS) for controlling the operation of the entire mobile communication terminal 100, application software for realizing various functions of the mobile communication terminal 100, and the like. .

  In the present embodiment, the control unit 110 executes a program stored in the program storage area 164, thereby realizing a functional configuration for performing processing according to the present embodiment. A functional configuration realized by the control unit 110 will be described below. Here, a functional configuration necessary for performing IP telephone communication by the mobile communication terminal 100 will be described. Note that the functional configuration realized in this case differs between the call recording terminal 100A and the call partner terminal 100B. Hereinafter, the functional configuration of the call recording terminal 100A will be described with reference to FIG. 3, and the functional configuration of the call partner terminal 100B will be described with reference to FIG.

  First, the functional configuration of the call recording terminal 100A will be described with reference to FIG. FIG. 3 is a functional block diagram showing a functional configuration of the call recording terminal 100A realized by the control unit 110. As shown in the figure, the control unit 110 includes an IP telephone processing unit 111, a received voice processing unit 112, a transmitted voice processing unit 113, a call recording processing unit 114A, a protocol control request unit 115A, a recording received voice processing unit 116A, and a recording. It functions as the data generation unit 117A.

  The IP telephone processing unit 111 performs processing related to the IP telephone function of the mobile communication terminal 100. In response to input from the operation unit 130, SIP call control (session establishment, disconnection, etc.) and voice Performs processing related to data transmission.

  The received voice processing unit 112 acquires voice data transmitted from the call partner terminal 100B in the IP phone session established by the IP phone processing unit 111 in cooperation with the communication control unit 120 and the voice processing unit 150. Process. The received voice processing unit 112 mainly performs processing for outputting voice data transmitted from the counterpart terminal 100B by connectionless communication as received voice during a call.

  Here, the received packets are sequentially supplied to the voice processing unit 150 in the order of the sequence numbers described in the RTP header of the received voice data packet, so that the transmitted voice from the call partner terminal 100B is output from the speaker 151. As described above, since UDP is used as a transport layer protocol in this embodiment, confirmation of a received packet is not performed.

  Note that the received voice processing unit 112 of the call recording terminal 100A uses the received voice processing for recording, which will be described later, as the voice data transmitted from the call partner terminal 100B by connection-type communication (details will be described later) established with the execution of call recording. To unit 116A. Here, it is determined whether the packet is a connectionless protocol packet or a connection protocol protocol packet based on the header information of the received audio data.

  In this case, since the protocol number indicating the protocol used in the transport layer is described in the IP header, which is the lower layer (internetwork layer) protocol, the received voice is referred to by referring to the IP header. It is possible to determine whether the protocol in the data transport layer is a connectionless type or a connection type. The connectionless protocol packet is provided to the voice processing unit 150, and the connection type protocol packet is provided to the recording reception voice processing unit 116A.

  The transmitted voice processing unit 113 cooperates with the communication control unit 120 and the voice processing unit 150 to transmit the sound collected by the microphone 152 of the call recording terminal 100A in the IP telephone session established by the IP telephone processing unit 111. By providing the voice data of the spoken voice to the voice processing unit 150, the voice data is transmitted to the call partner terminal 100B by connectionless communication. Here, the voice data input from the voice processing unit 150 is sequentially packet-divided, and the RTP header, UDP header, IP header, and other lower-layer protocol headers are sequentially added to the communication control unit 120, thereby providing connection-less. Type communication.

  The call recording processing unit 114A performs processing related to the call recording function of the call recording terminal 100A. Here, an input signal corresponding to the operation of the recording button of the operation unit 130 is input via the IP telephone processing unit 111, and processing related to the start and end of call recording is performed. In this case, the start or end of call recording is notified to the reception voice processing unit 112, the transmission voice processing unit 113, the protocol control request unit 115A, the recording reception voice processing unit 116A, and the recording data generation unit 117A, and recording starts. Or, it instructs the execution of the operation for termination.

  Here, at the start of call recording, the voice data processed by the transmission voice processing unit 113 is stored in the transmission buffer area 162A. In this case, the transmission voice processing unit 113 generates a copy of the voice data being processed and stores it in the transmission buffer area 162A. Further, the sequence number described in the RTP header of the received voice data processed by the received voice processing unit 112 at the start of call recording is acquired as information for specifying the recording start position for the received voice.

  The protocol control request unit 115A, in cooperation with the communication control unit 120, performs connection-type communication to the connection-less type communication currently being performed with respect to the communication partner terminal 100B that is the communication partner of the established IP phone session. Request additional protocol control. In this case, it is assumed that the protocol control request unit 115A issues a connection-type communication addition request using a SIP SIP request that is a call control protocol. The requested connection-type communication uses TCP (Transmission Control Protocol) as a transport layer protocol.

  The received voice processing unit for recording 116A obtains received voice data without a defect to be recorded data for call recording in cooperation with the communication control unit 120 and the storage unit 160. Here, in parallel with the acquisition of received voice data in connectionless communication performed by the received voice processing unit 112, the received voice data (TCP segment) transmitted from the call partner terminal 100B in connection type communication is received voice. Obtained from the processing unit 112.

  The reception voice processing unit 116A for recording stores the acquired TCP segment in the reception buffer area 161A, and sends a confirmation response about the received TCP segment to the communication partner terminal 100B via the communication control unit 120. When a packet is retransmitted from the call partner terminal 100B by this confirmation response, the recording reception voice processing unit 116A stores the retransmitted packet in the reception buffer area 161A.

  The recorded data generation unit 117A combines the received voice data temporarily stored in the reception buffer area 161A and the transmitted voice data temporarily stored in the transmission buffer area 162A, thereby recording the recorded data indicating the content of the call. Is stored in the recording data storage area 163A.

  Next, a functional configuration realized by the control unit 110 when the call partner terminal 100B performs IP telephone communication will be described with reference to FIG. As shown in the figure, the control unit 110 includes an IP telephone processing unit 111, a received voice processing unit 112, a transmitted voice processing unit 113, a request determination unit 114B, a protocol control unit 115B, a connection type transmission processing unit 116B, and an error correction processing unit. 117B, etc. Each functional configuration will be described below, but the IP telephone processing unit 111, the received voice processing unit 112, and the transmitted voice processing unit 113 are the same as those of the call recording terminal 100A, and thus description thereof is omitted.

  The request determination unit 114B determines a request from the call recording terminal 100A with which an IP telephone session is established. In the present embodiment, it is determined whether or not protocol control for adding connection-type communication is requested from the call recording terminal 100A. In this case, the request determination unit 114B determines whether addition of connection-type communication has been requested based on the SIP request from the call recording terminal 100A.

  The protocol control unit 115B instructs each unit to perform an operation for controlling the protocol used by the call partner terminal 100B in response to an addition request from the call recording terminal 100A. In this embodiment, an operation for performing connection-type communication using TCP is instructed simultaneously with connectionless communication using UDP as a transport layer protocol.

  Further, the protocol control unit 115B receives the transmission voice data processed by the transmission voice processing unit 113 from the time when the connection type communication addition request is received, so that the transmission buffer is used for transmission in the connection type communication. Temporary storage is performed in the area 162B. In this case, the transmission voice processing unit 113 generates a copy of the transmission voice data being processed and stores it in the transmission buffer area 162B.

  The connection-type transmission processing unit 116B, in cooperation with the communication control unit 120 and the storage unit 160, establishes a TCP sequence with the call recording terminal 100A in response to a connection-type communication addition request from the call recording terminal 100A. The transmission voice data temporarily stored in the transmission buffer area 162B is transmitted to the call recording terminal 100A by TCP packet processing.

  The error correction processing unit 117B, in cooperation with the communication control unit 120 and the storage unit 160, determines the presence or absence of packet loss based on the confirmation response regarding the TCP segment transmitted to the call recording terminal 100A by the connection-type transmission processing unit 116B. If there is a packet loss, the corresponding packet is acquired from the transmission buffer area 162B and retransmitted to the call recording terminal 100A. In the present embodiment, if a confirmation response for the transmitted TCP segment is not obtained from the call recording terminal 100A even after a predetermined time has elapsed, the TCP segment is retransmitted to the call recording terminal 100A.

  These functional configurations are functional configurations realized by the control unit 110 when the mobile communication terminal 100 functions as the call recording terminal 100A and the call partner terminal 100B. In the present embodiment, the above-described functional configuration is logically realized by the control unit 110 executing a program. For example, these functional configurations may be an ASIC (Application Specific Integrated Circuit). May be physically configured by hardware such as an integrated circuit).

  The above configuration is a configuration necessary for realizing the present invention, and other configurations necessary for basic functions and additional functions as a mobile communication terminal are provided as necessary. To do.

  The operation executed when IP telephone communication is performed in the mobile communication terminal 100 having the above configuration will be described below. First, an outline of operation in the voice communication system 1 when IP telephone communication is performed between the call recording terminal 100A and the call partner terminal 100B will be described with reference to a sequence chart shown in FIG. Here, a case where a call is made from the call recording terminal 100A to the call partner terminal 100B will be described as an example. It is assumed that requests and responses transmitted and received between the call recording terminal 100A and the call partner terminal 100B are relayed by the call control device SS on the voice communication system 1.

  When the user operates the operation unit 130 in the call recording terminal 100A and dials the IP telephone number of the call partner terminal 100B from an IP telephone call ready state (off-hook), the call recording terminal 100A makes a SIP call request ( INVITE) is transmitted to the communication partner terminal 100B (S10).

  The call partner terminal 100B that has received the call request performs a call operation such as ringing, and transmits a call notification (180 RINGING response) indicating that the call is being performed to the call recording terminal 100A (S20). . In the call partner terminal 100B, when the user operates the operation unit 130 to enter the off-hook state, the call partner terminal 100B transmits a success response (200 OK response) to the call recording terminal 100A (S30).

  The call recording terminal 100A that has received the success response from the call partner terminal 100B transmits an acknowledgment (ACK request) to the call partner terminal 100B (S40), so that the call recording terminal 100A and the call partner terminal 100B can communicate with each other. IP telephone communication is established, voice data is exchanged by connectionless communication using RTP / UDP, and voice communication is realized (S50).

  Then, when the user of the call recording terminal 100A operates the operation unit 130 to give an instruction to disconnect the call (on-hook), the call recording terminal 100A transmits a disconnection request (BYE request) to the call partner terminal 100B (S60). When the other party terminal 100B that has received the disconnection request also goes on-hook by operating the operation unit 130, the other party terminal 100B transmits a success response (200 OK response) to the call recording terminal 100A, so that the IP telephone communication session is completed. finish.

  The above is the procedure of normal IP telephone communication performed between the call recording terminal 100A and the call partner terminal 100B. In the present embodiment, when call recording is executed by the call recording terminal 100A having a call recording function, packet loss (sound) is obtained by simultaneously performing connection type communication in addition to voice call operation by connectionless type communication. Record calls without interruption.

  An outline of operations performed between the call recording terminal 100A and the call partner terminal 100B in this case will be described with reference to sequence charts shown in FIGS. Here, the call recording terminal 100A performs call recording after the call voice data exchange (S50) described in FIG.

  First, referring to FIG. 6, an outline of the operation at the start of call recording will be described. As shown in the figure, in the call recording terminal 100A, when the user operates the recording button of the operation unit 130 to instruct the start of recording, the call recording terminal 100A uses a RE-INVITE request that is a retransmission of the INVITE request, A request to add an RTP / TCP connection-type communication session to the RTP / UDP connection-less communication session currently in progress is transmitted to the call partner terminal 100B (S51).

  The call partner terminal 100B that has received the RE-INVITE request from the call recording terminal 100A returns a success response (200 OK response) to the call recording terminal 100A (S52). On the other hand, when the call recording terminal 100A transmits an acknowledgment (ACK request) to the call partner terminal 100B (S53), a session establishment operation is started by a TCP procedure which is a connection type protocol.

  In this case, a so-called 3-way handshake, which is a TCP path establishment procedure, is performed. That is, the call partner terminal 100B that performs data transmission transmits a TCP segment in which the SYN flag is turned on by the control bit of the TCP header to the call recording terminal 100A (S54). The TCP segment with the SYN flag turned on is returned to the call partner terminal 100B (S55). Furthermore, the call partner terminal 100B transmits a TCP segment with the ACK flag turned on to the call recording terminal 100A (S56), so that connection-type communication by RTP / TCP is performed between the call recording terminal 100A and the call partner terminal 100B. Establish (S57).

  In the present embodiment, voice data exchange for a call is performed by simultaneously performing already established RTP / UDP connectionless communication (S50) and newly established RTP / TCP connection type communication (S57). Are exchanged by connectionless communication and voice data for recording is exchanged by connection type communication (S50 ').

  An outline of the operation after the connectionless communication and the connection communication are established in parallel will be described with reference to the sequence chart shown in FIG.

  In this state, voice data is transmitted from the call partner terminal 100B to the call recording terminal 100A by a normal TCP procedure. That is, the voice data including the TCP segment is sequentially transmitted from the call partner terminal 100B to the call recording terminal 100A, and the call recording terminal 100A returns a confirmation response for the received TCP segment to the call partner terminal 100B as needed. If the confirmation response from the call recording terminal 100A is not returned to the call partner terminal 100B even after a predetermined time has elapsed, the packet loss is compensated by retransmitting the voice data including the corresponding TCP segment to the call recording terminal 100A. Do it.

  By repeating such operations, voice data used for call recording at the call recording terminal 100A is transmitted from the call partner terminal 100B to the call recording terminal 100A in parallel with the connectionless communication for calling. .

  Here, in the call recording terminal 100A, when the user operates the recording button of the operation unit 130 to instruct the end of recording, a procedure for ending the connection type communication is executed. In this case, the call recording terminal 100A transmits a TCP segment with the FIN flag turned on to the call partner terminal 100B, and requests disconnection of the TCP session (S51 ').

  In response to this, the communication partner terminal 100B transmits a TCP segment with the ACK flag turned on to the call recording terminal 100A for an acknowledgment (S52 '), and sends the TCP segment with the FIN flag and ACK flag turned on to the call recording terminal 100A. To disconnect the TCP session (S53 '). On the other hand, when the call recording terminal 100A returns a TCP segment with the ACK flag turned on (S54 '), the RTP / TCP session is terminated.

  In this way, while the call recording operation is performed at the call recording terminal 100A, the recording voice data is transferred by the connection type communication in parallel with the voice call by the normal connectionless type communication. Even after the connection type communication session is ended, the voice data exchange (S50) in the connectionless type communication by RTP / UDP is continued until the call is ended.

  The operations of the call recording terminal 100A and the call partner terminal 100B that perform the operation sequence as described above will be described in detail below. First, the call recording process executed by the call recording terminal 100A will be described with reference to the flowchart shown in FIG. In this call recording process, when IP telephone communication is performed with the other party terminal 100B by connectionless communication, a recording start instruction by operating the recording button of the operation unit 130 is given by the control unit 110 (IP telephone processing unit 111). It will be triggered by the input to.

  When the processing is started, IP telephone processing unit 111 notifies call recording processing unit 114A that recording start is instructed. In response to this notification, the call recording processing unit 114A notifies the reception voice processing unit 112 of the start of recording, and receives the header information of the received voice data currently processed by the reception voice processing unit 112 from the reception voice processing unit 112. The recording start position is specified by acquiring (step S101). Here, since the audio data by RTP / UDP is received, the sequence number and time stamp information described in the RTP header are used as information indicating the recording start position (hereinafter referred to as “recording start position information”). get.

  At the same time, the call recording processing unit 114A instructs the transmission voice processing unit 113 to temporarily store (buffer) the transmission voice data from the call recording terminal 100A in the transmission buffer area 162A. In response to this instruction, the transmission voice processing unit 113 duplicates the voice data of the transmission voice currently being processed and stores it in the transmission buffer area 162A (step S102). Here, since the transmitted voice is transmitted to the other party terminal 100B by RTP / UDP, voice data including a header corresponding to each protocol of IP, UDP, and RTP is stored in the transmission buffer area 162A.

  The call recording processing unit 114A instructs the protocol control request unit 115A to start recording and notifies the recording start position information acquired in step S101. The protocol control requesting unit 115A requests the call partner terminal 100B for protocol control according to the SIP procedure in order to request the call partner terminal 100B to transmit voice data to be used for call recording at the call recording terminal 100A (step S103). . Here, a connection type communication session is established by performing the operations in S51 to S53 in FIG. 6 (step S104), and the connection type communication (RTP / UDP session) is performed in the current connectionless type communication (RTP / UDP session). / TCP session).

  Here, when making a protocol control request to the call partner terminal 100B, the protocol control request unit 115A transmits the recording start position information notified from the call record processing unit 114A to the call partner terminal 100B, thereby determining the recording start position. The call partner terminal 100B is notified.

  As a result, the voice data from the recording start position is sequentially transmitted from the call partner terminal 100B by the connection-type communication established in step S104. Here, as described above, since the connectionless communication for call and the connection communication for recording are performed in parallel, the call partner terminal 100B receives voice data (RTP / UDP data) and connection type protocol voice data (RTP / TCP data) are mixedly transmitted.

  The voice data transmitted from the other party terminal 100B in this way is received by the communication control unit 120 and input to the received voice processing unit 112. The received voice processing unit 112 has been notified of the start of recording in step S101, and thus recognizes that RTP / UDP data and RTP / TCP data are mixed in voice data to be received. In this case, the received voice processing unit 112 refers to the IP header of the received voice data, and determines whether or not the acquired voice data packet is RTP / TCP data for recording (step S105).

  When the acquired voice data packet is RTP / TCP data (step S105: Yes), the received voice processing unit 112 supplies the data to the received voice processing unit for recording 116A. The recording reception voice processing unit 116A stores the RTP / TCP voice data supplied from the reception voice processing unit 112 in the reception buffer area 161A (step S106), and returns a TCP response confirmation to the call partner terminal 100B. (Step S107).

  The operations from step S105 to step S107 are repeated until the user of the call recording terminal 100A operates the recording button of the operation unit 130 to instruct to stop recording (step S108: No).

  In such RTP / TCP voice data acquisition, if a voice data packet transmitted from the call partner terminal 100B to the call recording terminal 100A is lost, the received voice processing unit for recording 116A confirms the response to the call partner. A reply cannot be made to terminal 100B. In such a case, the corresponding packet is retransmitted from the communication partner terminal 100B by the TCP error correction function. When the retransmitted packet is received in this manner, the response is returned to the call partner terminal 100B while being stored in the reception buffer area 161A by the operations in steps S105 to S107.

  When the user of the call recording terminal 100A operates the recording button of the operation unit 130 to instruct the end of recording (step S108: Yes), the input signal is input to the call recording processing unit 114A via the IP phone processing unit 111. . In this case, the call recording processing unit 114A instructs the reception voice processing unit 112 to end the recording and obtains header information of the reception voice data currently processed by the reception voice processing unit 112 from the reception voice processing unit 112. Use to specify the recording start position. Here, as in the processing in step S101, the sequence number and time stamp described in the RTP header of the RTP / UDP data processed by the received voice processing unit 112 is used to specify the recording end position (hereinafter referred to as the recording end position). , “Recording end position information”).

  When the call recording processing unit 114A obtains the recording end position information, the call recording processing unit 114A accesses the reception buffer area 161A and refers to the RTP header of the received reception voice data, so that the voice data packet (final data packet) at the recording end position is obtained. ) Is stored. Here, when the final data packet is not stored, all the audio data necessary for recording cannot be acquired (step S109: No), and the connection-type communication session is continued.

  In other words, if retransmission processing is performed using TCP, voice data may be received later than real-time communication using RTP / UDP. If all data has not been received, a recording end instruction is received. However, the connection type communication session is not terminated.

  Even if the last data packet is stored in the reception buffer area 161A, if the intermediate packet is a retransmission target, not all the voice data packets may be stored. Therefore, the call recording processing unit 114A checks whether or not all voice data packets are stored by checking the sequence number described in the TCP header of the received voice data stored in the reception buffer area 161A. A determination is made (step S109).

  When the received voice data acquired by the connection type communication performed in parallel with the connectionless type communication for a call includes all packets corresponding to the recording period (step S109: Yes), the call recording processing unit 114A Then, the end of the connectionless communication is instructed to the protocol control request unit 115A, and the recording data generation unit 117A is instructed to generate the recording data.

  The protocol control request unit 115A completes the connection-type communication session with the communication partner terminal 100B by performing the operations according to S51 'to S54' of FIG. 7 (step S110). Thereby, the session with the call partner terminal 100B is only connectionless communication (RTP / UDP) for calls.

  In addition, the recording data generation unit 117A combines the received voice data stored in the reception buffer area 161A and the transmission voice data stored in the transmission buffer area 162A, so that the content of the call during the recording period can be obtained. The recorded recording data is generated, and the generated recording data is stored in the recording data storage area 163A (step S111), thereby terminating the call recording process.

  When generating the recorded data, the actual call is synthesized by combining the time positions of the transmitted voice and the received voice based on the time stamps described in the RTP headers of the transmitted voice data and the received voice data. Recorded data that can be played back is generated.

  Next, a protocol control process executed by the communication partner terminal 100B will be described with reference to a flowchart shown in FIG. This protocol control process is started when the communication control unit 120 of the call partner terminal 100B receives the protocol control request transmitted from the call recording terminal 100A and inputs it to the control unit 110. That is, the processing is started when the request determination unit 114B determines that the SIP message input to the control unit 110 is a request for adding a session in TCP.

  In this case, the request determination unit 114B notifies the protocol control unit 115B that a TCP session addition has been requested. In response to the notification from the request determination unit 114B, the protocol control unit 115B instructs the transmission voice processing unit 113 to start buffering the transmission voice data currently being processed. In response to this instruction, the transmission voice processing unit 113 generates a copy of the transmission voice data being processed, and sequentially stores it in the transmission buffer area 162B (step S201).

  Here, as described above, the protocol control request from the call recording terminal 100A includes the recording start position information. The protocol control unit 115B accesses the transmission buffer area 162B, refers to the RTP header of the transmission voice data stored by the transmission voice processing unit 113, and before the recording start position requested from the call recording terminal 100A. If there is a packet indicating the voice part of, it is deleted. As a result, the voice data from the time when the recording button is operated on the call recording terminal 100A is temporarily stored in the transmission buffer area 162B.

  The protocol control unit 115B instructs the connection type transmission processing unit 116B to start a session of connection type communication simultaneously with the buffer start instruction to the transmission voice processing unit 113. The connection-type transmission processing unit 116B establishes a connection-type communication (RTP / TCP) session with the call recording terminal 100A by performing the operations according to S52 to S56 of FIG. 6 (step S202).

  The connection-type transmission processing unit 116B transmits the transmission voice data sequentially stored in the transmission buffer area 162B in step S201 to the call recording terminal 100A through the established RTP / TCP session (step S203). Here, since transmission is performed using the TCP protocol, a confirmation response to the transmitted packet is returned from the call recording terminal 100A. Therefore, the connection-type transmission processing unit 116B notifies the error correction processing unit 117B as needed when transmitting a packet in the RTP / TCP session. The error correction processing unit 117B measures the elapsed time since the transmission by the connection-type transmission processing unit 116B, and determines whether an acknowledgment for the transmission packet has been received within a predetermined time (step S204).

  If there is a packet that cannot receive a response confirmation within a predetermined time (step S204: Yes), the error correction processing unit 117B retransmits the packet according to the TCP retransmission procedure (step S205). If an acknowledgment is received within a predetermined time (step S204: No), the packet is deleted from the transmission buffer area 162B.

  By repeating such an operation until the end of the connection type communication is requested from the call recording terminal 100A (step S206: No), the transmission voice data indicating the voice of the user of the other party terminal 100B becomes the connection type. The lost packet is retransmitted to the call recording terminal 100A through the RTP / TCP session which is communication.

  Here, when the recording button is operated and an end of recording is instructed in the call recording terminal 100A, the recording end position information is transmitted from the call recording terminal 100A to the call partner terminal 100B together with a connection type communication end request. That is, the call recording terminal 100A transmits a TCP disconnection request to the call partner terminal 100B. In this case, the request determination unit 114B determines that the received signal is a TCP disconnection request. (Step S206: Yes).

  When the request determination unit 114B determines in this way, the protocol control unit 115B instructs the transmission voice processing unit 113 to end the buffer operation of the transmission voice data. Thus, when the transmission of the transmission voice data to the transmission buffer area 162B is completed, the protocol control unit 115B instructs the connection type transmission processing unit 116B to end the voice data transmission in the connection type communication and The recording end position information received from the recording terminal 100A is notified to the connection type transmission processing unit 116B.

  The connection-type transmission processing unit 116B transmits up to the packet (final data) corresponding to the notified recording end position information to the call recording terminal 100A by connection-type communication, and determines whether or not a confirmation response corresponding to this is received. (Step S207). As described above, since the packet that has received the acknowledgment is deleted from the transmission buffer area 162B, here, the connection-type transmission processing unit 116B accesses the transmission buffer area 162B, and the buffered transmission voice data is By confirming whether all have been deleted, it is determined whether or not the final data has been reliably transmitted to the call partner terminal 100B.

  Therefore, when data to be retransmitted still remains in the transmission buffer area 162B (step S207: No), the packet is retransmitted (step S205).

  On the other hand, when the confirmation response up to the final data has been received (step S207: No), the connection-type transmission processing unit 116B performs an operation related to S52 ′ to S54 ′ in FIG. The connection type communication (RTP / TCP) session is terminated (step S208), and the process is terminated.

  As described above, according to the present embodiment, a connectionless communication protocol is used between communication terminals that perform a voice call using an IP phone when a real-time call is required. While there is a session, a session using a connection-type communication protocol is also added, and the same voice data as the voice during the call is transferred by the connection-type communication. Thereby, since recording data without packet loss can be obtained, it is possible to perform call recording without interruption of sound during reproduction.

  In this case, since the recording data is generated by synthesizing the transmitted voice from the recording side device and the received voice received from the partner device by connection-type communication, the conversation content in the voice call can be expressed with a voice without interruption. You can record.

  In addition, since connection-type communication is added and voice data for recording is acquired only while call recording is being performed, voice data for a recording period desired by the user can be acquired, as well as processing in the device and network Do not put more load than necessary.

  The said embodiment is an example and the application range of this invention is not restricted to this. That is, various applications are possible, and all embodiments are included in the scope of the present invention.

  For example, in the above description of the present embodiment, the configuration of the recording side terminal and the configuration of the communication partner side terminal have been described separately for easy understanding. You may comprise.

  In the above embodiment, the mobile communication network MN is interposed between the mobile communication terminal 100 and the packet switching network IN. However, the base station BS and the mobile communication terminal 100 are, for example, IEEE802.16. When supporting wireless IP communication (so-called WiMAX, mobile WiMAX, etc.), the base station BS may be able to directly access the packet switching network IN without going through the mobile communication network MN. .

  Further, in the above embodiment, the transmission voice and the reception voice are synthesized and recorded so that the conversation contents at the time of the call can be reproduced. However, the present invention is not limited to such an operation. Only sound transmitted from the side may be recorded. According to such a configuration, for example, when recording one-side audio content from the other party, such as voice guidance, the transmission voice and the reception voice are not synthesized as shown in the above embodiment. Therefore, recording can be performed with a simpler operation.

  In the above embodiment, an example in which the present invention is applied to a mobile communication terminal is shown. However, any communication device having an IP telephone function may be used. For example, the present invention is applied to a fixed IP telephone. Also good. In addition, the present invention may be applied to an information processing apparatus that processes voice information. For example, the voice transmitted from the telephone device is translated into another language, and the translated voice data is returned to the transmission source telephone device. The present invention can also be applied to a server that provides a translation service. In this case, a connection type protocol is used for transmission of voice data from the telephone device to the server so that more accurate translation can be performed, and a connectionless type protocol is used for the translated voice data in the same way as a normal voice call. By performing protocol control, it is possible to send and receive good audio data according to the application.

  In addition, each protocol shown in the said embodiment is an example, and if it can implement | achieve connectionless type communication or connection type communication, it will not be restricted to the protocol mentioned above, You may use arbitrary things.

  In addition, the communication apparatus to which the present invention can be applied can be provided as an apparatus having the functions and configurations according to the present invention as shown in the above embodiment, and also by applying a program similar to the above-described program. The existing communication device can also function as the communication device according to the present invention.

  In this case, a computer (CPU or the like) that controls (applies to) an existing communication device having an IP telephone function by applying (installing) the program as executed by the mobile communication terminal 100 of the above embodiment. By executing the above, it is possible to realize a communication device having the same function as the mobile communication terminal 100 described above.

  Such a program distribution method is arbitrary. In addition to being able to be stored and distributed in a recording medium such as a CD-ROM or a memory card, the program may be distributed via a network such as the Internet.

It is a figure which shows the structure of the audio | voice communication system concerning embodiment of this invention. It is a block diagram which shows the hardware constitutions of the mobile communication terminal shown in FIG. It is a block diagram which shows the function structure implement | achieved by the control part of the call recording terminal shown in FIG. It is a block diagram which shows the function structure implement | achieved by the control part of the other party terminal shown in FIG. It is a sequence chart for demonstrating the procedure of the voice call between the call recording terminal shown in FIG. 1, and a calling party terminal. It is a sequence chart for demonstrating the communication procedure between a call recording terminal and a call other party terminal when call recording is started with the call recording terminal shown in FIG. It is a sequence chart for demonstrating the communication procedure between a call recording terminal and a call other party terminal when call recording is complete | finished with the call recording terminal shown in FIG. 3 is a flowchart for explaining “call recording processing” executed by the call recording terminal shown in FIG. 1. 3 is a flowchart for explaining a “protocol control process” executed in the call partner terminal shown in FIG. 1.

Explanation of symbols

DESCRIPTION OF SYMBOLS 1 ... Voice communication system, IN ... Packet switching network (IP network), SS ... Call control apparatus (SIP server), MN ... Mobile communication network (cellular network), BS ... Base station, 100 ... Mobile communication terminal, 100A ... Call recording terminal, 100B ... Call partner terminal, 110 ... Control unit, 111 ... IP phone processing unit, 112 ... Received voice processing unit, 113 ... Transmitted voice processing unit, 114A ... Call recording processing unit, 114B ... Request discrimination unit 115A ... Protocol control request unit, 115B ... Protocol control unit, 116A ... Recording received voice processing unit, 116B ... Connection type transmission processing unit, 117A ... Recording data generation unit, 117B ... Error correction processing unit, 120 ... Communication control unit 121 ... Antenna, 130 ... Operation unit, 140 ... Display unit, 150 ... Audio processing unit, 151 ... Speaker, 152 ... Microphone, 160 ... Parts, 161A ... received buffer area, 162A ... sending buffer area, 162B ... sending buffer area, 163A ... recording data storage area, 164 ... program storage area

Claims (8)

In a communication device having an IP telephone function,
Voice communication means for performing voice communication of the IP telephone function using a connectionless protocol;
When the recording of voice communication by the voice communication means is instructed, voice data transmission using the collectionless protocol and voice data transmission using the connection protocol are transmitted to the counterpart device with which the voice communication means is communicating. Request means for requesting, and
Recording data generation means for generating recording data using voice data transmitted by the connection type protocol in response to a request by the request means;
Recording data storage means for storing the recording data generated by the recording data generation means;
A communication apparatus comprising: The recorded data storage means includes
A transmission buffer for temporarily storing transmission voice data from the communication device;
A reception buffer for temporarily storing received voice data transmitted from the counterpart apparatus using the connection-type protocol;
The recording data generating means generates the recording data by synthesizing the transmission voice data temporarily stored in the transmission buffer and the reception voice data temporarily stored in the reception buffer.
The communication apparatus according to claim 1. The communication device is a mobile communication terminal.
The communication apparatus according to claim 1 or 2, wherein In a communication device having an IP telephone function,
A connectionless communication means for performing voice communication of the IP telephone function using a connectionless protocol;
A connection for transmitting voice data transmitted by the connectionless communication unit to the partner device using the connectionless protocol and a connection protocol in response to a request from the partner device with which the connectionless communication unit is communicating. Type communication means;
A communication apparatus comprising: The connection type communication means includes:
In response to a request transmitted when call recording is executed in the partner device, voice data transmission in the connection type protocol is started,
Ending voice data transmission in the connection-type protocol in response to a request sent from the counterpart device upon completion of the call recording;
The communication apparatus according to claim 4. The communication device is a mobile communication terminal.
The communication apparatus according to claim 4 or 5, wherein A computer that controls a communication device having an IP telephone function;
A function of performing voice communication of the IP telephone function using a connectionless protocol;
A function for requesting voice data transmission in the collectionless protocol and voice data transmission in the connection-type protocol to the counterpart device performing the voice communication in response to an instruction to record the voice communication; ,
A function of generating recording data using voice data transmitted by the connection-type protocol in response to the request;
A function to store the generated recording data in a storage device;
A program characterized by realizing. A computer that controls a communication device having an IP telephone function;
A function for performing voice communication of the IP telephone function using a connectionless protocol;
A function of transmitting voice data to be transmitted to the counterpart device in response to a request from the counterpart device performing the voice communication to the counterpart device using the connectionless protocol and a connection type protocol;
A program characterized by realizing.

Images