JP2016206516A - Voice transmitter, voice receiver, and voice transmission program - Google Patents

Abstract

PROBLEM TO BE SOLVED: To provide a voice transmitter capable of controlling arithmetic processing on the basis of a processing load actually measured in a telephone device.SOLUTION: The voice transmitter comprises an encoder 102 for coding an external signal at a first coding cycle and generating an encoded signal and a packet generator 103 for packetizing the signal at a first packetization cycle. The voice transmitter further comprises a packetization interval calculation unit 104 for measuring a packetization interval of continuous packets and outputting packetization time measurement information and a cycle determination unit 105 for comparing the packetization time measurement information with the first coding cycle or the first packetization cycle to determine a second coding cycle, and applying the second coding cycle to the encoder to encode the encoded signal at the second coding cycle.SELECTED DRAWING: Figure 1

Description

  The present invention relates to a voice transmission device, a voice reception device, and a voice transmission program, and can be applied to, for example, a voice transmission device, a voice reception device, and a voice transmission program that perform VoIP (Voice over IP) communication.

  In general, the digital telephone apparatus repeatedly performs arithmetic processing at specific time intervals. However, the digital telephone apparatus has a problem that the arithmetic processing cannot be completed within a specific time when the processing load of encoding is large. Further, the digital telephone apparatus has a problem that when the processing load for packetization is large, it takes time until the packet is transmitted, and the arithmetic processing cannot be completed within a specific time. Furthermore, when the digital telephone apparatus processes the encoding process and the packetization process synchronously, or when it is necessary to match the encoding process and the packetization process timing, when the processing load of the packetization is large, There was a problem that the arithmetic processing could not be completed within a specific time.

  As a conventional technique for controlling arithmetic processing (packetization or encoding) in accordance with the processing load of a telephone device in a digital telephone device, for example, the one disclosed in Patent Document 1 can be cited. The digital telephone apparatus described in Patent Literature 1 includes a plurality of methods of compression encoding means for performing compression encoding of call contents, a decoding means, and a load determination section that measures the processing load applied to the control section. According to the determination result of the load determination unit, one of a plurality of encoding means is selected and compression encoding is performed.

JP-A-11-27381

  However, the digital telephone device described in Patent Document 1 roughly determines the processing load applied to the control unit based on the operation state of the telephone device (standby, parent device call, child device call, etc.). For this reason, the digital telephone device described in Patent Document 1 has a problem that the arithmetic processing cannot be controlled based on the actually measured processing load in the telephone device. In addition, there is a problem that cannot be handled by the telephone device having the above-described configuration when processing with a large processing load is included other than the encoding means. For example, when the digital telephone apparatus is a soft phone, the problem becomes more apparent because a personal computer on which the soft phone is mounted performs various processes.

  Therefore, a voice transmission device, a voice reception device, and a voice transmission program that can control the arithmetic device based on the actually measured processing load in the telephone device are desired.

  The first aspect of the present invention is: (1) an encoder that encodes a signal input from the outside at a first encoding period to generate an encoded signal; and (2) the encoded signal that is a first packet. (3) Packetization that outputs packetization time measurement information by measuring the packetization interval of consecutive packets output by the packet generator A time measurement unit; (4) determining a second encoding period by comparing the packetization time measurement information with the first encoding period or the first packetization period; And a period specifying unit that gives the second encoding period to the encoder and encodes the encoded signal in the second encoding period.

  According to a second aspect of the present invention, there is provided a voice receiving apparatus including: a packet decomposing unit that decomposes a packet input from the outside at a first packet decomposing period; and a decoding unit that decodes the decomposed packet to generate a decoded signal. (1) a decoding interval calculation unit that calculates a decoding processing interval in successive packets from the decoding processing start time and decoding processing end time of the packet in the decoding unit, and outputs decoding processing time measurement information; (2) A second packet decomposition period is determined from the decoding processing time measurement information and the first packet decomposition period, the second packet decomposition period is given to the packet decomposition unit, and the second packet decomposition period is given. And a period designating unit for decomposing the packet at a packet decomposing period.

  According to a third aspect of the present invention, there is provided an audio transmission program comprising: (1) an encoder that generates an encoded signal by encoding an externally input signal at a first encoding period; And (2) a packet generator that packetizes the encoded signal at a first packetization period, and (3) packetization by measuring the packetization interval of successive packets output by the packet generator. A packetization time measurement unit that outputs time measurement information; and (4) a second code by comparing the packetization time measurement information with the first encoding period or the first packetization period. An encoding period is determined, the second encoding period is given to the encoder, and the encoder is made to function as a period specifying unit that encodes the encoded signal in the second encoding period.

  According to the present invention, the arithmetic processing can be controlled based on the actually measured processing load in the telephone device.

It is a block diagram which shows the internal structure of the transmission part which concerns on 1st Embodiment. It is explanatory drawing which shows the whole structure of the audio | voice communication system which concerns on 1st Embodiment. It is a time chart which shows operation | movement of each process of the transmission part which concerns on 1st Embodiment. It is a block diagram which shows the internal structure of the transmission part which concerns on 2nd Embodiment. It is a time chart (the 1) which shows operation | movement of each process of the transmission part which concerns on 2nd Embodiment. It is a time chart (the 2) which shows operation | movement of each process of the transmission part which concerns on 2nd Embodiment.

(A) First Embodiment Hereinafter, a first embodiment of a voice transmission device, a voice reception device, and a voice transmission program according to the present invention will be described in detail with reference to the drawings.

(A-1) Configuration of the First Embodiment FIG. 2 is an explanatory diagram showing the overall configuration of the voice communication system according to the first embodiment.

  In FIG. 2, the voice communication system 5 includes two voice communication apparatuses 1 </ b> A and 1 </ b> B that perform voice communication (call) in real time via the network 2. Although the communication system of the network 2 is not limited, for example, an IP communication network or the like can be applied (hereinafter, the network 2 will be described as an IP communication network). Each of the voice communication apparatuses 1A and 1B transmits and receives media data such as voice as IP packets.

  The voice communication device 1 </ b> A includes a transmission unit 10 and a reception unit 11. Although not shown, the voice communication device 1B has the same configuration as the voice communication device 1A.

  FIG. 1 is a block diagram illustrating an internal configuration of a transmission unit according to the first embodiment. The transmission unit according to the first embodiment can be configured by hardware except for the microphone, and can also be realized by software (voice transmission program) executed by the CPU and the CPU. However, even if any realization method is adopted, it can be functionally represented in FIG.

  In FIG. 1, the transmission unit 10 includes a microphone 101, an encoder 102, a packet generator 103, a packetization interval calculation unit 104, an encoding period determination unit 105, and a timer unit 106.

  The timer unit 106 measures the time in the transmission unit 10.

  The microphone 101 captures the sound in the vicinity of the sound communication apparatus 1A, converts the sound signal obtained by the capture into a digital signal, and outputs the result as an input signal S111 to the encoder 102. .

  The encoder 102 performs an encoding process on the input signal S111 and outputs it to the packet generator 103 as an encoded signal S112. At this time, the processing performed by the encoder 102 is performed according to a cycle indicated by encoding cycle information J124 described later.

  Note that the encoding method by the encoder 102 is not particularly limited, and various methods can be widely applied. For example, G. 729 and the like can be applied. In this embodiment, the encoder 102 performs an encoding process on the input signal S111 and processes necessary for generating a signal for sending a packet other than the encoding, for example, gain adjustment. It is assumed that reduction processing (band limitation, noise removal) of unnecessary components included in the input signal S111 is performed.

  The packet generator 103 generates a transmission packet S113 to be transmitted to the opposite voice communication device 1B based on the input encoded signal S112. At this time, the generation (packetization) of the transmission packet S113 is performed according to the cycle indicated by the transmission cycle information J122. It is assumed that this transmission cycle information J122 can be appropriately set and changed by a user operation on a packetization cycle designation unit (not shown) arranged in the voice communication device 1A. Then, the packetized transmission packet S113 is transmitted to the voice communication apparatus 1B via the network 2.

  Also, the packet generator 103 outputs the time at which packetization of the encoded signal S112 is started to the packetization interval calculation unit 104 as packetization start information J130. Further, the packet generator 103 outputs a transmission completion message of the output transmission packet S113 to the packetization interval calculation unit 104.

  In this embodiment, the packet generator 103 is described as operating when the encoded signal S112 output from the pre-processing encoder 102 is input. However, the encoder 102, Each of the packet generators 103 may operate independently.

  When the packetization interval calculation unit 104 receives the transmission completion message of the transmission packet S113, the packetization interval calculation unit 104 obtains the reception time from the timer unit 106 and stores it internally as the packetization end time PTM. Then, the packetization interval calculation unit 104 calculates the packetization interval from the packetization start information J130 and the packetization end time PTM, and sends the calculation result as the packetization time measurement information J123 to the encoding cycle determination unit 105. Output.

  The coding cycle determination unit 105 determines whether or not the packetization cycle is appropriate based on the packetization time measurement information J123, and if necessary, sets the coding cycle to be changed to the encoder 102 as the coding cycle information J124. Output. The encoding cycle information J124 only needs to be information that can specify the encoding cycle. For example, the encoding cycle time, an index indicating the encoding cycle, and the like are conceivable. The detailed operation of the coding cycle determination unit 105 will be described in the section of operation described later. Also, the coding cycle determination unit 105 stores the output coding cycle information J124 in the coding cycle CT0 as information indicating the current coding cycle.

(A-2) Operation of the First Embodiment Next, the operation of the transmission unit 10 of the first embodiment having the above configuration will be described with reference to the drawings. The transmission unit 10 of this embodiment will be described assuming that the processing of the encoder 102 and the processing of the packet generator 103 operate in synchronization. The transmission cycle information J122 is set in advance by the user.

  When the transmission unit 10 starts operating, the encoding period determining unit 105 determines an encoding period CT0 for encoding by the encoder 102 by an encoding period determining method to be described later as encoding period information J124. Output. In this embodiment, the encoding cycle information J124 indicates an initial value (for example, 10 ms) of the encoding cycle CT0 at the operation start time.

  An audio signal captured by the microphone 101 is converted into a digital signal and then output to the encoder 102 as an input signal S111.

  In the encoder 102, an encoding process is performed on the input signal S111. At this time, the input signal S111 is subjected to encoding processing every time (cycle) designated by the encoding cycle information J124. The input signal S111 subjected to the encoding process is output to the packet generator 103 as the encoded signal S112.

  In the packet generator 103, the encoded signal S112 is packetized every time specified by the transmission cycle information J122, and is output to the outside as a transmission packet S113. Further, the packet generator 103 outputs, as packetization start information J130, the time at which packetization processing is started for the input encoded signal S112. Further, the packet generator 103 outputs a transmission completion message of the output transmission packet S113 to the packetization interval calculation unit 104.

  The packetization interval calculation unit 104 stores the time when the transmission message of the transmission packet S113 is received as the packetization end time PTM. Further, the packetization interval calculation unit 104 calculates the difference between the packetization start information J130 and the packetization end time PTM acquired immediately before (in other words, the end time of the packetization process immediately before the present time) as the packetization time. The measurement information J123 is output to the encoding cycle determination unit 105. When the packetization time measurement information J123 cannot be determined, such as at the beginning of the operation of the transmission unit 10, the packetization time measurement information J123 is input with a value indicating undecided (for example, 0.0 ms). May be.

  Next, a coding cycle determination method performed by the coding cycle determination unit 105 will be described.

  The encoding period determination unit 105 is (c) when the value of the received packetization time measurement information J123 indicates (a) undefined, (b) when it is less than the encoding period CT0, and (c) is equal to or more than the encoding period CT0. Depending on the time, the operation is different. The encoding period determination unit 105 transmits the encoding period information J124 to the encoder 102 after performing processing corresponding to (a) to (c) described later.

  First, the operation of the coding period determining unit 105 when the value of the packetization time measurement information J123 in (a) indicates undefined will be described.

  At this time, since packetization is not performed by the packet generator 103, the encoding period determining unit 105 sets a predetermined default value (for example, 10 ms) in the encoding period information J124. Also, the coding cycle determination unit 105 stores the current coding cycle value (transmitted coding cycle information J124) as the coding cycle CT0.

  Next, the operation of the coding period determining unit 105 when the value of the packetization time measurement information J123 in (b) is less than the coding period CT0 will be described.

  In the packet generator 103, since the encoding process is not affected by the processing load of packetization, the encoding period determination unit 105 does not change the value of the encoding period CT0. If not changed, the coding cycle determination unit 105 does not transmit the coding cycle information J124 to the encoder 102, or the packet generator 103 uses the value of the coding cycle CT0 not changed as the coding cycle information J124. You may choose to send to

  A specific example in which this processing is performed is, for example, a case where an input signal s2 shown in FIG. 3 to be described later is encoded and packetized.

  Next, the operation of the coding period determination unit 105 when the value of the packetization time measurement information J123 in (c) is equal to or greater than the coding period CT0 will be described.

  In the packet generator 103, the processing load of packetization is large. As a result, the encoding process in the encoder 102 synchronized with the packet generator 103 cannot be completed within the encoding period specified by the encoding period information J124. For this reason, the coding cycle determination unit 105 increases the value of the coding cycle CT0 so that the time interval for performing the coding is increased. As a result, the encoding process can be completed within the newly set encoding cycle.

  Here, the coding period amount to be changed is changed so as to be larger than the value of the original coding period CT0 and equal to or larger than the value of the packetization time measurement information J123. In this embodiment, a time that is a natural number multiple of 10 ms and a value that is larger than the values of the coding period CT0 and the packetization time measurement information J123 are changed. However, this value may be changed so as to operate appropriately according to the device applied by the designer. For example, the value is larger than the original coding period CT0 and the packetization time measurement information J123 The encoding period may be changed to 1.5 times the value.

  If the value of the packetization time measurement information J123 is not equal to or greater than the coding period CT0 after changing the coding period CT0, the coding period determining unit 105 sets the increased coding period to the original value. Return to the coding period CT0. The encoding period CT0 before the change is held (stored) in the encoding period determining unit 105, and the encoding period determining unit 105 may read and reset this period. The process of returning the encoding period to the original is not limited to the above example, but is executed when a state in which the value of the packetization time measurement information J123 is not equal to or greater than the encoding period CT0 occurs three times in succession. Various methods can be used.

  A specific example in which this processing is performed is, for example, a case where an input signal s3 shown in FIG. 3 described later is encoded and packetized.

  Next, the operation of the transmission unit 10 will be described using the time chart of FIG. 3 as an example.

  Here, FIG. 3A shows the waveform of the sound captured by the microphone 101. FIG. 3B shows input signals S1 to s6 obtained by dividing an input signal S111 converted into a digital signal for every unit time (10 ms in this embodiment) with respect to the captured voice. FIG. 3C shows a block image of the time for encoding processing for each input signal. The time at which encoding is started for each input signal by the encoder 102 is indicated as time t2, time t5, time t8, time t11, and time t14. In addition, encoding cycles in which each encoding process is performed are indicated as ct01 to ct03. The cycle of the encoding cycle ct01 or ct02 corresponds to one divided input signal. The cycle of the encoding cycle ct03 corresponds to two divided input signals. FIG. 3D shows a block image of the time for packetizing the signal encoded by the encoder 102. The packetization start time (the head of each block) is indicated by time t3, time t6, time t9, time t12, and time t15. The end time of packetization processing (tail of each block) is indicated by time t4, time t7, time t10, time t13, and time t16. Also, the “arrow” of each block from each block in FIG. 3C to FIG. 3D indicates that the processing has been taken over from the encoder 102 to the packet generator 103. Note that there is some time lag in taking over this process. The packetization interval pp1 is a difference (interval) from time t6, which is the start of packetization processing, to time t4, which is the end time of the previous packet processing. Similarly, the packetization interval pp2 is a difference (interval) from time t9, which is the start of packetization processing, to time t7, which is the end time of the previous packetization processing.

  Next, the time chart of FIG. 3 will be described along time series.

  At time t1, the microphone 101 captures sound and converts the captured sound signal into a digital signal (input signal S111). At time t2, the encoder 102 starts encoding the input signal s1. The cycle for encoding the input signal s1 is the encoding cycle ct01. At time t3, the packet generator 103 starts packetizing the input signal s1 that has been encoded. At time t4 when packetization ends, the packet generator 103 sends the generated packet signal.

  Next, encoding and packetizing processes are performed on the input signal s2.

  At time t5, the encoder 102 encodes the input signal s2 with the encoding cycle ct02. At time t6, the packet generator 103 starts to packetize the input signal s2 that has been encoded. At time t7 when packetization ends, the packet generator 103 sends the generated packet signal.

  Note that the packetization interval calculation unit 104 calculates the interval of packetization processing performed every period as needed. For example, the packetization interval pp1 is a time (interval) obtained by subtracting the time t4 that is the end time of the packetization processing of the input signal s1 from the time t6 that is the start time of the packetization processing of the input signal s2. The encoding cycle determination unit 105 determines the encoding cycle each time it receives the packetization time measurement information J123 including the packetization interval information from the packetization interval calculation unit 104, and if necessary, determines the encoding cycle. Make changes. For example, when the packetization interval pp1 is compared with the current encoding cycle ct01, the packetization interval pp1 is less than the encoding cycle ct01. Therefore, the next encoding cycle ct02 is not changed.

  Next, encoding and packetizing processes are performed on the input signal s3.

  At time t8, the encoder 102 encodes the input signal s3 with the encoding cycle ct03. At time t9, the packet generator 103 starts packetizing the input signal s3 that has been encoded. At time t10 when packetization ends, the packet generator 103 sends out the generated packet signal.

  The encoding cycle ct03 is changed from the encoding cycle ct02 by the following process. The packetization interval pp2 calculated by the packetization interval calculation unit 104 is a time obtained by subtracting the time t7 which is the end time of the packetization processing of the input signal s2 from the time t9 which is the start time of the packetization processing of the input signal s3 ( Interval). In the encoding cycle determination unit 105, when the packetization interval pp2 is compared with the current encoding cycle ct02, since the packetization interval pp2 is larger than the encoding cycle ct02, the next encoding cycle ct03 is changed. It will be.

  The method of determining the value of the coding cycle ct03 is as described above. The value of the coding cycle ct03 is larger than the value of the original coding cycle ct02 and the value of the packetization time measurement information J123 (here, the packet). Is changed to a value equal to or greater than the conversion interval pp2). The value to be changed to any value is arbitrary, but in the example of FIG. 3, the coding cycle ct03 is changed to be twice as long as the coding cycle ct02.

  In the example of FIG. 3, after the process of the input signal S3 is completed, a process of returning the encoding period to the encoding period before the change is performed. The description of the processing after this (after time t11) is omitted, but the encoding / packetization processing is similarly performed for the processing of the input signals S4 to S6.

(A-3) Effect of the First Embodiment According to the first embodiment, the coding cycle determination unit 105 changes the coding cycle based on the packetization processing time, thereby It has become possible to prevent the time required for packetization processing from exceeding the encoding cycle.

  Further, according to the first embodiment, the packetization interval calculation unit 104 actually measures the processing load of the packet generator 103 as the packetization processing time, and the encoding cycle determination unit 105 performs encoding based on the actually measured value. Since the period is changed, the encoding process and the packetizing process can be accurately followed to real-time voice communication.

(B) Second Embodiment Next, a second embodiment of the voice transmission device, the voice reception device, and the voice transmission program according to the present invention will be described with reference to the drawings.

(B-1) Configuration of Second Embodiment As shown in FIG. 2 described above, the voice communication system 5 of the second embodiment also includes two voice communication apparatuses 1A or 1B that exchange IP packets. Are opposed to each other.

However, in the case of the second embodiment, the internal configuration of the voice communication device 1 (1A or 1B) is different from that of the first embodiment. That is, the second embodiment differs from the first embodiment in that the transmission unit 20 is applied to the voice communication device 1 (1A or 1B).

  FIG. 4 is a block diagram showing an internal configuration of the transmission unit 20 according to the second embodiment, and the same reference numerals are given to the same and corresponding parts as those in FIG. 1 according to the first embodiment. .

  4, the transmission unit 20 according to the second embodiment includes a microphone 101, an encoder 202, a packet generator 203, a packetization interval calculation unit 104, an encoding period calculation unit 207, and a period determination unit 208. That is, instead of the encoder 102, the packet generator 103, and the encoding period determining unit 105 in the first embodiment, an encoder 202, a packet generator 203, an encoding period calculating unit 207, and a period determining unit 208 are provided. The other components are the same as those of the first embodiment.

  In addition to the function of the encoder 102, the encoder 202 acquires the input signal S111 and outputs the time when the encoding process is started as the encoding start information J231. Further, the encoder 202 outputs a transmission completion message of the output encoded signal S112 to the encoding period calculation unit 207.

  The packet generator 203 has the function of the packet generator 103 except that packetization cycle instruction information J222 is input instead of the transmission cycle information J122.

  The encoding period calculation unit 207 calculates the encoding processing time based on the encoding start information J231 and the reception time of the transmission completion message of the encoded signal S112 (obtained from the timer unit 106), and the calculation result is encoded time. Output as measurement information J228.

  In addition to the function of the coding cycle determination unit 105, the cycle determination unit 208 acquires the transmission cycle information J122, the packetization time measurement information J123, and the coding time measurement information J228 and applies the coding cycle applied by the encoder 202. Is output as encoding period information J124, and the packetization period applied by the packet generator 203 is output as packetization period instruction information J222. In addition, the cycle determination unit 208 stores the output encoding cycle information J124 in the encoding cycle CT0 as information indicating the current encoding cycle. Further, the cycle determination unit 208 stores the output packetization cycle instruction information J222 in the packetization cycle PT0 as information indicating the current packetization cycle. The detailed operation of the period determination unit 208 will be clarified in the operation section described later.

(B-2) Operation | movement of 2nd Embodiment Next, operation | movement of the transmission part 20 which concerns on 2nd Embodiment is demonstrated centering on the difference with the operation | movement of the transmission part 10 which concerns on 1st Embodiment.

  When the transmission unit 20 starts to operate, the cycle determination unit 208 uses the transmission cycle information J122 specified by the user as in the first embodiment to store the encoding cycle information J124 and the packetization cycle instruction information J222. The determined value is output to the encoder 202 and the packet generator 203. At the start of the operation, the encoding cycle information J124 is set and output a predetermined value (in this embodiment, for example, 10 ms). Further, the packetization cycle instruction information J222 outputs the same value as the transmission cycle information J122. Further, the output encoding period information J124 and packetization period instruction information J222 are stored in the period determination unit 208 as an encoding period CT0 and a packetization period PT0, respectively.

  An audio signal captured by the microphone 101 is converted into a digital signal and then output to the encoder 202 as an input signal S111.

  The encoder 202 outputs the time at which encoding was started when encoding the input signal S111 to the encoding period calculation unit 207 as encoding start information J231. Further, the encoder 202 outputs a transmission completion message of the output encoded signal S112 to the encoding period calculation unit 207.

  The encoding period calculation unit 207 calculates the processing time in the encoder 202 from the encoding start information J231 and the reception time of the transmission completion message of the encoded signal S112. That is, the difference between the encoding start time given by the encoding start information J231 and the reception time of the transmission completion message is calculated as a processing time in the encoder 202, and the calculation result is measured as an encoding time measurement. The information J228 is output to the period determination unit 208.

  Since the packetization processing performed by the packet generator 203 and the packetization interval calculation processing performed by the packetization interval calculation unit 104 are the same as those in the first embodiment, the description thereof is omitted.

  The period determination unit 208 determines the packetization period instruction information J222 and the encoding period information J124 by the period determination method described later based on the packetization time measurement information J123 and the encoding time measurement information J228, and generates packet generations respectively. Output to the encoder 203 and the encoder 202.

  Next, the period determination method performed by the period determination unit 208 will be described.

  The period determination unit 208 operates differently depending on whether (1) the encoding time measurement information J228 is acquired or (2) the packetization time measurement information J123 is acquired. After performing processing corresponding to (1) or (2) described later, the period determining unit 208 transmits the encoding period information J124 to the encoder 202 and the packetization period instruction information J222 to the packet generator 203. .

  First, an operation when the period determination unit 208 in (1) acquires the encoding time measurement information J228 will be described.

  The period determination unit 208 compares the value of the encoding time measurement information J228 with the current encoding period CT0.

  The period determination unit 208 does not change the encoding period CT0 when the value of the encoding time measurement information J228 is equal to or less than the encoding period CT0. As a specific example in which the processing is performed, for example, a case where an input signal s2 shown in FIG.

  On the other hand, when the value of the encoding time measurement information J228 exceeds the encoding period CT0, the period determination unit 208 changes the encoding period CT0. In this case, it is determined that the encoding process of the input signal S111 performed by the encoder 202 is not completed within the time of the encoding cycle CT0.

  Specifically, the period determining unit 208 sets a value larger than the current encoding period CT0 in the encoding period information J124 in order to change the encoding period, and encodes the encoding period information J124. Output to the unit 202. The value set in the coding cycle information J124 is, for example, a value that is a time that is a natural number multiple of 10 ms and that is larger than the coding cycle CT0 and closest to the coding cycle CT0. Upon receiving the encoding cycle information J124, the encoder 202 changes the interval for encoding the input signal S111 to the value specified by the encoding cycle information J124. In addition, as a specific example in which the process is performed, for example, a case where an input signal s3 shown in FIG.

  Next, an operation when the period determination unit 208 in (2) acquires the packetization time measurement information J123 will be described.

  Period determination section 208 compares the value of packetization time measurement information J123 with the current packetization period PT0.

  As a result of the comparison, when the value of the packetization time measurement information J123 is equal to or less than the packetization period PT0, the period determination unit 208 does not change the values of the encoding period CT0 and the packetization period PT0. A specific example in which this processing is performed is, for example, a case where an input signal s2 shown in FIG. 6 to be described later is encoded / packetized.

  As a result of the comparison, if the value of the packetization time measurement information J123 exceeds the packetization period PT0, the period determination unit 208 performs the process of changing the encoding period shown in (1) above. Then, the packetization period PT0 is changed.

  Specifically, cycle determination unit 208 outputs a value larger than the value of coding cycle CT0 at the time of comparison as coding cycle information J124. Furthermore, the period determination unit 208 outputs a value larger than the current packetization period PT0 as the packetization period instruction information J222 in order to change the packetization period. The value of the packetization cycle instruction information J222 is changed to a value closest to the current packetization cycle PT0, for example, a time that is a natural number multiple of 10 ms and larger than the packetization cycle PT0. A specific example in which this processing is performed is, for example, a case where an input signal s4 shown in FIG. 6 to be described later is encoded / packetized.

  In addition, the above-described method for changing the encoding period and the packetization period is merely an example. In addition to this, the packetization period PT0 is changed using various methods so that the operation of the entire transmission unit 20 is not affected. You may do it. For example, when the packetization period PT0 is increased and the transmission period further exceeds, a method for adjusting the packetization period to be decreased or the packet is not transmitted (that is, the packet is treated as missing). Yes, the load on the packet generator 203 may be reduced.

  Note that the coding cycle CT0 used for determining the coding cycle information J124 as a value larger than the coding cycle CT0 is updated by a predetermined value or a coding cycle change process described in (1) above. Use the value obtained. Further, as in the first embodiment (A) described above, the coding period information J124 may be changed to be larger than the value of the coding period CT0 and equal to or larger than the value of the packetization time measurement information J123. Good.

  After receiving the coding cycle information J124, the encoder 202 changes the interval (coding cycle) for coding the input signal S111 to a value specified by the coding cycle information J124. Further, after receiving the packetization cycle instruction information J222, the packet generator 203 changes the interval (packetization cycle) for packetizing the encoded signal S112 to the value specified by the packetization cycle instruction information J222.

  Further, after the change, when the value of the packetization time measurement information J123 does not exceed the packetization period PT0, the period determination unit 208 sets the increased encoding period to the original encoding period CT0. At the same time, the increased packetization period PT0 is also restored. The encoding period CT0 and the packetization period PT0 before the change may be stored inside the period determining unit 208, and each period may be read and reset. The process of returning the encoding period and the packetization period to the original is not limited to the above example, and the state where the value of the packetization time measurement information J123 does not exceed the packetization period PT0 is three times. Various methods can be used, such as execution when a problem occurs continuously.

  In this embodiment, the period determination unit 208 designates the interval at which packets are transmitted according to the packetization period PT0. However, only the packetization period PT0 determined by the determination of the packetization time measurement information J123 is determined. The actual packetization period may not be manipulated. For example, when encoding / packetizing an input signal s4 in FIG. 6 to be described later, even if the packetization interval pp3 is larger than the packetization cycle pt03, the packetization cycle pt03 is not specified, and the cycle determination unit 208 You may make it use only by determination.

  Next, the operation of the transmission unit 20 (acquisition of the encoding time measurement information J228) will be described using the time chart of FIG. 5 as an example. In the following, FIG. 5 will be described focusing on differences from FIG.

  FIG. 5C shows a block image of the time for encoding each input signal, as in FIG. 3C described above. Further, FIG. 5C shows the processing time of each block as encoding intervals cp1 to cp3. The encoding intervals cp1 to cp3 are values output as the encoding time measurement information J228 by the calculation in the encoding period calculation unit 207. The encoding intervals cp1 to cp3 represent the time required for encoding the corresponding input signals s1 to s3, respectively. 5 (A), (B), and (D) are the same as FIGS. 3 (A), (B), and (D), and the description thereof is omitted.

  Next, the time chart of FIG. 5 will be described along a time series.

  Processing from time t1 to time t4 for encoding / packetizing the input signal s1 is the same as the processing at the same time in FIG.

  The processing from time t5 to time t7 for encoding / packetizing the input signal s2 is basically the same as the processing at the same time in FIG. 3 described above, but the determination processing for the encoding cycle ct02 is different. The period determination unit 208 determines the encoding period when the encoding time measurement information J228 is received from the encoding period calculation unit 207. That is, since the coding interval cp2 included in the coding time measurement information J228 is smaller than the coding cycle ct01 that is the current coding cycle, the coding cycle ct02 becomes the same cycle as the coding cycle ct01 (that is, The encoding cycle is not changed).

  Similarly, the process from time t8 to time t10 for encoding / packetizing the input signal s3 is basically the same as the process at the same time in FIG. 3 described above, but the determination process for the encoding cycle ct03 is as follows. Is different. That is, since the coding interval cp3 included in the coding time measurement information J228 is larger than the coding cycle ct02 which is the current coding cycle, the next coding cycle ct03 is changed to a cycle longer than the coding cycle ct02. To do. In the example of FIG. 5, the coding cycle ct03 is changed to a cycle twice the coding cycle ct02.

  In the example of FIG. 5, after the processing of the input signal S3 is completed, a process for returning the encoding period to the encoding period before the change is performed. The description of the processing after this (after time t11) is omitted, but the encoding / packetization processing is similarly performed for the processing of the input signals S4 to S6.

  Next, the operation of the transmission unit 20 (acquisition of packetization time measurement information J123) will be described using the time chart of FIG. 6 as an example. Hereinafter, FIG. 6 will be described focusing on differences from FIG. 3 and FIG. 5.

  FIG. 6D shows a block image of the time for packetizing the signal encoded by the encoder 202. Further, FIG. 6D shows packetization periods as packetization periods pt01 to pt04. 6A to 6C are the same as FIGS. 3 and 5A to 5C described above, and a description thereof will be omitted.

  The process of encoding / packetizing the input signals s1 to s3 is basically the same as the process shown in FIGS. 3 and 5 described above, but the process for determining the packetization period is different. The period determination unit 208 determines the packetization period when the packetization time measurement information J123 is received from the packetization interval calculation unit 104. For example, in the case of processing of the input signal s2, the packetization interval pp2 included in the packetization time measurement information J123 is a value smaller than the packetization period pt01. Therefore, the period determining unit 208 determines that the packetization period pt02 is the same value as the previous packetization period pt01 (that is, the value of the packetization period pt02 is not changed).

  Similarly, the processing from time t11 to time t14 for encoding / packetizing the input signal s4 is basically the same as the processing of FIGS. 3 and 5 described above, but the determination processing of the packetization period pt03 is as follows. Different. That is, since the packetization interval pp3 included in the packetization time measurement information J123 is larger than the previous packetization cycle pt02 (that is, the load of the packetization process is large), the cycle determination unit 208 determines the value of the packetization cycle pt03. Update. In the example of FIG. 6, the packetization period pt03 is changed to a period twice as long as the packetization period pt02. Also, the coding cycle ct04 is changed to be larger than the coding cycle ct03 and equal to or greater than the value of the packetization time measurement information J123 (here, the packetization interval pp3).

  In the example of FIG. 6, after the processing of the input signal S4 is completed, the encoding period and the packet period are returned to the encoding period and the packetization period before the change. The description of the processing after this (after time t15) is omitted, but the encoding / packetization processing is similarly performed for the processing of the input signals S5 and S6.

(B-3) Effect of the Second Embodiment According to the second embodiment, the period determination unit 208 performs the encoding period and packetization based on the encoding processing time and the packetization processing time. By changing the period, it is possible to prevent the time required for the encoding process and the packetizing process of the audio signal from exceeding the encoding period.

  Furthermore, according to the second embodiment, the encoding period calculation unit 207 and the packetization interval calculation unit 104 perform the load processing of the encoder 202 and the packet generator 203, respectively, as encoding processing time and packetization processing. It is actually measured as time, and the period determination unit 208 changes the encoding period and the packetization period based on the actual measurement value, so that the encoding process and the packetization process can accurately follow real-time voice communication. became.

(C) Other Embodiments In addition to the above-described embodiments, the following modified embodiments can be exemplified.

  (C-1) In each of the above embodiments, various devices (fixed telephone devices, smartphones, transceivers, etc.) can be applied as devices to which the present invention is applied, but particularly when applied to softphones. There is an effect. This is because, in the case of a soft phone, there is a possibility that other processes besides the call process may interrupt, and there is a possibility that the encoding period and the packetization period may be disturbed.

  (C-2) In each of the above embodiments, an example in which a voice communication device transmits a voice packet has been described. However, the present invention may be applied to a case where a voice packet is received. For example, the voice communication device (reception unit) decomposes a received packet, a packet decomposition unit that decodes the decomposed packet (payload), and decoding between packets before and after the decoding start time and processing end time. This can be realized by including a decoding interval calculation unit that calculates a processing interval, and a packet decomposition period calculation unit that determines an appropriate packet decomposition period from the decoding processing interval and the current packet decomposition period.

  DESCRIPTION OF SYMBOLS 1A, 1B ... Voice communication apparatus, 2 ... Network, 5 ... Voice communication system, 10, 20 ... Transmitter, 11 ... Receiver, 101 ... Microphone, 102 ... Encoder, 103 ... Packet generator, 104 ... Packetization Interval calculation unit 105... Coding cycle determination unit 106. Timer unit 202. Encoder 203 203 Packet generator 207 Coding cycle calculation unit 208.

Claims (8)

Speech having an encoder that encodes an externally input signal at a first encoding period to generate an encoded signal, and a packet generator that packetizes the encoded signal at a first packetization period In the transmission device,
A packetization time measuring unit that outputs a packetization time measurement information by measuring a packetization interval between successive packets output by the packet generator;
A second encoding period is determined by comparing the packetization time measurement information with the first encoding period or the first packetization period, and the second code is sent to the encoder. A voice transmitting apparatus comprising: a cycle designating unit that gives a coding cycle and codes the coded signal in the second coding cycle.   The period specifying unit compares the packetization time measurement information with the first encoding period, and when the value of the packetization time measurement information is equal to or greater than the value of the first encoding period. The voice transmitting apparatus according to claim 1, wherein the value of the second coding period is determined to be larger than the value of the packetization time measurement information.   The period specifying unit compares the packetization time measurement information with the first encoding period, and when the value of the packetization time measurement information is less than the value of the first encoding period, The voice transmitting apparatus according to claim 2, wherein the value of the second coding period is returned to the value of the first coding period.   The period specifying unit compares the packetization time measurement information with the first packetization period, and when the value of the packetization time measurement information is equal to or greater than the value of the first packetization period. , Determining the value of the second encoding period to a value larger than the value of the first encoding period, and increasing the value of the first packetization period to be a second packetization period, The voice transmitting apparatus according to claim 1, wherein the second packetization period is given to the packet generator.   The period designating unit further changes the value of the second coding period to a value larger than the value of the first coding period and larger than the value of the packetization time measurement information. The voice transmitting apparatus according to claim 4.   The period specifying unit compares the packetization time measurement information with the first packetization period, and the value of the packetization time measurement information is less than the value of the first packetization period And returning the value of the second coding period to the value of the first coding period and returning the value of the second packetization period to the value of the first packetization period. The voice transmitting device according to claim 4 or 5. The computer installed in the audio transmission device
An encoder that encodes an externally input signal at a first encoding period to generate an encoded signal;
A packet generator for packetizing the encoded signal at a first packetization period;
A packetization time measuring unit that outputs a packetization time measurement information by measuring a packetization interval between successive packets output by the packet generator;
A second encoding period is determined by comparing the packetization time measurement information with the first encoding period or the first packetization period, and the second code is sent to the encoder. An audio transmission program that functions as a period designating unit that provides an encoding period and encodes the encoded signal in the second encoding period. In a voice receiving device having a packet decomposing unit that decomposes a packet input from the outside at a first packet decomposing period, and a decoding unit that decodes the decomposed packet and generates a decoded signal.
In the decoding unit, a decoding interval calculation unit that calculates a decoding processing interval in successive packets from the decoding processing start time and decoding processing end time of the packet and outputs decoding processing time measurement information;
A second packet decomposition period is determined from the decoding processing time measurement information and the first packet decomposition period, the second packet decomposition period is given to the packet decomposition unit, and the second packet decomposition period is determined. And a period designating unit for decomposing the packet.

Images