JP2000347695A - Sound control method and sound controller - Google Patents

Abstract

PROBLEM TO BE SOLVED: To provide a sound control method and a sound controller for a visual telephone system capable of reducing electric power comsumption in a system with drive of a DSP chip optimized, and capable of conducting smooth sound data processing including the case of coping with the time of error generation. SOLUTION: A sound data flows through a sound processing part 210 and a muliplexing-multiplexing-releasing part 300. The processing part 210 provided with a sound control part 201, a sound CODEC part 202, a sound PCM part 203, two decoding-directional coding data storing parts 212, 213 between the multiplexing.multiplexing-releasing part 300 and the CODEC part 202, two decoding-directional raw data storing parts 222, 223 between the CODEC part 202 and a sound D/A part 206, an encoding-directional raw data storing part 241 between an A/D part 207 and the CODEC part 202, and an encoding- directional coding data storing part 231 between the CODEC part 202 and the multiplexing-multiplexing-releasing part 300.

Description

DETAILED DESCRIPTION OF THE INVENTION

[0001]

BACKGROUND OF THE INVENTION 1. Field of the Invention The present invention relates to a voice control method and a voice control device in a videophone system which requires periodic encoding and decoding of voice in a communication terminal for transmitting and receiving voice, image and data. Things.

[0002]

2. Description of the Related Art Conventionally, the H.264 standard has been proposed. In a system involving multiplexing of a plurality of types of information such as a 324 terminal, voice COD
The processing in the EC unit is performed by a DSP chip or the like according to the flow of audio data.

[0003]

However, in the above-mentioned conventional method and configuration, there is no strict synchronization processing for synchronizing with the clock in the audio data processing itself, and a unit for performing the encoding processing and the decoding processing is required. Sometimes they are processed separately in time, resulting in voice COD
The EC processing itself has not been able to efficiently extract the processing capability of a DSP chip or the like.

The present invention solves the above-mentioned conventional problems, and has a basic system structure capable of optimizing the driving of a DSP chip to be used and contributing to a reduction in system power consumption. It is an object of the present invention to provide a voice control method and a voice control device for a videophone system that can realize smooth processing of voice data.

[0005]

SUMMARY OF THE INVENTION In order to solve this problem, the present invention provides an audio codec system in which two audio raw data are transmitted before the D / A unit is operated at an initial stage of decoding start on the decoding direction side. The data is stored in the storage unit and the two coded data storage units, respectively, and then the D / A unit starts operating according to a command from the voice control unit. Even if one of the voice raw data storage units becomes empty, the D / A unit becomes empty. The unit A continues to extract data from the other audio raw data storage unit, starts decoding the contents of one encoded data storage unit when the audio raw data storage unit is switched, and completes the decoding when the decoding is completed. When the coded data storage unit becomes empty, the voice control unit is notified and the coded data storage unit manages the coded data for decoding with the demultiplexing unit. It is obtained to meet with.

[0006] With this configuration, it is possible to have a basic system structure capable of optimizing the driving of the DSP chip to be used and contributing to a reduction in the power consumption of the system, and to realize a smooth processing of the audio data including a countermeasure when an error occurs. A voice control method and a voice control device for a videophone system can be provided.

[0007]

DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS The first aspect of the present invention is to provide two audio raw data storage units and two audio data storage units before operating the D / A unit at the initial stage of decoding start on the decoding direction side of the audio codec system. Data is stored in each of the encoded data storage units, and then D / A
The D / A unit continues to extract data from the other audio raw data storage unit even when one of the audio raw data storage units is emptied. The decoding of the contents of one of the encoded data storage units is started, and when the decoding is completed and the one of the encoded data storage units becomes empty, a notification to the voice control unit is made, and the decoding with the demultiplexing unit is performed. By performing the encoded data management described above, the audio control method is such that the encoded data storage unit is filled with the encoded data.

[0008] With this configuration, data transmission to the D / A unit is started from a state already prepared before and after the audio CODEC unit, so that data transmission to the D / A unit can be performed without delay. In addition, since periodic processing can be performed, operation scheduling of a device such as a DSP chip can be performed.

According to a second aspect of the present invention, in the audio codec system, the D / A unit and the C / A
Two storage units corresponding to one frame size of audio raw data are provided between ODEC (decoder) units,
A voice control device is provided by providing two storage units corresponding to one frame size of encoded data between a (decoder) unit and a voice control unit. , A D / A unit, two audio raw data storage units, two audio encoded data storage units, a demultiplexing unit, and an audio control unit.

According to a third aspect of the present invention, in the audio codec system, when one of the audio raw data storage units is full on the encoding side, the audio raw data sent from the A / D unit becomes full. While the raw data is continuously stored in one of the raw audio data storage units, encoding of the raw data in the full audio raw data storage unit is started, and when the encoding is completed, the audio control unit is notified and the multiplexing is performed. The encoded data is sent to the encoding unit, and during this processing, the audio raw data from the A / D unit is stored in the audio raw data storage. The raw audio data from the / D unit is processed by the audio CODEC unit without being lost, and the encoded data can be sent to the multiplexing unit without any delay, and the periodic processing is performed. Since coming, it is possible to operate the scheduling of a device such as DSP chip.

According to a fourth aspect of the present invention, in the audio codec system, two storage units corresponding to one frame size of raw audio data are provided between the A / D unit and the CODEC (encoder) unit on the encoding direction side. And COD
An audio control device is provided by providing one storage unit corresponding to one frame size of encoded data between an EC (encoder) unit and an audio control unit. With this configuration, the audio data control method according to claim 3 is realized. Audio CODEC part, A / D part, 2
This can be realized by the configuration of one voice raw data storage unit, one voice coded data storage unit, a multiplexing unit, and a voice control unit.

According to a fifth aspect of the present invention, in the audio codec system, when a decoding error occurs in the CODEC section on the decoding direction side, silence, which is dummy data for one frame, is stored in the audio raw data storage section. This is a voice control method in which the corresponding temporary data is inserted to continue the data processing in the decoding direction. With this configuration, when a decoding processing error occurs in the voice CODEC part, the D / A part is Since the D / A data can be continuously transmitted, it is possible to prevent the D / A unit from processing apparently illegal data, thereby avoiding unpleasant sounds when outputting sound.

According to a sixth aspect of the present invention, in the audio codec system, when a decoding error occurs in the CODEC unit in the decoding direction, one frame of dummy data for one frame is stored in the audio raw data storage unit. This is a voice control method in which the same data as the previous data is inserted and the data processing in the decoding direction is continued by inserting the same data. With this configuration, when a decoding process error occurs in the voice CODEC unit, the D / A unit D / A data can be sent continuously, so that apparently illegal data is
Since it is possible to avoid processing by the / A section, it is possible to avoid unpleasant sounds when outputting sound.

According to a seventh aspect of the present invention, in the audio codec system, CODEC is provided on the encoding direction side.
A voice control method for inserting temporary data corresponding to silence, which is dummy data for one frame, into the voice-encoded data storage unit and continuing data processing in the encoding direction when the unit generates an encoding error; With this configuration, when an encoding error occurs in the audio CODEC unit, encoded data can be continuously transmitted to the multiplexing unit, so that the illegitimate data is processed by the multiplexing unit. Therefore, it is possible to avoid a multiplexing processing error in the multiplexing unit and a processing error in the communication partner terminal.

According to an eighth aspect of the present invention, in a voice codec system, a CODEC is provided on the encoding direction side.
In the case where an encoding error has occurred in the unit, the same data as the data of one frame before, which is dummy data for one frame, is inserted into the encoded audio data storage unit, and the audio data to continue the data processing in the encoding direction side With this configuration, when an encoding process error occurs in the audio CODEC unit, encoded data can be continuously transmitted to the multiplexing unit. , It is possible to avoid a multiplexing processing error in the multiplexing unit and a processing error in the communication partner terminal.

(Embodiment 1) FIG. 1 is a configuration diagram of a video conference system device including an audio control device according to Embodiment 1 of the present invention. Reference numeral 101 denotes a video conference system terminal capable of transmitting and receiving voice, image, and data. The voice data flows through a voice processing unit 210 and a multiplexing / demultiplexing unit 300. The multiplexing / demultiplexing unit 300 is connected to an image processing unit 400 and a data processing unit 500. The audio processing unit 210 includes an audio control unit 201, an audio decoder 2
CODEC unit 2 including audio 04 and audio encoder 205
02, an audio PCM unit 203 including an audio D / A unit 206 and an audio A / D unit 207, and two decode direction encoded data storage units 212 and 213 between the multiplexing / demultiplexing unit 300 and the audio decoder 204. Audio decoder 204 and audio D
/ A unit 206, two decoding direction raw data storage units 222 and 223, an audio A / D unit 207 and an audio encoder 205, an encoding direction raw data storage unit 241, and an audio encoder 205 with multiplexing / demultiplexing. An encoding direction encoded data storage unit 231 is provided between the units 300.

The audio D / A unit 206 of the audio processing unit 210 is connected to an audio output device 901 such as a speaker, etc.
Reference numeral 7 denotes a voice input device 902 such as a microphone, and an image processing device 4.
00 is an image input device 904 such as a camera, an image output device 903 such as a monitor, the data processing unit 500 is an application processing device 905 such as a personal computer, and the multiplexing / demultiplexing unit 300 is a data communication line which is a communication network. 600 are connected to the system.

A processing sequence in the decoding direction which is enabled by using this configuration will be described. FIGS. 2, 3, 4, and 5 are processing flowcharts of the voice control device according to the first embodiment of the present invention. In the initial stage, as shown in FIG.
And decode direction raw data storage units 1014 and 1015
Is an empty state. Next, as shown in FIG. 3, when audio encoded data is input from the input direction, the audio encoded data is accumulated in the decoded direction encoded data storage units 1011 and 1012,
The audio control unit 1001 appropriately operates the audio decoder 1013 (a in the figure), and stores the audio raw data in the decode direction raw data storage units 1014 and 1015. When both of the decode direction raw data storage units 1014 and 1015 are full, the audio control unit 1001 is notified of this (b in the figure), and the audio control unit 1001 receives the audio D / D at an appropriate timing in the system. The flow of the raw voice data to the A section 1016 is started (c in the figure).

Next, as shown in FIG. 4, by transferring the raw audio data to the audio D / A unit, when one of the decoding direction raw data storage units 1014 becomes empty, it is notified to the audio control unit 1001 (see FIG. 4). In the middle d), the audio control unit 1001 receives the data, flows the encoded data from the one decoding direction encoded data storage unit 1011 to the audio decoder 1013 (e in the figure), and operates the audio decoder 1013 (f in the figure). . Next, as shown in FIG. 5, the voice control unit 1001 that has recognized the empty of one of the decode direction encoded data storage units 1011 can prepare for data reception from the input side (multiplexing unit side).

(Embodiment 2) FIG. 6 is a configuration diagram of a video conference system device including an audio control device according to Embodiment 2 of the present invention. Reference numeral 102 denotes a video conference system terminal capable of transmitting and receiving voice, image, and data. The voice data flows through the voice processing unit 220 and the multiplexing / demultiplexing unit 300. The multiplexing / demultiplexing unit 300 is connected to an image processing unit 400 and a data processing unit 500. The audio processing unit 220 includes an audio control unit 201, an audio decoder 2
CODEC unit 2 including audio 04 and audio encoder 205
02, an audio PCM unit 203 including an audio D / A unit 206 and an audio A / D unit 207, a decoding direction encoded data storage unit 211, an audio decoder 204 between the multiplexing / demultiplexing unit 300 and the audio decoder 204. Between the audio D / A unit 206, the decode direction raw data storage unit 221, between the audio A / D unit 207 and the audio encoder 205, two encode direction raw data storage units 242, 243, and the audio encoder 2
05 and the multiplexing / demultiplexing unit 300, there is an encoding direction coded data storage unit 231.

The audio D / A unit 206 of the audio processing unit 220 is connected to an audio output device 901 such as a speaker, etc.
Reference numeral 7 denotes a voice input device 902 such as a microphone, and an image processing device 4.
00 is connected to an image input device 904 such as a camera, an image output device 903 such as a monitor, the data processing unit 500 is connected to an application processing device 905 such as a personal computer, and the multiplexing / demultiplexing unit 300 is connected to a data communication line 600. System configuration.

A description will be given of a processing sequence in the encoding direction which is enabled by using this configuration. 7, 8, 9, and 10 are processing flowcharts of the voice control device according to the second embodiment of the present invention. In the initial stage, as shown in FIG. 7, audio analog data is continuously input to the audio A / D unit 1021 in a certain cycle. The A / D-converted audio raw data is stored in one encoding direction raw data storage unit 1022, and notifies the audio control unit 1001 that the data has become full (h in the figure). Next, as shown in FIG. 8, the voice control unit 1001 that has recognized that one of the encoding direction raw data storage units 1022 has become full transfers the voice raw data to the voice encoder 1024 (i in the figure),
The audio encoder 1024 is operated (j in the figure). During that time, the audio raw data A / D-converted by the audio A / D unit 1021 continues to be stored in the other audio raw data storage unit 1023. Next, as shown in FIG.
When the encoding process at 24 is completed, a notification is sent to the audio control unit 1001 (k in the figure). The voice control unit 1001 that has received the notification sends the encoded data to the encoded direction encoded data storage unit 1025 (l in the figure). Next, as shown in FIG. 10, when the encoding direction coded data storage unit 1025 becomes full, it notifies the voice control unit 1001 of this (m in the figure), and upon receiving the notification, the voice control unit 1001 outputs Multiplexing) can be adjusted.

(Embodiment 3) FIG. 11 is a configuration diagram of a video conference system device including an audio control device according to Embodiment 3 of the present invention. Reference numeral 103 denotes a video conference system terminal capable of transmitting and receiving voice, image, and data. The voice data is processed by a voice processing unit 230, a multiplexing / demultiplexing unit 300
Flows through. The multiplexing / demultiplexing unit 300 is connected to an image processing unit 400 and a data processing unit 500.
The audio processing unit 230 includes an audio control unit 201, an audio CODEC unit 202 including an audio decoder 204 and an audio encoder 205, an audio PCM unit 203 including an audio D / A unit 206 and an audio A / D unit 207, and multiplexing / multiplexing. Two decode direction encoded data storage units 212 and 213 between the release unit 300 and the audio decoder 204, and three decode direction raw data storage units 224, 225 and 226 between the audio decoder 204 and the audio D / A unit 206. An encoding direction raw data storage unit 241 between the audio A / D unit 207 and the audio encoder 205, and an encoding direction encoded data storage unit 231 between the audio encoder 205 and the multiplexing / demultiplexing unit 300.
There is.

The audio D / A unit 206 of the audio processing unit 230 is connected to an audio output device 901 such as a speaker and the audio A / D unit 20.
Reference numeral 7 denotes a voice input device 902 such as a microphone, and an image processing device 4.
00 is connected to an image input device 904 such as a camera, an image output device 903 such as a monitor, the data processing unit 500 is connected to an application processing device 905 such as a personal computer, and the multiplexing / demultiplexing unit 300 is connected to a data communication line 600. System configuration.

A processing sequence in the decoding direction which is enabled by using this configuration will be described. FIG. 12 is a processing flowchart of the voice control device according to the third embodiment of the present invention. When normal audio raw data cannot be obtained due to a decoding error or the like as a result of performing the decoding process by the audio decoder 1013, the error is determined by the audio control unit 1013.
01 (n in the figure), the data in the decoding direction audio raw data storage unit 1031 storing the raw data of the immediately preceding frame can be transmitted to the audio D / A unit 1016.

When data corresponding to silence prepared in advance is sent to the audio D / A unit 1016 when the above error occurs, the configuration shown in FIG. 2 can be used.

(Embodiment 4) FIG. 13 is a configuration diagram of a video conference system device including an audio control device according to Embodiment 4 of the present invention. Reference numeral 104 denotes a video conference system terminal capable of transmitting and receiving voice, image, and data. The voice data is processed by a voice processing unit 240, a multiplexing / demultiplexing unit 300
Flows through. The multiplexing / demultiplexing unit 300 is connected to an image processing unit 400 and a data processing unit 500.
The audio processing unit 240 includes an audio control unit 201, an audio CODEC unit 202 including an audio decoder 204 and an audio encoder 205, an audio PCM unit 203 including an audio D / A unit 206 and an audio A / D unit 207, and multiplexing / multiplexing. The decoding direction coded data storage unit 211 between the cancel unit 300 and the audio decoder 204, the audio decoder 204 and the audio D / A unit 206
Between the decoding direction raw data storage 221 and the audio A / D
There are two encoding direction raw data storage units 242 and 243 between the unit 207 and the audio encoder 205, and two encoding direction encoded data storage units 232 and 233 between the audio encoder 205 and the multiplexing / demultiplexing unit 300. .

The audio D / A unit 206 of the audio processing unit 240 is connected to an audio output device 901 such as a speaker and the audio A / D unit 20.
Reference numeral 7 denotes a voice input device 902 such as a microphone, and an image processing device 4.
00 is connected to an image input device 904 such as a camera, an image output device 903 such as a monitor, the data processing unit 500 is connected to an application processing device 905 such as a personal computer, and the multiplexing / demultiplexing unit 300 is connected to a data communication line 600. System configuration.

A description will be given of a processing sequence in the encoding direction which is enabled by using this configuration. FIG. 14 is a processing flowchart of the voice control device according to the fourth embodiment of the present invention. If the result of the encoding process performed by the audio encoder 1024 does not result in normal encoded audio data due to an encoding error or the like, the audio control unit 1001 recognizes the error (p in the figure) and performs encoding. Encoding direction audio encoded data storage 10 storing encoded data of the immediately preceding frame with respect to the data output direction
41 data can be transmitted. When data corresponding to silence prepared in advance is transmitted to the encoded data output area when the above error occurs, the configuration shown in FIG. 7 can be used.

[0030]

As described above, the present invention has a basic system structure capable of optimizing the driving of the DSP chip to be used and contributing to a reduction in the power consumption of the system. It is possible to provide a voice control method and a voice control device of a videophone system capable of realizing data processing.

[Brief description of the drawings]

FIG. 1 is a configuration diagram of a video conference system device including a voice control device according to a first embodiment of the present invention;

FIG. 2 is a processing flowchart of the voice control device according to the first embodiment of the present invention;

FIG. 3 is a processing flowchart of the voice control device according to the first embodiment of the present invention;

FIG. 4 is a processing flowchart of the voice control device according to the first embodiment of the present invention;

FIG. 5 is a processing flowchart of the voice control device according to the first embodiment of the present invention.

FIG. 6 is a configuration diagram of a video conference system device including a voice control device according to a second embodiment of the present invention.

FIG. 7 is a processing flowchart of the voice control device according to the second embodiment of the present invention;

FIG. 8 is a processing flowchart of the voice control device according to the second embodiment of the present invention;

FIG. 9 is a processing flowchart of the voice control device according to the second embodiment of the present invention.

FIG. 10 is a processing flowchart of the voice control device according to the second embodiment of the present invention.

FIG. 11 is a configuration diagram of a video conference system device including a voice control device according to a third embodiment of the present invention.

FIG. 12 is a processing flowchart of the voice control device according to the third embodiment of the present invention.

FIG. 13 is a configuration diagram of a video conference system device including a voice control device according to a fourth embodiment of the present invention.

FIG. 14 is a processing flowchart of the voice control device according to the fourth embodiment of the present invention.

[Explanation of symbols]

 Reference Signs List 101 video conference system terminal 102 video conference system terminal 103 video conference system terminal 104 video conference system terminal 201 voice control unit 202 voice CODEC unit 203 voice PCM unit 204 voice decoder 205 voice encoder 206 voice D / A unit 207 voice A / D unit Reference Signs List 210 Audio processing unit 211 Decoding direction encoded data storage unit 212 Decoding direction encoded data storage unit 213 Decoding direction encoded data storage unit 220 Audio processing unit 221 Decoding direction raw data storage unit 222 Decoding direction raw data storage unit 223 Decoding direction raw Data storage unit 224 Decoding direction raw data storage unit 225 Decoding direction raw data storage unit 226 Decoding direction raw data storage unit 230 Audio processing unit 231 Encoding direction encoded data storage unit 232 Encoding direction encoded data storage unit 233 Encoding direction encoded data storage unit 240 Audio processing unit 241 Encoding direction raw data storage unit 242 Encoding direction raw data storage unit 243 Encoding direction raw data storage unit 300 Multiplexing / demultiplexing unit 400 Image Processing unit 500 Data processing unit 600 Communication network (data communication line) 901 Audio output device such as speaker 902 Audio input device such as microphone 903 Image output device such as monitor 904 Image input device such as camera

──────────────────────────────────────────────────続 き Continued on the front page (51) Int.Cl. ⁷ Identification symbol FI Theme coat ゛ (Reference) H04N 7/15 630 G10L 3/00 K

Claims (8)

[Claims] On the decoding direction side of an audio codec system, data is stored in two audio raw data storage units and two encoded data storage units before operating a D / A unit in an initial stage of decoding start. Then, the D / A unit starts operating according to a command from the audio control unit, and even if one of the audio raw data storage units becomes empty, the D / A unit continues to transmit data from the other audio raw data storage unit. Continue to extract, and start switching the contents of one encoded data storage unit when switching the raw audio data storage unit. When decoding is completed and one encoded data storage unit becomes empty, the audio control unit A voice control method comprising: notifying a user and managing encoded data for decoding with a demultiplexing unit so that an encoded data storage unit is filled with encoded data. 2. In the audio codec system, two storage units corresponding to one frame size of raw audio data are provided between a D / A unit and a CODEC unit on the decoding direction side, and a CODEC unit and an audio control unit are provided. A voice control device comprising two storage units each corresponding to one frame size of encoded data. 3. In the audio codec system, on the encoding direction side, when one audio raw data storage unit is full with audio raw data sent from the A / D unit, the other audio raw data storage unit is used. Start encoding the raw data in the full audio raw data storage unit while storing the raw data continuously, and when the encoding is completed, notify the audio control unit of the encoding and send the encoded data to the multiplexing unit. A voice control method characterized by transmitting the raw voice data from the A / D unit to the raw voice data storage during these processes. 4. In an audio codec system, two storage units corresponding to one frame size of raw audio data are provided between an A / D unit and a CODEC unit on the encoding direction side, and a CODEC unit and an audio control unit are provided. Wherein one storage unit corresponding to one frame size of encoded data is provided between the two. 5. In a voice codec system, when a CODEC unit causes a decoding error in a decoding direction, temporary data corresponding to silence, which is dummy data for one frame, is inserted into a voice raw data storage unit. And continue data processing in the decoding direction. 6. In the audio codec system, when a decoding error occurs in the CODEC unit on the decoding direction side, the same data as the data one frame before, which is dummy data for one frame, is stored in the audio raw data storage unit. And the data processing in the decoding direction is continued by inserting the data. 7. In the audio codec system, when an encoding error occurs in the CODEC unit on the encoding direction side, temporary data corresponding to silence, which is dummy data for one frame, is stored in the audio encoded data storage unit. A sound control method, comprising: inserting the data to continue data processing in the encoding direction. 8. In the audio codec system, when an encoding error occurs in the CODEC part on the encoding direction side, the same data as the data one frame before, which is dummy data for one frame, is stored in the audio coded data storage part. A voice control method comprising inserting data and continuing data processing in the encoding direction.