JP6368843B1 - Data communication reproduction device, data communication reproduction method, and data communication reproduction program - Google Patents

Abstract

Data communication reproducing apparatus and data communication reproducing method capable of reproducing transmitted data and suppressing the occurrence of echoes at the transmission source without significant design change in data communication such as voice And a data communication reproduction program. In a data communication reproducing apparatus for performing communication and reproduction of data, data of one channel is received as reception data, reverse phase data in which the phase of the reception data is inverted is generated, and the reception data and the reverse phase data are included. An anti-phase adding unit that generates 2-channel extension data, a reproduction data storage unit that stores reproduction data of two channels in which extension data is mixed, and a data reproduction unit that reproduces reproduction data stored in the reproduction data storage unit; A data synthesizing unit that synthesizes the data of both channels of the reproduction data to generate and transmit one-channel transmission data. [Selection] Figure 2

Description

  The present invention relates to a data communication reproduction technique for performing communication and reproduction of data such as voice, and more particularly to a technique for reproducing data of a transmission source and removing an echo generated due to the data.

  In recent years, the word “active learning” has become a hot keyword in the education world, and active learning-type classes have been adopted mainly by universities. Active learning is translated as active learning, meaning that the attitude and attitude of learning is active rather than passive. Classes that practice this active learning are active learning-type classes, and products that support such classes are sold.

  As products that support active learning type classes, there are products that use IT (Information Technology) equipment such as PCs (Personal Computers) and tablet terminals. In these products, a teacher PC (hereinafter referred to as “teacher PC”) and a student are arranged in order to share information between the teacher and the student. For example, data such as voice and images are communicated with a personal computer (hereinafter referred to as “student PC”) or between student PCs. Among the data to be communicated, for audio data, headphones are used as output devices assuming individual guidance, so that the teacher can listen not only to the student's voice but also to the teaching material voice that the student is listening to. Data other than the voice (hereinafter referred to as “microphone voice”) may be communicated.

  Generally, in the acquisition of audio or the like reproduced by a PC in a PC, a loopback capture function obtained from a reproduction device buffer is used. That is, audio reproduced on a PC, audio data transmitted from another PC, etc. are stored in a device buffer for reproduction, and data is acquired from this device buffer.

  Using this loopback capture function, the microphone sound is transmitted from the teacher PC to the student PC, the microphone sound is reproduced by the student PC, the voice data of the student PC is transmitted to the teacher PC, and the voice data is transmitted. When playing back on the teacher PC, an echo may occur. In other words, the microphone sound transmitted from the teacher PC is stored in the device buffer of the student PC, and the teaching material sound and the like reproduced on the student PC at that time are also stored in the device buffer. And transmitted to the teacher PC, the microphone sound transmitted by the teacher PC is reproduced with a time lag and becomes an echo.

  Various methods for canceling such echo or noise have been proposed. For example, in the noise cancellation circuit described in Japanese Patent Application Laid-Open No. 9-331377 (Patent Document 1), an audio signal input unit and a noise signal input unit are prepared, and an audio signal input from the noise signal input unit is phase-inverted, By synthesizing the inverted signal and the voice signal from the voice input means, the surrounding noise is eliminated and transmitted to the listener. If the method of Patent Document 1 is applied to cancel the echo in the teacher PC, the microphone sound of the teacher PC is regarded as noise, and the audio data stored in the device buffer for reproduction on the student PC The canceling process is performed in consideration of the audio signal from the audio input means.

Japanese Patent Laid-Open No. 9-331377

  However, in order to apply Patent Document 1 as described above, in the student PC, in addition to the playback device corresponding to the audio signal input means, another device corresponding to the noise signal input means is required. Therefore, a significant design change is required to store the microphone sound of the teacher PC corresponding to the noise in the buffer of the other device and to acquire the microphone sound from the buffer.

  The present invention has been made under the circumstances as described above, and an object of the present invention is to reproduce transmitted data in data communication such as voice and to greatly suppress the occurrence of echoes at the transmission source. An object of the present invention is to provide a data communication reproduction device, a data communication reproduction method, and a data communication reproduction program that can be realized without design change.

The present invention relates to a data communication reproducing apparatus that performs data communication and reproduction, and the object of the present invention is to receive data of one channel as received data, and generate reverse phase data in which the phase of the received data is inverted, Data mixture for generating two-channel reproduction data by mixing the extension data and the two-channel self data for each channel, and generating a two-channel reproduction data composed of the reception data and the anti-phase data. A reproduction data storage unit for storing the reproduction data, a data reproduction unit for reproducing the reproduction data stored in the reproduction data storage unit in a state where the self data is mixed, and both channels of the reproduction data Data for generating and transmitting 1-channel transmission data by canceling out the value of the extended data by combining the data of It is achieved by providing a forming unit.

The present invention also relates to a data communication reproduction method for performing communication and reproduction of data. The above object of the present invention is to receive one-channel data as reception data and generate reverse phase data obtained by inverting the phase of the reception data. Then, an anti-phase adding step for generating 2-channel extension data composed of the reception data and the anti-phase data, and the extension data and the self-data of 2 channels are mixed for each channel to generate 2-channel reproduction data. A data mixing step; a reproduction data storage step for storing the reproduction data; a data reproduction step for reproducing the reproduction data stored in the reproduction data storage step in a state where the self data is mixed ; By synthesizing the data of both channels, the value of the extended data is canceled out to 1 channel. It is achieved by having a data synthesizing step of generating and transmitting a transmission data.

  The object of the present invention is to generate the anti-phase data by inverting the sign of the reception data in the anti-phase adding unit or the anti-phase step in the reception data is a digital signal, or The data synthesizing unit or the data synthesizing step is more effectively achieved by adding the data of both channels of the reproduction data to generate the transmission data.

  Furthermore, the object of the present invention is achieved by a data communication reproduction program for executing the data communication reproduction method.

  According to the data communication reproduction device, the data communication reproduction method, and the data communication reproduction program of the present invention, a significant design can be achieved by performing data reproduction and transmission based on the reverse phase data obtained by inverting the phase of the reception data of one channel. Data reproduction and echo generation can be suppressed without any change.

It is the image figure which simplified and showed the processing content of this invention, and the conventional processing content. It is a block diagram which shows the structural example of this invention. It is a figure explaining the conversion method from an analog signal to a digital signal. It is a flowchart which shows the operation example of this invention. It is an image figure which shows the flow of the data between a teacher PC and a student PC. It is an image figure which shows the content of the data produced | generated by teacher PC and student PC.

  In the present invention, echoes generated when data such as voice (hereinafter collectively referred to as “voice data”) is communicated and reproduced between IT devices such as PCs are subjected to significant design changes to the existing configuration. Suppress without. Normally, a PC or the like reproduces one channel (monaural) audio data consisting of one sound source or two channels (stereo) audio data consisting of two sound sources, and communicates audio data of the same number of channels when communicating. . However, in the present invention, two-channel audio data (reproduction data) is reproduced during reproduction, but one-channel audio data is communicated during communication. Therefore, when audio data is transmitted, the data of both channels in the audio data of 2 channels are synthesized, converted into audio data of 1 channel (transmission data), and transmitted. When the received audio data of one channel is reproduced, the audio data (reverse phase data) obtained by inverting the phase of the received audio data (reception data) is generated, and the received data and the antiphase data are transmitted to different channels. It is played back as allocated 2-channel audio data (extended data). Two-channel audio data (hereinafter referred to as “self data”) output from a sound source of a device that receives the received data is reproduced as it is as two-channel audio data. When transmitting the self data and the extended data to be reproduced, the two-channel audio data in which both data are mixed is converted into the one-channel audio data and transmitted. Only the audio data is converted into audio data of one channel, but the value of the extension data is canceled by synthesizing the data of both channels. Therefore, since only the self data is actually transmitted, the echo is suppressed in the device that transmitted the received data. Note that the playback data is basically output from the headphones, and there is no superimposition of the playback data on its own data due to wraparound, but even when playback data is output from the speaker, the wraparound playback data is erased by another means, It is also possible to support echo suppression without superimposing on the data.

  FIG. 1 shows a simplified description of the above process. In FIG. 1, the received data is a sine wave, and the data of both channels in the self data is the same sine wave of a frequency different from that of the received data. For comparison, the same received data is applied to both channels of the extended data. The data when assigned is shown in FIG. 1 (A), and the data when assigned anti-phase data according to the present invention is shown in FIG. 1 (B). In FIG. 1, “left” indicates the left channel, and “right” indicates the right channel. In FIG. 1B, antiphase data is assigned to the right channel of the extension data. When the reverse phase data shown in FIG. 1 (A) is not used, the same received data and self data are mixed (added) in the left channel and the right channel to form reproduction data. Since the transmission data is synthesized from the data of both channels, the contents of the reception data remain in the transmission data. On the other hand, when the reverse phase data shown in FIG. 1B is used, the reception data is mixed in the left channel of the reproduction data, and the reverse phase data is mixed in the right channel. When the data is combined, the received data and the antiphase data cancel each other, so that the transmitted data is the same as the self data.

  If the communication data is one-channel audio data, the reproduction data may be audio data having more than two channels. In this case, in the extended data, received data and antiphase data are assigned to any two channels, and data having a value of zero is stored in the other channels.

  Embodiments of the present invention will be described below with reference to the drawings.

  FIG. 2 shows a configuration example of a data communication reproduction device according to the present invention. The data communication reproduction device 1 of this configuration example includes an antiphase adding unit 10, a data mixing unit 20, a reproduction data storage unit 30, and a data reproduction unit. 40 and a data synthesis unit 50.

The reception data Dr received by the data communication reproduction device 1 is a digital signal. Some audio data is originally generated as a digital signal, but microphone audio or the like is converted from an analog signal to a digital signal using a PCM (Pulse Code Modulation) method or the like. In the PCM method, as shown in FIG. 3, the amplitude of an analog signal is digitized (quantized) with a precision of 8 bits, 16 bits, etc. at regular intervals (sampling period) and converted into a digital signal. Usually, a digital signal is represented by a signed numerical value. In this case, if the maximum value of the analog signal is 1, the digital signal is digitized at intervals of 1/2 ^{(number of bits-1)} . Inversion of the phase of the digital signal can be performed by reversing the sign. In this embodiment, the digital signal is expressed by a 16-bit signed numerical value.

  The reverse phase adding unit 10 receives the reception data Dr, generates reverse phase data Da from the reception data Dr, and generates extension data Dx from the reception data Dr and the reverse phase data Da. Since the received data Dr is a digital signal, the inverted phase data Da is obtained by inverting the sign of the received data Dr. Then, by assigning the reception data Dr and the reverse phase data Da to different channels, for example, the reception data Dr to the left channel and the reverse phase data Da to the right channel, the two-channel extension data Dx is generated.

  The data mixing unit 20 receives the extended data Dx and the self data Ds output from the sound source (hereinafter referred to as “self sound source”) included in the data communication playback device 1, and generates the playback data Dp by mixing them. . Since the extension data Dx and the self data Ds are both 2-channel digital signals, the left channel data of the extension data Dx and the left channel data of the self data Ds are added to obtain the left channel data of the reproduction data Dp. The right channel data of the data Dx and the right channel data of the self data Ds are added to obtain the right channel data of the reproduction data Dp. When the self data Ds is not output from the self sound source, the extension data Dx becomes the reproduction data Dp as it is.

  The reproduction data storage unit 30 stores the reproduction data Dp output from the data mixing unit 20. For example, in the case of a PC, a device buffer for reproduction corresponds to the reproduction data storage unit 30.

  The data reproduction unit 40 reads the reproduction data Dp stored in the reproduction data storage unit 30 and outputs it to the outside via headphones or the like. When outputting the reproduction data Dp, the size of the reproduction data Dp may be adjusted by multiplying the gain or the like.

  The reproduction data Dp read from the data reproduction unit 40 is also input to the data synthesis unit 50. The data synthesizer 50 generates 1-channel transmission data Dt from the 2-channel reproduction data Dp and transmits it. Specifically, the left channel data and the right channel data of the reproduction data Dp are added to obtain transmission data Dt.

  In such a configuration, an operation example of the present embodiment will be described with reference to the flowchart of FIG.

  The data communication reproducing apparatus 1 inputs the received data Dr received to the antiphase adding unit 10 and inputs the self data Ds from the self sound source to the data mixing unit 20 (step S10).

  The anti-phase adding unit 10 generates the anti-phase data Da by inverting the sign of the reception data Dr (step S20), and assigns the reception data Dr and the anti-phase data Da to the left channel and the right channel, respectively. Data Dx is generated (step S30) and output to the data mixing unit 20.

  The data mixing unit 20 adds the self data Ds and the extension data Dx to generate reproduction data Dp (step S40). The reproduction data Dp is stored in the reproduction data storage unit 30 (step S50).

  The reproduction data Dp stored in the reproduction data storage unit 30 is read by the data reproduction unit 40 and the data synthesis unit 50, and the data reproduction unit 40 outputs the reproduction data Dp to the outside (step S60). The data synthesizing unit 50 adds the data of both channels of the reproduction data Dp and outputs it as transmission data Dt (step S70).

  The above operation is repeated at a constant interval (sampling period). Note that the operation of the data reproducing unit 40 and the operation of the data synthesizing unit 50 may be executed in the reverse order or at the same time.

  The contents of the audio data when this embodiment is applied to a student PC will be described with reference to FIGS. In this description, as shown in FIG. 5, it is assumed that the voice data of the teacher PC is transmitted to the student PC as received data, and the voice data of the student PC is transmitted to the teacher PC as transmitted data. The audio data reproduced by the teacher PC and the student PC is stereo (2-channel) data, and the data of each channel is a 2-byte (16-bit) digital signal. In addition, a playback device buffer is used as the playback data storage unit 30. In FIG. 6, L is the left channel data of the audio data on the teacher PC, R is the right channel data of the audio data on the teacher PC, l is the left channel data of the self data on the student PC, and r is It represents the data of the right channel of the student data on the student PC.

  First, the teacher PC captures (acquires) audio data stored in the device buffer ([1] in FIG. 5). As shown in FIG. 6A, the audio data in this case has a form in which left channel data (L) and right channel data (R) are alternately arranged. This audio data is combined into one channel and transmitted to the student PC as received data ([2] in FIG. 5). As shown in FIG. 6B, the received data in this case has a form in which data (L + R) obtained by adding the left channel data and the right channel data is arranged.

  The student PC receives the received data shown in FIG. 6B ([3] in FIG. 5), generates reverse phase data from the received data, and generates extended data from the received data and reverse phase data (FIG. 5). 5 [4]). As shown in FIG. 6C, the extended data in this case has a form in which the added data (L + R) and the data obtained by inverting the sign of the added data (-(L + R)) are alternately arranged.

  Further, the student PC generates reproduction data by mixing the self data with the extension data shown in FIG. 6C and stores it in the device buffer. As shown in FIG. 6D, the reproduction data in this case is data (l + (L + R)) obtained by adding the left channel data (l) of the self data to the left channel data (L + R) of the extension data. The data (r− (L + R)) obtained by adding the right channel data (r) of the self data to the right channel data (− (L + R)) of the extension data is alternately arranged.

  Then, the student PC captures the reproduction data stored in the device buffer ([5] in FIG. 5), reproduces the reproduction data, adds the data of both channels of the reproduction data, generates transmission data, Send to teacher PC. As shown in FIG. 6E, the transmission data in this case is a form in which the left channel data (l) of the self data and the data (l + r) obtained by adding the right channel data (r) are arranged side by side. The audio data transmitted from the PC has been deleted.

  The teacher PC receives the transmission data shown in FIG. 6E ([7] in FIG. 5), allocates the same transmission data to the left and right channels, and reproduces them ([8] in FIG. 5). As shown in FIG. 6 (F), the data to be reproduced in this case has a form in which the added data (l + r) is allocated to both channels and arranged alternately.

  As described above, in this embodiment, since echo can be suppressed by simply allocating the anti-phase data obtained by inverting the phase of the received data to one channel, it is not necessary to make a significant design change to the existing configuration. In addition, since the reverse phase data obtained by inverting the phase is used during reproduction, reproduction with a sense of incongruity is possible.

  The above-described embodiment can be realized with a configuration of a computer and a memory by realizing the reproduction data storage unit 30 as a memory and processing of other components as a program. Each component can also be realized by hardware such as a dedicated IC (Integrated Circuit) or FPGA (Field Programmable Gate Array). The received data received by the data communication reproduction device 1 is a digital signal, but may be an analog signal, and phase inversion or data addition may be performed on the analog signal. Alternatively, AD (Analog to Digital) conversion and / or DA (Digital to Analog) conversion may be inserted in the middle of processing, and processing for analog signals and processing for digital signals may be mixed.

  In addition, this invention is not limited to the said form, A various deformation | transformation is possible in the range which does not deviate from the summary of this invention.

DESCRIPTION OF SYMBOLS 1 Data communication reproduction | regeneration apparatus 10 Reverse phase addition part 20 Data mixing part 30 Reproduction data storage part 40 Data reproduction part 50 Data composition part

Claims (7)

In a data communication reproduction apparatus for performing data communication and reproduction,
An anti-phase adding unit that receives data of one channel as reception data, generates anti-phase data obtained by inverting the phase of the reception data, and generates extension data of two channels including the reception data and the anti-phase data;
A data mixing unit for generating the reproduction data of two channels by mixing the extension data and the self data of two channels for each channel;
A reproduction data storage unit for storing the reproduction data;
A data reproduction unit for reproducing the reproduction data stored in the reproduction data storage unit in a state where the self data is mixed ;
A data communication reproducing apparatus comprising: a data combining unit configured to generate transmission data of one channel by canceling the value of the extension data by combining the data of both channels of the reproduction data. The received data is a digital signal;
The data communication reproducing apparatus according to claim 1, wherein the reverse phase adding unit generates the reverse phase data by inverting the sign of the received data. The data synthesis unit
The data communication reproduction device according to claim 1 or 2, wherein the transmission data is generated by adding data of both channels of the reproduction data. In a data communication reproduction method for performing communication and reproduction of data,
An anti-phase addition step of receiving data of one channel as reception data, generating anti-phase data obtained by inverting the phase of the reception data, and generating extension data of two channels composed of the reception data and the anti-phase data;
A data mixing step of generating the reproduction data of 2 channels by mixing the extension data and the self data of 2 channels for each channel;
A reproduction data storage step for storing the reproduction data;
A data reproduction step of reproducing the reproduction data stored in the reproduction data storage step in a state where the self data is mixed ;
A data communication reproduction method comprising: a data combination step of generating and transmitting one-channel transmission data by canceling out the value of the extension data by combining the data of both channels of the reproduction data. The received data is a digital signal;
5. The data communication reproduction method according to claim 4, wherein, in the reverse phase step, the reverse phase data is generated by inverting a sign of the received data. In the data synthesis step,
6. The data communication reproduction method according to claim 4, wherein the transmission data is generated by adding data of both channels of the reproduction data.   A data communication reproduction program for executing the data communication reproduction method according to claim 4.