JP4554764B2 - Sound data receiving system and receiving method - Google Patents

Description

[0001]
BACKGROUND OF THE INVENTION
The present invention relates to a sound data receiving system and a receiving method in which sound data of a data transmission medium is transmitted , received and reproduced or output.
[0002]
[Prior art]
In recent years, with the improvement of network technology, the construction of computer networks such as the Internet, LAN (Local Area Network), WAN (WIDE Area Network), etc. has become popular, but it is particularly sufficient when using public telephone lines. When a high transmission rate cannot be expected, it takes a certain amount of time to transmit sound data such as voice having a larger amount of information than information such as characters. Therefore, in the method of transmitting sound data according to a time series generally used, the entire reproduction cannot be performed until the data transmission is completely completed, which causes a psychological burden on the user. Is required.
[0003]
FIG. 8 is an explanatory diagram of conventional sound data transmission / reception. Here, the sound data is expressed as sound data including sound, music, and various sounds (including natural sounds). FIG. 8A shows a general PCM (Pulse Code Modulation) process for converting analog sound data into digital sound data. The sound pressure is quantized for each sampling frequency of analog sound data. To obtain digital sound data. For example, when the sampling frequency is 8 KHz and the number of quantization bits is 8 bits, the transmission bit rate of the sound data is 64 KHz.
[0004]
For example, as shown in FIG. 8B, the sound data as described above is transmitted in chronological order in the order of 00 to 20 on the network when it is composed of 21 data of SD01 to SD21. .
[0005]
On the other hand, the transmitted sound data SD01 to SD20 are sequentially input by the input means 101 and temporarily stored in the buffer 102 as shown in FIG. When all the sound data SD01 to SD20 are input and temporarily stored in the buffer 102, the reproduction means 103 reproduces all the sound data SD01 to SD20 by D / A (digital / analog) conversion It is.
[0006]
[Problems to be solved by the invention]
However, as described above, all of the sound data SD01 to SD20 cannot be reproduced until the transmission is completed (input is completed), and the amount of information such as sound data is particularly large when transmitted using a public telephone line. There is a problem that a large amount of data requires a suitable transmission time and increases the psychological burden on the user.
[0007]
On the other hand, when transmitting data such as voice and moving images, there is a so-called streaming technology that enables playback during input. This streaming technique allows playback or display to start from the beginning before transmission ends, and apparently enables real-time processing. However, even in such a streaming technology, reproduction is as much as the input data. When all data is reproduced, it cannot be performed until the input of all data is completed as described above, and the transmission time Is very large compared to the reproduction time, there is a problem that the user's psychological burden related to transmission cannot be reduced.
[0008]
Therefore, the present invention has been made in view of the above problems, and provides a sound data transmission / reception system and transmission / reception method that enables reproduction as a whole even during transmission of sound data, and reproduction as normal whole sound data at the end of transmission. The purpose is to provide.
[0009]
[Means for Solving the Problems]
In order to solve the above problems, the present invention, in the receiving system, sequentially enter each individual data each individual data of the order in which each individual data extracted at predetermined intervals have been sequentially transmitted constituting the digital sound data In accordance with the order information, the sound data is temporarily stored in correspondence with the regular order constituting the sound data, each individual data temporarily stored in response to a request in the middle of input is stored in another storage area, The data is interpolated and reproduced in the missing part, and the sound data constituted by the individual data is reproduced or output when all the individual data is input .
[0011]
As described above, when all the sound data is inputted, the complete sound data is reproduced or output on the receiving side. However, even during the input, the sound data can be constituted by the inputted individual data and reproduced. It becomes possible. That is, by using data that complete sound data is configured at the end of input, it is possible to provide a audition that does not necessarily require high-quality sound, to provide a sound catalog, etc. It is possible to reduce the psychological burden on reception by the recipient.
[0012]
DETAILED DESCRIPTION OF THE INVENTION
Hereinafter, preferred embodiments of the present invention will be described with reference to the drawings.
FIG. 1 is a block diagram of a sound data transmission / reception system according to the present invention. In FIG. 1, a sound data transmitting / receiving system 11 receives sound data (sound, music, various sounds (including natural sounds), etc.) as sound data, and receives the transmitted sound data. The transmitting system 12 and the receiving system 13 are configured to perform data transmission / reception via a data transmission medium such as a computer network (Internet, LAN, WAN, etc.) or wireless.
[0013]
The transmission system 12 includes at least an A / D conversion unit 21, a transmission processing unit 22, a transmission unit 23, and a setting unit 24 that are digital data creation units. In addition, illustration of the control means etc. which operate | use this system 12 is abbreviate | omitted. The A / D converter 21 converts the input analog sound data into digital data by the PCM method, for example, as described above.
[0014]
The transmission processing means 22 will be described with reference to FIG. 2, but the arrangement of the individual data constituting the digital sound data is extracted at a predetermined interval set in advance by the setting unit 24 and set in a thinned-out state. The processing in which the array of is used as the transmission order is performed. When the sound data is transmitted in a thinned state, the setting by the setting unit 24 is obtained by determining the limit that can be barely heard even if the quality is low, by judging the listening experiment because the sound density is below a certain level. be able to. That is, it is preferable to set the determined audible limit thinning number as an initial skip number as a power of N = 2 for sound data in which each individual data is arranged in time series. Is not limited. In the present embodiment, a case where N = 2 is set to the third power (= 16) as will be described later.
[0015]
Then, the transmission means 23 outputs each individual piece of sound data as a single file on the computer network as a data transmission medium in the order of transmission processed by the transmission processing means 22. The file format in this case may be any format that can be expanded in the receiving system, and is sampled (sampled) as a general and general-purpose sound data format regardless of the presence or absence of header information for file operations. A file format in which the sound data is linearly arranged as it is (for example, WAVE format) can be adopted.
[0016]
The reception system 13 includes at least an input data processing unit 31, a reproduction data management unit 32, and a reproduction unit 33. The input data processing unit 31 includes an input unit 34 and a temporary storage management unit 35, and the reproduction data management unit 32 includes a reproduction control unit 36, a temporary storage unit 37, and an interpolation unit 38. In the system 13, illustration of control means for operation is omitted.
[0017]
The input data processing means 31 sequentially transmits individual data in the order of extracting individual data constituting digital sound data at predetermined intervals from the transmission system 12 and has been transmitted. Each individual data is sequentially input by the input means 34, and the individual data input by the temporary storage management means 35 (configuration will be described with reference to FIG. 2) is converted into a regular order that constitutes the sound data according to the input order information. Temporarily store it in correspondence.
[0018]
The reproduction management unit 32 manages the individual data temporarily stored in the temporary storage management unit 35 according to the input status of all the individual data transmitted by the reproduction control unit 36. When individual data is input, it is output to the reproduction means 33, and when a reproduction request signal is received as a request signal during the input of the individual data, the individual data temporarily stored is stored in a predetermined storage area. The data is stored in the temporary storage means (buffer) 37, and the interpolation means 38 interpolates the data in the missing portion between the individual data and outputs it to the reproduction means 33.
[0019]
Data interpolation includes, for example, a method of assigning the same data as the data input immediately before, a method of assigning an intermediate value by determining the linear state between the individual data before and after, and the like. Then, the reproduction means 33 outputs the input digital sound data to a predetermined external device, or converts it into analog sound data and reproduces it with a speaker or the like (or outputs it to a table recorder or the like).
[0020]
Here, FIG. 2 shows a block diagram of the transmission processing means and the temporary storage management means of FIG. FIG. 2A is a block configuration diagram of the transmission processing unit 22 of the transmission system 12, and FIG. 2B is a block configuration diagram of the temporary storage management unit 35 of the reception system 13.
[0021]
2A includes at least a data acquisition unit 41, a sword unit 42, a transmission information adding unit 43, and a buffer 44. The data acquisition unit 41 acquires the digital sound data (all individual data constituting the data) sent from the A / D conversion means 21 and sends it to the sorting unit 42. The sorting unit 42 rearranges the individual data constituting the sound data according to the setting value (step value of the thinning interval) set by the setting unit 24.
[0022]
The transmission information adding unit 43 includes at least flag information indicating the total number of sound data to be transmitted, that each individual data is a thinned-out signal, and the number of steps of transmission compared to the initial number of thinning steps. For example, it is attached to the beginning of transmission. The flag information is an amount of information that can be ignored compared to the amount of sound data, and does not affect the transmission time. Then, the buffer 44 temporarily stores the rearranged individual data at addresses in which the extraction order is the transmission order.
[0023]
2B includes at least an information recognition unit 51, a buffer management unit 52, and a buffer 53. The information recognition unit 51 recognizes the flag information provided by the transmission information addition unit 43. The buffer management unit 52 manages memory addresses corresponding to the order in the overall configuration of the individual data input by the input unit 34 according to the recognized information, and temporarily stores the memory addresses in the buffer 53.
[0024]
FIG. 3 is an explanatory diagram of the data structure of the sound data in the present invention. The sound data shown in FIG. 3 is composed of individual data SD01 to SD21, for example, as quantized at a sampling frequency of 8 KHz and 8 bits as shown in FIG. In FIG. 3A, individual data SD01 to SD21 of sound data digitized by the A / D conversion unit 21 in the transmission system 12 are acquired by the transmission processing means 22 (data acquisition unit 41), and the sort unit 42 For example, the order for extracting the individual data SD01 to SD21 every 16th as the thinning setting value, that is, the case where the transmission order is determined is shown.
[0025]
Then, as shown in FIG. 3B, the sorted state in the sorting unit 42 is shown. The rearranged individual data SD01 to SD21 are output on the computer network by the transmission means 23 in the order of transmission.
[0026]
In the input data processing means 21 in the receiving system 13, the individual data SD01 to SD21 in the transmission order shown in FIG. 3 (B) are sequentially inputted, and the buffer 53 of the temporary storage management means 37 is shown in FIG. 3 (C). The solid line individual data (SD01 to SD21) shown are temporarily stored at regular positions (addresses) constituting the sound data.
[0027]
FIG. 3C shows 10 individual data (SD01, SD03, SD05, SD07, SD09, SD11, SD13, SD15, SD17, SD21) out of the total individual data SD01 to SD21 when the reproduction request signal is input. Is input and is temporarily stored in the buffer 53. Conversely, the broken line individual data (SD02, SD04, SD06, SD08, SD10, SD12, SD14, SD16, SD18, SD19, SD20) is data that has not yet been transmitted when the reproduction request signal is input.
[0028]
FIG. 3D shows the interpolation data IP01 to IP09 corresponding to the broken line individual data shown in FIG. 3C in the interpolation means 38 of the reproduction data management means 32 in the reception system 13 (not shown). IP09 corresponds to SD18 to SD20) and is shown at a corresponding address on the temporary storage means (buffer) 37 of the reproduction data management means 32. That is, it is reproduced or output in the state shown in FIG.
[0029]
Next, FIG. 4 shows a processing flowchart of the transmission system of FIG. FIG. 4A is an overall processing flowchart of the transmission system 12, and FIG. 4B is a processing flowchart of the transmission processing means 22 provided in the transmission system 12. In FIG. 4A, the transmission system 12 first converts analog sound data input in the A / D converter 21 into digital sound data as described above (step (S) 1). When the data conversion is completed (S2), the individual data SD01 to SD21 constituting the digital sound data are sent to the transmission processing means 22.
[0030]
In the transmission processing means 22, the setting value of the interval for thinning out the individual data SD01 to SD21 is set in advance by the setting unit 24, and each of the sent individual data SD01 to SD21 in the normal order is set according to the set value. The data is extracted and rearranged in the order of transmission (S3) and sent to the transmission means 23 (described in FIG. 4B). The transmission means 23 sequentially outputs the individual data SD01 to SD21 in the transmitted order to the computer network (S4).
[0031]
In FIG. 4B, the transmission processing means 22 acquires the individual data SD01 to SD21 (normal order) constituting the digitized sound data in the data acquisition unit 41 (S11), and sends it to the sorting unit 42. Send it out. The sorting unit 42 assigns the extraction order of the individual data SD01 to SD21 in the normal order sent according to the set values that determine the transmission order as described above according to the set values (FIG. 3A), The extraction order is rearranged as the transmission order (S12, FIG. 3B) and sent to the transmission information adding unit 43.
[0032]
The transmission information adding unit 43 sorts the individual data in the order of transmission into a single sound file header, and, as described above, at least the total number of sound data to be transmitted and the individual data is a thinned signal. That is, flag information indicating the number of stages of transmission compared to the initial number of thinning steps is given (S13), and temporarily stored in the buffer 44 at the address in the order of transmission (FIG. 3B) (S14). ). The individual data stored in the buffer 44 is sequentially sent to the transmission means 23.
[0033]
Next, FIG. 5 shows a processing flowchart of the receiving system of FIG. FIG. 5A is an overall process flowchart of the reception system 13, and FIG. 5B is a process flowchart of the temporary storage management unit 37 included in the reception system 13. In FIG. 5A, the receiving system 13 sequentially inputs the individual data constituting the sound data output from the transmitting system 12 to the computer network and transmitted by the input means 34 in the input data processing means 31. (S21).
[0034]
The input individual data is sent to the temporary storage management means 35, where each individual data is expanded in accordance with the arrangement order of the normal order constituting the sound data file in accordance with the input order information, and temporarily stored. (S22, described in FIG. 5B). When a reproduction request signal is input to the reproduction control unit 36 in the reproduction data management unit 32 while the individual data input by the temporary storage management unit 35 is being temporarily stored in sequence (S23), Each individual data expanded in the temporary storage management means 35 is stored in the temporary storage means (buffer) 37 (S24). For example, as described above, when there is a reproduction request at the time when 10 pieces of individual data are input, the temporary storage unit 37 stores them in the state shown in FIG.
[0035]
In this state, the interpolation means 38 creates and interpolates the missing data between the individual data stored in the temporary storage means 37 in the normal order as described above (FIG. 3D), and as a whole. The data is sent to the reproducing means 33 as data without omission (S25). On the other hand, if the reproduction control means 36 does not input a reproduction request signal in step (S) 23, all the individual data SD01 to SD21 transmitted are inputted and developed in the temporary storage management means 35. Then, the sound data of all the individual data is sent to the reproduction means 33 (S26).
[0036]
Then, the reproducing means 33 converts the interpolated sound data sent or the normal digital sound data not interpolated into analog data (S27) and reproduces it with a speaker or the like (S28). Note that the playback means 33 may output to an external device without playing back with a speaker or the like. Alternatively, digital sound data may be output to an external device without converting the digital sound data into analog.
[0037]
In FIG. 5B, the information recognition unit 51 of the temporary storage management unit 35 in the input data processing unit 31 indicates that the total number of data of the input sound data file and each individual data is a thinned-out signal. The flag information indicating the number of stages of transmission compared to the initial number of thinning steps is recognized (S31), and the corresponding address of the memory area in the buffer 53 is determined according to the flag information with which the buffer management unit 52 has recognized each individual data. The arrangement position is determined by (S32). Then, individual data corresponding to the address of the determined arrangement position is stored (S33).
[0038]
As described above, complete sound data is reproduced when all the sound data is input. However, even during the input, the sound data can be constituted and reproduced by the input individual data. In other words, even if playback is performed in the middle, if all sound data is input, the original complete sound data is obtained, so transmission is not wasted.
[0039]
In other words, the quality of the playback during input is low (the quality is higher if the playback request is late), but it is possible to secure reproducible sound data at any time, and those who receive sound data with a large amount of information. It is possible to reduce the psychological burden in receiving the message. In particular, it is suitable for situations where high-quality sound is not necessarily required, such as browsing sound data, listening to music, and providing a sound catalog, and its application range is wide.
[0040]
By the way, the present invention is not affected by the transmission form from the transmission means 23 of the transmission system 12. For example, even in the form of packet transmission, it is only necessary to put each individual data in which the transmission order is rearranged in one packet, and it is sufficient to leave packet exchange to an existing network protocol.
[0041]
Next, FIG. 6 shows a block diagram of another embodiment of the present invention. In the sound data transmission / reception system 61 shown in FIG. 6A, a server 63 and a predetermined number of clients (terminals) 64A to 64N constituting a part of the transmission system are connected to a computer network 62 as a data transmission medium. In addition, the server 63 is provided with a database management means 65 and a sound database (DB) 66, and is provided with a transmission processing means 67 and a setting unit 68 to constitute a transmission system. The server 63 may include the database management unit 65, the transmission processing unit 67, and the setting unit 68 as appropriate.
[0042]
The server 63 includes a transmission unit that performs predetermined processing on a request from the client via the computer network 62 and outputs the requested data. Each of the clients 64A to 64N includes at least the receiving system 13 shown in FIG. The database management means 65 manages access to the sound DB 66 and copes with unauthorized access. The sound DB 66 stores a predetermined number of various sound data. As shown in FIG. 6B, predetermined analog sound data is converted into digital sound data by the A / D conversion means 71 (FIG. 8). Reference) and stored sequentially through the database management means 65.
[0043]
FIG. 7 shows a process flowchart of the sound data transmission / reception system in FIG. FIG. 7A is a flowchart for creating sound data stored in the sound DB 66, and FIG. 7B is a flowchart for exchanging data in the transmission system. In FIG. 7A, first, analog sound data input in the A / D converter 71 is converted into digital sound data as described above (S41), and when all data conversion is completed. (S42), each individual data (SD01 to SD21) constituting the digital sound data is sent to the database management means 65 and stored in the sound DB 66 (S43), and the desired sound data is sequentially stored. is there.
[0044]
Therefore, in FIG. 7B, when predetermined sound data is requested from any of the clients 64 (64A to 64N) connected to the computer network 62 (S51), the server 63 stores the corresponding sound data in the database. The sound DB 66 is read out via the management means 65, and the requested sound data is acquired (S53). The acquired sound data (each individual data) is sent to the transmission processing means 67, and each individual data (SD01 to SD21) in the normal order sent by the transmission processing means 67 based on the setting in the setting unit 68 as described above. ) Are extracted according to the set value and rearranged in the order of transmission (S53, see FIG. 2A).
[0045]
In addition, as described above, at least the total number of pieces of sound data to be transmitted, each individual data being a thinned-out signal, in the header of the sound data that is rearranged in the order of transmission into a single file. Flag information indicating the number of steps of transmission compared to the number of thinning steps is added (S54), and temporarily stored in the buffer at addresses in the order of transmission (FIG. 3B) (S55, FIG. 2A). reference). Then, the individual data (SD01 to SD21) in the transmission order are sequentially output to the corresponding clients on the computer network 62 by the transmission means (S6).
[0046]
The use of the sound DB 66 as described above can provide the same effects as described above. Also in this case, it can be applied to packet transmission as described above.
[0047]
【The invention's effect】
As described above, according to the present invention, in the receiving system, the individual data in which the individual data constituting the digital sound data are extracted at predetermined intervals and the individual data in the order of transmission are sequentially input. The individual data is temporarily stored in correspondence with the regular order constituting the sound data according to the order information, and is reproduced or output by interpolating the data in the missing part between the individual data in response to a request in the middle of input. Thus, when all sound data is input, complete sound data is played back, but even during input, sound data can be composed and played back by the input individual data, and sound with a large amount of information can be played back. It is possible to reduce a psychological burden in receiving data by a person who receives data.
[Brief description of the drawings]
FIG. 1 is a block diagram of a sound data transmission / reception system according to the present invention.
2 is a block configuration diagram of a transmission processing unit and a temporary storage management unit in FIG. 1;
FIG. 3 is an explanatory diagram of a data structure of sound data according to the present invention.
FIG. 4 is a process flowchart of the transmission system of FIG. 1;
FIG. 5 is a process flowchart of the reception system of FIG. 1;
FIG. 6 is a block diagram of another embodiment of the present invention.
7 is a processing flowchart of the sound data transmission / reception system in FIG. 6. FIG.
FIG. 8 is an explanatory diagram of conventional sound data transmission / reception.
[Explanation of symbols]
11, 61 Sound data transmission / reception system 12 Transmission system 13 Reception system 22, 67 Transmission processing means 31 Input data processing means 32 Playback data management means 35 Temporary storage management means 36 Playback control means 38 Interpolation means 42 Sorting section 43 Transmission information giving section 62 Computer network 63 Server 64 Client 65 Database management means 66 Sound database (DB)

Claims (2)

Using data transmission medium, the sound data is transmitted by the transmitting system, a reproduction or output in the row cormorants receiving system by the reproducing means receives this,
It is those each individual data of the order in which each individual data extracted at every predetermined interval to constitute the digital sound data coming sequentially transmitted sequentially enter each individual data transmitted, the individual input Input data processing means for temporarily storing the data in correspondence with the regular order constituting the sound data according to the input order information;
Managing the individual data temporarily stored in accordance with the input state before Kiko specific data to be transmitted, when all of the individual data is input and output to the reproduction unit for all of the individual data but the when there is a playback request in the middle input of individual data, the stores temporary memory that had been the individual data in a predetermined storage area, exited not have yet been transmitted between the individual data Reproduction data management means for interpolating data in the part and outputting to the reproduction means;
A sound data receiving system comprising: Sound data is transmitted using a data transmission medium, the receiving method of the sound data to be received and reproduced and output on the receiving side,
Be those each individual data of the order in which each individual data extracted at every predetermined interval to constitute the digital sound data coming sequentially transmitted, a step of sequentially inputting each individual data transmitted,
Temporarily storing the input individual data in correspondence with the regular order of the sound data according to the input order information;
Managing the individual data temporarily stored in accordance with the input state before Kiko specific data to be transmitted, when all of the individual data is input and output to the reproduction unit for all of the individual data but the when there is a playback request in the middle input of individual data, the stores temporary memory that had been the individual data in a predetermined storage area, exited not have yet been transmitted between the individual data Interpolating data in the part and reproducing or outputting;
A method of transmitting and receiving sound data, comprising:

Images