KR20200113224A - Audio playback method and system through multiple channels - Google Patents

Abstract

Disclosed is a method and system for reproducing audio through a plurality of channels. In the audio reproducing method according to embodiments of the present invention, different sound sources may be output for each channel in relation to one output device having a plurality of output units for each channel.

Description

Audio playback method and system through multiple channels

The following description relates to a method and system for reproducing audio through a plurality of channels, and in more detail, an audio reproducing method capable of outputting different sound sources for each channel in relation to one output device having a plurality of output units for each channel, The present invention relates to a computer device for performing the audio reproducing method, and a computer program stored in a computer-readable recording medium for executing the audio reproducing method on a computer by being combined with a computer, and a recording medium therefor.

Various technologies exist for outputting sound sources through multiple channels. For example, Korean Patent Laid-Open Publication No. 10-2007-0077220 relates to a method for encoding and decoding a multi-channel audio signal, generating a type of extension data that extends a channel of audio data to a multi-channel, and generating the encoded audio data. It discloses hierarchically encoding extension data that is extended to multi-channels to correspond to each layer of.

These conventional audio reproduction techniques output one sound source through multi-channels so that the listener can feel the stereoscopic sound effect.

An audio reproducing method capable of outputting different sound sources for each channel in relation to one output device having a plurality of output units for each channel, a computer device for performing the audio reproducing method, and a computer combined with a computer to provide the audio reproducing method A computer program stored in a computer-readable recording medium and the recording medium are provided for execution on the computer.

Identifying a plurality of channels corresponding to the plurality of output units for each channel; Managing a playlist for each channel for each of the plurality of channels; Selecting a sound source for each channel from the play list for each channel; Requesting a server for a multi-channel audio signal in which mono channel audio signals of sound sources selected for each channel are mixed along a time axis; Receiving the multi-channel audio signal from the server; And outputting mono-channel audio signals included in the multi-channel audio signal through output units of a corresponding channel among the plurality of output units for each channel.

According to one side, the plurality of output units for each channel may include a first output unit corresponding to a left channel and a second output unit corresponding to a right channel, and selecting the sound source comprises: the play list for each channel Among them, a first sound source may be selected from a first channel playlist for the left channel, and a second sound source may be selected from a second channel playlist for the right channel among the channel-specific playlists.

According to another aspect, in the requesting, a first mono channel audio signal of a first sound source selected for the left channel and a second mono channel audio signal of a second sound source selected for the right channel are mixed along a time axis. The multi-channel audio signal may be requested from the server, and the outputting may include receiving the first mono channel audio signal through a first output unit corresponding to the left channel and a second output unit corresponding to the right channel. Through each, the second mono channel audio signals may be output.

According to another aspect, in the requesting, the server obtains mono channel audio signals for each of the sound sources through the identifiers of the sound sources, and the mono channel audio signals are converted from channels corresponding to the channel information. In order to generate and transmit a multichannel audio signal mixed according to a time axis, identifiers of sound sources selected for each channel and channel information corresponding to each of the identifiers of the sound sources may be transmitted to the server.

According to another aspect, the receiving of the multi-channel audio signal from the server may sequentially receive files included by dividing the multi-channel audio signal by a unit of a preset time or size, and the files The m-th (where m is a natural number) generated file may include, for each channel, an m-th unit audio signal from among unit audio signals in which each of the mono channel audio signals is divided by the unit.

According to another aspect, the receiving of the multi-channel audio signal from the server may include a case in which an order of sound sources for a specific channel among the plurality of channels is changed or a playback position of a sound source being played for the specific channel is changed. , The file generated by changing the order or changing the unit audio signal of a channel corresponding to the change of the playback position may be received from the server.

Receiving identifiers of sound sources selected for each of a plurality of channels and channel information corresponding to each of the identifiers of the sound sources from a client device; Identifying mono channel audio signals for each of the sound sources through identifiers of the sound sources; Generating a multi-channel audio signal obtained by mixing the identified mono-channel audio signals according to a time axis in channels corresponding to the channel information; And transmitting the generated multi-channel audio signal to the client device.

In combination with a computer, there is provided a computer program stored in a computer-readable recording medium for executing the audio reproduction method on the computer.

There is provided a computer-readable recording medium in which a program for executing the audio reproduction method on a computer is recorded.

A computer device comprising: at least one processor embodied to execute an instruction readable by the computer device, wherein the at least one processor identifies a plurality of channels corresponding to a plurality of channel-specific output units, and the Manage a playlist for each channel for each of a plurality of channels, select a sound source for each channel from the playlist for each channel, and send a multi-channel audio signal in which mono channel audio signals of the selected sound sources for each channel are mixed along a time axis to a server. Requesting, receiving the multi-channel audio signal from the server, and outputting mono-channel audio signals included in the multi-channel audio signal through output units of a corresponding channel among the plurality of output units for each channel, respectively Provides.

A computer apparatus comprising: at least one processor embodied to execute a command readable by the computer apparatus, and by the at least one processor, identifiers of sound sources selected for each of a plurality of channels from a client device and identifiers of the sound sources Receive channel information corresponding to each of the sound sources, identify mono-channel audio signals for each of the sound sources through identifiers of the sound sources, and convert the identified mono-channel audio signals to a time axis in channels corresponding to the channel information. There is provided a computer device for generating a mixed multi-channel audio signal according to the above, and transmitting the generated multi-channel audio signal to the client device.

In relation to one output device having a plurality of output units for each channel, different sound sources may be output for each channel. For example, different sound sources may be output through each of the left channel and the right channel to an output device having a first output unit for a left channel and a second output unit for a right channel, such as an earphone or an ear set. As another example, by arranging a plurality of output units each outputting audio signals for each channel included in a multi-channel audio signal in different spaces, and outputting mono channel audio signals of different sound sources through the plurality of output units. , Different sound sources may be output for each channel corresponding to a plurality of output units to which one output device is connected.

1 is a diagram showing an example of a network environment according to an embodiment of the present invention.
2 is a block diagram showing an example of a computer device according to an embodiment of the present invention.
3 is a diagram illustrating an example of an audio reproduction environment according to an embodiment of the present invention.
4 is a diagram illustrating an example of mixing mono channel audio signals according to an embodiment of the present invention.
5 is a diagram illustrating an example of a case in which a sound source included in a play list is changed according to an embodiment of the present invention.
6 is a diagram illustrating an example of audio reproduction using earphones according to an embodiment of the present invention.
7 is a flowchart showing an example of an audio reproduction method according to an embodiment of the present invention.
8 is a flowchart illustrating another example of an audio reproducing method according to an embodiment of the present invention.

Best mode for carrying out the invention

Hereinafter, embodiments will be described in detail with reference to the accompanying drawings.

The audio reproduction method according to embodiments of the present invention may be implemented through a computer device such as an electronic device and/or a server to be described later. In this case, a computer program according to an embodiment of the present invention may be installed and driven in the computer device, and the computer device may perform the audio reproduction method according to the embodiments of the present invention under control of the driven computer program. . The above-described computer program may be combined with a computer device and stored in a computer-readable recording medium to execute an audio reproduction method on a computer.

1 is a diagram showing an example of a network environment according to an embodiment of the present invention. The network environment of FIG. 1 shows an example including a plurality of electronic devices 110, 120, 130, and 140, a plurality of servers 150 and 160, and a network 170. FIG. 1 is an example for describing the invention, and the number of electronic devices or servers is not limited as in FIG. 1.

The plurality of electronic devices 110, 120, 130, and 140 may be a fixed terminal implemented as a computer device or a mobile terminal. Examples of a plurality of electronic devices (110, 120, 130, 140), smart phone (smart phone), mobile phone, navigation, computer, notebook, digital broadcasting terminal, PDA (Personal Digital Assistants), PMP (Portable Multimedia Player) , Tablet PC, etc. As an example, in FIG. 1, the shape of a smartphone is shown as an example of the electronic device 1 110, but in the embodiments of the present invention, the electronic device 1 110 substantially connects the network 170 using a wireless or wired communication method. It may mean one of various physical computer devices capable of communicating with other electronic devices 120, 130, and 140 and/or the servers 150 and 160.

The communication method is not limited, and not only a communication method using a communication network (for example, a mobile communication network, wired Internet, wireless Internet, and broadcasting network) that the network 170 may include, but also short-range wireless communication between devices may be included. For example, the network 170 includes a personal area network (PAN), a local area network (LAN), a campus area network (CAN), a metropolitan area network (MAN), a wide area network (WAN), and a broadband network (BBN). , Internet, and the like. In addition, the network 170 may include any one or more of a network topology including a bus network, a star network, a ring network, a mesh network, a star-bus network, a tree or a hierarchical network, etc. Not limited.

Each of the servers 150 and 160 is a computer device or a plurality of computers that communicates with a plurality of electronic devices 110, 120, 130, 140 and a network 170 to provide commands, codes, files, contents, services, etc. It can be implemented with devices. For example, the server 150 serves as a plurality of electronic devices 110, 120, 130, 140 accessed through the network 170 (for example, a social network service, a messaging service, a search service, a mail service, It may be a system that provides a content providing service, etc.).

2 is a block diagram showing an example of a computer device according to an embodiment of the present invention. Each of the electronic devices 110, 120, 130, and 140 described above or each of the servers 150 and 160 may be implemented by the computer apparatus 200 illustrated in FIG. 2. For example, a computer program according to an embodiment may be installed and driven in the computer device 200, and the computer device 200 is an audio reproduction method according to embodiments of the present invention under control of the driven computer program. Can be done.

As illustrated in FIG. 2, the computer device 200 may include a memory 210, a processor 220, a communication interface 230, and an input/output interface 240. The memory 210 is a computer-readable recording medium and may include a permanent mass storage device such as a random access memory (RAM), read only memory (ROM), and a disk drive. Here, a non-destructive large-capacity recording device such as a ROM and a disk drive may be included in the computer device 200 as a separate permanent storage device separated from the memory 210. In addition, an operating system and at least one program code may be stored in the memory 210. These software components may be loaded into the memory 210 from a computer-readable recording medium separate from the memory 210. Such a separate computer-readable recording medium may include a computer-readable recording medium such as a floppy drive, disk, tape, DVD/CD-ROM drive, and memory card. In another embodiment, software components may be loaded into the memory 210 through a communication interface 230 other than a computer-readable recording medium. For example, software components may be loaded into the memory 210 of the computer device 200 based on a computer program installed by files received through the network 170.

The processor 220 may be configured to process instructions of a computer program by performing basic arithmetic, logic, and input/output operations. Commands may be provided to the processor 220 by the memory 210 or the communication interface 230. For example, the processor 220 may be configured to execute a command received according to a program code stored in a recording device such as the memory 210.

The communication interface 230 may provide a function for the computer device 200 to communicate with other devices (eg, storage devices described above) through the network 170. For example, a request, command, data, file, etc., generated by the processor 220 of the computer device 200 according to a program code stored in a recording device such as the memory 210, is transmitted to the network according to the control of the communication interface 230. 170) can be transferred to other devices. Conversely, signals, commands, data, files, etc. from other devices may be received by the computer device 200 through the communication interface 230 of the computer device 200 via the network 170. Signals, commands, data, etc. received through the communication interface 230 may be transmitted to the processor 220 or the memory 210, and the file, etc. may be a storage medium (described above) that the computer device 200 may further include. Permanent storage).

The input/output interface 240 may be a means for an interface with the input/output device 250. For example, the input device may include a device such as a microphone, a keyboard, or a mouse, and the output device may include a device such as a display or a speaker. As another example, the input/output interface 240 may be a means for interfacing with a device in which input and output functions are integrated into one, such as a touch screen. The input/output device 250 may be configured with the computer device 200 and one device.

Further, in other embodiments, the computer device 200 may include fewer or more components than the components of FIG. 2. However, there is no need to clearly show most of the prior art components. For example, the computer device 200 may be implemented to include at least some of the input/output devices 250 described above, or may further include other components such as a transceiver and a database.

3 is a diagram illustrating an example of an audio reproduction environment according to an embodiment of the present invention. The client device 310 according to the present embodiment may include output units 320 for N (a natural number of 2 or more) channels or may be associated with the output units 320. For example, the client device 310 is wired and/or wirelessly connected to an earphone or earphone having two output units, an output unit for a left channel and an output unit for a right channel, thereby providing an audio signal for each channel as an earphone or an earphone. Can be printed. As another example, the client device 310 may include a device having five output units, such as a speaker having five channels, or may be connected to the device by wire and/or wire.

In this case, the client device 310 may identify output units for each channel, and manage a playlist for each channel for each channel. In the embodiment of FIG. 3, N playlists 330 for each channel corresponding to each of the output units 320 for N channels are disclosed. If there are output units for two channels, such as an earphone or an earphone, the client device 310 may generate and manage a play list for a left channel and a play list for a right channel, respectively.

In this case, the client device 310 may control each of the output units 320 for N channels to output a sound source of a playlist of a corresponding channel. To this end, the client device 310 can identify sound sources to be played from each of the N playlists 330 for each channel, and transmits information on the identified sound sources to the server 340 to identify sound sources. You can request audio signals for At this time, the server 340 does not simply provide the audio signals of each of the requested sound sources, but mixes the mono channel audio signals of the requested sound sources according to the time axis in the corresponding channel to obtain one multi-channel audio signal. It may be generated, and the generated multi-channel audio signal may be transmitted to the client device 310. In other words, the server 340 includes a first mono channel audio signal for a first sound source of a first channel, a second mono channel audio signal for a second sound source of a second channel, ... , N-th mono-channel audio signals for the N-th sound source of the N-th channel may be mixed according to a time axis to generate an N-channel audio signal, and the generated N-channel audio signal may be transmitted to the client device 310.

In this case, each of the N mono-channel audio signals included in the N-channel audio signal may include information on which one of the plurality of channels in the client device 310 is an audio signal. The client device 310 may correspond each of the N mono-channel audio signals included in the N-channel audio signal to a plurality of channels, and an output unit of a corresponding channel among the output units 320 for N channels. A corresponding mono channel audio signal can be output through. For example, it is assumed that the client device 310 receives a stereo audio signal including a first mono channel audio signal for a left channel and a second mono channel audio signal for a right channel from the server 340.

In this case, the client device 310 may output the first mono channel audio signal through the output unit of the left channel and output the second mono channel audio signal through the output unit of the right channel. Accordingly, different sound sources may be output to the left channel output unit and the right channel output unit of the earphone or earphone. In other words, it is possible for two users to simultaneously listen to different sound sources through earphones or earphones connected to one client device 310.

Considering the N-channel output units 320 and the N-channel playlists 330, it will be easily understood that one client device 310 can simultaneously output N different sound sources. .

4 is a diagram illustrating an example of mixing mono channel audio signals according to an embodiment of the present invention. In the embodiment of FIG. 4, the 1-1 sound source and the 1-2 sound source are sequentially reproduced in the play list for the first channel, and the 2-1 sound source and the 2-2 sound source are in the play list for the second channel. Consider a case in which these are sequentially reproduced, and the N-1th sound source and the N-2th sound source are sequentially reproduced in the playlist for the Nth channel. Each sound source may have different play times.

The client device 310 is a 1-1 sound source, a 2-1 sound source, ... , If the identifiers of the N-1th sound source and the respective channel information are provided, the server 340 transmits the 1-1 mono-channel audio signal for the 1-1 sound source and the 2-1 2-1 mono channel audio signal for sound source,… , Like the N-1th mono channel audio signal for the N-1th sound source, a total of N mono channel audio signals may be mixed along the time axis to generate the N channel audio signal 440.

At this time, when the play time of the 2-1 sound source ends as at the second point in time 420, the server 340 may receive information on the next sound source from the client device 310 in the play list for the second channel. I can. The playback order of sound sources in the playlist may be set based on the order of sound sources and a repeat playback flag. The server 340 according to the embodiment may receive information on all sound sources of the N playlists 330 for each channel and their orders in advance. In this case, the server 340 is a 1-1 mono-channel audio signal for the 1-1 sound source, a 2-2 mono-channel audio signal for the 2-2 sound source, ... , Like the N-1th mono channel audio signal for the N-1th sound source, a total of N mono channel audio signals may be mixed along the time axis to generate the N channel audio signal 440.

Similarly, when the play time of the N-1th sound source ends at the third point in time 430, the server 340 may receive information on the next sound source from the client device 310 in the playlist for the Nth channel. I can. In this case, the server 340 is a 1-1 mono-channel audio signal for the 1-1 sound source, a 2-2 mono-channel audio signal for the 2-2 sound source, ... , Like the N-2th mono channel audio signal for the N-2th sound source, the N-channel audio signal 440 may be generated by mixing a total of N mono-channel audio signals along the time axis.

As such, the multi-channel audio signal generated by the server 340 may be generated for at least one sound source for each channel selected from each of the N playlists 330 for each channel. In this case, the lengths of the sound sources may be different, and it will be easily understood that the length of the N-channel audio signal 440 may correspond to the playback length in the channel having the longest total play time.

Meanwhile, the server 340 may provide the multi-channel audio signal after generating all the multi-channel audio signals, but may provide only a portion generated simultaneously with the generation of the multi-channel audio signal through a streaming method. In this case, a change in sound sources or a change in playback position in each of the N playlists 330 for each channel may be reflected in the generation of a multi-channel audio signal.

5 is a diagram illustrating an example of a case in which a sound source included in a play list is changed according to an embodiment of the present invention. In this embodiment, a case in which sound sources included in each of the N playlists 330 for each channel are changed may be considered. For example, a case in which the 2-1 sound source is changed to the 2-5 sound source between the first view point 410 and the second view point 420 may be considered. FIG. 5 shows an example in which the sound source 2-1 is changed to the sound source 2-5 at a fourth time point 510, which is a time point between the first time point 410 and the second time point 420. In this case, the client device 310 may notify the server 340 that the 2-1 sound source has been changed to the 2-5 sound source in the second channel, and the server 340 is The N-channel audio signal 440 may be generated by using the 2-5 mono-channel audio signal for the 2-5 sound source instead of the 2-1 mono-channel audio signal for the sound source.

In other words, between the fourth time point 510 and the third time point 430, the server 340 transmits a 1-1 mono channel audio signal for the 1-1 sound source, and the 2-5 channel audio signal for the 2-5 sound source. Mono channel audio signal,… , Like the N-2th mono channel audio signal for the N-2th sound source, the N-channel audio signal 440 may be generated by mixing a total of N mono-channel audio signals along the time axis.

In this case, for an arbitrary sound source, one mono channel audio signal for each sound source may be generated as a plurality of mono channel audio signals (hereinafter referred to as'unit audio signals') divided by a predetermined time or by a predetermined unit. For example, assuming that the 1-1 sound source of FIG. 5 has a length of 2 minutes and the mono channel audio signal of the 1-1 sound source is divided in units of 10 seconds, a total of 12 sound sources for the 1-1 sound source Unit audio signals of (2 minutes = 120 seconds) may be generated. For better understanding, these 12 unit audio signals are divided into 1-1-1st unit audio signals to 1-1-12th unit audio signals. Similarly, assuming that the 2-1 sound source has a length of 50 seconds, for the 2-1 sound source, a total of 5 units from the 2-1-1 unit audio signal to the 2-1-5 unit audio signal Audio signals can be generated. In addition, assuming that the N-1th sound source has a length of 1 minute and 30 seconds, for the N-1th sound source, a total of 9 audio signals from the N-1-1th unit audio signal to the N-1-9th unit audio signal Unit audio signals may be generated. At this time, the first 10 second unit of the N-channel audio signal 440 is a 1-1-1 unit audio signal, a 2-1-1 unit audio signal, ... , May correspond to N unit audio signals of the N-1-1th unit audio signal.

As another example, it may be assumed that the 2-1 sound source has a length of 45 seconds. In this case, in order to divide the sound source in units of 10 seconds, the 2-1-5 unit audio signal generated for the 2-1 sound source not only includes the audio signal for the last 5 seconds of the 2-1 sound source. Alternatively, it may be generated to further include an audio signal for the first 5 seconds of the 2-5th sound source, which is the next sound source.

Meanwhile, as in the embodiment of FIG. 5, a case in which sound sources included in each of the N playlists 330 for each channel are changed may be considered. For example, the N-channel audio signal 440 generated for the embodiment of FIG. 4 and provided to the client device 310 is the fifth 10 second unit and the audio signal for the last 5 seconds of the 2-1 sound source 2-2 A 2-1-5 unit audio signal including an audio signal for the first 5 seconds of the sound source may be included. If the 2-5 sound source is added between the 2-1 sound source and the 2-2 sound source at the fourth time point 510 as in the embodiment of FIG. 5, the second sound source is followed by the 2-1 sound source. 5 The sound source should be played. Accordingly, the server 340 regenerates the 2-1-5 unit audio signal to include the audio signal for the first 5 seconds of the 2-5 sound source instead of the audio signal for the first 5 seconds of the 2-2 sound source. , The 2-1-5 unit audio signal included in the previously provided N-channel audio signal 440 by transmitting the regenerated 2-1-5 unit audio signal to the client device 310 is regenerated 2-1 It can be replaced with a -5 unit audio signal. In other words, as the N-channel audio signal 440 is generated by dividing the N-channel audio signal 440 into a plurality of N-channel audio signals of the same unit for a predetermined time, the change of sound sources in each of the N-channel playlists 330 Even in the case of a change, the N-channel audio signal 440 does not need to be entirely regenerated, and it is possible to respond in the form of changing only after a period related to the change. For example, when the server 340 provides a streaming service to the client device 310, when a sound source of a specific channel is changed, only the unit audio signals from the time when the sound source is changed are recombined and the client device 310 By providing the N-channel audio signal 440, it is possible to respond to changes in a specific channel.

To this end, the N-channel audio signal 440 may be generated in the form of a file for each unit. For example, the first 10 second unit of the N-channel audio signal 440 is a 1-1-1th unit audio signal, a 2-1-1th unit audio signal, ... , N unit audio signals of the N-1-1th unit audio signal may be mixed and generated as an included first file. In this case, the aforementioned 2-1-5 unit audio signal may be generated as a fifth file corresponding to the fifth 10 second unit of the N-channel audio signal 440. In the example described above, when the playback order is changed so that the 2-5 sound source is played instead of the 2-2 sound source at the fourth time point 510, the server 340 regenerates the fifth file and transmits it to the client device 310 Accordingly, it is possible to respond to changes in sound sources or changes in reproduction positions without changing the entire N-channel audio signal 440. An embodiment in which unit audio signals are divided into units of size rather than time may be easily understood through the foregoing descriptions.

Similarly, even when the playback order of sound sources included in the playlist is changed or the playback position of the sound source is changed, the sound source of the corresponding playback order or the mono channel audio signal of the corresponding playback position are mixed with the mono channel audio signals of other channels. As a result, an N-channel audio signal 440 may be generated. As such, since the N-channel audio signal 440 is mixed by applying changes in the playlists 330 for each N channels, users who listen to each of the N channels change the sound source for their own channel in real time. Or change the playback position.

6 is a diagram illustrating an example of audio reproduction using earphones according to an embodiment of the present invention. In the embodiment of FIG. 6, it is assumed that there are output units 610 and 620 for each of the left and right channels, like an earphone, and play lists 630 and 640 for each of the channels exist. In addition, in FIG. 6, a 3-minute long sound source 1, a 4-minute long sound source 2, and a 2-minute long sound source 3 are included in the playlist 630 for the left channel, and the playlist 640 for the right channel Suppose that a 2-minute long sound source a, a 3-minute long sound source b, and a 5-minute long sound source c are included.

The client device 310 may transmit information on sound sources (for example, identifiers and playback order of sound sources, etc.) and channel information to the server 340 according to the playback order on the playlists 630 and 640, and the server Reference numeral 340 may generate a multi-channel audio signal based on the received information. In this case, the multi-channel audio signal generated by the server 340 may include a mono channel audio signal for a left channel and a mono channel audio signal for a right channel.

In this case, as shown in the embodiment of FIG. 6, the multi-channel audio signal for the first 2 minutes may include a mono channel audio signal of sound source 1 for the left channel and a mono channel audio signal of sound source a for the right channel. . Since the playback length of source a is 2 minutes, the playback time of source a ends, and the multi-channel audio signal for the next 1 minute is mono channel audio signal of source 1 for the left channel and mono channel audio signal of source b for the right channel. It may include a channel audio signal. Similarly, since the playback length of source 1 is 3 minutes, the playback time of source 1 ends, and the multi-channel audio signal for the next 2 minutes is the mono channel audio signal of source 2 for the left channel and the audio source for the right channel. b may include a mono channel audio signal. Since the playback length of source b is 3 minutes, the playback time of source b ends, and the multi-channel audio signal for the next 2 minutes is a mono channel audio signal of source 2 for the left channel and a mono channel of source c for the right channel. It may contain an audio signal. After generating a multichannel audio signal for a reproduction length of 9 minutes in this manner, a mono channel audio signal for all sound sources for the left channel is included in the multichannel audio signal. On the other hand, for the right channel, since there is a playback length of 1 minute for the sound source c, the multichannel audio signal for the last minute is an empty mono channel audio signal (or any mono channel audio signal) for the left channel and the right channel. It may include a mono channel audio signal of sound source c for the channel.

The arbitrary mono-channel audio signal may include, for example, an audio signal randomly generated by the server 340 (eg, an atmospheric guidance audio signal) or a mono-channel audio signal of the sound source c for a light channel. When the mono channel audio signal of the sound source c for the right channel is used as an arbitrary mono channel audio signal, both the left channel and the right channel can listen to the same sound source for the last minute. As another example, the server 340 may utilize the mono channel audio of the first sound source (sound source 1 in the embodiment of FIG. 6) again for the left channel as an arbitrary mono channel audio signal.

If, in the case where the repetition playback flag is set in the playlist, it will be easily understood by those of ordinary skill in the art that mono channel audio signals of sound sources can be used in an order according to the repetition playback flag set in the playlist for each channel.

7 is a flowchart showing an example of an audio reproduction method according to an embodiment of the present invention. The audio reproducing method according to the present embodiment may be performed by the computer device 200 implementing the client device 310 described above. For example, the processor 220 of the computer device 200 may be implemented to execute a code of an operating system included in the memory 210 or a control instruction according to the code of at least one program. Here, the processor 220 may cause the computer device 200 to perform steps 710 to 760 included in the audio reproducing method of FIG. 7 according to a control command provided by a code stored in the computer device 200. 200) can be controlled.

In step 710, the computer device 200 may identify a plurality of channels corresponding to a plurality of output units for each channel. Here, the plurality of channels may be N (N is a natural number of 2 or more). For example, the earphone or earphone may include two output units for each channel: a first output unit corresponding to a left channel and a second output unit corresponding to a right channel. When the computer device 200 is connected to an earphone or an earphone, the computer device 200 may identify two channels corresponding to output units for each of the two channels.

In step 720, the computer device 200 may manage a playlist for each channel for each of the plurality of channels. For example, in the example of the earphone or earphone described above, a play list for a left channel and a play list for a right channel may be considered. Each playlist may independently include sound source lists.

In step 730, the computer device 200 may select a sound source for each channel from the play list for each channel. For example, the computer apparatus 200 may select at least one sound source from a first play list for a left channel and at least one sound source from a second play list for a right channel. As another example, the computer apparatus 200 may select all sound sources in the playlist for the left channel and all sound sources in the playlist for the right channel.

In operation 740, the computer apparatus 200 may request a multi-channel audio signal obtained by mixing mono channel audio signals of sound sources selected for each channel according to a time axis from the server. In other words, the computer apparatus 200 may request a multi-channel audio signal from a server in which mono-channel audio signals of different sound sources correspond to individual channels instead of multi-channel for one sound source. In the above-described example of earphones or earphones, the computer apparatus 200 mixes the first mono channel audio signal of the first sound source selected for the left channel and the second mono channel audio signal of the second sound source selected for the right channel along the time axis. You can request the multi-channel audio signal from the server. More specifically, in step 730, the computer device 200 may transmit identifiers of sound sources selected for each channel and channel information corresponding to each of the identifiers of sound sources to the server. In this case, the server acquires mono-channel audio signals for each of the sound sources through the identifiers of the sound sources, and generates and transmits a multi-channel audio signal obtained by mixing mono-channel audio signals in channels corresponding to the channel information along a time axis. I can.

In step 750, the computer device 200 may receive a multi-channel audio signal from a server. The multi-channel audio signal received from the server includes a first mono channel audio signal of the first sound source selected for the left channel and a second mono channel audio signal of the second sound source selected for the right channel in the example of the earphone or ear set described above. can do.

The computer device 200 according to the embodiment may sequentially receive files included by dividing the multi-channel audio signal by a unit of a predetermined time or size in step 750. In this case, the m-th generated file among the files (where m is a natural number) may include, for each channel, the m-th divided unit audio signal among the unit audio signals divided by each of the mono channel audio signals. . Prior to the embodiment of FIG. 5, the first 10 second unit of the N-channel audio signal 440 is a 1-1-1 unit audio signal, a 2-1-1 unit audio signal, ... , It has been described that unit audio signals for each N channels of the N-1-1th unit audio signal may be generated as a mixed first file. In this case, when the order of sound sources for a specific channel among the plurality of channels is changed or the playback position of the sound source being played for a specific channel is changed, the change of the order or the change of the playback position and the corresponding channel The file generated by changing the unit audio signal can be received from the server. If the computer device 200 has received the file from the server before changing the order or before changing the playback location, and before audio signals corresponding to the file are still played, the computer device 200 You can replace the file with the regenerated file.

In step 760, the computer apparatus 200 may output mono-channel audio signals included in the multi-channel audio signal through output units of a corresponding channel among a plurality of output units for each channel. In the example of the earphone or ear set described above, the computer device 200 transmits a first mono channel audio signal through a first output unit corresponding to a left channel, and a second mono channel audio signal through a second output unit corresponding to a right channel. Each can be printed. Accordingly, the first listener wearing the first output unit for the left channel and the second listener wearing the second output unit for the right channel may use the output units included in the earphone or earphone connected to one computer device 200. Through this, you can enjoy different sound sources.

It will be readily understood by a person skilled in the art that three or more different sound sources may be simultaneously enjoyed through three or more output units for three or more channels for outputting surround sound.

8 is a flowchart illustrating another example of an audio reproducing method according to an embodiment of the present invention. The audio reproduction method according to the present embodiment may be performed by the computer device 200 implementing the server 340 described above. For example, the processor 220 of the computer device 200 may be implemented to execute a code of an operating system included in the memory 210 or a control instruction according to the code of at least one program. Here, the processor 220 may cause the computer device 200 to perform steps 810 to 840 included in the audio reproducing method of FIG. 8 according to a control command provided by a code stored in the computer device 200. 200) can be controlled.

In step 810, the computer device 200 may receive identifiers of sound sources selected for each of a plurality of channels and channel information corresponding to each of the identifiers of the sound sources from the client device. In this case, the plurality of channels may correspond to each of the output units for each of a plurality of channels of the client device, and the sound sources may correspond to sound sources selected for each channel from a playlist for each channel managed by the client device for each of the plurality of channels. .

In step 820, the computer device 200 may identify mono channel audio signals for each of the sound sources through the identifiers of the sound sources. When sound sources for each channel to be played by the client device are changed, the computer device 200 may identify mono channel audio signals for each of the changed sound sources through steps 810 and 820. In addition, when reproduction is requested from the middle part of the sound source, the computer device 200 may further receive information on the reproduction position of the sound source from the client device, and based on the received information, the mono channel audio signal from the corresponding reproduction position. You can also identify

In operation 830, the computer apparatus 200 may generate a multi-channel audio signal obtained by mixing the identified mono-channel audio signals from channels corresponding to the channel information according to a time axis. According to an embodiment, the computer device 200 may sequentially generate files included by dividing the multi-channel audio signal by a unit of a predetermined time or size in step 830. In this case, the m-th generated file among the files may include the m-th divided unit audio signal among the unit audio signals divided by each of the mono channel audio signals for each channel. have. Prior to the embodiment of FIG. 5, the first 10 second unit of the N-channel audio signal 440 is a 1-1-1 unit audio signal, a 2-1-1 unit audio signal, ... , It has been described that unit audio signals for each N channels of the N-1-1th unit audio signal may be generated as a mixed first file. In addition, when the order of sound sources for a specific channel among a plurality of channels is changed, or when the playback position of the sound source being played for the specific channel is changed, the channel corresponding to the change of the order or the change of the playback position A file in which the unit audio signal of is changed can be generated and transmitted to the client device. If the client device has received the corresponding file before changing the order or before changing the playback position, and has not yet played the file, the client device can replace the previously received file with the regenerated file.

In step 840, the computer device 200 may transmit the generated multi-channel audio signal to the client device. In this case, the client device may output mono-channel audio signals included in the generated multi-channel audio signal through an output unit of a corresponding channel among a plurality of output units for each channel of the client device.

In the above embodiments, an embodiment in which the sound source selected by the client device 310 is provided through the server 340 and outputted for each channel has been described. However, multi-channel audio in which mono-channel audio signals of different sound sources are mixed for each channel. When a signal exists (for example, a file containing the multi-channel audio exists), a plurality of output units can be provided by playing multi-channel audio on different channels through the file without communication with a playlist or server. Embodiments for outputting different sound sources may also be easily understood by a person skilled in the art through the above embodiments.

As described above, according to embodiments of the present invention, different sound sources may be output for each channel in relation to one output device having a plurality of output units for each channel.

The system or device described above may be implemented as a hardware component, a software component, or a combination of a hardware component and a software component. For example, the devices and components described in the embodiments are, for example, a processor, a controller, an arithmetic logic unit (ALU), a digital signal processor, a microcomputer, a field programmable gate array (FPGA). , A programmable logic unit (PLU), a microprocessor, or any other device capable of executing and responding to instructions, such as one or more general purpose computers or special purpose computers. The processing device may execute an operating system (OS) and one or more software applications executed on the operating system. In addition, the processing device may access, store, manipulate, process, and generate data in response to the execution of software. For the convenience of understanding, although it is sometimes described that one processing device is used, one of ordinary skill in the art, the processing device is a plurality of processing elements and/or a plurality of types of processing elements. It can be seen that it may include. For example, the processing device may include a plurality of processors or one processor and one controller. In addition, other processing configurations are possible, such as a parallel processor.

The software may include a computer program, code, instructions, or a combination of one or more of these, configuring the processing unit to behave as desired or processed independently or collectively. You can command the device. Software and/or data may be interpreted by a processing device or to provide instructions or data to a processing device, of any type of machine, component, physical device, virtual equipment, computer storage medium or device. Can be embodyed in The software may be distributed over networked computer systems and stored or executed in a distributed manner. Software and data may be stored on one or more computer-readable recording media.

The method according to the embodiment may be implemented in the form of program instructions that can be executed through various computer means and recorded in a computer-readable medium. The computer-readable medium may include program instructions, data files, data structures, and the like alone or in combination. The program instructions recorded on the medium may be specially designed and configured for the embodiment, or may be known and usable to a person skilled in computer software. Examples of computer-readable recording media include magnetic media such as hard disks, floppy disks, and magnetic tapes, optical media such as CD-ROMs and DVDs, and magnetic media such as floptical disks. -A hardware device specially configured to store and execute program instructions such as magneto-optical media, and ROM, RAM, flash memory, and the like. Such a recording medium may be a variety of recording means or storage means in a form in which a single piece of hardware or several pieces of hardware are combined, and is not limited to a medium directly connected to a computer system, but may be distributed on a network. Examples of the program instructions include not only machine language codes such as those produced by a compiler, but also high-level language codes that can be executed by a computer using an interpreter or the like.

Mode for carrying out the invention

As described above, although the embodiments have been described by the limited embodiments and drawings, various modifications and variations are possible from the above description by those of ordinary skill in the art. For example, the described techniques are performed in a different order from the described method, and/or components such as a system, structure, device, circuit, etc. described are combined or combined in a form different from the described method, or other components Alternatively, even if substituted or substituted by an equivalent, an appropriate result can be achieved.

Therefore, other implementations, other embodiments, and equivalents to the claims fall within the scope of the following claims.

Claims (16)

Identifying a plurality of channels corresponding to the plurality of output units for each channel;
Managing a playlist for each channel for each of the plurality of channels;
Selecting a sound source for each channel from the play list for each channel;
Requesting a server for a multi-channel audio signal in which mono channel audio signals of sound sources selected for each channel are mixed along a time axis;
Receiving the multi-channel audio signal from the server; And
Outputting mono-channel audio signals included in the multi-channel audio signal through an output unit of a corresponding channel among the plurality of output units for each channel
Audio playback method comprising a. The method of claim 1,
The plurality of output units for each channel includes a first output unit corresponding to a left channel and a second output unit corresponding to a right channel,
The step of selecting the sound source,
Audio playback for selecting a first sound source from a first channel playlist for the left channel among the channel playlists, and selecting a second sound source from a second channel playlist for the right channel among the channel playlists Way. The method of claim 2,
The requesting step,
A first mono-channel audio signal of a first sound source selected for the left channel and a second mono-channel audio signal of a second sound source selected for the right channel are mixed along a time axis to request a multi-channel audio signal from the server,
The outputting step,
Outputting the first mono-channel audio signal through a first output unit corresponding to the left channel and the second mono-channel audio signal through a second output unit corresponding to the right channel. The method of claim 1,
The requesting step,
The server obtains mono-channel audio signals for each of the sound sources through the identifiers of the sound sources, and generates a multi-channel audio signal obtained by mixing the mono-channel audio signals in channels corresponding to the channel information along a time axis, and Transmitting, to the server, identifiers of sound sources selected for each channel and channel information corresponding to each of the identifiers of the sound sources to be transmitted. The method of claim 1,
Receiving the multi-channel audio signal from the server,
The multi-channel audio signal is divided into units of a preset time or size to sequentially receive files included,
Of the files, the m-th generated file (where m is a natural number) is an audio reproduction including, for each channel, the m-th unit audio signal divided among unit audio signals each of the mono channel audio signals is divided by the unit Way. The method of claim 5,
Receiving the multi-channel audio signal from the server,
When the order of sound sources for a specific channel among the plurality of channels is changed or the playback position of the sound source being played for the specific channel is changed, a unit audio signal of a channel corresponding to the change of the order or the change of the playback position An audio reproduction method for receiving a modified and generated file from the server. Receiving identifiers of sound sources selected for each of a plurality of channels and channel information corresponding to each of the identifiers of the sound sources from a client device;
Identifying mono channel audio signals for each of the sound sources through identifiers of the sound sources;
Generating a multi-channel audio signal obtained by mixing the identified mono-channel audio signals according to a time axis in channels corresponding to the channel information; And
Transmitting the generated multi-channel audio signal to the client device
Audio playback method comprising a. The method of claim 7,
The plurality of channels correspond to each of a plurality of channel-specific output units of the client device,
The sound sources are selected for each channel from a playlist for each channel managed by the client device for each of the plurality of channels. The method of claim 7,
The generated multi-channel audio signal is implemented so that mono-channel audio signals included in the multi-channel audio signal are respectively output through an output unit of a corresponding channel among a plurality of output units for each channel of the client device . The method of claim 7,
Generating the multi-channel audio signal,
The multi-channel audio signal is divided into units of a preset time or size to sequentially generate files included,
Of the files, the m-th generated file (where m is a natural number) is an audio reproduction including, for each channel, the m-th unit audio signal divided among unit audio signals each of the mono channel audio signals is divided by the unit Way. The method of claim 10,
When the order of sound sources for a specific channel among the plurality of channels is changed or the playback position of the sound source being played for the specific channel is changed, a unit audio signal of a channel corresponding to the change of the order or the change of the playback position Creating a modified file and transmitting it to the client device
Audio playback method further comprising a. A computer-readable recording medium having a computer program recorded thereon for executing the method of claim 1 on a computer. In the computer device,
At least one processor embodied to execute instructions readable in the computer device
Including,
By the at least one processor,
Receive identifiers of sound sources selected for each of a plurality of channels from a client device and channel information corresponding to each of the identifiers of the sound sources,
Identifying mono channel audio signals for each of the sound sources through the identifiers of the sound sources,
A multi-channel audio signal is generated by mixing the identified mono-channel audio signals according to a time axis in channels corresponding to the channel information,
Transmitting the generated multi-channel audio signal to the client device,
Computer device. The method of claim 13,
The plurality of channels correspond to each of a plurality of channel-specific output units of the client device,
The sound sources are selected for each channel from a playlist for each channel managed by the client device for each of the plurality of channels. The method of claim 13,
The generated multi-channel audio signal is implemented such that mono-channel audio signals included in the multi-channel audio signal are respectively output through an output unit of a corresponding channel among a plurality of output units for each channel of the client device. The method of claim 13,
By the at least one processor,
The multi-channel audio signal is divided into units of a preset time or size to sequentially generate files included,
A computer device including, for each channel, the m-th generated file among the files (where m is a natural number) and includes the m-th unit audio signal of the unit audio signals divided by each of the mono channel audio signals for each channel .

Images