JP2021517661A - Sound source playback sharing method and system - Google Patents

Abstract

Provides a sound source playback sharing method and system. In the sound source reproduction sharing method according to the embodiment of the present invention, at the stage where the main device establishes short-range wireless communication with at least one sub-device, the sound source that the main device intends to reproduce and share with at least one sub-device is used. The confirmed sound source and the confirmed sound source have been confirmed by the main device via the established short-range wireless communication so that the confirmation step and the confirmed sound source are reproduced by the at least one sub-device. A step of transmitting a reproduction command to the sound source to the at least one subdevice to reproduce the confirmed sound source is included. [Selection diagram] Fig. 3

Description

The following description relates to a sound source reproduction sharing method and a system, and more particularly, a sound source reproduction sharing method capable of sharing sound source reproduction by a main device with sub-devices located in the same space or adjacent distances, said sound source reproduction sharing. The present invention relates to a computer device that executes a method, a computer program that is combined with a computer and recorded on a computer-readable recording medium in order to cause the computer to execute the sound source reproduction sharing method, and the recording medium thereof.

There is a need (needs) to share one sound source with a plurality of users. For example, in order to share the sound source reproduced by the mobile device of the user A with the user B, the user C, and the user D, there is a method of outputting the audio signal of the reproduced sound source from the speaker included in the mobile device of the user A. ..

Unlike this, even in situations where it is difficult to output audio signals from speakers, such as in public spaces, or when audio signals can be output from speakers, each user uses earphones or a headset. There may be a need for each to listen to the sound source individually. In such a case, there is a limit to sharing the same sound source through the mobile device of user A.

As a result, Korean Registered Patent No. 10-1481657 discloses a method in which music can be listened to together through a sound source streaming server. For example, such a method discloses a technique of confirming the login of a listening user, confirming the login of a friend user of the listening user, and supplying the currently played music of the friend user to the listening user. However, such a conventional technique has a problem that each user is forced to consume the data of each user because each user communicates with the server using his / her own mobile device. In addition, each user must register as a member of the service provided by the server, and there is an inconvenience that the login process must be performed after accessing the server.

A sound source playback sharing method that can share sound source playback by the main device with sub-devices located in the same space or adjacent distances, a computer device that executes the sound source playback sharing method, and the sound source playback sharing method that is combined with a computer. Provided are a computer program recorded on a computer-readable recording medium and the recording medium thereof for execution by a computer.

A step in which the main device establishes short-range wireless communication with at least one subdevice, a step in which the main device confirms a sound source to be reproduced and shared with the at least one subdevice, and a step in which the confirmed sound source is said to be at least. The main device transmits a reproduction command for the confirmed sound source and the confirmed sound source to the at least one subdevice via the established short-range wireless communication so as to be played by one subdevice. Then, the sound source reproduction sharing method including the step of reproducing the confirmed sound source is provided.

According to one aspect, in the step of confirming the sound source, the segment file of the sound source is streamed from the server in which the sound source is recorded to the main device, and in the stage of playing the confirmed sound source, the segment file of the sound source is streamed from the server. The segment file and the reproduction command for the segment file may be transmitted to the at least one subdevice via the established short-range wireless communication to reproduce the streamed segment file.

According to another aspect, the sound source reproduction sharing method was generated by the server so that the main device allows reproduction sharing of the sound source via short-range wireless communication for the at least one subdevice. The step of receiving the play allowed key from the server and playing the confirmed sound source may transmit the play instruction including the play allowed key to the at least one subdevice together with the segment file. ..

According to another aspect, in the step of confirming the sound source, the main device loads the sound source recorded in the local storage of the main device into the memory, and in the stage of playing back the confirmed sound source, the local storage. The sound source recorded in the above and the reproduction command for the sound source may be transmitted to the at least one sub-device via the established short-range wireless communication.

According to another aspect, the confirmed sound source includes a multi-channel audio signal, and at the stage of reproducing the confirmed sound source, the main device and the at least one sub-device are different from each other of the multi-channel audio signal. The main device separates the multi-channel audio signal so as to reproduce the channel signal, the audio signal of at least a part of the channel is transmitted to the at least one subdevice, and the audio signal of the remaining part of the channel is the main. The device may be realized to play and the at least one sub-device to play the audio signal of the partial channel received from the main device.

According to another aspect, in the sound source reproduction sharing method, the position of each of the at least one sub-devices is determined by the main device communicating with the at least one sub-device via the established short-range wireless communication. The step of reproducing the confirmed sound source further includes the step of identifying, in which the main device separates the multi-channel audio signal for each channel, and the at least one sub-device of the audio signals separated for each channel. The audio signal of the channel to be transmitted to may be determined based on the identified position.

According to another aspect, the sound source reproduction sharing method further includes a step in which the main device confirms the output performance of the audio signal of the at least one sub-device, and the step of reproducing the confirmed sound source is the step. The output performance of the confirmed audio signal in which the main device separates the multi-channel audio signal for each channel and transmits the audio signal of the channel for transmission to the at least one sub-device among the audio signals separated for each channel. It may be decided based on.

According to another aspect, the step of confirming the output performance of the audio signal is the step of receiving the profile information of the at least one subdevice from the at least one subdevice via the established short-range wireless communication. The step of requesting the server for information on the output performance of the audio signal of the at least one sub-device using the received profile information, and the information on the output performance of the audio signal of the device corresponding to the profile information. It may include a step of receiving from the server.

According to yet another aspect, the stage of reproducing the confirmed sound source is such that the main device synchronizes the reproduction time of the confirmed sound source with the main device and the at least one sub-device. The reproduction time information of the generated sound source is generated, the generated reproduction time information is transmitted to at least one sub-device together with the confirmed sound source, and the confirmed sound source is transmitted at a time corresponding to the reproduction time information. The at least one sub-device may be realized to reproduce and reproduce the confirmed sound source received from the main device at a time corresponding to the reproduction time information.

Provided is a computer program that is combined with a computer and recorded on a computer-readable recording medium for causing the computer to execute the sound source reproduction sharing method.

Provided is a computer-readable recording medium in which a program for causing a computer to execute the sound source reproduction sharing method is recorded.

The at least one processor comprises at least one processor implemented to execute a computer-readable instruction, wherein the main device establishes short-range wireless communication with at least one subdevice, and the main device is said to be said. A sound source to be reproduced and shared with at least one subdevice is confirmed, and the main device is played via the established short-range wireless communication so that the confirmed sound source is reproduced by the at least one subdevice. Provided is a computer device that reproduces the confirmed sound source by transmitting a reproduction command for the confirmed sound source and the confirmed sound source to the at least one sub-device.

Sound source playback by the main device can be shared with at least one sub-device located in the same space or at adjacent distances.

It is a figure which showed the example of the network environment in one Embodiment of this invention. It is a block diagram which showed the example of the computer apparatus in one Embodiment of this invention. It is a figure which showed the example of the environment where the sound source reproduction sharing method is executed in one Embodiment of this invention. It is a figure which showed the example of the process of reproducing a segment file using the reproduction allowable key in one Embodiment of this invention. It is a figure which showed the example of the environment where the sound source reproduction sharing method is executed in one Embodiment of this invention. It is a figure which showed the example of the environment which provides the surround sound by the sound source reproduction sharing method in one Embodiment of this invention. It is a figure which showed the example of the method of measuring the distance between devices in one Embodiment of this invention. It is a figure which showed the example which measures the relative direction between devices in one Embodiment of this invention. It is a figure which showed the example which measures the relative direction between devices in one Embodiment of this invention. It is a flowchart which showed the example of the sound source reproduction sharing method in one Embodiment of this invention.

Hereinafter, embodiments will be described in detail with reference to the accompanying drawings.

The sound source reproduction sharing method according to the embodiment of the present invention may be realized by a computer device such as an electronic device and / or a server described below. At this time, in the computer device, the computer program according to the embodiment of the present invention may be installed and executed, and the computer device may play and share the sound source according to the embodiment of the present invention under the control of the executed computer program. You may carry out the method. The computer program described above may be recorded on a computer-readable recording medium in combination with a computer device to allow the computer to perform a sound source reproduction sharing method.

FIG. 1 is a diagram showing an example of a network environment according to an embodiment of the present invention. The network environment of FIG. 1 shows an example including a plurality of electronic devices 110, 120, 130, 140, a plurality of servers 150, 160, and a network 170. Such FIG. 1 is merely an example for explaining the invention, and the number of electronic devices and the number of servers are not limited as in FIG.

The plurality of electronic devices 110, 120, 130, 140 may be fixed terminals or mobile terminals realized by a computer device. Examples of the plurality of electronic devices 110, 120, 130, 140 include smartphones, mobile phones, navigation systems, PCs (personal computers), notebook PCs, digital broadcasting terminals, PDAs (Personal Digital Assistants), and PMPs (Portable Multimedia Players). ), Tablets, etc. As an example, FIG. 1 shows a smartphone as an example of the electronic device 1 (110), but in the embodiment of the present invention, the electronic device 1 (110) substantially utilizes a wireless or wired communication method. It may mean one of a variety of physical computer devices capable of communicating with other electronic devices 120, 130, 140 and / or servers 150, 160 via network 170.

The communication method is not limited, and not only the communication method using the communication network (for example, mobile communication network, wired Internet, wireless Internet, broadcasting network) that can be included in the network 170, but also the short distance between devices. Wireless communication may be included. For example, the network 170 includes a PAN (personal area network), a LAN (local area network), a CAN (campus area network), a MAN (metropolitan area network), a WAN (wide network), etc. It may include any one or more of the networks. Further, network 170 may include, but is limited to, any one or more of network topologies, including bus networks, star networks, ring networks, mesh networks, star-bus networks, tree or hierarchical networks, and the like. Will not be done.

Each of the servers 150, 160 is realized by one or more computer devices that communicate with a plurality of electronic devices 110, 120, 130, 140 via a network 170 to provide instructions, codes, files, contents, services, and the like. good. For example, the server 150 provides services (for example, social network services, messaging services, search services, mail services, content providing services, etc.) to a plurality of electronic devices 110, 120, 130, 140 connected via the network 170. It may be the provided system.

FIG. 2 is a block diagram showing an example of a computer device according to an embodiment of the present invention. Each of the plurality of electronic devices 110, 120, 130, 140 and the servers 150, 160 described above may be realized by the computer device 200 shown in FIG. For example, in the computer device 200, the computer program according to the embodiment may be installed and executed, and the computer device 200 uses the sound source reproduction sharing method according to the embodiment of the present invention under the control of the computer program to be executed. You may do it.

Such a computer device 200 may include a memory 210, a processor 220, a communication interface 230, and an input / output interface 240, as shown in FIG. The memory 210 is a computer-readable recording medium and may include a permanent large-capacity recording device such as a RAM (random access memory), a ROM (read only memory), and a disk drive. Here, a permanent large-capacity recording device such as a ROM or a disk drive may be included in the computer device 200 as another permanent recording device that is separated from the memory 210. Further, the memory 210 may record an operating system and at least one program code. Such software components may be loaded into memory 210 from a computer-readable recording medium separate from memory 210. Such other computer readable recording media may include computer readable recording media such as floppy® drives, disks, tapes, DVD / CD-ROM drives, memory cards and the like. In other embodiments, software components may be loaded into memory 210 through a communication module 230 that is not a computer-readable recording medium. For example, software components may be loaded into memory 210 of computer equipment 200 based on a computer program installed by a file received over network 170.

Processor 220 may be configured to process instructions in a computer program by performing basic arithmetic, logic, and I / O operations. Instructions may be provided to processor 220 by memory 210 or communication interface 230. For example, the processor 220 may be configured to execute instructions received according to program code recorded in a recording device such as memory 210.

The communication module 230 may provide a function for the computer device 200 to communicate with another device (for example, the recording device described above) via the network 170. As an example, requests, instructions, data, files, etc. generated by the processor 220 of the computer device 200 according to the program code recorded in the recording device such as the memory 210 are sent via the network 170 under the control of the communication interface 230. May be transmitted to the device of. On the contrary, signals, instructions, data, files and the like from other devices may be received by the computer device 200 via the communication interface 230 of the computer device 200 via the network 170. Signals, instructions, data and the like received through the communication module 230 may be transmitted to the processor 220 and the memory 210, and files and the like may be transferred to a recording medium (the above-mentioned permanent recording device) that can be further included in the computer device 200. May be recorded.

The input / output interface 240 may be a means for an interface with the input / output device 250. For example, the input device may include a device such as a microphone, keyboard, or mouse, and the output device may include a device such as a display, speaker. As another example, the input / output interface 240 may be a means for an interface with a device such as a touch screen in which functions for input and output are integrated into one. The input / output device 250 may be composed of a computer device 200 and one device.

Also, in other embodiments, the computer device 200 may include fewer or more components than the components of FIG. However, it is not necessary to clearly illustrate most of the prior art components. For example, the computer device 200 may be implemented to include at least a portion of the input / output devices 250 described above, or may further include other components such as transceivers, databases, and the like. As a more specific example, when the electronic device 110 is a smartphone, an acceleration sensor or gyro sensor, a camera module, various physical buttons, buttons using a touch panel, an input / output port, which are generally included in the smartphone, Various components, such as a vibrating device for vibration, may be realized to be further included in the electronic device 110.

FIG. 3 is a diagram showing an example of an environment in which the sound source reproduction sharing method according to the embodiment of the present invention is executed. In the embodiment of FIG. 3, device 1 (310) as a main device and device 2 (320), device 3 (330), and device 4 (340) as at least one sub-device are shown. At this time, although one main device and three sub-devices are illustrated in the embodiment of FIG. 3, the number of sub-devices should not be limited by the embodiment of FIG. Further, in the embodiment of FIG. 3, a streaming server 350 that streams a sound source to the device 1 (310), which is the main device, is shown.

Such devices 310-340 may correspond to the plurality of electronic devices 110, 120, 130, 140 described above, and the streaming server 350 may correspond to the server 150 described above. At this time, in the devices 310 to 340, a computer program for causing the computer to execute the sound source reproduction sharing method may be installed and executed, and the devices 310 to 340 reproduce the sound source under the control of such a computer program. You may implement the sharing method. As an example, the computer program may be an application installed and executed on the devices 310-340 in order to provide a streaming service to the devices 310-340 in cooperation with the streaming server 350.

The device 1 (310) may establish short-range wireless communication with each of the device 2 (320), the device 3 (330), and the device 4 (340) that share the sound source. For example, device 1 (310) may establish connections with device 2 (320), device 3 (330), and device 4 (340) by Bluetooth. Alternatively, device 1 (310) is associated with device 2 (320), device 3 (330), and device 4 (340), respectively, via an access point (AP) that provides local Wi-Fi. A connection may be established. As another example, device 1 (310) operates as a hot spot to establish connections with device 2 (320), device 3 (330), and device 4 (340), respectively. You may. In this way, the device 1 (310) is the device 2 (320), the device 3 (the device 3) that attempts to share the sound source by one of various methods that can be directly / indirectly connected to other peripheral devices. You may establish short-range wireless communication with each of 330) and device 4 (340).

At this time, the sound source may be streamed to the device 1 (310) from the streaming server 350. For example, the device 1 (310) may sequentially receive the segment files of the sound source transmitted by the streaming server 350. In this case, the device 1 (310) issues a received segment file and a playback instruction to such a segment file via the established short-range wireless communication, the device 2 (320), the device 3 (330), and the device 1 (330). It may be transmitted to each of the devices 4 (340), and the sound source may be reproduced using the segment file streamed from the streaming server 350.

On the other hand, each of the device 2 (320), the device 3 (330), and the device 4 (340) reproduces the segment file transmitted from the device 1 (310) according to the reproduction instruction, whereby the device 1 (310), One sound source may be shared with device 2 (320), device 3 (330), and device 4 (340). In this case, each of the at least one sub-device, device 2 (320), device 3 (330), and device 4 (340), is a data network even if it is not registered in the service of the streaming server 350. Since the sound source is provided from the device 1 (310), which is the main device, instead of directly connecting to the streaming server 350 via the above, the sound source is provided without consuming its own cellular data. Can be shared.

Further, the device 1 (310) generates sound source playback time point information in order to synchronize the sound source playback time points, and transmits the sound source playback time point information to each of the device 2 (320), the device 3 (330), and the device 4 (340). It's okay. In this case, the reproduction of the sound source may be shared by each of the device 1 (310), the device 2 (320), the device 3 (330), and the device 4 (340) reproducing the sound source based on the reproduction time point information. ..

Here, the device 1 (310) or the user of the device 1 (310) may be a device or user registered in the streaming server 350 and capable of using the sound source. On the other hand, each user of device 2 (320), device 3 (330), and device 4 (340) or each user of device 2 (320), device 3 (330), and device 4 (340) is such a sound source. It may be a device or user who is not allowed to play against. For this purpose, the streaming server 350 may provide the sub-device with a playback permissible key for allowing the main device to share sound source playback only for short-range wireless communication. For example, the device 1 (310) may request the streaming server 350 for a playable key, and the streaming server 350 generates a playable key according to the request of the device 1 (310) and transmits it to the device 1 (310). You can do it. In this case, the device 1 (310) transmits the playback allowable key to the device 2 (320), the device 3 (330), and the device 4 (340), respectively, so that the device 2 (320) and the device 3 (330) , And the device 4 (340), respectively, may allow the sound source to be played using the streaming file.

As a more specific example, the playback allowable key is a decoding key for decoding a segment file for the corresponding sound source and a session identifier for short-range wireless communication established between the main device and the sub device. It may be generated by combining.

FIG. 4 is a diagram showing an example of a process of reproducing a segment file using a reproduction allowable key in one embodiment of the present invention.

The first process 410 may be a process in which the device 1 (310) and the device 2 (320) establish short-range wireless communication. At this time, the device 1 (310) may confirm the device identifier of the device 2 (320) and the session identifier of the short-range wireless communication.

The second process 420 may be a process in which the device 1 (310) transmits the device identifier and the session identifier of the device 2 (320) to the streaming server 350. Such a process may be a process in which the device 1 (310) requests the sound source and the playback allowable key of the sound source for the device 2 (320) from the streaming server 350.

The third process 430 may be a process in which the streaming server 350 generates a playback allowable key for the device 2 (320) and transmits it to the device 1 (310) together with the sound source. At this time, the streaming server 350 generates a playback allowable key for the device 2 (320) identified by the device identifier by combining the decoding key for decoding the segment file for the sound source and the session identifier. It's okay. As an example, the streaming server 350 may transmit the device identifier received in the second process and the playback allowable key generated in the third process to the device 1 (310) together with the sound source, and the device 1 (310) is the device identifier. It may be identified that the playable key received by is the playable key for device 2 (320). At this time, the sound source may be transmitted to the device 1 (310) by a method in which the streaming server 350 streams the segment file for the sound source.

The fourth process 440 may be a process in which the device 1 (310) transmits the sound source and the reproduction allowable key to the device 2 (320). At this time, the computer program installed and executed on the device 2 (320) is a short-range radio established between the first session identifier included in the playback allowable key and the device 1 (310) that transmitted the sound source. The second session identifier of the communication may be compared, and if the first session identifier and the second session identifier are the same, the reproduction allowance of the corresponding sound source may be authenticated. Further, when the reproduction of the sound source is permitted, the computer program of the device 2 (320) decodes the segment file of the sound source transmitted from the device 1 (310) by the decoding key included in the reproduction allowable key to obtain the sound source. You may play it.

The process described with reference to FIG. 4 is performed for each of device 2 (320), device 3 (330), and device 4 (340) in the embodiment of FIG. 3, thereby performing device 1 (310). Alternatively, the reproduction of the sound source, which was permitted only to the user of the device 1 (310), is also permitted to the device 2 (320), the device 3 (330), and the device 4 (340), thereby enabling sharing. ..

Here, the sound source reproduction sharing method according to the embodiment of FIG. 4 is merely an example for sharing the reproduction of the sound source when the reproduction of the sound source is limited to the user or the device. Any method can be used without limitation as long as it is a method for allowing reproduction of a sound source only for range wireless communication.

The device 1 (310) can also share the reproduction of the sound source recorded in the local storage of the device 1 (310) with the device 2 (320), the device 3 (330), and the device 4 (340). be.

FIG. 5 is a diagram showing an example of an environment in which the sound source reproduction sharing method according to the embodiment of the present invention is executed. As described with reference to FIG. 3, device 1 (310) may establish short-range wireless communication with device 2 (320), device 3 (330), and device 4 (340), respectively. At this time, the device 1 (310) loads the sound source recorded in the local storage 510 into the memory 520, and then transmits the sound source to each of the device 2 (320), the device 3 (330), and the device 4 (340). Then, the sound source loaded in the memory 520 may be reproduced. In this case, the sound source may be shared by each of the device 2 (320), the device 3 (330), and the device 4 (340) playing the sound source transmitted from the device 1 (310).

Also in this case, in order to synchronize the playback time of the sound source, the device 1 (310) generates the playback time information of the sound source, and the device 2 (320), the device 3 (330), and the device 4 (340). ) May be sent to each. In this case, the reproduction of the sound source may be shared by each of the device 1 (310), the device 2 (320), the device 3 (330), and the device 4 (340) reproducing the sound source according to the reproduction time point information.

Not only this, but also in such a case, a technique for limiting the sound source to be reproduced in a single manner only for the sub-device for which short-range wireless communication has been established may be applied. For example, the sound source recorded in the local storage 510 of the device 1 (310) may be a sound source that can be played back only by the user of the device 1 (310) or the device 1 (310) for copyright protection. .. In this case, the device 1 (310) receives the playback allowable key from the server linked with the application installed and executed in each of the devices 310 to 340 as described with reference to FIG. 5, and the device 2 (320) and the device 1 (320). It may be transmitted to 3 (330) and 4 (340) respectively. In this case, the playable key may be generated by combining the restore key for repairing the sound source recorded in the local storage 510 of the device 1 (310) so that it can be played back, and the session identifier of the short-range wireless communication. , Device 2 (320), Device 3 (330), and Device 4 (340), respectively, with sound source restoration installed on Device 2 (320), Device 3 (330), and Device 4 (340), respectively. According to the control of the executed computer program, it may be restricted while the short-range radio communication corresponding to the device 1 (310) and the session identifier is established.

In the embodiment of FIGS. 3 and 4, an example of streaming the sound source from the streaming server 350 has been described, but the device 1 (310) downloads the sound source from another server, and the device 2 (320) and the device 3 (330). , And an embodiment in which the reproduction of the sound source is shared with each of the devices 4 (340) is also conceivable. In this case, the sound source downloaded by the device 1 (310) from another server may be recorded in the local storage 510 of the device 1 (310) described with reference to FIG. 5, and as in the embodiment described with reference to FIG. Sound source playback may be shared with each of 2 (320), device 3 (330), and device 4 (340).

Further, in the embodiment of FIG. 5, the embodiment in which the device 1 (310) streams the sound source to the device 2 (320), the device 3 (330), and the device 4 (340) can be considered. In this case, the device 1 (310) may generate a segment file for the sound source under the control of the computer program installed and executed in the device 1 (310), and the device 2 (310) may use the generated segment file. The sound source may be streamed to each of the 320), the device 3 (330), and the device 4 (340). In this case, the computer program of device 1 (310) may generate a playable key and provide it to device 2 (320), device 3 (330), and device 4 (340), respectively.

Further, the reproduction sharing of the sound source described above may be utilized for reproducing the surround sound of the sound source including the multi-channel audio signal.

FIG. 6 is a diagram showing an example of an environment in which surround sound is provided by a sound source reproduction sharing method according to an embodiment of the present invention. In FIG. 6, in order to reproduce surround sound based on a sound source including a multi-channel audio signal, the device 1 separates the multi-channel audio signal into channels, and the sub-devices device 2 (320) and device 3 (330). , And an example of transmitting an audio signal for each of the separated channels to the device 4 (340) are shown.

For example, the device 1 (310) may receive a sound source including a multi-channel audio signal from the streaming server 350 by a streaming method. At this time, the device 1 (310) may separate the multi-channel audio signal included in the received sound source for each channel, and may determine the channel of the audio signal to be transmitted to each sub-device. In FIG. 6, device 1 (310) transmits a second channel audio signal to device 2 (320), third channel audio signal to device 3 (330), and device 4 (340). An example of transmitting a fourth channel audio signal is shown. Further, in FIG. 6, the device 1 (310) reproduces the first channel audio signal, the device 2 (320) reproduces the second channel audio signal, and the device 3 (330) reproduces the three channel audio signal. An example is shown in which the surround sound is reproduced by the device 4 (340) reproducing the fourth channel audio signal.

In some embodiments, it is also possible for one main device or one subdevice to reproduce audio signals for two or more channels.

Device 1 (310) may determine the audio signal of the channel played by the subdevice based on the position of the subdevice. Here, the position of the sub-device may be a position relative to the main device, and the main device grasps the position of the sub-device by one of various techniques for grasping the position between devices. good. In one embodiment, the main device may communicate with the sub-device via short-range wireless communication established with the sub-device to identify the location of each sub-device. The method of identifying the position will be described in more detail below.

In this case, device 1 (310) sends the audio signal of the channel to be transmitted to the sub-devices (device 2 (320), device 3 (330), and device 4 (340), respectively) based on the identified position. It may be determined and the audio signal of the channel in question may be transmitted to the corresponding subdevice. At this time, the surround sound by the multi-channel audio signal included in the sound source may be provided to the user (or the users) by each of the devices 310 to 340 reproducing the audio signal for each assigned channel.

FIG. 7 is a diagram showing an example of a method for measuring the distance between devices in one embodiment of the present invention. FIG. 7 describes an example in which the device 1 (310) identifies the distance from the device 2 (320).

In step 710, device 1 (310) may request device 2 (320) to transmit radio and sound signals via short-range radio communication established with device 2 (320). ..

In the second process 720, the device 2 (320) may transmit each of the radio signal and the sound signal to the device 1 (310) according to the request of the device 1 (310). At this time, the radio signal may include information regarding the time when the device 2 (320) transmits the radio signal and the sound signal. Further, the radio signal may be transmitted via the short-range wireless communication established between the device 1 (310) and the device 2 (320), and the sound signal is output from the speaker of the device 2 (320). good.

In the third process 730, the device 1 (310) delays the transmission of the radio signal based on the information regarding the reception time of the radio signal, the reception time of the sound signal, and the time when the radio signal and the sound signal included in the radio signal are transmitted. The time t1 and the sound signal transmission delay time t2 may be calculated, and the distance to the device 2 (320) may be calculated based on T, which is the difference between t2 and t1.

8 and 9 are diagrams showing an example of measuring the relative orientation between devices in one embodiment of the present invention.

In the embodiment of FIG. 8, the device 1 (310) includes the first microphone 810 and the second microphone 820 at different positions, and recognizes the distance H1 between the first microphone 810 and the second microphone 820. Assume. The device 1 (310) may request the device 2 (320) to transmit a sound signal via short-range wireless communication established with the device 2 (320). The device 2 (320) may output a sound signal from the speaker 830, and the first microphone 810 and the second microphone 820 of the device 1 (310) may receive the sound signal output from the speaker 830, respectively. At this time, the device 1 (310) may calculate the distance d11 between the first microphone 810 and the speaker 830 by the method described with reference to FIG. 7, and may calculate the distance d12 between the second microphone 820 and the speaker 830. .. In this case, the device 1 (310) utilizes the H1, d11, and d12 to obtain the distance D1 between the device 1 (310) and the device 2 (320), and the device 1 (310) to the device 2 (320) (from the device 1 (310). Specifically, the relative direction θ1 to the speaker 830) may be calculated.

As a more specific example, d11 means the distance between the point corresponding to the first microphone 810 (hereinafter, "first point") and one point corresponding to the speaker 830 (hereinafter, "second point"). D12 may mean the distance between one point (hereinafter, “third point”) corresponding to the second microphone 820 and the second point. In this case, H1 may mean the distance between the first point and the third point. On the other hand, the distance D1 may mean the distance between an arbitrary point (hereinafter, "fourth point") on the line connecting the first point and the third point and the second point. At this time, in order to calculate D1 and θ1, it is assumed that the device 1 (310) recognizes the distance between the first point and the fourth point and the distance between the third point and the fourth point. As an example, the intermediate point between the first point and the third point may be the fourth point.

Similarly, in the embodiment of FIG. 9, the device 1 (310) includes the first speaker 910 and the second speaker 920 at different positions, and recognizes the distance H2 between the first speaker 910 and the second speaker 920. Suppose you are. The device 1 (310) may transmit a control command to prepare the device 2 (320) for receiving a sound signal via short-range wireless communication established with the device 2 (320). Further, the device 1 (310) may output a sound signal from each of the first speaker 910 and the second speaker 920. The device 2 (320) may calculate the distance d21 between the first speaker 910 and the device 2 (320) and the distance d22 between the second speaker 920 and the device 2 (320) by the method described with reference to FIG. , D21 and d22 calculated via short-range wireless communication may be transmitted to the device 1 (310). In this case, the device 1 (310) utilizes H2, d21, and d22 to obtain the distance D2 between the device 1 (310) and the device 2 (320) and the device 1 (310) to the device 2 (330) ( More specifically, the relative direction θ2 to the microphone 930) may be calculated.

The distance and direction calculation methods described with reference to FIGS. 7 to 9 are only presented as an example for measuring the position of the device, and are one of various well-known techniques for measuring the position between devices. Those skilled in the art will readily understand that one may apply to embodiments of the present invention.

In other embodiments, the audio signal of the channel for transmission to the subdevice may be determined based on the output performance of the audio signal of the subdevice. For example, in FIG. 6, device 1 (310), which is the main device, may receive profile information of each of the devices 320 to 340 via short-range wireless communication established with each of the devices 320 to 340. At this time, the device 1 (310) may acquire information on the output performance of the audio signal of each of the devices 320 to 340 based on such profile information.

In one embodiment, the computer program installed and executed on the device 1 (310) may manage information on the output performance of the audio signal for each device model. In this case, the device 1 (310) may acquire information on the output performance of the audio signal corresponding to the model based on the model extracted from the acquired profile information.

As another embodiment, the device 1 (310) provides profile information to the above-mentioned streaming server 350 or another server, and provides information on the output performance of an audio signal corresponding to the profile information from the streaming server 350 or another server. You may receive it.

In this case, the device 1 (310) may determine the channel of the audio signal for each of the devices 320 to 340 based on the output performance of the audio signal obtained for each of the devices 320 to 340. For example, device 1 (310) may allocate the main channel of the multi-channel audio signal to the device having the highest output performance of the audio signal.

As another embodiment, the device 1 (310) receives the profile information of each of the devices 320 to 340 and transmits the profile information of each of the devices 320 to 340 to the streaming server 350 via the short-range wireless communication established with each of the devices 320 to 340. The streaming server 350 may receive information about the channel of the audio signal determined for each of the devices 320 to 340. At this time, the streaming server 350 determines the output performance of the audio signal of the device from the profile information received from the device 1 (310), and based on the determined output performance of the audio signal, the channel of the audio signal to the devices 320 to 340. May be decided.

Depending on the embodiment, both the position of the device and the output performance of the audio signal described above may be utilized. The technology itself for allocating multi-channel audio signals based on performance and arrangement already determined between speakers is related to acoustic technology and can be easily understood by those skilled in the art from well-known acoustic technology. Let's do it.

FIG. 10 is a flowchart showing an example of a sound source reproduction sharing method according to an embodiment of the present invention. The sound source reproduction sharing method according to the present embodiment may be executed by the computer device 200 that realizes the above-mentioned main device. For example, the processor 220 of the computer device 200 may be implemented to execute a control instruction by the code of the operating system included in the memory 210 and the code of at least one program. Here, the processor 220 controls the computer device 200 so that the computer device 200 executes the steps 1010 to 1030 included in the sound source reproduction sharing method of FIG. 10 according to the control instruction provided by the code recorded in the computer device 200. You can.

At step 1010, the computer device 200 may establish short-range wireless communication with the subdevice. Here, the number of sub-devices may correspond to the above-mentioned devices 320 to 340, and the number thereof is not particularly limited, but it is preferable that the number of sub-devices is equal to or less than the number of computer devices 200 capable of simultaneously communicating.

At step 1020, the computer device 200 may identify a sound source that is to share playback with the subdevice. As described in the above-described embodiment, the sound source to be shared for playback is recorded in the sound source streamed from the streaming server 350 or in the local storage of the computer device 200 (as an example, the local storage 510 described with reference to FIG. 5). The sound source may be included.

At step 1030, the computer device 200 transmits the confirmed sound source and the playback instruction to the confirmed sound source to the sub-device via established short-range wireless communication so that the confirmed sound source is played on the sub-device. Then, the confirmed sound source may be reproduced. In this case, the computer device 200 may share the sound source reproduction with the sub device by reproducing the received sound source on the sub device according to the reproduction instruction.

In one embodiment, the computer device 200 establishes short-range wireless communication with a sub-device, and a sound source for sharing playback with the sub-device by streaming a segment file of the sound source from a server on which the sound source is recorded. You may check. In this case, the computer device 200 may transmit the segment file streamed from the server and the reproduction instruction for the segment file to the sub-device via the established short-range wireless communication to reproduce the streamed segment file. At this time, the sub-device may also share the sound source reproduction between the computer device 200 and the sub-device by reproducing the received segment file according to the reproduction instruction. In this case, the sub-device can share the reproduction of the sound source with the computer device 200 without registering in the streaming service provided by the server or logging in to the streaming service.

At this time, as described with reference to FIG. 4, for the sound source whose reproduction is permitted only to the computer device 200 or the user of the computer device 200, the reproduction of the corresponding sound source is shared with the sub device by using the reproduction allowable key. You may be able to do it. For example, in the present embodiment, the computer device 200 may receive a reproduction allowable key generated by the server from the server in order to allow the sub-device to reproduce and share the sound source via short-range wireless communication. As a more specific example, the computer device 200 may request a playable key for the subdevice while transmitting the session identifier of the short-range wireless communication established with the subdevice to the server. The server may generate a playback allowable key by combining the decoding key for decoding the segment file for the sound source and the session identifier received from the computer device 200 and send it to the computer device 200. In this case, the computer device 200 may transmit the segment file, the reproduction instruction for the segment file, and the reproduction allowable key to the corresponding subdevices. At this time, the sub-device follows the control of the computer program installed and executed for the sound source reproduction sharing method, and the short-range wireless communication established between the session identifier included in the reproduction allowable key and the computer device 200. If they match each other, the segment file may be decoded and played using the decryption key further included in the play allowed key. Such a computer program may be implemented so as not to allow the reproduction of the sound source by deleting the reproduction allowable key when the session identifiers do not match.

In another embodiment, the computer device 200 may establish short-range wireless communication with the sub-device and load the sound source recorded in the local storage of the computer device 200 into memory. In this case, the computer device 200 may reproduce the sound source by transmitting the sound source recorded in the local storage and the reproduction instruction for the sound source to the sub-device via the established short-range wireless communication. The sub-device may also reproduce the sound source received from the computer device 200 according to the reproduction instruction and share the reproduction of the sound source with the computer device 200. At this time, as described above, the reproduction allowable key may be utilized also in this embodiment. For example, when a playback restriction function utilizing DRM (Digital Rights Management) technology is applied to a sound source recorded in the local storage of the computer device 200, the computer device 200 uses the above-mentioned playback allowable key to approach the sound source. It may be controlled so as to allow the sound source reproduction sharing of the sub device only for the range wireless communication. For example, the computer device 200 may request a playback allowable key from a server related to DRM technology by using a session identifier of short-range wireless communication established with a sub-device, and decode the sound source from the server. The reproduction allowable key generated by the combination of the conversion key and the session identifier may be received and transmitted to the sub-device. In this case, the sub-device is subject to the session identifier included in the playable key and the session identifier for short-range wireless communication established between the computer device 200, according to the control of the computer program installed and executed in the sub-device. May be compared to determine whether or not the sound source can be reproduced. For this purpose, both the computer program installed and executed in the computer device 200 and the computer program installed and executed in the subdevice may cooperate with the server associated with the DRM technology. As an example, the server may be a server that streams or downloads a sound source, and the computer program may be an application distributed by such a server.

In another embodiment, the computer device 200 may establish short-range wireless communication with the sub-device and confirm the sound source to share the reproduction with the sub-device. At this time, the confirmed sound source may include a multi-channel audio signal. In this case, the computer device 200 separates the multi-channel audio signal so that the computer device 200 and the sub-device can reproduce different channel signals of the multi-channel audio signal, and the audio signal of at least a part of the channels is sub. It is transmitted to the device, and the audio signal of the remaining some channels may be played by the main device. At this time, the sub-device may reproduce the surround sound by reproducing the received audio signal of a part of the channel. Further, in the present embodiment, the computer device 200 transmits to the sub-device based on the position of the sub-device and at least one of the output performance of the audio signal of the sub-device, as described with reference to FIGS. 6 to 9. The audio signal of the channel may be determined.

In each embodiment, in order to synchronize the reproduction time of the confirmed sound source, the computer device 200 may generate the reproduction time information of the confirmed sound source and transmit it to the sub-device. At this time, each of the computer device 200 and the sub-device may synchronize the reproduction time of the sound source by reproducing the sound source according to the reproduction time information.

For the contents omitted in the embodiment described with reference to FIG. 10, reference may be made to FIGS. 1 to 9.

As described above, according to the embodiment of the present invention, the sound source reproduction by the main device can be shared with at least one sub-device located in the same space or adjacent distance. Further, the surround sound can be output by sharing and outputting the channel of the multi-channel audio signal included in one sound source by the main device and at least one sub-device.

Also, even if many devices do not access and / or log in to the server, only one main device accesses the server and receives the sound source, and shares the playback of the sound source with each of the many devices. be able to.

Further, even if the sound source is allowed to be reproduced by only one user or one device, the reproduction of the corresponding sound source can be shared without the need for each of a large number of devices to communicate with the server.

The system or device described above may be implemented by a hardware component, a software component, or a combination of the hardware component and the software component. For example, the devices and components described in the embodiments include, for example, a processor, a controller, an ALU (arithmetic logic unit), a digital signal processor, a microprocessor, an FPGA (field programmable gate array), a PLU (programmable log unit), and a micro. It may be implemented using one or more general purpose computers or special purpose computers, such as a processor or various devices capable of executing and responding to instructions. The processing device may execute an operating system (OS) and one or more software applications running on said OS. The processing device may also respond to the execution of the software, access the data, store, manipulate, process, and generate the data. For convenience of understanding, one processor may be described as being used, but one of ordinary skill in the art may appreciate that the processor may include multiple processing elements and / or multiple types of processing elements. You can understand. For example, the processing device may include multiple processors or one processor and one controller. Other processing configurations, such as parallel processors, are also possible.

The software may include computer programs, code, instructions, or a combination of one or more of these, configuring the processing equipment to operate at will, or instructing the processing equipment independently or collectively. You may do it. Software and / or data is embodied in any type of machine, component, physical device, virtual device, computer storage medium or device to be interpreted based on the processing device or to provide instructions or data to the processing device. It may be converted. The software is distributed on a networked computer system and may be stored or executed in a distributed state. The software and data may be stored on one or more computer-readable recording media.

The method according to the embodiment may be implemented in the form of program instructions that can be executed by various computer means and recorded on a computer-readable medium. The computer-readable medium may include program instructions, data files, data structures, etc. alone or in combination. The program instructions recorded on the medium may be those specially designed and configured for the embodiment or may be usable known to those skilled in the art of computer software. Examples of computer-readable recording media include hard disks, floppy disks, and magnetic media such as magnetic tape, optical media such as CD-ROMs and DVDs, and optical magnetic media such as floptic discs. , And hardware devices specially configured to store and execute program instructions such as ROM, RAM, flash memory, and the like. Such a recording medium may be a variety of recording or storage means in the form of a combination of single or multiple hardware, and is not limited to the medium connected to a computer system, but on a network. It may be dispersed in the system. Examples of program instructions include not only machine language code, such as those generated by a compiler, but also high-level language code, which is executed by a computer using an interpreter or the like.

As described above, the embodiments have been described based on the limited embodiments and drawings, but those skilled in the art will be able to make various modifications and modifications from the above description. For example, the techniques described may be performed in a different order than the methods described, and / or components such as the systems, structures, devices, circuits described may be in a form different from the methods described. Appropriate results can be achieved even if they are combined or combined, or confronted or replaced by other components or equivalents.

Therefore, even if the embodiments are different, they belong to the attached claims as long as they are equal to the claims.

Claims (17)

A computer program recorded on a computer-readable recording medium that is combined with a computer to allow the computer to perform a sound source playback sharing method.
The sound source reproduction sharing method is
The stage where the main device establishes short-range wireless communication with at least one sub-device,
The step of confirming a sound source for which the main device intends to share playback with the at least one subdevice, and the establishment of the main device so that the confirmed sound source is played on the at least one subdevice. A computer program comprising the step of transmitting the confirmed sound source and a reproduction command for the confirmed sound source to the at least one subdevice to reproduce the confirmed sound source via the short-range wireless communication. The stage of confirming the sound source is
A segment file of the sound source is streamed from the server on which the sound source is recorded to the main device.
The stage of reproducing the confirmed sound source is
A segment file streamed from the server and a play instruction for the segment file are transmitted to the at least one subdevice via the established short-range wireless communication to play the streamed segment file.
The computer program according to claim 1. Further including a step of receiving a reproduction allowable key generated by the server from the server in order for the main device to allow reproduction sharing of the sound source via short-range wireless communication for the at least one sub-device. ,
The stage of reproducing the confirmed sound source is
The reproduction instruction including the reproduction allowable key is transmitted to the at least one subdevice together with the segment file.
The computer program according to claim 2. The stage of confirming the sound source is
The main device loads the sound source recorded in the local storage of the main device into the memory, and the sound source is loaded into the memory.
The stage of reproducing the confirmed sound source is
A sound source recorded in the local storage and a reproduction instruction for the sound source are transmitted to the at least one sub-device via the established short-range wireless communication to reproduce the sound source.
The computer program according to claim 1. The identified sound source includes a multi-channel audio signal and contains
The stage of reproducing the confirmed sound source is
The main device separates the multi-channel audio signal so that the main device and the at least one sub-device reproduce different channel signals of the multi-channel audio signal, and the audio signal of at least a part of the channels is the at least the above. The main device reproduces the audio signals of the remaining partial channels transmitted to one sub-device.
The computer program according to any one of claims 1 to 4. Further comprising the step of the main device communicating with the at least one subdevice based on the established short-range radio communication to identify the location of each of the at least one subdevice.
The stage of reproducing the confirmed sound source is
The main device separates the multi-channel audio signal by channel, and among the audio signals separated by the channel, the audio signal of the channel for transmission to the at least one sub-device is based on the identified position. decide,
The computer program according to claim 5. The main device further includes a step of confirming the output performance of the audio signal of the at least one sub device.
The stage of reproducing the confirmed sound source is
The main device separates the multi-channel audio signal for each channel, and among the audio signals separated for each channel, the output of the confirmed audio signal is the audio signal of the channel for transmission to the at least one sub-device. Determined based on performance,
The computer program according to claim 5. The stage of confirming the output performance of the audio signal is
The step of receiving profile information of the at least one subdevice from the at least one subdevice via the established short-range wireless communication.
The step of requesting the server for information on the output performance of the audio signal of the at least one sub-device using the received profile information, and the information on the output performance of the audio signal of the device corresponding to the profile information from the server. Including the stage of receiving
The computer program according to claim 7. The stage of reproducing the confirmed sound source is
In order to synchronize the reproduction time of the confirmed sound source with the main device and the at least one sub-device, the main device generates the reproduction time information of the confirmed sound source, and the generated reproduction time is generated. Information is transmitted to the at least one sub-device together with the confirmed sound source, and the confirmed sound source is reproduced at a time corresponding to the reproduction time point information.
The computer program according to any one of claims 1 to 8. The stage where the main device establishes short-range wireless communication with at least one sub-device,
The main device is established at the stage of confirming the sound source that the main device intends to play and share with the at least one subdevice, and so that the confirmed sound source is played by the at least one subdevice. A sound source reproduction sharing method including a step of transmitting the confirmed sound source and a reproduction command for the confirmed sound source to the at least one subdevice to reproduce the confirmed sound source via short-range wireless communication. .. The stage of confirming the sound source is
A segment file of the sound source is streamed from the server on which the sound source is recorded to the main device.
The stage of reproducing the confirmed sound source is
A segment file streamed from the server and a play instruction for the segment file are transmitted to the at least one subdevice via the established short-range wireless communication to play the streamed segment file.
The sound source reproduction sharing method according to claim 10. Further including a step of receiving a reproduction allowable key generated by the server from the server in order for the main device to allow reproduction sharing of the sound source via short-range wireless communication for the at least one sub-device. ,
The stage of reproducing the confirmed sound source is
The reproduction instruction including the reproduction allowable key is transmitted to the at least one subdevice together with the segment file.
The sound source reproduction sharing method according to claim 11. The stage of confirming the sound source is
The main device loads the sound source recorded in the local storage of the main device into the memory, and the sound source is loaded into the memory.
The stage of reproducing the confirmed sound source is
A sound source recorded in the local storage and a reproduction instruction for the sound source are transmitted to the at least one sub-device via the established short-range wireless communication to reproduce the sound source.
The sound source reproduction sharing method according to claim 10. The identified sound sources include multi-channel audio signals and
The stage of reproducing the confirmed sound source is
The main device separates the multi-channel audio signal so that the main device and the at least one sub-device reproduce different channel signals of the multi-channel audio signal, and the audio signal of at least a part of the channels is the at least the above. The main device reproduces the audio signals of the remaining partial channels transmitted to one sub-device.
The sound source reproduction sharing method according to any one of claims 10 to 13. Further comprising the step of the main device communicating with the at least one subdevice based on the established short-range radio communication to identify the location of each of the at least one subdevice.
The stage of reproducing the confirmed sound source is
The main device separates the multi-channel audio signal by channel, and among the audio signals separated by the channel, the audio signal of the channel for transmission to the at least one sub-device is based on the identified position. decide,
The sound source reproduction sharing method according to claim 14. The main device further includes a step of confirming the output performance of the audio signal of the at least one sub device.
The stage of reproducing the confirmed sound source is
The main device separates the multi-channel audio signal for each channel, and among the audio signals separated for each channel, the output of the confirmed audio signal is the audio signal of the channel for transmission to the at least one sub-device. Determined based on performance,
The sound source reproduction sharing method according to claim 14. A computer-readable recording medium, wherein a computer program for causing a computer to execute the method according to any one of claims 10 to 16 is recorded.

Images