KR102255156B1 - Device and method to manage plurality of music files - Google Patents

Abstract

A method of managing a plurality of music files includes extracting a plurality of fingerprints from each of a plurality of music files, grouping a plurality of music files into music file groups according to tempos of the plurality of music files, and And comparing fingerprints of music files belonging to at least one music file group among the music file groups to identify music files including the same audio data.

Description

Device and method for managing a plurality of music files TECHNICAL FIELD [DEVICE AND METHOD TO MANAGE PLURALITY OF MUSIC FILES]

The present invention relates to an apparatus and method for storing a plurality of music files, and more particularly, to an apparatus and method for managing a plurality of music files for a service provided to a user.

The music classification service may detect music signal characteristics of each music file, and create classification criteria in a database by referring to information associated with each music file such as a musician and a genre and the detected music signal characteristics. This classification criterion can be used for various services provided to users. For example, when a certain music file is specified, related music files may be provided according to the classification criteria.

In order to determine the music signal characteristics of each music file, a music recognition technique using an audio fingerprint may be used. The audio fingerprint can be extracted through various methods. For example, an audio fingerprint may be determined through a multiple hashing method (MLH) in which energy for each band is calculated according to frequency conversion and corresponding fingerprints are generated.

Meanwhile, new music contents are frequently created, and among these music contents, substantially the same as existing music contents may exist. For example, a recording album including music contents identical to existing music contents may be released. Although the new music content is the same as the existing music content, the user cannot know it until the new music content is played. For example, the user has to confirm that the new music content and the existing music content are identical to each other by checking information related to the new music content and the existing music content, and downloading and playing the corresponding music content.

The above-described content is only intended to aid in understanding the background art of the technical idea of the present invention, and therefore, it cannot be understood as the content corresponding to the prior art known to those skilled in the art of the present invention.

Embodiments of the present invention are to provide an apparatus and method capable of efficiently identifying music files including the same audio data. For example, music files containing the same audio data can be identified with reduced required time and resources as well.

A method of managing a plurality of music files according to an embodiment of the present invention includes: extracting a plurality of fingerprints from each of the plurality of music files; Grouping the plurality of music files into music file groups according to the tempos of the plurality of music files; And comparing fingerprints of music files belonging to at least one music file group among the music file groups to identify music files including the same audio data.

The grouping may include grouping music files having the same tempo into one music file group.

The music file groups include a first music file group including music files having a first tempo among the plurality of music files, and a second music file including music files having a second tempo among the plurality of music files Including a group, and identifying the same music files, when the second tempo is an integer multiple of the first tempo, fingerprints of the music files belonging to the first and second music file groups are compared with each other. Thus, it may include the step of identifying the music files including the same audio data.

The music file groups further include a third music file group including music files having a third tempo among a plurality of music files, and the step of identifying the same music files, wherein the third tempo is the first and When the second tempo is an integer multiple of at least one, the music files belonging to the third music file group are further compared with the music files belonging to the first and second music file groups to include the same audio data. It may include the step of identifying the music files.

The method may further include generating and storing metadata representing the music files including the same audio data.

Another aspect of the present invention relates to a computer device that manages a plurality of music files. The computer device includes: a database configured to store a plurality of music files; And at least one processor configured to communicate with the database. The at least one processor extracts a plurality of fingerprints from the plurality of music files, respectively; Determining tempos respectively corresponding to the plurality of music files; Among the music file groups in which the plurality of music files are grouped according to the tempos, fingerprints of music files belonging to a selected music file group are compared with each other to identify music files including the same audio data.

The at least one processor may be configured to determine the music file groups by grouping music files having the same tempo into one music file group.

The music file groups include a first music file group including music files having a first tempo among the plurality of music files, and a second music file including music files having a second tempo among the plurality of music files A group, and the at least one processor, when the second tempo is an integer multiple of the first tempo, compares the fingerprints of the music files belonging to the first and second music file groups with each other to obtain the same It may be configured to identify the music files containing audio data.

The at least one processor may be further configured to generate and store metadata representing the music files including the same audio data.

A computer device according to another embodiment of the present invention includes a database configured to store a plurality of music files; At least one processor configured to communicate with the database, wherein the at least one processor extracts a plurality of fingerprints from the plurality of music files, respectively; Determining tempos of the plurality of music files; It is configured to compare fingerprints of music files corresponding to tempos having an integer multiple relationship with each other to identify music files including the same audio data.

The at least one processor may be further configured to generate and store metadata representing the music files including the same audio data.

According to another embodiment of the present invention, a method of managing a plurality of music files includes: extracting a plurality of fingerprints from the plurality of music files; Grouping the plurality of music files into a plurality of music file groups according to tempos of the plurality of music files; Selecting music file groups corresponding to tempos having an integer multiple of the plurality of music file groups; And comparing fingerprints of music files belonging to the selected music file groups to identify music files including the same audio data.

According to embodiments of the present invention, an apparatus and method capable of efficiently identifying music files including the same audio data are provided. For example, music files containing the same audio data can be identified with reduced required time and resources as well.

1 is a block diagram showing a network system including a sound source management server.
2 is a block diagram illustrating a sound source management server according to an embodiment of the present invention.
3 is a table showing music file groups classified by tempo.
4 is a diagram for describing operations of generating meta data by a fingerprint comparator.
5 is a flowchart illustrating a method of operating a sound source management server according to an embodiment of the present invention.
6 is a block diagram showing an exemplary computer device suitable for implementing a sound source management server.

Hereinafter, preferred embodiments of the present invention will be described in detail with reference to the accompanying drawings. In the following description, it should be noted that only parts necessary to understand the operation according to the present invention will be described, and descriptions of other parts will be omitted so as not to obscure the subject matter of the present invention. In addition, the present invention is not limited to the embodiments described herein and may be embodied in other forms. However, the embodiments described herein are provided to explain in detail enough to be able to easily implement the technical idea of the present invention to those of ordinary skill in the art to which the present invention pertains.

Throughout the specification, when a part is said to be "connected" with another part, this includes not only "directly connected" but also "indirectly connected" with another element interposed therebetween. . The terms used herein are for describing specific embodiments and not for limiting the present invention. Throughout the specification, when a part "includes" a certain component, it means that other components may be further included rather than excluding other components unless specifically stated to the contrary. "At least any one of X, Y, and Z", and "at least any one selected from the group consisting of X, Y, and Z" means X one, Y one, Z one, or two of X, Y, and Z, or It can be interpreted as any combination beyond that (eg, XYZ, XYY, YZ, ZZ). Herein, "and/or" includes all combinations of one or more of the corresponding elements.

1 is a block diagram showing a network system including a sound source management server.

Referring to FIG. 1, the network system 100 may include a network 105, at least one user terminal 110, and a sound source management server 120.

Network system 100 may include a plurality of devices, servers, and/or software components that operate to perform various methods in accordance with embodiments of the present invention described herein. The devices and/or servers shown in FIG. 1 may be configured in different ways, and the operations and services provided by the devices and/or servers may be combined or separated for the embodiments described herein. And may be performed by a greater or lesser number of devices and/or servers. One or more devices and/or servers may be run and/or maintained by the same or different companies.

The network 105 connects components within the network system 100 such as the user terminal 110 and the sound source management server 120. The network 105 may include at least one of a public network, at least one private network, a wired network, a wireless network, another suitable type of network, and combinations thereof. Each of the user terminal 110 and the sound source management server 120 may include at least one of a wired communication function and a wireless communication function, and thus may communicate with each other through the network 105.

The user terminal 110 may communicate with the sound source management server 120 through the network 105 to perform operations for using a service provided by the sound source management server 120. For example, the user terminal 110 accesses web pages of the sound source management server 120, registers a user account with the sound source management server 120, and transmits a search word to the sound source management server 120 to store music. Among the files, music files corresponding to the search word and/or information related thereto may be requested.

In embodiments, the user terminal 110 is a computer, UMPC (Ultra Mobile PC), workstation, net-book, PDA (Personal Digital Assistants), portable (portable) computer, web tablet (web tablet), wireless Transmit and receive information such as wireless phone, mobile phone, smart phone, e-book, portable multimedia player (PMP), and portable game console in wired and/or wireless environments It may include a device that is capable of.

The sound source management server 120 may include a database 121 configured to store a plurality of music files. However, the technical idea of the present invention is not limited thereto. At least a part of the database 121 may be separated from the sound source management server 120, and in this case, the sound source management server 120 may communicate with the database 121 through the network 105.

The sound source management server 120 communicates with the user terminal 110 through the network 105. The sound source management server 120 may provide a selected music file from among music files stored in the database 121 in response to a request from the user terminal 110. The database 121 may further store information related to music files such as titles, musicians, genres, and sound quality of each music file. The sound source management server 120 may provide related information stored in the database 121 in response to a request from the user terminal 110. For example, when receiving a search word from the user terminal 110, the sound source management server 120 searches for music files corresponding to the search word among music files stored in the database 121, and retrieves related information of the searched music files. It can be provided to the user terminal 110.

Some of the music files stored in the database 121 may be music files including the same audio data. When duplicate music files are stored in the database 121 as described above, duplicate music files and/or related information thereof may be provided to the user terminal 110 in response to a search word from the user terminal 110. This means that unnecessary data and/or signals are transmitted to the user terminal 110 through the network 105, and accordingly, resources of the network 105, the user terminal 110, and the sound source management server 120 will be wasted. I can.

According to embodiments of the present invention, the sound source management server 120 is configured to identify music files including the same audio data among music files stored in the database 121. Depending on the identification result, the sound source management server 120 is a user of music files (ie, non-overlapping music files) and/or their associated information including different music data in response to the search word from the user terminal 110. It can be provided to the terminal 110.

2 is a block diagram illustrating a sound source management server according to an embodiment of the present invention.

Referring to FIG. 2, the sound source management server 200 includes a communication unit 205, a controller 210, a communication interface 220, a storage medium 230, and a sound source management device 240.

The communicator 205 may communicate with the user terminal 110 (see FIG. 1) through the network 105 (see FIG. 1) in response to the control of the controller 210. The communication unit 205 may include at least one of a wired communication function and a wireless communication function, and the controller 210 may communicate with the user terminal 110 through the communication unit 205.

The controller 210 controls all operations of the sound source management server 200. The controller 210 is connected to the storage medium 230 through the communication interface 220. The controller 210 is configured to read data stored in the storage medium 230 through the communication interface 220 and transmit the read data to the user terminal 110 through the communication unit 205. The controller 210 may provide the music files MF stored in the storage medium 230 and/or the related information MI of the music files MF to the user terminal 110.

The storage medium 230 further stores meta data MD corresponding to the music files MF. The metadata MD includes information for identifying music files including the same music data among the music files MF. For example, the meta data MD may correspond to music files MF, respectively, and meta data of music files including the same music data may have the same value. The controller 210 may provide music files including different music data to the user terminal 110 and/or related information thereof to the user terminal 110 with reference to the metadata MD, and thus the same music Music files including data (ie, duplicate music files) may not be provided to the user terminal 110.

The communication interface 220 provides a communication interface for connecting the storage medium 230 to the controller 210 and the sound source management device 240. In embodiments, components of the system bus included in the sound source management server 200 may be provided as the communication interface 220.

The storage medium 230 may be provided as the database 121 of FIG. 1. The storage medium 230 is configured to store music files MF, related information MI, and meta data MD. In embodiments, each music file may include at least some of the relevant information. The metadata MD is generated by the sound source management device 240 and stored in the storage medium 230. The storage medium 230 may be a non-volatile storage device.

The sound source management device 240 may operate in response to control signals from the controller 210. The sound source management device 240 is connected to the storage medium 230 through the communication interface 220. The sound source management apparatus 240 includes a fingerprint generator 241, a tempo generator 242, and a fingerprint comparator 243.

The fingerprint generator 241 is configured to extract audio fingerprints AFP from the music files MF, respectively, and provide the extracted audio fingerprints AFP to the fingerprint comparator 243. In embodiments, the audio fingerprints AFP may be stored in the storage medium 230 and then read from the storage medium 230 by the fingerprint comparator 243.

In embodiments, a plurality of audio fingerprints may be extracted from one music file. In this case, a plurality of audio fingerprints may be mapped to a corresponding music file as an audio fingerprint set. For example, by adjusting the sampling rate, the number of audio fingerprints extracted from one music file can be changed.

The tempo generator 242 is configured to calculate tempos TP corresponding to each of the music files MF and provide the tempos TP to the fingerprint comparator 243. In embodiments, the tempos TP may be stored in the storage medium 230 and then read from the storage medium 230 by the fingerprint comparator 243. The tempo of each music file can be determined according to various methods. For example, the tempo generator 242 may extract a spectrum from a music file and extract energy from the spectrum to determine the tempo of the music file. In embodiments, the tempo of the music file may be determined as a value representing beat per minute (bpm). For example, the tempo of a music file may be Z bpm (Z is a real number greater than 0).

The fingerprint comparator 243 is configured to group the music files MF into music file groups according to the tempos TP. The fingerprint comparator 243 may group music files MF having the same tempo into one music file group. Further, the fingerprint comparator 243 is configured to compare audio fingerprints of music files belonging to each music file group with each other to identify music files including the same audio data. The fingerprint comparator 243 may identify music files having the same audio fingerprint.

The fingerprint comparator 243 may store meta data MD indicating an identification result. For example, the meta data MD may correspond to the music files MF, respectively, and the fingerprint comparator 243 may update meta data of music files including the same music data to have the same value. .

If the audio fingerprints AFP of all the music files MF are compared with each other regardless of the music file group, a considerable amount of time and resources may be required. For example, when performing operations for comparing each audio fingerprint with all other audio fingerprints, a considerable amount of time and resources may be required.

The probability that music files having the same tempo contain the same audio data will be relatively higher than that of music files having different tempos. According to embodiments of the present invention, music files MF are grouped into music file groups according to tempos TP, and audio fingerprints of music files belonging to each music file group are compared with each other to obtain the same audio data. Identify the music files it contains. Accordingly, time and resources required to identify music files including the same audio data using the audio fingerprints AFP may be reduced.

3 is a table showing music file groups classified by tempo.

Referring to FIG. 3, first to nth music file groups MFG1 to MFGn correspond to first to nth tempos TP1 to TPn, respectively. The first to nth tempos TP1 to TPn may be different from each other. For example, the first tempo TP1 may be 60 bpm, the second tempo TP2 may be 120 bpm, the third tempo TP3 may be 180 bpm, and the n-th tempo TPn may be 80 bpm.

Each of the first to nth music file groups MFG1 to MFGn includes music files of the same tempo. For example, the first music file group MFG1 includes first music files MF11 to MF1m having a first tempo TP1.

An audio fingerprint is extracted from each music file by a fingerprint generator 241 (refer to FIG. 2). The extracted audio fingerprint is mapped to the corresponding music file. In FIG. 3, the first audio fingerprints AFP11 to AFP1m are shown to be mapped to the first music files MF11 to MF1m, respectively.

4 is a diagram for describing operations of generating meta data by a fingerprint comparator.

Referring to FIG. 4, the fingerprint comparator 243 may receive audio fingerprints of one or more music file groups (S110 ). The fingerprint comparator 243 may select music file groups corresponding to tempos having an integer multiple relationship, and may receive music files of the selected music file groups. For example, as illustrated in FIG. 3, when the first to third tempos TP1 to TP3 are 60 bpm, 120 bpm, and 180 bpm, respectively, the first to third tempos TP1 to TP3 are They have an integral multiple of each other. In this case, the fingerprint comparator 243 includes first audio fingerprints AFP11 to AFP1m corresponding to the first music file group MFG1 and second audio fingerprints corresponding to the second music file group MFG2. (AFP21 to AFP2p) and third audio fingerprints AFP31 to AFP3q corresponding to the third music file group MFG3 may be received.

The fingerprint comparator 243 compares the received audio fingerprints with each other to identify music files including the same audio data (S120). Music files having the same audio fingerprint may include the same audio data.

The fingerprint comparator 243 updates the meta data MD to include the identification result (S130). The fingerprint comparator 243 includes first metadata MD11 to MD1m corresponding to music files of the first music file group MFG1, and second metadata corresponding to music files of the second music file group MFG2. The meta data MD21 to MD2p and the third meta data MD31 to MD3q corresponding to the music files of the third music file group MFG3 may be updated. For example, the fingerprint comparator 243 allows the metadata corresponding to the music files including the same audio data among the music files of the first to third music file groups MFG1 to MFG3 to have the same value. Can be updated.

Even if the music files have the same audio data, the tempo generator 242 may determine that the music files are different, but have an integer multiple relationship with each other.

The tempo (eg, beats per minute) is determined according to the beat, and the tempo of the corresponding music file may vary depending on how the tempo generator 242 defines the reference beat of each music file. For example, the tempo generator 242 may determine the tempo by calculating how many single beats per minute are included according to the implementation example. On the other hand, the tempo generator 242 may determine the tempo by calculating how many counteracts per minute are included according to the implementation example. When considering the reliability of the tempo generator 242, it can be expected to define one of the beats having a relationship of integer multiples as a reference beat. In this case, when the reference beat defined by the tempo generator 242 changes, the tempo may increase or decrease by an integer multiple.

According to an embodiment of the present invention, the fingerprint comparator 243 selects music file groups corresponding to tempos having an integer multiple relationship, compares audio fingerprints of the selected music file groups to each other, and includes the same audio data. Music files can be identified. That is, audio fingerprints of music files corresponding to tempos having an integer multiple relationship may be compared with each other to identify music files including the same audio data. Accordingly, the fingerprint comparator 243 may identify music files including the same audio data even if they belong to different music file groups. Accordingly, the sound source management apparatus 200 having improved reliability in identifying music files including the same audio data among the music files MF may be provided.

5 is a flowchart illustrating a method of operating a sound source management server according to an embodiment of the present invention.

1 and 5, in step S210, a plurality of audio fingerprints are extracted from a plurality of music files stored in the database 121, respectively. In embodiments, a plurality of audio fingerprints may be extracted from one music file. In this case, a plurality of audio fingerprints may be mapped to a corresponding music file as one audio fingerprint set.

In step S220, a plurality of music files are grouped into music file groups according to the tempos of the plurality of music files. Each music file group may include music files having the same tempo. Step S220 may be performed before step S210.

In step S230, audio fingerprints of music files belonging to the selected music file group are obtained. In embodiments, one group of music files may be selected. In embodiments, music file groups corresponding to tempos having an integer multiple relationship may be selected.

In step S240, the obtained audio fingerprints are compared to identify identical music files. Music files having the same audio fingerprint may include the same audio data.

In step S250, metadata is generated (or updated) in association with the identified music files. The metadata includes information for identifying music files containing the same music data. In embodiments, meta data corresponding to each of the identified music files may be updated to have the same value.

According to embodiments of the present invention, music files are grouped into music file groups according to tempos, and audio fingerprints of music files belonging to at least one music file group are compared with each other to obtain music files including the same audio data. Identify. Accordingly, time and resources required to identify music files including the same audio data using audio fingerprints can be reduced.

6 is a block diagram showing an exemplary computer device suitable for implementing a sound source management server.

Referring to FIG. 6, the computer device 1000 includes a bus 1100, at least one processor 1200, a system memory 1300, a storage medium 1400, and a communicator 1500.

The bus 1100 is connected to various components of the computer device 1000 to transmit data, signals, and information. The processor 1200 may be either a general purpose or a dedicated processor, and may control all operations of the computer device 1000. At least some of the components of the bus 110 may function as the communication interface 220 of FIG. 2.

When executed, the processor 1200 loads program codes and instructions that provide various functions into the system memory 1300 and is configured to process the loaded program codes and instructions. For example, the system memory 1300 may be provided as a working memory of the processor 1200.

As an embodiment, the system memory 1300 may include at least one of a random access memory (RAM), a read only memory (ROM), and another type of computer readable medium.

The processor 1200 includes a control module 1310 that provides functions of the controller 210 of FIG. 1 when executed by the processor 1200, and the sound source management apparatus 240 of FIG. 1 when executed by the processor 1200. The sound source management module 1320 providing functions may be loaded into the system memory 1300. Such program codes and/or instructions may be executed by the processor 1200 to function as the controller 210 and the sound source management device 240 described with reference to FIGS. 2, 3, and 4. In addition, the system memory 1300 may further include program codes and instructions that provide one or more additional functions when executed by the processor 1200.

Program codes and/or instructions to be loaded into the system memory 1300 may be loaded from the storage medium 1400, which is a recording medium readable by a separate computer. Program codes and instructions may be loaded into the system memory 1300 from an external device of the computer device 1000 through the communicator 1500. Furthermore, the storage medium 1400 may function as the storage medium 230 of FIG. 2 or the database 121 of FIG. 1. In this case, the storage medium 1400 may store music files MF, related information MI, and meta data MD of FIG. 2.

As an embodiment, the storage medium 1400 may include various types of nonvolatile storage media that maintain stored data even when power is cut off, for example, a flash memory, a hard disk, and the like. .

The communicator 1500 (or transceiver) transmits and receives signals between the computer device 1000 and other devices in the network system 100 (refer to FIG. 1) through the network 105. The communicator 1500 may function as the communicator 205 of FIG. 2.

Although specific embodiments and application examples have been described herein, these are provided only to help a more general understanding of the present invention, and the present invention is not limited to the above embodiments, and those skilled in the art to which the present invention pertains As it grows, various modifications and variations are possible from this description.

Therefore, the spirit of the present invention is limited to the described embodiments and should not be defined, and all things that are equivalent or equivalent to the claims as well as the claims to be described later fall within the scope of the spirit of the present invention. .

200: sound source management server
210: controller
220: communication interface
230: storage medium
240: sound source management device

Claims (12)

In how to manage multiple music files:
Extracting a plurality of fingerprints from the plurality of music files, respectively;
Grouping the plurality of music files into music file groups according to tempos of the plurality of music files; And
And comparing fingerprints of music files belonging to at least one music file group among the music file groups to identify music files containing the same audio data. The method of claim 1,
The grouping includes grouping music files having the same tempo into one music file group. The method of claim 2,
The music file groups include a first music file group including music files having a first tempo among the plurality of music files, and a second music file including music files having a second tempo among the plurality of music files Includes groups,
The identifying of the same music files may include comparing fingerprints of the music files belonging to the first and second music file groups to each other when the second tempo is an integer multiple of the first tempo, and the same audio data A method comprising the step of identifying the music files comprising a. The method of claim 3,
The music file groups further include a third music file group including music files having a third tempo among a plurality of music files,
The step of identifying the same music files may include, when the third tempo is an integer multiple of at least one of the first and second tempos, the music files belonging to the third music file group are included in the first and second music files. And identifying the music files containing the same audio data by further comparing them with the music files belonging to groups of files. The method of claim 1,
And generating and storing metadata representing the music files including the same audio data. A database configured to store a plurality of music files;
Including at least one processor configured to communicate with the database,
The at least one processor,
Extracting a plurality of fingerprints from the plurality of music files, respectively;
Determining tempos respectively corresponding to the plurality of music files;
And comparing fingerprints of music files belonging to a selected music file group among music file groups in which the plurality of music files are grouped according to the tempo, to identify music files including the same audio data. The method of claim 6,
The at least one processor is configured to determine the music file groups by grouping music files having the same tempo into one music file group. The method of claim 6,
The music file groups include a first music file group including music files having a first tempo among the plurality of music files, and a second music file including music files having a second tempo among the plurality of music files Includes groups,
The at least one processor includes the same audio data by comparing fingerprints of the music files belonging to the first and second music file groups when the second tempo is an integer multiple of the first tempo. A computer device configured to identify the music files. The method of claim 6,
The at least one processor is further configured to generate and store metadata representing the music files including the same audio data. A database configured to store a plurality of music files;
Including at least one processor configured to communicate with the database,
The at least one processor,
Extracting a plurality of fingerprints from the plurality of music files, respectively;
Determining tempos of the plurality of music files;
A computer apparatus configured to identify music files including the same audio data by comparing fingerprints of music files corresponding to tempos having an integer multiple of relationship with each other. The method of claim 10,
The at least one processor is further configured to generate and store metadata representing the music files including the same audio data. In the method of managing a plurality of music files:
Extracting a plurality of fingerprints from the plurality of music files, respectively;
Grouping the plurality of music files into a plurality of music file groups according to tempos of the plurality of music files;
Selecting music file groups corresponding to tempos having an integer multiple of the plurality of music file groups; And
And comparing fingerprints of music files belonging to the selected music file groups to identify music files containing the same audio data.

Images