KR102450361B1 - Method for providing navigation service using music information visualization method and navigation device - Google Patents

Abstract

According to one embodiment of the present invention, a navigation device providing a navigation service by using a music information visualization method, which enables a user to intuitively recognize information on various attributes included in music, may include: a driving route generation unit which generates driving route information based on information on going to a destination input by a user; a display unit in which the driving route information is displayed; a recommended music list generation unit which generates a recommended music list corresponding to the driving route information based on the input information input by the user and the driving route information; a music information generation unit which analyzes music in the recommended music list to generate music information for each attribute included in the music; a visual information generation unit which maps a figure to express properties of the attribute according to a predetermined mapping method, and generates visual information including relative size information on a numerical value included in the music information with a method of changing at least one of the size of the figure, the length, the thickness, and a color; and a control unit displaying a music visualization list, in which the visual information is matched the music in the recommended music list and is displayed, on a display unit with the driving route information together.

Description

Method for providing navigation service using music information visualization method and navigation device

The present invention relates to a navigation service providing method and a navigation device using a music information visualization method. More specifically, the present invention provides a navigation route guidance service using visualized information so that a user can intuitively recognize information on various properties of music. It is an invention related to the technology that is provided to users with

With the development of technology, existing large-capacity media can be digitized and converted into low-capacity media. Today, users can store various types of media in a portable user terminal device, select the desired media and enjoy it conveniently while on the go. became possible In addition, media digitized through digital compression technology enables media sharing between users on a network, thereby activating online media services explosively, and many related applications and programs are being developed.

Music accounts for a significant portion of this vast amount of media, and it has a low capacity compared to other media types and has a low communication load, so it is easy to support real-time streaming services, which gives high satisfaction to both service providers and users. Accordingly, services that provide online music to users in various ways are now emerging.

Existing online music services simply provide sound sources to users connected online in real time by providing sound sources to user terminal devices or streaming services. It provides a service that recommends media with high preference to users.

However, the recommendation method in the current online music service is a method of generating a music chart by simply counting the number of sound sources purchased, listened to, or searched by a user, and recommending it based on this. This is a method of recommending music based on criteria, ignoring diversity and variability in user preferences. In addition, since this recommendation method recommends music based on the accumulated number of accesses, the volatility of the music chart is low, and the previously recommended music and the currently recommended music mostly overlap, which greatly reduces the effectiveness.

In addition, when music is recommended in this way, since the user does not know how the music is recommended, the user can know whether the recommended music is the user's favorite music only when the user actually listens to the music due to the characteristics of the music. That is, there is a problem in that a lot of time is consumed because information about the genre of the recommended music, the tempo, and the structure of the music can be known only when the user listens to the end.

A method and apparatus for providing a music information visualization service according to an embodiment and a navigation system including the same are inventions designed to solve the above-described problems, and the information about music can be viewed at a glance without the user directly listening to the music or reading the description. The purpose is to make it intuitively recognizable.

Specifically, by providing the user with information visually displayed using figures for the numerical values analyzed for various properties of music, the user can intuitively know information about the various properties of music at a glance. The purpose is to make it possible.

In addition, the navigation system according to an embodiment recommends various music suitable for a driving route to the user based on driving information of the vehicle and various information of the user and passengers, and at the same time responds to the information on the recommended song to the driving route The purpose is to enable the user to intuitively recognize it.

A navigation device for providing a navigation service using a method for visualizing music information according to an embodiment includes a driving route generator configured to generate driving route information based on information from a user to a destination inputted by a user, and displaying the driving route information. A display unit, a recommended music list generator for generating a recommended music list corresponding to the driving route information based on input information input by a user and the driving route information, and analyzing music existing in the recommended music list, the music A music information generating unit that generates music information for each attribute possessed, maps a figure representing the property of the attribute according to a predetermined mapping method, and transforms at least one of size, length, thickness, and color of the figure a visual information generating unit for generating visual information including relative size information with respect to numerical values included in the music information, and music visualization displaying the visual information in correspondence with music present in the recommended music list It may include a control unit for displaying the list together with the driving route information on the display unit.

The driving route information may include at least one of information on an expected average moving speed for each section to the destination, information on the destination, information on a route environment to the destination, information on a current time, and information on current weather. may include.

The control unit provides the user with an interface through the display unit that allows the user to change the order of the music present in the music visualization list to the user through the display unit, and allows the user to change the order of the music present in the music visualization list is changed, a music visualization list according to the changed order may be displayed on the display unit.

The control unit may classify the driving route in consideration of the playback order and replay time of the music present in the music visualization list, and display it on the display unit.

A method of providing a navigation service using a method of visualizing music information according to an embodiment comprises the steps of analyzing music existing in a music list, generating music information for each attribute of the music, and determining that the attribute is determined according to a predetermined mapping method. Creating visual information including relative size information with respect to numerical values included in the music information by mapping a figure to express its properties and transforming at least one of the size, length, thickness, and color of the figure Step, generating music visualization information displayed by matching the visual information to music existing in the music list, and generating driving route information based on information from a user to a destination, and then adding the visual information to the and displaying a music visualization list displayed in correspondence to music present in the music list together with the driving route information on a display unit, wherein the figure is at least one of a triangle, a rectangle, a pentagon, a hexagon, a circle, an ellipse, and an arc. Including one, and the properties are, the size of the RMS (Root Mean Square) of the music, the type of the genre, the degree of the mood, the degree of the tempo, the vocal in the music It may include at least one of the specific gravity of (Vocal) and the overall structure of the music.

A method and apparatus for providing a music information visualization service according to an embodiment visually display information about the relative sizes of various attributes of music using a figure, so that a user can see at a glance various attributes of music. There is an advantage of being able to know information intuitively.

In addition, since the navigation system according to an embodiment provides the driver with a music visualization list including visual information on music corresponding to the driving route along with the driving route, the driver intuitively provides information on music to be played in the future. There is an effect of knowing without interruption of driving.

1 is a block diagram illustrating some components of a system for providing a music information visualization service according to an embodiment of the present invention.
2 is a block diagram illustrating some components of an apparatus for providing a music information visualization service according to an embodiment of the present invention.
3 is a diagram illustrating a diagram representing the size of an RMS of music according to an embodiment of the present invention.
4 is a diagram illustrating a diagram representing a degree of a tempo of music according to an embodiment of the present invention.
FIG. 5 is a diagram illustrating the degree of the proportion occupied by a vocal in music according to an embodiment of the present invention.
6 is a diagram illustrating an HSL system as a reference for mapping genres of music according to an embodiment of the present invention.
7 is a diagram illustrating a diagram in which information on a music mood is mapped based on saturation and brightness according to an embodiment of the present invention.
8 is a diagram illustrating various examples of visual information generated by a visual information generating unit according to an embodiment of the present invention.
9 is a view showing information on the structure of music and visual information including the information according to an embodiment of the present invention.
10 is a diagram illustrating a dynamic example of visual information generated according to an embodiment of the present invention.
11 is a diagram illustrating a screen on which visual information is displayed in a music list according to an embodiment of the present invention.
12 is a diagram illustrating a screen on which visual information is displayed by overlapping image information of music existing in a music list according to an embodiment of the present invention.
13 and 14 are diagrams illustrating screens displayed on a user terminal device according to an embodiment of the present invention.
15 is a block diagram illustrating some components of a navigation system according to an embodiment of the present invention.
16 is a diagram illustrating a screen displayed on a display unit according to an embodiment of the present invention.
17 is a diagram illustrating a method for a user to change the order of music according to an embodiment of the present invention.
18 is a diagram illustrating a screen displayed on a display unit according to another embodiment of the present invention.

Hereinafter, embodiments according to the present invention will be described with reference to the accompanying drawings. In adding reference numerals to the components of each drawing, it should be noted that the same components are given the same reference numerals as much as possible even though they are indicated on different drawings. In addition, in describing the embodiment of the present invention, if it is determined that a detailed description of a related known configuration or function interferes with the understanding of the embodiment of the present invention, the detailed description thereof will be omitted. In addition, embodiments of the present invention will be described below, but the technical spirit of the present invention is not limited thereto or may be variously implemented by those skilled in the art.

In addition, the terms used herein are used to describe the embodiments, and are not intended to limit and/or limit the disclosed invention. The singular expression includes the plural expression unless the context clearly dictates otherwise.

In the present specification, terms such as "comprises", "comprises" or "have" are intended to designate that the features, numbers, steps, operations, components, parts, or combinations thereof described in the specification exist, but one It does not preclude in advance the possibility of the presence or addition of other features or numbers, steps, actions, components, parts, or combinations thereof, or other features.

In addition, throughout the specification, when a certain part is said to be "connected" with another part, it is not only "directly connected" but also "indirectly connected" with another element interposed therebetween. Including, terms including an ordinal number, such as "first", "second", etc. used herein may be used to describe various elements, but the elements are not limited by the terms.

Hereinafter, with reference to the accompanying drawings, the embodiments of the present invention will be described in detail so that those skilled in the art can easily carry out the embodiments of the present invention. And in order to clearly explain the present invention in the drawings, parts irrelevant to the description will be omitted.

1 is a block diagram illustrating some components of a system for providing a music information visualization service according to an embodiment of the present invention.

Referring to FIG. 1 , a system 1 for providing a music information visualization service according to an embodiment may include a plurality of user terminal devices 300a and 300b , a vehicle 400 , and an apparatus 100 for providing a music information visualization service. In addition, the music information visualization service providing apparatus 100 may be operated in communication with a plurality of user terminal devices 300a and 300b and a plurality of vehicles 400 .

The music information visualization service providing apparatus 100 generates a recommended music list based on information received from the user terminal device 300 or the vehicle 400, generates visual information about music in the recommended music list, and generates the generated music information. The visual information may be transmitted to the plurality of user terminal devices 300 and the vehicle 400 together with the recommended music list.

Accordingly, the apparatus 100 for providing a music information visualization service may be implemented as a device capable of providing a music information visualization service to a user, generally a server.

A server means a normal server. The server is computer hardware on which a program is executed, and monitors and controls the entire network such as printer control or file management, or connects to other networks through mainframes or public networks, Sharing software resources such as data, programs, files, or modems, fax machines, or printers. It can support sharing of hardware resources such as other equipment.

Such a server can manage the Internet homepage corresponding to the URL by mounting an app related to the online commerce brokerage system and connecting to the user terminal device 300 and the vehicle 400 through a network, respectively.

The user terminal device 300 accesses the music information visualization service providing apparatus 100 according to the user's control, and receives information about the music desired by the user, or the music information visualization service providing apparatus 100 recommends music to the user. To create a list, you can enter personal information about the user and various information about the music the user likes.

Accordingly, the user terminal device 300 may include a mobile terminal device capable of accessing the music information visualization service providing apparatus 100 through a dedicated application or a general application, but generally includes a computing device.

In FIG. 1 , as an example, the user terminal device 300 is illustrated as a smart phone (Smartphone, 300a) and a laptop (Laptop, 300b), but devices that may be included in the user terminal device 300 include a personal computer (PC), a GSM. (Global System for Mobile communication), PDC (Personal Digital Cellular), PHS (Personal Handyphone System), PDA (Personal Digital Assistant), IMT (International Mobile Telecommunication)-2000, CDMA (Code Division Multiple Access)-2000, W- All devices such as CDMA (W-Code Division Multiple Access), Wibro (Wireless Broadband Internet) terminal, smartpad, tablet PC, smart watch, smart glass, wearable device, etc. A type of handheld-based wireless communication device may be included.

In addition, although the number of user terminal devices 300 is described as a limited number due to space limitations in FIG. 1 , the present invention is not limited thereto, and a plurality of user terminal devices may be included in the music information service providing system 1 . have.

The vehicle 400 accesses the music information visualization service providing apparatus 100 according to the user's control, and receives information on the music desired by the user, or the music information visualization service providing apparatus 100 provides a music recommendation list for the user. In order to generate , various information about the user's personal information and the user's favorite music may be transmitted to the music information visualization service providing apparatus 100 .

Specifically, the vehicle 400 may access the music information visualization service providing apparatus 100 using the navigation device 200 or the communication unit 210 of the vehicle 400 . The navigation device 200 may be implemented as a component included in the component of the vehicle 400 , or may be implemented as a component independent of the vehicle 400 . That is, the network may be implemented as a portable terminal capable of accessing the music information visualization service providing device 100 , and the portable terminal includes a smart pad, a tablet PC, a smart watch, and a smart glass. , and all types of handheld-based wireless communication devices such as wearable devices may be included.

2 is a block diagram illustrating some components of the apparatus 100 for providing a music information visualization service according to an embodiment.

Referring to FIG. 2 , the apparatus 100 for providing a music information visualization service may include a music list generator 110 , a music information generator 120 , a visual information generator 130 , and the like.

The music list generator 110 may generate a music list for the music selected by the user, or may generate a recommended music list for recommending music to the user based on the user's input information.

The music selected by the user may be the title of a song directly input by the user, or may be music for a specific genre or artist selected by the user. The music list generator 110 may provide the music list to the user by generating the music selected by the user as one list.

The recommended music list means a list of recommended music that analyzes a user's taste based on input information input by the user and recommends music to the user based on this. may include at least one of information on the tempo of the song, the title of the music, the title of the album, and the name of the artist.

In addition, the music list in the present invention does not necessarily mean only a music list that is generated only when there is a user's specific input information. Music displayed on the screen every time it is changed is also regarded as a music list, and the principles of the present invention can be applied to music displayed on the screen.

Accordingly, the music list generating unit 110 may generate a recommended music list based on the input information. Specifically, the music included in the input information, a genre, a mood, and an instrument ), vocal (vocal), sample (sample), and rhythm (rhythm), including music similar to at least one may be generated.

For example, when generating a recommended music list based on a genre, the music list generator 110 determines a genre preferred by the user based on input information input by the user, and a genre similar to the user's preferred genre. can be included in the recommended music list, and when the recommended music list is generated based on the rhythm, the user's preferred rhythm is determined based on the input information input by the user, and the user's preferred rhythm is included. You can include the music you are playing in the recommended music list.

In addition, in generating the recommended music list, when the user is a driver, the music list generator 110 may generate the recommended music list by synthesizing the tendencies of the driver and the passenger and the route to the destination.

Specifically, the music list generating unit 110 includes basic personal information such as gender and age of the driver and passengers, as well as information on the expected average moving speed for each section to the destination, information on the destination, and information on the route environment to the destination. , information on the current time and information on the current weather may be received through the communication unit 210 of the navigation device 200 , and a recommended music list may be generated based on the received information.

For example, if the destination is city X, a song related to city X may be included in the recommended music list, and if it is late in the evening when it rains during driving time, music related to the environment may be included in the recommended music list.

The music information generation unit 120 analyzes music existing in the music list generated by the music list generation unit 110 and includes a numerical value that can express the relative size of each attribute of the music. You can create music information.

The properties analyzed by the music information generation unit 120 for music are RMS (Root Mean Square), Tempo, Genre, Mood, overall structure, and vocal in the music. (Vocal) may include specific gravity and the like.

For example, if there is music with artist A - song title B in the music list, the music information generating unit 120 analyzes the music with song title B, and determines the size of the RMS and the degree of tempo. It is possible to generate information about what kind of music it is, what proportion of vocals in the whole music, what genre the music has, what the mood level is, and how the overall structure of the music progresses.

RMS is an abbreviation of Root Mean Square, which indicates the effective output. That is, the RMS means the overall energy value of the music, and the numerical value of the RMS size may be output between 0 and 1. When it is determined that the energy of the music is high, a value close to 1 may be output, and when it is determined that the energy is low, a value close to 0 may be output.

Tempo means information on the speed of music, and may be generally expressed as beats per minute (BPM) information in which the speed of music is expressed as a number. Therefore, the numerical value for tempo can be calculated as a value between 0 and about 250 based on the BPM. A larger numerical value means faster music, and a lower numerical value means slower music. .

The proportion of vocals refers to the proportion of vocals in music. The numerical value for the proportion of vocals can be calculated from 0 to 1. The closer to 1, the higher the proportion of vocals in the music and the lower the proportion of performance parts. It means that the proportion is low and the proportion occupied by the vocals is high.

Genre is information about the type of music to be analyzed. Specifically, genres are metal, rock, latin, folk, new age, Includes jazz, blues, electronic, pop, hip-pop, reggae, and the like. The music information generating unit 120 may analyze the music and determine which genre the music belongs to among the above-described genres, and as will be described later in FIG. 3 , the numerical values for each genre are set from 0 degrees to 360 degrees by the HSL color system. It may be calculated as one of the values between the figures.

The mood is information about the emotion of music, and includes arousal information indicating the intensity of emotion and valence information meaning information about positive/negative emotions. It can be output as a pair of numeric values.

The numerical value of arousal value and the numerical value of valence value each have a range between 0 and 1, and when it is judged that the analyzed music has high arousal, the numerical value approaches 1, and when it is judged that it has low arousal Its numerical value approaches zero. For valence information, if it is determined that the analyzed music has a high valence, the numerical value approaches 1, and when it is determined that the music to be analyzed has a low valence, the numerical value approaches 0.

The visual information generating unit 130 maps the figure expressing the properties of the properties described above, and the size of the figure so that the user can visually see at a glance how much value the music has for each property; By changing at least one of length, thickness, and color, visual information including relative size information with respect to a numerical value of each attribute included in the music information may be generated.

A figure expressing the properties of the properties described above may be mapped according to a predetermined criterion. Specifically, the size of the RMS of music is mapped to the thickness of the concentric circles, and the degree of tempo of the music can be mapped to the length of an arc disposed in one of the outer quadrants of the outer circumferential surface of the concentric circles. Among the outer quadrants of the outer circumferential surface of the concentric circle, the arc length may be mapped to a length of an arc disposed in another quadrant except for one of the quadrants in which an arc matching the tempo is located. The types of music genres are mapped to concentric circle colors, the degree of music mood can be mapped to the color saturation and brightness, and the music structure can be mapped to a figure in which a plurality of triangles or squares are sequentially connected. have. Let's find out in detail through the drawings.

3 is a diagram illustrating the size of an RMS of music according to an embodiment of the present invention.

Referring to FIG. 3 , since the size of the RMS of music is mapped to the thickness of the concentric circles 20 , the degree of the size of the RMS may be expressed as the degree of the thickness of the concentric circles. That is, as the size of the RMS increases, the thickness of the concentric circle increases, and as the size of the RMS decreases, the thickness of the concentric circle decreases.

For example, if the numerical value of the RMS size of the music analyzed by the music information generation unit 120 is calculated to be about 0.1, the thickness of the concentric circles as shown in the leftmost figure 21 of FIG. 3B is It can be expressed in a thin form. Conversely, if the numerical value for the size of the RMS is calculated to be about 0.9, the thickness of the concentric circles may be expressed in a very thick form like the figure 22 on the rightmost side of FIG. 3B. Therefore, according to the present invention, even if the user does not listen to all the music, the user can intuitively know information about the size of the RMS that the music has with only the thickness of the figure, so that the user can easily select the music he or she prefers. exist.

4 is a diagram illustrating a diagram representing a degree of a tempo of music according to an embodiment of the present invention.

Referring to FIG. 4 , the tempo of music may be mapped to an arc disposed in one of the outer quadrants of the outer circumferential surface of the concentric circles. In FIG. 4 , the music tempo is expressed by arranging it in the second quadrant among the outer quadrants of the outer circumferential surface of the concentric circle 20 , but the present invention is not limited thereto and may be arranged in the first, third, and fourth quadrants.

The degree of tempo can be expressed in proportion to the arc length. Therefore, the faster the tempo of the music, the longer the arc length, and the slower the music tempo, the shorter the arc length.

For example, as described above, since a numerical value for the degree of tempo can be calculated as a BPM value, when the BPM value is calculated low, the arc length is similar to the figure 31 expressed on the leftmost side of FIG. 4(b). It can be expressed very small. Conversely, when the BPM value is calculated to be high, the arc length may be expressed as long as the figure 32 shown on the rightmost side of FIG. 4(b). The range of bpm (0 to 250) shown in FIG. 4B is an example, and the value of bpm may be calculated as a value greater than 250 according to the characteristics of music.

However, since the length of the arc located outside the outer circumferential surface of the concentric circle cannot be expressed in more than one quadrant, if the arc indicating the degree of tempo is located in the second quadrant, the length of the arc has an angle between 90 and 180 degrees. It can be expressed as an arc.

FIG. 5 is a diagram illustrating the degree of the proportion occupied by a vocal in music according to an embodiment of the present invention.

Referring to FIG. 5 , the proportion of the vocal in music may be mapped to an arc disposed in one of the outer quadrants of the outer circumferential surface of the concentric circles 20 . In FIG. 5 , the music tempo is expressed as being disposed in the fourth quadrant among the outer quadrants of the outer circumferential surface of the concentric circle 20 , but the present invention is not limited thereto and may be disposed in the first, third, and fourth quadrants.

However, in order to prevent user confusion, the arc expressing the degree of tempo expressed in FIG. 4 and the arc expressing the degree of the specific gravity of the vocal in FIG. 5 should be placed in different quadrants, and in order to increase the user's intuition, It is efficient to arrange them in symmetrical quadrants (quadrants 1 and 3, and quadrants 2 and 4), respectively. Hereinafter, an arc representing the degree of tempo is referred to as a tempo arc 30 , and an arc representing the degree of specific gravity of the vocal is referred to as a vocal arc 40 .

Since the proportion of vocals in music is expressed in proportion to the length of the arc, the arc length increases as the proportion of vocals increases, and the arc length decreases as the proportion of vocals decreases.

For example, in the case of a song with a low proportion of vocals in music and many performance parts, the numerical value of the vocal proportion attribute is calculated by the music information generating unit 120 close to 0. As shown in the figure 41 on the left, the arc length can be expressed as very small. Conversely, when the proportion occupied by the vocal is high and the proportion occupied by the performance part is low, the numerical value of the vocal proportion property is calculated close to 1, so Like the figure 42 expressed on the rightmost side of (b), the arc length can be expressed as long. However, since the length of the arc cannot be expressed in more than one quadrant, if the vocal arc 40 is disposed in the fourth quadrant, it may be expressed as an arc having an angle between 360 degrees and 270 degrees.

6 is a diagram illustrating an HSL system as a reference for mapping genres of music according to an embodiment of the present invention. FIG. 6 (a) is a diagram illustrating an HSL color system, where HSL is Hue, It means a word made after the initials of Saturation and Lightness, and Fig. 6 (b) shows a table matching the color for each genre of music and the degree in the HSL color system. it is one drawing

Hue ranges from 0 to 360 degrees, where 0 represents red, 120 represents green, and 240 represents blue, and numbers between 0 and 120 and 240 degrees represent the color somewhere in between. Therefore, according to the HSL color system, 360 colors can be expressed as a specific degree value.

For example, when it is determined that the genre of music analyzed by the music information generation unit 120 is metal, as shown in FIG. 6(b), metal matches 0 degrees, and 0 degrees is an HSL color. Since red is matched by the system, the color of the figure representing the analyzed genre of music becomes red. If the genre of the analyzed music is funk, as shown in FIG. 6(b), funk may be matched to 196 degrees, and 196 degrees is matched to sky blue by the HSL color system, so the analyzed music The color of the figure expressing the genre of can be sky blue.

7 is a diagram illustrating a diagram in which mood information is mapped based on color saturation and brightness according to an embodiment of the present invention.

As described above, the mood is information about the emotion of the music, and includes arousal information indicating the intensity of the emotion and valence information that is information about the positive/negative of the emotion, and each information is transmitted to the music information generating unit 120 . It is calculated as a value between 0 and 1. In addition, as shown in FIG. 7 , arousal is mapped to color saturation, and valence is mapped to color brightness as shown in FIG. 7 . Saturation means the degree of coloration (intensity of color), 0% means a completely achromatic color, 100% means a primary color, Lightness means brightness (content of light), 0% means black , 100% means white. When the arousal value is calculated to be high, the saturation is mapped to a darker color, and when the valence value is calculated to be high, the brightness of the color is gradually mapped to a lighter color.

For example, if the arousal numerical value and valence numerical value of the music to be analyzed by the music information generating unit 120 are calculated as 0.842 and 0.720, respectively, as shown in FIG. 7 , each value corresponds to saturation and brightness. It can be mapped to point X. Therefore, since the color determined by FIG. 6 is transformed into a color with relatively higher saturation and brightness by the process according to FIG. 7 , the visual information generating unit 130 determines the color of the concentric circles 20 later in FIG. The color of the concentric circles 20 may be determined as a color having higher saturation and brightness than the color determined by 6 .

On the contrary, if the arousal numerical value and the valence numerical value of the music analyzed by the music information generating unit 120 were calculated as low values as -0.576 and -0.748, respectively, as shown in FIG. Since both are mapped to relatively low values, the color determined by FIG. 6 is transformed into a color with lower saturation and brightness and displayed.

In FIG. 7 , a method of mapping information on mood to saturation and brightness of a color after acquiring arousal information indicating the intensity of emotion and valence information indicating positive/negative information of an emotion has been described, but the implementation of the present invention The example is not limited thereto, and it is possible to directly map the color saturation and brightness, respectively, without going through arousal information and valence information.

Specifically, the music information generating unit 120 divides a person's emotions into a plurality of emotions according to a predetermined criterion, and then generates information about the mood based on the map information mapped to the color saturation and brightness for each emotion. You can map the brightness. For example, as shown in FIG. 7 , after dividing human emotions into nine emotions, emotion map information in which color saturation and lightness are mapped in advance for each emotion is generated, and the driver's emotions obtained by various sensors Information on the color saturation and brightness can be extracted by finding information in the emotion map information.

8 is a diagram illustrating various examples of visual information generated by a visual information generating unit according to an embodiment of the present invention.

The visual information generating unit 130 applies the method described in FIGS. 3 to 7 for each attribute by the music list generating unit 110 based on the music information, and a numerical value for each attribute included in the music information. It is possible to generate the visual information 10 including the relative size information for the .

As an example, FIG. 8A is a diagram illustrating a screen in which only the visual information 10 without text information is generated. Based on the above description, the color of the concentric circles 20 is purple, so the genre of music is pop, and the length of the tempo arc 30 arranged in the second quadrant is arranged from about 90 degrees to about 180 degrees. Therefore, it can be intuitively known that the tempo is relatively fast music. In addition, since the length of the vocal arc 40 arranged in the fourth quadrant is also arranged from about 270 degrees to about 360 degrees, it can be seen that the proportion of the vocal in music is relatively high.

FIG. 8B is a diagram illustrating a screen on which visual information 10 including text information 11 to 15 is generated as another embodiment of visual information 10 . As shown in (b) of FIG. 8 , genre information 13 describing a genre may be disposed in the center of the visual information 10 , and information on tempo 11 is provided at each corner of the visual information 10 . , information on the size of the RMS (12), information on the mood (14), and information on the weight of the vocal (15) may be written in text. Different types of information may be arranged in each corner according to a user's preference.

In addition, the visual information according to the present invention may generate the visual information 10 including information on the overall structure of the song. 9 is a view illustrating a process and various examples of generating visual information including information on the overall structure of music and information on the overall structure of music.

The music structure is information indicating the energy or strength/weakness of music from the beginning to the end of the music, and the music information generating unit 120 includes an intro, a verse, a bridge, and a chorus. By assigning values to chorus) and outro, it is possible to calculate the information 50 on the structure of the music including the information on the structure of the music.

For example, the information 50 on the music structure shown in (a) of FIG. 9 has a structure in which the energy of the music increases from the beginning to the middle, then decreases, and then the energy increases again from the middle to the end. It can mean to express something that exists. The information 50 on the music structure may be expressed in various figures as shown in FIG. 9(b) according to the characteristics of the analyzed music.

10 is a diagram illustrating a dynamic example of visual information generated by a visual information generating unit according to another embodiment of the present invention.

Referring to FIG. 10 , the visual information 10 in the center of FIG. 10 is the same visual information as the visual information described with reference to FIGS. 3 to 8, and the information analyzed for each attribute of one song is visualized. It is the visual information shown, and the other visual information (61 to 65) shows dynamic visual information that changes in real time according to the passage of time.

The dynamic time information refers to visual information that is changed in real time by reflecting values of properties of music that change as the music is played when a user selects and plays a specific piece of music. Accordingly, the thickness of the concentric circles 20 or values of various text information included in the music information may be changed in real time according to the passage of time.

11 to 14 are diagrams illustrating a screen displayed when a web/mobile screen or an application of a user terminal device is executed, according to an embodiment of the present invention.

Specifically, FIG. 11 is a diagram illustrating a screen on which visual information is displayed in a music list, and FIG. 12 is a diagram illustrating a screen in which visual information is displayed by overlapping image information of music existing in the music list.

As in the present invention, if the properties of music existing in the music list are analyzed and the visualization information for each music is displayed as shown in FIGS. 11 and 12, the user can intuitively know the information about each music, It has the advantage of being able to know all the general tendencies of existing music in a short period of time, and at the same time being able to select and listen to only the ones you prefer. That is, according to the prior art, the user could know whether the music in the music list was his or her favorite music only by directly listening to the music or reading the text information. Since the information is provided as visualization information so that the user can recognize it at a glance, there is an effect that the user can know the information about the music more easily and quickly without listening to the music.

13 is a view showing a screen displayed on the user terminal device when an application related to the present invention installed in the user terminal device is executed, and FIG. 14 is displayed on the user terminal device when music present in the music list is played It is a diagram showing a screen that becomes

In generating visual information, the apparatus 100 for providing a music information visualization service according to an embodiment of the present invention displays visual information on the cover image of each song existing in the music list as shown in FIG. 13 (a). It is also possible to create a music visualization list 70 created by overlapping, and a music visualization list 70 in which visual information 10 is arranged on one side of the original music list as shown in FIG. 13(b). can also create

When the user selects one of the songs from the music list, various pieces of information about the song may be displayed together with visual information on the screen of the user terminal device 300 as shown in FIG. 14 .

15 is a block diagram illustrating some components of a navigation system 2 according to another embodiment of the present invention. The navigation system 2 may include a music information visualization service providing device 100 and a navigation device 200 . Also, the apparatus 100 for providing a music information visualization service may be implemented as a server capable of transmitting and receiving data with the navigation device 200 installed in the vehicle 400 .

The apparatus 100 for providing a music information visualization service in FIG. 15 is the same device as the apparatus 100 for providing a music information visualization service described in FIG. 2 , and a detailed description thereof will be omitted because it is redundant.

The navigation device 200 receives signals from several Global Positioning System (GPS) satellites for the current location of the vehicle, and then determines the current location, and the fastest driving route to the destination based on the current traffic conditions. It is a device whose purpose is to inform

The navigation device 200 performs a function of providing various service information necessary for navigation to a user (current location and speed of a moving object, distance and route to a destination, detailed information on a destination, etc.) in association with a map, separately from the above purpose You may.

Specifically, the navigation device 200 may include a communication unit 210 , a driving route generation unit 220 , a control unit 230 , a display unit 240 , and the like.

The communication unit 210 may serve to transmit and receive data to and from the apparatus 100 for providing a music information visualization service. The data may include data for generating a driving route to a destination, visual information 10 and music visualization list 70 generated by the apparatus 100 for providing a music information visualization service, and the like, and the communication unit 210 is The data received from the apparatus 100 for providing a music information visualization service may be transmitted to the driving route generator 220 and the controller 230 .

Accordingly, the communication unit 210 may include one or more components capable of transmitting and receiving data to and from the apparatus 100 for providing a music information visualization service. For example, it may include at least one of a wired communication module and a wireless communication module.

The wired communication module includes a variety of wired communication modules such as a Controller Area Network (CAN) communication module, a Local Area Network (LAN) module, a Wide Area Network (WAN) module, or a Value Added Network (VAN) module. Various cable communication such as USB (Universal Serial Bus), HDMI (High Definition Multimedia Interface), DVI (Digital Visual Interface), RS-232 (recommended standard232), power line communication, or POTS (plain old telephone service) as well as communication module It can contain modules.

In addition to the Wi-Fi module and the wireless broadband module, the wireless communication module includes a global system for mobile communication (GSM), a code division multiple access (CDMA), a wideband code division multiple access (WCDMA), and a universal mobile telecommunications system (UMTS). ), Time Division Multiple Access (TDMA), Long Term Evolution (LTE), etc. may include a wireless communication module supporting various wireless communication methods.

The driving route generating unit 220 generates a driving route to the destination based on the data received from the communication unit 210 and the current vehicle location, and displays the generated driving route on the first screen 241, which is the left screen of FIG. 16 . may be displayed on the display unit 240 as shown in FIG.

Specifically, the driving route refers to the route from the current location to the destination based on the conditions set by the user. Various information may be displayed together.

The display unit 240 may output the driving path displayed by the driving path generating unit 220 and the visual information 10 or the visualization music list 80 transmitted by the apparatus 100 for providing a music information visualization service to the outside. .

Accordingly, the display unit may include various display panels such as a Liquid Crystal Display (LCD) panel, a Light Emitting Diode (LED) panel, or an Organic Light Emitting Diode (OLED) panel. Meanwhile, when the display unit includes a graphical user interface (GUI) such as a touch pad, that is, a software device, it may serve as an input unit (not shown) for receiving a user's input.

The control unit 230 alone displays the visual information 10 or the music visualization list 70 transmitted by the music information visualization service providing apparatus 100 on the display unit 240, or the driving route generation unit 220 generates It may be displayed on the display unit 240 together with one driving route in various ways.

16 is a diagram illustrating a screen displayed on a display unit according to an embodiment of the present invention, and FIG. 17 is a diagram illustrating a method for a user to change the order of music according to an embodiment of the present invention.

As shown in FIG. 16 , the controller 230 may display the driving route on the first screen 241 of the display unit 240 and display the music visualization list 70 on the second screen 242 . As shown in FIG. 16 , when driving route information is displayed on the first screen 241 and a music visualization list 70 corresponding thereto is displayed on the second screen, the driver intuitively controls the music to be played according to the driving route. There is an effect of being able to know the information and the order of information without interruption of driving.

In addition, the driver can view the music visualization list 70 displayed on the second screen 242 and easily change the music playback order by using a touch as shown in FIG. 17 . According to the prior art, in the future Because the style of playing music cannot be known in advance, users or drivers cannot remove them from the list of music or change the order in which they are played without listening to a style of music they do not prefer. However, as in the present invention, if information on all music existing in the music list is displayed as visual information and provided to the user, the user can intuitively know information about the music included in the playlist at a glance, so that they can listen to the actual music. There is an effect that can change the order of the music played in the music list or remove the music without it.

In addition, as shown in FIG. 17 , the present invention can easily change the music playback order by using a touch pad while driving, so that the driver can also reduce the possibility of an accident occurring while forcibly changing the music playback order. There are advantages that can be

18 is a diagram illustrating a screen displayed on a display unit according to another embodiment of the present invention.

The control unit 230 divides the driving route into a plurality of sections based on the time of each music present in the music list, and then creates a music visualization list ( 70) can be displayed on the second screen.

For example, if the estimated time required to reach the destination based on the current location is expected to take as much as the time for playing 4 songs, the controller 230 may divide the section to the destination into 4 sections in proportion to the playback time of each music. After dividing into (section A, section B, section C, and section D), a music visualization list 70 including visual information 10 for music reproduced in each section is created as shown in FIG. 18 . It can be displayed on two screens 242 .

As shown in FIG. 18 , when driving route information is displayed on the first screen 241 and a corresponding music visualization list 70 is displayed on the second screen 242 , the driver intuitively moves forward while driving. There is an advantage of being able to know information about music to be played for each driving section. Accordingly, there is an advantage in that the driver can easily change the order of the music list so that the music he/she wants is played according to the driving environment for each section by viewing the music visualization list 70 . A method of changing the order of music reproduced for each section may be changed to the method described with reference to FIG. 17 .

So far, we have studied in detail a method and apparatus for providing a music information visualization service and a navigation system including the same through drawings.

A method and apparatus for providing a music information visualization service according to an embodiment visually display information about the relative sizes of various properties of music using a figure, so that a user can see various properties of music at a glance. There is an advantage of being able to know information about information intuitively.

In addition, since the navigation system according to an embodiment provides the driver with a music visualization list including visual information on music corresponding to the driving route along with the driving route, the driver intuitively provides information on music to be played in the future. There is an effect of knowing without interruption of driving.

On the other hand, components, units, modules, components, etc. described as "~" described in this specification may be implemented together or individually as interoperable logic devices. Depictions of different features of modules, units, etc. are intended to emphasize different functional embodiments, and do not necessarily imply that they must be realized by separate hardware or software components. Rather, functionality associated with one or more modules or units may be performed by separate hardware or software components or integrated within common or separate hardware or software components.

Although acts are shown in the drawings in a particular order, it should not be understood that such acts need to be performed in the particular order shown, or in sequential order, or all shown acts need to be performed to achieve a desired result. .In certain circumstances, multitasking and parallel processing may be advantageous. Moreover, the division of various components in the above-described embodiments should not be construed as requiring such division in all embodiments, and that the described components will generally be integrated together into a single software product or packaged into multiple software products. It should be understood that there can be

A computer program (also known as a program, software, software application, script or code) may be written in any form of any programming language, including compiled or interpreted language or a priori or procedural language, as a stand-alone program or module; It can be deployed in any form, including components, subroutines, or other units suitable for use in a computer environment.

Additionally, the logic flows and structural block diagrams described in this patent document describe corresponding acts and/or specific methods supported by corresponding functions and steps supported by the disclosed structural means, and corresponding It can also be used to build software structures and algorithms and their equivalents.

The processes and logic flows described herein may be performed by one or more programmable processors executing one or more computer programs to perform functions by operating on input data and generating output.

The present description sets forth the best mode of the invention, and provides examples to illustrate the invention, and to enable any person skilled in the art to make or use the invention. This written specification does not limit the present invention to the specific terms presented.

Although the above has been described with reference to the preferred embodiment of the present invention, those skilled in the art or those having ordinary knowledge in the technical field will not depart from the spirit and technical scope of the present invention described in the claims to be described later. It will be understood that various modifications and variations of the present invention can be made without departing from the scope of the present invention. Accordingly, the technical scope of the present invention should be defined by the claims rather than being limited to the contents described in the detailed description of the specification.

100: music information visualization service providing device
110: music list generator
120; music information generator
130: visual information generating unit
200: navigation device
210: communication unit
220: driving route generating unit
230: control unit
240: display unit

Claims (5)

a driving route generator configured to generate travel route information based on information from the user to the input destination;
a display unit on which the driving route information is displayed;
a recommended music list generator configured to generate a recommended music list corresponding to the driving route information based on input information input by a user and the driving route information;
a music information generation unit that analyzes music existing in the recommended music list and generates music information for each attribute of the music;
A method of mapping a figure expressing the property of the attribute according to a predetermined mapping method, and transforming at least one of a size, length, thickness, and color of the figure, relative to a numerical value included in the music information a visual information generating unit generating visual information including information; and
a control unit for displaying a music visualization list displayed by matching the visual information with music existing in the recommended music list together with the driving route information on the display unit;
The attributes include the size of the RMS (Root Mean Square) of the music, the type of the genre, the level of the mood, the level of the tempo, and the weight of the vocal in the music. and at least one of the overall structure of the music,
The figure includes at least one of a triangle, a quadrangle, a pentagon, a hexagon, a circle, an ellipse, and an arc,
A navigation device that provides a navigation service using a music information visualization method. The method of claim 1,
The driving route information is
At least one of information on the expected average moving speed for each section to the destination, information on the destination, information on the route environment to the destination, information on the current time, and information on the current weather,
A navigation device that provides a navigation service using a music information visualization method. 3. The method of claim 2,
The control unit is
When an interface that allows the user to change the order of the music in the music visualization list through the display unit is provided to the user through the display unit, and the user changes the order of the music present in the music visualization list , displaying a music visualization list according to the changed order on the display unit,
A navigation device that provides a navigation service using a music information visualization method. 3. The method of claim 2,
The control unit is
In consideration of the playback order and playback time of the music present in the music visualization list, the driving route is divided and displayed on the display unit
A navigation device that provides a navigation service using a music information visualization method. analyzing music existing in the music list and generating music information for each attribute of the music;
A method of mapping a figure expressing the property of the attribute according to a predetermined mapping method, and transforming at least one of a size, length, thickness, and color of the figure, relative to a numerical value included in the music information generating visual information including information;
generating music visualization information in which the visual information corresponds to music existing in the music list; and
After generating driving route information based on the information from the user to the destination, displaying the music visualization list displayed by matching the visual information with music existing in the music list together with the driving route information on the display unit step; including,
The figure includes at least one of a triangle, a quadrangle, a pentagon, a hexagon, a circle, an ellipse, and an arc,
The attributes include the size of the RMS (Root Mean Square) of the music, the type of the genre, the level of the mood, the level of the tempo, and the weight of the vocal in the music. and at least one of the overall structure of the music. A method of providing a navigation service using a music information visualization method.

Images