KR20220035865A - Method for providing navigation service using music information visualization method and navigation device - Google Patents

Abstract

A navigation device that provides a navigation service using a music information visualization method according to an embodiment includes a driving route generator that generates driving route information based on information to a destination input by a user, and a driving route information display unit. A display unit, a recommended music list generator for generating a recommended music list corresponding to the driving route information based on the input information input by the user and the driving route information, analyzing music existing in the recommended music list, and A music information generation unit that generates music information for each attribute, maps a shape to express the properties of the attribute according to a predetermined mapping method, and transforms at least one of the size, length, thickness, and color of the shape. a visual information generator that generates visual information including relative size information for numerical values included in the music information, and music visualization that displays the visual information in correspondence with music existing in the recommended music list. It may include a control unit that displays the list along with the driving route information on the display unit.

Description

Method for providing navigation service using music information visualization method and navigation device}

The present invention relates to a method of providing a navigation service and a navigation device using a music information visualization method. More specifically, the present invention relates to a navigation route guidance service that provides visualized information so that users can intuitively recognize information about various properties of music. It is an invention related to technology provided to users.

With the advancement of technology, it has become possible to digitize existing large-capacity media and convert it into low-capacity media. Today, users can store various types of media on portable user terminal devices and easily select and enjoy the media they want on the go. It became possible. In addition, media digitized through digital compression technology is explosively revitalizing online media services by enabling media sharing between users on a network, and many applications or programs related to this are being developed.

Among the vast amounts of media provided, music accounts for a significant portion. Compared to other types of media, it has a lower capacity and communication load, so it is easy to support real-time streaming services, resulting in high satisfaction for both service providers and users. Accordingly, services that provide online music to users in various ways are currently emerging.

Existing online music services simply provide music in real time to users connected online by providing music to the user's terminal device or providing streaming services, but recently, they have utilized big data or artificial intelligence technology. We provide a service that recommends highly preferred media to users.

However, the current recommendation method in online music services is to create a music chart by simply counting the number of music sources purchased, listened to, or searched by the user and make recommendations based on this. This recommendation method is a statistical method based on the simple number of accesses. It is a method of recommending music based on standards and ignores the diversity and volatility of the user's preferences. In addition, since this recommendation method recommends music based on the accumulated number of accesses, the volatility of the music chart is low, and most of the previously recommended music overlaps with the currently recommended music, greatly reducing its effectiveness.

Additionally, when music is recommended in this way, the user does not know how the music was recommended, so due to the nature of the music, the user must actually listen to it to know whether the recommended music is music that the user likes. In other words, there is a problem that a lot of time is consumed because the user must listen to the end to find out information about what genre of music the recommended music is, what the tempo is, and what structure the music has.

A method and device for providing a music information visualization service according to an embodiment and a navigation system including the same are inventions designed to solve the problems described above, and provide information about music at a glance without the user having to directly listen to the music or read the description. The purpose is to enable intuitive recognition.

Specifically, by providing users with information visually displayed using shapes about the numerical values analyzed for the various properties of music, users can intuitively see information about the various properties of music at a glance. The purpose is to make it possible.

In addition, the navigation system according to one embodiment recommends various music suitable for the driving route to the user based on the vehicle's driving information and various information of the user and passengers, and at the same time provides information about the recommended songs in response to the driving route. The purpose is to enable users to recognize it intuitively.

A navigation device that provides a navigation service using a music information visualization method according to an embodiment includes a driving route generator that generates driving route information based on information to a destination input by a user, and a driving route information display unit. A display unit, a recommended music list generator for generating a recommended music list corresponding to the driving route information based on the input information input by the user and the driving route information, analyzing music existing in the recommended music list, and A music information generation unit that generates music information for each attribute, maps a shape to express the properties of the attribute according to a predetermined mapping method, and transforms at least one of the size, length, thickness, and color of the shape. a visual information generator that generates visual information including relative size information for numerical values included in the music information, and music visualization that displays the visual information in correspondence with music existing in the recommended music list. It may include a control unit that displays the list along with the driving route information on the display unit.

The driving route information is at least one of information about the expected average moving speed for each section to the destination, information about the destination, information about the route environment to the destination, information about the current time, and information about the current weather. may include.

The control unit provides the user with an interface through which the user can change the order of music existing in the music visualization list through the display unit, and allows the user to change the order of music existing in the music visualization list. When changed, a music visualization list according to the changed order can be displayed on the display unit.

The control unit may classify the driving path and display it on the display unit by considering the playback order and playback time of music existing in the music visualization list.

A method of providing a navigation service using a music information visualization method according to an embodiment includes the steps of analyzing music existing in a music list and generating music information for each property of the music, and determining the properties according to a predetermined mapping method. Generating visual information including relative size information for numerical values included in the music information by mapping a shape to express the property and modifying at least one of the size, length, thickness, and color of the shape. Steps: generating music visualization information displayed by matching the visual information to music existing in the music list; and generating driving route information based on information to the destination input by the user, and then storing the visual information in the music list. and displaying a music visualization list corresponding to music existing in the music list on a display unit together with the driving route information, wherein the shape is at least one of a triangle, a square, a pentagon, a hexagon, a circle, an oval, and an arc. It includes one, and the properties include the size of the root mean square (RMS) of the music, the type of genre, the degree of mood, the degree of tempo, and the vocals in the music. It may include at least one of the proportion of (Vocal) and the overall structure of the music.

A method and device for providing a music information visualization service according to an embodiment visually displays information about the relative size of various properties of music using shapes, allowing the user to view the various properties of music at a glance. There is an advantage to knowing information intuitively.

In addition, the navigation system according to one embodiment provides the driver with a music visualization list containing visual information about music corresponding to the driving route along with the driving route, so the driver intuitively receives information about music to be played in the future. There is an effect of knowing without interfering with driving.

Figure 1 is a block diagram showing some components of a music information visualization service providing system according to an embodiment of the present invention.
Figure 2 is a block diagram showing some components of a music information visualization service providing device according to an embodiment of the present invention.
Figure 3 is a diagram showing a figure representing the RMS size of music according to an embodiment of the present invention.
Figure 4 is a diagram showing a figure expressing the degree of tempo of music according to an embodiment of the present invention.
Figure 5 is a diagram showing a figure expressing the degree of proportion of vocals in music according to an embodiment of the present invention.
Figure 6 is a diagram illustrating an HSL system that serves as a standard for mapping genres of music according to an embodiment of the present invention.
Figure 7 is a diagram illustrating information about the mood of music mapped based on saturation and brightness according to an embodiment of the present invention.
Figure 8 is a diagram illustrating various examples of visual information generated by a visual information generator according to an embodiment of the present invention.
Figure 9 is a diagram showing information about the structure of music and visual information including the same according to an embodiment of the present invention.
Figure 10 is a diagram illustrating a dynamic example of visual information generated according to an embodiment of the present invention.
Figure 11 is a diagram illustrating a screen where visual information is displayed on a music list according to an embodiment of the present invention.
Figure 12 is a diagram illustrating a screen in which visual information is displayed overlapping image information of music existing in a music list according to an embodiment of the present invention.
Figures 13 and 14 are diagrams showing screens displayed on a user terminal device according to an embodiment of the present invention.
Figure 15 is a block diagram showing some components of a navigation system according to an embodiment of the present invention.
Figure 16 is a diagram illustrating a screen displayed on a display unit according to an embodiment of the present invention.
Figure 17 is a diagram illustrating a method for a user to change the order of music according to an embodiment of the present invention.
Figure 18 is a diagram illustrating a screen displayed on a display unit according to another embodiment of the present invention.

Hereinafter, embodiments according to the present invention will be described with reference to the attached drawings. When adding reference signs to components in each drawing, it should be noted that the same components are given the same reference numerals as much as possible even if they are shown in different drawings. Additionally, when describing embodiments of the present invention, if detailed descriptions of related known configurations or functions are judged to impede understanding of the embodiments of the present invention, the detailed descriptions will be omitted. In addition, embodiments of the present invention will be described below, but the technical idea of the present invention is not limited or limited thereto and may be modified and implemented in various ways by those skilled in the art.

Additionally, the terms used in this specification are used to describe embodiments and are not intended to limit and/or limit the disclosed invention. Singular expressions include plural expressions unless the context clearly dictates otherwise.

In this specification, terms such as “comprise,” “provide,” or “have” are intended to designate the presence of features, numbers, steps, operations, components, parts, or combinations thereof described in the specification. It does not exclude in advance the existence or addition of other features, numbers, steps, operations, components, parts, or combinations thereof.

In addition, throughout the specification, when a part is said to be “connected” to another part, this refers not only to the case where it is “directly connected” but also to the case where it is “indirectly connected” with another element in between. Terms including ordinal numbers, such as “first” and “second,” used in this specification may be used to describe various components, but the components are not limited by the terms.

Below, with reference to the attached drawings, embodiments of the present invention will be described in detail so that those skilled in the art can easily implement the present invention. In order to clearly explain the present invention in the drawings, parts unrelated to the description are omitted.

Figure 1 is a block diagram showing some components of a music information visualization service providing system according to an embodiment of the present invention.

Referring to FIG. 1, a music information visualization service providing system 1 according to an embodiment may include a plurality of user terminal devices 300a and 300b, a vehicle 400, and a music information visualization service providing device 100. The music information visualization service providing device 100 may be operated in communication with a plurality of user terminal devices 300a and 300b and a plurality of vehicles 400.

The music information visualization service providing device 100 generates a recommended music list based on information received from the user terminal device 300 or the vehicle 400, generates visual information about the music in the recommended music list, and generates the generated music information. Visual information can be transmitted to a plurality of user terminal devices 300 and vehicles 400 along with a list of recommended music.

Accordingly, the music information visualization service providing device 100 may be implemented as a device, generally a server, that can provide music information visualization services to users.

A server refers to a typical server. A server is computer hardware on which a program is running. It monitors and controls the entire network, such as printer control or file management, or connects to other networks through a mainframe or public network. Sharing software resources such as data, programs, and files, or modems, fax machines, and printers. It can support sharing hardware resources such as other equipment.

These servers are equipped with apps related to the online commerce brokerage system and are connected to the user terminal device 300 and the vehicle 400 through a network, respectively, so that they can manage the Internet homepage corresponding to the URL.

The user terminal device 300 connects to the music information visualization service providing device 100 under the user's control, receives information about music desired by the user, or allows the music information visualization service providing device 100 to recommend music to the user. To create a list, you can enter personal information about the user and various information about the music the user likes.

Accordingly, the user terminal device 300 may include a mobile terminal device capable of accessing the music information visualization service providing device 100 through a dedicated application or a general-purpose application, and generally includes a computing device.

In FIG. 1, as an example, the user terminal device 300 is shown as a smart phone (300a) and a laptop (Laptop, 300b), but devices that may be included in the user terminal device 300 include a personal computer (PC) and a GSM. (Global System for Mobile communication), PDC (Personal Digital Cellular), PHS (Personal Handyphone System), PDA (Personal Digital Assistant), IMT (International Mobile Telecommunication)-2000, CDMA (Code Division Multiple Access)-2000, W- All devices such as CDMA (W-Code Division Multiple Access), Wibro (Wireless Broadband Internet) terminal, SmartPad, tablet PC, smart watch, smart glass, wearable device, etc. It may include various types of handheld-based wireless communication devices.

In addition, in Figure 1, the number of user terminal devices 300 is shown as a limited number due to space limitations, but the present invention is not limited to this and a larger number of user terminal devices can be included in the music information service providing system 1. there is.

The vehicle 400 connects to the music information visualization service providing device 100 under the user's control and receives information about music desired by the user, or the music information visualization service providing device 100 provides a music recommendation list for the user. Personal information about the user and various information about the music the user likes can be transmitted to the music information visualization service providing device 100 so as to generate a .

Specifically, the vehicle 400 may access the music information visualization service providing device 100 using the navigation device 200 or the communication unit 210 of the vehicle 400. The navigation device 200 may be implemented as a component included in the vehicle 400 or may be implemented as a component independent of the vehicle 400. In other words, the network can be implemented as a portable terminal capable of accessing the music information visualization service providing device 100, and the portable terminal can be a SmartPad, tablet PC, smart watch, or smart glass. , all types of handheld-based wireless communication devices such as wearable devices, etc. may be included.

FIG. 2 is a block diagram showing some components of the apparatus 100 for providing a music information visualization service according to an embodiment.

Referring to FIG. 2, the music information visualization service providing device 100 may include a music list generator 110, a music information generator 120, a visual information generator 130, and the like.

The music list generator 110 may generate a music list for music selected by the user or create a recommended music list that recommends music to the user based on the user's input information.

The music selected by the user may be the title of a song directly entered by the user, or may be music for a specific genre or artist selected by the user. The music list generator 110 may generate a list of music selected by the user and provide the music list to the user.

The recommended music list refers to a list of recommended music that analyzes the user's tastes based on the input information entered by the user and recommends it to the user based on this. The input information includes the genre of music entered by the user, the mood of the music, and the music. It may include at least one of information about the tempo, the title of the music, the title of the album, and the name of the artist.

In addition, the music list in the present invention does not necessarily mean only a music list created with the user's specific input information, and includes music displayed on the screen when the user first accesses the web or pages within the music website. The music displayed on the screen whenever it is changed is also considered a music list, and the principles of the present invention can also be applied to the music displayed on the screen.

Therefore, the music list generator 110 can generate a recommended music list based on the input information. Specifically, the music, genre, mood, and instrument included in the input information. ), a music list can be created including music similar to at least one of vocals, samples, and rhythms.

For example, when generating a recommended music list based on genre, the music list generator 110 determines the user's preferred genre based on the input information entered by the user, and selects a genre similar to the user's preferred genre. Music with a can be included in the recommended music list. When creating a recommended music list based on rhythm, the user's preferred rhythm is determined based on the input information entered by the user, and the user's preferred rhythm is included. You can include the music you are playing in the recommended music list.

Additionally, when creating a recommended music list, the music list generator 110 may generate a recommended music list by combining the preferences of the driver and passengers and the route to the destination when the user is a driver.

Specifically, the music list generator 110 provides basic personal information such as gender and age of the driver and passenger, as well as information about the expected average moving speed for each section to the destination, information about the destination, and information about the route environment to the destination. , At least one of information about the current time and information about the current weather may be received through the communication unit 210 of the navigation device 200, and a recommended music list may be generated based on the received information.

For example, if the destination is city X, songs related to city

The music information generation unit 120 analyzes the music existing in the music list generated by the music list generation unit 110 and includes a numerical value that can express the relative size of each attribute of the music. Music information can be generated.

The attributes that the music information generation unit 120 analyzes for music include RMS (Root Mean Square), Tempo, Genre, Mood, overall structure, and vocals in the music. It may include the proportion of (Vocal), etc.

For example, if there is music with artist A - song title B in the music list, the music information generation unit 120 analyzes the music with song title B to determine the RMS size and the degree of tempo. It is possible to generate information about what the music is like, how much vocals occupy in the entire music, what genre the music has, what the mood is like, and how the overall structure of the music progresses.

RMS is an abbreviation for Root Mean Square, which refers to the effective output. It refers to the value that serves as the standard for the average output capable of continuously outputting a signal from an amplifier or speaker, and is also called the effective value. In other words, RMS refers to the overall energy value of the music, and the numerical value for the size of RMS can be output between 0 and 1. If the music is judged to have high energy, a value close to 1 may be output, and if the energy is judged to be low, a value close to 0 may be output.

Tempo refers to information about the speed of music, and can generally be expressed as BPM (beats per minute) information, which indicates the speed of music in numbers. Therefore, the numerical value for tempo can be calculated as a value between 0 and about 250 based on BPM. A larger numerical value means faster music, and a smaller numerical value means slower music. .

The proportion of vocals refers to the proportion of vocals in music. The numerical value for the proportion of vocals can be calculated between 0 and 1. The closer it is to 1, the music has a higher proportion of vocals in the music and a lower proportion of performance parts, and the closer it is to 0, the higher the proportion of vocals in the music. This means that the proportion is low and the vocals account for a high proportion.

Genre is information about what type of music is being analyzed. Specifically, genres include metal, rock, Latin, folk, new age, Includes jazz, blues, electronic, pop, hip-pop, reggae, etc. The music information generator 120 can analyze the music and determine which genre the music belongs to among the genres described above. As will be described later in FIG. 3, the numerical value for each genre ranges from 0 degrees to 360 degrees by the HSL color system. It can be calculated as one of the values between degrees.

Mood is information about the emotion of music and includes arousal information, which represents the intensity of the emotion, and valence information, which represents information about the positivity/negativity of the emotion. The information about the mood is a quantifiable form of arousal information and valence information. The output can be a pair of numerical values.

The numerical arousal and valence numerical values each range from 0 to 1. If the music being analyzed is judged to have high arousal, the numerical value approaches 1, and if it is judged to have low arousal, the numerical value approaches 1. The numerical value approaches 0. If the music being analyzed for valence information is judged to have high valence, the numerical value approaches 1, and if it is judged to have low valence, the numerical value approaches 0.

The visual information generator 130 maps shapes to express the properties of the properties described above, and configures the size of the shapes so that the user can visually see at a glance how much value the music has for each property. Visual information containing relative size information for the numerical value of each attribute included in the music information can be generated by modifying at least one of the length, thickness, and color.

Figures that express the properties of the attributes described above can be mapped according to predetermined standards. Specifically, the size of the music's RMS can be mapped to the thickness of the concentric circle, the degree of tempo of the music can be mapped to the length of an arc placed in one of the outer quadrants of the outer circumference of the concentric circle, and the proportion of vocals in the music is mapped to It may be mapped to the length of an arc placed in a quadrant other than one of the outer quadrants of the outer peripheral surface of the concentric circle, except for one of the four quadrants in which the arc matching the tempo is located. The type of music genre can be mapped to the color of a concentric circle, the degree of the mood of the music can be mapped to the saturation and brightness of the color, and the structure of the music can be mapped to a shape in which a plurality of triangles or squares are sequentially connected. there is. Let’s look at this in detail through the drawings.

Figure 3 is a diagram showing a figure representing the size of RMS of music according to an embodiment of the present invention.

Referring to FIG. 3, since the size of the RMS of music is mapped to the thickness of the concentric circle 20, the degree of the size of the RMS can be expressed as the degree of the thickness of the concentric circle. That is, as the size of the RMS increases, the thickness of the concentric circle increases, and as the size of the RMS decreases, the thickness of the concentric circle decreases.

For example, if the numerical value of the RMS size of the music analyzed by the music information generator 120 is calculated to be about 0.1, the thickness of the concentric circle, as shown in the figure 21 on the far left of (b) of FIG. 3, is It can be expressed in a thin form. On the other hand, if the numerical value for the size of the RMS is calculated to be about 0.9, the thickness of the concentric circles can be expressed as very thick, like the figure 22 on the far right of Figure 3 (b). Therefore, according to the present invention, the user can intuitively know the information about the RMS size of the music based only on the thickness of the shape without having to listen to all the music, which has the effect of allowing the user to easily select the music he or she prefers. exist.

Figure 4 is a diagram showing a figure expressing the degree of tempo of music according to an embodiment of the present invention.

Referring to Figure 4, the tempo of music can be mapped to an arc placed in one of the outer quadrants of the outer circumference of the concentric circle. In FIG. 4, the tempo of music is expressed by being placed in the second quadrant out of the four quadrants outside the outer circumference of the concentric circle 20, but it is not limited to this and can also be placed in the first, third, and fourth quadrants.

The degree of tempo can be expressed in proportion to the length of the arc. Therefore, as the tempo of the music increases, the length of the arc increases; as the tempo of the music slows, the length of the arc decreases.

For example, as described above, the numerical value of the degree of tempo can be calculated as a BPM value, so if the BPM value is calculated low, the length of the arc, as shown in the figure 31 expressed on the leftmost side of (b) of Figure 4, is It can be expressed very small. Conversely, when the BPM value is calculated to be high, the length of the arc may be expressed as long, as shown in the figure 32 shown on the far right of Figure 4 (b). The bpm range (0 to 250) shown in (b) of FIG. 4 is an example, and depending on the characteristics of the music, the bpm value may be calculated to be greater than 250.

However, since the length of the arc located outside the outer circumference of the concentric circle cannot be expressed beyond one quadrant, if the arc indicating the degree of tempo is located in the second quadrant, the length of the arc has an angle between 90 and 180 degrees. It can be expressed as an arc.

Figure 5 is a diagram showing a figure expressing the degree of proportion of vocals in music according to an embodiment of the present invention.

Referring to FIG. 5, the proportion of vocals in music can be mapped as an arc placed in one of the outer quadrants of the outer peripheral surface of the concentric circle 20. In FIG. 5, the tempo of the music is expressed as being placed in the 4th quadrant of the outer circumference of the concentric circle 20, but it is not limited to this and can also be placed in the 1st, 3rd, and 4th quadrant.

However, in order to prevent user confusion, the arc expressing the degree of tempo expressed in Figure 4 and the arc expressing the degree of vocal proportion in Figure 5 should be placed in different quadrants, and in order to increase user intuition, It is efficient to place them in four symmetrical quadrants (1st and 3rd, 2nd and 4th). Hereinafter, the arc representing the degree of tempo is referred to as the tempo arc (30), and the arc representing the degree of vocal proportion is referred to as the vocal arc (40).

The degree of importance of vocals in music is expressed in proportion to the length of the arc, so the higher the proportion of vocals, the longer the arc increases, and the lower the proportion of vocals, the lower the length of the arc.

For example, in the case of a song in which the proportion of vocals in the music is low and has many performance parts, the numerical value for the vocal proportion attribute is calculated close to 0 by the music information generation unit 120, so it is included in the most part of (b) of Figure 5. As shown in the figure 41 shown on the left, the length of the arc can be expressed as very small, and conversely, when the proportion of vocals is high and the proportion of performance parts is low, the numerical value for the vocal proportion attribute is calculated close to 1, so in Figure 5 The length of the arc can be expressed as long, as shown in figure 42 on the far right of (b). However, since the length of the arc cannot be expressed beyond one quadrant, if the vocal arc 40 is placed in the fourth quadrant, it can be expressed as an arc having an angle between 360 degrees and 270 degrees.

Figure 6 is a diagram showing the HSL system, which is a standard for mapping genres of music according to an embodiment of the present invention. Figure 6 (a) is a diagram showing the HSL color system, where HSL is Hue, It refers to a word created by combining the initials of Saturation and Lightness, and Figure 6 (b) shows a table matching the colors for each genre of music and the degrees in the HSL color system. It is a drawing.

Hue ranges from 0 to 360 degrees, with 0 being red, 120 being green, and 240 being blue. Numbers between 0 and 120 and 240 degrees represent colors somewhere in between. Therefore, according to the HSL color system, 360 colors can be expressed with specific degree values.

For example, if the genre of music analyzed by the music information generator 120 is determined to be metal, as shown in (b) of FIG. 6, metal is matched to 0 degrees, and 0 degrees is the HSL color. Since it is matched to red by the system, the color of the shape representing the genre of the analyzed music becomes red. If the genre of the analyzed music is funk, as shown in (b) of Figure 6, funk can be matched to 196 degrees, and 196 degrees is matched to light blue by the HSL color system, so the analyzed music The color of the shape representing the genre can be light blue.

Figure 7 is a diagram showing a diagram in which information about mood is mapped based on color saturation and brightness according to an embodiment of the present invention.

As described above, the mood is information about the emotion of music and includes arousal information indicating the intensity of the emotion and valence information, which is information about the positivity/negativity of the emotion, and each piece of information is stored in the music information generator 120. It is calculated as a value between 0 and 1. And for each value calculated in this way, arousal is mapped to the saturation of the color, and valence is mapped to the brightness of the color, as shown in Figure 7. Saturation means the degree of coloring (intensity of color), 0% is completely achromatic, 100% means primary color, and Lightness means brightness (content of light), and 0% is black. , 100% means white. If the arousal value is calculated to be high, the saturation is mapped to increasingly darker colors, and if the valence value is calculated to be high, the brightness of the color is mapped to increasingly brighter colors.

For example, if the arousal numerical value and the valence numerical value of the music to be analyzed by the music information generator 120 were calculated as 0.842 and 0.720, respectively, as shown in FIG. 7, each value corresponds to saturation and brightness. It can be mapped to point X. Therefore, the color determined in Figure 6 is transformed into a color with relatively higher saturation and brightness through the process according to Figure 7, so when the visual information generator 130 later determines the color of the concentric circle 20, The color of the concentric circle 20 can be determined as a color with higher saturation and brightness than the color determined by 6.

On the contrary, if the arousal numerical value and the valence numerical value of the music analyzed by the music information generation unit 120 were calculated as low values, such as -0.576 and -0.748, respectively, as shown in FIG. 7, the respective values are chroma and brightness. Since both are mapped to relatively low values, the color determined in Figure 6 is transformed and displayed as a color with lower saturation and brightness.

In FIG. 7, a method of acquiring information about the mood as arousal information indicating the intensity of emotion and valence information indicating the positive/negative information of the emotion and then mapping them to color saturation and brightness, respectively, is explained. However, in practice of the present invention, The example is not limited to this, and can be mapped directly to the saturation and brightness of each color without going through arousal information and valence information.

Specifically, the music information generator 120 divides a person's emotions into a plurality of emotions according to a certain standard and then generates information about the mood based on map information that maps each emotion to color saturation and brightness. Brightness can be mapped. As an example, as shown in FIG. 7, human emotions are divided into nine emotions, emotion map information is generated by pre-mapping color saturation and brightness for each emotion, and then the driver's emotions are acquired by multiple sensors. By finding information in the emotional map information, information about the saturation and brightness of the corresponding color can be extracted.

Figure 8 is a diagram illustrating various examples of visual information generated by a visual information generator according to an embodiment of the present invention.

The visual information generator 130 generates a numerical value for each attribute included in the music information by applying the method described in FIGS. 3 to 7 to each attribute based on the music list generator 110. Visual information 10 including relative size information about can be generated.

As an example, (a) of FIG. 8 is a diagram showing a screen that generates only visual information 10 without text information. Based on the information described above, the color of the concentric circles (20) is purple, so the genre of music is pop, and the length of the tempo arc (30) placed in the second quadrant is arranged from about 90 degrees to about 180 degrees. Therefore, we can intuitively know that the tempo of the music is relatively fast. In addition, the length of the vocal arc 40 arranged in the fourth quadrant ranges from about 270 degrees to about 360 degrees, so it can be seen that the music has a relatively high proportion of vocals.

FIG. 8 (b) is another example of visual information 10, and is a diagram showing a screen on which visual information 10 including text information 11 to 15 is generated. As shown in (b) of FIG. 8, genre information 13 explaining the genre may be placed in the exact center of the visual information 10, and information about the tempo 11 is located at each corner of the visual information 10. , information about the size of the RMS (12), information about the mood (14), and information about the proportion of vocals (15) can be written in text. The type of information placed at each corner may be different depending on the user's preference.

Additionally, the visual information according to the present invention can generate visual information 10 containing information about the overall structure of the song. Figure 9 is a diagram illustrating visual information containing information about the overall structure of music, the process of generating information about the overall structure of music, and various examples.

The structure of music is information indicating the energy or strength/weakness of the music from the beginning to the end of the music, and the music information generator 120 generates intro, verse, bridge, and chorus ( By assigning values to chorus and outro, information 50 about the structure of the music, which includes information about the pre-event structure of the music, can be calculated.

For example, the information 50 about the music structure shown in (a) of FIG. 9 has a structure in which the energy of the music increases from the beginning to the middle of the music, then decreases, and then increases again from the middle to the end. It can mean expressing something that exists. Information 50 about the music structure may be expressed in various shapes as shown in (b) of FIG. 9 depending on the characteristics of the music being analyzed.

FIG. 10 is a diagram illustrating a dynamic example of visual information generated by a visual information generator according to another embodiment of the present invention.

Referring to FIG. 10, the visual information 10 in the exact center of FIG. 10 is the same visual information as the visual information explained in FIGS. 3 to 8, and visualizes the information analyzed for each attribute of one song. This is visual information shown, and other visual information (61 to 65) shows dynamic visual information that changes in real time with the passage of time.

Dynamic time information refers to visual information that changes in real time by reflecting the values of the properties of the music that change as the music is played when the user selects and plays specific music. Accordingly, the thickness of the concentric circle 20 or the values of various text information included in the music information may change in real time as time passes.

11 to 14 are diagrams illustrating a web/mobile screen of a user terminal device or a screen displayed when an application is executed, according to an embodiment of the present invention.

Specifically, FIG. 11 is a diagram illustrating a screen in which visual information is displayed in a music list, and FIG. 12 is a diagram illustrating a screen in which visual information is displayed overlapping image information of music existing in a music list.

As in the present invention, by analyzing the properties of the music existing in the music list and displaying visualization information for each music as shown in Figures 11 and 12, the user can intuitively know the information about each music and add it to the music list. There is an advantage in that you can know the overall tendency of music in a short period of time, and at the same time, you can select and listen to only the music you prefer. In other words, according to the prior art, the user had to listen to the music directly or read the text information to know whether the music in the music list was the user's favorite music. However, in the case of the present invention, the properties of the music are known. Because information is provided in visual form so that users can understand it at a glance, users can learn information about music more easily and quickly without having to listen to the music directly.

FIG. 13 is a diagram illustrating a screen displayed on the user terminal device when running an application related to the present invention installed on the user terminal device, and FIG. 14 is a diagram illustrating a screen displayed on the user terminal device when music existing in the music list is played. This is a diagram showing the screen.

In generating visual information, the music information visualization service providing device 100 according to an embodiment of the present invention places visual information on the cover image of each song existing in the music list, as shown in (a) of FIG. 13. A music visualization list 70 created by overlapping can be created, and as shown in (b) of FIG. 13, a music visualization list 70 in which visual information 10 is placed on one side of the original music list. You can also create .

When the user selects one of the songs in the music list, various information about the song may be displayed along with visual information on the screen of the user terminal device 300, as shown in FIG. 14.

Figure 15 is a block diagram showing some components of the navigation system 2, which is another embodiment of the present invention. The navigation system 2 may include a music information visualization service providing device 100 and a navigation device 200. The music information visualization service providing device 100 may be implemented as a server capable of transmitting and receiving data with the navigation device 200 installed in the vehicle 400.

The music information visualization service providing device 100 in FIG. 15 is the same device as the music information visualization service providing device 100 described in FIG. 2, and detailed description thereof will be omitted as it is redundant.

The navigation device 200 determines the current location of the vehicle after receiving signals from multiple GPS (Global Positioning System) satellites located above the Earth, and determines the fastest driving route to the destination based on the current traffic situation. It is a device whose purpose is to inform.

Aside from the above purpose, the navigation device 200 performs a function of providing the user with various service information required for navigation (current location and speed of the moving object, distance and route to the destination, detailed information about the destination, etc.) in association with the map. You may.

Specifically, the navigation device 200 may include a communication unit 210, a driving route creation unit 220, a control unit 230, and a display unit 240.

The communication unit 210 may serve to transmit and receive data with the music information visualization service providing device 100. The data may include visual information 10 and a music visualization list 70 generated by the data and music information visualization service providing device 100 for generating a driving route to the destination, and the communication unit 210 Data received from the music information visualization service providing device 100 may be transmitted to the driving path creation unit 220 and the control unit 230.

Accordingly, the communication unit 210 may include one or more components capable of transmitting and receiving data with the music information visualization service providing device 100. For example, it may include at least one of a wired communication module and a wireless communication module.

Wired communication modules include a variety of wired communication modules, such as Controller Area Network (CAN) communication modules, Local Area Network (LAN) modules, Wide Area Network (WAN) modules, or Value Added Network (VAN) modules. In addition to communication modules, various cable communications such as USB (Universal Serial Bus), HDMI (High Definition Multimedia Interface), DVI (Digital Visual Interface), RS-232 (recommended standard232), power line communication, or POTS (plain old telephone service) Can contain modules.

In addition to Wi-Fi modules and WiBro (Wireless broadband) modules, wireless communication modules include GSM (global System for Mobile Communication), CDMA (Code Division Multiple Access), WCDMA (Wideband Code Division Multiple Access), and UMTS (universal mobile telecommunications system). ), TDMA (Time Division Multiple Access), and LTE (Long Term Evolution) may include a wireless communication module that supports various wireless communication methods.

The driving path generator 220 generates a driving path to the destination based on the data received from the communication unit 210 and the current location of the vehicle, and displays the generated driving path on the first screen 241, which is the left screen of FIG. 16. As shown, it can be displayed on the display unit 240.

Specifically, the driving route refers to the travel route from the current location to the destination based on the conditions set by the user, and the driving route includes the estimated time required to reach the destination, expected arrival time, expected average speed, and road environment. Various information, etc. may be displayed together.

The display unit 240 may externally output the driving path displayed by the driving path generator 220 and the visual information 10 or the visualization music list 80 transmitted by the music information visualization service providing device 100. .

Accordingly, the display unit may include various display panels, such as a liquid crystal display (LCD) panel, a light emitting diode (LED) panel, or an organic light emitting diode (OLED) panel. Meanwhile, if the display unit includes a GUI (Graphical User Interface), that is, a software device, such as a touch pad, it may serve as an input unit (not shown) that receives user input.

The control unit 230 independently displays the visual information 10 or the music visualization list 70 transmitted by the music information visualization service providing device 100 on the display unit 240, or the driving path creation unit 220 generates the visual information 10 or the music visualization list 70. A driving path can be displayed on the display unit 240 in various ways.

FIG. 16 is a diagram illustrating a screen displayed on a display unit according to an embodiment of the present invention, and FIG. 17 is a diagram illustrating a method for a user to change the order of music according to an embodiment of the present invention.

As shown in FIG. 16, the control unit 230 can display a driving route on the first screen 241 of the display unit 240 and a music visualization list 70 on the second screen 242. As shown in FIG. 16, when driving route information is displayed on the first screen 241 and the corresponding music visualization list 70 is displayed on the second screen, the driver intuitively selects music to be played in accordance with the driving route. There is an effect of knowing the information and order without interfering with driving.

Additionally, the driver can view the music visualization list 70 displayed on the second screen 242 and easily change the playback order of the music using touch as shown in FIG. 17. In the case of the prior art, in the future Because the style of music being played cannot be known in advance, the user or driver cannot remove it from the music list or change the order in which it is played without listening to music of a style that is not preferred. However, as in the present invention, if information about all music existing in the music list is displayed as visual information and provided to the user, the user can intuitively know information about the music included in the playlist at a glance, so that he or she can not listen to the actual music. There is an effect that can change the order of music played in the music list or remove music without it.

In addition, as shown in FIG. 17, the present invention can easily change the music playback order by using the touch pad while driving, thereby reducing the possibility of an accident occurring while the driver unreasonably changes the playback order of music. There are advantages that can be achieved.

Figure 18 is a diagram illustrating a screen displayed on a display unit according to another embodiment of the present invention.

The control unit 230 divides the driving route into a plurality of sections based on the time of each music present in the music list, and then creates a music visualization list ( 70) can be displayed on the second screen.

For example, if the estimated time required to reach the destination based on the current location is expected to be as long as the time for 4 songs to be played, the control unit 230 divides the section to the destination into a total of 4 sections in proportion to the playing time of each music. After being divided into (section A, section B, section C and section D), a music visualization list 70 containing visual information 10 about the music played in each section is presented as shown in FIG. 18. It can be displayed on screen 2 (242).

As shown in FIG. 18, when driving route information is displayed on the first screen 241 and the corresponding music visualization list 70 is displayed on the second screen 242, the driver intuitively knows the future direction while driving. There is an advantage in being able to know information about the music to be played for each driving section. Therefore, there is an advantage in that the driver can easily change the order of the music list by looking at the music visualization list 70 so that the music he wants is played according to the driving environment for each section. The method of changing the order of music played for each section can be changed by the method described in FIG. 17.

So far, we have looked at the drawings in detail about the method and device for providing music information visualization services and the navigation system that includes them.

A method and device for providing a music information visualization service according to an embodiment visually displays information about the relative sizes of various properties of music using shapes, allowing the user to view the various properties of music at a glance. There is an advantage in being able to know information intuitively.

In addition, the navigation system according to one embodiment provides the driver with a music visualization list containing visual information about music corresponding to the driving route along with the driving route, so the driver intuitively receives information about music to be played in the future. There is an effect of knowing without interfering with driving.

Meanwhile, the components, units, modules, components, etc. described in this specification as "~ part" may be implemented together or individually as separate but interoperable logic devices. The description of different features for modules, units, etc. is intended to highlight different functional embodiments and does not necessarily imply that they must be realized by individual hardware or software components. Rather, functionality associated with one or more modules or units may be performed by separate hardware or software components or may be integrated within common or separate hardware or software components.

Although operations are shown in the drawings in a particular order, it should not be understood that these operations are to be performed in the particular order shown, or sequential order, or that all depicted operations need to be performed to achieve the desired results. .In some environments, multitasking and parallel processing may be advantageous. Moreover, the distinction of various components in the above-described embodiments should not be construed as requiring such a distinction in all embodiments, and the described components may generally be integrated together into a single software product or packaged into multiple software products. It must be understood that it can be done.

A computer program (also known as a program, software, software application, script, or code) may be written in any form of a programming language, including a compiled or interpreted language, or an a priori or procedural language, as a stand-alone program or module; It can be deployed in any form, including components, subroutines, or other units suitable for use in a computer environment.

Additionally, the logical flow and structural block diagram described in this patent document describe corresponding actions and/or specific methods supported by corresponding functions and steps supported by the disclosed structural means, and correspond to It can also be used to build software structures and algorithms and their equivalents.

The processes and logic flows described herein can be performed by one or more programmable processors, one or more of which execute computer programs to perform functions by operating on input data and generating output.

The present description sets forth the best mode of the invention and provides examples to illustrate the invention and to enable any person skilled in the art to make or use the invention. The specification prepared in this way does not limit the present invention to the specific terms presented.

Although the present invention has been described above with reference to preferred embodiments, those skilled in the art or have ordinary knowledge in the relevant technical field should not deviate from the spirit and technical scope of the present invention as set forth in the claims to be described later. It will be understood that the present invention can be modified and changed in various ways within the scope of the present invention. Therefore, the technical scope of the present invention should not be limited to what is described in the detailed description of the specification, but should be determined by the scope of the patent claims.

100: Music information visualization service provision device
110: Music list creation unit
120; Music information generation unit
130: Visual information generation unit
200: Navigation device
210: Department of Communications
220: Driving path creation unit
230: control unit
240: Display unit

Claims (5)

a driving path generator that generates driving path information based on information to the destination input by the user;
A display unit that displays the driving route information;
a recommended music list generator that generates a recommended music list corresponding to the driving route information based on the input information entered by the user and the driving route information;
a music information generator that analyzes music in the recommended music list and generates music information for each attribute of the music;
Mapping a shape to express the properties of the attribute according to a predetermined mapping method, and modifying at least one of the size, length, thickness, and color of the shape, the relative size to the numerical value included in the music information a visual information generating unit that generates visual information containing information; and
A control unit that displays a music visualization list displayed by matching the visual information to music existing in the recommended music list on a display unit together with the driving route information;
A navigation device that provides navigation services using a music information visualization method. According to clause 1,
The driving route information is,
Containing at least one of information about the expected average moving speed for each section to the destination, information about the destination, information about the route environment to the destination, information about the current time, and information about the current weather,
A navigation device that provides navigation services using music information visualization methods. According to clause 2,
The control unit,
An interface through which the user can change the order of music in the music visualization list is provided to the user through the display unit, and the user changes the order of music in the music visualization list. , displaying a music visualization list according to the changed order on the display unit,
A navigation device that provides navigation services using music information visualization methods. According to clause 2,
The control unit,
The driving path is classified and displayed on the display unit in consideration of the playback order and playback time of the music existing in the music visualization list.
A navigation device that provides navigation services using a music information visualization method. Analyzing music existing in a music list and generating music information for each attribute of the music;
Mapping a shape to express the properties of the attribute according to a predetermined mapping method, and modifying at least one of the size, length, thickness, and color of the shape, the relative size to the numerical value included in the music information generating visual information containing information;
generating music visualization information displayed by matching the visual information to music existing in the music list; and
After generating driving route information based on information to the destination input from the user, a music visualization list displayed by matching the visual information to music existing in the music list is displayed on the display unit together with the driving route information. Including steps;
The shape includes at least one of a triangle, square, pentagon, hexagon, circle, ellipse, and arc,
The properties include the size of the RMS (Root Mean Square) of the music, the type of genre, the degree of mood, the degree of tempo, and the proportion of vocals in the music. and a method of providing a navigation service using a music information visualization method, including at least one of the overall structure of the music.