KR102598242B1 - Electronic apparatus and method for controlling thereof - Google Patents

Abstract

The present invention relates to an electronic device and a control method thereof, including a user interface, a communication interface, a speaker, a memory, and a processor, where the processor enters a radio mode when a preset user command is input, and the radio When entering the mode, meta information about the music included in the playlist is obtained, keywords included in the obtained meta information are extracted, and keywords extracted to obtain detailed information about the music based on the keywords is sent to the search server, detailed information about the music included in the playlist is received from the search server, and a description of the music included in the playlist and the music included in the playlist are output based on the obtained detailed information. .

Description

Electronic device and method for controlling the same {ELECTRONIC APPARATUS AND METHOD FOR CONTROLLING THEREOF}

The present disclosure relates to an electronic device and a control method thereof, and more specifically, to an electronic device and a control method thereof that provide a description of the music to the user as if listening to the radio while playing music included in a playlist. .

Methods of listening to music include playing music included in a playlist stored on an electronic device or server or listening to the radio.

Playlists stored on electronic devices or servers may be music that has been selected and organized by individuals according to their preferences, organized by a third party and shared online, or organized by a music streaming service provider by period, genre, or country. It could be a music chart sorted by star popularity. Users can download and play music included in a playlist stored on an electronic device or server on an electronic device, or listen to music online through real-time streaming. In this case, the user can selectively listen to the music they want according to their preference, but there is a disadvantage that the individual cannot listen to a separate explanation of the music, so to obtain information about the music, the individual must find the information through a web search on their own.

In contrast, when listening to music through the radio, radio signals are received through an electronic device and the broadcasted radio broadcast is listened to. When listening to music through the radio, the radio broadcaster provides an explanation of the music so you can hear about the artist, reputation, and background knowledge of the music. However, there is the inconvenience of having to listen to music that the individual does not want to listen to.

Therefore, there is a need to find a way to selectively listen to music according to individual preferences while simultaneously listening to information related to the music being listened to as if listening to the radio.

The present disclosure is designed to solve the above-described problem, and the purpose of the present disclosure is to provide an electronic device and a control method for the same that provide a description of the music before and after playing each piece of music while listening to music included in a playlist. It is in

The electronic device according to this embodiment for achieving the above-described purpose includes a user interface, a communication interface, a speaker, a memory, and a processor, and the processor switches to radio mode when a preset user command is input. When entering the radio mode, meta information about music included in the playlist is obtained, keywords included in the obtained meta information are extracted, and detailed information about the music is based on the keywords. Transmitting the extracted keyword to a search server to obtain information, receiving detailed information about music included in the playlist from the search server, and music included in the playlist based on the obtained detailed information A description of and music included in the playlist can be output.

Meanwhile, the processor may receive a description of the music included in the playlist and detailed information about a plurality of pieces of music included in the playlist before starting to output the music included in the playlist.

Meanwhile, the processor inputs the received detailed information into a natural language synthesis neural network model to synthesize descriptions of music included in the playlist into natural language in text format, and converts the synthesized natural language in text format into voice. Can be printed.

Meanwhile, the processor identifies the type of voice to be output based on the genre of the music extracted from the meta information about the music included in the playlist, and converts the natural language in the synthesized text format into the identified type of voice. It is converted and output, and the type of voice may be one of a male voice, a female voice, and a celebrity voice.

Meanwhile, the processor identifies previously output detailed information among the received detailed information, and provides a description of music included in the playlist and the playlist based on detailed information different from the identified previously output detailed information. You can output music included in .

Meanwhile, if the preset user command is input while outputting the first music included in the playlist, the processor may enter the radio mode starting with the second music to be output after the first music.

Meanwhile, the keyword may be a keyword related to at least one of the song name, singer name, genre, and release year extracted from meta information about music included in the playlist.

Meanwhile, the detailed information may be information about at least one of song title information, singer name information, release date information, album information, lyricist and composer information, related artist information, and history information of the music.

A method of controlling an electronic device according to an embodiment of the present disclosure includes the steps of entering a radio mode when a preset user command is input, and when entering the radio mode, metadata for music included in a playlist. Obtaining information, extracting a keyword included in the obtained meta information, transmitting the extracted keyword to a search server to obtain detailed information about the music based on the keyword, Receiving detailed information about music included in the playlist from the search server and outputting a description of the music included in the playlist and the music included in the playlist based on the obtained detailed information. may include.

Meanwhile, the step of receiving the detailed information includes receiving a description of the music included in the playlist and detailed information about a plurality of music included in the playlist before starting to output the music included in the playlist. It may include steps.

Meanwhile, the output step includes inputting the received detailed information into a natural language synthesis neural network model to synthesize a description of music included in the playlist into natural language in text format, and converting the synthesized natural language in text format into voice. It may include the step of converting and outputting.

Meanwhile, the output step includes identifying the type of voice to be output based on the genre of the music extracted from meta information about the music included in the playlist, and converting the natural language in the synthesized text format into the identified It includes the step of converting and outputting a type of voice, and the type of voice may be one of a male voice, a female voice, and a celebrity voice.

Meanwhile, the output step includes identifying previously output detailed information among the received detailed information, and a description of music included in the playlist based on detailed information different from the identified previously output detailed information. It may include outputting music included in the playlist.

Meanwhile, in the step of entering the radio mode, if the preset user command is input while outputting the first music included in the playlist, the radio mode is entered starting from the second music to be output after the first music. A control method comprising:

Meanwhile, the keyword may be a keyword related to at least one of the song name, singer name, genre, and release year extracted from meta information about music included in the playlist.

Meanwhile, the detailed information may be information about at least one of song title information, singer name information, release date information, album information, lyricist and composer information, related artist information, and history information of the music.

While listening to music selectively according to individual preferences, you can also listen to information related to the music you are listening to before and after playing the music, just like listening to the radio.

1 is a diagram for explaining an electronic device and a server according to an embodiment of the present disclosure.
FIG. 2 is a block diagram for explaining components of an electronic device according to an embodiment of the present disclosure.
FIG. 3 is a diagram for explaining meta information included in music data according to various embodiments of the present disclosure.
FIG. 4 is a diagram illustrating a natural language synthesis neural network model according to various embodiments of the present disclosure.
FIG. 5 is a diagram illustrating a description of music included in a playlist synthesized in natural language in text format, according to an embodiment of the present disclosure.
FIG. 6 is a flowchart for explaining the operation of an electronic device according to an embodiment of the present disclosure.

Since these embodiments can be modified in various ways and have various embodiments, specific embodiments will be illustrated in the drawings and described in detail in the detailed description. However, this is not intended to limit the scope to specific embodiments, and should be understood to include various modifications, equivalents, and/or alternatives to the embodiments of the present disclosure. In connection with the description of the drawings, similar reference numbers may be used for similar components.

In describing the present disclosure, if it is determined that a detailed description of a related known function or configuration may unnecessarily obscure the gist of the present disclosure, the detailed description thereof will be omitted.

In addition, the following examples may be modified into various other forms, and the scope of the technical idea of the present disclosure is not limited to the following examples. Rather, these embodiments are provided to make the present disclosure more faithful and complete and to completely convey the technical idea of the present disclosure to those skilled in the art.

The terms used in this disclosure are merely used to describe specific embodiments and are not intended to limit the scope of rights. Singular expressions include plural expressions unless the context clearly dictates otherwise.

In the present disclosure, expressions such as “have,” “may have,” “includes,” or “may include” refer to the presence of the corresponding feature (e.g., component such as numerical value, function, operation, or part). , and does not rule out the existence of additional features.

In the present disclosure, expressions such as “A or B,” “at least one of A or/and B,” or “one or more of A or/and B” may include all possible combinations of the items listed together. . For example, “A or B,” “at least one of A and B,” or “at least one of A or B” includes (1) at least one A, (2) at least one B, or (3) it may refer to all cases including both at least one A and at least one B.

Expressions such as “first,” “second,” “first,” or “second,” used in the present disclosure can modify various components regardless of order and/or importance, and can refer to one component. It is only used to distinguish from other components and does not limit the components.

A component (e.g., a first component) is “(operatively or communicatively) coupled with/to” another component (e.g., a second component). When referred to as “connected to,” it should be understood that a certain component can be connected directly to another component or connected through another component (e.g., a third component).

On the other hand, when a component (e.g., a first component) is said to be "directly connected" or "directly connected" to another component (e.g., a second component), It may be understood that no other components (e.g., third components) exist between the elements.

The expression “configured to” used in the present disclosure may mean, for example, “suitable for,” “having the capacity to,” depending on the situation. ," can be used interchangeably with "designed to," "adapted to," "made to," or "capable of." The term “configured (or set to)” may not necessarily mean “specifically designed to” in hardware.

Instead, in some contexts, the expression “a device configured to” may mean that the device is “capable of” working with other devices or components. For example, the phrase "processor configured (or set) to perform A, B, and C" refers to a processor dedicated to performing the operations (e.g., an embedded processor), or by executing one or more software programs stored on a memory device. , may refer to a general-purpose processor (e.g., CPU or application processor) capable of performing the corresponding operations.

In an embodiment, a 'module' or 'unit' performs at least one function or operation, and may be implemented as hardware or software, or as a combination of hardware and software. Additionally, a plurality of 'modules' or a plurality of 'units' may be integrated into at least one module and implemented with at least one processor, except for 'modules' or 'units' that need to be implemented with specific hardware.

Meanwhile, various elements and areas in the drawing are schematically drawn. Accordingly, the technical idea of the present invention is not limited by the relative sizes or spacing drawn in the attached drawings.

Hereinafter, with reference to the attached drawings, embodiments according to the present disclosure will be described in detail so that those skilled in the art can easily implement them.

The electronic device 200 according to an embodiment of the present disclosure includes a mobile device, a wearable device, a smart phone, a CD player, a DVD player, a cassette player, a media box (e.g., Samsung HomeSyncTM, Apple TVTM, or Google TVTM), and a desktop computer. , It can be implemented in various devices that can provide audio media content, such as laptop computers, tablets, speakers, TVs, etc. The electronic device 200 is not limited to the above-mentioned devices, and the electronic device 200 may be implemented as an electronic device 200 having two or more functions of the above-mentioned devices.

Additionally, the electronic device 200 may be connected to other external devices and operate to perform one or more functions.

1 is a diagram for explaining an electronic device and a server according to an embodiment of the present disclosure.

Referring to FIG. 1, the electronic device 200 may perform one or more functions by transmitting or receiving information through a communication connection with the server 100, and the server may be a search server. For example, in order to obtain detailed information about music, the electronic device 200 may perform a web search operation by transmitting keywords extracted from meta information included in music to the server 100. The electronic device 100 may receive detailed information about music from the server 100. However, without being limited to the above-described embodiment, the electronic device 200 receives detailed description data about music synthesized in natural language in text format from the server 100 based on detailed information about music obtained as a result of a web search. You may.

FIG. 2 is a block diagram for explaining components of an electronic device according to an embodiment of the present disclosure.

The user interface 210 may include buttons, levers, switches, touch-type interfaces, etc., and the touch-type interface may be switches, levers, etc. that detect changes in capacitance. , It can also be implemented by receiving input through the user's touch on the display screen (not shown). Additionally, the user interface 210 may recognize a user's gesture and receive a user command even when there is no direct contact between the user's body and the electronic device 200.

The processor 250 may receive user commands for all operations related to the radio mode through the user interface 210. Specifically, the processor 250 may receive user input through the user interface 210 to enter or exit the radio mode, and may temporarily stop the radio mode.

Communication interface 220 may include a wireless communication interface, a wired communication interface, or an input interface. The wireless communication interface can communicate with various external devices using wireless communication technology or mobile communication technology. These wireless communication technologies include, for example, Bluetooth, Bluetooth Low Energy, CAN communication, Wi-Fi, Wi-Fi Direct, and ultra-wideband communication. (UWB, ultrawide band), Zigbee, IrDA (infrared Data Association), or NFC (Near Field Communication) may be included, and mobile communication technologies include 3GPP and Wi-Max. , LTE (Long Term Evolution), 5G, etc. may be included. A wireless communication interface can be implemented using an antenna, a communication chip, a board, etc. that can transmit electromagnetic waves to the outside or receive electromagnetic waves transmitted from the outside.

The wired communication interface can communicate with various external devices based on a wired communication network. Here, the wired communication network may be implemented using physical cables such as, for example, a pair cable, a coaxial cable, an optical fiber cable, or an Ethernet cable.

Either the wireless communication interface or the wired communication interface may be omitted depending on the embodiment. Accordingly, the electronic device 200 may include only a wireless communication interface or only a wired communication interface. In addition, the electronic device 200 may be equipped with an integrated communication interface that supports both wireless connection using a wireless communication interface and wired connection using a wired communication interface.

The electronic device 200 is not limited to including one communication interface 220 that performs a single type of communication connection, and may include a plurality of communication interfaces 220.

The processor 250 according to various embodiments of the present disclosure may communicate with a server or an external electronic device through the communication interface 220.

Specifically, the processor 250 may establish a communication connection with the server 100 through the communication interface 220, and the server 100 may be a search server. The processor 250 may perform a web search operation by transmitting keywords extracted from meta information included in the music to the server 100 to obtain detailed information about the music through the communication interface 220. The electronic device 100 may receive detailed information about music from the server 100. However, without being limited to the above-described embodiment, the processor 250 may receive detailed description data about music synthesized in natural language in text format from the server 100 based on detailed information about the music obtained as a result of a web search. It may be possible.

The processor 250 may transmit or receive information by performing a communication connection with an external electronic device (not shown) through the communication interface 220. Specifically, the processor 250 performs a communication connection with one or more external computers, TVs, speakers, etc. through the communication interface 220 to provide a text format obtained based on music sounds included in the playlist or detailed information about the music. A description of music made up of synthesized natural language can be output.

The speaker 230 includes a tweeter for reproducing high-pitched sounds, a midrange for reproducing mid-range sounds, a woofer for reproducing low-pitched sounds, a subwoofer for reproducing extremely low-pitched sounds, an enclosure for controlling resonance, and an input signal to the speaker. It may be comprised of a crossover network that divides the electrical signal frequency into bands.

The speaker 230 may output an acoustic signal to the outside of the electronic device 200. The speaker 230 can output multimedia playback, recording playback, various notification sounds, voice messages, etc. The electronic device 200 may include an audio output device such as the speaker 230, or may include an output device such as an audio output terminal. In particular, the speaker 230 can provide acquired information, information processed and produced based on the acquired information, response results to the user's voice, or operation results, etc. in voice form.

The processor 250 may output, through the speaker 230, a description of the music composed of natural language synthesized in a text format obtained based on music sounds included in the playlist or detailed information about the music.

The memory 240 temporarily or non-temporarily stores various programs or data, and transmits the stored information to the processor 250 according to a call from the processor 120. Additionally, the memory 240 can store various information necessary for calculation, processing, or control operations of the processor 250 in an electronic format.

The memory 240 may include, for example, at least one of a main memory and an auxiliary memory. The main memory may be implemented using semiconductor storage media such as ROM and/or RAM. ROM may include, for example, conventional ROM, EPROM, EEPROM, and/or MASK-ROM. RAM may include, for example, DRAM and/or SRAM. Auxiliary storage devices include flash memory devices, SD (Secure Digital) cards, solid state drives (SSDs), hard disk drives (HDDs), magnetic drums, compact disks (CDs), and DVDs. ) or an optical recording medium such as a laser disk, magnetic tape, magneto-optical disk, and/or floppy disk, etc. may be implemented using at least one storage medium capable of storing data permanently or semi-permanently.

The memory 240 includes music included in the playlist, meta information about the music, keywords extracted from the meta information about the music, detailed information about the music, a natural language synthesis neural network model, and music composed of natural language synthesized in text format. Description data can be saved.

The processor 250 controls the overall operation of the electronic device 200. Specifically, the processor 160 is connected to the configuration of the electronic device 200 including the memory 240 as described above, and executes at least one instruction stored in the memory 240 as described above, thereby controlling the electronic device ( 200) can be controlled overall. In particular, the processor 250 may be implemented not only as one processor 250 but also as a plurality of processors 250.

Processor 250 may be implemented in various ways. For example, the processor 250 may include an application specific integrated circuit (ASIC), an embedded processor, a microprocessor, hardware control logic, a hardware finite state machine (FSM), and a digital signal processor. Processor, DSP).

Meanwhile, in the present disclosure, the processor 250 includes a central processing unit (CPU), a micro controller unit (MCU), a micro processing unit (MPU), a controller, and an application processor that process digital signals. It may include one or more of a processor (AP), a communication processor (CP), or an ARM processor, or may be defined by that term. Additionally, the processor 160 may be implemented as a System on Chip (SoC) with a built-in processing algorithm, large scale integration (LSI), or may be implemented in the form of a Field Programmable Gate Array (FPGA). The processor 250 can perform various functions by executing computer executable instructions stored in the memory 240. In addition, in order to perform artificial intelligence functions, the processor 250 may include at least one of a separate AI-specific processor: GPU (graphics-processing unit), NPU (Neural Processing Unit), and VPU (Visual Processing Unit). there is.

A specific method of controlling the electronic device 200 by the processor 250 will be described in detail with reference to FIGS. 3 to 5.

When a preset user command is input through the user interface 210, the processor 250 may enter radio mode.

Here, the radio mode is an operation mode that outputs information about the music in the form of natural language before and after playing the music, as if listening to the radio.

If a preset user command is input while outputting the first music included in the playlist, the processor 250 may control the electronic device 200 to enter the radio mode starting from the second music to be output after the first music. there is.

When entering the radio mode, the processor 250 can obtain meta information about music included in the playlist.

FIG. 3 is a diagram for explaining meta information included in music data according to various embodiments of the present disclosure.

Referring to FIG. 3, the music data 300 includes a song name 310 indicating the title of the music, a name of the singer 320, and a genre 330 of the music (e.g., ballad, hip-hop, rock, soul, children's song, classical music, Opera, jazz) and the year of music release (340) may be included, but are not limited to this and may include various meta information related to music.

The processor 250 may extract keywords included in the obtained meta information. Keywords extracted from meta information include the song name (310), the name of the music artist (320), the genre of the music (330) (e.g. ballad, hip-hop, rock, soul, children's song, classical music, opera, jazz), and the year of music release ( It may be related to at least one of 340).

For example, the processor 250 may extract keywords from “Hey Jude,” which is the song name (310), “Beatles,” which is the singer’s name (320), and “1968,” which is the year of release (340), among the meta information about music. .

The processor 250 may perform a communication connection with the search server 100 through the communication interface 220 to obtain detailed information about music based on the extracted keywords and transmit the extracted keywords to the search server 100. there is. The processor 250 may perform a communication connection with the search server 100 through the communication interface 220 and receive detailed information about music obtained through a keyword-based search from the search server 100.

The detailed information may be at least one of music song title information, singer name information, release date information, album information, lyricist and composer information, related artist information, and history information.

For example, the details obtained include release date information such as "August 26, 1968" in written form or in the form of a list of words, album information "Single Track", and lyricist and composer information "Paul McCartney". ,It could be historical information,"one of the greatest songs in the history of popular music."

Here, the processor 250 can obtain detailed information about individual music included in the playlist in real time while music is being played in radio mode. However, without being limited thereto, the processor 250 provides a description of the music included in the playlist and a plurality of music included in the playlist or all music included in the playlist before starting to output the music included in the playlist. You can receive detailed information about In this case, since detailed information about the music can be obtained in advance before music playback begins, delays due to information processing during music playback can be prevented.

For example, the processor 250 operates to obtain detailed information about each piece of music in real time while playing music included in a playlist consisting of “Hey Jude,” “My heart will go on,” and “Let it be.” However, before starting to play the music included in the playlist and output descriptions for the music, Detailed information can also be obtained in advance.

The processor 250 may input detailed information about the received music into a natural language synthesis neural network model and synthesize a description of the music included in the playlist in natural language in text format.

FIG. 4 is a diagram illustrating a natural language synthesis neural network model according to various embodiments of the present disclosure, and FIG. 5 is a diagram for music included in a playlist synthesized in natural language in text format according to an embodiment of the present disclosure. This is a drawing showing the explanation.

Referring to FIG. 4, the processor 250 inputs detailed information about the music 410 into the natural language synthesis neural network model 420, and provides a detailed description of the music delivered to listeners by an actual radio DJ through broadcasting in text. Natural language 430 in text format can be obtained.

For example, the processor 250 stores release date information such as “August 26, 1968,” album information “Single Track,” and lyricist and composer information “Paul McCartney,” which are in written form or in the form of a list of words. , one of the greatest masterpieces in the history of popular music,” input detailed music information (410), such as historical information, into the natural language synthesis neural network model (420) to obtain a natural language (430) in text format expressing a detailed description of the music in text. However, the processor 250 is not limited to this, and the processor 250 converts the meta information obtained from the music data 300, such as the song name information “Hey Jude” and the singer name information “Beatles”, into natural language along with the detailed information 410. By inputting it into the synthetic neural network model 420, natural language 430 in a text format expressing a detailed description of music can be obtained.

Specifically, referring to FIG. 5, the processor 250 uses the natural language synthesis neural network model 420 to display “This song is Hey Jude by the Beatles” (510), “To” (520), and “I did it” (530). ), “This song is” (540), and “It is often chosen” (550).

Here, a neural network model can be designed to simulate the human brain structure on a computer. An artificial intelligence model may include a plurality of network nodes with weights that simulate neurons of a human neural network. A plurality of network nodes can each form a connection relationship to simulate synaptic activity in which neurons send and receive signals through synapses. The artificial intelligence model may include, for example, a neural network model or a deep learning model developed from a neural network model. In a deep learning model, multiple network nodes are located at different depths (or layers) and can exchange data according to convolutional connections. For example, models such as Deep Neural Network (DNN), Recurrent Neural Network (RNN), and Bidirectional Recurrent Deep Neural Network (BRDNN) may be used as artificial intelligence models, but are not limited thereto.

Specifically, the neural network model may include multiple artificial neural network layers. Artificial neural networks include deep neural network (DNN), convolutional neural network (CNN), recurrent neural network (RNN), restricted boltzmann machine (RBM), belief deep network (DBN), bidirectional recurrent deep neural network (BRDNN), It may be one of deep Q-networks or a combination of two or more of the above, but is not limited to the examples described above. In addition to hardware structures, artificial intelligence models may additionally or alternatively include software structures.

A neural network model may include a learning algorithm. For example, it may include supervised learning, unsupervised learning, semi-supervised learning, or reinforcement learning, but is not limited to the examples described above. An artificial intelligence model may include multiple artificial neural network layers.

Additionally, the natural language synthesis neural network model 420 according to the present disclosure may be ELMo (Embedding from Language Model) or BERT (Bidirectional Encoder Representation of Transformer) for Natural Language Processing (NLP).

As described above, the processor 250 can convert a description of music in natural language 430 in text format obtained based on the detailed information 410 into voice and output it together before and after outputting the music being played.

Here, the processor 250 can identify the type of voice to be output, such as a male voice, a female voice, a celebrity voice, etc., based on the genre of music 330 extracted from meta information about music included in the playlist. In addition, a description of music made up of natural language 430 in a synthesized text format can be converted into an identified type of voice and output.

For example, if the genre of music 330 is “ballad,” the processor 250 can identify the type of voice as a male celebrity voice with a mid-low pitch, and provide a description of the music in natural language 430 in text format. can be output as a low-pitched male celebrity voice.

However, not limited to this, the processor 250 receives a user command through the user interface 210, identifies the type of voice to be output, and provides a description of the music in natural language 430 in text format using the identified type of voice. Of course, it can be converted to and output.

The processor 250 according to another embodiment of the present disclosure identifies detailed information 410 that has been previously output in natural language 430 in text format among the received detailed information 410, and identifies the previously output detailed information ( A description of the music included in the playlist and the music included in the playlist can be output based on detailed information 410 that is different from 410).

For example, the processor 250 may identify whether the album information “Single Track” and the lyricist and composer information “Paul McCartney” are already printed detailed information 410.

Here, the processor 250 controls to store a description of music based on the previously output detailed information 410 in the memory 240 or the server 100, and based on the stored previously output detailed information 410, the current It is possible to identify whether the description of the music to be output refers to the detailed information 410 that has already been output.

If the album information called "Single Track" and the lyricist and composer information called "Paul McCartney" are identified as previously printed detailed information 410, the processor 250 processes the album information called "Single Track" and the lyricist and composer information called "Paul McCartney". By outputting a description of the music obtained based on detailed information 410 that is different from the lyricist and composer information, it is possible to prevent the problem of causing fatigue to the user by repeatedly providing the same content to the user.

As described above, the processor 250 outputs the music included in the playlist and a description of the music together, providing an experience similar to listening to music included in a playlist organized according to the user's preferences as if listening to the radio. You can.

FIG. 6 is a flowchart for explaining the operation of an electronic device according to an embodiment of the present disclosure.

When a preset user command is input, the electronic device 200 may enter the radio mode (S610). Here, if a preset user command is input while outputting the first music included in the playlist, the electronic device 100 may enter the radio mode starting with the second music to be output after the first music.

When entering the radio mode, the electronic device 200 can obtain meta information about music included in the playlist (S620).

The electronic device 200 may extract a keyword included in the acquired meta information (S630). Here, the keyword may be a keyword related to at least one of the song name 310, singer name 320, genre 330, and release year 340 extracted from meta information about music included in the playlist.

The electronic device 200 may transmit the extracted keyword to the search server 100 to obtain detailed information 410 about music based on the keyword (S640).

The electronic device 200 may receive detailed information 410 about music included in the playlist from the search server 100 (S650). Here, the electronic device 200 may receive a description of the music included in the playlist and detailed information 410 about a plurality of music included in the playlist before starting to output the music included in the playlist. .

The electronic device 200 may output a description of the music included in the playlist and the music included in the playlist based on the acquired detailed information 410 (S660). Here, the electronic device 200 inputs the received detailed information 410 into the natural language synthesis neural network model 420 to synthesize the description of the music included in the playlist in natural language in text format, and natural language in the synthesized text format ( 430) can be converted to voice and output. In addition, the electronic device 200 identifies the type of voice to be output, such as a male voice, a female voice, a celebrity voice, etc., based on the genre of music 330 extracted from meta information about music included in the playlist, and synthesized Natural language 430 in text format can be converted into an identified type of voice and output. The electronic device 200 identifies previously output detailed information 410 among the received detailed information 410 and includes it in the playlist based on detailed information 410 that is different from the identified previously output detailed information 410. You can output a description of the music and the music included in the playlist.

According to one embodiment, methods according to various embodiments disclosed in this document may be included and provided in a computer program product. Computer program products are commodities and can be traded between sellers and buyers. The computer program product may be distributed in the form of a machine-readable storage medium (e.g. compact disc read only memory (CD-ROM)) or through an application store (e.g. Play StoreTM) or on two user devices (e.g. It can be distributed (e.g. downloaded or uploaded) directly between smartphones) or online. In the case of online distribution, at least a portion of the computer program product (e.g., a downloadable app) is stored on a machine-readable storage medium, such as the memory of a manufacturer's server, an application store's server, or a relay server. It can be temporarily stored or created temporarily.

In the above, preferred embodiments of the present disclosure have been shown and described, but the present disclosure is not limited to the specific embodiments described above, and may be used in the technical field pertaining to the disclosure without departing from the gist of the disclosure as claimed in the claims. Of course, various modifications can be made by those skilled in the art, and these modifications should not be understood individually from the technical ideas or perspectives of the present disclosure.

200: electronic device
210: User interface
220: communication interface
230: speaker
240: memory
250: processor

Claims (16)

In electronic devices,
user interface;
communication interface;
speaker;
Memory; and
Including a processor;
The processor,
When a preset user command is entered, it enters Radio Mode,
When entering the radio mode, obtain meta information about music included in the playlist,
Extract keywords included in the obtained meta information,
Transmitting the extracted keywords to a search server to obtain detailed information about the music based on the keywords,
Receiving first detailed information in text format about music included in the playlist from the search server,
Inputting the first detailed information into a natural language synthesis neural network model to synthesize the description of the music included in the playlist into second detailed information in the form of a sentence,
An electronic device that simultaneously outputs a voice description of the music, which is a result of converting the second detailed information into voice, and the music included in the playlist. According to paragraph 1,
The processor,
An electronic device that receives a description of the music included in the playlist and first detailed information in text format about a plurality of pieces of music included in the playlist before starting to output the music included in the playlist. delete According to claim 1,
The processor,
Identifying the type of voice to be output based on the genre of the music extracted from meta information about the music included in the playlist,
Converting and outputting the natural language in the synthesized text format into the identified type of voice,
The type of voice is one of a male voice, a female voice, and a celebrity voice. According to paragraph 1,
The processor,
Identify previously output detailed information among the received first detailed information,
An electronic device that simultaneously outputs the audio description of music included in the playlist and the music included in the playlist based on first detailed information excluding the previously output detailed information. According to paragraph 1,
The processor,
If the preset user command is input while outputting the first music included in the playlist, the electronic device enters the radio mode starting with the second music to be output after the first music. According to paragraph 1,
The above keywords are,
An electronic device that is a keyword related to at least one of the song name, singer name, genre, and release year extracted from meta information about music included in the playlist. According to paragraph 1,
The first detailed information in the text format is,
An electronic device that is information about at least one of song title information, singer name information, release date information, album information, lyricist and composer information, related artist information, and history information of the music. In a method of controlling an electronic device,
Entering a radio mode when a preset user command is input;
Upon entering the radio mode, obtaining meta information about music included in the playlist;
Extracting keywords included in the obtained meta information;
transmitting the extracted keyword to a search server to obtain detailed information about the music based on the keyword;
Receiving first detailed information in text format about music included in the playlist from the search server;
Inputting the first detailed information into a natural language synthesis neural network model to synthesize the description of the music included in the playlist into second detailed information in the form of a sentence; and
A control method comprising simultaneously outputting a voice description of the music, which is a result of converting the second detailed information into voice, and music included in the playlist. According to clause 9,
The step of receiving the detailed information is,
Receiving a description of the music included in the playlist and first detailed information in text format about a plurality of music included in the playlist before starting to output the music included in the playlist; comprising: Control method. delete According to clause 9,
The output step is,
identifying a type of voice to be output based on the genre of the music extracted from meta information about the music included in the playlist; and
Converting the natural language in the synthesized text format into the identified type of voice and outputting it,
The type of voice is one of a male voice, a female voice, and a celebrity voice. According to clause 9,
The output step is,
identifying previously output detailed information among the received first detailed information; and
A control method comprising simultaneously outputting the audio description of the music included in the playlist and the music included in the playlist based on first detailed information excluding the previously output detailed information. According to clause 9,
The step of entering the radio mode is,
If the preset user command is input while outputting the first music included in the playlist, entering the radio mode starting with the second music to be output after the first music. According to clause 9,
The above keywords are,
A control method that is a keyword related to at least one of the song name, singer name, genre, and release year extracted from meta information about music included in the playlist. According to clause 9,
The first detailed information in the text format is,
A control method, which is information about at least one of song name information, singer name information, release date information, album information, lyricist and composer information, related artist information, and history information of the music.

Images