Classifications

• • G—PHYSICS
  • G10—MUSICAL INSTRUMENTS; ACOUSTICS
  • G10H—ELECTROPHONIC MUSICAL INSTRUMENTS; INSTRUMENTS IN WHICH THE TONES ARE GENERATED BY ELECTROMECHANICAL MEANS OR ELECTRONIC GENERATORS, OR IN WHICH THE TONES ARE SYNTHESISED FROM A DATA STORE
  • G10H1/00—Details of electrophonic musical instruments

Definitions

• This disclosure relates to an information processing device and an information processing method.
• a generative AI model is a model that, in response to a prompt containing input information, generates content (generation results) based on any or a combination of the instructions, context, questions, and output format indicated by the prompt, and returns that content as response information.
• Patent Document 1 The technology itself for generating music content using generative AI models like the one described above already exists (see Patent Document 1).
• the purpose of this disclosure is to utilize a generative AI model to automatically generate music content appropriate for a scene estimated from the surrounding circumstances, user attributes and preferences, etc.
• the information processing device includes a reception unit that receives request information for generating music content suited to a scene, an acquisition unit that acquires information for scene estimation in response to the reception of the request information for generating the music content, an estimation unit that estimates a scene based on the acquired information for scene estimation, and an output unit that outputs an input sentence to a prompt for instructing the generation of music content based on the estimated scene.
• FIG. 1 is a configuration diagram of an entire system including an information processing device.
• FIG. 2 is a flow diagram of a process executed by the information processing device.
• FIG. 10 is a diagram illustrating an example of information for scene estimation.
• FIG. 10 is a diagram showing an example of an input sentence to a prompt.
• FIG. 10 is a diagram illustrating another example of a system configuration.
• FIG. 2 is a diagram illustrating an example of a hardware configuration of an information processing device.
• LLM large language model
• FIG. 1 illustrates a configuration diagram of a system 1 including an information processing device 10 according to the present disclosure.
• the system 1 includes an external server 30A running a large-scale language model (LLM) 30, the information processing device 10, and an external server 20A.
• the external server 20A stores various information, including, for example, a map information database (DB) 20, a music information database (DB) 21, and a user information database (DB) 22.
• the map information DB 20 stores map information used to estimate a user's current location and activity.
• the map information includes, for example, map data for various regions and information on various commercial facilities, event facilities, and buildings.
• the music information DB 21 stores reference information for generating music content tailored to a scene.
• the reference information includes, for example, information on various musicians, various music genres, and various song specifications (such as melody and length).
• the user information DB 22 stores various information about users, and the information about users includes, for example, user attribute information (information such as the user's age, gender, family structure, place of residence, occupation, and annual income), and user preference information (information such as favorite music genres (J-pop, techno, anime songs, classical, rock, dance music, etc.), and songs frequently listened to on video distribution sites and music distribution services).
• the information processing device 10 can employ various information processing devices (smartphones, mobile phones, smartwatches, wearable devices, laptops, desktop computers, servers, etc.) as hardware, but the information processing device 10 of this embodiment is intended to be a mobile device carried by the user (smartphones, mobile phones, smartwatches, wearable devices, etc.).
• the information processing device 10 has a RAG (Retrieval-Augmented Generation) system application installed, and the RAG system operates.
• the RAG system is a type of prompt extension technology used for corporate information sharing between LLMs. Specifically, when a generation request is made to an LLM using an instruction statement (input text to a prompt) based on a content generation request, the system searches for related information (reference information) in advance if necessary and requests the LLM to generate the obtained information along with the instruction statement.
• the information processing device 10 includes a reception unit 11, an acquisition unit 12, an estimation unit 13, and an output unit 14. The functions of each unit are described below.
• the reception unit 11 is a functional unit that receives request information for generating music content suitable for a scene.
• the request information for generating music content suitable for a scene is request information that is notified to the reception unit 11 when a generation request button provided on a web page or application page displayed on the display of the information processing device 10 is pressed.
• the acquisition unit 12 also searches the user information DB 22 using a user ID or other key to acquire user attribute information (e.g., the user's age, gender, family composition, place of residence, occupation, annual income, etc.) and user preference information (favorite music genres (J-pop, techno, anime songs, classical, rock, dance music, etc.), songs frequently listened to on video distribution sites and music distribution services, etc.). Additionally, if there is selection information individually entered by the user, that selection information is acquired from the reception unit 11.
• the estimation unit 13 is a functional unit that estimates a scene based on the acquired information for scene estimation.
• the estimation unit 13 estimates the current location and activity details that form the basis for scene estimation, based on the acquired current position information, acceleration information, and map information around the current location.
• the estimation unit 13 estimates the user's activity details based on information for scene estimation, such as (2) user attribute information, (3) user preference information, and (4) selection information individually input by the user.
• the estimation unit 13 estimates a scene from the current location and activity details. An example of estimating a scene in which a user is running in a park will be described later.
• the output unit 14 is a functional unit that outputs an input sentence (an instruction sentence exemplified in FIG. 4) to a prompt for instructing the generation of music content based on the estimated scene. Furthermore, the output unit 14 receives and outputs the generated music content as a generation result output from the LLM 30 in response to the input sentence to the prompt. Examples of the above-mentioned music content include music data in MP3 format or the like that can be played by a music playback application installed on the information processing device 10.
• the output unit 14 searches the music information DB 21 of the external server 20A to obtain reference information for generating music content suited to the scene (e.g., information related to musicians, music genres, and song specifications (melody, length, etc.)), and includes this information in the input text for the prompt.
• the music information DB 21 may be searched using keywords such as "music to listen to when you're in a mellow mood" to obtain famous hits and their descriptions as the reference information.
• expressions such as “soft” or “comfortable” may be used instead of "mellow,” or information related to genres such as “downtempo, trip-hop, ambient” may be used.
• the output unit 14 may include, as the above-mentioned reference information, information indicating the degree of the conditions for generating music content in the input sentence for the prompt. For example, by including "Techno 70%, J-Pop 30%" in the input sentence as in condition (2) shown in Figure 4, a techno song with J-Pop-like elements can be generated. By including information indicating the degree in this way, it is possible to instruct the generation of complex music content that seems as if it were thought up by a human. Note that the information indicating the degree may be information received from the user, or may be determined from information registered in advance by the operator.
• the output unit 14 may include conditions regarding playback time appropriate for the scene, conditions regarding playback volume appropriate for the scene, etc. in the input sentence for the prompt.
• the LLM 30 generates music content based on the above conditions as well, so it can be expected that the result generated by the LLM 30 will be music content that is more suited to the scene in terms of both playback time and playback volume.
• the output unit 14 may generate multiple candidate music content items, and include in the input sentence to the prompt a statement indicating that the music content to be output as the generated result will be determined from the multiple music content items based on the scene.
• the LLM 30 generates the music content based on the above instructions, so that the generated result by the LLM 30 can be expected to be music content that matches the scene at that time, and even if there is a scene change, music content that matches the new scene can be expected to be output quickly.
• the estimation unit 13 estimates a scene based on the information for scene estimation (step S2). For example, by comparing the user's current location information with map data, the estimation unit 13 estimates that the user's current location is within the grounds of Park A, and also determines the movement speed from the temporal progression of the location information, and estimates that the user is running from the movement speed, acceleration information, and user preference information (likes running), and estimates the scene as "running in Park A.”
• the output unit 14 outputs an input sentence (an instruction sentence to the LLM 30) to a prompt for instructing the creation of music content based on the scene.
• an input sentence including multiple items such as a role, a task, and a condition as shown in FIG. 4, "Role: You are a composer.”
• Task Generate background music. conditions (1) Use up-tempo background music that you can listen to while running. (2) The genre will be 70% techno and 30% J-pop. (3) The length should be approximately 30 minutes. (4) The playback volume should be loud.
• LLM 30 outputs the music content generated based on the scene as the generation result, and output unit 14 acquires and outputs the generation result (music content) from LLM 30 (step S4).
• the acquired music content is, for example, music data in MP3 format or the like that can be played by a music playback application installed on information processing device 10.
• the system 1 is not limited to the configuration shown in FIG. 1 , and may have a configuration in which the LLM 30 is implemented in the information processing device 10, as shown in FIG. 5 .
• This configuration can be realized by installing an application that executes the functions of the LLM 30 in the information processing device 10.
• FIGS. 1 and 5 show examples in which the map information DB 20, music information DB 21, and user information DB 22 are implemented outside the information processing device 10 (for example, on a network), at least one of these may be implemented inside the information processing device 10.
• the gist of the present disclosure lies in the following [1] to [8].
• a reception unit that receives request information for generating music content suitable for a scene; an acquisition unit that acquires information for scene estimation in response to reception of the music content generation request information; an estimation unit that estimates a scene based on the acquired information for scene estimation; an output unit that outputs an input sentence to a prompt for instructing the generation of music content based on the estimated scene.
• the acquisition unit acquires at least current position information, acceleration information, and map information as information for the scene estimation,
• the information processing device according to [1], wherein the estimation unit estimates a current location and activity content that are the basis for estimating the scene based on at least the position information, the acceleration information, and the map information.
• each functional block may be realized using a single device that is physically or logically coupled, or may be realized using two or more physically or logically separated devices that are directly or indirectly connected (e.g., wired, wireless, etc.) and these multiple devices.
• the functional block may also be realized by combining software with the single device or multiple devices.
• Functions include, but are not limited to, judgment, determination, assessment, calculation, computation, processing, derivation, investigation, search, confirmation, reception, transmission, output, access, resolution, selection, election, establishment, comparison, assumption, expectation, regard, broadcasting, notifying, communicating, forwarding, configuring, reconfiguring, allocating, mapping, and assignment.
• a functional block (component) that performs transmission functions is called a transmitting unit or transmitter.
• transmitting unit or transmitter As mentioned above, there are no particular limitations on how these functions are implemented.
• an information processing device may function as a computer that executes the processes of the present disclosure.
• Figure 6 is a diagram showing an example of the hardware configuration of an information processing device 10 according to an embodiment of the present disclosure.
• the information processing device 10 described above may be physically configured as a computer device including a processor 1001, memory 1002, storage 1003, a communication device 1004, an input device 1005, an output device 1006, a bus 1007, etc.
• the term "apparatus" can be interpreted as a circuit, device, unit, etc.
• the hardware configuration of the information processing device 10 may be configured to include one or more of the devices shown in the figure, or may be configured to exclude some of the devices.
• Each function of the information processing device 10 is realized by loading specific software (programs) onto hardware such as the processor 1001 and memory 1002, causing the processor 1001 to perform calculations, control communications via the communication device 1004, and control at least one of reading and writing data from and to the memory 1002 and storage 1003.
• the processor 1001 for example, runs an operating system to control the entire computer.
• the processor 1001 may be configured as a central processing unit (CPU) that includes an interface with peripheral devices, a control unit, an arithmetic unit, registers, etc.
• CPU central processing unit
• the processor 1001 reads programs (program code), software modules, data, etc. from at least one of the storage 1003 and the communication device 1004 into the memory 1002, and executes various processes in accordance with these.
• the programs used are those that cause a computer to execute at least some of the operations described in the above-mentioned embodiments. While the various processes have been described as being executed by a single processor 1001, they may also be executed simultaneously or sequentially by two or more processors 1001.
• the processor 1001 may be implemented by one or more chips.
• the programs may also be transmitted from a network via telecommunications lines.
• Memory 1002 is a computer-readable recording medium and may be composed of, for example, at least one of ROM (Read Only Memory), EPROM (Erasable Programmable ROM), EEPROM (Electrically Erasable Programmable ROM), RAM (Random Access Memory), etc. Memory 1002 may also be called a register, cache, main memory (primary storage device), etc. Memory 1002 can store executable programs (program code), software modules, etc. for implementing a wireless communication method according to one embodiment of the present disclosure.
• ROM Read Only Memory
• EPROM Erasable Programmable ROM
• EEPROM Electrical Erasable Programmable ROM
• RAM Random Access Memory
• Memory 1002 may also be called a register, cache, main memory (primary storage device), etc.
• Memory 1002 can store executable programs (program code), software modules, etc. for implementing a wireless communication method according to one embodiment of the present disclosure.
• Storage 1003 is a computer-readable recording medium, and may be composed of at least one of an optical disk such as a CD-ROM (Compact Disc ROM), a hard disk drive, a flexible disk, a magneto-optical disk (e.g., a compact disk, a digital versatile disk, a Blu-ray (registered trademark) disk), a smart card, flash memory (e.g., a card, a stick, a key drive), a floppy (registered trademark) disk, a magnetic strip, etc.
• Storage 1003 may also be referred to as an auxiliary storage device.
• the above-mentioned storage medium may be, for example, a database, a server, or other appropriate medium that includes at least one of memory 1002 and storage 1003.
• the communication device 1004 is hardware (transmission/reception device) for communicating between computers via at least one of a wired network and a wireless network, and is also referred to as a network device, network controller, network card, or communication module.
• the communication device 1004 may be configured to include a high-frequency switch, duplexer, filter, frequency synthesizer, etc. to realize at least one of frequency division duplex (FDD) and time division duplex (TDD).
• FDD frequency division duplex
• TDD time division duplex
• the input device 1005 is an input device (e.g., a keyboard, mouse, microphone, switch, button, sensor, etc.) that accepts input from the outside.
• the output device 1006 is an output device (e.g., a display, speaker, LED lamp, etc.) that outputs to the outside. Note that the input device 1005 and the output device 1006 may be integrated into one device (e.g., a touch panel).
• each device such as the processor 1001 and memory 1002, is connected by a bus 1007 for communicating information.
• the bus 1007 may be configured using a single bus, or may be configured using different buses for each device.
• the information processing device 10 may be configured to include hardware such as a microprocessor, a digital signal processor (DSP), an application-specific integrated circuit (ASIC), a programmable logic device (PLD), or a field-programmable gate array (FPGA), and some or all of the functional blocks may be realized by this hardware.
• the processor 1001 may be implemented using at least one of these pieces of hardware.
• the notification of information is not limited to the aspects/embodiments described in this disclosure and may be performed using other methods.
• the notification of information may be performed using physical layer signaling (e.g., DCI (Downlink Control Information), UCI (Uplink Control Information)), higher layer signaling (e.g., RRC (Radio Resource Control) signaling, MAC (Medium Access Control) signaling, broadcast information (MIB (Master Information Block), SIB (System Information Block))), other signals, or a combination of these.
• RRC signaling may be referred to as an RRC message, and may be, for example, an RRC Connection Setup message, an RRC Connection Reconfiguration message, etc.
• LTE Long Term Evolution
• LTE-A Long Term Evolution
• SUPER 3G IMT-Advanced
• 4G 4th generation mobile communication system
• 5G 5th generation mobile communication system
• 6G 6th generation mobile communication system
• xG xG (x is, for example, an integer or decimal number)
• FRA Full Radio Access Network
• the present invention may be applied to at least one of systems using IEEE 802.11 (Wi-Fi (registered trademark)), IEEE 802.16 (WiMAX (registered trademark)), IEEE 802.20 (Ultra-Wideband), Bluetooth (registered trademark), CDMA2000, NR (new Radio Access), NR (new radio), New radio access (NX), Future generation radio access (FX), W-CDMA (registered trademark), GSM (registered trademark), CDMA2000, UMB (Ultra Mobile Broadband), IEEE 802.11 (Wi-Fi (registere
• Input and output information may be stored in a specific location (for example, memory) or may be managed using a management table. Input and output information may be overwritten, updated, or added to. Output information may be deleted. Input information may be sent to another device.
• the determination may be made based on a value represented by one bit (0 or 1), a Boolean value (true or false), or a numerical comparison (for example, comparison with a predetermined value).
• notification of specified information is not limited to being done explicitly, but may also be done implicitly (e.g., not notifying the specified information).
• Software shall be construed broadly to mean instructions, instruction sets, code, code segments, program code, programs, subprograms, software modules, applications, software applications, software packages, routines, subroutines, objects, executable files, threads of execution, procedures, functions, etc., whether referred to as software, firmware, middleware, microcode, hardware description language, or otherwise.
• software, instructions, information, etc. may be transmitted and received via a transmission medium.
• a transmission medium such as coaxial cable, fiber optic cable, twisted pair, or Digital Subscriber Line (DSL)
• wired technology such as coaxial cable, fiber optic cable, twisted pair, or Digital Subscriber Line (DSL)
• wireless technology such as infrared or microwave
• the information, signals, etc. described in this disclosure may be represented using any of a variety of different technologies.
• data, instructions, commands, information, signals, bits, symbols, chips, etc. that may be referred to throughout the above description may be represented by voltages, currents, electromagnetic waves, magnetic fields or magnetic particles, optical fields or photons, or any combination thereof.
• a channel and a symbol may be a signal (signaling).
• a signal may be a message.
• a component carrier CC may be called a carrier frequency, a cell, a frequency carrier, etc.
• system and “network” are used interchangeably.
• radio resources may be indicated by an index.
• the names used for the parameters described above are not intended to be limiting in any way. Furthermore, the mathematical formulas using these parameters may differ from those explicitly disclosed in this disclosure.
• the various channels (e.g., PUCCH, PDCCH, etc.) and information elements may be identified by any suitable names, and therefore the various names assigned to these various channels and information elements are not intended to be limiting in any way.
• determining may encompass a wide variety of actions.
• Determining and “determining” may include, for example, judging, calculating, computing, processing, deriving, investigating, looking up, searching, inquiring (e.g., searching a table, database, or other data structure), and ascertaining something that is considered to be a “determination.”
• Determining and “determining” may also include receiving (e.g., receiving information), transmitting (e.g., sending information), input, output, accessing (e.g., accessing data in memory), and so on.
• judgment and “decision” can include regarding actions such as resolving, selecting, choosing, establishing, and comparing as having been “judgment” or “decision.” In other words, “judgment” and “decision” can include regarding some action as having been “judgment” or “decision.” Furthermore, “judgment (decision)” can be interpreted as “assuming,” “expecting,” “considering,” etc.
• the phrase “based on” does not mean “based only on,” unless expressly stated otherwise. In other words, the phrase “based on” means both “based only on” and “based at least on.”
• any reference to an element using a designation such as "first,” “second,” etc. does not generally limit the quantity or order of those elements. These designations may be used in this disclosure as a convenient method of distinguishing between two or more elements. Thus, a reference to a first and a second element does not imply that only two elements may be employed or that the first element must in some way precede the second element.
• a and B are different may mean “A and B are different from each other.” Note that this term may also mean “A and B are each different from C.” Terms such as “separate” and “combined” may also be interpreted in the same way as “different.”

Landscapes

• Physics & Mathematics (AREA)
• Engineering & Computer Science (AREA)
• Acoustics & Sound (AREA)
• Multimedia (AREA)
• Information Retrieval, Db Structures And Fs Structures Therefor (AREA)

Priority Applications (2)

Applications Claiming Priority (1)

Publications (1)

Family

ID=98318069

Family Applications (1)

Country Status (2)

Citations (5)

• 2024
  • 2024-07-01 JP JP2026531307A patent/JPWO2026009291A1/ja active Pending
  • 2024-07-01 WO PCT/JP2024/023801 patent/WO2026009291A1/ja active Pending

Patent Citations (5)

Also Published As

Similar Documents

Legal Events