CN111506743A - Media resource storage method, media resource playing method and related equipment - Google Patents
Media resource storage method, media resource playing method and related equipment Download PDFInfo
- Publication number
- CN111506743A CN111506743A CN202010315952.8A CN202010315952A CN111506743A CN 111506743 A CN111506743 A CN 111506743A CN 202010315952 A CN202010315952 A CN 202010315952A CN 111506743 A CN111506743 A CN 111506743A
- Authority
- CN
- China
- Prior art keywords
- user
- resource
- media
- keywords
- information
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/40—Information retrieval; Database structures therefor; File system structures therefor of multimedia data, e.g. slideshows comprising image and additional audio data
- G06F16/41—Indexing; Data structures therefor; Storage structures
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/40—Information retrieval; Database structures therefor; File system structures therefor of multimedia data, e.g. slideshows comprising image and additional audio data
- G06F16/43—Querying
- G06F16/432—Query formulation
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/40—Information retrieval; Database structures therefor; File system structures therefor of multimedia data, e.g. slideshows comprising image and additional audio data
- G06F16/48—Retrieval characterised by using metadata, e.g. metadata not derived from the content or metadata generated manually
Landscapes
- Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- Physics & Mathematics (AREA)
- Multimedia (AREA)
- Data Mining & Analysis (AREA)
- Databases & Information Systems (AREA)
- General Engineering & Computer Science (AREA)
- General Physics & Mathematics (AREA)
- Mathematical Physics (AREA)
- Software Systems (AREA)
- Library & Information Science (AREA)
- Information Retrieval, Db Structures And Fs Structures Therefor (AREA)
Abstract
The invention provides a media resource storage method, a media resource playing method and related equipment, wherein the media resource storage method comprises the following steps: receiving media resources uploaded by a user through terminal equipment, wherein the terminal equipment is in communication connection with the cloud server; receiving keywords corresponding to the media resources uploaded by the terminal equipment; and storing the media resources and the keywords in a resource database in an associated manner. In the embodiment of the invention, the user can upload the media resources and the corresponding keywords to the cloud server providing the cloud service for the sound box equipment through the terminal equipment, and the cloud server stores the media resources and the corresponding keywords in the resource database in a correlated manner, so that the sound box equipment can support the user to request the media resources uploaded by the user in the resource database, thereby not only expanding the media resource playing mode of the sound box equipment, but also flexibly meeting the requirement of the user for playing the user-defined media resources.
Description
Technical Field
The present invention relates to the field of speech processing technologies, and in particular, to a media resource storage method, a media resource playing method, and a related device.
Background
The sound box device is a device capable of converting an audio signal into sound, and the sound box itself emits the sound after amplifying the audio signal, so that the sound becomes louder, and better hearing enjoyment is brought to a user. The intelligent sound box is a product of upgrading a common sound box, and has a strong natural language interaction system, so that a user can directly wake up the sound box to perform voice interaction without manually operating or wearing accessories.
Nowadays, an intelligent sound box is a tool for a household consumer to surf the internet by voice, such as song playing, online shopping, or weather forecast knowing, and the like, and can also be interconnected with intelligent household equipment to control the intelligent household equipment, such as opening a curtain, setting the temperature of a refrigerator, warming a water heater in advance, and the like. The convenient and practical function of intelligence audio amplifier and the interesting user experience that it brought make its daily life space that permeates people gradually.
However, the smart speaker is also a speaker in nature, and playing audio is a necessary attribute of the smart speaker, but the existing speaker device usually intelligently plays some fixed audio resources, such as local resources or audio resources pushed by a cloud server. Therefore, the media resource playing mode of the existing sound box equipment is single, and the requirement of a user for flexibly playing different media resources cannot be met.
Disclosure of Invention
The embodiment of the invention provides a media resource storage method, a media resource playing method and related equipment, and aims to solve the problems that the playing mode of media resources of sound box equipment is single and the requirements of users for flexibly playing different media resources cannot be met.
In order to solve the technical problem, the invention is realized as follows:
in a first aspect, an embodiment of the present invention provides a media resource storage method, which is applied to a cloud server that provides cloud services for speaker devices, where the method includes:
receiving media resources uploaded by a user through terminal equipment, wherein the terminal equipment is in communication connection with the cloud server;
receiving keywords corresponding to the media resources uploaded by the terminal equipment;
and storing the media resources and the keywords in a resource database in an associated manner.
Optionally, after receiving the keyword corresponding to the media resource uploaded by the terminal device, the method further includes:
and storing the keywords into a Natural language Processing (Natural L angle Processing, N L P for short) engine.
Optionally, after receiving the media resource uploaded by the user through the terminal device, the method further includes:
acquiring user information corresponding to the media resource, wherein the user information comprises at least one of a voiceprint feature and a user identifier;
the storing the media resources and the keywords in a resource database in an associated manner includes:
and storing the media resources, the keywords and the user information into a resource database in an associated manner.
In a second aspect, an embodiment of the present invention provides a media resource playing method, which is applied to a sound box device, and the method includes:
receiving voice information input by a user;
identifying keywords and characteristic information in the voice information;
searching matched target media resources from a resource database according to the keywords and the characteristic information, wherein the resource database stores media resources uploaded by a user in advance;
and playing the target media resource.
Optionally, the feature information is limited information associated with the keyword in the voice information;
the searching for the matched target media resource from the resource database according to the keyword and the characteristic information comprises the following steps:
determining a resource database to be searched according to the limiting information, wherein the sound box equipment is associated with at least two databases;
and searching the target media resources matched with the keywords from the resource database.
Optionally, each media resource stored in the resource database is associated with corresponding user information, where the user information includes at least one of a user voiceprint feature and a user identifier; the characteristic information is target user information corresponding to the voice information;
the searching for the matched target media resource from the resource database according to the keyword and the characteristic information comprises the following steps:
and searching a target media resource matched with the keyword and the target user information from a resource database.
Optionally, the resource database is a database established in the cloud server.
In a third aspect, an embodiment of the present invention provides a cloud server for providing cloud services for speaker devices, where the cloud server includes:
the system comprises a first receiving module, a second receiving module and a third receiving module, wherein the first receiving module is used for receiving media resources uploaded by a user through a terminal device, and the terminal device is in communication connection with the cloud server;
the second receiving module is used for receiving the keywords corresponding to the media resources uploaded by the terminal equipment;
and the first storage module is used for storing the media resources and the keywords into a resource database in an associated manner.
Optionally, the cloud server further includes:
and the second storage module is used for storing the keywords into the natural language processing N L P engine.
Optionally, the cloud server further includes:
an obtaining module, configured to obtain user information corresponding to the media resource, where the user information includes at least one of a voiceprint feature and a user identifier;
the first storage module is used for storing the media resources, the keywords and the user information into a resource database in an associated mode.
In a fourth aspect, an embodiment of the present invention provides a sound box apparatus, including:
the receiving module is used for receiving voice information input by a user;
the recognition module is used for recognizing the keywords and the characteristic information in the voice information;
the searching module is used for searching matched target media resources from a resource database according to the keywords and the characteristic information, wherein the resource database stores media resources uploaded by a user in advance;
and the playing module is used for playing the target media resource.
Optionally, the feature information is limited information associated with the keyword in the voice information;
the search module comprises:
the determining unit is used for determining a resource database to be searched according to the limiting information, wherein the sound box equipment is associated with at least two databases;
and the searching unit is used for searching the target media resources matched with the keywords from the resource database.
Optionally, each media resource stored in the resource database is associated with corresponding user information, where the user information includes at least one of a user voiceprint feature and a user identifier; the characteristic information is target user information corresponding to the voice information;
the search module is used for searching the target media resources matched with the keywords and the target user information from a resource database.
Optionally, the resource database is a database established in the cloud server.
In a fifth aspect, an embodiment of the present invention provides a media resource playing system, including a terminal device, a cloud server, and a speaker device, where the cloud server is respectively in communication connection with the terminal device and the speaker device; wherein the content of the first and second substances,
the terminal equipment is used for uploading media resources and keywords corresponding to the media resources to the cloud server based on user input;
the cloud server is used for receiving media resources uploaded by a user through the terminal equipment; receiving keywords corresponding to the media resources uploaded by the terminal equipment; storing the media resources and the keyword association into a resource database;
the sound box equipment is used for receiving voice information input by a user; identifying keywords and characteristic information in the voice information; searching matched target media resources from the resource database according to the keywords and the characteristic information; and playing the target media resource.
In a sixth aspect, an embodiment of the present invention provides a cloud server, including a processor, a memory, and a computer program stored in the memory and capable of running on the processor, where the computer program, when executed by the processor, implements the steps in the media resource storage method according to the first aspect.
In a seventh aspect, an embodiment of the present invention provides a sound box apparatus, including a processor, a memory, and a computer program stored on the memory and capable of running on the processor, where the computer program, when executed by the processor, implements the steps in the media resource playing method according to the second aspect.
In an eighth aspect, an embodiment of the present invention provides a computer-readable storage medium, where a computer program is stored on the computer-readable storage medium, and when executed by a processor, the computer program implements the steps in the media resource storage method according to the first aspect; alternatively, the computer program, when executed by a processor, implements the steps in the media asset playing method according to the second aspect.
In the embodiment of the invention, the user can upload the media resources and the corresponding keywords to the cloud server providing the cloud service for the sound box equipment through the terminal equipment, and the cloud server stores the media resources and the corresponding keywords in the resource database in a correlated manner, so that the sound box equipment can support the user to request the media resources uploaded by the user in the resource database, thereby not only expanding the media resource playing mode of the sound box equipment, but also flexibly meeting the requirement of the user for playing the user-defined media resources.
Drawings
In order to more clearly illustrate the technical solutions of the embodiments of the present invention, the drawings needed to be used in the description of the embodiments of the present invention will be briefly introduced below, and it is obvious that the drawings in the following description are only some embodiments of the present invention, and it is obvious for those skilled in the art that other drawings can be obtained according to these drawings without inventive exercise.
Fig. 1 is a flowchart of a media resource storage method according to an embodiment of the present invention;
fig. 2 is a flowchart of a media resource playing method according to an embodiment of the present invention;
fig. 3a is a schematic flowchart illustrating a process of uploading a media resource by a user according to an embodiment of the present invention;
FIG. 3b is a flowchart illustrating a user playing a media asset according to an embodiment of the present invention;
fig. 4 is a schematic structural diagram of a cloud server according to an embodiment of the present invention;
fig. 5 is a schematic structural diagram of a sound box apparatus according to an embodiment of the present invention;
fig. 6 is a schematic structural diagram of another cloud server according to an embodiment of the present invention;
fig. 7 is a schematic diagram of a hardware structure of a sound box device according to an embodiment of the present invention.
Detailed Description
The technical solutions in the embodiments of the present invention will be clearly and completely described below with reference to the drawings in the embodiments of the present invention, and it is obvious that the described embodiments are some, not all, embodiments of the present invention. All other embodiments, which can be derived by a person skilled in the art from the embodiments given herein without making any creative effort, shall fall within the protection scope of the present invention.
Referring to fig. 1, fig. 1 is a flowchart of a media resource storage method provided in an embodiment of the present invention, and is applied to a cloud server for providing cloud services for speaker devices, as shown in fig. 1, the method includes the following steps:
In the embodiment of the present invention, the cloud server is a cloud virtual server that provides cloud services for a sound box device, such as an intelligent sound box supporting a voice function, the sound box device may establish a communication connection with the cloud server through an access network, and a terminal device may establish a connection with the sound box device through the cloud server, for example, a personal computer may establish a communication connection with the cloud server through a web page, a mobile terminal such as a mobile phone may establish a communication connection with the cloud server through an APP corresponding to the sound box device, and further establish a network connection with the sound box device, and a user may control or set the sound box device through the terminal device.
For making the audio amplifier equipment possess the function of supporting the user-defined media resource of broadcast user, the accessible the high in the clouds server provides a way for the user to upload self-defined media resource, specifically, the user can be in terminal equipment with under the circumstances that communication connection was established to the high in the clouds server, the terminal equipment is last to select the media resource of waiting to upload, confirm the back by the terminal equipment with the media resource of user's selection upload to the high in the clouds server, thereby the high in the clouds server can receive the user and pass through the media resource that terminal equipment uploaded.
The media resources can be user-defined, that is, the user can upload the media resources recorded by the user or upload the media resource files downloaded from a resource website by the user, the media resources can include audio resources and/or video resources, and for the speaker equipment configured with the display screen, the cloud server can support the user to upload the video resources and play the video resources on the speaker equipment.
And 102, receiving keywords corresponding to the media resources uploaded by the terminal equipment.
When or after the user uploads the media resource, the user is also required to input a keyword corresponding to the uploaded media resource, so that when or after the user uploads the media resource, the keyword corresponding to the media resource uploaded by the terminal device can be received, so as to distinguish different media resources uploaded by the user through the keyword, wherein the keyword can be a file name or a unique identifier of the media resource. The terminal equipment can also upload keywords input by a user to the cloud server, so that the cloud server can receive the keywords corresponding to the media resources uploaded by the terminal equipment.
Optionally, after the step 102, the method further includes:
and storing the keywords into a Natural language Processing (Natural L angle Processing, N L P for short) engine.
In this embodiment, after receiving the keyword corresponding to the media resource uploaded by the terminal device, the keyword may be stored in the N L P engine for performing intent analysis on the content in the voice information input by the user, specifically, after extracting the keyword in the voice information input by the user, the N L P engine may match the keyword in the voice information with the stored keyword, so as to determine the intent of the user.
In this way, when keyword matching and intention resolution are performed on the voice information input by the user, the media resources which the user intends to play can be quickly located through the N L P engine.
And 103, storing the media resources and the keywords in a resource database in an associated manner.
After receiving the media resources uploaded by the user through the terminal device and the corresponding keywords, the media resources and the keywords can be stored in a resource database in an associated manner, so that the corresponding, i.e., matched, media resources can be retrieved in the resource database through the keywords in the following process.
The resource database may be a database built in the cloud server and specially used for storing user-defined media resources uploaded by the user, or may be a database built in a sub-server of the cloud server, for example, the cloud server may divide an independent resource server used for providing resource services, and a resource database is built in the resource server and used for storing media resources uploaded by the user.
Optionally, after the step 101, the method further includes:
acquiring user information corresponding to the media resource, wherein the user information comprises at least one of a voiceprint feature and a user identifier;
the step 103 comprises:
and storing the media resources, the keywords and the user information into a resource database in an associated manner.
In the embodiment, in order to avoid the problem that a plurality of media resources cannot be accurately positioned to a media resource which a user really intends to play due to the fact that the keywords are the same and are matched with the media resources, user information can be further acquired when the user uploads the media resource and is stored in association with the uploaded media resource, wherein the user information comprises at least one of a voiceprint feature and a user identifier, and the user identifier can be a user name, a nickname or other identifying information.
The obtaining of the user information corresponding to the media resource may be extracting a user voiceprint feature from a recorded media resource uploaded by a user, or prompting the user to input voice information after the user uploads the media resource to obtain the voiceprint feature of the user, or prompting the user to input personal information (such as a name, a nickname, and the like) to obtain a user identifier after the user uploads the media resource, or may also be obtaining the voiceprint feature and the user identifier of the user at the same time by using the above method. After obtaining the user information, the media resource, the keyword, and the user information may be stored in the resource database in an associated manner.
In this way, after the plurality of media resources are matched based on the keywords, the target media resources uploaded by the corresponding users can be further positioned based on the user information in the user voice information, or the target media resources uploaded by the corresponding users can be positioned based on the keywords and the user information in the user voice information at the same time, so that the matched media resources are searched in a targeted manner and played on the sound box device.
The media resource storage method in the embodiment receives media resources uploaded by a user through terminal equipment, wherein the terminal equipment is in communication connection with the cloud server; receiving keywords corresponding to the media resources uploaded by the terminal equipment; and storing the media resources and the keywords in a resource database in an associated manner. Therefore, the user can upload the media resources and the corresponding keywords to the cloud server providing the cloud service for the sound box equipment through the terminal equipment, and the cloud server stores the media resources and the corresponding keywords in the resource database in an associated manner, so that the sound box equipment can support the user to order the media resources uploaded by the user in the resource database, the media resource playing mode of the sound box equipment is expanded, and the requirement of the user for playing the user-defined media resources can be flexibly met.
Referring to fig. 2, fig. 2 is a flowchart of another media resource playing method provided in an embodiment of the present invention, and is applied to a sound box device, as shown in fig. 2, the method includes the following steps:
In the embodiment of the present invention, the sound box device may be an intelligent sound box device supporting a voice function, and a user may wake up the sound box device by voice or control the sound box device to play a related media resource during using the sound box device, and may input voice information to the sound box device when the user desires to play a certain media resource, so that the sound box device may receive the voice information input by the user, where the voice information may be voice information including a related play instruction, for example, the user may input "play ××× song", and particularly, when the user desires to play a media resource uploaded in advance, the voice information including a keyword corresponding to the media resource desired to be played and related feature information may be input.
In this way, after receiving the voice information input by the user, the sound box device may recognize the voice information, specifically may perform voice Recognition on the voice information through Automatic Speech Recognition (ASR) to obtain a text meaning corresponding to the voice information, then extract a keyword and related feature information from the text meaning, specifically may perform language understanding and Processing on the text information through Natural language Processing (N L P), extract the keyword and feature information included in the text meaning, where the feature information may be user information related to the input user, such as a user voiceprint feature, user identification information, and the like, or may be some limiting information used for limiting the keyword, which is carried in the voice information, and the feature information is used to match the sound box device to a media resource most related to the keyword based on the feature information, that is, to locate a target media resource that the user corresponding to the voice information really desires to play.
And step 204, playing the target media resource.
After the keywords and the feature information in the voice information are identified, a target media resource matched with the keywords and the feature information may be searched from a resource database, where the resource database may be a local database or a database in a cloud server providing cloud services for the sound box device, and the resource database may store a media resource uploaded in advance by a user, that is, the user may upload a media resource desired to be played to the resource database in advance, and specifically upload the media resource locally through a data line, or upload the media resource to the cloud server through a terminal device, where a specific implementation manner of uploading the media resource to the cloud server through the terminal device may refer to related descriptions in the method embodiment shown in fig. 1, and in order to avoid repetition, details are not repeated here.
The media resources can be user-defined, that is, the user can upload the media resources recorded by the user or upload the media resource files downloaded from a resource website by the user, the media resources can include audio resources and/or video resources, and for the speaker equipment configured with the display screen, the cloud server can support the user to upload the video resources and play the video resources on the speaker equipment.
In this step, the target media resource to be searched from the resource database according to the keyword and the feature information may be specifically, a media resource including the keyword is directly searched from the resource database, or different media resources in the resource database are respectively associated with corresponding keywords, so that the corresponding media resource may be searched according to the keyword, and the matched target media resource may be further determined according to the feature information, for example, the target media resource whose voiceprint features are also matched may be further determined according to the voiceprint features in the voice information and the voiceprint features of each media resource stored in the resource database, or the resource database to be searched may be determined according to the definition information carried in the voice information, and then the target media resource that is matched with the keyword in the voice information is searched from the determined resource database, for example, when the voice information of a song ××× uploaded by a user is received, the target media resource to be searched from the resource database stored in the media database uploaded by the user may be determined according to the definition information "uploaded by the user", and then the target media resource is matched with the searched from the resource database.
It should be noted that, when the resource database is a local database, the sound box device may directly obtain the target media resource from local search, and when the resource database is a cloud database, the keyword and the feature information may be sent to a cloud server, the cloud server searches for a matched target media resource, and then receives the target media resource returned by the cloud server.
And after the matched target media resource is obtained through searching, the target media resource can be loaded and played.
Optionally, the feature information is limited information associated with the keyword in the voice information;
the step 203 comprises:
determining a resource database to be searched according to the limiting information, wherein the sound box equipment is associated with at least two databases;
and searching the target media resources matched with the keywords from the resource database.
In one embodiment, the characteristic information may be a definition information associated with the keyword in the voice information, for example, the "uploaded by user" in the voice information of "playing ××× song uploaded by user" is the definition information, the "three-by-three" in the voice information of "playing ××× song three-by-three" is also the definition information, and so on.
In this embodiment, at least two or more databases may be associated with the speaker device, different databases may store media resources of different types or different sources, wherein the resource database may be a database dedicated to storing media resources uploaded by users, such that, after determining the limitation information in the voice information, the database to be searched may be determined according to the limitation information, for example, according to the limitation information "uploaded by user", the database to be searched can be quickly located to the resource database storing the media resources uploaded by the user, and can search the resource database for the target media resource matching the keyword, thus avoiding the need to search from many databases one by one, and the media resources which are not expected by the user are prevented from being searched from other databases, so that the resource searching speed and precision can be improved.
Optionally, each media resource stored in the resource database is associated with corresponding user information, where the user information includes at least one of a user voiceprint feature and a user identifier; the characteristic information is target user information corresponding to the voice information;
the step 203 comprises:
and searching a target media resource matched with the keyword and the target user information from a resource database.
Specifically, when the characteristic information in the voice information is recognized, the voiceprint feature of the user may be extracted from the voice information, and/or when the voice information carrying the user identification is input by the user, the corresponding user identification may be extracted from the voice information, for example, when the user inputs the voice information of "××× song for playing zhang san", the user identification therein may be determined as "zhang san".
The resource database may store user information corresponding to each media resource in an associated manner, where the user information includes at least one of a user voiceprint feature and a user identifier, and a specific storage manner may refer to related descriptions in the method embodiment shown in fig. 1, and details are not repeated here to avoid repetition.
It should be noted that the target user information extracted from the voice information needs to be consistent with the user information type stored in association in the resource database, for example, when the user information stored in association in the resource database is only the user voiceprint feature, the user voiceprint feature is also correspondingly extracted from the voice information when the voice information is identified; when the user information stored in the resource database in a correlated manner is only the user identifier, the user needs to input the voice information carrying the user identifier, and the user identifier is extracted from the voice information during recognition; when the user information stored in the resource database in an associated manner includes both the user voiceprint feature and the user identifier, at least one of the corresponding user voiceprint feature and the user identifier may be extracted when the user voice information is recognized.
In this embodiment, after obtaining the target user information in the voice information, the resource database may be searched for a target media resource matching both the keyword and the target user information according to the keyword and the target user information, for example, when a plurality of media resources matching the keyword are searched, the target media resource uploaded by the current voice input user may be further located through matching of user voiceprint features, or the media resource uploaded by the corresponding user may be located according to the user voiceprint features first, and then the matched target media resource may be searched according to the keyword.
Therefore, in the embodiment, aiming at scenes with the same keywords which are possibly uploaded by different users, the target media resources which the users really desire to play can be searched more pertinently through double matching of the keywords and the user information, and the searching result is ensured to be more accurate.
Optionally, the resource database is a database established in the cloud server.
In order to save the local storage space of the sound box device and save system resources, a resource database can be set in the cloud server for storing the media resources uploaded by the user, so that the media resources uploaded by the user and expected to be played by the user can be quickly searched, and the searching time and space are saved. And more specifically, the cloud server may specially divide a resource server for searching media resources uploaded by the user, and establish a resource database for storing user-defined media resources uploaded by the user in the resource server, so that after keywords and feature information in voice information input by the user are analyzed, the resource server can search matched target media resources.
The media resource playing method in the embodiment receives voice information input by a user; identifying keywords and characteristic information in the voice information; searching matched target media resources from a resource database according to the keywords and the characteristic information, wherein the resource database stores media resources uploaded by a user in advance; and playing the target media resource. Therefore, the sound box equipment can support the user to order the media resources uploaded by the user in the resource database, thereby not only expanding the media resource playing mode of the sound box equipment, but also flexibly meeting the requirement of the user for playing the user-defined media resources.
The following describes, by referring to the flow shown in fig. 3a for uploading media resources by a user and the flow shown in fig. 3b for playing media resources by the user, a specific implementation manner in which the sound box device supports playing of user-defined media resources in the embodiment of the present invention:
as shown in fig. 3a, a user may upload a customized audio/video resource file to a cloud server through a PC web page or a mobile APP, and the like, and re-upload the file in case of upload failure, and further define keywords, such as an input file name, for the uploaded resource file in case of successful upload, where the resource file successfully uploaded may be stored in a resource database in a specific resource server, and may be associated with uploaded user information (such as user voiceprint characteristics, personal information such as a user name and a nickname) and the keywords for access of a speaker device, and the defined keywords may be stored in a natural language processing N L P engine for use in parsing content intent after the ASR identifies user dialog content.
As shown in fig. 3b, the user can input a voice message of "play ×××", the sound box device recognizes the voice input by the user through ASR to obtain corresponding text content, and then sends the text content to the N L P engine for language understanding, the result after N L P understanding becomes a keyword for searching resources, a matched resource file is searched from the resource database according to the keyword, in case of successful search, the sound box device can play a warning tone "play ×××" for you, and start playing the searched resource file after playing the warning tone, in case of failed search, if no matched resource is searched, the sound box device can play a warning tone "no find the resource".
For the situation that keywords created by different users may be the same, specific users can be located according to existing voiceprint data of the current users in the cloud server, resources are searched in a targeted mode, and the resources are played on the loudspeaker box device after the search is successful.
Referring to fig. 4, fig. 4 is a schematic structural diagram of a cloud server according to an embodiment of the present invention, where the cloud server is configured to provide a cloud service for a speaker device, and as shown in fig. 4, the cloud server 400 includes:
a first receiving module 401, configured to receive a media resource uploaded by a user through a terminal device, where the terminal device and the cloud server establish a communication connection;
a second receiving module 402, configured to receive a keyword corresponding to the media resource uploaded by the terminal device;
a first storage module 403, configured to store the media resource and the keyword in association with each other in a resource database.
Optionally, the cloud server 400 further includes:
and the second storage module is used for storing the keywords into the natural language processing N L P engine.
Optionally, the cloud server 400 further includes:
an obtaining module, configured to obtain user information corresponding to the media resource, where the user information includes at least one of a voiceprint feature and a user identifier;
the first storage module 403 is configured to store the media resource, the keyword, and the user information in a resource database in an associated manner.
The cloud server 400 can implement each process implemented by the cloud server in the method embodiment of fig. 1, and is not described herein again to avoid repetition. The cloud server 400 of the embodiment of the invention can store the media resources uploaded by the user through the terminal device and the corresponding keywords into the resource database in an associated manner, so that the sound box device can support the user to request the media resources uploaded by the user in the resource database, thereby not only expanding the media resource playing mode of the sound box device, but also flexibly meeting the requirement of the user for playing the user-defined media resources.
Referring to fig. 5, fig. 5 is a schematic structural diagram of an acoustic enclosure apparatus according to an embodiment of the present invention, and as shown in fig. 5, the acoustic enclosure apparatus 500 includes:
a receiving module 501, configured to receive voice information input by a user;
the recognition module 502 is configured to recognize a keyword and feature information in the voice information;
a searching module 503, configured to search a resource database for a matched target media resource according to the keyword and the feature information, where the resource database stores media resources uploaded by a user in advance;
a playing module 504, configured to play the target media resource.
Optionally, the feature information is limited information associated with the keyword in the voice information;
the search module 503 includes:
the determining unit is used for determining a resource database to be searched according to the limiting information, wherein the sound box equipment is associated with at least two databases;
and the searching unit is used for searching the target media resources matched with the keywords from the resource database.
Optionally, each media resource stored in the resource database is associated with corresponding user information, where the user information includes at least one of a user voiceprint feature and a user identifier; the characteristic information is target user information corresponding to the voice information;
the searching module 503 is configured to search a resource database for a target media resource matching both the keyword and the target user information.
Optionally, the resource database is a database established in the cloud server.
The sound box device 500 can implement each process implemented by the sound box device in the method embodiment of fig. 2, and is not described herein again to avoid repetition. The sound box equipment 500 of the embodiment of the invention can support the user to order the media resources uploaded by the user in the resource database, thereby not only expanding the media resource playing mode of the sound box equipment, but also flexibly meeting the requirement of the user for playing the user-defined media resources.
Referring to fig. 6, fig. 6 is a schematic structural diagram of another cloud server according to an embodiment of the present invention, where the cloud server is configured to provide cloud services for a sound box device. As shown in fig. 6, the cloud server 600 includes: a processor 601, a memory 602, and a computer program stored on the memory 602 and executable on the processor, the various components in the cloud server 600 are coupled together by a bus interface 603. It is understood that the bus interface 603 is used to enable connection communication between these components.
Wherein, the processor 601 is configured to:
receiving media resources uploaded by a user through terminal equipment, wherein the terminal equipment is in communication connection with the cloud server;
receiving keywords corresponding to the media resources uploaded by the terminal equipment;
and storing the media resources and the keywords in a resource database in an associated manner.
Optionally, the processor 601 is further configured to:
storing the keywords in a natural language processing N L P engine.
Optionally, the processor 601 is further configured to:
acquiring user information corresponding to the media resource, wherein the user information comprises at least one of a voiceprint feature and a user identifier;
and storing the media resources, the keywords and the user information into a resource database in an associated manner.
The cloud server 600 can implement each process implemented by the cloud server in the method embodiment of fig. 1, and is not described herein again to avoid repetition. The cloud server 600 of the embodiment of the invention can store the media resources uploaded by the user through the terminal device and the corresponding keywords into the resource database in an associated manner, so that the sound box device can support the user to request the media resources uploaded by the user in the resource database, thereby not only expanding the media resource playing mode of the sound box device, but also flexibly meeting the requirement of the user for playing the user-defined media resources.
The embodiment of the invention also provides a media resource playing system which comprises terminal equipment, a cloud server and sound box equipment, wherein the cloud server is respectively in communication connection with the terminal equipment and the sound box equipment; wherein the content of the first and second substances,
the terminal equipment is used for uploading media resources and keywords corresponding to the media resources to the cloud server based on user input;
the cloud server is used for receiving media resources uploaded by a user through the terminal equipment; receiving keywords corresponding to the media resources uploaded by the terminal equipment; storing the media resources and the keyword association into a resource database;
the sound box equipment is used for receiving voice information input by a user; identifying keywords and characteristic information in the voice information; searching matched target media resources from the resource database according to the keywords and the characteristic information; and playing the target media resource.
It should be noted that, the media resource playing system provided in the embodiment of the present invention may execute the method embodiment, where the terminal device, the cloud server, and the sound box device may respectively correspond to implementation schemes of the terminal device, the cloud server, and the sound box device in the method embodiment, and the implementation principle and the technical effect are similar, and this embodiment is not described herein again.
In the media resource playing system in the embodiment of the invention, a user can upload media resources to a cloud server through terminal equipment, and define keywords for the uploaded media resources, and the cloud server can store the media resources uploaded by the user through the terminal equipment and the corresponding keywords into a resource database in an associated manner; therefore, when a user uses the sound box equipment to play the media resources, the user can control the sound box equipment to play the media resources uploaded by the user in advance in the resource database by inputting the voice information with the keywords and the characteristic information, so that the playing mode of the media resources of the sound box equipment is expanded, and the requirement of the user for playing the user-defined media resources can be flexibly met.
Preferably, an embodiment of the present invention further provides a cloud server, which includes a processor 601, a memory 602, and a computer program stored in the memory 602 and capable of running on the processor 601, where the computer program, when executed by the processor 601, implements each process of the foregoing media resource storage method embodiment, and can achieve the same technical effect, and in order to avoid repetition, details are not described here again.
Fig. 7 is a schematic diagram of a hardware structure of an audio enclosure device 700 for implementing various embodiments of the present invention, where the audio enclosure device 700 includes, but is not limited to: a radio frequency unit 701, a network module 702, an audio output unit 703, an audio input unit 704, a user input unit 705, an interface unit 706, a memory 707, a processor 708, and a power supply 709. Those skilled in the art will appreciate that the configuration of the loudspeaker device shown in FIG. 7 does not constitute a limitation of loudspeaker devices, and that loudspeaker devices may include more or fewer components than shown, or some components may be combined, or a different arrangement of components.
The processor 710 is configured to receive voice information input by a user through the audio input unit 704;
identifying keywords and characteristic information in the voice information;
searching matched target media resources from a resource database according to the keywords and the characteristic information, wherein the resource database stores media resources uploaded by a user in advance;
and controlling the audio output unit 703 to play the target media resource.
Optionally, the feature information is limited information associated with the keyword in the voice information;
processor 710 is further configured to:
determining a resource database to be searched according to the limiting information, wherein the sound box equipment is associated with at least two databases;
and searching the target media resources matched with the keywords from the resource database.
Optionally, each media resource stored in the resource database is associated with corresponding user information, where the user information includes at least one of a user voiceprint feature and a user identifier; the characteristic information is target user information corresponding to the voice information;
processor 710 is further configured to:
and searching a target media resource matched with the keyword and the target user information from a resource database.
Optionally, the resource database is a database established in the cloud server.
The sound box device 700 can implement each process implemented by the sound box device in the foregoing embodiments, and for avoiding repetition, the details are not described here. The sound box device 700 of the embodiment of the invention can support the user to order the media resources uploaded by the user in the resource database, thereby not only expanding the media resource playing mode of the sound box device, but also flexibly meeting the requirement of the user for playing the user-defined media resources.
It should be understood that, in the embodiment of the present invention, the radio frequency unit 701 may be used for receiving and sending signals during a message transmission and reception process or a call process, and specifically, receives downlink data from the network service platform and then processes the received downlink data to the processor 710; in addition, the uplink data is sent to the network service platform. In general, radio frequency unit 701 includes, but is not limited to, an antenna, at least one amplifier, a transceiver, a coupler, a low noise amplifier, a duplexer, and the like. In addition, the radio frequency unit 701 may also communicate with a network and other devices through a wireless communication system.
The speaker device 700 provides wireless broadband internet access to the user via the network module 702, for example, to help the user query for media information.
The audio output unit 703 may convert audio data received by the radio frequency unit 701 or the network module 702 or stored in the memory 707 into an audio signal and output as sound. Also, the audio output unit 703 may also provide audio output related to a specific function performed by the speaker device 700 (e.g., a call signal reception sound, a message reception sound, etc.). The audio output unit 703 may include a speaker, a receiver, and the like.
The audio input unit 704 is used to receive an audio signal. The audio input unit 704 may include a microphone 7041, and the microphone 7041 may receive sounds and be capable of processing such sounds into audio data. The processed audio data may be speech recognized by processor 708. The processed audio data may also be converted into a format output that can be transmitted to a network communication service platform or a telecom carrier network telephony service platform via the radio frequency unit 701 in case of a call mode.
The user input unit 705 may be used to receive key signal inputs that generate key signals related to user settings and function controls of the loudspeaker device. Specifically, the user input unit 705 includes keys 7051 and other input devices 7052. The keys 7051 may be physical keys or touch keys, and specifically may include a power key, a volume key, a play key, a bluetooth key, and the like. In addition to the key 7051, the user input unit 705 may include other input devices 7052.
The interface unit 706 is an interface through which an external device is connected to the speaker apparatus 700. For example, the external device may include a wired or wireless headset port, an external power supply (or battery charger) port, a wired or wireless data port, a memory card port, a port for connecting a device having an identification module, an audio input/output (I/O) port, a video I/O port, an earphone port, and the like. The interface unit 706 may be used to receive input (e.g., data information, audio, etc.) from an external device and transmit the received input to one or more elements within the audio enclosure apparatus 700 or may be used to transmit data between the audio enclosure apparatus 700 and the external device.
The memory 707 may be used to store software programs as well as various data. The memory 707 may mainly include a program storage area and a data storage area, wherein the program storage area may store an operating system, an application program required by at least one function (such as a sound playing function, an image playing function, and the like), and the like; the storage data area may store data (such as audio data, a phonebook, etc.) created according to the use of the cellular phone, and the like. Further, the memory 707 may include high speed random access memory, and may also include non-volatile memory, such as at least one magnetic disk storage device, flash memory device, or other volatile solid state storage device.
The processor 708 is a control center of the sound box device, connects various parts of the whole sound box device by using various interfaces and lines, and performs various functions of the sound box device and processes data by running or executing software programs and/or modules stored in the memory 707 and calling data stored in the memory 707, thereby performing overall monitoring of the sound box device. Processor 708 may include one or more processing units; preferably, the processor 708 may integrate an application processor, which primarily handles operating systems, user interfaces, applications, etc., and a modem processor, which primarily handles wireless communications. It will be appreciated that the modem processor described above may not be integrated into processor 708.
The loudspeaker device 700 may further include a power source 709 (e.g., a battery) for supplying power to various components, and preferably, the power source 709 may be logically connected to the processor 708 via a power management system, so as to manage charging, discharging, and power consumption management functions via the power management system.
In addition, the speaker device 700 includes some functional modules that are not shown, and thus are not described in detail herein.
Preferably, an embodiment of the present invention further provides a sound box device, which includes a processor 708, a memory 707, and a computer program stored in the memory 707 and capable of running on the processor 708, where the computer program, when executed by the processor 708, implements each process of the above-mentioned media resource playing method embodiment, and can achieve the same technical effect, and in order to avoid repetition, details are not described here again.
The embodiment of the present invention further provides a computer-readable storage medium, where a computer program is stored on the computer-readable storage medium, and when the computer program is executed by a processor, the computer program implements each process of the above-mentioned media resource storage method embodiment, and can achieve the same technical effect, and in order to avoid repetition, details are not repeated here. The computer-readable storage medium may be a Read-Only Memory (ROM), a Random Access Memory (RAM), a magnetic disk or an optical disk.
The embodiment of the present invention further provides a computer-readable storage medium, where a computer program is stored on the computer-readable storage medium, and when the computer program is executed by a processor, the computer program implements each process of the above-mentioned media resource playing method embodiment, and can achieve the same technical effect, and in order to avoid repetition, details are not repeated here. The computer readable storage medium is, for example, ROM, RAM, magnetic disk or optical disk.
It should be noted that, in this document, the terms "comprises," "comprising," or any other variation thereof, are intended to cover a non-exclusive inclusion, such that a process, method, article, or apparatus that comprises a list of elements does not include only those elements but may include other elements not expressly listed or inherent to such process, method, article, or apparatus. Without further limitation, an element defined by the phrase "comprising an … …" does not exclude the presence of other like elements in a process, method, article, or apparatus that comprises the element.
Through the above description of the embodiments, those skilled in the art will clearly understand that the method of the above embodiments can be implemented by software plus a necessary general hardware platform, and certainly can also be implemented by hardware, but in many cases, the former is a better implementation manner. Based on such understanding, the technical solutions of the present invention may be embodied in the form of a software product, which is stored in a storage medium (such as ROM/RAM, magnetic disk, optical disk) and includes instructions for enabling a terminal (such as a mobile phone, a computer, a server, an air conditioner, or a network device) to execute the method according to the embodiments of the present invention.
While the present invention has been described with reference to the embodiments shown in the drawings, the present invention is not limited to the embodiments, which are illustrative and not restrictive, and it will be apparent to those skilled in the art that various changes and modifications can be made therein without departing from the spirit and scope of the invention as defined in the appended claims.
Claims (13)
1. A media resource storage method is applied to a cloud server for providing cloud service for sound box equipment, and is characterized by comprising the following steps:
receiving media resources uploaded by a user through terminal equipment, wherein the terminal equipment is in communication connection with the cloud server;
receiving keywords corresponding to the media resources uploaded by the terminal equipment;
and storing the media resources and the keywords in a resource database in an associated manner.
2. The method according to claim 1, wherein after receiving the keyword corresponding to the media resource uploaded by the terminal device, the method further comprises:
storing the keywords in a natural language processing N L P engine.
3. The method according to claim 1 or 2, wherein after receiving the media resource uploaded by the user through the terminal device, the method further comprises:
acquiring user information corresponding to the media resource, wherein the user information comprises at least one of a voiceprint feature and a user identifier;
the storing the media resources and the keywords in a resource database in an associated manner includes:
and storing the media resources, the keywords and the user information into a resource database in an associated manner.
4. A media resource playing method is applied to sound box equipment, and is characterized by comprising the following steps:
receiving voice information input by a user;
identifying keywords and characteristic information in the voice information;
searching matched target media resources from a resource database according to the keywords and the characteristic information, wherein the resource database stores media resources uploaded by a user in advance;
and playing the target media resource.
5. The method according to claim 4, wherein the feature information is definition information associated with the keyword in the voice message;
the searching for the matched target media resource from the resource database according to the keyword and the characteristic information comprises the following steps:
determining a resource database to be searched according to the limiting information, wherein the sound box equipment is associated with at least two databases;
and searching the target media resources matched with the keywords from the resource database.
6. The method of claim 4, wherein each media resource stored in the resource database has associated therewith corresponding user information, the user information including at least one of a user voiceprint characteristic and a user identification; the characteristic information is target user information corresponding to the voice information;
the searching for the matched target media resource from the resource database according to the keyword and the characteristic information comprises the following steps:
and searching a target media resource matched with the keyword and the target user information from a resource database.
7. The method according to any one of claims 4 to 6, wherein the resource database is a database established in a cloud server.
8. The utility model provides a high in the clouds server provides cloud service for audio amplifier equipment, its characterized in that, high in the clouds server includes:
the system comprises a first receiving module, a second receiving module and a third receiving module, wherein the first receiving module is used for receiving media resources uploaded by a user through a terminal device, and the terminal device is in communication connection with the cloud server;
the second receiving module is used for receiving the keywords corresponding to the media resources uploaded by the terminal equipment;
and the first storage module is used for storing the media resources and the keywords into a resource database in an associated manner.
9. An acoustic enclosure apparatus, comprising:
the receiving module is used for receiving voice information input by a user;
the recognition module is used for recognizing the keywords and the characteristic information in the voice information;
the searching module is used for searching matched target media resources from a resource database according to the keywords and the characteristic information, wherein the resource database stores media resources uploaded by a user in advance;
and the playing module is used for playing the target media resource.
10. A media resource playing system is characterized by comprising terminal equipment, a cloud server and sound box equipment, wherein the cloud server is respectively in communication connection with the terminal equipment and the sound box equipment; wherein the content of the first and second substances,
the terminal equipment is used for uploading media resources and keywords corresponding to the media resources to the cloud server based on user input;
the cloud server is used for receiving media resources uploaded by a user through the terminal equipment; receiving keywords corresponding to the media resources uploaded by the terminal equipment; storing the media resources and the keyword association into a resource database;
the sound box equipment is used for receiving voice information input by a user; identifying keywords and characteristic information in the voice information; searching matched target media resources from the resource database according to the keywords and the characteristic information; and playing the target media resource.
11. Cloud server, comprising a processor, a memory and a computer program stored on the memory and executable on the processor, wherein the computer program, when executed by the processor, implements the steps in the media resource storage method according to any one of claims 1 to 3.
12. Loudspeaker device, comprising a processor, a memory and a computer program stored on the memory and executable on the processor, the computer program, when executed by the processor, implementing the steps in the media asset playback method according to any of claims 4 to 7.
13. A computer-readable storage medium, having stored thereon a computer program which, when executed by a processor, implements the steps in the media asset storage method of any of claims 1 to 3; alternatively, the computer program when executed by a processor implements the steps in a media asset playback method as claimed in any one of claims 4 to 7.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202010315952.8A CN111506743A (en) | 2020-04-21 | 2020-04-21 | Media resource storage method, media resource playing method and related equipment |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202010315952.8A CN111506743A (en) | 2020-04-21 | 2020-04-21 | Media resource storage method, media resource playing method and related equipment |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN111506743A true CN111506743A (en) | 2020-08-07 |
Family
ID=71874353
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202010315952.8A Pending CN111506743A (en) | 2020-04-21 | 2020-04-21 | Media resource storage method, media resource playing method and related equipment |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN111506743A (en) |
Cited By (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN113012693A (en) * | 2021-02-18 | 2021-06-22 | 深圳创维－Rgb电子有限公司 | Local media screening and playing method and device based on voice, terminal equipment and medium |
Citations (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN107222757A (en) * | 2017-07-05 | 2017-09-29 | 深圳创维数字技术有限公司 | A kind of voice search method, set top box, storage medium, server and system |
| CN107291373A (en) * | 2016-04-12 | 2017-10-24 | 陈旭 | A kind of digital media resource content storage management system |
| CN109005229A (en) * | 2018-08-03 | 2018-12-14 | 北京车和家信息技术有限公司 | A kind of method for processing media resource and relevant device |
-
2020
- 2020-04-21 CN CN202010315952.8A patent/CN111506743A/en active Pending
Patent Citations (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN107291373A (en) * | 2016-04-12 | 2017-10-24 | 陈旭 | A kind of digital media resource content storage management system |
| CN107222757A (en) * | 2017-07-05 | 2017-09-29 | 深圳创维数字技术有限公司 | A kind of voice search method, set top box, storage medium, server and system |
| CN109005229A (en) * | 2018-08-03 | 2018-12-14 | 北京车和家信息技术有限公司 | A kind of method for processing media resource and relevant device |
Cited By (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN113012693A (en) * | 2021-02-18 | 2021-06-22 | 深圳创维－Rgb电子有限公司 | Local media screening and playing method and device based on voice, terminal equipment and medium |
| CN113012693B (en) * | 2021-02-18 | 2024-04-30 | 深圳创维－Rgb电子有限公司 | Voice-based local media screening and playing method and device, terminal equipment and medium |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN107623614B (en) | Method and device for pushing information | |
| CN104394491B (en) | A kind of intelligent earphone, Cloud Server and volume adjusting method and system | |
| CN107895578B (en) | Voice interaction method and device | |
| US10034029B1 (en) | Systems and methods for audio object delivery based on audible frequency analysis | |
| US10074365B2 (en) | Voice control method, mobile terminal device, and voice control system | |
| US10097884B2 (en) | Media playback method, client and system | |
| CN110413250B (en) | Voice interaction method, device and system | |
| US9699297B2 (en) | Method for converting character text messages to audio files with respective titles determined using the text message word attributes for their selection and reading aloud with mobile devices | |
| CN107205097B (en) | Mobile terminal searching method and device and computer readable storage medium | |
| JP2018169624A (en) | Voice interaction control method | |
| KR20170032096A (en) | Electronic Device, Driving Methdo of Electronic Device, Voice Recognition Apparatus, Driving Method of Voice Recognition Apparatus, and Computer Readable Recording Medium | |
| US7689424B2 (en) | Distributed speech recognition method | |
| CN102196207A (en) | Method, device and system for controlling television by using voice | |
| JP6783339B2 (en) | Methods and devices for processing audio | |
| CN110989968A (en) | Intelligent sound effect processing method, electronic equipment, storage medium and multi-sound effect sound box | |
| CN104091596A (en) | Music identifying method, system and device | |
| CN109509472A (en) | Method, apparatus and system based on voice platform identification background music | |
| WO2022206704A1 (en) | Voice interaction method and electronic device | |
| JP2001086239A (en) | Voice input terminal, voice recognition device, voice communication system and voice communication method | |
| CN111429917A (en) | Equipment awakening method and terminal equipment | |
| US20010049278A1 (en) | Audio-contents demo system | |
| CN111506743A (en) | Media resource storage method, media resource playing method and related equipment | |
| CN110600045A (en) | Sound conversion method and related product | |
| CN202289477U (en) | Voice toy terminal equipment playing voices through wireless network | |
| CN110418243B (en) | Intelligent sound box control system and control method |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination |