CN111210826B - Voice information processing method and device, storage medium and intelligent terminal - Google Patents
Voice information processing method and device, storage medium and intelligent terminal Download PDFInfo
- Publication number
- CN111210826B CN111210826B CN201911363138.7A CN201911363138A CN111210826B CN 111210826 B CN111210826 B CN 111210826B CN 201911363138 A CN201911363138 A CN 201911363138A CN 111210826 B CN111210826 B CN 111210826B
- Authority
- CN
- China
- Prior art keywords
- uploading
- information
- voice information
- voice
- mode
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
- 230000010365 information processing Effects 0.000 title claims abstract description 32
- 238000003672 processing method Methods 0.000 title claims abstract description 22
- 238000012545 processing Methods 0.000 claims abstract description 35
- 238000000034 method Methods 0.000 claims abstract description 29
- 238000004806 packaging method and process Methods 0.000 claims description 28
- 238000004590 computer program Methods 0.000 claims description 14
- 230000003993 interaction Effects 0.000 claims description 13
- 230000006870 function Effects 0.000 description 10
- 230000008569 process Effects 0.000 description 8
- 238000010586 diagram Methods 0.000 description 6
- 238000005538 encapsulation Methods 0.000 description 5
- 238000004891 communication Methods 0.000 description 4
- 230000004044 response Effects 0.000 description 4
- 238000012795 verification Methods 0.000 description 4
- 238000010408 sweeping Methods 0.000 description 3
- 230000000694 effects Effects 0.000 description 2
- 238000005516 engineering process Methods 0.000 description 2
- 238000004458 analytical method Methods 0.000 description 1
- 238000013473 artificial intelligence Methods 0.000 description 1
- 230000005540 biological transmission Effects 0.000 description 1
- 238000011161 development Methods 0.000 description 1
- 238000012986 modification Methods 0.000 description 1
- 230000004048 modification Effects 0.000 description 1
- 230000003287 optical effect Effects 0.000 description 1
- 238000011160 research Methods 0.000 description 1
- 230000000630 rising effect Effects 0.000 description 1
- 238000006467 substitution reaction Methods 0.000 description 1
- 238000012360 testing method Methods 0.000 description 1
Images
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L67/00—Network arrangements or protocols for supporting network services or applications
- H04L67/01—Protocols
- H04L67/06—Protocols specially adapted for file transfer, e.g. file transfer protocol [FTP]
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L67/00—Network arrangements or protocols for supporting network services or applications
- H04L67/01—Protocols
- H04L67/10—Protocols in which an application is distributed across nodes in the network
Landscapes
- Engineering & Computer Science (AREA)
- Computer Networks & Wireless Communication (AREA)
- Signal Processing (AREA)
- Telephonic Communication Services (AREA)
Abstract
The application is applicable to the technical field of voice information processing, and provides a voice information processing method, a device, a storage medium and an intelligent terminal, which comprise the following steps: acquiring attribute information of an intelligent terminal and voice information sent by the intelligent terminal; performing voice recognition on the voice information, and determining the operation type of processing operation corresponding to the voice information; determining an uploading mode of the voice information according to the attribute information and/or the operation type of the intelligent terminal; and uploading the voice information to a cloud server based on the determined uploading mode. The method and the device can release the space resources of the local server, reduce the processing pressure of the server and improve the execution efficiency of the server.
Description
Technical Field
The present application belongs to the field of voice information processing technologies, and in particular, to a voice information processing method, apparatus, storage medium, and intelligent terminal.
Background
With the further rapid development of artificial intelligence in recent years, the robot industry is also rising rapidly, the voice recording system is more and more emphasized as an important system for uploading voice and issuing instructions of a robot, the system is more and more emphasized as a key system for the robot or other terminals to report voice and issue analysis result instructions, and the high-frequency and high-concurrent access of clients also brings great pressure to the voice recording system.
ASR (automatic speech recognition) technology has long played an important role as an integral part of service recognition of user languages. However, as the number of users increases, the pronunciation standard and the volume of the users both affect that the ASR cannot have a high recognition rate. Therefore, many enterprises or scientific research institutions need to use a large amount of voice files to test the voice algorithm, unfortunately, the number of standard voice channels which can be obtained at present is not large, the voice quality is low, and the problem of multiple dialects cannot be met. Therefore, it is highly necessary to store high-quality complete and smooth standard speech.
However, as the quantity of collected users increases gradually, data loss caused by insufficient storage space of the server occurs sometimes, the execution efficiency of the server is reduced due to excessive files stored in the server, the files are uploaded to the cloud in real time, the processing pressure of the server is increased, and storage failure is easily caused.
Disclosure of Invention
The embodiment of the application provides a voice information processing method and device, a storage medium and an intelligent terminal, and the problems that in the prior art, too many files are stored in a server, the execution efficiency of the server is reduced, the files are uploaded to a cloud end in real time, the processing pressure of the server is increased, and storage failure is easily caused are solved.
In a first aspect, an embodiment of the present application provides a method for processing voice information, including:
acquiring attribute information of intelligent equipment and voice information sent by the intelligent equipment;
performing voice recognition on the voice information, and determining the operation type of processing operation corresponding to the voice information;
determining an uploading mode of the voice information according to the attribute information and/or the operation type of the intelligent equipment;
and uploading the voice information to a cloud server based on the determined uploading mode.
In a possible implementation manner of the first aspect, the step of determining an uploading manner of the voice information according to the attribute information of the smart device includes:
determining an application scene type corresponding to the attribute information of the intelligent equipment according to the attribute information of the intelligent equipment;
and determining the uploading mode of the voice information corresponding to the application scene type of the intelligent equipment according to the application scene type and a preset scene uploading mode comparison table.
In a possible implementation manner of the first aspect, the determining, according to the operation type, an uploading manner of the voice information includes:
performing voice recognition on the voice information, and determining the operation type of processing operation corresponding to the voice information according to the voice recognition result;
and determining an uploading mode corresponding to the operation type according to the operation type and a preset type uploading mode comparison table.
In a possible implementation manner of the first aspect, the uploading the voice information to a cloud server based on the determined uploading manner includes:
reading voice byte information with a specified size from the voice information, and storing the voice byte information into a predefined message queue, wherein the message queue is used for storing the voice byte information to be uploaded;
and the starting thread uploads the voice byte information in the message queue to a cloud server based on the determined uploading mode.
In a possible implementation manner of the first aspect, the uploading the voice information to a cloud server based on the determined uploading manner includes:
if the uploading mode of the voice information is determined to be additional uploading, acquiring the packaging parameters of the additional uploading;
and packaging the voice information according to the additionally uploaded packaging parameters and uploading the voice information to a cloud server.
In a possible implementation manner of the first aspect, the uploading the voice information to a cloud server based on the determined uploading manner includes:
if the uploading mode of the voice information is one-time uploading, determining whether the voice information carries an end identifier;
if the voice information does not carry an end identifier, storing the voice information into a temporary folder;
if the voice information carries an end identifier, storing the voice information into the temporary folder, and acquiring a one-time uploaded packaging parameter;
and according to the one-time uploaded packaging parameters, packaging and packaging the voice information in the temporary folder, and uploading the packaged voice information to a cloud server.
In a second aspect, an embodiment of the present application provides a speech information processing apparatus, including:
the information acquisition unit is used for acquiring attribute information of the intelligent equipment and voice information sent by the intelligent equipment;
the information identification unit is used for carrying out voice identification on the voice information and determining the operation type of processing operation corresponding to the voice information;
the uploading mode determining unit is used for determining the uploading mode of the voice information according to the attribute information and/or the operation type of the intelligent equipment;
and the information uploading unit is used for uploading the voice information to a cloud server based on the determined uploading mode.
In a third aspect, an embodiment of the present application provides an intelligent terminal, which includes a memory, a processor, and a computer program stored in the memory and executable on the processor, where the processor implements the method for processing voice information according to the first aspect when executing the computer program.
In a fourth aspect, the present application provides a computer-readable storage medium, where a computer program is stored, and when executed by a processor, the computer program implements the method for processing voice information according to the first aspect.
In a fifth aspect, the present application provides a computer program product, which, when running on an intelligent terminal, causes the intelligent terminal to execute the voice information processing method according to the first aspect.
In the embodiment of the application, through the attribute information who acquires the smart machine and the speech information that the smart machine sent, it is right speech information carries out speech recognition, confirms the operation type of the processing operation that speech information corresponds, then according to the attribute information of smart machine and/or operation type confirms speech information's upload mode is based on the affirmation again the upload mode will speech information uploads to the high in the clouds server, and this application not only can release local server's space resource, improves the execution efficiency of server, still can upload speech information to the high in the clouds server from local server according to the upload mode of nimble affirmation, guarantees the integrality that speech information uploaded, can effectively reduce the execution pressure of server simultaneously.
Drawings
In order to more clearly illustrate the technical solutions in the embodiments of the present application, the drawings needed to be used in the embodiments or the prior art descriptions will be briefly described below, and it is obvious that the drawings in the following description are only some embodiments of the present application, and it is obvious for those skilled in the art to obtain other drawings based on these drawings without inventive exercise.
Fig. 1 is a flowchart of an implementation of a voice information processing method provided in an embodiment of the present application;
fig. 2 is a flowchart of a specific implementation of the voice information processing method S103 according to an embodiment of the present application;
fig. 3 is a flowchart illustrating a specific implementation of uploading in an additional uploading manner in step S104 of the voice information processing method according to the embodiment of the present application;
fig. 4 is a flowchart illustrating a specific implementation of uploading in a one-time transmission manner in step S104 of a voice information processing method according to an embodiment of the present application;
fig. 5 is a block diagram of a voice information processing apparatus according to an embodiment of the present application;
fig. 5a is a block diagram of a speech information processing apparatus according to another embodiment of the present application;
fig. 5b is a block diagram of a structure of an information uploading unit provided in an embodiment of the present application;
fig. 6 is a schematic diagram of an intelligent terminal provided in an embodiment of the present application.
Detailed Description
In the following description, for purposes of explanation and not limitation, specific details are set forth, such as particular system structures, techniques, etc. in order to provide a thorough understanding of the embodiments of the present application. It will be apparent, however, to one skilled in the art that the present application may be practiced in other embodiments that depart from these specific details. In other instances, detailed descriptions of well-known systems, devices, circuits, and methods are omitted so as not to obscure the description of the present application with unnecessary detail.
It will be understood that the terms "comprises" and/or "comprising," when used in this specification and the appended claims, specify the presence of stated features, integers, steps, operations, elements, and/or components, but do not preclude the presence or addition of one or more other features, integers, steps, operations, elements, components, and/or groups thereof.
It should also be understood that the term "and/or" as used in this specification and the appended claims refers to and includes any and all possible combinations of one or more of the associated listed items.
As used in this specification and the appended claims, the term "if" may be interpreted contextually as "when", "upon" or "in response to" determining "or" in response to detecting ". Similarly, the phrase "if it is determined" or "if a [ described condition or event ] is detected" may be interpreted contextually to mean "upon determining" or "in response to determining" or "upon detecting [ described condition or event ]" or "in response to detecting [ described condition or event ]".
Furthermore, in the description of the present application and the appended claims, the terms "first," "second," "third," and the like are used for distinguishing between descriptions and not necessarily for describing or implying relative importance.
Reference throughout this specification to "one embodiment" or "some embodiments," or the like, means that a particular feature, structure, or characteristic described in connection with the embodiment is included in one or more embodiments of the present application. Thus, appearances of the phrases "in one embodiment," "in some embodiments," "in other embodiments," or the like, in various places throughout this specification are not necessarily all referring to the same embodiment, but rather "one or more but not all embodiments" unless specifically stated otherwise. The terms "comprising," "including," "having," and variations thereof mean "including, but not limited to," unless expressly specified otherwise.
The voice information processing method provided by the embodiment of the present application can be applied to intelligent terminals such as servers and ultra-mobile personal computers (UMPCs), and the specific type of the intelligent terminal is not limited in any way in the embodiment of the present application.
Fig. 1 shows an implementation flow of a voice information processing method provided by an embodiment of the present application, where the method flow includes steps S101 to S104. The specific realization principle of each step is as follows:
s101: acquiring attribute information of the intelligent device and voice information sent by the intelligent device,
the attribute information of the intelligent equipment with different service processing functions is different, the attribute information comprises model information, equipment identification information and the like, and the attribute information of the intelligent equipment can be used for determining the application scene of the intelligent equipment. The execution end in this embodiment is a server, and the intelligent device may be a robot or an intelligent sound box. Illustratively, model information of the robot is acquired when the robot establishes a communication connection with the server. In the embodiment of the application, a voice access system runs on the server, the user wakes up the intelligent device, and the intelligent device establishes communication with the server through a token issued by the voice access system running on the server.
Specifically, a user inputs attribute information of a smart device, such as attribute information of a robot, on an APP of a mobile terminal, the mobile terminal sends the attribute information of the smart device to a server, receives a verification code fed back by the server based on the attribute information of the smart device sent by the mobile terminal and forwards the verification code to the smart device, the smart device requests a token from the server according to the verification code, the token is used for establishing communication between the smart device and the server, the server generates a token according to the attribute information of the smart device and the verification code and sends the token to the smart device, and after the smart device acquires the token, the smart device sends voice information of the user to the server in real time based on the token and the server communication connection, and the server acquires the voice information sent by the intelligent equipment in real time.
S102: and performing voice recognition on the voice information, and determining the operation type of the processing operation corresponding to the voice information.
In the embodiment of the application, a main thread is started to perform voice recognition on the voice information, corresponding processing operation is executed according to the result of the voice recognition, the result information of the processing operation is fed back to the intelligent equipment, and meanwhile, the operation type of the processing operation corresponding to the voice information is determined. Specifically, the processing operations corresponding to the voice information are classified according to the number of interactions, for example, a single interaction type or a multi-round interaction type, and it is determined whether the corresponding processing operation can be completed once or the voice information needs to be acquired multiple times to execute multiple processing operations according to the result of the voice recognition.
S103: and determining the uploading mode of the voice information according to the model information and/or the operation type of the intelligent equipment.
In order to improve the efficiency of information uploading and ensure the integrity of the uploaded information, in the embodiment of the present application, the uploading manner of the voice information may be determined according to the attribute information of the intelligent device and/or the operation type, where the uploading manner of the voice information includes, but is not limited to, additional uploading and one-time uploading. The one-time uploading refers to that a plurality of pieces of voice information are packaged together and uploaded. The voice information sent by the robots of different models can correspond to different uploading modes, correspond to voice information of different operation types, and the modes of uploading to the cloud server can be different.
As an embodiment of the present application, the attribute information includes model information, and the step of determining the uploading manner of the voice information according to the attribute information of the smart device specifically includes:
a1: and determining the application scene type corresponding to the attribute information of the intelligent equipment according to the attribute information of the intelligent equipment. The application scene type refers to a service function of the intelligent device, for example, the robot is determined to be a floor sweeping robot, a child learning robot or a companion robot according to the model information of the robot.
A2: and determining the uploading mode of the voice information corresponding to the application scene type of the intelligent equipment according to the application scene type and a preset scene uploading mode comparison table. A preset scene uploading mode comparison table is set, and the preset scene uploading mode comparison table comprises a comparison relation between an application scene type and an uploading mode of voice information, for example, if the robot is a sweeping robot, the uploading mode corresponding to the voice information sent by the sweeping robot is additional uploading; if the robot is a child learning robot, the uploading mode of the voice information sent by the child learning robot is one-time uploading. It should be noted that the scene upload mode comparison table includes two upload modes, that is, one-time upload mode and additional upload mode, for example, a random upload mode, that is, a randomly selected upload mode may also be included.
As an embodiment of the present application, the step of determining an uploading manner of the voice information according to the operation type specifically includes:
b1: and performing voice recognition on the voice information, and determining the operation type of the processing operation corresponding to the voice information according to the voice recognition result.
B2: and determining an uploading mode corresponding to the operation type according to the operation type and a preset type uploading mode comparison table. The preset type uploading mode comparison table comprises a comparison relation between the operation type and the uploading mode. For example, if the operation type of the processing operation corresponding to the voice information is a single interaction type, the uploading mode corresponding to the voice information is an additional uploading mode; and if the operation type of the processing operation corresponding to the voice information is a multi-round interaction type, the uploading mode corresponding to the voice information is a one-time uploading mode. It should be noted that the type upload mode comparison table includes two upload modes, i.e., one-time upload mode and additional upload mode, and may also include a random upload mode, i.e., a randomly selected upload mode.
As an embodiment of the present application, as shown in fig. 2, a specific implementation flow of step S103 of a voice information processing method provided in an embodiment of the present application specifically includes:
c1: and reading voice byte information with a specified size from the voice information, and storing the voice byte information into a predefined message queue, wherein the message queue is used for storing the voice byte information to be uploaded. In this embodiment, the server obtains the voice information uploaded by the intelligent device in real time, reads the voice byte information with the specified size from the voice information according to the set frequency, and sequentially stores the read voice byte information into a predefined message queue. The message queue is preset and used for storing voice byte information to be uploaded.
C2: and the starting thread uploads the voice byte information in the message queue to a cloud server based on the determined uploading mode. Specifically, a set number of sub-threads are started to consume the message queue, and the voice byte information in the message queue is uploaded to a cloud server according to a determined uploading mode.
In the embodiment of the application, a main thread is started to perform voice recognition on the voice information, corresponding processing operation is executed according to the result of the voice recognition, a set number of sub-threads are started to consume the message queue, and the voice byte information in the message queue is uploaded to a cloud server based on a determined uploading mode. The voice information is uploaded to the cloud server through the sub-thread, whether the voice information is uploaded successfully or not, the main thread is not influenced to process the voice information and feed back a processing result, the voice information is effectively uploaded to the cloud server to be stored while the voice information is processed efficiently, the processing efficiency of the server on the voice information is improved, the voice information is uploaded by introducing the message queue, uploading congestion is avoided, and meanwhile the pressure of the server is relieved.
Optionally, if it is determined that the uploading mode of the voice information corresponding to the application scene type of the smart device is a random uploading mode according to the application scene type and a preset scene uploading mode comparison table, determining the uploading mode corresponding to the operation type according to the operation type and a preset type uploading mode comparison table, and determining the uploading mode corresponding to the operation type as the uploading mode of the voice information.
S104: and uploading the voice information to a cloud server based on the determined uploading mode.
In the embodiment of the application, an API (application programming interface) corresponding to an additional uploading mode, a one-time uploading mode or other uploading modes is called, and the voice information is uploaded to a cloud server to be stored. Note that the upload method in the embodiment of the present application is not limited to the additional upload and the one-time upload.
As an embodiment of the present application, fig. 3 shows a specific implementation flow of uploading in an additional uploading manner in step S104 of the voice information processing method provided in the embodiment of the present application, which is detailed as follows:
d1: and if the uploading mode of the voice information is determined to be additional uploading, acquiring the packaging parameters of the additional uploading. Specifically, the encapsulation parameters of different uploading modes are different, and the encapsulation parameters include the identifiers of the uploading modes. And when the uploading mode of the voice information is determined to be additional uploading, generating an additional uploading packaging parameter aiming at the voice information according to a preset rule according to a user identifier, an intelligent equipment identifier and an additional uploading mode identifier carried by the voice information.
D2: and packaging the voice information according to the additionally uploaded packaging parameters and uploading the voice information to a cloud server.
In the embodiment of the application, the voice information is packaged according to the corresponding packaging parameters and then uploaded to the cloud server, and due to the fact that the uploading mode identification exists in the packaging parameters, the uploading mode of the stored voice information can be conveniently determined in the cloud server. Optionally, the cloud server may dynamically generate a folder name dedicated to the voice information according to the user identifier and the smart device identifier in the encapsulation information, and the server uploads the voice information uploaded by the smart device in an additional manner within a certain time period to the same folder for storage.
As an embodiment of the present application, fig. 4 shows a specific implementation flow of uploading in a one-time uploading manner in step S104 of a voice information processing method provided in the embodiment of the present application, which is detailed as follows:
e1: and if the uploading mode of the voice information is one-time uploading, determining whether the voice information carries an end identifier. Specifically, if the voice information is determined to be a first section of initial voice information uploaded by the intelligent device, generating an initial identifier for the voice; and if the voice information is determined to be the last section of voice information of the intelligent equipment in the current interaction stage, generating an ending identifier of the voice information. In the embodiment of the application, the voice information acquired in the current round of interaction for the first time is determined as a first section of voice information, the server fixedly reads the voice information with the specified length every time, and when the length of the read voice information is smaller than the specified length, the voice information is determined as a last section of voice information, or the voice information uploaded by the intelligent device is not detected within the preset time, the user is determined to be muted, and the voice information uploaded by the intelligent device before the user is muted is determined as the last section of voice information.
E2: and if the voice information does not carry an end identifier, storing the voice information into a temporary folder. If the voice information does not carry the ending mark, judging that the user has not recorded the voice information, continuously acquiring the voice information uploaded by the intelligent equipment, wherein each section of voice information uploaded by the intelligent equipment carries an information number, and sequentially storing the voice information into a temporary folder according to the information number. The temporary folder is used for caching voice information. In one embodiment, the storage space is periodically cleaned, the temporary folders which are uploaded in a packaged mode are deleted, and the storage space is released.
E3: and if the voice information carries an end identifier, storing the voice information into the temporary folder, and acquiring the packaging parameters uploaded at one time. Specifically, when the uploading mode of the voice information is determined to be one-time uploading, generating a packaging parameter for the one-time uploading of the voice information according to a preset rule according to a user identifier, an intelligent device identifier and a one-time uploading mode identifier carried by the voice information.
E4: and according to the one-time uploaded packaging parameters, packaging and packaging the voice information in the temporary folder, and uploading the packaged voice information to a cloud server. And the server can dynamically generate the folder name of the temporary folder according to the user identifier, the intelligent equipment identifier and the one-time uploading mode identifier carried by the voice information.
In the embodiment of the application, the voice information originally stored in the local server is uploaded to the cloud server, so that the space resource of the server is released, and the execution efficiency of the server can be improved.
In this application embodiment, through the attribute information that acquires the smart machine and the speech information that the smart machine sent, it is right the speech information carries out speech recognition, confirms the operation type of the processing operation that the speech information corresponds, then according to the attribute information of smart machine and/or operation type confirms speech information's upload mode is based on the affirmation again the upload mode will the speech information uploads to the high in the clouds server, and this application not only can release local server's space resource, improves the execution efficiency of server, still can be according to nimble certain upload mode with speech information from local server upload to the high in the clouds server, guarantees the integrality that speech information uploaded, can effectively reduce the execution pressure of server simultaneously.
It should be understood that, the sequence numbers of the steps in the foregoing embodiments do not imply an execution sequence, and the execution sequence of each process should be determined by its function and inherent logic, and should not constitute any limitation to the implementation process of the embodiments of the present application.
Fig. 5 shows a block diagram of a voice information processing apparatus according to an embodiment of the present application, which corresponds to the voice information processing method described in the foregoing embodiment, and only shows portions related to the embodiment of the present application for convenience of description.
Referring to fig. 5, the voice information processing apparatus includes: an information acquisition unit 51, an information identification unit 52, an upload mode determination unit 53, and an information upload unit 54, wherein:
an information obtaining unit 51, configured to obtain attribute information of an intelligent device and voice information sent by the intelligent device;
an information recognition unit 52, configured to perform speech recognition on the speech information, and determine an operation type of a processing operation corresponding to the speech information;
an upload mode determining unit 53, configured to determine an upload mode of the voice information according to the attribute information of the smart device and/or the operation type;
and an information uploading unit 54, configured to upload the voice information to a cloud server based on the determined uploading manner.
Optionally, as shown in fig. 5a, the upload mode determining unit 53 includes:
the scene type determining module 531 is configured to determine, according to the attribute information of the intelligent device, an application scene type corresponding to the attribute information of the intelligent device;
a first mode determining module 532, configured to determine, according to the application scene type and a preset scene uploading mode comparison table, an uploading mode of the voice information corresponding to the application scene type of the smart device.
Optionally, the upload mode determination unit 53 includes:
the operation type determining module is used for carrying out voice recognition on the voice information and determining the operation type of processing operation corresponding to the voice information according to the voice recognition result;
and the second mode determining module is used for determining the uploading mode corresponding to the operation type according to the operation type and a preset type uploading mode comparison table.
Optionally, the upload mode determining unit 53 further includes:
and the third mode determining module is used for determining the uploading mode corresponding to the operation type according to the operation type and a preset type uploading mode comparison table if the uploading mode of the voice information corresponding to the application scene type of the intelligent device is determined to be a random uploading mode according to the application scene type and a preset scene uploading mode comparison table.
Optionally, the information uploading unit 54 includes:
the information reading module is used for reading voice byte information with specified size from the voice information and storing the voice byte information into a predefined message queue, and the message queue is used for storing the voice byte information to be uploaded;
and the information uploading module is used for starting the sub thread and uploading the voice byte information in the message queue to a cloud server based on the determined uploading mode.
Optionally, the information uploading unit 54 includes:
the first parameter acquisition module is used for acquiring the packaging parameters of the additional uploading if the uploading mode of the voice information is determined to be the additional uploading;
and the first uploading module is used for uploading the voice information to a cloud server after packaging according to the additionally uploaded packaging parameters.
Optionally, as shown in fig. 5b, the information uploading unit 54 includes:
an identifier determining module 541, configured to determine whether the voice information carries an end identifier if the voice information is uploaded in a one-time uploading manner;
the information caching module 542 is configured to store the voice information into a temporary folder if the voice information does not carry an end identifier;
a second parameter obtaining module 543, configured to store the voice information in the temporary folder and obtain a one-time uploaded encapsulation parameter if the voice information carries an end identifier;
the second uploading module 544 is configured to, according to the one-time uploaded encapsulation parameter, package and encapsulate the voice information in the temporary folder, and then upload the voice information to a cloud server.
In this application embodiment, through the attribute information who acquires the smart machine and the speech information that the smart machine sent, it is right speech information carries out speech recognition, confirms the operation type of the processing operation that speech information corresponds, then according to the attribute information of smart machine and/or operation type confirms speech information's upload mode is based on the affirmation again speech information uploads to the high in the clouds server, and this application not only can release local server's space resource, improves the execution efficiency of server, still can upload to the high in the clouds server from local server according to the upload mode of nimble affirmation with speech information, guarantees the integrality that speech information uploaded, can effectively reduce the execution pressure of server simultaneously.
It should be noted that, for the information interaction, execution process, and other contents between the above-mentioned devices/units, the specific functions and technical effects thereof are based on the same concept as those of the embodiment of the method of the present application, and specific reference may be made to the part of the embodiment of the method, which is not described herein again.
Embodiments of the present application further provide a computer-readable storage medium, which stores computer-readable instructions, and when the computer-readable instructions are executed by a processor, the steps of any one of the voice information processing methods shown in fig. 1 to 4 are implemented.
An embodiment of the present application further provides an intelligent terminal, which includes a memory, a processor, and computer readable instructions stored in the memory and executable on the processor, where the processor executes the computer readable instructions to implement any one of the steps of the voice information processing method shown in fig. 1 to 4.
The embodiment of the present application further provides a computer program product, which, when running on a server, causes the server to execute the steps of implementing any one of the voice information processing methods shown in fig. 1 to 4.
Fig. 6 is a schematic diagram of an intelligent terminal according to an embodiment of the present application. As shown in fig. 6, the intelligent terminal 6 of this embodiment includes: a processor 60, a memory 61, and computer readable instructions 62 stored in the memory 61 and executable on the processor 60. The processor 60, when executing the computer readable instructions 62, implements the steps in the various speech information processing method embodiments described above, such as steps S101-S104 shown in fig. 1. Alternatively, the processor 60, when executing the computer readable instructions 62, implements the functions of the modules/units in the above-described device embodiments, such as the functions of the units 51 to 54 shown in fig. 5.
Illustratively, the computer readable instructions 62 may be partitioned into one or more modules/units that are stored in the memory 61 and executed by the processor 60 to accomplish the present application. The one or more modules/units may be a series of computer-readable instruction segments capable of performing certain functions, which are used to describe the execution of the computer-readable instructions 62 in the intelligent terminal 6.
The intelligent terminal 6 may be a server. The intelligent terminal 6 may include, but is not limited to, a processor 60, and a memory 61. It will be understood by those skilled in the art that fig. 6 is merely an example of the intelligent terminal 6, and does not constitute a limitation of the intelligent terminal 6, and may include more or less components than those shown, or combine some components, or different components, for example, the intelligent terminal 6 may further include an input-output device, a network access device, a bus, etc.
The Processor 60 may be a Central Processing Unit (CPU), other general purpose Processor, a Digital Signal Processor (DSP), an Application Specific Integrated Circuit (ASIC), an off-the-shelf Programmable Gate Array (FPGA) or other Programmable logic device, discrete Gate or transistor logic device, discrete hardware component, etc. A general purpose processor may be a microprocessor or the processor may be any conventional processor or the like.
The memory 61 may be an internal storage unit of the intelligent terminal 6, such as a hard disk or a memory of the intelligent terminal 6. The memory 61 may also be an external storage device of the intelligent terminal 6, such as a plug-in hard disk, a Smart Media Card (SMC), a Secure Digital (SD) Card, a Flash memory Card (Flash Card), and the like, which are equipped on the intelligent terminal 6. Further, the memory 61 may also include both an internal storage unit and an external storage device of the smart terminal 6. The memory 61 is used for storing the computer readable instructions and other programs and data required by the intelligent terminal. The memory 61 may also be used to temporarily store data that has been output or is to be output.
It should be noted that, for the information interaction, execution process, and other contents between the above-mentioned devices/units, the specific functions and technical effects thereof are based on the same concept as those of the embodiment of the method of the present application, and specific reference may be made to the part of the embodiment of the method, which is not described herein again.
It will be apparent to those skilled in the art that, for convenience and brevity of description, only the above-mentioned division of the functional units and modules is illustrated, and in practical applications, the above-mentioned function distribution may be performed by different functional units and modules according to needs, that is, the internal structure of the apparatus is divided into different functional units or modules to perform all or part of the above-mentioned functions. Each functional unit and module in the embodiments may be integrated in one processing unit, or each unit may exist alone physically, or two or more units are integrated in one unit, and the integrated unit may be implemented in a form of hardware, or in a form of software functional unit. In addition, specific names of the functional units and modules are only for convenience of distinguishing from each other, and are not used for limiting the protection scope of the present application. The specific working processes of the units and modules in the system may refer to the corresponding processes in the foregoing method embodiments, and are not described herein again.
The integrated unit, if implemented in the form of a software functional unit and sold or used as a stand-alone product, may be stored in a computer readable storage medium. Based on such understanding, all or part of the processes in the methods of the embodiments described above can be implemented by a computer program, which can be stored in a computer-readable storage medium and can implement the steps of the embodiments of the methods described above when the computer program is executed by a processor. Wherein the computer program comprises computer program code, which may be in the form of source code, object code, an executable file or some intermediate form, etc. The computer readable medium may include at least: any entity or apparatus capable of carrying the computer program code with the speech information processing apparatus/terminal device, recording medium, computer Memory, Read-Only Memory (ROM), Random Access Memory (RAM), electrical carrier signal, telecommunications signal and software distribution medium. Such as a usb-disk, a removable hard disk, a magnetic or optical disk, etc. In certain jurisdictions, computer-readable media may not be an electrical carrier signal or a telecommunications signal in accordance with legislative and patent practice.
In the above embodiments, the descriptions of the respective embodiments have respective emphasis, and reference may be made to the related descriptions of other embodiments for parts that are not described or illustrated in a certain embodiment.
The above-mentioned embodiments are only used for illustrating the technical solutions of the present application, and not for limiting the same; although the present application has been described in detail with reference to the foregoing embodiments, it should be understood by those of ordinary skill in the art that: the technical solutions described in the foregoing embodiments may still be modified, or some technical features may be equivalently replaced; such modifications and substitutions do not substantially depart from the spirit and scope of the embodiments of the present application and are intended to be included within the scope of the present application.
Claims (10)
1. A method for processing speech information, comprising:
acquiring attribute information of intelligent equipment and voice information sent by the intelligent equipment;
performing voice recognition on the voice information, and determining an operation type of processing operation corresponding to the voice information, wherein the operation type comprises a single interaction type and a multi-round interaction type;
determining an uploading mode of the voice information according to the attribute information and/or the operation type of the intelligent equipment, wherein the uploading mode comprises additional uploading, one-time uploading and random uploading;
and uploading the voice information to a cloud server based on the determined uploading mode.
2. The method according to claim 1, wherein the step of determining the uploading manner of the voice information according to the attribute information of the smart device comprises:
determining an application scene type corresponding to the attribute information of the intelligent equipment according to the attribute information of the intelligent equipment;
and determining the uploading mode of the voice information corresponding to the application scene type of the intelligent equipment according to the application scene type and a preset scene uploading mode comparison table.
3. The method according to claim 1, wherein the step of determining the uploading manner of the voice information according to the operation type comprises:
performing voice recognition on the voice information, and determining the operation type of processing operation corresponding to the voice information according to the voice recognition result;
and determining an uploading mode corresponding to the operation type according to the operation type and a preset type uploading mode comparison table.
4. The method of claim 1, wherein the uploading the voice message to a cloud server based on the determined uploading manner comprises:
reading voice byte information with a specified size from the voice information, and storing the voice byte information into a predefined message queue, wherein the message queue is used for storing the voice byte information to be uploaded;
and the starting thread uploads the voice byte information in the message queue to a cloud server based on the determined uploading mode.
5. The method of claim 1, wherein the uploading the voice message to a cloud server based on the determined uploading manner comprises:
if the uploading mode of the voice information is determined to be additional uploading, acquiring the packaging parameters of the additional uploading;
and packaging the voice information according to the additionally uploaded packaging parameters and uploading the voice information to a cloud server.
6. The method of claim 1, wherein the uploading the voice message to a cloud server based on the determined uploading manner comprises:
if the uploading mode of the voice information is one-time uploading, determining whether the voice information carries an end identifier;
if the voice information does not carry an end identifier, storing the voice information into a temporary folder;
if the voice information carries an end identifier, storing the voice information into the temporary folder, and acquiring a one-time uploaded packaging parameter;
and according to the one-time uploaded packaging parameters, packaging and packaging the voice information in the temporary folder, and uploading the packaged voice information to a cloud server.
7. A speech information processing apparatus characterized by comprising:
the information acquisition unit is used for acquiring attribute information of the intelligent equipment and voice information sent by the intelligent equipment;
the information identification unit is used for carrying out voice identification on the voice information and determining the operation type of processing operation corresponding to the voice information, wherein the operation type comprises a single interaction type and a multi-round interaction type;
the uploading mode determining unit is used for determining the uploading mode of the voice information according to the attribute information and/or the operation type of the intelligent equipment, and the uploading mode comprises additional uploading, one-time uploading and random uploading;
and the information uploading unit is used for uploading the voice information to a cloud server based on the determined uploading mode.
8. The speech information processing apparatus according to claim 7, wherein the upload mode determination unit includes:
the application scene determining module is used for determining an application scene type corresponding to the attribute information of the intelligent equipment according to the attribute information of the intelligent equipment;
and the first mode determining module is used for determining the uploading mode of the voice information corresponding to the application scene type of the intelligent equipment according to the application scene type and a preset scene uploading mode comparison table.
9. An intelligent terminal comprising a memory, a processor, and a computer program stored in the memory and executable on the processor, wherein the processor implements the speech information processing method according to any one of claims 1 to 6 when executing the computer program.
10. A computer-readable storage medium, in which a computer program is stored, which, when being executed by a processor, carries out a speech information processing method according to any one of claims 1 to 6.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201911363138.7A CN111210826B (en) | 2019-12-26 | 2019-12-26 | Voice information processing method and device, storage medium and intelligent terminal |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201911363138.7A CN111210826B (en) | 2019-12-26 | 2019-12-26 | Voice information processing method and device, storage medium and intelligent terminal |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN111210826A CN111210826A (en) | 2020-05-29 |
| CN111210826B true CN111210826B (en) | 2022-08-05 |
Family
ID=70786468
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201911363138.7A Active CN111210826B (en) | 2019-12-26 | 2019-12-26 | Voice information processing method and device, storage medium and intelligent terminal |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN111210826B (en) |
Families Citing this family (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN113782021B (en) * | 2021-09-14 | 2023-10-24 | Vidaa(荷兰)国际控股有限公司 | Display equipment and prompt tone playing method |
| CN114157523B (en) * | 2021-11-24 | 2022-10-11 | 珠海格力电器股份有限公司 | Data reporting method and device, intelligent household equipment and storage medium |
Citations (8)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| JP2012247679A (en) * | 2011-05-30 | 2012-12-13 | Nippon Telegr & Teleph Corp <Ntt> | Text and voice feature amount collection method, system therefor, and program |
| CN103617797A (en) * | 2013-12-09 | 2014-03-05 | 腾讯科技（深圳）有限公司 | Voice processing method and device |
| JP2017107198A (en) * | 2015-12-02 | 2017-06-15 | 悠之介 北 | Voice collection method and voice transplantation method |
| CN107342079A (en) * | 2017-07-05 | 2017-11-10 | 谌勋 | A kind of acquisition system of the true voice based on internet |
| CN108010518A (en) * | 2017-12-13 | 2018-05-08 | 腾讯科技（深圳）有限公司 | A kind of voice acquisition method, system and the storage medium of interactive voice equipment |
| CN108510290A (en) * | 2018-03-12 | 2018-09-07 | 平安科技（深圳）有限公司 | Customer information amending method, device, computer equipment and storage medium in call |
| CN109192205A (en) * | 2018-09-12 | 2019-01-11 | 深圳市酷搏创新科技有限公司 | A kind of intelligent speech interactive system and its control method |
| CN109961781A (en) * | 2017-12-22 | 2019-07-02 | 深圳市优必选科技有限公司 | Voice messaging method of reseptance, system and terminal device based on robot |
Family Cites Families (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| JP5803056B2 (en) * | 2009-11-16 | 2015-11-04 | ヤマハ株式会社 | Acoustic processing system and acoustic processing method |
| KR101294553B1 (en) * | 2011-10-13 | 2013-08-07 | 기아자동차주식회사 | System for managing sound source information |
| US10645490B2 (en) * | 2016-07-27 | 2020-05-05 | Sound Devices Llc | Network system for reliable reception of wireless audio |
| JP7094486B2 (en) * | 2017-12-27 | 2022-07-04 | トヨタ自動車株式会社 | Information provider |
-
2019
- 2019-12-26 CN CN201911363138.7A patent/CN111210826B/en active Active
Patent Citations (8)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| JP2012247679A (en) * | 2011-05-30 | 2012-12-13 | Nippon Telegr & Teleph Corp <Ntt> | Text and voice feature amount collection method, system therefor, and program |
| CN103617797A (en) * | 2013-12-09 | 2014-03-05 | 腾讯科技（深圳）有限公司 | Voice processing method and device |
| JP2017107198A (en) * | 2015-12-02 | 2017-06-15 | 悠之介 北 | Voice collection method and voice transplantation method |
| CN107342079A (en) * | 2017-07-05 | 2017-11-10 | 谌勋 | A kind of acquisition system of the true voice based on internet |
| CN108010518A (en) * | 2017-12-13 | 2018-05-08 | 腾讯科技（深圳）有限公司 | A kind of voice acquisition method, system and the storage medium of interactive voice equipment |
| CN109961781A (en) * | 2017-12-22 | 2019-07-02 | 深圳市优必选科技有限公司 | Voice messaging method of reseptance, system and terminal device based on robot |
| CN108510290A (en) * | 2018-03-12 | 2018-09-07 | 平安科技（深圳）有限公司 | Customer information amending method, device, computer equipment and storage medium in call |
| CN109192205A (en) * | 2018-09-12 | 2019-01-11 | 深圳市酷搏创新科技有限公司 | A kind of intelligent speech interactive system and its control method |
Non-Patent Citations (2)
| Title |
|---|
| Yang Yongxia.FPGA-based High-speed Data Acquisition and Transmission of Voice Logging System.《Electronic Science and Technology 》.2011, * |
| 施荣荣.基于USB2.0接口语音采集系统的设计与实现.《中国优秀硕士学位论文全文数据库信息科技辑》.2007, * |
Also Published As
| Publication number | Publication date |
|---|---|
| CN111210826A (en) | 2020-05-29 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| JP7112919B2 (en) | Smart device task processing method and device | |
| CN110457256A (en) | Date storage method, device, computer equipment and storage medium | |
| CN108763268B (en) | Batch processing method and device of three-dimensional model and storage medium | |
| CN111210826B (en) | Voice information processing method and device, storage medium and intelligent terminal | |
| WO2017107514A1 (en) | Offline transcoding method and system | |
| CN102957622B (en) | Method, device and system for data processing | |
| US11699073B2 (en) | Network off-line model processing method, artificial intelligence processing device and related products | |
| CN113656503A (en) | Data synchronization method, device and system and computer readable storage medium | |
| CN110661829A (en) | File downloading method and device, client and computer readable storage medium | |
| CN109089174A (en) | A kind of processing method and processing device of multimedia data stream, computer storage medium | |
| CN113923268B (en) | Resolution method, device and storage medium for multi-version communication protocol | |
| CN111338716A (en) | Data processing method and device based on rule engine and terminal equipment | |
| CN110708363A (en) | File transmission method, system, electronic equipment and storage medium | |
| CN110769064A (en) | System, method and equipment for offline message pushing | |
| CN114564227A (en) | Application program updating method and device, electronic equipment and storage medium | |
| CN112182046A (en) | Information recommendation method, device, equipment and medium | |
| CN107329832B (en) | Data receiving method and device | |
| CN111401566B (en) | Machine learning training method and system | |
| CN106648912B (en) | Modularization method and device for data processing in data acquisition platform | |
| CN111414339A (en) | File processing method, system, device, equipment and medium | |
| CN111294613A (en) | Video processing method, client and server | |
| CN112182327A (en) | Data processing method, device, equipment and medium | |
| CN110806874A (en) | Analysis method, storage medium, electronic device and system for configuration file of live broadcast room | |
| WO2015078124A1 (en) | Network data processing method and device | |
| CN109033189B (en) | Compression method and device of link structure log, server and readable storage medium |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant | ||
| TR01 | Transfer of patent right | ||
| TR01 | Transfer of patent right |
Effective date of registration: 20231204 Address after: Room 601, 6th Floor, Building 13, No. 3 Jinghai Fifth Road, Beijing Economic and Technological Development Zone (Tongzhou), Tongzhou District, Beijing, 100176 Patentee after: Beijing Youbixuan Intelligent Robot Co.,Ltd. Address before: 518000 16th and 22nd Floors, C1 Building, Nanshan Zhiyuan, 1001 Xueyuan Avenue, Nanshan District, Shenzhen City, Guangdong Province Patentee before: Shenzhen Youbixuan Technology Co.,Ltd. |