WO2018166367A1 - Real-time prompt method and device in real-time conversation, storage medium, and electronic device - Google Patents
Real-time prompt method and device in real-time conversation, storage medium, and electronic device Download PDFInfo
- Publication number
- WO2018166367A1 WO2018166367A1 PCT/CN2018/077980 CN2018077980W WO2018166367A1 WO 2018166367 A1 WO2018166367 A1 WO 2018166367A1 CN 2018077980 W CN2018077980 W CN 2018077980W WO 2018166367 A1 WO2018166367 A1 WO 2018166367A1
- Authority
- WO
- WIPO (PCT)
- Prior art keywords
- real
- time
- user
- conversation
- voice data
- Prior art date
Links
- 238000000034 method Methods 0.000 title claims abstract description 62
- 230000015654 memory Effects 0.000 claims description 18
- 238000004590 computer program Methods 0.000 claims description 7
- 230000006870 function Effects 0.000 claims description 7
- 238000000605 extraction Methods 0.000 claims description 4
- 230000004044 response Effects 0.000 claims description 4
- 238000006243 chemical reaction Methods 0.000 claims description 3
- 230000005540 biological transmission Effects 0.000 description 6
- 238000010586 diagram Methods 0.000 description 5
- 230000003993 interaction Effects 0.000 description 2
- 230000003287 optical effect Effects 0.000 description 2
- 238000007781 pre-processing Methods 0.000 description 2
- 230000011664 signaling Effects 0.000 description 2
- 238000001914 filtration Methods 0.000 description 1
- 238000011068 loading method Methods 0.000 description 1
- 238000010295 mobile communication Methods 0.000 description 1
- 238000005070 sampling Methods 0.000 description 1
- 239000007787 solid Substances 0.000 description 1
- 239000000725 suspension Substances 0.000 description 1
Images
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L65/00—Network arrangements, protocols or services for supporting real-time applications in data packet communication
- H04L65/40—Support for services or applications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L65/00—Network arrangements, protocols or services for supporting real-time applications in data packet communication
- H04L65/1066—Session management
- H04L65/1069—Session establishment or de-establishment
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L65/00—Network arrangements, protocols or services for supporting real-time applications in data packet communication
- H04L65/1066—Session management
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L67/00—Network arrangements or protocols for supporting network services or applications
- H04L67/50—Network services
- H04L67/56—Provisioning of proxy services
Definitions
- the present invention relates to the field of data processing, and in particular, to a real-time reminding method, device, storage medium and electronic device in a real-time conversation.
- real-time conversations can also be applied to a variety of scenarios, such as opening a voice or video conference.
- users may miss or miss some key information in the real-time conversation process.
- an effective solution is needed.
- the invention provides a real-time reminding method in a real-time conversation, which can promptly remind the user according to the user's needs in the process of real-time conversation, thereby reducing the probability that the user misses or misses the key information in the real-time conversation.
- the present invention provides a real-time reminding method in a real-time conversation, and the real-time reminding method includes:
- a real-time reminder signal is sent to the user with the user identification.
- the method further includes:
- the voice data is successfully matched with the reminder key information, the voice data is identified, and the text data converted by the voice data is saved.
- the method further includes:
- the user identifier of the user who sent the voice data is saved, and the time information when the user sends the voice data.
- the method further includes:
- the conversation record including text data converted by the voice data, a user identifier of a user transmitting the voice data, and time information when the user sends the voice data Corresponding relationship, wherein the conversation record of the real-time conversation is used for downloading by participating users in the real-time conversation.
- the method further includes:
- a dialog record that has been edited twice by the user is received and saved for download by the participating users in the real-time conversation.
- the reminding key information is voice data
- the using the voice data to match the reminder key information corresponding to the user identifiers of the participating users in the real-time conversation including:
- Extracting features of the voice data the features including waveform information
- the features of the voice data are matched with the features of the reminder key information corresponding to the user identifiers of the respective users in the real-time conversation.
- the reminding key information is text data
- the using the voice data to match the reminder key information corresponding to the user identifiers of the participating users in the real-time conversation including:
- the text data is matched with the reminder key information corresponding to the user identifiers of the participating users in the real-time conversation.
- the method further includes:
- the client's client receives the alert signal, in response to the alert signal, the audio or video recording function is turned on.
- the present invention also provides a real-time reminding device in a real-time conversation, the device comprising:
- the first saving module is configured to receive preset reminder key information and a user identifier, and save a correspondence between the reminder key information and the user identifier;
- the first obtaining module is configured to acquire, when the voice data is received in real time, the user identifier of each user participating in the conversation in the real-time conversation to which the voice data belongs;
- the matching module is configured to use the voice data to perform real-time matching with the reminder key information corresponding to the user identifiers of the participating users in the real-time conversation;
- a second acquiring module configured to: when the voice data is successfully matched with the reminder key information, acquire a user identifier that has a corresponding relationship with the reminder key information;
- the first sending module is configured to send a real-time reminder signal to the user having the user identification.
- the device further includes:
- the second saving module is configured to identify the voice data when the voice data is successfully matched with the reminder key information, and save the text data converted by the voice data.
- the device further includes:
- the third saving module is configured to: when the voice data is successfully matched with the reminder key information, save the user identifier of the user who sends the voice data, and time information when the user sends the voice data.
- the device further includes:
- a generating module configured to generate a conversation record of the real-time conversation, the conversation record including text data converted by the voice data, a user identifier of a user transmitting the voice data, and the user transmitting the voice Correspondence between time information of data, wherein the conversation record of the real-time conversation is used for downloading by participating users in the real-time conversation.
- the device further includes:
- a second sending module configured to send the conversation record to the user when receiving a download request of the conversation record of the real-time conversation by the user in the real-time conversation;
- the third storage module is configured to receive and save the dialog record edited by the user for secondary downloading for the participating users in the real-time conversation.
- the reminding key information is voice data
- the matching module includes:
- An extraction submodule configured to extract features of the speech data, the features including waveform information
- the first matching sub-module is configured to match the feature of the voice data with the feature of the reminder key information corresponding to the user identifier of the participating user in the real-time conversation.
- the reminding key information is text data
- the matching module includes:
- a conversion submodule configured to identify the voice data and convert the voice data into text data
- the second matching sub-module is configured to match the text data with reminder key information respectively corresponding to the user identifiers of the participating users in the real-time conversation.
- the present invention provides a real-time reminding method in a real-time conversation.
- a preset reminder key information and a user identifier are received, and a correspondence relationship between the reminder key information and the user identifier is saved.
- the voice data is received in real time
- the user identifier of each user participating in the conversation in the real-time conversation to which the voice data belongs is obtained.
- real-time matching is performed with the reminder key information corresponding to the user identifiers of the participating users in the real-time conversation.
- the voice data is successfully matched with the reminder key information
- the user identifier corresponding to the reminder key information is acquired.
- a real-time reminder signal is sent to the user with the user identification.
- the real-time reminding method in the real-time dialogue provided by the invention can remind the user according to the user's needs, thereby reducing the probability that the user misses or misses the key information in the real-time conversation.
- FIG. 1 is a flow chart of a real-time reminding method in a real-time conversation provided by the present invention
- FIG. 2 is a signaling interaction diagram of a real-time reminding method in a real-time conversation provided by the present invention
- FIG. 3 is a schematic structural diagram of a real-time reminding device in a real-time conversation provided by the present invention
- FIG. 4 is a structural block diagram of an electronic device according to the present invention.
- FIG. 1 is a flowchart of a real-time reminding method in a real-time conversation according to an embodiment of the present invention.
- the method may specifically include:
- S101 Receive preset reminder key information and a user identifier, and save a correspondence between the reminder key information and the user identifier.
- the reminder key information when the user performs a real-time conversation, the reminder key information may be set in advance for the real-time conversation. Specifically, after the user sets the reminder key information on the client, the user in the real-time conversation sends the reminder key information to the server. After the server receives the reminder key information set by the user and the user identifier, the corresponding relationship between the reminder key information and the user identifier is stored.
- the real-time conversation includes an audio-video real-time conversation, and the user identifier includes a user nickname, a user identity identifier (ID), and the like, which can uniquely identify the user in the audio-video conversation.
- S102 When receiving voice data in real time, acquire a user identifier of each user participating in the conversation in the real-time conversation to which the voice data belongs.
- each voice spoken by the user is sent to the server as voice data.
- the server receives the voice data in the real-time conversation, the user identifier of each user participating in the real-time conversation is first obtained. .
- S103 Perform real-time matching with the reminder key information corresponding to the user identifiers of the participating users in the real-time conversation by using the voice data.
- the server after obtaining the user identifiers of the users participating in the real-time conversation, the server separately obtains the pre-stored reminder key information corresponding to the user identifiers of the respective users. Specifically, some users in the real-time conversation may not set the reminder key information in advance. Therefore, the embodiment of the present invention only obtains the reminder key information of the user preset in the real-time conversation.
- the received voice data is used to match the reminder key information corresponding to the user identifier of each user in the real-time conversation, and the reminder key information that successfully matches the voice data is determined.
- the reminder key information preset by the user in the embodiment of the present invention may be voice data or text data. Specifically, the way to match different types of reminder key information is different.
- the method for matching the key information to the voice data includes: first, performing pre-processing such as denoising, filtering, sampling, etc. on the received voice data, and secondly, performing feature extraction on the voice data subjected to the pre-processing, and then The extracted features are matched with the features of the reminder key information of each user in this real-time conversation.
- the feature includes waveform information, specifically, calculating a similarity between the waveform information of the voice data and the waveform information of the pre-stored reminder key information, and if the similarity satisfies the preset value, determining the two The match was successful.
- the conditions for the specific matching success are not limited to the above.
- the matching manner for reminding the key information as text data includes: first, after denoising the received voice data, identifying the voice data, and converting the voice data into text data. Then, the text data is matched with the reminder key information of each user in the real-time conversation. In one implementation, if the text data includes or is included in any of the reminder key information, it is determined that the two matches are successful.
- the conditions for the specific matching success are not limited to the above.
- the user identifier corresponding to the reminder key information is acquired.
- S105 Send a real-time reminder signal to the user having the user identifier.
- the embodiment of the present invention sends a real-time reminder signal to the user who presets the reminder key information after the voice data is successfully matched with the reminder key information, so as to remind the user. Pay attention to the role of this real-time dialogue.
- the user may be reminded in real time through various reminding methods, for example, by means of a splash screen or a text suspension manner.
- the preset reminding key information and the user identifier are first received, and the correspondence between the reminding key information and the user identifier is saved.
- the voice data is received in real time
- the user identifier of each user participating in the conversation in the real-time conversation to which the voice data belongs is obtained.
- real-time matching is performed with the reminder key information corresponding to the user identifiers of the participating users in the real-time conversation.
- the voice data is successfully matched with the reminder key information
- the user identifier corresponding to the reminder key information is acquired.
- a real-time reminder signal is sent to the user with the user identification.
- the real-time reminding method in the real-time conversation provided by the embodiment of the present invention can promptly remind the user according to the user's needs, thereby reducing the probability that the user misses or misses the key information in the real-time conversation.
- the embodiment of the present invention further provides a real-time reminding method in a real-time conversation.
- FIG. 2 it is a signaling interaction diagram of a real-time reminding method in a real-time conversation according to an embodiment of the present invention, where the method includes:
- S200 The server receives and saves reminder key information set by the first user of the first client and the second user of the second client respectively.
- the user reminding method in the real-time conversation can apply real-time conversations of two or more people.
- the following only takes two users (the first user and the second user) to establish a real-time conversation as an example.
- the server pre-establishes a correspondence between the user identifier of the first user and the first reminder key information, and a relationship between the user identifier of the second user and the second reminder key information.
- the user can set and send reminder key information before the real-time conversation is established, and can also set and send reminder key information during the real-time conversation.
- S202 The server receives voice data in real time, and the voice data is sent by the first user.
- the first user initiates a real-time conversation, and first sends a real-time conversation request to the server, and then the server forwards the request to the second user, and after the second user agrees to establish a real-time conversation, the success is successful.
- the voice data sent by each other needs to be forwarded by the server.
- the following only takes the voice data from the first user by the server as an example.
- the server After processing the voice data, the server matches the reminder key information preset by the first user and the second user in the current real-time conversation.
- the voice data sent by the first user is processed, matching with the key information preset by the first user and the second user in the current real-time conversation, if the matching is successful, the voice data is identified. And storing text data converted by the voice data for the user to query the content of the real-time conversation.
- the text data converted by the voice data is stored, the user identifier of the user who sends the voice data, and the time information when the user sends the voice data Corresponding to the relationship, and generating a dialogue record of the current real-time conversation according to the correspondence.
- S208 Send a reminder signal to the first user if the matching is successful.
- the embodiment of the present invention sends a reminder signal to the first user who sends the voice information, so as to remind the first user to pay attention to the real-time conversation, and avoid missing or missing key information in the real-time conversation.
- the audio or video recording function can be turned on to record the subsequent content in the real-time conversation.
- the first user can also upload the recorded audio and video files to the server for sharing with other users.
- S210 The first user and the second user request to download the conversation record of the current real-time conversation.
- S212 The server sends a conversation record of the real-time conversation.
- the first user and the second user may request the server to download the conversation record of the current real-time conversation.
- the first user and the second user may also perform secondary editing on the conversation record, and upload the edited conversation record to the server for sharing to other users.
- the real-time reminding method in the real-time conversation not only can remind the user according to the user's needs, thereby reducing the probability that the user misses or misses the key information in the real-time conversation, and can generate the dialogue record of the real-time conversation, For users to view later.
- the embodiment of the present invention further provides a real-time reminding device in a real-time conversation.
- FIG. 3 it is a schematic structural diagram of a real-time reminding device in a real-time conversation according to an embodiment of the present invention.
- the device includes:
- the first saving module 301 is configured to receive preset reminder key information and a user identifier, and save a correspondence between the reminder key information and the user identifier;
- the first obtaining module 302 is configured to acquire, when the voice data is received in real time, the user identifier of each user participating in the conversation in the real-time conversation to which the voice data belongs;
- the matching module 303 is configured to use the voice data to perform real-time matching with the reminder key information corresponding to the user identifiers of the participating users in the real-time conversation;
- the second obtaining module 304 is configured to: when the voice data is successfully matched with the reminder key information, acquire a user identifier that has a corresponding relationship with the reminder key information;
- the first sending module 305 is configured to send a real-time reminder signal to the user having the user identifier.
- the apparatus may further include:
- the second saving module is configured to identify the voice data when the voice data is successfully matched with the reminder key information, and save the text data converted by the voice data.
- the device also includes:
- the third saving module is configured to: when the voice data is successfully matched with the reminder key information, save the user identifier of the user who sends the voice data, and time information when the user sends the voice data.
- the device also includes:
- a generating module configured to generate a conversation record of the real-time conversation, the conversation record including text data converted by the voice data, a user identifier of a user transmitting the voice data, and the user transmitting the voice Correspondence between time information of data, wherein the conversation record of the real-time conversation is used for downloading by participating users in the real-time conversation.
- the device also includes:
- a second sending module configured to send the conversation record to the user when receiving a download request of the conversation record of the real-time conversation by the user in the real-time conversation;
- the third storage module is configured to receive and save the dialog record edited by the user for secondary downloading for the participating users in the real-time conversation.
- the reminding key information is voice data
- the matching module includes:
- An extraction submodule configured to extract features of the speech data, the features including waveform information
- the first matching sub-module is configured to match the feature of the voice data with the feature of the reminder key information corresponding to the user identifier of the participating user in the real-time conversation.
- the reminding key information is text data
- the matching module includes:
- a conversion submodule configured to identify the voice data and convert the voice data into text data
- the second matching sub-module is configured to match the text data with reminder key information respectively corresponding to the user identifiers of the participating users in the real-time conversation.
- the real-time reminding device in the real-time dialog provided by the embodiment of the present invention can implement the following functions: receiving preset reminder key information and user identifier, and saving a correspondence between the reminder key information and the user identifier.
- the voice data is received in real time
- the user identifier of each user participating in the conversation in the real-time conversation to which the voice data belongs is obtained.
- the voice data is used to perform real-time matching with the reminder key information corresponding to the user identifiers of the participating users in the real-time conversation.
- the user identifier corresponding to the reminder key information is acquired.
- a real-time reminder signal is sent to the user with the user identification.
- the user reminding device in the real-time conversation provided by the embodiment of the present invention can remind the user according to the user's needs, thereby reducing the probability that the user misses or misses the key information in the real-time conversation.
- an embodiment of the present invention further provides an electronic device.
- the electronic device may include: one or more (only one shown) processor 201, memory 203, and transmission device 205.
- the electronic device may further include an input and output device 207.
- the memory 203 can be used to store a computer program and a module, such as a real-time reminding method in a real-time dialog and a program instruction/module corresponding to the device in the embodiment of the present invention, and the processor 201 is configured to run the software stored in the memory 203.
- the program and the module thereby performing various function applications and data processing, that is, realizing the real-time reminding method in the above-mentioned real-time conversation.
- Memory 203 can include high speed random access memory, and can also include non-volatile memory, such as one or more magnetic storage devices, flash memory, or other non-volatile solid state memory.
- memory 203 can further include memory remotely located relative to processor 201, which can be connected to the terminal over a network. Examples of such networks include, but are not limited to, the Internet, intranets, local area networks, mobile communication networks, and combinations thereof.
- the above described transmission device 205 is used to receive or transmit data via a network, and can also be used for data transmission between the processor and the memory.
- Specific examples of the above network may include a wired network and a wireless network.
- the transmission device 205 includes a Network Interface Controller (NIC) that can be connected to other network devices and routers through a network cable to communicate with the Internet or a local area network.
- the transmission device 205 is a Radio Frequency (RF) module for communicating with the Internet wirelessly.
- NIC Network Interface Controller
- RF Radio Frequency
- the memory 203 is used to store an application.
- the processor 201 can call the application stored in the memory 203 through the transmission device 205 to perform the steps of: receiving the preset reminder key information and the user identifier, and saving the correspondence between the reminder key information and the user identifier. Obtaining a user identifier of each user participating in the conversation in the real-time conversation to which the voice data belongs in real time; and using the voice data to perform reminder key information corresponding to the user identifiers of the participating users in the real-time conversation Real-time matching; when the voice data is successfully matched with the reminder key information, obtaining a user identifier corresponding to the reminder key information; and sending a real-time reminder signal to the user having the user identifier.
- the processor 201 is further configured to: when the voice data is successfully matched with the reminder key information, identify the voice data, and save the text data converted by the voice data.
- the processor 201 is further configured to: when the voice data is successfully matched with the reminder key information, save the user identifier of the user who sends the voice data, and the time information when the user sends the voice data.
- the processor 201 is further configured to: generate a conversation record of the real-time conversation, the conversation record includes text data converted by the voice data, a user identifier of a user who sends the voice data, and the Correspondence between time information when the user sends the voice data, wherein the conversation record of the real-time conversation is used for downloading by participating users in the real-time conversation.
- the processor 201 is further configured to: when receiving a download request of the conversation record of the real-time conversation by the user in the real-time conversation, sending the conversation record to the user; receiving and saving The user edits the conversation record for the user to download in the real-time conversation.
- the processor 201 is further configured to: perform the following steps: the reminding key information is voice data; extracting features of the voice data, the features include waveform information; and characterizing the voice data with each of the real-time conversations The characteristics of the reminder key information corresponding to the user identifier of the user are matched.
- the processor 201 is further configured to: perform the following steps: the reminding key information is text data; identifying the voice data, and converting the voice data into text data; and participating the text data in the real-time conversation The key information corresponding to the user ID of the user is matched.
- the processor 201 is further configured to perform the following steps: when the client of the user receives the reminder signal, turn on the recording function of the audio or video in response to the reminder signal.
- a scheme of a real-time reminding method in a real-time conversation is provided.
- the preset reminder key information and the user identifier are received, and the correspondence between the reminder key information and the user identifier is saved.
- the voice data is received in real time
- the user identifier of each user participating in the conversation in the real-time conversation to which the voice data belongs is obtained.
- real-time matching is performed with the reminder key information corresponding to the user identifiers of the participating users in the real-time conversation.
- the voice data is successfully matched with the reminder key information
- the user identifier corresponding to the reminder key information is acquired.
- a real-time reminder signal is sent to the user with the user identification.
- the real-time reminding method in the real-time conversation provided by the present invention can remind the user according to the user's needs, thereby reducing the probability that the user misses or misses the key information in the real-time conversation.
- the structure shown in FIG. 4 is merely illustrative, and the electronic device can be a smart phone (such as an Android mobile phone, an iOS mobile phone, etc.), a tablet computer, a palm computer, and a mobile Internet device (MID). Terminal equipment such as PAD.
- FIG. 4 does not limit the structure of the above electronic device.
- the electronic device may also include more or fewer components (such as a network interface, display device, etc.) than shown in FIG. 4, or have a different configuration than that shown in FIG.
- a person of ordinary skill in the art may understand that all or part of the steps of the foregoing embodiments may be completed by a program to instruct terminal device related hardware, and the program may be stored in a computer readable storage medium, and the storage medium may be Including: flash disk, read-only memory (Read-Only Memory, ROM for short), random access memory (Random Access Memory, RAM), disk or optical disk.
- the storage medium may be Including: flash disk, read-only memory (Read-Only Memory, ROM for short), random access memory (Random Access Memory, RAM), disk or optical disk.
- Embodiments of the present invention also provide a storage medium.
- a computer program is stored in the storage medium, wherein the computer program is configured to execute a data loading method at runtime.
- the foregoing storage medium may be located on at least one of the plurality of network devices in the network shown in the foregoing embodiment.
- the storage medium is arranged to store program code for performing the following steps:
- the preset reminder key information and the user identifier are received, and the correspondence between the reminder key information and the user identifier is saved.
- the storage medium is further configured to store program code for performing the following steps: when the voice data is successfully matched with the reminder key information, identifying the voice data, and saving text data converted by the voice data .
- the storage medium is further configured to store program code for performing the following steps: when the voice data is successfully matched with the reminder key information, saving the user identifier of the user who sent the voice data, and the user sending station Time information when the voice data is described.
- the storage medium is further configured to store program code for: generating a conversation record of the real-time conversation, the conversation record comprising text data converted from the voice data, and transmitting the voice data Corresponding relationship between the user identifier of the user and the time information when the user sends the voice data, wherein the conversation record of the real-time conversation is used for downloading by participating users in the real-time conversation.
- the storage medium is further configured to store program code for performing the step of: transmitting the download request to the user when receiving a download request for the conversation record of the real-time conversation in the real-time conversation a conversation record; receiving and saving a conversation record that has been edited twice by the user for download by the participating users in the real-time conversation.
- the storage medium is further configured to store program code for performing the following steps: the reminder key information is voice data; extracting features of the voice data, the features including waveform information; The feature matches the characteristics of the reminder key information corresponding to the user identifiers of the respective users in the real-time conversation.
- the storage medium is further configured to store program code for performing the following steps: the reminder key information is text data; identifying the voice data, and converting the voice data into text data; The data is matched with the reminder key information corresponding to the user IDs of the participating users in the real-time conversation.
- the storage medium is further configured to store program code for performing the following steps: when the client's client receives the alert signal, in response to the alert signal, turning on the audio or video recording function.
- the foregoing storage medium may include, but is not limited to, a USB flash drive, a Read-Only Memory (ROM), and a Random Access Memory (RAM).
- ROM Read-Only Memory
- RAM Random Access Memory
- the device embodiment since it basically corresponds to the method embodiment, reference may be made to the partial description of the method embodiment.
- the device embodiments described above are merely illustrative, wherein the units described as separate components may or may not be physically separate, and the components displayed as units may or may not be physical units, ie may be located A place, or it can be distributed to multiple network units. Some or all of the modules may be selected according to actual needs to achieve the purpose of the solution of the embodiment. Those of ordinary skill in the art can understand and implement without any creative effort.
Landscapes
- Engineering & Computer Science (AREA)
- Computer Networks & Wireless Communication (AREA)
- Signal Processing (AREA)
- Multimedia (AREA)
- Business, Economics & Management (AREA)
- General Business, Economics & Management (AREA)
- Telephonic Communication Services (AREA)
- Information Transfer Between Computers (AREA)
Abstract
Disclosed in the present invention are a real-time prompt method and device in a real-time conversation, a storage medium, and an electronic device. The method comprises: receiving preset prompt key information and user identifiers and storing corresponding relationships between the prompt key information and the user identifiers; then when receiving speech data in real time, acquiring the user identifier of each user participating in a real-time conversation to which the speech data belongs; next, matching, in real time, the speech data with prompt key information respectively corresponding to the user identifiers of the users participating in the real-time conversation; when the speech data is successfully matched with prompt key information, acquiring the user identifier corresponding to the prompt key information; and finally, sending a real-time prompt signal to the user with the user identifier. According to the real-time prompt method in a real-time conversation provided by the present invention, a user can be prompted according to the user's requirements. Thus, the probability that the user ignores or misses key information in the real-time conversation is reduced.
Description
本申请要求于2017年03月13日提交中国专利局、申请号为201710146401.1、发明名称“一种实时对话中的实时提醒方法及装置”的中国专利申请的优先权,其全部内容通过引用结合在本申请中。This application claims the priority of the Chinese Patent Application filed on March 13, 2017, the Chinese Patent Office, Application No. 201710146401.1, the title of the invention, "Real-time Reminder Method and Apparatus in Real-Time Dialogue", the entire contents of which are incorporated by reference. In this application.
本发明涉及数据处理领域,具体涉及一种实时对话中的实时提醒方法、装置、存储介质及电子装置。The present invention relates to the field of data processing, and in particular, to a real-time reminding method, device, storage medium and electronic device in a real-time conversation.
互联网时代下,人与人之间的沟通交流方式越来越多样化,例如,身处异地的人们可以使用聊天工具进行实时对话,拉近了人与人之间的距离。In the Internet age, people communicate with each other more and more. For example, people in different places can use chat tools to conduct real-time conversations, which brings people closer together.
在实际生活中,实时对话还可以应用于各种场景,例如开语音或视频会议等等。但是,基于各种原因,用户可能会遗漏或错过实时对话过程中的某些关键信息,为了减少上述情况的发生,目前需要一种有效的解决方案。In real life, real-time conversations can also be applied to a variety of scenarios, such as opening a voice or video conference. However, for various reasons, users may miss or miss some key information in the real-time conversation process. In order to reduce the above situation, an effective solution is needed.
发明内容Summary of the invention
本发明提供了一种实时对话中的实时提醒方法,能够在实时对话的过程中根据用户的需求实时提醒用户,从而降低用户遗漏或错过实时对话中的关键信息的几率。The invention provides a real-time reminding method in a real-time conversation, which can promptly remind the user according to the user's needs in the process of real-time conversation, thereby reducing the probability that the user misses or misses the key information in the real-time conversation.
本发明提供了一种实时对话中的实时提醒方法,所述实时提醒方法包括:The present invention provides a real-time reminding method in a real-time conversation, and the real-time reminding method includes:
接收预设的提醒关键信息及用户标识,并保存所述提醒关键信息与所述用户标识之间的对应关系;Receiving a preset reminder key information and a user identifier, and storing a correspondence between the reminder key information and the user identifier;
实时接收语音数据时,获取所述语音数据所属的实时对话中参与对话的各个用户的用户标识;When receiving the voice data in real time, acquiring a user identifier of each user participating in the conversation in the real-time conversation to which the voice data belongs;
利用所述语音数据,与所述实时对话中参与用户的用户标识分别对应的提醒关键信息进行实时匹配;And using the voice data to perform real-time matching with the reminder key information corresponding to the user identifiers of the participating users in the real-time conversation;
当所述语音数据与提醒关键信息匹配成功,获取与所述提醒关键信息具有对应关系的用户标识;When the voice data is successfully matched with the reminder key information, obtaining a user identifier that has a corresponding relationship with the reminder key information;
向具有所述用户标识的用户发送实时提醒信号。A real-time reminder signal is sent to the user with the user identification.
可选地,所述方法还包括:Optionally, the method further includes:
当所述语音数据与提醒关键信息匹配成功,识别所述语音数据,并保存由所述语音数据转化成的文本数据。When the voice data is successfully matched with the reminder key information, the voice data is identified, and the text data converted by the voice data is saved.
可选地,所述方法还包括:Optionally, the method further includes:
当所述语音数据与提醒关键信息匹配成功,保存发送所述语音数据的用户的用户标识,以及所述用户发送所述语音数据时的时间信息。When the voice data is successfully matched with the reminder key information, the user identifier of the user who sent the voice data is saved, and the time information when the user sends the voice data.
可选地,所述方法还包括:Optionally, the method further includes:
生成所述实时对话的对话记录,所述对话记录包括由所述语音数据转化成的文本数据、发送所述语音数据的用户的用户标识,以及所述用户发送所述语音数据时的时间信息之间的对应关系,其中,所述实时对话的对话记录用于供所述实时对话中的参与用户下载。Generating a conversation record of the real-time conversation, the conversation record including text data converted by the voice data, a user identifier of a user transmitting the voice data, and time information when the user sends the voice data Corresponding relationship, wherein the conversation record of the real-time conversation is used for downloading by participating users in the real-time conversation.
可选地,所述方法还包括:Optionally, the method further includes:
在接收到所述实时对话中的用户对所述实时对话的对话记录的下载请求时,向所述用户发送所述对话记录;Receiving, by the user in the real-time conversation, a download request of the conversation record of the real-time conversation, sending the conversation record to the user;
接收并保存经过所述用户二次编辑的对话记录,以供所述实时对话中的参与用户下载。A dialog record that has been edited twice by the user is received and saved for download by the participating users in the real-time conversation.
可选地,所述提醒关键信息为语音数据;Optionally, the reminding key information is voice data;
相应的,所述利用所述语音数据,与所述实时对话中的参与用户的用户标识分别对应的提醒关键信息进行匹配,包括:Correspondingly, the using the voice data to match the reminder key information corresponding to the user identifiers of the participating users in the real-time conversation, including:
提取所述语音数据的特征,所述特征包括波形信息;Extracting features of the voice data, the features including waveform information;
将所述语音数据的特征与所述实时对话中的各个用户的用户标识分别对应的提醒关键信息的特征进行匹配。The features of the voice data are matched with the features of the reminder key information corresponding to the user identifiers of the respective users in the real-time conversation.
可选地,所述提醒关键信息为文本数据;Optionally, the reminding key information is text data;
相应的,所述利用所述语音数据,与所述实时对话中的参与用户的用户标识分别对应的提醒关键信息进行匹配,包括:Correspondingly, the using the voice data to match the reminder key information corresponding to the user identifiers of the participating users in the real-time conversation, including:
识别所述语音数据,并将所述语音数据转化成文本数据;Identifying the voice data and converting the voice data into text data;
将所述文本数据与所述实时对话中的参与用户的用户标识分别对应的提醒关键信息进行匹配。The text data is matched with the reminder key information corresponding to the user identifiers of the participating users in the real-time conversation.
可选地,所述方法还包括:Optionally, the method further includes:
当所述用户的客户端接收到所述提醒信号时,响应于所述提醒信号,开启音频或视频的录制功能。When the client's client receives the alert signal, in response to the alert signal, the audio or video recording function is turned on.
本发明还提供了一种实时对话中的实时提醒装置,所述装置包括:The present invention also provides a real-time reminding device in a real-time conversation, the device comprising:
第一保存模块,被设置为接收预设的提醒关键信息及用户标识,并保存所述提醒关键信息与所述用户标识之间的对应关系;The first saving module is configured to receive preset reminder key information and a user identifier, and save a correspondence between the reminder key information and the user identifier;
第一获取模块,被设置为实时接收到语音数据时,获取所述语音数据所属的实时对话中的参与对话的各个用户的用户标识;The first obtaining module is configured to acquire, when the voice data is received in real time, the user identifier of each user participating in the conversation in the real-time conversation to which the voice data belongs;
匹配模块,被设置为利用所述语音数据,与所述实时对话中参与用户的用户标识分别对应的提醒关键信息进行实时匹配;The matching module is configured to use the voice data to perform real-time matching with the reminder key information corresponding to the user identifiers of the participating users in the real-time conversation;
第二获取模块,被设置为当所述语音数据与提醒关键信息匹配成功,获取与所述提醒关键信息具有对应关系的用户标识;a second acquiring module, configured to: when the voice data is successfully matched with the reminder key information, acquire a user identifier that has a corresponding relationship with the reminder key information;
第一发送模块,被设置为向具有所述用户标识的用户发送实时提醒信 号。The first sending module is configured to send a real-time reminder signal to the user having the user identification.
可选地,所述装置还包括:Optionally, the device further includes:
第二保存模块,被设置为当所述语音数据与提醒关键信息匹配成功,识别所述语音数据,并保存由所述语音数据转化成的文本数据。The second saving module is configured to identify the voice data when the voice data is successfully matched with the reminder key information, and save the text data converted by the voice data.
可选地,所述装置还包括:Optionally, the device further includes:
第三保存模块,被设置为当所述语音数据与提醒关键信息匹配成功,保存发送所述语音数据的用户的用户标识,以及所述用户发送所述语音数据时的时间信息。The third saving module is configured to: when the voice data is successfully matched with the reminder key information, save the user identifier of the user who sends the voice data, and time information when the user sends the voice data.
可选地,所述装置还包括:Optionally, the device further includes:
生成模块,被设置为生成所述实时对话的对话记录,所述对话记录包括由所述语音数据转化成的文本数据、发送所述语音数据的用户的用户标识,以及所述用户发送所述语音数据时的时间信息之间的对应关系,其中,所述实时对话的对话记录用于供所述实时对话中的参与用户下载。a generating module configured to generate a conversation record of the real-time conversation, the conversation record including text data converted by the voice data, a user identifier of a user transmitting the voice data, and the user transmitting the voice Correspondence between time information of data, wherein the conversation record of the real-time conversation is used for downloading by participating users in the real-time conversation.
可选地,所述装置还包括:Optionally, the device further includes:
第二发送模块,被设置为在接收到所述实时对话中的用户对所述实时对话的对话记录的下载请求时,向所述用户发送所述对话记录;a second sending module, configured to send the conversation record to the user when receiving a download request of the conversation record of the real-time conversation by the user in the real-time conversation;
第三存储模块,被设置为接收并保存经过所述用户二次编辑的对话记录,以供所述实时对话中的参与用户下载。The third storage module is configured to receive and save the dialog record edited by the user for secondary downloading for the participating users in the real-time conversation.
可选地,所述提醒关键信息为语音数据;Optionally, the reminding key information is voice data;
相应的,所述匹配模块,包括:Correspondingly, the matching module includes:
提取子模块,被设置为提取所述语音数据的特征,所述特征包括波形信息;An extraction submodule configured to extract features of the speech data, the features including waveform information;
第一匹配子模块,被设置为将所述语音数据的特征与所述实时对话中的参与用户的用户标识分别对应的提醒关键信息的特征进行匹配。The first matching sub-module is configured to match the feature of the voice data with the feature of the reminder key information corresponding to the user identifier of the participating user in the real-time conversation.
可选地,所述提醒关键信息为文本数据;Optionally, the reminding key information is text data;
相应的,所述匹配模块,包括:Correspondingly, the matching module includes:
转化子模块,被设置为识别所述语音数据,并将所述语音数据转化成文本数据;a conversion submodule configured to identify the voice data and convert the voice data into text data;
第二匹配子模块,被设置为将所述文本数据与所述实时对话中的参与用户的用户标识分别对应的提醒关键信息进行匹配。The second matching sub-module is configured to match the text data with reminder key information respectively corresponding to the user identifiers of the participating users in the real-time conversation.
本发明提供了一种实时对话中的实时提醒方法,首先,接收预设的提醒关键信息及用户标识,并保存所述提醒关键信息与所述用户标识之间的对应关系。其次,实时接收语音数据时,获取所述语音数据所属的实时对话中参与对话的各个用户的用户标识。再次,利用所述语音数据,与所述实时对话中参与用户的用户标识分别对应的提醒关键信息进行实时匹配。当所述语音数据与提醒关键信息匹配成功,获取与所述提醒关键信息具有对应关系的用户标识。最后,向具有所述用户标识的用户发送实时提醒信号。本发明提供的实时对话中的实时提醒方法能够根据用户的需求提醒用户,从而降低用户遗漏或错过实时对话中的关键信息的几率。The present invention provides a real-time reminding method in a real-time conversation. First, a preset reminder key information and a user identifier are received, and a correspondence relationship between the reminder key information and the user identifier is saved. Secondly, when the voice data is received in real time, the user identifier of each user participating in the conversation in the real-time conversation to which the voice data belongs is obtained. Again, using the voice data, real-time matching is performed with the reminder key information corresponding to the user identifiers of the participating users in the real-time conversation. When the voice data is successfully matched with the reminder key information, the user identifier corresponding to the reminder key information is acquired. Finally, a real-time reminder signal is sent to the user with the user identification. The real-time reminding method in the real-time dialogue provided by the invention can remind the user according to the user's needs, thereby reducing the probability that the user misses or misses the key information in the real-time conversation.
为了更清楚地说明本申请实施例中的技术方案,下面将对实施例描述中所需要使用的附图作简单地介绍,显而易见地,下面描述中的附图仅仅是本申请的一些实施例,对于本领域普通技术人员来讲,在不付出创造性劳动性的前提下,还可以根据这些附图获得其他的附图。In order to more clearly illustrate the technical solutions in the embodiments of the present application, the drawings used in the description of the embodiments will be briefly described below. It is obvious that the drawings in the following description are only some embodiments of the present application. Other drawings may also be obtained from those of ordinary skill in the art in view of the drawings.
图1为本发明提供的一种实时对话中的实时提醒方法流程图;1 is a flow chart of a real-time reminding method in a real-time conversation provided by the present invention;
图2为本发明提供的一种实时对话中的实时提醒方法的信令交互图;2 is a signaling interaction diagram of a real-time reminding method in a real-time conversation provided by the present invention;
图3为本发明提供的一种实时对话中的实时提醒装置的结构示意图;3 is a schematic structural diagram of a real-time reminding device in a real-time conversation provided by the present invention;
图4为本发明提供的一种电子装置的结构框图。4 is a structural block diagram of an electronic device according to the present invention.
下面将结合本申请实施例中的附图,对本申请实施例中的技术方案进行清楚、完整地描述,显然,所描述的实施例仅仅是本申请一部分实施例,而不是全部的实施例。基于本申请中的实施例,本领域普通技术人员在没有做出创造性劳动前提下所获得的所有其他实施例,都属于本申请保护的范围。The technical solutions in the embodiments of the present application are clearly and completely described in the following with reference to the drawings in the embodiments of the present application. It is obvious that the described embodiments are only a part of the embodiments of the present application, and not all of the embodiments. All other embodiments obtained by a person of ordinary skill in the art based on the embodiments of the present application without departing from the inventive scope are the scope of the present application.
参考图1,为本发明实施例提供的一种实时对话中的实时提醒方法流程图,所述方法具体可以包括:FIG. 1 is a flowchart of a real-time reminding method in a real-time conversation according to an embodiment of the present invention. The method may specifically include:
S101:接收预设的提醒关键信息及用户标识,并保存所述提醒关键信息与所述用户标识之间的对应关系。S101: Receive preset reminder key information and a user identifier, and save a correspondence between the reminder key information and the user identifier.
本发明实施例中,用户在进行实时对话时,可以预先为本次实时对话设置提醒关键信息。具体的,本次实时对话中的用户在客户端设置提醒关键信息后,将所述提醒关键信息发送至服务器。当服务器接收到用户设置的提醒关键信息以及用户标识后,存储所述提醒关键信息与所述用户标识之间的对应关系。其中,所述实时对话包括音视频实时对话,所述用户标识包括用户昵称、用户身份标识符(Identity,简称为ID)等能够在本次音视频对话中唯一标识所述用户的信息。In the embodiment of the present invention, when the user performs a real-time conversation, the reminder key information may be set in advance for the real-time conversation. Specifically, after the user sets the reminder key information on the client, the user in the real-time conversation sends the reminder key information to the server. After the server receives the reminder key information set by the user and the user identifier, the corresponding relationship between the reminder key information and the user identifier is stored. The real-time conversation includes an audio-video real-time conversation, and the user identifier includes a user nickname, a user identity identifier (ID), and the like, which can uniquely identify the user in the audio-video conversation.
S102:实时接收语音数据时,获取所述语音数据所属的实时对话中参与对话的各个用户的用户标识。S102: When receiving voice data in real time, acquire a user identifier of each user participating in the conversation in the real-time conversation to which the voice data belongs.
在实时对话中,用户讲的每一段语音都会作为语音数据发送至服务器,当所述服务器接收到本次实时对话中的语音数据时,首先获取参与到本次实时对话中的各个用户的用户标识。In the real-time conversation, each voice spoken by the user is sent to the server as voice data. When the server receives the voice data in the real-time conversation, the user identifier of each user participating in the real-time conversation is first obtained. .
S103:利用所述语音数据,与所述实时对话中参与用户的用户标识分别对应的提醒关键信息进行实时匹配。S103: Perform real-time matching with the reminder key information corresponding to the user identifiers of the participating users in the real-time conversation by using the voice data.
本发明实施例中,服务器在获取到参与本次实时对话中的各个用户的用户标识后,再分别获取预先存储的与各个用户的用户标识对应的提醒关 键信息。具体的,可能本次实时对话中的某些用户并未预先设置提醒关键信息,所以,本发明实施例只获取本次实时对话中预先设置的用户的提醒关键信息。In the embodiment of the present invention, after obtaining the user identifiers of the users participating in the real-time conversation, the server separately obtains the pre-stored reminder key information corresponding to the user identifiers of the respective users. Specifically, some users in the real-time conversation may not set the reminder key information in advance. Therefore, the embodiment of the present invention only obtains the reminder key information of the user preset in the real-time conversation.
实际应用中,利用接收到的语音数据,与本次实时对话中的各个用户的用户标识对应的提醒关键信息进行匹配,并确定与所述语音数据匹配成功的提醒关键信息。In an actual application, the received voice data is used to match the reminder key information corresponding to the user identifier of each user in the real-time conversation, and the reminder key information that successfully matches the voice data is determined.
本发明实施例中用户预先设置的提醒关键信息可以是语音数据,也可以是文本数据。具体的,与不同类型的提醒关键信息进行匹配的方式也是不同的。The reminder key information preset by the user in the embodiment of the present invention may be voice data or text data. Specifically, the way to match different types of reminder key information is different.
对于提醒关键信息为语音数据的匹配方式包括:首先,对接收到的所述语音数据进行去噪、滤波、采样等预处理,其次,对经过上述预处理的语音数据进行特征提取,然后,将提取到的特征与本次实时对话中各个用户的提醒关键信息的特征进行匹配。一种实现方式中,所述特征包括波形信息,具体的,计算所述语音数据的波形信息与预先存储的提醒关键信息的波形信息的相似度,如果相似度满足预设值,则确定二者匹配成功。具体的匹配成功的条件不限于上述方式。The method for matching the key information to the voice data includes: first, performing pre-processing such as denoising, filtering, sampling, etc. on the received voice data, and secondly, performing feature extraction on the voice data subjected to the pre-processing, and then The extracted features are matched with the features of the reminder key information of each user in this real-time conversation. In an implementation manner, the feature includes waveform information, specifically, calculating a similarity between the waveform information of the voice data and the waveform information of the pre-stored reminder key information, and if the similarity satisfies the preset value, determining the two The match was successful. The conditions for the specific matching success are not limited to the above.
另外,对于提醒关键信息为文本数据的匹配方式包括:首先,对接收到的所述语音数据进行去噪后,识别所述语音数据,并将所述语音数据转化为文本数据。然后,将所述文本数据与本次实时对话中各个用户的提醒关键信息进行匹配。一种实现方式中,如果所述文本数据包括或被包括于任一提醒关键信息,则确定二者匹配成功。具体的匹配成功的条件不限于上述方式。In addition, the matching manner for reminding the key information as text data includes: first, after denoising the received voice data, identifying the voice data, and converting the voice data into text data. Then, the text data is matched with the reminder key information of each user in the real-time conversation. In one implementation, if the text data includes or is included in any of the reminder key information, it is determined that the two matches are successful. The conditions for the specific matching success are not limited to the above.
S104:当所述语音数据与提醒关键信息匹配成功,获取与所述提醒关键信息具有对应关系的用户标识。S104: When the voice data is successfully matched with the reminder key information, obtain a user identifier that has a corresponding relationship with the reminder key information.
本发明实施例中,如果所述语音数据与本次实时对话中的任一用户预先设置的任一提醒关键信息匹配成功,则获取与所述提醒关键信息具有对 应关系的用户标识。In the embodiment of the present invention, if the voice data is successfully matched with any of the reminder key information preset by any user in the real-time conversation, the user identifier corresponding to the reminder key information is acquired.
S105:向具有所述用户标识的用户发送实时提醒信号。S105: Send a real-time reminder signal to the user having the user identifier.
为了避免用户遗漏或错过本次实时对话中的关键信息,本发明实施例在语音数据与提醒关键信息匹配成功后,向预先设置所述提醒关键信息的用户发送实时提醒信号,以起到提醒用户关注本次实时对话的作用。In order to prevent the user from missing or missing the key information in the real-time conversation, the embodiment of the present invention sends a real-time reminder signal to the user who presets the reminder key information after the voice data is successfully matched with the reminder key information, so as to remind the user. Pay attention to the role of this real-time dialogue.
本发明实施例中,在所述用户的客户端接收到所述实时提醒信号后,可以通过各种提醒方式实时提醒所述用户,例如,通过闪屏的方式、文字悬浮的方式提醒用户。In the embodiment of the present invention, after the real-time reminder signal is received by the client of the user, the user may be reminded in real time through various reminding methods, for example, by means of a splash screen or a text suspension manner.
本发明实施例提供的实时对话中的实时提醒方法中,首先接收预设的提醒关键信息及用户标识,并保存所述提醒关键信息与所述用户标识之间的对应关系。其次,实时接收语音数据时,获取所述语音数据所属的实时对话中参与对话的各个用户的用户标识。再次,利用所述语音数据,与所述实时对话中参与用户的用户标识分别对应的提醒关键信息进行实时匹配。当所述语音数据与提醒关键信息匹配成功,获取与所述提醒关键信息具有对应关系的用户标识。最后,向具有所述用户标识的用户发送实时提醒信号。本发明实施例提供的实时对话中的实时提醒方法能够根据用户的需求实时提醒用户,从而降低用户遗漏或错过实时对话中的关键信息的几率。In the real-time reminding method in the real-time conversation provided by the embodiment of the present invention, the preset reminding key information and the user identifier are first received, and the correspondence between the reminding key information and the user identifier is saved. Secondly, when the voice data is received in real time, the user identifier of each user participating in the conversation in the real-time conversation to which the voice data belongs is obtained. Again, using the voice data, real-time matching is performed with the reminder key information corresponding to the user identifiers of the participating users in the real-time conversation. When the voice data is successfully matched with the reminder key information, the user identifier corresponding to the reminder key information is acquired. Finally, a real-time reminder signal is sent to the user with the user identification. The real-time reminding method in the real-time conversation provided by the embodiment of the present invention can promptly remind the user according to the user's needs, thereby reducing the probability that the user misses or misses the key information in the real-time conversation.
本发明实施例还提供了一种实时对话中的实时提醒方法,参考图2,为本发明实施例提供的一种实时对话中的实时提醒方法的信令交互图,所述方法包括:The embodiment of the present invention further provides a real-time reminding method in a real-time conversation. Referring to FIG. 2, it is a signaling interaction diagram of a real-time reminding method in a real-time conversation according to an embodiment of the present invention, where the method includes:
S200:服务器接收并保存第一客户端的第一用户和第二客户端的第二用户分别设置的提醒关键信息。S200: The server receives and saves reminder key information set by the first user of the first client and the second user of the second client respectively.
本发明实施例提供的实时对话中的用户提醒方法能够应用两人或多人的实时对话中,以下仅以两个用户(第一用户和第二用户)建立实时对 话为例。具体的,服务器预先建立所述第一用户的用户标识与第一提醒关键信息的对应关系,以及所述第二用户的用户标识与第二提醒关键信息的关系。值得注意的是,用户可以在实时对话建立之前设置并发送提醒关键信息,也可以在实时对话期间设置并发送提醒关键信息。The user reminding method in the real-time conversation provided by the embodiment of the present invention can apply real-time conversations of two or more people. The following only takes two users (the first user and the second user) to establish a real-time conversation as an example. Specifically, the server pre-establishes a correspondence between the user identifier of the first user and the first reminder key information, and a relationship between the user identifier of the second user and the second reminder key information. It is worth noting that the user can set and send reminder key information before the real-time conversation is established, and can also set and send reminder key information during the real-time conversation.
S202:所述服务器实时接收语音数据,所述语音数据由所述第一用户发送。S202: The server receives voice data in real time, and the voice data is sent by the first user.
本发明实施例中,第一用户发起实时对话,首先向所述服务器发送实时对话请求,然后,由所述服务器将所述请求转发给第二用户,当第二用户同意建立实时对话后,成功与所述第一用户建立实时对话。In the embodiment of the present invention, the first user initiates a real-time conversation, and first sends a real-time conversation request to the server, and then the server forwards the request to the second user, and after the second user agrees to establish a real-time conversation, the success is successful. Establishing a real-time conversation with the first user.
本发明实施例中,在第一用户与第二用户的实时对话期间,互相发送的语音数据均需要经过所述服务器的转发。以下仅以所述服务器接收来自第一用户的语音数据为例。In the embodiment of the present invention, during the real-time conversation between the first user and the second user, the voice data sent by each other needs to be forwarded by the server. The following only takes the voice data from the first user by the server as an example.
S204:所述服务器对所述语音数据处理后,与本次实时对话中的第一用户和第二用户预先设置的提醒关键信息进行匹配。S204: After processing the voice data, the server matches the reminder key information preset by the first user and the second user in the current real-time conversation.
本发明实施例中,第一用户发送的语音数据经过处理后,与本次实时对话中的第一用户和第二用户预先设置的提醒关键信息进行匹配,如果匹配成功,则识别所述语音数据,并存储由所述语音数据转化成的文本数据,以供用户对本次实时对话的内容进行查询。In the embodiment of the present invention, after the voice data sent by the first user is processed, matching with the key information preset by the first user and the second user in the current real-time conversation, if the matching is successful, the voice data is identified. And storing text data converted by the voice data for the user to query the content of the real-time conversation.
S206:如果匹配成功,则识别所述语音数据,并存储由所述语音数据转化成的文本数据,发送所述语音数据的用户的用户标识,以及所述用户发送所述语音数据时的时间信息,并生成本次实时对话的对话记录。S206: if the matching is successful, identifying the voice data, and storing text data converted by the voice data, a user identifier of a user who sends the voice data, and time information when the user sends the voice data And generate a dialogue record of this real-time conversation.
本发明实施例中,如果匹配成功,则存储由所述语音数据转化成的文本数据,发送所述语音数据的用户的用户标识,以及所述用户发送所述语音数据时的时间信息之间的对应关系,并根据所述对应关系生成本次实时对话的对话记录。In the embodiment of the present invention, if the matching is successful, the text data converted by the voice data is stored, the user identifier of the user who sends the voice data, and the time information when the user sends the voice data Corresponding to the relationship, and generating a dialogue record of the current real-time conversation according to the correspondence.
S208:如果匹配成功,则向所述第一用户发送提醒信号。S208: Send a reminder signal to the first user if the matching is successful.
另外,本发明实施例在匹配成功后,还将向发送所述语音信息的第一用户发送提醒信号,以便提醒第一用户关注本次实时对话,避免遗漏或错过实时对话中的关键信息。In addition, after the matching is successful, the embodiment of the present invention sends a reminder signal to the first user who sends the voice information, so as to remind the first user to pay attention to the real-time conversation, and avoid missing or missing key information in the real-time conversation.
当第一客户端接收到提醒信号后,可以开启音频或视频的录制功能,以便对本次实时对话中的后续内容进行录制。另外,第一用户还可以将录制得到的音视频文件上传服务器,以分享给其他用户。After the first client receives the reminder signal, the audio or video recording function can be turned on to record the subsequent content in the real-time conversation. In addition, the first user can also upload the recorded audio and video files to the server for sharing with other users.
S210:第一用户和第二用户请求下载本次实时对话的对话记录。S210: The first user and the second user request to download the conversation record of the current real-time conversation.
S212:所述服务器下发所述实时对话的对话记录。S212: The server sends a conversation record of the real-time conversation.
本发明实施例中,在本次实时对话结束后,第一用户和第二用户可以向服务器请求下载本次实时对话的对话记录。另外,第一用户和第二用户还可以对所述对话记录进行二次编辑,并将经过二次编辑后的对话记录上传至所述服务器,以便分享给其他用户。In the embodiment of the present invention, after the current real-time conversation ends, the first user and the second user may request the server to download the conversation record of the current real-time conversation. In addition, the first user and the second user may also perform secondary editing on the conversation record, and upload the edited conversation record to the server for sharing to other users.
本发明实施例提供的实时对话中的实时提醒方法,不仅能够根据用户的需求提醒用户,从而降低用户遗漏或错过实时对话中的关键信息的几率,而且能够生成本次实时对话的对话记录,以供用户后续查看。The real-time reminding method in the real-time conversation provided by the embodiment of the present invention not only can remind the user according to the user's needs, thereby reducing the probability that the user misses or misses the key information in the real-time conversation, and can generate the dialogue record of the real-time conversation, For users to view later.
本发明实施例还提供了一种实时对话中的实时提醒装置,参考图3,为本发明实施例提供的一种实时对话中的实时提醒装置的结构示意图,所述装置包括:The embodiment of the present invention further provides a real-time reminding device in a real-time conversation. Referring to FIG. 3, it is a schematic structural diagram of a real-time reminding device in a real-time conversation according to an embodiment of the present invention. The device includes:
第一保存模块301,被设置为接收预设的提醒关键信息及用户标识,并保存所述提醒关键信息与所述用户标识之间的对应关系;The first saving module 301 is configured to receive preset reminder key information and a user identifier, and save a correspondence between the reminder key information and the user identifier;
第一获取模块302,被设置为实时接收到语音数据时,获取所述语音数据所属的实时对话中的参与对话的各个用户的用户标识;The first obtaining module 302 is configured to acquire, when the voice data is received in real time, the user identifier of each user participating in the conversation in the real-time conversation to which the voice data belongs;
匹配模块303,被设置为利用所述语音数据,与所述实时对话中参与用户的用户标识分别对应的提醒关键信息进行实时匹配;The matching module 303 is configured to use the voice data to perform real-time matching with the reminder key information corresponding to the user identifiers of the participating users in the real-time conversation;
第二获取模块304,被设置为当所述语音数据与提醒关键信息匹配成功,获取与所述提醒关键信息具有对应关系的用户标识;The second obtaining module 304 is configured to: when the voice data is successfully matched with the reminder key information, acquire a user identifier that has a corresponding relationship with the reminder key information;
第一发送模块305,被设置为向具有所述用户标识的用户发送实时提醒信号。The first sending module 305 is configured to send a real-time reminder signal to the user having the user identifier.
另外,所述装置还可以包括:Additionally, the apparatus may further include:
第二保存模块,被设置为当所述语音数据与提醒关键信息匹配成功,识别所述语音数据,并保存由所述语音数据转化成的文本数据。The second saving module is configured to identify the voice data when the voice data is successfully matched with the reminder key information, and save the text data converted by the voice data.
所述装置还包括:The device also includes:
第三保存模块,被设置为当所述语音数据与提醒关键信息匹配成功,保存发送所述语音数据的用户的用户标识,以及所述用户发送所述语音数据时的时间信息。The third saving module is configured to: when the voice data is successfully matched with the reminder key information, save the user identifier of the user who sends the voice data, and time information when the user sends the voice data.
所述装置还包括:The device also includes:
生成模块,被设置为生成所述实时对话的对话记录,所述对话记录包括由所述语音数据转化成的文本数据、发送所述语音数据的用户的用户标识,以及所述用户发送所述语音数据时的时间信息之间的对应关系,其中,所述实时对话的对话记录用于供所述实时对话中的参与用户下载。a generating module configured to generate a conversation record of the real-time conversation, the conversation record including text data converted by the voice data, a user identifier of a user transmitting the voice data, and the user transmitting the voice Correspondence between time information of data, wherein the conversation record of the real-time conversation is used for downloading by participating users in the real-time conversation.
所述装置还包括:The device also includes:
第二发送模块,被设置为在接收到所述实时对话中的用户对所述实时对话的对话记录的下载请求时,向所述用户发送所述对话记录;a second sending module, configured to send the conversation record to the user when receiving a download request of the conversation record of the real-time conversation by the user in the real-time conversation;
第三存储模块,被设置为接收并保存经过所述用户二次编辑的对话记录,以供所述实时对话中的参与用户下载。The third storage module is configured to receive and save the dialog record edited by the user for secondary downloading for the participating users in the real-time conversation.
所述提醒关键信息为语音数据;The reminding key information is voice data;
相应的,所述匹配模块,包括:Correspondingly, the matching module includes:
提取子模块,被设置为提取所述语音数据的特征,所述特征包括波形 信息;An extraction submodule configured to extract features of the speech data, the features including waveform information;
第一匹配子模块,被设置为将所述语音数据的特征与所述实时对话中的参与用户的用户标识分别对应的提醒关键信息的特征进行匹配。The first matching sub-module is configured to match the feature of the voice data with the feature of the reminder key information corresponding to the user identifier of the participating user in the real-time conversation.
所述提醒关键信息为文本数据;The reminding key information is text data;
相应的,所述匹配模块,包括:Correspondingly, the matching module includes:
转化子模块,被设置为识别所述语音数据,并将所述语音数据转化成文本数据;a conversion submodule configured to identify the voice data and convert the voice data into text data;
第二匹配子模块,被设置为将所述文本数据与所述实时对话中的参与用户的用户标识分别对应的提醒关键信息进行匹配。The second matching sub-module is configured to match the text data with reminder key information respectively corresponding to the user identifiers of the participating users in the real-time conversation.
本发明实施例提供的实时对话中的实时提醒装置能够实现以下功能:接收预设的提醒关键信息及用户标识,并保存所述提醒关键信息与所述用户标识之间的对应关系。实时接收语音数据时,获取所述语音数据所属的实时对话中参与对话的各个用户的用户标识。利用所述语音数据,与所述实时对话中参与用户的用户标识分别对应的提醒关键信息进行实时匹配。当所述语音数据与提醒关键信息匹配成功,获取与所述提醒关键信息具有对应关系的用户标识。向具有所述用户标识的用户发送实时提醒信号。本发明实施例提供的实时对话中的用户提醒装置能够根据用户的需求提醒用户,从而降低用户遗漏或错过实时对话中的关键信息的几率。The real-time reminding device in the real-time dialog provided by the embodiment of the present invention can implement the following functions: receiving preset reminder key information and user identifier, and saving a correspondence between the reminder key information and the user identifier. When the voice data is received in real time, the user identifier of each user participating in the conversation in the real-time conversation to which the voice data belongs is obtained. The voice data is used to perform real-time matching with the reminder key information corresponding to the user identifiers of the participating users in the real-time conversation. When the voice data is successfully matched with the reminder key information, the user identifier corresponding to the reminder key information is acquired. A real-time reminder signal is sent to the user with the user identification. The user reminding device in the real-time conversation provided by the embodiment of the present invention can remind the user according to the user's needs, thereby reducing the probability that the user misses or misses the key information in the real-time conversation.
相应的,本发明实施例还提供一种电子装置,参见图4所示,该电子装置可以包括:一个或多个(图中仅示出一个)处理器201、存储器203、以及传输装置205,如图4所示,该电子装置还可以包括输入输出设备207。Correspondingly, an embodiment of the present invention further provides an electronic device. As shown in FIG. 4, the electronic device may include: one or more (only one shown) processor 201, memory 203, and transmission device 205. As shown in FIG. 4, the electronic device may further include an input and output device 207.
其中,存储器203可用于存储计算机程序以及模块,如本发明实施例中的实时对话中的实时提醒方法和装置对应的程序指令/模块,处理器201被设置为通过运行存储在存储器203内的软件程序以及模块,从而执行各 种功能应用以及数据处理,即实现上述的实时对话中的实时提醒方法。存储器203可包括高速随机存储器,还可以包括非易失性存储器,如一个或者多个磁性存储装置、闪存、或者其他非易失性固态存储器。在一些实例中,存储器203可进一步包括相对于处理器201远程设置的存储器,这些远程存储器可以通过网络连接至终端。上述网络的实例包括但不限于互联网、企业内部网、局域网、移动通信网及其组合。The memory 203 can be used to store a computer program and a module, such as a real-time reminding method in a real-time dialog and a program instruction/module corresponding to the device in the embodiment of the present invention, and the processor 201 is configured to run the software stored in the memory 203. The program and the module, thereby performing various function applications and data processing, that is, realizing the real-time reminding method in the above-mentioned real-time conversation. Memory 203 can include high speed random access memory, and can also include non-volatile memory, such as one or more magnetic storage devices, flash memory, or other non-volatile solid state memory. In some examples, memory 203 can further include memory remotely located relative to processor 201, which can be connected to the terminal over a network. Examples of such networks include, but are not limited to, the Internet, intranets, local area networks, mobile communication networks, and combinations thereof.
上述的传输装置205用于经由一个网络接收或者发送数据,还可以用于处理器与存储器之间的数据传输。上述的网络具体实例可包括有线网络及无线网络。在一个实例中,传输装置205包括一个网络适配器(Network Interface Controller,简称为NIC),其可通过网线与其他网络设备与路由器相连从而可与互联网或局域网进行通讯。在一个实例中,传输装置205为射频(Radio Frequency,简称为RF)模块,其用于通过无线方式与互联网进行通讯。The above described transmission device 205 is used to receive or transmit data via a network, and can also be used for data transmission between the processor and the memory. Specific examples of the above network may include a wired network and a wireless network. In one example, the transmission device 205 includes a Network Interface Controller (NIC) that can be connected to other network devices and routers through a network cable to communicate with the Internet or a local area network. In one example, the transmission device 205 is a Radio Frequency (RF) module for communicating with the Internet wirelessly.
其中,具体地,存储器203用于存储应用程序。Specifically, the memory 203 is used to store an application.
处理器201可以通过传输装置205调用存储器203存储的应用程序,以执行下述步骤:接收预设的提醒关键信息及用户标识,并保存所述提醒关键信息与所述用户标识之间的对应关系;实时接收语音数据时,获取所述语音数据所属的实时对话中参与对话的各个用户的用户标识;利用所述语音数据,与所述实时对话中参与用户的用户标识分别对应的提醒关键信息进行实时匹配;当所述语音数据与提醒关键信息匹配成功,获取与所述提醒关键信息具有对应关系的用户标识;向具有所述用户标识的用户发送实时提醒信号。The processor 201 can call the application stored in the memory 203 through the transmission device 205 to perform the steps of: receiving the preset reminder key information and the user identifier, and saving the correspondence between the reminder key information and the user identifier. Obtaining a user identifier of each user participating in the conversation in the real-time conversation to which the voice data belongs in real time; and using the voice data to perform reminder key information corresponding to the user identifiers of the participating users in the real-time conversation Real-time matching; when the voice data is successfully matched with the reminder key information, obtaining a user identifier corresponding to the reminder key information; and sending a real-time reminder signal to the user having the user identifier.
处理器201还用于执行下述步骤:当所述语音数据与提醒关键信息匹配成功,识别所述语音数据,并保存由所述语音数据转化成的文本数据。The processor 201 is further configured to: when the voice data is successfully matched with the reminder key information, identify the voice data, and save the text data converted by the voice data.
处理器201还用于执行下述步骤:当所述语音数据与提醒关键信息匹配成功,保存发送所述语音数据的用户的用户标识,以及所述用户发送所述语音数据时的时间信息。The processor 201 is further configured to: when the voice data is successfully matched with the reminder key information, save the user identifier of the user who sends the voice data, and the time information when the user sends the voice data.
处理器201还用于执行下述步骤:生成所述实时对话的对话记录,所述对话记录包括由所述语音数据转化成的文本数据、发送所述语音数据的用户的用户标识,以及所述用户发送所述语音数据时的时间信息之间的对应关系,其中,所述实时对话的对话记录用于供所述实时对话中的参与用户下载。The processor 201 is further configured to: generate a conversation record of the real-time conversation, the conversation record includes text data converted by the voice data, a user identifier of a user who sends the voice data, and the Correspondence between time information when the user sends the voice data, wherein the conversation record of the real-time conversation is used for downloading by participating users in the real-time conversation.
处理器201还用于执行下述步骤:在接收到所述实时对话中的用户对所述实时对话的对话记录的下载请求时,向所述用户发送所述对话记录;接收并保存经过所述用户二次编辑的对话记录,以供所述实时对话中的参与用户下载。The processor 201 is further configured to: when receiving a download request of the conversation record of the real-time conversation by the user in the real-time conversation, sending the conversation record to the user; receiving and saving The user edits the conversation record for the user to download in the real-time conversation.
处理器201还用于执行下述步骤:所述提醒关键信息为语音数据;提取所述语音数据的特征,所述特征包括波形信息;将所述语音数据的特征与所述实时对话中的各个用户的用户标识分别对应的提醒关键信息的特征进行匹配。The processor 201 is further configured to: perform the following steps: the reminding key information is voice data; extracting features of the voice data, the features include waveform information; and characterizing the voice data with each of the real-time conversations The characteristics of the reminder key information corresponding to the user identifier of the user are matched.
处理器201还用于执行下述步骤:所述提醒关键信息为文本数据;识别所述语音数据,并将所述语音数据转化成文本数据;将所述文本数据与所述实时对话中的参与用户的用户标识分别对应的提醒关键信息进行匹配。The processor 201 is further configured to: perform the following steps: the reminding key information is text data; identifying the voice data, and converting the voice data into text data; and participating the text data in the real-time conversation The key information corresponding to the user ID of the user is matched.
处理器201还用于执行下述步骤:当所述用户的客户端接收到所述提醒信号时,响应于所述提醒信号,开启音频或视频的录制功能。The processor 201 is further configured to perform the following steps: when the client of the user receives the reminder signal, turn on the recording function of the audio or video in response to the reminder signal.
采用本发明实施例,提供了一种实时对话中的实时提醒方法的方案。首先,接收预设的提醒关键信息及用户标识,并保存所述提醒关键信息与所述用户标识之间的对应关系。其次,实时接收语音数据时,获取所述语音数据所属的实时对话中参与对话的各个用户的用户标识。再次,利用所述语音数据,与所述实时对话中参与用户的用户标识分别对应的提醒关键信息进行实时匹配。当所述语音数据与提醒关键信息匹配成功,获取与所述提醒关键信息具有对应关系的用户标识。最后,向具有所述用户标识的用户发送实时提醒信号。本发明提供的实时对话中的实时提醒方法能够根 据用户的需求提醒用户,从而降低用户遗漏或错过实时对话中的关键信息的几率。With the embodiment of the present invention, a scheme of a real-time reminding method in a real-time conversation is provided. First, the preset reminder key information and the user identifier are received, and the correspondence between the reminder key information and the user identifier is saved. Secondly, when the voice data is received in real time, the user identifier of each user participating in the conversation in the real-time conversation to which the voice data belongs is obtained. Again, using the voice data, real-time matching is performed with the reminder key information corresponding to the user identifiers of the participating users in the real-time conversation. When the voice data is successfully matched with the reminder key information, the user identifier corresponding to the reminder key information is acquired. Finally, a real-time reminder signal is sent to the user with the user identification. The real-time reminding method in the real-time conversation provided by the present invention can remind the user according to the user's needs, thereby reducing the probability that the user misses or misses the key information in the real-time conversation.
可选地,本实施例中的具体示例可以参考上述实施例中所描述的示例,本实施例在此不再赘述。For example, the specific examples in this embodiment may refer to the examples described in the foregoing embodiments, and details are not described herein again.
本领域普通技术人员可以理解,图4所示的结构仅为示意,电子装置可以是智能手机(如Android手机、iOS手机等)、平板电脑、掌上电脑以及移动互联网设备(Mobile Internet Devices,MID)、PAD等终端设备。图4其并不对上述电子装置的结构造成限定。例如,电子装置还可包括比图4中所示更多或者更少的组件(如网络接口、显示装置等),或者具有与图4所示不同的配置。A person skilled in the art can understand that the structure shown in FIG. 4 is merely illustrative, and the electronic device can be a smart phone (such as an Android mobile phone, an iOS mobile phone, etc.), a tablet computer, a palm computer, and a mobile Internet device (MID). Terminal equipment such as PAD. FIG. 4 does not limit the structure of the above electronic device. For example, the electronic device may also include more or fewer components (such as a network interface, display device, etc.) than shown in FIG. 4, or have a different configuration than that shown in FIG.
本领域普通技术人员可以理解上述实施例的各种方法中的全部或部分步骤是可以通过程序来指令终端设备相关的硬件来完成,该程序可以存储于一计算机可读存储介质中,存储介质可以包括:闪存盘、只读存储器(Read-Only Memory,简称为ROM)、随机存取器(Random Access Memory,简称为RAM)、磁盘或光盘等。A person of ordinary skill in the art may understand that all or part of the steps of the foregoing embodiments may be completed by a program to instruct terminal device related hardware, and the program may be stored in a computer readable storage medium, and the storage medium may be Including: flash disk, read-only memory (Read-Only Memory, ROM for short), random access memory (Random Access Memory, RAM), disk or optical disk.
本发明的实施例还提供了一种存储介质。可选地,在本实施例中,上述存储介质中存储有计算机程序,其中,所述计算机程序被设置为运行时执行数据加载方法。Embodiments of the present invention also provide a storage medium. Optionally, in this embodiment, a computer program is stored in the storage medium, wherein the computer program is configured to execute a data loading method at runtime.
可选地,在本实施例中,上述存储介质可以位于上述实施例所示的网络中的多个网络设备中的至少一个网络设备上。Optionally, in this embodiment, the foregoing storage medium may be located on at least one of the plurality of network devices in the network shown in the foregoing embodiment.
可选地,在本实施例中,存储介质被设置为存储用于执行以下步骤的程序代码:Optionally, in the present embodiment, the storage medium is arranged to store program code for performing the following steps:
S1,接收预设的提醒关键信息及用户标识,并保存所述提醒关键信息与所述用户标识之间的对应关系;S1. The preset reminder key information and the user identifier are received, and the correspondence between the reminder key information and the user identifier is saved.
S2,实时接收语音数据时,获取所述语音数据所属的实时对话中参与对话的各个用户的用户标识;S2, when receiving voice data in real time, acquiring a user identifier of each user participating in the conversation in the real-time conversation to which the voice data belongs;
S3,利用所述语音数据,与所述实时对话中参与用户的用户标识分别对应的提醒关键信息进行实时匹配;S3, using the voice data, to perform real-time matching with the reminder key information corresponding to the user identifiers of the participating users in the real-time conversation;
S4,当所述语音数据与提醒关键信息匹配成功,获取与所述提醒关键信息具有对应关系的用户标识;S4, when the voice data is successfully matched with the reminder key information, obtaining a user identifier that has a corresponding relationship with the reminder key information;
S5,向具有所述用户标识的用户发送实时提醒信号。S5. Send a real-time reminder signal to the user with the user identifier.
可选地,存储介质还被设置为存储用于执行以下步骤的程序代码:当所述语音数据与提醒关键信息匹配成功,识别所述语音数据,并保存由所述语音数据转化成的文本数据。Optionally, the storage medium is further configured to store program code for performing the following steps: when the voice data is successfully matched with the reminder key information, identifying the voice data, and saving text data converted by the voice data .
可选地,存储介质还被设置为存储用于执行以下步骤的程序代码:当所述语音数据与提醒关键信息匹配成功,保存发送所述语音数据的用户的用户标识,以及所述用户发送所述语音数据时的时间信息。Optionally, the storage medium is further configured to store program code for performing the following steps: when the voice data is successfully matched with the reminder key information, saving the user identifier of the user who sent the voice data, and the user sending station Time information when the voice data is described.
可选地,存储介质还被设置为存储用于执行以下步骤的程序代码:生成所述实时对话的对话记录,所述对话记录包括由所述语音数据转化成的文本数据、发送所述语音数据的用户的用户标识,以及所述用户发送所述语音数据时的时间信息之间的对应关系,其中,所述实时对话的对话记录用于供所述实时对话中的参与用户下载。Optionally, the storage medium is further configured to store program code for: generating a conversation record of the real-time conversation, the conversation record comprising text data converted from the voice data, and transmitting the voice data Corresponding relationship between the user identifier of the user and the time information when the user sends the voice data, wherein the conversation record of the real-time conversation is used for downloading by participating users in the real-time conversation.
可选地,存储介质还被设置为存储用于执行以下步骤的程序代码:在接收到所述实时对话中的用户对所述实时对话的对话记录的下载请求时,向所述用户发送所述对话记录;接收并保存经过所述用户二次编辑的对话记录,以供所述实时对话中的参与用户下载。Optionally, the storage medium is further configured to store program code for performing the step of: transmitting the download request to the user when receiving a download request for the conversation record of the real-time conversation in the real-time conversation a conversation record; receiving and saving a conversation record that has been edited twice by the user for download by the participating users in the real-time conversation.
可选地,存储介质还被设置为存储用于执行以下步骤的程序代码:所述提醒关键信息为语音数据;提取所述语音数据的特征,所述特征包括波形信息;将所述语音数据的特征与所述实时对话中的各个用户的用户标识分别对应的提醒关键信息的特征进行匹配。Optionally, the storage medium is further configured to store program code for performing the following steps: the reminder key information is voice data; extracting features of the voice data, the features including waveform information; The feature matches the characteristics of the reminder key information corresponding to the user identifiers of the respective users in the real-time conversation.
可选地,存储介质还被设置为存储用于执行以下步骤的程序代码:所述提醒关键信息为文本数据;识别所述语音数据,并将所述语音数据转化 成文本数据;将所述文本数据与所述实时对话中的参与用户的用户标识分别对应的提醒关键信息进行匹配。Optionally, the storage medium is further configured to store program code for performing the following steps: the reminder key information is text data; identifying the voice data, and converting the voice data into text data; The data is matched with the reminder key information corresponding to the user IDs of the participating users in the real-time conversation.
可选地,存储介质还被设置为存储用于执行以下步骤的程序代码:当所述用户的客户端接收到所述提醒信号时,响应于所述提醒信号,开启音频或视频的录制功能。Optionally, the storage medium is further configured to store program code for performing the following steps: when the client's client receives the alert signal, in response to the alert signal, turning on the audio or video recording function.
可选地,本实施例中的具体示例可以参考上述实施例中所描述的示例,本实施例在此不再赘述。For example, the specific examples in this embodiment may refer to the examples described in the foregoing embodiments, and details are not described herein again.
可选地,在本实施例中,上述存储介质可以包括但不限于:U盘、只读存储器(Read-Only Memory,简称为ROM)、随机存取存储器(Random Access Memory,简称为RAM)、移动硬盘、磁碟或者光盘等各种可以存储程序代码的介质。Optionally, in the embodiment, the foregoing storage medium may include, but is not limited to, a USB flash drive, a Read-Only Memory (ROM), and a Random Access Memory (RAM). A variety of media that can store program code, such as a hard disk, a disk, or an optical disk.
对于装置实施例而言,由于其基本对应于方法实施例,所以相关之处参见方法实施例的部分说明即可。以上所描述的装置实施例仅仅是示意性的,其中所述作为分离部件说明的单元可以是或者也可以不是物理上分开的,作为单元显示的部件可以是或者也可以不是物理单元,即可以位于一个地方,或者也可以分布到多个网络单元上。可以根据实际的需要选择其中的部分或者全部模块来实现本实施例方案的目的。本领域普通技术人员在不付出创造性劳动的情况下,即可以理解并实施。For the device embodiment, since it basically corresponds to the method embodiment, reference may be made to the partial description of the method embodiment. The device embodiments described above are merely illustrative, wherein the units described as separate components may or may not be physically separate, and the components displayed as units may or may not be physical units, ie may be located A place, or it can be distributed to multiple network units. Some or all of the modules may be selected according to actual needs to achieve the purpose of the solution of the embodiment. Those of ordinary skill in the art can understand and implement without any creative effort.
需要说明的是,在本文中,诸如第一和第二等之类的关系术语仅仅用来将一个实体或者操作与另一个实体或操作区分开来,而不一定要求或者暗示这些实体或操作之间存在任何这种实际的关系或者顺序。而且,术语“包括”、“包含”或者其任何其他变体意在涵盖非排他性的包含,从而使得包括一系列要素的过程、方法、物品或者设备不仅包括那些要素,而且还包括没有明确列出的其他要素,或者是还包括为这种过程、方法、物品或者设备所固有的要素。在没有更多限制的情况下,由语句“包括一个……”限定的要素,并不排除在包括所述要素的过程、方法、物品或者设备中还存在另外的相同要素。It should be noted that, in this context, relational terms such as first and second are used merely to distinguish one entity or operation from another entity or operation, and do not necessarily require or imply such entities or operations. There is any such actual relationship or order between them. Furthermore, the term "comprises" or "comprises" or "comprises" or any other variations thereof is intended to encompass a non-exclusive inclusion, such that a process, method, article, or device that comprises a plurality of elements includes not only those elements but also Other elements, or elements that are inherent to such a process, method, item, or device. An element that is defined by the phrase "comprising a ..." does not exclude the presence of additional equivalent elements in the process, method, item, or device that comprises the element.
以上对本发明实施例所提供的一种实时对话中的实时提醒方法及装置进行了详细介绍,本文中应用了具体个例对本发明的原理及实施方式进行了阐述,以上实施例的说明只是用于帮助理解本发明的方法及其核心思想;同时,对于本领域的一般技术人员,依据本发明的思想,在具体实施方式及应用范围上均会有改变之处,综上所述,本说明书内容不应理解为对本发明的限制。The method and device for real-time reminding in a real-time conversation provided by the embodiments of the present invention are described in detail. The principles and implementation manners of the present invention are described in the following examples. The description of the above embodiments is only used for To help understand the method of the present invention and its core idea; at the same time, for those skilled in the art, according to the idea of the present invention, there will be changes in specific embodiments and application scopes. It should not be construed as limiting the invention.
Claims (17)
- 一种实时对话中的实时提醒方法,所述实时提醒方法包括:A real-time reminding method in a real-time conversation, the real-time reminding method includes:接收预设的提醒关键信息及用户标识,并保存所述提醒关键信息与所述用户标识之间的对应关系;Receiving a preset reminder key information and a user identifier, and storing a correspondence between the reminder key information and the user identifier;实时接收语音数据时,获取所述语音数据所属的实时对话中参与对话的各个用户的用户标识;When receiving the voice data in real time, acquiring a user identifier of each user participating in the conversation in the real-time conversation to which the voice data belongs;利用所述语音数据,与所述实时对话中参与用户的用户标识分别对应的提醒关键信息进行实时匹配;And using the voice data to perform real-time matching with the reminder key information corresponding to the user identifiers of the participating users in the real-time conversation;当所述语音数据与提醒关键信息匹配成功,获取与所述提醒关键信息具有对应关系的用户标识;When the voice data is successfully matched with the reminder key information, obtaining a user identifier that has a corresponding relationship with the reminder key information;向具有所述用户标识的用户发送实时提醒信号。A real-time reminder signal is sent to the user with the user identification.
- 根据权利要求1所述的实时对话中的实时提醒方法,其中,所述方法还包括:The real-time reminding method in the real-time conversation according to claim 1, wherein the method further comprises:当所述语音数据与提醒关键信息匹配成功,识别所述语音数据,并保存由所述语音数据转化成的文本数据。When the voice data is successfully matched with the reminder key information, the voice data is identified, and the text data converted by the voice data is saved.
- 根据权利要求2所述的实时对话中的实时提醒方法,其中,所述方法还包括:The real-time reminding method in the real-time conversation according to claim 2, wherein the method further comprises:当所述语音数据与提醒关键信息匹配成功,保存发送所述语音数据的用户的用户标识,以及所述用户发送所述语音数据时的时间信息。When the voice data is successfully matched with the reminder key information, the user identifier of the user who sent the voice data is saved, and the time information when the user sends the voice data.
- 根据权利要求3所述的实时对话中的实时提醒方法,其中,所述方法还包括:The real-time reminding method in the real-time conversation according to claim 3, wherein the method further comprises:生成所述实时对话的对话记录,所述对话记录包括由所述语音数据转化成的文本数据、发送所述语音数据的用户的用户标识,以及所述用户发送所述语音数据时的时间信息之间的对应关系,其中,所述实时对话的对话记录用于供所述实时对话中的参与用户下载。Generating a conversation record of the real-time conversation, the conversation record including text data converted by the voice data, a user identifier of a user transmitting the voice data, and time information when the user sends the voice data Corresponding relationship, wherein the conversation record of the real-time conversation is used for downloading by participating users in the real-time conversation.
- 根据权利要求4所述的实时对话中的实时提醒方法,其中,所述方法还包括:The real-time reminding method in the real-time conversation according to claim 4, wherein the method further comprises:在接收到所述实时对话中的用户对所述实时对话的对话记录的下载请求时,向所述用户发送所述对话记录;Receiving, by the user in the real-time conversation, a download request of the conversation record of the real-time conversation, sending the conversation record to the user;接收并保存经过所述用户二次编辑的对话记录,以供所述实时对话中的参与用户下载。A dialog record that has been edited twice by the user is received and saved for download by the participating users in the real-time conversation.
- 根据权利要求1所述的实时对话中的实时提醒方法,其中,所述提醒关键信息为语音数据;The real-time reminding method in real-time conversation according to claim 1, wherein the reminding key information is voice data;相应的,所述利用所述语音数据,与所述实时对话中的参与用户的用户标识分别对应的提醒关键信息进行匹配,包括:Correspondingly, the using the voice data to match the reminder key information corresponding to the user identifiers of the participating users in the real-time conversation, including:提取所述语音数据的特征,所述特征包括波形信息;Extracting features of the voice data, the features including waveform information;将所述语音数据的特征与所述实时对话中的各个用户的用户标识分别对应的提醒关键信息的特征进行匹配。The features of the voice data are matched with the features of the reminder key information corresponding to the user identifiers of the respective users in the real-time conversation.
- 根据权利要求1所述的实时对话中的实时提醒方法,其中,所述提醒关键信息为文本数据;The real-time reminding method in real-time conversation according to claim 1, wherein the reminding key information is text data;相应的,所述利用所述语音数据,与所述实时对话中的参与用户的用户标识分别对应的提醒关键信息进行匹配,包括:Correspondingly, the using the voice data to match the reminder key information corresponding to the user identifiers of the participating users in the real-time conversation, including:识别所述语音数据,并将所述语音数据转化成文本数据;Identifying the voice data and converting the voice data into text data;将所述文本数据与所述实时对话中的参与用户的用户标识分别对应的提醒关键信息进行匹配。The text data is matched with the reminder key information corresponding to the user identifiers of the participating users in the real-time conversation.
- 根据权利要求1所述的实时对话中的实时提醒方法,其中,所述方法还包括:The real-time reminding method in the real-time conversation according to claim 1, wherein the method further comprises:当所述用户的客户端接收到所述提醒信号时,响应于所述提醒信号,开启音频或视频的录制功能。When the client's client receives the alert signal, in response to the alert signal, the audio or video recording function is turned on.
- 一种实时对话中的实时提醒装置,包括一个或多个处理器,以及一个或多个存储程序单元的存储器,其中,所述程序单元由所述处理器执 行,所述程序单元包括:A real-time reminder device in a real-time conversation, comprising one or more processors, and one or more memories storing program units, wherein the program units are executed by the processor, the program units comprising:第一保存模块,被设置为接收预设的提醒关键信息及用户标识,并保存所述提醒关键信息与所述用户标识之间的对应关系;The first saving module is configured to receive preset reminder key information and a user identifier, and save a correspondence between the reminder key information and the user identifier;第一获取模块,被设置为实时接收到语音数据时,获取所述语音数据所属的实时对话中的参与对话的各个用户的用户标识;The first obtaining module is configured to acquire, when the voice data is received in real time, the user identifier of each user participating in the conversation in the real-time conversation to which the voice data belongs;匹配模块,被设置为利用所述语音数据,与所述实时对话中参与用户的用户标识分别对应的提醒关键信息进行实时匹配;The matching module is configured to use the voice data to perform real-time matching with the reminder key information corresponding to the user identifiers of the participating users in the real-time conversation;第二获取模块,被设置为当所述语音数据与提醒关键信息匹配成功,获取与所述提醒关键信息具有对应关系的用户标识;a second acquiring module, configured to: when the voice data is successfully matched with the reminder key information, acquire a user identifier that has a corresponding relationship with the reminder key information;第一发送模块,被设置为向具有所述用户标识的用户发送实时提醒信号。The first sending module is configured to send a real-time reminder signal to the user having the user identifier.
- 根据权利要求9所述的实时对话中的实时提醒装置,其中,所述装置还包括:The real-time reminding device in the real-time conversation according to claim 9, wherein the device further comprises:第二保存模块,被设置为当所述语音数据与提醒关键信息匹配成功,识别所述语音数据,并保存由所述语音数据转化成的文本数据。The second saving module is configured to identify the voice data when the voice data is successfully matched with the reminder key information, and save the text data converted by the voice data.
- 根据权利要求10所述的实时对话中的实时提醒装置,其中,所述装置还包括:The real-time reminding device in the real-time conversation according to claim 10, wherein the device further comprises:第三保存模块,被设置为当所述语音数据与提醒关键信息匹配成功,保存发送所述语音数据的用户的用户标识,以及所述用户发送所述语音数据时的时间信息。The third saving module is configured to: when the voice data is successfully matched with the reminder key information, save the user identifier of the user who sends the voice data, and time information when the user sends the voice data.
- 根据权利要求11所述的实时对话中的实时提醒装置,其中,所述装置还包括:The real-time reminding device in the real-time conversation according to claim 11, wherein the device further comprises:生成模块,被设置为生成所述实时对话的对话记录,所述对话记录包括由所述语音数据转化成的文本数据、发送所述语音数据的用户的用户标识,以及所述用户发送所述语音数据时的时间信息之间的对应关系,其中,所述实时对话的对话记录用于供所述实时对话中的参与用户下载。a generating module configured to generate a conversation record of the real-time conversation, the conversation record including text data converted by the voice data, a user identifier of a user transmitting the voice data, and the user transmitting the voice Correspondence between time information of data, wherein the conversation record of the real-time conversation is used for downloading by participating users in the real-time conversation.
- 根据权利要求12所述的实时对话中的实时提醒装置,其中,所述装置还包括:The real-time reminding device in the real-time conversation according to claim 12, wherein the device further comprises:第二发送模块,被设置为在接收到所述实时对话中的用户对所述实时对话的对话记录的下载请求时,向所述用户发送所述对话记录;a second sending module, configured to send the conversation record to the user when receiving a download request of the conversation record of the real-time conversation by the user in the real-time conversation;第三存储模块,被设置为接收并保存经过所述用户二次编辑的对话记录,以供所述实时对话中的参与用户下载。The third storage module is configured to receive and save the dialog record edited by the user for secondary downloading for the participating users in the real-time conversation.
- 根据权利要求9所述的实时对话中的实时提醒装置,其中,所述提醒关键信息为语音数据;The real-time reminding device in the real-time conversation according to claim 9, wherein the reminding key information is voice data;相应的,所述匹配模块,包括:Correspondingly, the matching module includes:提取子模块,被设置为提取所述语音数据的特征,所述特征包括波形信息;An extraction submodule configured to extract features of the speech data, the features including waveform information;第一匹配子模块,被设置为将所述语音数据的特征与所述实时对话中的参与用户的用户标识分别对应的提醒关键信息的特征进行匹配。The first matching sub-module is configured to match the feature of the voice data with the feature of the reminder key information corresponding to the user identifier of the participating user in the real-time conversation.
- 根据权利要求9所述的实时对话中的实时提醒装置,其中,所述提醒关键信息为文本数据;The real-time reminding device in the real-time conversation according to claim 9, wherein the reminding key information is text data;相应的,所述匹配模块,包括:Correspondingly, the matching module includes:转化子模块,被设置为识别所述语音数据,并将所述语音数据转化成文本数据;a conversion submodule configured to identify the voice data and convert the voice data into text data;第二匹配子模块,被设置为将所述文本数据与所述实时对话中的参与用户的用户标识分别对应的提醒关键信息进行匹配。The second matching sub-module is configured to match the text data with reminder key information respectively corresponding to the user identifiers of the participating users in the real-time conversation.
- [根据细则26改正21.03.2018]
一种存储介质,其中,所述存储介质中存储有计算机程序,所述计算机程序被设置为运行时执行所述权利要求1至8任一项中所述的方法。 [Correct according to Rule 26 21.03.2018]
A storage medium, wherein a computer program is stored in the storage medium, the computer program being arranged to perform the method of any one of claims 1 to 8 at runtime. - [根据细则26改正21.03.2018]
一种电子装置,包括存储器和处理器,其中,所述存储器中存储有计算机程序,所述处理器被设置为通过所述计算机程序执行所述权利要求1至8任一项中所述的方法。 [Correct according to Rule 26 21.03.2018]
An electronic device comprising a memory and a processor, wherein the memory stores a computer program, the processor being arranged to perform the method of any one of claims 1 to 8 by the computer program .
Applications Claiming Priority (2)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
CN201710146401.1 | 2017-03-13 | ||
CN201710146401.1A CN108574680B (en) | 2017-03-13 | 2017-03-13 | Real-time reminding method and device in audio and video real-time conversation |
Publications (1)
Publication Number | Publication Date |
---|---|
WO2018166367A1 true WO2018166367A1 (en) | 2018-09-20 |
Family
ID=63521767
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
PCT/CN2018/077980 WO2018166367A1 (en) | 2017-03-13 | 2018-03-05 | Real-time prompt method and device in real-time conversation, storage medium, and electronic device |
Country Status (2)
Country | Link |
---|---|
CN (1) | CN108574680B (en) |
WO (1) | WO2018166367A1 (en) |
Cited By (2)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN112735421A (en) * | 2019-10-28 | 2021-04-30 | 北京京东尚科信息技术有限公司 | Real-time quality inspection method and device for voice call |
CN113223558A (en) * | 2021-04-30 | 2021-08-06 | 广州虎牙科技有限公司 | Audio data silencing method and device, electronic equipment and storage medium |
Families Citing this family (2)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN109104535B (en) * | 2018-09-30 | 2020-10-27 | 联想(北京)有限公司 | Information processing method, electronic equipment and system |
CN109451158B (en) * | 2018-11-09 | 2021-07-27 | 维沃移动通信有限公司 | Reminding method and device |
Citations (7)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN101931701A (en) * | 2010-08-25 | 2010-12-29 | 宇龙计算机通信科技(深圳)有限公司 | Method, system and mobile terminal for prompting contact information in communication process |
CN102970210A (en) * | 2012-11-02 | 2013-03-13 | 北京百度网讯科技有限公司 | Method and device for reminding group messages in instant chat tool |
US20140218461A1 (en) * | 2013-02-01 | 2014-08-07 | Maitland M. DeLand | Video Conference Call Conversation Topic Sharing System |
CN105681564A (en) * | 2016-01-25 | 2016-06-15 | 宇龙计算机通信科技(深圳)有限公司 | Message reminding method and device |
CN105827501A (en) * | 2015-07-30 | 2016-08-03 | 维沃移动通信有限公司 | Message reminding method and electronic equipment |
CN106302933A (en) * | 2016-08-31 | 2017-01-04 | 宇龙计算机通信科技(深圳)有限公司 | Voice information whose processing method and terminal |
CN106330685A (en) * | 2016-09-18 | 2017-01-11 | 依偎科技(南昌)有限公司 | Group message prompt method and terminal |
Family Cites Families (1)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN104793725B (en) * | 2014-01-16 | 2018-11-06 | 华为技术有限公司 | The processing method and processing device of alert notification message |
-
2017
- 2017-03-13 CN CN201710146401.1A patent/CN108574680B/en active Active
-
2018
- 2018-03-05 WO PCT/CN2018/077980 patent/WO2018166367A1/en active Application Filing
Patent Citations (7)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN101931701A (en) * | 2010-08-25 | 2010-12-29 | 宇龙计算机通信科技(深圳)有限公司 | Method, system and mobile terminal for prompting contact information in communication process |
CN102970210A (en) * | 2012-11-02 | 2013-03-13 | 北京百度网讯科技有限公司 | Method and device for reminding group messages in instant chat tool |
US20140218461A1 (en) * | 2013-02-01 | 2014-08-07 | Maitland M. DeLand | Video Conference Call Conversation Topic Sharing System |
CN105827501A (en) * | 2015-07-30 | 2016-08-03 | 维沃移动通信有限公司 | Message reminding method and electronic equipment |
CN105681564A (en) * | 2016-01-25 | 2016-06-15 | 宇龙计算机通信科技(深圳)有限公司 | Message reminding method and device |
CN106302933A (en) * | 2016-08-31 | 2017-01-04 | 宇龙计算机通信科技(深圳)有限公司 | Voice information whose processing method and terminal |
CN106330685A (en) * | 2016-09-18 | 2017-01-11 | 依偎科技(南昌)有限公司 | Group message prompt method and terminal |
Cited By (3)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN112735421A (en) * | 2019-10-28 | 2021-04-30 | 北京京东尚科信息技术有限公司 | Real-time quality inspection method and device for voice call |
CN113223558A (en) * | 2021-04-30 | 2021-08-06 | 广州虎牙科技有限公司 | Audio data silencing method and device, electronic equipment and storage medium |
CN113223558B (en) * | 2021-04-30 | 2024-03-15 | 广州虎牙科技有限公司 | Audio data silencing method and device, electronic equipment and storage medium |
Also Published As
Publication number | Publication date |
---|---|
CN108574680B (en) | 2021-05-04 |
CN108574680A (en) | 2018-09-25 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
WO2018166367A1 (en) | Real-time prompt method and device in real-time conversation, storage medium, and electronic device | |
TWI507063B (en) | Method, terminal, server and system for sharing information | |
CN107609045B (en) | Conference record generating device and method thereof | |
US10423958B2 (en) | Method, apparatus and system for voice verification | |
CN105120299B (en) | Video pushing method and device | |
CN104202491A (en) | Method for handling customer service telephone call and device thereof | |
CN107370610B (en) | Conference synchronization method and device | |
CN103841272B (en) | A kind of method and device sending speech message | |
WO2017101297A1 (en) | Method and device for video messaging, terminal, and server | |
CN112350834B (en) | AI voice conference system with screen and method | |
CN104092653B (en) | Data processing method and system | |
WO2020124453A1 (en) | Automatic information reply method and related apparatus | |
CN110971984B (en) | Wheat connecting method, device, system, equipment and storage medium | |
US20220005483A1 (en) | Group Chat Voice Information Processing Method and Apparatus, Storage Medium, and Server | |
WO2016180220A1 (en) | Conversation setup method and apparatus | |
CN112634932B (en) | Audio signal processing method and device, server and related equipment | |
CN112306560B (en) | Method and apparatus for waking up an electronic device | |
WO2020125588A1 (en) | Voice call identification method, device and storage medium | |
US10505876B2 (en) | Instant communication method and server | |
US20200184973A1 (en) | Transcription of communications | |
CN111988426B (en) | Communication method and device based on voiceprint recognition, intelligent terminal and storage medium | |
CN103929524A (en) | Method for recording information in communication process and mobile terminal with method applied | |
CN115879583B (en) | Method and device for processing work order data and computer readable storage medium | |
TWM591212U (en) | Automatic customer service agent system | |
CN113139392B (en) | Conference summary generation method, device and storage medium |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
121 | Ep: the epo has been informed by wipo that ep was designated in this application |
Ref document number: 18767114 Country of ref document: EP Kind code of ref document: A1 |
|
NENP | Non-entry into the national phase |
Ref country code: DE |
|
122 | Ep: pct application non-entry in european phase |
Ref document number: 18767114 Country of ref document: EP Kind code of ref document: A1 |