CN111490928A - Instant communication message reading and replying method and device and electronic equipment - Google Patents

Instant communication message reading and replying method and device and electronic equipment Download PDF

Info

Publication number
CN111490928A
CN111490928A CN202010231386.2A CN202010231386A CN111490928A CN 111490928 A CN111490928 A CN 111490928A CN 202010231386 A CN202010231386 A CN 202010231386A CN 111490928 A CN111490928 A CN 111490928A
Authority
CN
China
Prior art keywords
instant messaging
message
voice
messaging application
unread
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
CN202010231386.2A
Other languages
Chinese (zh)
Inventor
王伟
罗小霞
王莹
王永强
翟林静
程秋菊
杨娜
闫永波
疏秦
高�克明
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Beijing Sankuai Online Technology Co Ltd
Original Assignee
Beijing Sankuai Online Technology Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Beijing Sankuai Online Technology Co Ltd filed Critical Beijing Sankuai Online Technology Co Ltd
Priority to CN202010231386.2A priority Critical patent/CN111490928A/en
Publication of CN111490928A publication Critical patent/CN111490928A/en
Pending legal-status Critical Current

Links

Images

Classifications

    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L51/00—User-to-user messaging in packet-switching networks, transmitted according to store-and-forward or real-time protocols, e.g. e-mail
    • H04L51/04—Real-time or near real-time messaging, e.g. instant messaging [IM]
    • H04L51/046—Interoperability with other network applications or services
    • G—PHYSICS
    • G10—MUSICAL INSTRUMENTS; ACOUSTICS
    • G10L—SPEECH ANALYSIS OR SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING; SPEECH OR AUDIO CODING OR DECODING
    • G10L15/00—Speech recognition
    • G10L15/26—Speech to text systems
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L51/00—User-to-user messaging in packet-switching networks, transmitted according to store-and-forward or real-time protocols, e.g. e-mail
    • H04L51/07—User-to-user messaging in packet-switching networks, transmitted according to store-and-forward or real-time protocols, e.g. e-mail characterised by the inclusion of specific contents
    • H04L51/10—Multimedia information
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L51/00—User-to-user messaging in packet-switching networks, transmitted according to store-and-forward or real-time protocols, e.g. e-mail
    • H04L51/07—User-to-user messaging in packet-switching networks, transmitted according to store-and-forward or real-time protocols, e.g. e-mail characterised by the inclusion of specific contents
    • H04L51/18—Commands or executable codes
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04M—TELEPHONIC COMMUNICATION
    • H04M1/00—Substation equipment, e.g. for use by subscribers
    • H04M1/72—Mobile telephones; Cordless telephones, i.e. devices for establishing wireless links to base stations without route selection
    • H04M1/724—User interfaces specially adapted for cordless or mobile telephones
    • H04M1/72403—User interfaces specially adapted for cordless or mobile telephones with means for local support of applications that increase the functionality
    • H04M1/72406—User interfaces specially adapted for cordless or mobile telephones with means for local support of applications that increase the functionality by software upgrading or downloading
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04M—TELEPHONIC COMMUNICATION
    • H04M1/00—Substation equipment, e.g. for use by subscribers
    • H04M1/72—Mobile telephones; Cordless telephones, i.e. devices for establishing wireless links to base stations without route selection
    • H04M1/724—User interfaces specially adapted for cordless or mobile telephones
    • H04M1/72403—User interfaces specially adapted for cordless or mobile telephones with means for local support of applications that increase the functionality
    • H04M1/72409—User interfaces specially adapted for cordless or mobile telephones with means for local support of applications that increase the functionality by interfacing with external accessories
    • H04M1/72412—User interfaces specially adapted for cordless or mobile telephones with means for local support of applications that increase the functionality by interfacing with external accessories using two-way short-range wireless interfaces
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04M—TELEPHONIC COMMUNICATION
    • H04M1/00—Substation equipment, e.g. for use by subscribers
    • H04M1/72—Mobile telephones; Cordless telephones, i.e. devices for establishing wireless links to base stations without route selection
    • H04M1/724—User interfaces specially adapted for cordless or mobile telephones
    • H04M1/72403—User interfaces specially adapted for cordless or mobile telephones with means for local support of applications that increase the functionality
    • H04M1/7243—User interfaces specially adapted for cordless or mobile telephones with means for local support of applications that increase the functionality with interactive means for internal management of messages
    • H04M1/72433—User interfaces specially adapted for cordless or mobile telephones with means for local support of applications that increase the functionality with interactive means for internal management of messages for voice messaging, e.g. dictaphones
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04M—TELEPHONIC COMMUNICATION
    • H04M1/00—Substation equipment, e.g. for use by subscribers
    • H04M1/72—Mobile telephones; Cordless telephones, i.e. devices for establishing wireless links to base stations without route selection
    • H04M1/724—User interfaces specially adapted for cordless or mobile telephones
    • H04M1/72403—User interfaces specially adapted for cordless or mobile telephones with means for local support of applications that increase the functionality
    • H04M1/7243—User interfaces specially adapted for cordless or mobile telephones with means for local support of applications that increase the functionality with interactive means for internal management of messages
    • H04M1/72436—User interfaces specially adapted for cordless or mobile telephones with means for local support of applications that increase the functionality with interactive means for internal management of messages for text messaging, e.g. SMS or e-mail
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04M—TELEPHONIC COMMUNICATION
    • H04M1/00—Substation equipment, e.g. for use by subscribers
    • H04M1/72—Mobile telephones; Cordless telephones, i.e. devices for establishing wireless links to base stations without route selection
    • H04M1/724—User interfaces specially adapted for cordless or mobile telephones
    • H04M1/72448—User interfaces specially adapted for cordless or mobile telephones with means for adapting the functionality of the device according to specific conditions
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04M—TELEPHONIC COMMUNICATION
    • H04M1/00—Substation equipment, e.g. for use by subscribers
    • H04M1/72—Mobile telephones; Cordless telephones, i.e. devices for establishing wireless links to base stations without route selection
    • H04M1/724—User interfaces specially adapted for cordless or mobile telephones
    • H04M1/72466—User interfaces specially adapted for cordless or mobile telephones with selection means, e.g. keys, having functions defined by the mode or the status of the device

Abstract

The application discloses a method for reading and replying instant messaging messages, belongs to the technical field of computers, and is beneficial to improving the convenience of reading and sending the instant messaging messages. The method for reading and replying the instant messaging message disclosed by the embodiment of the application comprises the following steps: reading an unread instant messaging message and a session identifier associated with the unread instant messaging message; converting the read unread instant messaging message into voice data, and sending the voice data to a specified audio output device for broadcasting; when a first preset key of the audio output device is triggered, inputting reply voice through the appointed audio input device, generating a reply message comprising a voice message and a text message according to the reply voice through the preset instant messaging application server, and replying the message. The method automatically reads the unread instant messaging message, can quickly reply the instant messaging message only by operating the keys of the audio input device, does not need to open client software, and improves the efficiency of instant messaging.

Description

Instant communication message reading and replying method and device and electronic equipment
Technical Field
The embodiment of the application relates to the technical field of computers, in particular to a method and a device for reading and replying an instant messaging message, electronic equipment and a computer-readable storage medium.
Background
In the prior art, reading and replying of instant messaging messages can be completed only by manual operation of a user. For example, the user opens the instant messaging application client, views the unread instant messaging messages, and then enters and sends a reply message. In some application scenarios, some instant messaging application messages require the user to read and reply in time, but often the user cannot read and reply in time because both hands are occupied. For example, the takeaway merchant side of the ordering application needs to open the session detail page of the ordering application after the merchant receives an instant messaging application message, read the specific content of the unread message, and then perform voice or text reply on the session page. During peak meal times, merchants have less time to hold and are likely to have meal packaging or other work in progress, and are unable to free both hands to view and reply to unread messages in time, so some important messages are often not read and reply in time.
Therefore, the instant messaging application in the prior art at least has the problem of complex operation.
Disclosure of Invention
The embodiment of the application provides a method for reading and replying instant messaging messages, which is beneficial to improving the convenience of reading and sending the instant messaging messages.
In order to solve the above problem, in a first aspect, an embodiment of the present application provides a method for reading and replying an instant messaging message, including:
the instant messaging application client reads an unread instant messaging message and a session identifier associated with the unread instant messaging message;
the instant messaging application client acquires and runs the state information of an audio output device of the electronic equipment of the instant messaging application client by calling a system interface;
responding to the state information to indicate that the audio output device is in an available state, converting the read unread instant messaging message into voice data, and sending the voice data to the audio output device of the electronic equipment for broadcasting;
starting monitoring a trigger event of a first preset key on an audio input device of the electronic equipment;
in response to the monitoring of the trigger event of the first preset key, the instant messaging application client calls an audio data reading interface matched with the audio input device, and a reply voice is input through the audio input device;
the instant messaging application client sends the session identification and the reply voice to a preset instant messaging application server;
the preset instant messaging application server generates a voice message according to the reply voice, converts the reply voice into a text and generates a text message according to the converted text;
the preset instant messaging application server encapsulates the generated voice message and text message body into a unified message body, issues the unified message body to the instant messaging application client associated with the session identifier, and replies the read unread instant messaging message; wherein, the unified message body comprises: a field carrying the text message, a field carrying the download address of the voice message, and a message type field indicating that the unified message body includes the voice message and the text message
In a second aspect, an embodiment of the present application provides an instant messaging message reading and replying device, including:
the message reading module is used for reading an unread instant messaging message and a session identifier associated with the unread instant messaging message by the instant messaging application client;
the audio output device state acquisition module is used for acquiring the state information of an audio output device of the electronic equipment running the instant messaging application client by calling a system interface by the instant messaging application client;
the voice broadcasting module is used for responding to the state information to indicate that the audio output device is in an available state, converting the read unread instant messaging message into voice data and sending the voice data to the audio output device of the electronic equipment for broadcasting;
the key monitoring module is used for starting the monitoring of the triggering event of a first preset key on the audio input device of the electronic equipment;
the reply voice recording module is used for responding to the trigger event of monitoring the first preset key, calling an audio data reading interface matched with the audio input device by the instant communication application client, and recording reply voice through the audio input device;
the reply voice sending module is used for sending the session identifier and the reply voice to a preset instant messaging application server by the instant messaging application client;
the reply message generation module is used for generating a voice message by the preset instant messaging application server according to the reply voice, converting the reply voice into a text by the preset instant messaging application server, and generating a text message according to the converted text;
a reply message sending module, configured to encapsulate the generated voice message and text message into a unified message body by the preset instant messaging application server, send the unified message body to the instant messaging application client associated with the session identifier, and reply to the read unread instant messaging message; wherein, the unified message body comprises: a field carrying the text message, a field carrying the download address of the voice message, and a message type field indicating that the unified message body includes the voice message and the text message.
In a third aspect, an embodiment of the present application further discloses an electronic device, which includes a memory, a processor, and a computer program stored in the memory and executable on the processor, where the processor implements the method for reading and replying an instant messaging message according to the embodiment of the present application when executing the computer program.
In a fourth aspect, the present application provides a computer-readable storage medium, on which a computer program is stored, where the computer program is executed by a processor, and the computer program is used to perform the steps of the instant messaging message reading and replying method disclosed in the present application.
The method for reading and replying the instant messaging message, disclosed by the embodiment of the application, comprises the steps of reading an unread instant messaging message and a session identifier associated with the unread instant messaging message through an instant messaging application client; the instant messaging application client acquires and runs the state information of an audio output device of the electronic equipment of the instant messaging application client by calling a system interface; responding to the state information to indicate that the audio output device is in an available state, converting the read unread instant messaging message into voice data, and sending the voice data to the audio output device of the electronic equipment for broadcasting; starting monitoring a trigger event of a first preset key on an audio input device of the electronic equipment; in response to the monitoring of the trigger event of the first preset key, the instant messaging application client calls an audio data reading interface matched with the audio input device, and a reply voice is input through the audio input device; the instant messaging application client sends the session identification and the reply voice to a preset instant messaging application server; the preset instant messaging application server generates a voice message according to the reply voice, converts the reply voice into a text and generates a text message according to the converted text; the preset instant messaging application server encapsulates the generated voice message and text message into a unified message body, sends the unified message body to the instant messaging application client associated with the session identifier, and replies the read unread instant messaging message, so that the convenience of reading and sending the instant messaging message can be improved.
The foregoing description is only an overview of the technical solutions of the present application, and the present application can be implemented according to the content of the description in order to make the technical means of the present application more clearly understood, and the following detailed description of the present application is given in order to make the above and other objects, features, and advantages of the present application more clearly understandable.
Drawings
In order to make the objects, technical solutions and advantages of the embodiments of the present application clearer, the technical solutions in the embodiments of the present application will be clearly and completely described below with reference to the drawings in the embodiments of the present application, and it is obvious that the described embodiments are some embodiments of the present application, but not all embodiments. All other embodiments, which can be derived by a person skilled in the art from the embodiments given herein without making any creative effort, shall fall within the protection scope of the present application.
Fig. 1 is a flowchart of a method for reading and replying an instant messaging message according to a first embodiment of the present application;
fig. 2 is a schematic structural diagram of an application system of a method for reading and replying an instant messaging message according to a first embodiment of the present application;
fig. 3 is a schematic structural diagram of an instant messaging message reading and replying device according to a second embodiment of the present application;
fig. 4 is a second schematic structural diagram of an instant messaging message reading and replying device according to a second embodiment of the present application;
FIG. 5 schematically shows a block diagram of an electronic device for performing a method according to the present application; and
fig. 6 schematically shows a storage unit for holding or carrying program code implementing a method according to the present application.
Detailed Description
The technical solutions in the embodiments of the present application will be clearly and completely described below with reference to the drawings in the embodiments of the present application, and it is obvious that the described embodiments are some, but not all, embodiments of the present application. All other embodiments, which can be derived by a person skilled in the art from the embodiments given herein without making any creative effort, shall fall within the protection scope of the present application.
Example one
As shown in fig. 1, a method for reading and replying an instant messaging message disclosed in an embodiment of the present application includes: step 110 to step 180.
Step 110, the instant messaging application client reads an unread instant messaging message and a session identifier associated with the unread instant messaging message.
The method for reading and replying instant messaging messages in the embodiment of the application is applied to a message processing system shown in fig. 2, and the message processing system comprises: the instant messaging system comprises an electronic device 210, an audio output device 220 and an audio input device 230, wherein the electronic device 210 runs an instant messaging application client 2101, and the audio output device 220 and the audio input device 230 can be the same device or different devices. For example, the audio output device 220 and the audio input device 230 are bluetooth headsets or bluetooth speakers with voice input function; alternatively, the audio output device 220 is a sound box, and the audio input device 230 is a bluetooth headset with a voice input function.
The electronic device in the embodiment of the application can be a smart phone, a meal ordering terminal, a tablet personal computer and other devices, and an instant messaging application client for receiving meal ordering information or product order information runs on the electronic device. Through the instant messaging application client, a merchant can receive order information of a customer and have a conversation with the customer or an order information sending platform.
In some embodiments of the present application, the instant messaging message reading and replying method can be applied to the instant messaging application, and an improvement is made to the instant messaging application in the prior art. In other embodiments of the present application, the instant messaging message reading and replying method may be implemented as a plug-in on an electronic device running the instant messaging application, and the instant messaging message is acquired and input by performing interface call with the instant messaging application. A person skilled in the art can also implement the instant messaging message reading and replying method disclosed in the embodiments of the present application in other ways without creative work, and all effects of conveniently reading and replying an unread instant messaging message in an instant messaging application can be achieved, and all the effects are within the protection scope of the present patent.
In order to facilitate the reader to understand the technical solution of the present application, a specific implementation of the instant messaging message reading and replying method disclosed in the present application is described in detail below, taking a takeaway ordering client obtained by improving the instant messaging application in the prior art as an example. The electronic equipment can be a food ordering terminal of a merchant, and the instant messaging application client running on the electronic equipment is a merchant side client of a food ordering application.
In some embodiments of the present application, an unread session message queue may be pre-established, and then, the instant messaging messages unread by the merchant in the instant messaging messages received by the merchant-side client of the ordering application running on the ordering terminal are sequentially stored in the unread session message queue according to the receiving time sequence. Associating data stored in the unread session message queue with each unread instant communication message further comprises: the conversation identification of the conversation to which the unread instant messaging message belongs, and order information associated with the unread instant messaging message, wherein the order information comprises information such as customer identification and order content. And in the running process of the instant messaging application, obtaining the unread instant messaging message in real time through the unread session message queue.
In specific implementation, the instant messaging application reads and processes one unread instant messaging message each time. And after the processing is finished, reading the next unread instant messaging message until no unread instant messaging message exists in the unread session message queue.
In some embodiments of the present application, after an unread instant message is read from the unread session message queue, the unread session message queue may be blocked, and only after a processing result of the fetched instant message is returned, the next unread instant message may be read, so as to avoid a situation that broadcast is disordered due to simultaneous processing of two messages.
In some embodiments of the present application, the reading an unread instant message by the instant messaging application client includes: the instant messaging application client reads an unread instant messaging message in sequence according to the sequence of receiving and reading first; and/or the instant messaging application client preferentially reads an unread instant messaging message associated with the conversation identifier read last time according to the sequence of receiving the unread instant messaging message first.
For example, when the instant messaging application client determines that the unread session message queue includes multiple unread session messages, the instant messaging application client preferentially reads the session messages received first according to the receiving time sequence of the unread session messages to perform automatic voice broadcast.
In other embodiments of the present application, in order to improve the efficiency of processing the session messages, when determining that the unread session message queue includes multiple unread session messages, the instant communication application client may continuously process the multiple unread session messages of the same session. For example, after the instant messaging application client preferentially reads the session Message1 received first to perform automatic voice broadcast according to the receiving time sequence of the unread session Message, and completes voice reply or abandons the reply, the instant messaging application client next traverses the session messages belonging to the same session (i.e. having the same session identifier) as the session Message1 in the unread session Message queue, and preferentially reads one session Message received first to perform automatic voice broadcast according to the receiving time sequence of the session messages belonging to the same session as the session Message 1.
Step 120, the instant messaging application client obtains and runs the state information of the audio output device of the electronic equipment of the instant messaging application client by calling a system interface.
The audio output device may be a bluetooth headset, a bluetooth speaker, or other audio output devices.
In some embodiments of the present application, the state of the audio output device of the electronic device may be obtained by calling the system interface. For different operating systems, the called system interfaces are different, please refer to the prior art. The acquired state of the audio output device is used to indicate whether the audio output device of the electronic apparatus can be normally connected, whether the audio output device is in an idle state, application attribute information of the audio output device being used, and the like.
Taking the audio output device as a bluetooth headset as an example, the access state of the bluetooth headset can be acquired by creating a connection state monitor of the bluetooth device, and when the bluetooth headset is connected and disconnected, the state monitor receives corresponding monitoring events, so as to acquire the state information of the bluetooth headset in the access state.
Step 130, in response to the state information indicating that the audio output device is in an available state, converting the read unread instant messaging message into voice data, and sending the voice data to the audio output device of the electronic device for broadcasting.
Further, the instant messaging application client determines whether the audio output device is in an available state according to the acquired state information of the audio output device. For example, when the audio output device is in an idle state, determining that the audio output device is in an available state; when the audio output device is in a call application use state, determining that the audio output device is in an unavailable state.
In some embodiments of the application, when it is determined that the state information indicates that the audio output device is in the available state, the read unread instant messaging message is converted into voice data, and then the converted voice data is sent to the audio output device of the electronic device for broadcasting according to a calling interface of the audio output device.
Typically, the unread instant message messages in the unread session message queue are stored in text form. When the method is implemented specifically, when an unread instant messaging message is obtained, the unread instant messaging message needs to be converted into voice data to broadcast to merchants, so that the problem that ordering information of customers cannot be obtained in time due to the fact that the instant messaging application client is not browsed for no time in busy hours is avoided.
In the prior art, when a user reads an instant messaging message by browsing an instant messaging application client, the user can generally obtain related additional information, and a merchant determines whether to respond to the instant messaging message preferentially or not according to the additional information. For example, the tag of the sender of the instant message identifies the customer as a VIP customer or a new customer, and the merchant determines whether to prioritize the order carried in the instant message based on the additional information. In order to make up for the defects that only text content information in the broadcast instant messaging message is not comprehensive enough, the message identification degree is not high, and a merchant is not convenient to accurately process the unread instant messaging message, in some embodiments of the present application, the unread instant messaging message to be read is converted into voice data, and the voice data is sent to an audio output device of the electronic device for broadcast, including: obtaining order information associated with the unread instant messaging message; integrating the order information and the unread instant messaging message to obtain playing information; and converting the playing information into voice data, and sending the voice data to an audio output device of the electronic equipment for broadcasting.
In the unread session message queue, information such as order identification, customer identification and the like is stored in association with each unread instant communication message. When an unread instant messaging message is read, the order information stored in association with the instant messaging message is read at the same time. Wherein the order information includes, but is not limited to, any one or more of the following: order number, order content, customer identification, customer label, information feedback time limit description, and the like. And then, the instant messaging application client splices the order information and the message content of the unread instant messaging message to obtain a piece of broadcast information for subsequent voice broadcast. For example, the message content of the original unread instant messaging message is: "just click a single take-out and ask for when the meal can be completed? "after the unread instant messaging message and the associated order information are spliced, the obtained broadcast information may be: "three VIP customers, order content: one part of boiled fish, one part of boiled lettuce and one part of cooked rice leave a message, and ask for the time for the completion of the meal when the person just clicks a bill for taking out. Therefore, after the unread instant messaging message and the associated order information are integrated, the obtained broadcast information is used for voice broadcast, and a merchant can conveniently obtain more comprehensive information.
In some embodiments of the present application, the unread instant message may be converted into voice data by calling a text-to-voice service or a text-to-voice interface in the prior art. Alternatively, the unread instant message is converted into voice data by other methods. The present application is not limited to the specific implementation of converting text information into voice data.
Step 140, starting a trigger event monitor of a first preset key on an audio input device of the electronic device.
In some embodiments of the application, will voice data send to after the audio output device that electronic equipment connects carries out voice broadcast, instant messaging application client can be right voice data's broadcast time is timed, and after voice data has reported, through the audio input device that electronic equipment connects acquires to reporting voice data's reply pronunciation.
In some embodiments of the application, the reply voice of the voice data to be broadcasted is acquired through the audio input device connected to the electronic device, and it is first necessary to detect an operation that a user starts recording the reply voice.
For example, after the instant messaging application client sends the voice data to the audio output device for broadcasting, a first preset trigger operation of a user on the audio input device connected to the electronic equipment is started to be detected, where the first preset trigger operation is used to instruct to start recording voice. In some embodiments of the present application, initiating monitoring of a triggering event of a first preset key on an audio input device of the electronic device includes: monitoring a trigger event of a user to the audio input device indicating a pause playing key or an indication recording start key, wherein the audio input device includes but is not limited to: bluetooth headset, bluetooth intelligence wearing equipment, bluetooth speaker, plug wire earphone. Taking an audio input device in a connection state with the electronic device as an example, taking a bluetooth headset as an audio input device, after an instant messaging application client sends the voice data to the audio output device for broadcasting, the instant messaging application client registers a monitoring event by calling a system interface, so that the operation of detecting that a play pause key of the bluetooth headset is pressed down in real time can be realized. After the play pause key of the bluetooth headset is pressed, the instant messaging application client receives a trigger event of a first preset key on the audio input device, and accordingly determines that a user is ready to perform voice reply on played voice data.
In order to improve the processing efficiency of the unread instant messaging message, a delay time can be preset to control the feedback time limit of the voice data broadcasted by the user. In some embodiments of the present application, after the triggering event monitoring on the first preset key on the audio input device of the electronic device is started, the method further includes: performing time delay and timing on the trigger event; according to the time delay result, outputting a prompt voice indicating to give up replying the unread instant messaging message, and skipping to the step that the instant messaging application client reads the unread instant messaging message and a session identifier associated with the unread instant messaging message; or monitoring a trigger event of the first preset key.
For example, the instant messaging application client starts monitoring a trigger event of a first preset key on an audio input device of the electronic device and starts timing feedback operation of a merchant after determining that the voice data is completely broadcasted according to the playing duration of the voice data. If the instant messaging application client does not monitor the trigger event of the first preset key on the audio input device within the preset delay time, namely the merchant does not trigger the operation of starting to record voice, the merchant is considered to abandon the reply of the voice data, namely the merchant is determined to abandon the reply of the obtained unread instant messaging message; if the instant messaging application client monitors a trigger event of a first preset key on an audio input device within a preset delay time, namely, a merchant triggers an operation of starting to record voice, the instant messaging application client starts a recording module to record voice through the audio input device connected with the electronic equipment, and the recorded voice data is used as reply voice for replying the voice data, namely, the merchant is determined to reply the acquired reply voice of the unread instant messaging message.
In some embodiments of the application, if the operation of triggering recording and replying voice is not obtained within the preset delay time, the information of giving up replying the current unread instant messaging message, such as "you have given up replying the current unread instant messaging message", is broadcasted to the merchant.
At this point, when the processing of the current unread instant messaging message is finished, the instant messaging application may continue to determine whether there are unread instant messaging messages in the session message queue, and if so, go to step 110, and take one unread instant messaging message in sequence for processing.
Step 150, in response to the monitoring of the trigger event of the first preset key, the instant messaging application client calls an audio data reading interface matched with the audio input device, and records reply voice through the audio input device.
And after a triggering event of the first preset key is monitored, namely the operation of triggering recording reply voice by a user is obtained, starting recording through an audio input device of the instant messaging application client.
In some embodiments of the present application, whether to end recording may be determined according to the discontinuity of the audio stream transmitted by the audio input device. For example, in the process of acquiring the audio stream output by the audio input device at the instant messaging application client, if the audio stream output by the audio input device is not acquired for 10 seconds continuously, it may be considered that the merchant has finished the voice reply, and the acquired audio streams are sequentially spliced into the reply voice.
In some embodiments of the present application, whether to end recording may be determined according to the recording duration. For example, in the process of acquiring an audio stream output by an audio input device at an instant messaging application client, if the recording duration of a received video stream exceeds 1 minute, recording of an answering voice is finished, and the acquired audio streams are sequentially spliced into the answering voice.
In some embodiments of the application, whether to end recording may be determined according to a triggering operation of the second preset key by the merchant (for example, after the key for acquiring the bluetooth headset and indicating to start recording is released or the key for indicating to stop recording is triggered). For example, the instant messaging application client calls an audio data reading interface matched with the audio input device, and records reply voice through the audio input device, including: the instant messaging application client starts timing of the reply voice recording time length and starts monitoring of a trigger event of a second preset key on an audio input device of the electronic equipment; the instant messaging application client circularly calls an audio data reading interface matched with the audio input device to obtain an audio stream recorded by the audio input device; in the process of circularly calling the audio data reading interface matched with the audio input device, the instant communication application client executes the following operations: in response to that the timing result of the reply voice recording duration meets the preset duration, stopping calling an audio data reading interface matched with the audio input device, and splicing the acquired audio streams into reply voices in sequence; or, in response to monitoring a trigger event to a second preset key on an audio input device of the electronic equipment, stopping calling an audio data reading interface matched with the audio input device, and sequentially splicing the acquired audio streams into reply voice.
For example, the instant messaging application client monitors the triggering operation of a second preset key on the audio input device of the electronic equipment by registering and monitoring the triggering time of the second preset key on the audio input device. In order to avoid the problem that the recording time of the reply voice is too long, the recording time duration can be started simultaneously and is real-time. And then, the instant messaging application client starts the operation of receiving the audio stream through the audio input device and starts the process of recording the reply voice. In the process of recording the reply voice, the instant messaging application client judges the recording duration in real time, stops recording the reply voice when the recording duration reaches a preset threshold value, and sequentially splices the acquired audio streams into the reply voice.
If the instant messaging application client monitors a trigger event of a second preset key on an audio input device of the electronic equipment in the recording process, stopping calling an audio data reading interface matched with the audio input device, and splicing the acquired audio streams into reply voice in sequence
After stopping recording the reply voice, the instant messaging application saves the voice data that has been recorded as the reply voice for the voice data that is played (i.e., the unread instant messaging message that is currently processed).
Step 160, the instant messaging application client sends the session identifier and the reply voice to a preset instant messaging application server.
After the instant messaging application client acquires the reply voice aiming at the current automatically played session message, packaging the reply voice, the session identifier of the session message aiming at the reply voice and the current login user identifier of the instant messaging application client (namely the user identifier of the reply voice sending user) into instant messaging message data to be sent, and sending the instant messaging message data to a preset instant messaging application server.
Step 170, the preset instant messaging application server generates a voice message according to the reply voice, converts the reply voice into a text and generates a text message according to the converted text.
After receiving instant messaging message data sent by an instant messaging application client, the preset instant messaging application server analyzes the instant messaging message data to obtain reply voice included in the instant messaging message data, then stores the reply voice, and generates a voice message according to a storage address of the reply voice. And simultaneously, the preset instant messaging application server converts the reply voice obtained by analysis into a text, and generates a text message according to the text obtained by conversion.
Step 180, the preset instant messaging application server encapsulates the generated voice message and text message into a unified message body, and sends the unified message body to the instant messaging application client associated with the session identifier, so as to reply to the read unread instant messaging message.
And then, the preset instant messaging application server generates a unified message body according to the voice message and the text message generated in the previous step and a preset format. Wherein, the unified message body comprises: a field carrying the text message, a field carrying the download address of the voice message, and a message type field indicating that the unified message body includes the voice message and the text message.
Further, the preset instant messaging application server may further obtain the session identifier associated with the reply voice by analyzing the instant messaging message data, and the preset instant messaging application server further issues the unified message body to the instant messaging application client associated with the session identifier, so as to reply to the read unread instant messaging message.
In some embodiments of the present application, a message body format of an existing instant messaging message may be improved, so that a message body includes two types of messages, namely a text message and a voice message, and meanwhile, a tag is set for the message body to identify that the message requires displaying both the text message and the voice message in a client page.
In some embodiments of the present application, the encapsulating, by the preset instant messaging application server, the generated voice message and text message into a unified message body, sending the unified message body to the instant messaging application client associated with the session identifier, and after replying to the read unread instant messaging message, further includes: the instant messaging application client analyzes the received unified message body and determines the message type matched with the unified message body; and responding to the message type to indicate that the unified message body comprises the voice message and the text message, displaying the text message, downloading the voice message through the download address and displaying the voice message. For example, after receiving an instant messaging message, the client of the instant messaging application parses the received message body according to the above format, and if a tag that displays both voice and text is parsed, further extracts the text message and the voice message from the message body and displays them on the page of the instant messaging application client, respectively. By displaying the reply voice and the corresponding text content at the same time, the user can conveniently acquire the reply message in various ways, and message errors caused by inaccurate conversion results when the recovered voice is converted into the text are avoided.
In some embodiments of the present application, after the instant messaging application client sends the session identifier and the reply voice to a preset instant messaging application server, the method further includes: and the instant messaging application client receives the information which is returned by the preset instant messaging application server and indicates that the reply voice is successfully sent, plays prompt information indicating that the voice reply is successful, and jumps to the step that the instant messaging application client reads an unread instant messaging message and a session identifier associated with the unread instant messaging message. For example, after the preset instant messaging application server encapsulates the generated voice message and text message into a unified message body and successfully issues the unified message body to the instant messaging application client associated with the session identifier, the preset instant messaging application server returns information indicating that the sending of the reply voice is successful to the instant messaging application client sending the reply voice, where the information includes the session identifier associated with the reply voice. Further, after the instant messaging application client sending the reply voice receives feedback information indicating that the reply voice is successfully sent, a nickname of a conversation partner (such as a customer), or order information and the like can be further determined according to a conversation identifier contained in the feedback information, and prompt information indicating that the voice reply is successful is played to a merchant, wherein the prompt information indicating that the voice reply is successful includes the conversation partner information (such as a nickname) and/or order information (such as an order number) targeted by the reply voice, so that the merchant can confirm the conversation message that has been successfully replied.
The method for reading and replying the instant messaging message, disclosed by the embodiment of the application, comprises the steps of reading an unread instant messaging message and a session identifier associated with the unread instant messaging message through an instant messaging application client; the instant messaging application client acquires and runs the state information of an audio output device of the electronic equipment of the instant messaging application client by calling a system interface; responding to the state information to indicate that the audio output device is in an available state, converting the read unread instant messaging message into voice data, and sending the voice data to the audio output device of the electronic equipment for broadcasting; starting monitoring a trigger event of a first preset key on an audio input device of the electronic equipment; in response to the monitoring of the trigger event of the first preset key, the instant messaging application client calls an audio data reading interface matched with the audio input device, and a reply voice is input through the audio input device; the instant messaging application client sends the session identification and the reply voice to a preset instant messaging application server; the preset instant messaging application server generates a voice message according to the reply voice, converts the reply voice into a text and generates a text message according to the converted text; the preset instant messaging application server encapsulates the generated voice message and text message into a unified message body, sends the unified message body to the instant messaging application client associated with the session identifier, and replies the read unread instant messaging message, so that the convenience of reading and sending the instant messaging message can be improved.
The instant messaging message reading and replying method disclosed by the embodiment of the application automatically reads the unread instant messaging message, an instant messaging application client does not need to be opened, the instant messaging message can be quickly replied only by operating the key for starting and/or stopping recording the reply voice of the audio input device by a user, the instant messaging message can be quickly read and replied only by pressing the recording starting key at least once, the message is not needed to be read by eyes, eyes and hands are liberated, and the convenience for reading and sending the instant messaging message is effectively improved. Moreover, when the conversation participants browse the conversation messages in a flawless way, the instant communication messages can be read and replied in time by the instant communication message reading and replying method disclosed by the embodiment of the application, so that the instant communication efficiency is improved, and the conversation experience of the user is improved.
Example two
An instant messaging message reading and replying device disclosed in an embodiment of the present application, as shown in fig. 3, the device includes:
a message reading module 310, configured to read an unread instant message and a session identifier associated with the unread instant message by an instant messaging application client;
an audio output device state obtaining module 320, configured to obtain, by the instant messaging application client, state information of an audio output device of the electronic device running the instant messaging application client by calling a system interface;
the voice broadcasting module 330 is configured to respond to that the status information indicates that the audio output device is in an available status, convert the read unread instant messaging message into voice data, and send the voice data to the audio output device of the electronic device for broadcasting;
the key monitoring module 340 is configured to start triggering event monitoring on a first preset key on an audio input device of the electronic device;
the reply voice recording module 350 is configured to, in response to monitoring the trigger event of the first preset key, invoke an audio data reading interface matched with the audio input device by the instant messaging application client, and record a reply voice through the audio input device;
a reply voice sending module 360, configured to send the session identifier and the reply voice to a preset instant messaging application server by the instant messaging application client;
a reply message generation module 370, configured to generate, by the preset instant messaging application server, a voice message according to the reply voice, convert, by the preset instant messaging application server, the reply voice into a text, and generate a text message according to the text obtained by conversion;
a reply message sending module 380, configured to encapsulate the generated voice message and text message into a unified message body by the preset instant messaging application server, send the unified message body to the instant messaging application client associated with the session identifier, and reply to the read unread instant messaging message; wherein, the unified message body comprises: a field carrying the text message, a field carrying the download address of the voice message, and a message type field indicating that the unified message body includes the voice message and the text message.
In some embodiments of the present application, as shown in fig. 4, the apparatus further comprises:
a reply information display module 390, configured to analyze the received unified message body by the instant messaging application client, and determine a message type matched with the unified message body; and the number of the first and second groups,
and responding to the message type to indicate that the unified message body comprises the voice message and the text message, displaying the text message, downloading the voice message through the download address and displaying the voice message.
In some embodiments of the present application, the voice broadcast module 330 is further configured to:
obtaining order information associated with the unread instant messaging message;
integrating the order information and the unread instant messaging message to obtain playing information;
and converting the playing information into voice data, and sending the voice data to an audio output device of the electronic equipment for broadcasting.
In some embodiments of the present application, as shown in fig. 4, the apparatus further comprises:
the first recovery processing module 3401 is configured to perform time delay timing on a trigger event after monitoring of the trigger event of a first preset key on an audio input device of the electronic device is started; and the number of the first and second groups,
according to the time delay result, outputting a prompt voice indicating to give up replying the unread instant messaging message, and skipping to the step that the instant messaging application client reads the unread instant messaging message and a session identifier associated with the unread instant messaging message; or monitoring a trigger event of the first preset key.
In some embodiments of the present application, as shown in fig. 4, the apparatus further comprises:
a second reply processing module 3601, configured to, after the instant messaging application client sends the session identifier and the reply voice to a preset instant messaging application server, receive, by the instant messaging application client, information that indicates that the reply voice is sent successfully and is returned by the preset instant messaging application server, play a prompt message that indicates that the voice reply is successful, and jump to a step in which the instant messaging application client reads an unread instant messaging message and a session identifier associated with the unread instant messaging message.
In some embodiments of the present application, the reading an unread instant message by the instant messaging application client includes:
the instant messaging application client reads an unread instant messaging message in sequence according to the sequence of receiving and reading first; and/or the presence of a gas in the gas,
and the instant messaging application client preferentially reads an unread instant messaging message associated with the conversation identifier read last time according to the sequence of receiving the unread instant messaging message first.
In some embodiments of the present application, the key monitor module 340 is further configured to:
monitoring a trigger event of a user for indicating a play pause key or a recording start key on the audio input device; wherein the audio input device includes: bluetooth headset, bluetooth intelligence wearing equipment, bluetooth speaker, plug wire earphone.
In some embodiments of the present application, the reply voice recording module 350 is further configured to:
the instant messaging application client starts timing of the reply voice recording time length and starts monitoring of a trigger event of a second preset key on an audio input device of the electronic equipment;
the instant messaging application client circularly calls an audio data reading interface matched with the audio input device to obtain an audio stream recorded by the audio input device;
in the process of circularly calling the audio data reading interface matched with the audio input device, the instant communication application client executes the following operations:
in response to that the timing result of the reply voice recording duration meets the preset duration, stopping calling an audio data reading interface matched with the audio input device, and splicing the acquired audio streams into reply voices in sequence; alternatively, the first and second electrodes may be,
in response to the monitoring of the triggering event of a second preset key on the audio input device of the electronic equipment, stopping calling the audio data reading interface matched with the audio input device, and splicing the acquired audio streams into reply voice in sequence
The device for reading and replying an instant messaging message disclosed in the embodiment of the present application is used for implementing the method for reading and replying an instant messaging message described in the first embodiment of the present application, and specific implementation manners of each module of the device are not described again, and reference may be made to specific implementation manners of corresponding steps in the method embodiment.
The reading and replying device for the instant messaging message, disclosed by the embodiment of the application, reads an unread instant messaging message and a session identifier associated with the unread instant messaging message through an instant messaging application client; the instant messaging application client acquires and runs the state information of an audio output device of the electronic equipment of the instant messaging application client by calling a system interface; responding to the state information to indicate that the audio output device is in an available state, converting the read unread instant messaging message into voice data, and sending the voice data to the audio output device of the electronic equipment for broadcasting; starting monitoring a trigger event of a first preset key on an audio input device of the electronic equipment; in response to the monitoring of the trigger event of the first preset key, the instant messaging application client calls an audio data reading interface matched with the audio input device, and a reply voice is input through the audio input device; the instant messaging application client sends the session identification and the reply voice to a preset instant messaging application server; the preset instant messaging application server generates a voice message according to the reply voice, converts the reply voice into a text and generates a text message according to the converted text; the preset instant messaging application server encapsulates the generated voice message and text message into a unified message body, sends the unified message body to the instant messaging application client associated with the session identifier, and replies the read unread instant messaging message, so that the convenience of reading and sending the instant messaging message can be improved.
The reading and replying device of the instant messaging message, automatically read the unread instant messaging message, an instant messaging application client does not need to be opened, and the instant messaging message can be quickly replied only by operating the key of the audio input device for starting and/or stopping recording the reply voice by a user, at least, the recording starting key needs to be pressed down once, so that the instant messaging message can be quickly read and replied, the message does not need to be read by eyes, eyes and hands are liberated, and the convenience of reading and sending the instant messaging message is effectively improved. Moreover, when the conversation participants browse the conversation messages in a flawless way, the instant communication messages can be read and replied in time through the instant communication message reading and replying device disclosed by the embodiment of the application, so that the instant communication efficiency is improved, and the conversation experience of the user is improved.
The embodiments in the present specification are described in a progressive manner, each embodiment focuses on differences from other embodiments, and the same and similar parts among the embodiments are referred to each other. For the device embodiment, since it is basically similar to the method embodiment, the description is simple, and for the relevant points, refer to the partial description of the method embodiment.
The above detailed description is made on a method and a device for reading and replying an instant messaging message provided by the present application, and a specific example is applied in the present application to explain the principle and the implementation manner of the present application, and the description of the above embodiment is only used to help understanding the method and a core idea of the present application; meanwhile, for a person skilled in the art, according to the idea of the present application, there may be variations in the specific embodiments and the application scope, and in summary, the content of the present specification should not be construed as a limitation to the present application.
The above-described embodiments of the apparatus are merely illustrative, and the units described as separate parts may or may not be physically separate, and parts displayed as units may or may not be physical units, may be located in one place, or may be distributed on a plurality of network units. Some or all of the modules may be selected according to actual needs to achieve the purpose of the solution of the present embodiment. One of ordinary skill in the art can understand and implement it without inventive effort.
The various component embodiments of the present application may be implemented in hardware, or in software modules running on one or more processors, or in a combination thereof. Those skilled in the art will appreciate that a microprocessor or Digital Signal Processor (DSP) may be used in practice to implement some or all of the functionality of some or all of the components in an electronic device according to embodiments of the present application. The present application may also be embodied as apparatus or device programs (e.g., computer programs and computer program products) for performing a portion or all of the methods described herein. Such programs implementing the present application may be stored on a computer readable medium or may be in the form of one or more signals. Such a signal may be downloaded from an internet website or provided on a carrier signal or in any other form.
For example, fig. 5 shows an electronic device that may implement a method according to the present application. The electronic device can be a PC, a mobile terminal, a personal digital assistant, a tablet computer and the like. The electronic device conventionally comprises a processor 510 and a memory 520, and program code 530 stored on said memory 520 and executable on the processor 510, said processor 510 implementing the method described in the above embodiments when executing said program code 530. The memory 520 may be a computer program product or a computer readable medium. The memory 520 may be an electronic memory such as a flash memory, an EEPROM (electrically erasable programmable read only memory), an EPROM, a hard disk, or a ROM. The memory 520 has a storage space 5201 for program code 530 of the computer program for performing any of the method steps of the above-described method. For example, the storage space 5201 for the program code 530 may include respective computer programs for implementing the respective steps in the above methods. The program code 530 is computer readable code. The computer programs may be read from or written to one or more computer program products. These computer program products comprise a program code carrier such as a hard disk, a Compact Disc (CD), a memory card or a floppy disk. The computer program comprises computer readable code which, when run on an electronic device, causes the electronic device to perform the method according to the above embodiments.
The embodiment of the present application also discloses a computer readable storage medium, on which a computer program is stored, which when executed by a processor, implements the steps of the instant communication message reading and replying method according to the first embodiment of the present application.
Such a computer program product may be a computer-readable storage medium that may have memory segments, memory spaces, etc. arranged similarly to the memory 520 in the electronic device shown in fig. 5. The program code may be stored in a computer readable storage medium, for example, compressed in a suitable form. The computer readable storage medium is typically a portable or fixed storage unit as described with reference to fig. 6. Typically, the storage unit comprises computer readable code 530 ', said computer readable code 530' being code read by a processor, which when executed by the processor, performs the steps of the method described above.
Reference herein to "one embodiment," "an embodiment," or "one or more embodiments" means that a particular feature, structure, or characteristic described in connection with the embodiment is included in at least one embodiment of the present application. Moreover, it is noted that instances of the word "in one embodiment" are not necessarily all referring to the same embodiment.
In the description provided herein, numerous specific details are set forth. However, it is understood that embodiments of the application may be practiced without these specific details. In some instances, well-known methods, structures and techniques have not been shown in detail in order not to obscure an understanding of this description.
In the claims, any reference signs placed between parentheses shall not be construed as limiting the claim. The word "comprising" does not exclude the presence of elements or steps not listed in a claim. The word "a" or "an" preceding an element does not exclude the presence of a plurality of such elements. The application may be implemented by means of hardware comprising several distinct elements, and by means of a suitably programmed computer. In the unit claims enumerating several means, several of these means may be embodied by one and the same item of hardware. The usage of the words first, second and third, etcetera do not indicate any ordering. These words may be interpreted as names.
Finally, it should be noted that: the above embodiments are only used to illustrate the technical solutions of the present application, and not to limit the same; although the present application has been described in detail with reference to the foregoing embodiments, it should be understood by those of ordinary skill in the art that: the technical solutions described in the foregoing embodiments may still be modified, or some technical features may be equivalently replaced; and such modifications or substitutions do not depart from the spirit and scope of the corresponding technical solutions in the embodiments of the present application.

Claims (12)

1. A method for reading and replying to an instant messaging message, comprising:
the instant messaging application client reads an unread instant messaging message and a session identifier associated with the unread instant messaging message;
the instant messaging application client acquires and runs the state information of an audio output device of the electronic equipment of the instant messaging application client by calling a system interface;
responding to the state information to indicate that the audio output device is in an available state, converting the read unread instant messaging message into voice data, and sending the voice data to the audio output device of the electronic equipment for broadcasting;
starting monitoring a trigger event of a first preset key on an audio input device of the electronic equipment;
in response to the monitoring of the trigger event of the first preset key, the instant messaging application client calls an audio data reading interface matched with the audio input device, and a reply voice is input through the audio input device;
the instant messaging application client sends the session identification and the reply voice to a preset instant messaging application server;
the preset instant messaging application server generates a voice message according to the reply voice, converts the reply voice into a text and generates a text message according to the converted text;
the preset instant messaging application server encapsulates the generated voice message and text message body into a unified message body, issues the unified message body to the instant messaging application client associated with the session identifier, and replies the read unread instant messaging message; wherein, the unified message body comprises: a field carrying the text message, a field carrying the download address of the voice message, and a message type field indicating that the unified message body includes the voice message and the text message.
2. The method according to claim 1, wherein the preset instant messaging application server encapsulates the generated voice message and text message into a unified message body, sends the unified message body to the instant messaging application client associated with the session identifier, and replies to the read unread instant messaging message, and thereafter, further comprising:
the instant messaging application client analyzes the received unified message body and determines the message type matched with the unified message body;
and responding to the message type to indicate that the unified message body comprises the voice message and the text message, displaying the text message, downloading the voice message through the download address and displaying the voice message.
3. The method according to claim 1 or 2, wherein the step of converting the read unread instant message into voice data and sending the voice data to an audio output device of the electronic device for broadcasting comprises:
obtaining order information associated with the unread instant messaging message;
integrating the order information and the unread instant messaging message to obtain playing information;
and converting the playing information into voice data, and sending the voice data to an audio output device of the electronic equipment for broadcasting.
4. The method according to claim 1 or 2, wherein the step of initiating the monitoring of the triggering event of the first preset key on the audio input device of the electronic equipment further comprises:
performing time delay and timing on the trigger event;
according to the time delay result, outputting a prompt voice indicating to give up replying the unread instant messaging message, and skipping to the step that the instant messaging application client reads the unread instant messaging message and a session identifier associated with the unread instant messaging message; or monitoring a trigger event of the first preset key.
5. The method according to claim 1 or 2, wherein after the step of sending the session identifier and the reply voice to a preset instant messaging application server by the instant messaging application client, the method further comprises:
and the instant messaging application client receives the information which is returned by the preset instant messaging application server and indicates that the reply voice is successfully sent, plays prompt information indicating that the voice reply is successful, and jumps to the step that the instant messaging application client reads an unread instant messaging message and a session identifier associated with the unread instant messaging message.
6. The method according to claim 1 or 2, wherein the step of reading an unread instant message by the instant messaging application client comprises:
the instant messaging application client reads an unread instant messaging message in sequence according to the sequence of receiving and reading first; and/or the presence of a gas in the gas,
and the instant messaging application client preferentially reads an unread instant messaging message associated with the conversation identifier read last time according to the sequence of receiving the unread instant messaging message first.
7. The method according to claim 1 or 2, wherein the step of initiating the monitoring of the triggering event of the first preset key on the audio input device of the electronic equipment comprises:
monitoring a trigger event of a user for indicating a play pause key or a recording start key on the audio input device; wherein the audio input device includes: bluetooth headset, bluetooth intelligence wearing equipment, bluetooth speaker, plug wire earphone.
8. The method according to claim 1 or 2, wherein the instant messaging application client calls an audio data reading interface matched with the audio input device, and the step of entering reply voice through the audio input device comprises:
the instant messaging application client starts timing of the reply voice recording time length and starts monitoring of a trigger event of a second preset key on an audio input device of the electronic equipment;
the instant messaging application client circularly calls an audio data reading interface matched with the audio input device to obtain an audio stream recorded by the audio input device;
in the process of circularly calling the audio data reading interface matched with the audio input device, the instant communication application client executes the following operations:
in response to that the timing result of the reply voice recording duration meets the preset duration, stopping calling an audio data reading interface matched with the audio input device, and splicing the acquired audio streams into reply voices in sequence; alternatively, the first and second electrodes may be,
and in response to monitoring a trigger event of a second preset key on an audio input device of the electronic equipment, stopping calling an audio data reading interface matched with the audio input device, and splicing the acquired audio streams into reply voice in sequence.
9. An instant messaging message reading and replying device, comprising:
the message reading module is used for reading an unread instant messaging message and a session identifier associated with the unread instant messaging message by the instant messaging application client;
the audio output device state acquisition module is used for acquiring the state information of an audio output device of the electronic equipment running the instant messaging application client by calling a system interface by the instant messaging application client;
the voice broadcasting module is used for responding to the state information to indicate that the audio output device is in an available state, converting the read unread instant messaging message into voice data and sending the voice data to the audio output device of the electronic equipment for broadcasting;
the key monitoring module is used for starting the monitoring of the triggering event of a first preset key on the audio input device of the electronic equipment;
the reply voice recording module is used for responding to the trigger event of monitoring the first preset key, calling an audio data reading interface matched with the audio input device by the instant communication application client, and recording reply voice through the audio input device;
the reply voice sending module is used for sending the session identifier and the reply voice to a preset instant messaging application server by the instant messaging application client;
the reply message generation module is used for generating a voice message by the preset instant messaging application server according to the reply voice, converting the reply voice into a text by the preset instant messaging application server, and generating a text message according to the converted text;
a reply message sending module, configured to encapsulate the generated voice message and text message into a unified message body by the preset instant messaging application server, send the unified message body to the instant messaging application client associated with the session identifier, and reply to the read unread instant messaging message; wherein, the unified message body comprises: a field carrying the text message, a field carrying the download address of the voice message, and a message type field indicating that the unified message body includes the voice message and the text message.
10. The apparatus of claim 9, further comprising:
the reply information display module is used for analyzing the received unified message body by the instant messaging application client and determining the message type matched with the unified message body; and the number of the first and second groups,
and responding to the message type to indicate that the unified message body comprises the voice message and the text message, displaying the text message, downloading the voice message through the download address and displaying the voice message.
11. An electronic device comprising a memory, a processor and a program code stored on the memory and executable on the processor, wherein the processor implements the instant messaging message reading and replying method of any one of claims 1 to 8 when executing the program code.
12. A computer readable storage medium having stored thereon program code, characterized in that the program code realizes the steps of the method for reading and replying to instant messaging messages according to any one of claims 1 to 8 when executed by a processor.
CN202010231386.2A 2020-03-27 2020-03-27 Instant communication message reading and replying method and device and electronic equipment Pending CN111490928A (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN202010231386.2A CN111490928A (en) 2020-03-27 2020-03-27 Instant communication message reading and replying method and device and electronic equipment

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN202010231386.2A CN111490928A (en) 2020-03-27 2020-03-27 Instant communication message reading and replying method and device and electronic equipment

Publications (1)

Publication Number Publication Date
CN111490928A true CN111490928A (en) 2020-08-04

Family

ID=71810819

Family Applications (1)

Application Number Title Priority Date Filing Date
CN202010231386.2A Pending CN111490928A (en) 2020-03-27 2020-03-27 Instant communication message reading and replying method and device and electronic equipment

Country Status (1)

Country Link
CN (1) CN111490928A (en)

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN117273867A (en) * 2023-11-16 2023-12-22 浙江口碑网络技术有限公司 Information processing system, method, apparatus, electronic device, and computer storage medium

Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101378530A (en) * 2007-08-30 2009-03-04 乐金电子(中国)研究开发中心有限公司 Method and system for transmitting and receiving short message, and short message server
CN103747511A (en) * 2014-01-07 2014-04-23 衡阳加一电子科技有限公司 Message broadcasting method and system
CN105744072A (en) * 2016-03-24 2016-07-06 惠州Tcl移动通信有限公司 Information integration method and mobile terminal
CN106791015A (en) * 2016-11-29 2017-05-31 维沃移动通信有限公司 A kind of message is played and answering method and device
CN107436748A (en) * 2017-07-13 2017-12-05 普联技术有限公司 Handle method, apparatus, terminal device and the computer-readable recording medium of third-party application message

Patent Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101378530A (en) * 2007-08-30 2009-03-04 乐金电子(中国)研究开发中心有限公司 Method and system for transmitting and receiving short message, and short message server
CN103747511A (en) * 2014-01-07 2014-04-23 衡阳加一电子科技有限公司 Message broadcasting method and system
CN105744072A (en) * 2016-03-24 2016-07-06 惠州Tcl移动通信有限公司 Information integration method and mobile terminal
CN106791015A (en) * 2016-11-29 2017-05-31 维沃移动通信有限公司 A kind of message is played and answering method and device
CN107436748A (en) * 2017-07-13 2017-12-05 普联技术有限公司 Handle method, apparatus, terminal device and the computer-readable recording medium of third-party application message

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN117273867A (en) * 2023-11-16 2023-12-22 浙江口碑网络技术有限公司 Information processing system, method, apparatus, electronic device, and computer storage medium

Similar Documents

Publication Publication Date Title
CN111817943B (en) Data processing method and device based on instant messaging application
US11200899B2 (en) Voice processing method, apparatus and device
CN107436748B (en) Method and device for processing third-party application message, terminal equipment and readable medium
JP6467554B2 (en) Message transmission method, message processing method, and terminal
US8150023B2 (en) Automated system and method for distinguishing audio signals received in response to placing and outbound call
CN103905644A (en) Generating method and equipment of mobile terminal call interface
CN112073294B (en) Voice playing method and device of notification message, electronic equipment and medium
CN111629253A (en) Video processing method and device, computer readable storage medium and electronic equipment
CN110032355B (en) Voice playing method and device, terminal equipment and computer storage medium
CN108696763A (en) Advertisement broadcast method and device
WO2017172655A1 (en) Analysis of a facial image to extract physical and emotional characteristics of a user
WO2012065567A1 (en) Conversion method and apparatus of text message
CN111490928A (en) Instant communication message reading and replying method and device and electronic equipment
CN109151148B (en) Call content recording method, device, terminal and computer readable storage medium
KR101643808B1 (en) Method and system of providing voice service using interoperation between application and server
CN110018806A (en) A kind of method of speech processing and device
US7949104B1 (en) Message delivery system with echo-cancellation
CN114639392A (en) Audio processing method and device, electronic equipment and storage medium
WO2016177063A1 (en) Method, device and storage medium for synchronously acquiring intelligent terminal information by speech customer service
CN113852835A (en) Live broadcast audio processing method and device, electronic equipment and storage medium
CN106168755A (en) A kind of intelligent alarm clock implementation method
CN110265031A (en) A kind of method of speech processing and device
CN111314557B (en) Information processing method and device
CN113873085B (en) Voice start-up white generation method and related device
CN111064844A (en) Message prompting method and device, electronic equipment and computer readable medium

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
RJ01 Rejection of invention patent application after publication
RJ01 Rejection of invention patent application after publication

Application publication date: 20200804