CN107436748B - Method and device for processing third-party application message, terminal equipment and readable medium - Google Patents
Method and device for processing third-party application message, terminal equipment and readable medium Download PDFInfo
- Publication number
- CN107436748B CN107436748B CN201710572639.0A CN201710572639A CN107436748B CN 107436748 B CN107436748 B CN 107436748B CN 201710572639 A CN201710572639 A CN 201710572639A CN 107436748 B CN107436748 B CN 107436748B
- Authority
- CN
- China
- Prior art keywords
- message
- voice
- party application
- display interface
- calling
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Expired - Fee Related
Links
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/16—Sound input; Sound output
- G06F3/167—Audio in a user interface, e.g. using voice commands for navigating, audio feedback
Landscapes
- Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- Multimedia (AREA)
- Health & Medical Sciences (AREA)
- Audiology, Speech & Language Pathology (AREA)
- General Health & Medical Sciences (AREA)
- Human Computer Interaction (AREA)
- Physics & Mathematics (AREA)
- General Engineering & Computer Science (AREA)
- General Physics & Mathematics (AREA)
- Telephone Function (AREA)
Abstract
The invention discloses a method for processing third-party application messages, which comprises the following steps: sending a voice prompt whether to answer the message or not after monitoring the message from the third-party application; when receiving a voice instruction for confirming answering, calling a system notification service to acquire the content of the message; when the type of the content of the message is judged to be a voice message, opening a display interface of the voice message, and acquiring the position of the voice message on the display interface according to a pre-stored layout library; the pre-stored layout library is used for storing layout information of interface operation controls of third-party applications; and simulating clicking the position to play the voice message. The invention also discloses a device, terminal equipment and a readable medium for processing the third-party application message, which can quickly, safely and efficiently finish the processing of important information on the premise of not contacting the mobile terminal.
Description
Technical Field
The present invention relates to the field of mobile terminals, and in particular, to a method and an apparatus for processing a third-party application message, a terminal device, and a readable medium.
Background
In some scenarios, such as driving, running, etc., a user may have some important messages with strong instantaneity that need to be processed quickly, such as short messages, telephone calls, important social application messages, etc., but due to the limitation of the scenario, the user cannot vacate hands and can only delay processing, or some users can process messages with one mind and one side, but this may cause a serious safety hazard. In the existing driving mode, when a call or a short message comes, a corresponding voice prompt is provided, and related operations such as answering, hanging up, voice playing of a short message, callback and the like can be performed through voice, but people increasingly use third-party social software, and the existing driving mode can only process the call or the short message, but cannot process important messages of the third-party social software.
Disclosure of Invention
In view of the foregoing problems, an object of the present invention is to provide a method, an apparatus, a terminal device and a readable medium for processing a third-party application message, which can complete processing of important information quickly, safely and efficiently without contacting a mobile terminal.
The invention provides a method for processing third-party application messages, which comprises the following steps:
sending a voice prompt whether to answer the message or not after monitoring the message from the third-party application;
when receiving a voice instruction for confirming answering, calling a system notification service to acquire message content of the message;
when the type of the message content is judged to be voice message, opening a display interface of the voice message, and acquiring the position of the voice message on the display interface according to a pre-stored layout library; the pre-stored layout library is used for storing layout information of interface operation controls of third-party applications;
and simulating clicking the position to play the voice message.
Preferably, when receiving the voice instruction for confirming answering, the method for obtaining the message content of the message by invoking a system notification service specifically includes:
when receiving a voice instruction for confirming answering, judging whether the voice instruction belongs to an authorized user through voiceprint recognition;
and when the voice indication is judged to belong to the authorized user, calling a system notification service to acquire the message content of the message.
Preferably, when it is determined that the type of the message content is a voice message, opening a display interface of the voice message, and obtaining a position of the voice message on the display interface according to a pre-stored layout library specifically includes:
calling a system screen locking service to unlock a screen;
calling the system notification service to acquire a source application and a display interface of the voice message;
opening a display interface of the voice message;
acquiring layout information of the interface operation control of the source application from the pre-stored layout library according to the source application;
and acquiring the position of the voice message on the display interface according to the layout information.
Preferably, the invoking a system screen locking service to unlock the screen specifically includes:
when a screen unlocking instruction is monitored, extracting a pre-stored unlocking password from a password library;
and calling the system screen locking service to read the unlocking password unlocking screen.
Preferably, after the step of calling a system notification service to obtain the message content of the message when the voice instruction for confirming the answering is obtained, the method further comprises the following steps:
and when the type of the message content is judged to be a text message, converting the text message into voice and playing the voice.
Preferably, after the simulating clicks the position to play the voice message, the method further comprises:
sending out a voice prompt whether to reply or not;
when a voice instruction for confirming the reply is acquired, starting a recording function to receive the voice reply of the user;
converting the voice reply into text content;
acquiring positions of a reply frame and a sending button on the display interface according to the pre-stored layout library, and simulating and clicking the reply frame to copy the text content into the reply frame;
and simulating to click the sending button to send the text content.
The invention also provides a device for processing the third-party application message, which comprises the following steps:
the monitoring module is used for sending out a voice prompt for judging whether to answer the message or not after monitoring the message from the third-party application;
the service calling module is used for calling a system notification service to acquire the message content of the message when receiving a voice instruction for confirming answering;
the interface display module is used for opening a display interface of the voice message when the type of the message content is judged to be the voice message, and acquiring the position of the voice message on the display interface according to a pre-stored layout library; the pre-stored layout library is used for storing layout information of interface operation controls of third-party applications;
and the message playing module is used for simulating and clicking the position to play the voice message.
Preferably, the service invoking module is specifically:
the voice print recognition unit is used for judging whether the voice instruction belongs to an authorized user or not through voice print recognition when receiving the voice instruction for confirming answering;
and the notification service calling unit is used for calling a system notification service to acquire the message content of the message when the voice indication is judged to belong to the authorized user.
Preferably, the interface display module specifically includes:
the unlocking unit is used for calling the system screen locking service to unlock the screen;
the information acquisition unit is used for calling the system notification service to acquire a source application and a display interface of the voice message;
the interface opening unit is used for opening a display interface of the voice message;
the layout acquisition unit is used for acquiring layout information of the interface operation control of the source application from the pre-stored layout library according to the source application;
and the position acquisition unit is used for acquiring the position of the voice message on the display interface according to the layout information.
Preferably, the unlocking unit is specifically:
the password extraction subunit is used for extracting a pre-stored unlocking password from the password library when a screen unlocking instruction is monitored;
and the reading subunit is used for calling the system screen locking service to read the unlocking password unlocking screen.
Preferably, after the service invoking module, the method further includes:
and the text message module is used for converting the text message into voice and playing the voice when the type of the message content is judged to be the text message.
Preferably, after the message playing module, the method further comprises:
the reply reminding module is used for sending out a voice prompt for whether to reply or not;
the recording module is used for starting a recording function to receive the voice reply of the user when the voice instruction for confirming the reply is acquired;
the conversion module is used for converting the voice reply into text content;
the character copying module is used for acquiring the positions of a reply frame and a sending button on the display interface according to the pre-stored layout library, and simulating and clicking the reply frame to copy the character content into the reply frame;
and the sending module is used for simulating and clicking the sending button to send the text content.
The invention also provides a terminal device for processing a third party application message, which comprises a processor, a memory and a computer program stored in the memory and configured to be executed by the processor, wherein the processor implements the method for processing the third party application message.
The present invention also provides a computer-readable storage medium, which is characterized in that the computer-readable storage medium includes a stored computer program, and when the computer program runs, the apparatus on which the computer-readable storage medium is located is controlled to execute the method for processing the third-party application message according to any one of the above.
The invention provides a method, a device, a terminal device and a readable medium for processing a third-party application message, wherein when a voice message from a third-party application is received, the position of the voice message on a display interface of the voice message is acquired from a pre-stored layout library, and the voice is played by simulating and clicking the position, so that a user can quickly, safely and efficiently process the message of the third-party application through voice reply under the condition of not contacting a mobile terminal, the coverage scene is wider and more comprehensive, the requirement of timely processing the message by the user under the actual scene is better met, the purpose of really liberating two hands is achieved, and the user can concentrate more energy on the current activity.
Drawings
In order to more clearly illustrate the technical solution of the present invention, the drawings needed to be used in the embodiments will be briefly described below, and it is obvious that the drawings in the following description are only some embodiments of the present invention, and it is obvious for those skilled in the art that other drawings can be obtained according to the drawings without creative efforts.
Fig. 1 is a flowchart illustrating a method for processing a third-party application message according to a first embodiment of the present invention.
Fig. 2 is a flowchart illustrating a method for processing a third-party application message according to a second embodiment of the present invention.
Fig. 3 is a flowchart of an apparatus for processing a third-party application message according to a third embodiment of the present invention.
Fig. 4 is a schematic structural diagram of an apparatus for processing a third-party application message according to a fourth embodiment of the present invention.
Fig. 5 is a schematic structural diagram of an interface display module of an apparatus for processing a third-party application message according to a fourth embodiment of the present invention.
Detailed Description
The technical solutions in the embodiments of the present invention will be clearly and completely described below with reference to the drawings in the embodiments of the present invention, and it is obvious that the described embodiments are only a part of the embodiments of the present invention, and not all of the embodiments. All other embodiments, which can be derived by a person skilled in the art from the embodiments given herein without making any creative effort, shall fall within the protection scope of the present invention.
Referring to fig. 1, a first embodiment of the present invention provides a method for processing a third-party application message, which can be executed on a terminal device and includes the following steps:
and S10, sending out voice prompt whether to answer the message or not after monitoring the message from the third party application.
In the embodiment of the invention, the terminal device can be a mobile terminal such as a mobile phone, a notebook computer, a tablet computer, a vehicle-mounted computer, a POS machine and the like, and with the rapid development of the integrated circuit technology, the mobile terminal has strong processing capability, and becomes a comprehensive information processing platform, so that people increasingly use the mobile terminal to process information.
After the message from the third-party application is monitored, the terminal device can obtain information such as source application, content, title, notification mode and the like of the message by calling a system notification service carried by the system, and send out a voice prompt for whether to answer the message, namely, by playing preset voice, for example, whether to answer the message, or whether to answer or receive the message from ×× application, or whether to answer the message, so as to inquire whether the user needs to answer.
In the embodiment of the invention, the user can set the information from which third-party applications are not to be answered in advance, the application acquires the source application of the message by calling the system notification service after monitoring the information from the third-party applications, and the user is not notified when the source application of the message is found in the list of the non-answering applications set in advance by the user after matching.
S20, when receiving the voice indication confirming answering, invoking a system notification service to obtain message content of the message.
In the embodiment of the invention, the terminal device can collect the voice indication of the user through the microphone, recognize the intention of the user through the voice recognition technology, and end the interaction when recognizing the intention of the user not to listen to the message, for example, receiving the voice of "not listen to" or "no". When an intention that the user wants to listen to the message is identified, e.g. a "kay" or "listen" voice is received, i.e. a voice indication confirming the listening is received.
It should be noted that, in the embodiment of the present invention, when receiving the voice instruction for confirming answering, the terminal device may further determine whether the voice instruction belongs to an authorized user through voiceprint recognition. The voice print recognition is adopted for improving the use safety, when the voice indication is judged not to belong to the authorized user, preset voice such as 'please reply again whether to answer' is played to acquire voice feedback again, and if the voice feedback acquired again after the voice print recognition judgment again does not belong to the authorized user, the early warning system of the mobile equipment is started or response is not directly performed. When the voice indication belongs to an authorized user, the terminal device calls a system notification service carried by a system to acquire the content of the message, and judges whether the type of the content is a voice message or a text message or other messages such as videos or expressions and the like according to the content of the message.
S30, when the type of the message content is judged to be a voice message, opening a display interface of the voice message, and acquiring the position of the voice message on the display interface according to a pre-stored layout library; the pre-stored layout library is used for storing layout information of the interface operation control of the third-party application.
In the embodiment of the present invention, specifically, when the type of the content of the message is determined to be a voice message, the terminal device invokes a system screen locking service provided by the system itself to unlock a screen of the mobile terminal, and invokes the system notification service to obtain a source application and a display interface of the voice message. And then, the terminal equipment acquires the layout information of the interface operation control of the source application from the pre-stored layout library according to the source application, and acquires the position of the voice message on the display interface according to the layout information.
In the embodiment of the invention, the step of calling the system screen locking service to unlock the screen of the mobile terminal specifically comprises the steps of extracting a prestored unlocking password from a password library when a screen unlocking instruction is monitored, and calling the system screen locking service to read the unlocking password unlocking screen, namely reminding and enabling a user to input the screen unlocking password into the password library in advance for prestored work. When a screen unlocking instruction is monitored, extracting a pre-stored unlocking password from a password library, and calling the system screen locking service to read the unlocking password to unlock the screen.
In the embodiment of the invention, when the third-party application is detected to have the opening password, the user is reminded and enabled to input the opening password corresponding to the third-party application into the password library in advance so as to facilitate the opening of the third-party application when the subsequent voice message comes or the message is answered, and the third-party application is opened by enabling the third-party application to read the corresponding opening password.
In the embodiment of the present invention, the pre-stored layout library is used for storing layout information of the interface operation control of the third party application, and may pre-store layout information of display interfaces of the third party application as many as possible on the market, such as a position of speech or text information of an application such as a WeChat or a nail, a position of a reply box, a position of a send button, and the like, so long as a source application of a message is obtained, a position of the operation control on the display interface of the source application may be obtained from the pre-stored layout library, and then a next operation flow is performed according to the position. In addition, when a newly installed or updated third-party application is detected, the layout information of the interface operation control of the third-party application can be obtained from the third-party application.
And S40, simulating clicking the position to play the voice message.
In the embodiment of the invention, the position of the voice message is obtained from a pre-stored layout library, namely the coordinate of the playing operation control of the voice message is obtained, and the adb command is executed in the system service to simulate clicking the coordinate, namely the playing operation control is simulated clicking to play the voice message. And the service to which the adb command belongs is rooted in the system, and the service has the same authority as the system service.
In summary, the present invention provides a method for processing a third-party application message, when receiving a voice message from a third-party application, obtaining a position of the voice message on a display interface of the voice message from a pre-stored layout library, and simulating to click the position to play the voice. Under the condition that a user does not contact with the mobile terminal, the information of the third-party application is quickly, safely and efficiently processed through voice reply, the coverage scene is wider and more comprehensive, the requirement of the user for timely processing the information under the actual scene is met, the purpose of really liberating both hands is achieved, and the user is enabled to concentrate more energy on the current activity.
In order to facilitate an understanding of the invention, some preferred embodiments of the invention will now be described.
Second embodiment of the invention:
referring to fig. 2, after the step S20, the method further includes, in accordance with the first embodiment:
and S25, when the type of the message content is judged to be a text message, converting the text message into voice and playing the voice.
In the embodiment of the invention, after the mobile terminal judges that the content type of the message is the text message, the text message is converted into the voice to be played through the function of converting the text into the voice, so that a user can obtain the content of the message without contacting the mobile terminal.
Third embodiment of the invention:
referring to fig. 3, after the step S40, the method further includes, in accordance with the first embodiment:
and S50, sending out a voice prompt for whether to reply.
In the embodiment of the present invention, after the voice message or the text message is converted into the voice, the mobile terminal plays a preset voice, for example, "whether to reply" to ask the user whether to reply after acquiring the message content.
And S60, when the voice instruction for confirming the reply is acquired, starting a recording function to receive the voice reply of the user.
In the embodiment of the invention, after informing a user that recording equipment such as a microphone and the like is prepared, the mobile terminal collects the reply of the user through the microphone, identifies the intention of the user through a voice identification technology, and if the intention that the user does not reply to a message is identified, ends the interaction. If the intention of the user to reply the message is recognized, a microphone device or other sound recording devices are called to collect the voice reply of the user.
And S70, converting the voice reply into text.
In the embodiment of the invention, the mobile terminal converts the voice reply into the text content through a voice recognition technology. Preferably, the user can optionally play the text content to distinguish whether the conversion process has errors of individual converted text content due to the speaker ambiguity of the user or other reasons, whether to re-input and convert the text content is controlled by voice, and if the conversion process is confirmed to be correct, the user performs voice confirmation.
And S80, acquiring the positions of a reply box and a sending button on the display interface according to the pre-stored layout library, and simulating to click the reply box to copy the text content into the reply box.
In the embodiment of the present invention, if the voice played before is the voice converted from the text message, the mobile terminal needs to open an interface that needs to be replied, that is, a system screen locking service is called to unlock the screen of the mobile terminal. And simultaneously calling the system notification service to acquire the source application and the display interface of the text message. And opening a display interface corresponding to the text message according to the acquired display interface information. If the voice played before is the voice message, the corresponding interface is opened before, and the operation is not required to be repeated. After the mobile terminal opens a corresponding interface, the layout information of the display interface is obtained from the pre-stored layout library, the positions of a reply frame and a sending button on the display interface are obtained according to the layout information, and the reply frame is simulated to be clicked to copy the text content to the reply frame.
And S90, simulating and clicking the sending button to send the text content.
In the embodiment of the invention, after the mobile terminal acquires the coordinates of the sending button control, the mobile terminal simulates clicking the coordinates by executing an adb command in a system service, namely, the mobile terminal simulates clicking the sending button control to send the text content. The function of efficiently replying the message without contacting the mobile terminal is provided for the user, so that the user concentrates more energy on the current activity.
Referring to fig. 4, a fourth embodiment of the present invention further provides an apparatus for processing a third-party application message, including:
the monitoring module 10 is used for sending out a voice prompt for judging whether to answer the message or not after monitoring the message from the third party application;
a service calling module 20, configured to, when receiving a voice instruction for confirming answering, call a system notification service to obtain message content of the message;
the interface display module 30 is configured to, when it is determined that the type of the content of the message is a voice message, open a display interface of the voice message, and obtain a position of the voice message on the display interface according to a pre-stored layout library; the pre-stored layout library is used for storing layout information of interface operation controls of third-party applications;
and the message playing module 40 is used for simulating clicking the position to play the voice message.
Preferably, the service invoking module 20 is specifically:
the voice print recognition unit is used for judging whether the voice instruction belongs to a user or not through voice print recognition when receiving the voice instruction for confirming answering;
and the notification service calling unit is used for calling a system notification service to acquire the message content of the message when judging that the voice indication belongs to the user.
Preferably, referring to fig. 5, the interface display module 30 specifically includes:
an unlocking unit 31 for calling a system screen locking service to unlock a screen;
an information obtaining unit 32, configured to invoke the system notification service to obtain a source application and a display interface of the voice message;
an interface opening unit 33 configured to open a display interface of the voice message;
a layout obtaining unit 34, configured to obtain layout information of the interface operation control of the source application from the pre-stored layout library according to the source application;
a position obtaining unit 35, configured to obtain, according to the layout information, a position of the voice message on the display interface.
Preferably, the unlocking unit 31 is specifically:
the password extraction subunit is used for extracting a pre-stored unlocking password from the password library when a screen unlocking instruction is monitored;
and the reading subunit is used for calling the system screen locking service to read the unlocking password unlocking screen.
Preferably, after the service invoking module 20, the method further includes:
and the text message module is used for converting the text message into voice and playing the voice when the type of the message content is judged to be the text message.
Preferably, after the message playing module 40, the method further includes:
the reply reminding module is used for sending out a voice prompt for whether to reply or not;
the recording module is used for starting a recording function to receive the voice reply of the user when the voice instruction for confirming the reply is acquired;
the conversion module is used for converting the voice reply into text content;
the character copying module is used for acquiring the positions of a reply frame and a sending button on the display interface according to the pre-stored layout library, and simulating and clicking the reply frame to copy the character content into the reply frame;
and the sending module is used for simulating and clicking the sending button to send the text content.
A fifth embodiment of the present invention provides a terminal device for processing a third-party application message. The terminal device for processing the third-party application message of the embodiment comprises: a processor, a memory, and a computer program stored in the memory and executable on the processor, such as a program for processing third party application messages. The processor, when executing the computer program, implements the steps in the above-described embodiments of the method for processing a third party application message, such as step S10 shown in fig. 1. Alternatively, the processor, when executing the computer program, implements the functions of the modules in the above-described device embodiments, such as the module 20 in fig. 3.
Illustratively, the computer program may be partitioned into one or more modules that are stored in the memory and executed by the processor to implement the invention. The one or more modules may be a series of computer program instruction segments capable of performing specific functions, which are used for describing the execution process of the computer program in the terminal device for processing the third-party application message.
The terminal device for processing the third-party application message may be a desktop computer, a notebook, a palm computer, a cloud server and other computing devices. The terminal device for processing the third party application message may include, but is not limited to, a processor and a memory. It will be understood by those skilled in the art that the schematic diagram is merely an example of a terminal device for processing a third party application message, and does not constitute a limitation of a terminal device for processing a third party application message, and may include more or fewer components than those shown, or some components may be combined, or different components may be included, for example, the terminal device for processing a third party application message may further include an input-output device, a network access device, a bus, etc.
The Processor may be a Central Processing Unit (CPU), other general purpose Processor, a Digital Signal Processor (DSP), an Application Specific Integrated Circuit (ASIC), an off-the-shelf Programmable Gate Array (FPGA) or other Programmable logic device, discrete Gate or transistor logic, discrete hardware components, etc. The general-purpose processor may be a microprocessor or the processor may be any conventional processor, etc., and the processor is a control center of the terminal device for processing the third party application message, and various interfaces and lines are used to connect various parts of the whole terminal device for processing the third party application message.
The memory may be used for storing the computer program and/or the module, and the processor may implement various functions of the terminal device for processing the third party application message by executing or executing the computer program and/or the module stored in the memory and calling the data stored in the memory. The memory may mainly include a storage program area and a storage data area, wherein the storage program area may store an operating system, an application program required by at least one function (such as a sound playing function, a text conversion function, etc.), and the like; the storage data area may store data (such as audio data, text message data, etc.) created according to the use of the cellular phone, etc. In addition, the memory may include high speed random access memory, and may also include non-volatile memory, such as a hard disk, a memory, a plug-in hard disk, a Smart Media Card (SMC), a Secure Digital (SD) Card, a Flash memory Card (Flash Card), at least one magnetic disk storage device, a Flash memory device, or other volatile solid state storage device.
The module integrated by the terminal device for processing the third party application message can be stored in a computer readable storage medium if the module is implemented in the form of a software functional unit and sold or used as an independent product. Based on such understanding, all or part of the flow of the method according to the embodiments of the present invention may also be implemented by a computer program, which may be stored in a computer-readable storage medium, and when the computer program is executed by a processor, the steps of the method embodiments may be implemented. Wherein the computer program comprises computer program code, which may be in the form of source code, object code, an executable file or some intermediate form, etc. The computer-readable medium may include: any entity or device capable of carrying the computer program code, recording medium, usb disk, removable hard disk, magnetic disk, optical disk, computer Memory, Read-only Memory (ROM), Random Access Memory (RAM), electrical carrier wave signals, telecommunications signals, software distribution medium, etc. It should be noted that the computer readable medium may contain content that is subject to appropriate increase or decrease as required by legislation and patent practice in jurisdictions, for example, in some jurisdictions, computer readable media does not include electrical carrier signals and telecommunications signals as is required by legislation and patent practice.
It should be noted that the above-described device embodiments are merely illustrative, where the units described as separate parts may or may not be physically separate, and the parts displayed as units may or may not be physical units, may be located in one place, or may be distributed on multiple network units. Some or all of the modules may be selected according to actual needs to achieve the purpose of the solution of the present embodiment. In addition, in the drawings of the embodiment of the apparatus provided by the present invention, the connection relationship between the modules indicates that there is a communication connection between them, and may be specifically implemented as one or more communication buses or signal lines. One of ordinary skill in the art can understand and implement it without inventive effort.
While the foregoing is directed to the preferred embodiment of the present invention, it will be understood by those skilled in the art that various changes and modifications may be made without departing from the spirit and scope of the invention.
Claims (9)
1. A method of processing third party application messages, comprising the steps of:
sending a voice prompt whether to answer the message or not after monitoring the message from the third-party application;
when receiving a voice instruction for confirming answering, calling a system notification service to acquire message content of the message;
when the type of the message content is judged to be voice message, opening a display interface of the voice message, and acquiring the position of the voice message on the display interface according to a pre-stored layout library; the pre-stored layout library is used for storing layout information of interface operation controls of third-party applications;
simulating clicking the position to play the voice message;
when the type of the message content is judged to be a voice message, opening a display interface of the voice message, and acquiring the position of the voice message on the display interface according to a pre-stored layout library, specifically comprising:
calling a system screen locking service to unlock a screen;
calling the system notification service to acquire a source application and a display interface of the voice message;
opening a display interface of the voice message;
acquiring layout information of the interface operation control of the source application from the pre-stored layout library according to the source application;
and acquiring the position of the voice message on the display interface according to the layout information.
2. The method according to claim 1, wherein the invoking a system notification service to obtain message content of the message when receiving a voice indication confirming answering comprises:
when receiving a voice instruction for confirming answering, judging whether the voice instruction belongs to an authorized user through voiceprint recognition;
and when the voice indication is judged to belong to the authorized user, calling a system notification service to acquire the message content of the message.
3. The method for processing a third-party application message according to claim 1, wherein the invoking a system screen lock service to unlock a screen specifically comprises:
when a screen unlocking instruction is monitored, extracting a pre-stored unlocking password from a password library;
and calling the system screen locking service to read the unlocking password unlocking screen.
4. The method of claim 1, further comprising, after the invoking a system notification service to obtain message content of the message when the voice indication confirming answering is obtained, the following:
and when the type of the message content is judged to be a text message, converting the text message into voice and playing the voice.
5. The method of processing a third party application message according to claim 1, further comprising, after said simulating clicking the location to play the voice message:
sending out a voice prompt whether to reply or not;
when a voice instruction for confirming the reply is acquired, starting a recording function to receive the voice reply of the user;
converting the voice reply into text content;
acquiring positions of a reply frame and a sending button on the display interface according to the pre-stored layout library, and simulating and clicking the reply frame to copy the text content into the reply frame;
and simulating to click the sending button to send the text content.
6. An apparatus for processing third party application messages, comprising:
the monitoring module is used for sending out a voice prompt for judging whether to answer the message or not after monitoring the message from the third-party application;
the service calling module is used for calling a system notification service to acquire the message content of the message when receiving a voice instruction for confirming answering;
the interface display module is used for opening a display interface of the voice message when the type of the message content is judged to be the voice message, and acquiring the position of the voice message on the display interface according to a pre-stored layout library; the pre-stored layout library is used for storing layout information of interface operation controls of third-party applications;
the message playing module is used for simulating and clicking the position to play the voice message;
the interface display module specifically comprises:
the unlocking unit is used for calling the system screen locking service to unlock the screen;
the information acquisition unit is used for calling the system notification service to acquire a source application and a display interface of the voice message;
the interface opening unit is used for opening a display interface of the voice message;
the layout acquisition unit is used for acquiring layout information of the interface operation control of the source application from the pre-stored layout library according to the source application;
and the position acquisition unit is used for acquiring the position of the voice message on the display interface according to the layout information.
7. The apparatus for processing third-party application messages according to claim 6, wherein the service invocation module is specifically configured to:
the voice print recognition unit is used for judging whether the voice instruction belongs to an authorized user or not through voice print recognition when receiving the voice instruction for confirming answering;
and the notification service calling unit is used for calling a system notification service to acquire the message content of the message when the voice indication is judged to belong to the authorized user.
8. A terminal device for processing a third party application message, comprising a processor, a memory and a computer program stored in the memory and configured to be executed by the processor, the processor implementing the method of processing a third party application message according to any one of claims 1 to 5 when executing the computer program.
9. A computer-readable storage medium, comprising a stored computer program, wherein the computer program, when executed, controls an apparatus on which the computer-readable storage medium is located to perform the method for processing third party application messages according to any one of claims 1 to 5.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201710572639.0A CN107436748B (en) | 2017-07-13 | 2017-07-13 | Method and device for processing third-party application message, terminal equipment and readable medium |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201710572639.0A CN107436748B (en) | 2017-07-13 | 2017-07-13 | Method and device for processing third-party application message, terminal equipment and readable medium |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN107436748A CN107436748A (en) | 2017-12-05 |
| CN107436748B true CN107436748B (en) | 2020-06-30 |
Family
ID=60459741
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201710572639.0A Expired - Fee Related CN107436748B (en) | 2017-07-13 | 2017-07-13 | Method and device for processing third-party application message, terminal equipment and readable medium |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN107436748B (en) |
Families Citing this family (10)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN110881001B (en) * | 2018-09-06 | 2022-06-03 | Oppo广东移动通信有限公司 | Electronic red packet detection method, system and terminal equipment |
| CN109451140A (en) * | 2018-09-25 | 2019-03-08 | 深圳壹账通智能科技有限公司 | Social message method for pushing, device, computer storage medium and terminal |
| CN109408271B (en) * | 2018-10-19 | 2022-04-15 | 北京小米移动软件有限公司 | Response method and device for sliding cover operation and storage medium |
| CN111385661B (en) * | 2018-12-29 | 2021-08-27 | Tcl科技集团股份有限公司 | Method, device, terminal and storage medium for voice control of full screen playing |
| CN112748968A (en) * | 2019-10-31 | 2021-05-04 | 阿里巴巴集团控股有限公司 | Auxiliary operation method, device, equipment and storage medium |
| CN111083283B (en) * | 2019-12-05 | 2021-07-23 | 成都欧珀通信科技有限公司 | Display control method and device, computer readable medium, wireless communication terminal |
| CN111243116A (en) * | 2020-01-16 | 2020-06-05 | 厦门快商通科技股份有限公司 | Method and system for automatic sign-in of APP application software |
| CN111490928A (en) * | 2020-03-27 | 2020-08-04 | 北京三快在线科技有限公司 | Instant communication message reading and replying method and device and electronic equipment |
| CN113364669B (en) * | 2021-06-02 | 2023-04-18 | 中国工商银行股份有限公司 | Message processing method and device, electronic equipment and medium |
| CN115248650A (en) * | 2022-06-24 | 2022-10-28 | 南京伟柏软件技术有限公司 | Screen reading method and device |
Citations (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN103442130A (en) * | 2013-04-10 | 2013-12-11 | 威盛电子股份有限公司 | Voice control method, mobile terminal device and voice control system |
| CN104461446A (en) * | 2014-11-12 | 2015-03-25 | 科大讯飞股份有限公司 | Software running method and system based on voice interaction |
| CN105739819A (en) * | 2016-01-22 | 2016-07-06 | 努比亚技术有限公司 | Cursor positioning method and device and mobile terminal |
| CN105739831A (en) * | 2016-02-01 | 2016-07-06 | 珠海市魅族科技有限公司 | Display method and device of message contents |
| CN105955602A (en) * | 2016-04-19 | 2016-09-21 | 深圳市全智达科技有限公司 | Method and device for operating mobile terminal |
| CN105989267A (en) * | 2015-02-16 | 2016-10-05 | 中兴通讯股份有限公司 | Voiceprint recognition based safety protection method and apparatus |
| CN106384593A (en) * | 2016-09-05 | 2017-02-08 | 北京金山软件有限公司 | Voice information conversion and information generation method and device |
-
2017
- 2017-07-13 CN CN201710572639.0A patent/CN107436748B/en not_active Expired - Fee Related
Patent Citations (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN103442130A (en) * | 2013-04-10 | 2013-12-11 | 威盛电子股份有限公司 | Voice control method, mobile terminal device and voice control system |
| CN104461446A (en) * | 2014-11-12 | 2015-03-25 | 科大讯飞股份有限公司 | Software running method and system based on voice interaction |
| CN105989267A (en) * | 2015-02-16 | 2016-10-05 | 中兴通讯股份有限公司 | Voiceprint recognition based safety protection method and apparatus |
| CN105739819A (en) * | 2016-01-22 | 2016-07-06 | 努比亚技术有限公司 | Cursor positioning method and device and mobile terminal |
| CN105739831A (en) * | 2016-02-01 | 2016-07-06 | 珠海市魅族科技有限公司 | Display method and device of message contents |
| CN105955602A (en) * | 2016-04-19 | 2016-09-21 | 深圳市全智达科技有限公司 | Method and device for operating mobile terminal |
| CN106384593A (en) * | 2016-09-05 | 2017-02-08 | 北京金山软件有限公司 | Voice information conversion and information generation method and device |
Also Published As
| Publication number | Publication date |
|---|---|
| CN107436748A (en) | 2017-12-05 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN107436748B (en) | Method and device for processing third-party application message, terminal equipment and readable medium | |
| JP6596173B1 (en) | Incoming call management method and apparatus | |
| CN103888581B (en) | A kind of communication terminal and its method for recording call-information | |
| US9854439B2 (en) | Device and method for authenticating a user of a voice user interface and selectively managing incoming communications | |
| CN104144239B (en) | A kind of voice supplemental communication method and apparatus | |
| US11762629B2 (en) | System and method for providing a response to a user query using a visual assistant | |
| WO2017166464A1 (en) | Information interaction method and terminal | |
| CN110765502B (en) | Information processing method and related product | |
| WO2018133767A1 (en) | Call control method, terminal apparatus, and data storage medium | |
| CN104917724A (en) | Identity verification method and apparatus | |
| CN105577882B (en) | A kind of method that information is shown and user terminal | |
| CN110379099A (en) | Terminal alarms method, apparatus, terminal and storage medium | |
| CN105791538A (en) | Reminding method and device | |
| CN112035087A (en) | Information prompting method and device, electronic equipment and readable storage medium | |
| CN108305373B (en) | Voting method, device, equipment and storage medium | |
| WO2016202277A1 (en) | Message sending method and mobile terminal | |
| CN107239685B (en) | Method of controlling bluetooth device, and computer-readable storage medium | |
| CN106101361B (en) | Display methods, device and the mobile phone of cell phone address book | |
| CN105208520A (en) | Method and device for automatic information sending of mobile terminal | |
| CN103813031A (en) | Method and device for processing call | |
| CN111163234A (en) | Service call processing method and device, electronic equipment and storage medium | |
| CN104836901A (en) | Terminal | |
| CN104503736A (en) | Information prompt method and device | |
| US20170195864A1 (en) | Emergency Communication Method and Electronic Device | |
| CN105025482B (en) | Communication information processing method and equipment thereof |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant | ||
| CF01 | Termination of patent right due to non-payment of annual fee |
Granted publication date: 20200630 |
|
| CF01 | Termination of patent right due to non-payment of annual fee |