CN109086116B - Communication tool speech real-time monitoring method and device based on auxiliary function service - Google Patents

Communication tool speech real-time monitoring method and device based on auxiliary function service Download PDF

Info

Publication number
CN109086116B
CN109086116B CN201810951109.1A CN201810951109A CN109086116B CN 109086116 B CN109086116 B CN 109086116B CN 201810951109 A CN201810951109 A CN 201810951109A CN 109086116 B CN109086116 B CN 109086116B
Authority
CN
China
Prior art keywords
communication
information
communication interface
determining
content
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
CN201810951109.1A
Other languages
Chinese (zh)
Other versions
CN109086116A (en
Inventor
沈鑫
范渊
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Hangzhou Dbappsecurity Technology Co Ltd
Original Assignee
Hangzhou Dbappsecurity Technology Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Hangzhou Dbappsecurity Technology Co Ltd filed Critical Hangzhou Dbappsecurity Technology Co Ltd
Priority to CN201810951109.1A priority Critical patent/CN109086116B/en
Publication of CN109086116A publication Critical patent/CN109086116A/en
Application granted granted Critical
Publication of CN109086116B publication Critical patent/CN109086116B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F9/00Arrangements for program control, e.g. control units
    • G06F9/06Arrangements for program control, e.g. control units using stored programs, i.e. using an internal store of processing equipment to receive or retain programs
    • G06F9/44Arrangements for executing specific programs
    • G06F9/451Execution arrangements for user interfaces
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F40/00Handling natural language data
    • G06F40/20Natural language analysis
    • G06F40/279Recognition of textual entities
    • G06F40/284Lexical analysis, e.g. tokenisation or collocates
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04LTRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L51/00User-to-user messaging in packet-switching networks, transmitted according to store-and-forward or real-time protocols, e.g. e-mail
    • H04L51/04Real-time or near real-time messaging, e.g. instant messaging [IM]
    • H04L51/046Interoperability with other network applications or services

Abstract

The invention provides a communication tool speech real-time monitoring method and a device based on auxiliary function service, which relate to the technical field of communication monitoring and comprise the following steps: if the communication interface refreshing of the communication tool is detected, determining the type information of the communication interface refreshing; if the type information indicates that the content of the communication interface is changed, determining the refreshed communication interface as a target communication interface; and acquiring communication information from the target communication interface, and monitoring the communication information to obtain a monitoring result, wherein the communication information comprises the speech content, so that the technical problem that the stored communication message record is incomplete in the prior art is solved.

Description

Communication tool speech real-time monitoring method and device based on auxiliary function service
Technical Field
The invention relates to the technical field of communication monitoring, in particular to a communication tool speech real-time monitoring method and device based on auxiliary function service.
Background
The chat tool is also called Instant Messaging (IM) software tool or IM software, and is a tool for providing real-time text transmission and the like for clients based on the internet. Technically, the method is mainly divided into server-based IM tool software and peer-to-peer computer network (P2P) technology-based IM tool software.
At present, real-time messaging communication tools such as office and chat software (such as nailing, WeChat, skype and the like) are common communication modes for work communication, and the communication cost among staff is greatly reduced by the aid of the real-time messaging communication tools. The biggest difference between real-time messaging and e-mail is that the real-time messaging and e-mail do not need to wait, do not need to press once every two minutes to transmit and receive, and can transmit characters and the like to the opposite party like a multimedia telephone as long as two persons are on line simultaneously, and the two parties can communicate no matter how far apart the two parties are.
However, if the user uses the functions of "recall" and the like, the key contents of the communication are likely to be lost, so that the communication message records stored in the chat records are incomplete.
Disclosure of Invention
In view of the above, an object of the present invention is to provide a method and an apparatus for real-time monitoring of a communication tool talk based on an auxiliary function service, so as to solve the technical problem in the prior art that a stored communication message record is not complete.
In a first aspect, an embodiment of the present invention provides a communication tool talk real-time monitoring method based on an auxiliary function Service, which is applied to an auxiliary function Service (access Service) tool, and the method includes:
if the communication interface refreshing of the communication tool is detected, determining the type information of the communication interface refreshing;
if the type information indicates that the content of the communication interface is changed, determining the refreshed communication interface as a target communication interface;
and acquiring communication information from the target communication interface, and monitoring the communication information to obtain a monitoring result, wherein the communication information comprises the speech content.
With reference to the first aspect, an embodiment of the present invention provides a first possible implementation manner of the first aspect, where determining type information of communication interface refresh if the communication interface refresh of the communication tool is detected includes:
if the communication interface refreshing of the communication tool is detected, an auxiliary function Event (Accessibility Event) is triggered, and the Accessibility Event is used for determining the refreshing type information of the communication interface.
With reference to the first aspect, an embodiment of the present invention provides a second possible implementation manner of the first aspect, where the obtaining communication information from the target communication interface includes:
determining a target dialog box from the target communication interface;
view layout analysis is carried out on the target communication interface, and then layout identification information of the target dialog box in the target communication interface is obtained;
and acquiring content information in the target dialog box according to the layout identification information, and determining the content information as the communication information.
With reference to the first aspect, an embodiment of the present invention provides a third possible implementation manner of the first aspect, where the communication information further includes at least one of: message content, message sender, message sending time, message receiver, and message receiving time.
With reference to the first aspect, an embodiment of the present invention provides a fourth possible implementation manner of the first aspect, where a preset field is obtained, where the preset field is used to characterize an interest field.
With reference to the first aspect, an embodiment of the present invention provides a fifth possible implementation manner of the first aspect, where the monitoring the communication information to obtain a monitoring result includes:
comparing the communication information with the preset field to obtain a comparison result;
judging whether an interest field represented by the preset field exists in the communication information according to the comparison result;
if so, recording the content related to the interest field in the communication information based on the preset field to obtain recorded information, and determining the recorded information as the monitoring result.
With reference to the first aspect, an embodiment of the present invention provides a sixth possible implementation manner of the first aspect, where the recording, based on the preset field, the content associated with the interest field in the communication information to obtain recorded information includes:
determining the occurrence time of the preset field in the target communication interface;
determining the recording range of the communication information by combining the occurrence time and a preset range;
and recording the content associated with the interest field in the communication information based on the recording range to obtain recorded information.
In a second aspect, an embodiment of the present invention further provides an access Service-based communication tool talk real-time monitoring device, which is applied to an access Service tool, and the device includes:
the first determining module is used for determining the type information of communication interface refreshing when the communication interface refreshing of the communication tool is detected;
the second determining module is used for determining the refreshed communication interface as a target communication interface when the content of the communication interface of the type information is changed;
the acquisition module is used for acquiring communication information from the target communication interface;
and the monitoring module is used for monitoring the communication information to obtain a monitoring result, wherein the communication information comprises the speech content.
In a third aspect, an embodiment of the present invention further provides an electronic device, including a memory and a processor, where the memory stores a computer program operable on the processor, and the processor implements the steps of the method according to the first aspect when executing the computer program.
In a fourth aspect, the present invention also provides a computer-readable medium having non-volatile program code executable by a processor, where the program code causes the processor to execute the method according to the first aspect.
The technical scheme provided by the embodiment of the invention has the following beneficial effects: the communication tool speech real-time monitoring method and device based on the auxiliary function service provided by the embodiment of the invention comprise the following steps: firstly, if the communication interface of the communication tool is detected to be refreshed, determining the refreshed type information of the communication interface, if the type information is that the content of the communication interface is changed, determining the refreshed communication interface as a target communication interface, then, communication information is obtained from the target communication interface, and the communication information is monitored, so as to obtain a monitoring result, wherein, the communication information comprises the speaking content, therefore, as long as the communication interface of the communication tool is detected to be refreshed, the communication information of the communication interface which is refreshed and has changed content is obtained, so as to realize the real-time monitoring of the communication interface, the communication information and the like, thereby timely and real-time acquiring communication information, avoiding the withdrawal function, improving the integrity of communication records, therefore, the technical problem that the stored communication message records are incomplete in the prior art is solved.
Additional features and advantages of the invention will be set forth in the description which follows, and in part will be obvious from the description, or may be learned by practice of the invention. The objectives and other advantages of the invention will be realized and attained by the structure particularly pointed out in the written description and drawings.
In order to make the aforementioned and other objects, features and advantages of the present invention comprehensible, preferred embodiments accompanied with figures are described in detail below.
Drawings
In order to more clearly illustrate the embodiments of the present invention or the technical solutions in the prior art, the drawings used in the description of the embodiments or the prior art will be briefly described below, and it is obvious that the drawings in the following description are some embodiments of the present invention, and other drawings can be obtained by those skilled in the art without creative efforts.
Fig. 1 is a flowchart illustrating a method for real-time monitoring communication tool speech based on auxiliary function services according to an embodiment of the present invention;
fig. 2 is a flowchart illustrating a communication tool-based real-time monitoring method for accessibility services according to a second embodiment of the present invention;
fig. 3 is a schematic structural diagram illustrating a communication tool-based real-time monitoring apparatus for auxiliary function services according to a third embodiment of the present invention;
fig. 4 shows a schematic structural diagram of an electronic device according to a fourth embodiment of the present invention.
Icon: 3-communication tool speech real-time monitoring device based on auxiliary function service; 31-a first determination module; 32-a second determination module; 33-an acquisition module; 34-a monitoring module; 4-an electronic device; 41-a memory; 42-a processor; 43-bus; 44-communication interface.
Detailed Description
To make the objects, technical solutions and advantages of the embodiments of the present invention clearer, the technical solutions of the present invention will be clearly and completely described below with reference to the accompanying drawings, and it is apparent that the described embodiments are some, but not all embodiments of the present invention. All other embodiments, which can be derived by a person skilled in the art from the embodiments given herein without making any creative effort, shall fall within the protection scope of the present invention.
At present, the communication software does not have the function of completely storing and exporting the chat records, although the query operation can be carried out in the chat records, the search can be carried out in all the chat records, and the efficiency and the target directivity are low. More importantly, due to the existence of the 'withdrawal' function, key contents may be lost, the message records stored in the chat records are incomplete, and when disputes, conflicts and the like occur, the real-time monitoring communication theory is difficult to control, so that the whole event process cannot be restored, and responsibility tracing is difficult.
Based on this, the communication tool talk real-time monitoring method and device based on the auxiliary function service provided by the embodiment of the invention can solve the technical problem that the stored communication message records are not complete in the prior art.
To facilitate understanding of the embodiment, a communication tool statement real-time monitoring method and device based on auxiliary function service disclosed in the embodiment of the present invention are first described in detail.
The first embodiment is as follows:
the communication tool language real-time monitoring method based on the auxiliary function Service (access Service) provided by the embodiment of the invention is applied to an access Service tool and can be used as a communication software language real-time monitoring and processing method based on the access Service, as shown in fig. 1, the method comprises the following steps:
s11: and if the communication interface refreshing of the communication tool is detected, determining the refreshing type information of the communication interface.
As a preferred embodiment of this embodiment, as soon as it is detected that the communication interface of the communication tool is refreshed, the subsequent process is started, and the subsequent process includes determining the type information of the refreshed communication interface.
S12: and if the type information indicates that the content of the communication interface is changed, determining the refreshed communication interface as a target communication interface.
Preferably, if the type information indicates that the content of the communication interface is changed, indicating that new chat information occurs, and the like, the refreshed communication interface is determined as the target communication interface.
S13: and acquiring communication information from the target communication interface, and monitoring the communication information to obtain a monitoring result, wherein the communication information comprises the speech content.
In practical application, communication information such as the speech content and the like is obtained from the refreshed communication interface so as to monitor the communication information such as the speech content and the like, and therefore a monitoring result is obtained.
For the prior art, if the user uses the functions of "recall", etc., the key contents of the communication will be lost, so that the communication message record stored in the chat record is incomplete. The method for monitoring, analyzing, recording and timely processing the speech in the communication software is realized through the real-time monitoring method of the speech of the communication tool based on the Accessibility Service, and the speech of the staff members can be effectively monitored in real time based on the mode of calling the Accessibility Service related method, so that the whole process of the event can be restored to realize accurate responsibility tracing. Moreover, the method can be operated on mobile phones, flat panels and other equipment, and is simple, reliable and low in cost. Most importantly, the communication tool talk real-time monitoring method based on the Accessibility Service can store the communication content in real time and in time, so that the existence of a withdrawal function is avoided, the condition of key content loss cannot be sent again, and the integrity of communication record forensics is ensured to a great extent.
Example two:
the communication tool language real-time monitoring method based on the auxiliary function Service (access Service) provided by the embodiment of the invention is applied to an access Service tool and can be used as a communication software language real-time monitoring and processing method based on the access Service, as shown in fig. 2, the method comprises the following steps:
s21: if the communication interface refreshing of the communication tool is detected, an auxiliary function Event (Access Event) is triggered, and the type information of the communication interface refreshing is determined by using the Access Event.
It should be noted that an Accessibility Service (Accessibility Service) is a Service provided by an Android system, and the Accessibility Service itself is a legacy Service. This service provides an enhanced user interface intended to help people who may temporarily be unable to fully interact with the device. The functions provided by the access Service include: searching interface elements and realizing simulated click so as to realize an abstract method for inheriting the Accessibility Service class by an auxiliary function Service requirement and realizing the same. Specifically, an Accessibility Service class Sample (for example, Accessibility Sample Service, which may be named arbitrarily) is customized, and the Accessibility Service of the system is inherited and the triggered Accessibility Event (on Accessibility Event) and triggered Interrupt (on Interrupt) methods are overwritten. After the service class is written, the service is registered in a system configuration file (e.g., Android Manifest. xml). The registration and configuration of the basic auxiliary function Service are completed after the two steps are completed, the specific function realization needs to be completed in the on access Event, the Event can be filtered according to the access Event object transmitted by the on access Event callback method, and the searching and clicking of the authority node can be realized by combining the searching node provided by the access Sample Service and the interface related to the simulated clicking.
Specifically, step S21 may include: the embodiment takes a communication tool as chat software as an example for explanation, and includes the steps of starting a monitoring service, entering a chat interface for waiting, receiving new chat information, refreshing the interface, and the like.
Firstly, in the step of starting the monitoring service, a detector can control the starting and stopping of the monitoring service by clicking a switch control button (switch), and the judgment is carried out by monitoring the state of the control in a program; then, for the step of entering a chat interface for waiting, exiting the main program interface, opening the chat software, entering a chat page to be monitored, keeping the chat page on the page and constantly lighting the equipment screen; then, in the step of 'receiving new chat information and refreshing the interface', when the content in the chat page is refreshed, the access Event in the access Service is called, and then the communication interface refresh Type is judged by an Event Type (get Event Type) acquisition method of the Event (Event) introduced in the access Event.
S22: and if the type information indicates that the content of the communication interface is changed, determining the refreshed communication interface as a target communication interface.
If the communication interface refreshing TYPE is a WINDOW CONTENT change (TYPE WINDOW CONTENT CHANGED) Event, the refreshed communication interface is determined as a target communication interface, namely the communication interface is monitored for the chat interface CONTENT change in real time through TYPE WINDOW CONTENT CHANGED of the access Event in the access Service.
S23: and determining a target dialog box from the target communication interface.
The method for obtaining the Root directory (get Root In Active Window) In the Active Window obtains the auxiliary function Node information (access Node Info) of the Window, that is, obtains the dialog object, such as dialog box a, of the interface Window by the method for obtaining the Root In Active Window.
S24: and carrying out view layout analysis on the target communication interface so as to obtain layout identification information of the target dialog box in the target communication interface.
In this step, the control may be selected by using an automation program Dump View Hierarchy (e.g., Dump View for UI automation) function in a Device Monitor (e.g., Android Device Monitor) tool, so as to obtain the required layout identification information (layout ID).
For example, the layout identification information of the required message dialog (e.g., dialog a) control is obtained through a Dump View Hierarchy for UI automation function in a Device Monitor (e.g., Android Device Monitor) tool provided in the development software (e.g., Android Studio).
S25: and acquiring the content information in the target dialog box according to the layout identification information, and determining the content information as communication information.
In practical application, after a method of searching Accessibility auxiliary function Node information (find Accessibility Node info By ViewId) through a view is called to transmit a control ID, the control object can be obtained, and then communication information such as required message content, a sender, sending time and the like is obtained. Wherein, the communication information may further include at least one of: message content, message sender, message sending time, message receiver, and message receiving time. Wherein, the communication information comprises the speech content.
For example, the layout identification information of the dialog box a is introduced By calling the method of find access Node Info By view id, so as to obtain the frame Node (Node) content information of the latest message of the dialog box a, the object dialog box a is of access Node Info type, different fields, such as message content, sender, etc., can be obtained By the obtaining (get) method, and then the communication information, such as message content, sender, sending time, etc., can be obtained By calling the Text obtaining (get Text) method of the object.
As another implementation manner of this embodiment, after this step, a step of "storing the latest chat content in the database" may be further performed, that is, after the required message content, sender, and sending time are obtained in the previous step, data such as communication information and the like may be stored in a light database (for example, SQLite) on the software system (for example, Android), and the occupied resources for storage are very low, and in the embedded device, the Application Programming Interface (API) may be operated only with less than one KB of memory.
S26: and acquiring a preset field, wherein the preset field is used for representing the interest field.
Of course, the step S26 can be completed in any process of the method, for example, before the step S21, the preset field is obtained. Therefore, the step is used as a process of configuring the keywords, the content of the specific fields can be configured through a visual interface of a program, and the monitoring personnel can successfully configure the keywords after setting the preset fields and clicking the submitted keywords.
S27: and comparing the communication information with a preset field to obtain a comparison result.
Preferably, the communication information is compared with a preset field, namely a keyword, representing the interest field to obtain a comparison result. For example, after the data is saved, the message content and the configured keywords are compared one by one, so as to obtain a comparison result.
S28: and judging whether the interest fields represented by the preset fields exist in the communication information according to the comparison result.
As a preferable scheme, it is judged whether a keyword occurs in the communication information such as the utterance content, and if no matched keyword occurs, the process returns to the step of "waiting for entering chat interface" in step S21.
S29: if so, recording the content related to the interest field in the communication information based on the preset field to obtain the recorded information, and determining the recorded information as the monitoring result.
In this step, recording the content associated with the interest field in the communication information based on the preset field to obtain recorded information, including: and determining the appearance time of the preset field in the target communication interface. And determining the recording range of the communication information by combining the occurrence time and the preset range. And recording the content associated with the interest field in the communication information based on the recording range to obtain the recorded information.
The recording range may be several messages before and after the message with the keyword. For example, when the program finds that there is a keyword that is successfully matched, first store 30 message contents before the message with the keyword into the table of the abnormal record, and then store the next 30 message contents after the message with the keyword into the table of the abnormal record, of course, store the message contents into the table of the normal contents in the database at the same time, and after completing the storage of the total 61 abnormal messages (including the message with the keyword), the program may return to the step of "waiting for entering chat interface" in step S21.
As another implementation manner of this embodiment, the monitoring personnel may quit the program at any time according to the control of the monitoring personnel, for example, the monitoring personnel may open the main program interface, click the switch control to switch the start/stop state, so as to close the service, and the monitoring service of the whole program may be stopped.
In the embodiment, based on the access Service and other methods, the problem that no official push-out function of exporting the complete record of the chat record exists in the chat communication software is solved at low cost, and the method is used as a real-time analysis recording and processing method of the speech in the communication software and relates to office and chat software which are commonly used at ordinary times. The content in the chat page, the sender and the like are monitored and recorded by setting the keywords, the internal communication group is monitored in real time according to the configured keywords, if the keywords are successfully matched, the related content before and after the record is automatically stored in a database, and the related content can be called and checked when needed. Therefore, the method provided by the embodiment has practical functions, stable performance and flexible use, realizes the real-time monitoring of the content of the comments of the staff members in the internal communication group, and solves the problem of difficult responsibility tracing in the process of restoring events.
Therefore, by the real-time monitoring and processing method of the communication software talk based on Accessibility Service provided in this embodiment, after the keywords are configured, real-time monitoring can be performed in the corresponding internal communication group, if the keywords appear, the content before and after the record is automatically stored in the database, even if the sender uses the "withdraw" function to withdraw the content, because the content is automatically stored in the database, the situation that the complete incident restoring process cannot be performed due to the content loss does not occur, the talk of staff members can be monitored in real time, and thus the incident restoring process is completed.
Example three:
the communication tool speech real-time monitoring device based on the auxiliary function Service (Accessibility Service) provided by the embodiment of the invention is applied to an Accessibility Service tool, and as shown in fig. 3, the communication tool speech real-time monitoring device 3 based on the auxiliary function Service comprises: a first determination module 31, a second determination module 32, an acquisition module 33, and a monitoring module 34.
Further, the first determining module 31 is configured to determine the type information of the communication interface refresh when the communication interface refresh of the communication tool is detected. The second determining module 32 is configured to determine the refreshed communication interface as the target communication interface when the content of the communication interface is changed according to the type information. The obtaining module 33 is configured to obtain the communication information from the target communication interface. The monitoring module 34 is configured to monitor communication information to obtain a monitoring result, where the communication information includes speech content.
Example four:
as shown in fig. 4, the electronic device 4 includes a memory 41 and a processor 42, where the memory stores a computer program that can run on the processor, and the processor executes the computer program to implement the steps of the method provided in the first embodiment or the second embodiment.
Referring to fig. 4, the electronic device further includes: a bus 43 and a communication interface 44, the processor 42, the communication interface 44 and the memory 41 being connected by the bus 43; the processor 42 is for executing executable modules, such as computer programs, stored in the memory 41.
The Memory 41 may include a high-speed Random Access Memory (RAM) and may also include a non-volatile Memory (non-volatile Memory), such as at least one disk Memory. The communication connection between the network element of the system and at least one other network element is realized through at least one communication interface 44 (which may be wired or wireless), and the internet, a wide area network, a local network, a metropolitan area network, and the like can be used.
The bus 43 may be an ISA bus, a PCI bus, an EISA bus, or the like. The bus may be divided into an address bus, a data bus, a control bus, etc. For ease of illustration, only one double-headed arrow is shown in FIG. 4, but that does not indicate only one bus or one type of bus.
The memory 41 is used for storing a program, and the processor 42 executes the program after receiving an execution instruction, and the method executed by the apparatus defined by the flow process disclosed in any of the foregoing embodiments of the present invention may be applied to the processor 42, or implemented by the processor 42.
The processor 42 may be an integrated circuit chip having signal processing capabilities. In implementation, the steps of the above method may be performed by instructions in the form of hardware, integrated logic circuits, or software in the processor 42. The Processor 42 may be a general-purpose Processor, and includes a Central Processing Unit (CPU), a Network Processor (NP), and the like; the device can also be a Digital Signal Processor (DSP), an Application Specific Integrated Circuit (ASIC), a Field-Programmable Gate Array (FPGA), or other Programmable logic devices, discrete Gate or transistor logic devices, discrete hardware components. The various methods, steps and logic blocks disclosed in the embodiments of the present invention may be implemented or performed. A general purpose processor may be a microprocessor or the processor may be any conventional processor or the like. The steps of the method disclosed in connection with the embodiments of the present invention may be directly implemented by a hardware decoding processor, or implemented by a combination of hardware and software modules in the decoding processor. The software module may be located in ram, flash memory, rom, prom, or eprom, registers, etc. storage media as is well known in the art. The storage medium is located in a memory 41, and a processor 42 reads information in the memory 41 and performs the steps of the method in combination with hardware thereof.
Example five:
the computer-readable medium provided by the embodiment of the invention has a non-volatile program code executable by a processor, and the program code causes the processor to execute the method provided by the first embodiment or the second embodiment.
Unless specifically stated otherwise, the relative steps, numerical expressions, and values of the components and steps set forth in these embodiments do not limit the scope of the present invention.
It is clear to those skilled in the art that, for convenience and brevity of description, the specific working processes of the system and the apparatus described above may refer to the corresponding processes in the foregoing method embodiments, and are not described herein again.
In all examples shown and described herein, any particular value should be construed as merely exemplary, and not as a limitation, and thus other examples of example embodiments may have different values.
It should be noted that: like reference numbers and letters refer to like items in the following figures, and thus, once an item is defined in one figure, it need not be further defined and explained in subsequent figures.
The flowchart and block diagrams in the figures illustrate the architecture, functionality, and operation of possible implementations of systems, methods and computer program products according to various embodiments of the present invention. In this regard, each block in the flowchart or block diagrams may represent a module, segment, or portion of code, which comprises one or more executable instructions for implementing the specified logical function(s). It should also be noted that, in some alternative implementations, the functions noted in the block may occur out of the order noted in the figures. For example, two blocks shown in succession may, in fact, be executed substantially concurrently, or the blocks may sometimes be executed in the reverse order, depending upon the functionality involved. It will also be noted that each block of the block diagrams and/or flowchart illustration, and combinations of blocks in the block diagrams and/or flowchart illustration, can be implemented by special purpose hardware-based systems which perform the specified functions or acts, or combinations of special purpose hardware and computer instructions.
The computer-readable medium having the processor-executable non-volatile program code provided in the embodiment of the present invention has the same technical features as the communication tool talk real-time monitoring method, apparatus and electronic device based on the auxiliary function service provided in the above embodiment, so that the same technical problems can be solved, and the same technical effects can be achieved.
Furthermore, the terms "first," "second," and "third" are used for descriptive purposes only and are not to be construed as indicating or implying relative importance.
The computer program product for performing the communication tool talk real-time monitoring method based on the auxiliary function service provided by the embodiment of the present invention includes a computer readable storage medium storing a non-volatile program code executable by a processor, where instructions included in the program code may be used to execute the method described in the foregoing method embodiment, and specific implementation may refer to the method embodiment, which is not described herein again.
In the several embodiments provided in the present application, it should be understood that the disclosed system, apparatus and method may be implemented in other ways. The above-described embodiments of the apparatus are merely illustrative, and for example, the division of the units is only one logical division, and there may be other divisions when actually implemented, and for example, a plurality of units or components may be combined or integrated into another system, or some features may be omitted, or not executed. In addition, the shown or discussed mutual coupling or direct coupling or communication connection may be an indirect coupling or communication connection of devices or units through some communication interfaces, and may be in an electrical, mechanical or other form.
The units described as separate parts may or may not be physically separate, and parts displayed as units may or may not be physical units, may be located in one place, or may be distributed on a plurality of network units. Some or all of the units can be selected according to actual needs to achieve the purpose of the solution of the embodiment.
In addition, functional units in the embodiments of the present invention may be integrated into one processing unit, or each unit may exist alone physically, or two or more units are integrated into one unit.
The functions, if implemented in the form of software functional units and sold or used as a stand-alone product, may be stored in a computer readable storage medium. Based on such understanding, the technical solution of the present invention may be embodied in the form of a software product, which is stored in a storage medium and includes instructions for causing a computer device (which may be a personal computer, a server, or a network device) to execute all or part of the steps of the method according to the embodiments of the present invention. And the aforementioned storage medium includes: a U-disk, a removable hard disk, a Read-Only Memory (ROM), a Random Access Memory (RAM), a magnetic disk or an optical disk, and other various media capable of storing program codes.
Finally, it should be noted that: the above-mentioned embodiments are only specific embodiments of the present invention, which are used for illustrating the technical solutions of the present invention and not for limiting the same, and the protection scope of the present invention is not limited thereto, although the present invention is described in detail with reference to the foregoing embodiments, those skilled in the art should understand that: any person skilled in the art can modify or easily conceive the technical solutions described in the foregoing embodiments or equivalent substitutes for some technical features within the technical scope of the present disclosure; such modifications, changes or substitutions do not depart from the spirit and scope of the embodiments of the present invention, and they should be construed as being included therein. Therefore, the protection scope of the present invention shall be subject to the protection scope of the claims.

Claims (6)

1. A communication tool talk real-time monitoring method based on auxiliary function Service is characterized in that the method is applied to an auxiliary function Service (Accessibility Service) tool, and the method comprises the following steps:
if the communication interface refreshing of the communication tool is detected, determining the type information of the communication interface refreshing;
if the type information indicates that the content of the communication interface is changed, determining the refreshed communication interface as a target communication interface;
acquiring communication information from the target communication interface, and monitoring the communication information to obtain a monitoring result, wherein the communication information comprises speech content;
further comprising:
acquiring a preset field, wherein the preset field is used for representing an interest field;
the monitoring the communication information to obtain a monitoring result comprises:
comparing the communication information with the preset field to obtain a comparison result;
judging whether an interest field represented by the preset field exists in the communication information according to the comparison result;
if so, recording the content associated with the interest field in the communication information based on the preset field to obtain recorded information, and determining the recorded information as the monitoring result;
the recording the content associated with the interest field in the communication information based on the preset field to obtain recorded information, including:
determining the occurrence time of the preset field in the target communication interface;
determining the recording range of the communication information by combining the occurrence time and a preset range;
and recording the content associated with the interest field in the communication information based on the recording range to obtain recorded information.
2. The method of claim 1, wherein determining the type information of the communication interface refresh if the communication interface refresh of the communication tool is detected comprises:
if the communication interface refreshing of the communication tool is detected, triggering an auxiliary function Event, and determining the refreshing type information of the communication interface by using the auxiliary function Event.
3. The method of claim 1, wherein the obtaining communication information from the target communication interface comprises:
determining a target dialog box from the target communication interface;
view layout analysis is carried out on the target communication interface, and then layout identification information of the target dialog box in the target communication interface is obtained;
and acquiring content information in the target dialog box according to the layout identification information, and determining the content information as the communication information.
4. The method of any of claims 1 to 3, wherein the communication information further comprises at least one of: message content, message sender, message sending time, message receiver, and message receiving time.
5. An electronic device comprising a memory and a processor, wherein the memory stores a computer program operable on the processor, and wherein the processor implements the steps of the method of any of claims 1 to 4 when executing the computer program.
6. A computer-readable medium having non-volatile program code executable by a processor, wherein the program code causes the processor to perform the method of any of claims 1 to 4.
CN201810951109.1A 2018-08-20 2018-08-20 Communication tool speech real-time monitoring method and device based on auxiliary function service Active CN109086116B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201810951109.1A CN109086116B (en) 2018-08-20 2018-08-20 Communication tool speech real-time monitoring method and device based on auxiliary function service

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201810951109.1A CN109086116B (en) 2018-08-20 2018-08-20 Communication tool speech real-time monitoring method and device based on auxiliary function service

Publications (2)

Publication Number Publication Date
CN109086116A CN109086116A (en) 2018-12-25
CN109086116B true CN109086116B (en) 2021-07-30

Family

ID=64793952

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201810951109.1A Active CN109086116B (en) 2018-08-20 2018-08-20 Communication tool speech real-time monitoring method and device based on auxiliary function service

Country Status (1)

Country Link
CN (1) CN109086116B (en)

Families Citing this family (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN110730120A (en) * 2019-10-31 2020-01-24 北京小米移动软件有限公司 Instant communication message processing method, device, equipment and storage medium

Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN102882762A (en) * 2011-07-11 2013-01-16 腾讯科技(深圳)有限公司 Method and system for synchronizing chat status information in multiple pages
CN105933215A (en) * 2016-07-09 2016-09-07 东莞市华睿电子科技有限公司 Chat message withdraw control method based on instant messaging
CN106294541A (en) * 2016-07-22 2017-01-04 深圳天珑无线科技有限公司 A kind of communication information collection method and device
CN106685797A (en) * 2016-07-09 2017-05-17 东莞市华睿电子科技有限公司 Method for verifying identity based on instant communication
CN107222632A (en) * 2017-06-23 2017-09-29 北京金山安全软件有限公司 Instant messaging method and device

Family Cites Families (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US9503401B1 (en) * 2014-01-31 2016-11-22 Whatsapp Inc. Automated message recall from a sender's device
CN105490919B (en) * 2015-11-24 2019-11-08 小米科技有限责任公司 Message cancelling method and device
CN106302136A (en) * 2016-10-21 2017-01-04 珠海格力电器股份有限公司 The control method of mobile terminal, device and mobile terminal
CN107659490B (en) * 2017-09-27 2021-01-12 Oppo广东移动通信有限公司 File sending method, terminal and storage medium

Patent Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN102882762A (en) * 2011-07-11 2013-01-16 腾讯科技(深圳)有限公司 Method and system for synchronizing chat status information in multiple pages
CN105933215A (en) * 2016-07-09 2016-09-07 东莞市华睿电子科技有限公司 Chat message withdraw control method based on instant messaging
CN106685797A (en) * 2016-07-09 2017-05-17 东莞市华睿电子科技有限公司 Method for verifying identity based on instant communication
CN106294541A (en) * 2016-07-22 2017-01-04 深圳天珑无线科技有限公司 A kind of communication information collection method and device
CN107222632A (en) * 2017-06-23 2017-09-29 北京金山安全软件有限公司 Instant messaging method and device

Also Published As

Publication number Publication date
CN109086116A (en) 2018-12-25

Similar Documents

Publication Publication Date Title
US10200319B2 (en) Searchable peer-to-peer system through instant messaging based topic indexes
CN107390983B (en) Service instruction execution method, client and storage medium
CN107133309B (en) Method and device for storing and querying process example, storage medium and electronic equipment
US9372776B2 (en) Monitoring user activity and performance of computerized devices
CN109218407B (en) Code management and control method based on log monitoring technology and terminal equipment
CN108038665B (en) Business rule management method, device, equipment and computer readable storage medium
CN113377626B (en) Visual unified alarm method, device, equipment and medium based on service tree
CN112235253B (en) Data asset carding method, device, computer equipment and storage medium
CN110610376A (en) Behavior data response method and device, computer equipment and storage medium
CN111400170A (en) Data permission testing method and device
CN111880887A (en) Message interaction method and device, storage medium and electronic equipment
CN109753419A (en) A kind of method and device of the abnormal log information of all applications of non-invasive monitoring Android system
CN109086116B (en) Communication tool speech real-time monitoring method and device based on auxiliary function service
CN111309743A (en) Report pushing method and device
WO2021179944A1 (en) Device sharing method and server
CN108062401B (en) Application recommendation method and device and storage medium
US11676345B1 (en) Automated adaptive workflows in an extended reality environment
CN116069838A (en) Data processing method, device, computer equipment and storage medium
CN113792008A (en) Method and device for acquiring network topology structure, electronic equipment and storage medium
CN116136801B (en) Cloud platform data processing method and device, electronic equipment and storage medium
CN114172978A (en) Multi-protocol equipment access method and related device
CN103399752A (en) Mobile phone application chain reaction system and method based on Internet service
CN113377682A (en) Service testing method and device
CN111352790A (en) Test method and device for reporting input event, mobile terminal and storage medium
CN110858174A (en) Picture auditing method for mobile device chat software

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant