CN117097692A - Session storage system - Google Patents

Session storage system Download PDF

Info

Publication number
CN117097692A
CN117097692A CN202311150431.1A CN202311150431A CN117097692A CN 117097692 A CN117097692 A CN 117097692A CN 202311150431 A CN202311150431 A CN 202311150431A CN 117097692 A CN117097692 A CN 117097692A
Authority
CN
China
Prior art keywords
session
data
service
subsystem
tool
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
CN202311150431.1A
Other languages
Chinese (zh)
Inventor
肖建毅
徐梓桐
陈维汉
梁培玮
蔡海滨
何宇新
李宏亮
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
China Southern Power Grid Digital Enterprise Technology Guangdong Co ltd
Original Assignee
China Southern Power Grid Digital Enterprise Technology Guangdong Co ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by China Southern Power Grid Digital Enterprise Technology Guangdong Co ltd filed Critical China Southern Power Grid Digital Enterprise Technology Guangdong Co ltd
Priority to CN202311150431.1A priority Critical patent/CN117097692A/en
Publication of CN117097692A publication Critical patent/CN117097692A/en
Pending legal-status Critical Current

Links

Classifications

    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L51/00—User-to-user messaging in packet-switching networks, transmitted according to store-and-forward or real-time protocols, e.g. e-mail
    • H04L51/21—Monitoring or handling of messages
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L51/00—User-to-user messaging in packet-switching networks, transmitted according to store-and-forward or real-time protocols, e.g. e-mail
    • H04L51/04—Real-time or near real-time messaging, e.g. instant messaging [IM]
    • Y—GENERAL TAGGING OF NEW TECHNOLOGICAL DEVELOPMENTS; GENERAL TAGGING OF CROSS-SECTIONAL TECHNOLOGIES SPANNING OVER SEVERAL SECTIONS OF THE IPC; TECHNICAL SUBJECTS COVERED BY FORMER USPC CROSS-REFERENCE ART COLLECTIONS [XRACs] AND DIGESTS
    • Y02—TECHNOLOGIES OR APPLICATIONS FOR MITIGATION OR ADAPTATION AGAINST CLIMATE CHANGE
    • Y02D—CLIMATE CHANGE MITIGATION TECHNOLOGIES IN INFORMATION AND COMMUNICATION TECHNOLOGIES [ICT], I.E. INFORMATION AND COMMUNICATION TECHNOLOGIES AIMING AT THE REDUCTION OF THEIR OWN ENERGY USE
    • Y02D10/00—Energy efficient computing, e.g. low power processors, power management or thermal management

Abstract

The embodiment of the invention discloses a session storage system. The system comprises: a session acquisition subsystem, a session processing subsystem and a session storage subsystem; the session acquisition subsystem is used for acquiring session data of at least one instant messaging tool accessed to the session storage system and transmitting the session data to the session processing subsystem; the session processing subsystem is used for receiving the session data, carrying out standardized processing on the session data to obtain standardized data, and sending the standardized data to the session storage subsystem; the session storage subsystem is used for receiving the standardized data and storing the standardized data. The technical scheme of the embodiment of the invention can avoid the problem that the session storage function of the instant messaging tool has data risk.

Description

Session storage system
Technical Field
The embodiment of the invention relates to the technical field of computers, in particular to a session storage system.
Background
As networks go deep into thousands of households, people chat and interact through instant messaging (Instant Messaging, IM) tools, and thus, instant messaging tools have become one of the irreplaceable software in people's lives and works. And the chat record, the incoming and outgoing file and other data of the user on the instant messaging tool have storage and analysis values.
At present, data is becoming a core resource in the information age, a large number of internal files and business data are in chat form in an instant communication tool to conduct information circulation, sensitive information security early warning and blocking transmission are difficult to develop, information tracing is difficult afterwards, meanwhile, security audit requirements such as periodic retention of data assets are considered, and related information security regulations are strictly followed from the aspect of security compliance. Therefore, the session storage function of the instant messaging tool is at data risk and the tap is to be resolved.
Disclosure of Invention
The embodiment of the invention provides a session storage system for avoiding the problem of data risk of the session storage function of an instant messaging tool.
According to an aspect of the present invention, there is provided a session storage system, which may include: a session acquisition subsystem, a session processing subsystem and a session storage subsystem; wherein,
the session acquisition subsystem is used for acquiring session data of at least one instant messaging tool accessed by the session storage system and transmitting the session data to the session processing subsystem;
the session processing subsystem is used for receiving the session data, carrying out standardized processing on the session data to obtain standardized data, and sending the standardized data to the session storage subsystem;
And the session storage subsystem is used for receiving the standardized data and storing the standardized data.
The technical scheme of the embodiment of the invention, a session storage system, comprises: a session acquisition subsystem, a session processing subsystem and a session storage subsystem; the session data of at least one instant messaging tool accessed by the session storage system is acquired through the session acquisition subsystem, and the session data is sent to the session processing subsystem; receiving session data through a session processing subsystem, carrying out standardized processing on the session data to obtain standardized data, and sending the standardized data to a session storage subsystem; and receiving the standardized data through the session storage subsystem and storing the standardized data. According to the technical scheme, the session storage function of the instant messaging tool is realized by providing the database by the IM provider and embedding the database into the IM tool, but because the IM provider has operation authority on the database, the session storage function of the instant messaging tool at present has data risk, the session storage system which is independently deployed can be used for providing the session storage service for at least one instant messaging tool, and the database provided by the IM provider is not needed to be relied on, so that the problem of data risk caused by relying on the database provided by the IM provider is avoided, and the problem of data risk of the session storage function of the instant messaging tool is avoided.
It should be understood that the description in this section is not intended to identify key or critical features of the embodiments of the invention, nor is it intended to be used to limit the scope of the invention. Other features of the present invention will become apparent from the description that follows.
Drawings
In order to more clearly illustrate the technical solutions of the embodiments of the present invention, the drawings required for the description of the embodiments will be briefly described below, and it is apparent that the drawings in the following description are only some embodiments of the present invention, and other drawings may be obtained according to these drawings without inventive effort for a person skilled in the art.
FIG. 1 is a block diagram of a session storage system provided according to an embodiment of the present invention;
FIG. 2 is a block diagram of another session storage system provided in accordance with an embodiment of the present invention;
FIG. 3 is a block diagram of a further session storage system provided in accordance with an embodiment of the present invention;
FIG. 4 is an exemplary diagram of a session detection service in yet another session storage system provided in accordance with an embodiment of the present invention;
FIG. 5 is a block diagram of still another session storage system provided in accordance with an embodiment of the present invention;
FIG. 6 is a block diagram of a further session storage system provided in accordance with an embodiment of the present invention;
FIG. 7 is an exemplary diagram of a session retrieval service in yet another session storage system provided in accordance with an embodiment of the present invention;
fig. 8 is a block diagram of an alternative example of a session storage system according to an embodiment of the present invention.
Detailed Description
In order that those skilled in the art will better understand the present invention, a technical solution in the embodiments of the present invention will be clearly and completely described below with reference to the accompanying drawings in which it is apparent that the described embodiments are only some embodiments of the present invention, not all embodiments. All other embodiments, which can be made by those skilled in the art based on the embodiments of the present invention without making any inventive effort, shall fall within the scope of the present invention.
It should be noted that the terms "first," "second," and the like in the description and the claims of the present invention and the above figures are used for distinguishing between similar objects and not necessarily for describing a particular sequential or chronological order. It is to be understood that the data so used may be interchanged where appropriate such that the embodiments of the invention described herein may be implemented in sequences other than those illustrated or otherwise described herein. The cases of "target", "original", etc. are similar and will not be described in detail herein. Furthermore, the terms "comprises," "comprising," and "having," and any variations thereof, are intended to cover a non-exclusive inclusion, such that a process, method, system, article, or apparatus that comprises a list of steps or elements is not necessarily limited to those steps or elements expressly listed but may include other steps or elements not expressly listed or inherent to such process, method, article, or apparatus.
Fig. 1 is a block diagram of a session storage system according to an embodiment of the present application. The embodiment is applicable to the situation of session storage, in particular to the situation of instant messaging tool session storage. Referring to fig. 1, a session storage system of an embodiment of the present application may include: session acquisition subsystem 1100, session processing subsystem 1200, and session storage subsystem 1300; wherein,
a session acquisition subsystem 1100, configured to acquire session data of at least one instant messaging tool accessed by the session storage system, and send the session data to the session processing subsystem 1200;
the session processing subsystem 1200 receives session data, performs standardization processing on the session data to obtain standardized data, and sends the standardized data to the session storage subsystem 1300;
session storage subsystem 1300 receives the normalized data and stores the normalized data.
It should be noted that, in the technical scheme of the application, the acquisition, storage, use, processing and the like of the data all conform to the relevant regulations of the key laws and regulations.
The instant messaging tool is a real-time messaging service which can enable a user to establish a chat room on a network. The session data is data related to the session generated by the user through the instant messaging tool; session data may include chat records, public number communication records, file interaction data, voice data, picture data, and/or video data for a session, and the like; the session data may also include participant data of the session, time of generation of the session data, and/or identification or name of an instant messaging tool generating the session data, etc.; the conversation party data may include a conversation party's cell phone model, nickname, and/or avatar, etc. In the embodiment of the present application, the content of the session data is not particularly limited.
It should be noted that the session storage system provides at least one input interface with a format corresponding to each other, and different instant messaging tools can be respectively adapted according to the format of the input interface and the interface of the session storage system and then be connected to the session storage system through the interface, so that the interface connected between the instant messaging tools and the session storage system can be used as an entry of session data. In the embodiment of the present invention, the format type of the input interface is not particularly limited.
In an embodiment of the present invention, the session acquisition subsystem 1100 may acquire session data of at least one instant messaging tool accessed by the session storage system, and send the session data to the session processing subsystem 1200. It should be noted that, the session acquisition subsystem 1100 may perform data pulling in parallel and quickly by using a multithreading technology according to the format and/or the characteristics of the interface accessed between the instant messaging tools and the session storage system, so as to simultaneously acquire session data of multiple instant messaging tools accessed by the session storage system, thereby ensuring that a large amount of session data of the multiple instant messaging tools can be accurately input into the session storage system in a short time.
In an embodiment of the present invention, the session processing subsystem 1200 may receive session data, normalize the session data to obtain normalized data, and send the normalized data to the session storage subsystem 1300. The normalization processing may be, for example, marking processing, data analysis processing, and/or data mining processing on session data, where in the embodiment of the present invention, a processing manner of the normalization processing is not specifically limited; the marking process may be understood as a process of marking session data, for example, marking file interaction data in the session data with a file tag, marking voice data with a voice tag, and so on; the normalized data is the data obtained after normalized processing of the session data.
In the embodiment of the present invention, the session storage subsystem 1300 may receive the normalized data and store the normalized data, for example, may be a slice storage or the like, and in the embodiment of the present invention, a manner of storing the normalized data is not specifically limited. It should be noted that the session storage subsystem 1300 may use a database or a storage server in a master-slave mode to store the normalized data, so as to improve the disaster tolerance of the session storage system.
In an embodiment of the present invention, the session acquisition subsystem 1100 may acquire session data of at least one instant messaging tool accessed by the session storage system, and send the session data to the session processing subsystem 1200.
The technical scheme of the embodiment of the invention, a session storage system, comprises: a session acquisition subsystem, a session processing subsystem and a session storage subsystem; the session data of at least one instant messaging tool accessed by the session storage system is acquired through the session acquisition subsystem, and the session data is sent to the session processing subsystem; receiving session data through a session processing subsystem, carrying out standardized processing on the session data to obtain standardized data, and sending the standardized data to a session storage subsystem; and receiving the standardized data through the session storage subsystem and storing the standardized data. According to the technical scheme, the session storage function of the instant messaging tool is realized by providing the database by the IM provider and embedding the database into the IM tool, but because the IM provider has operation authority on the database, the session storage function of the instant messaging tool at present has data risk, the session storage system which is independently deployed can be used for providing the session storage service for at least one instant messaging tool, and the database provided by the IM provider is not needed to be relied on, so that the problem of data risk caused by relying on the database provided by the IM provider is avoided, and the problem of data risk of the session storage function of the instant messaging tool is avoided.
An optional technical scheme, the session acquisition subsystem comprises a distributed task scheduling module and at least one data acquisition service; the distributed task scheduling module is used for determining a target acquisition service corresponding to the instant messaging tool from at least one data acquisition service aiming at each instant messaging tool in the at least one instant messaging tool; the target acquisition service is used for acquiring the session data of the instant messaging tool and sending the session data to the session processing subsystem.
In the embodiment of the invention, the session acquisition subsystem may include a distributed task scheduling module and at least one data acquisition service, and each data acquisition service in the at least one data acquisition service may be used to acquire session data sent by one instant messaging tool. It should be noted that, there may be a one-to-one correspondence between the data collection service and the instant messaging tool; the data acquisition service and the instant messaging tool can be in one-to-one correspondence, namely, any idle data acquisition service can acquire session data of the instant messaging tool.
In the embodiment of the present invention, each of the at least one data acquisition service may be further configured to acquire session data of a data type sent by at least one instant messaging tool, for example, one of the data acquisition services may be configured to acquire session data of all picture types sent by the at least one instant messaging tool.
In the embodiment of the invention, the distributed task scheduling module can determine the target acquisition service corresponding to the instant messaging tool from at least one data acquisition service aiming at each instant messaging tool in at least one instant messaging tool; the target acquisition service may acquire session data for the instant messaging tool and send the session data to the session processing subsystem. According to the technical scheme, the data processing efficiency of the session storage system can be improved by setting at least one data acquisition service to ensure that a large amount of session data of a plurality of instant messaging tools can be acquired in a short time.
Based on the above scheme, another optional technical scheme is that the session processing subsystem comprises a message middleware and at least one data consumption service; message middleware for receiving the session data, determining a target consumption service corresponding to the session data from at least one data consumption service, and transmitting the session data to the target consumption service; and the target consumption service is used for carrying out standardized processing on the received session data to obtain standardized data and sending the standardized data to the session storage subsystem.
The message middleware can be middleware for caching session data and determining target consumption services corresponding to the session data; the message middleware may be, for example, a high availability message middleware.
In an embodiment of the present invention, the session processing subsystem includes message middleware and at least one data consumption service, each of which can be used to receive session data sent by one target acquisition service. It should be noted that, there may be a one-to-one correspondence between the data consumption service and the target acquisition service; the data consumption service and the target acquisition service can also have no one-to-one correspondence, namely, any idle data consumption service can acquire session data sent by the target acquisition service.
In the embodiment of the present invention, each of the at least one data consumption service may be further configured to obtain session data of a data type sent by at least one target acquisition service, for example, one of the data consumption services may be configured to obtain session data of all picture types sent by the at least one target acquisition service.
In the embodiment of the invention, the message middleware can receive the session data, determine a target consumption service corresponding to the session data from at least one data consumption service, and send the session data to the target consumption service; the target consumption service may normalize the received session data to obtain normalized data, and send the normalized data to the session storage subsystem. According to the technical scheme, a large amount of session data can be ensured to be output in a short time by setting at least one data consumption service, so that the data processing efficiency of the session storage system is further improved.
Fig. 2 is a block diagram of another session storage system provided in an embodiment of the present invention. The present embodiment is optimized based on the above technical solutions. In this embodiment, optionally, the session storage system further includes: a tool expansion subsystem; a tool extension subsystem for: determining a target extension tool in response to the tool extension instruction; and carrying out access operation on the session storage system and the target extension tool, and updating at least one instant messaging tool according to the accessed target extension tool. Wherein, the explanation of the same or corresponding terms as the above embodiments is not repeated herein.
Specifically, referring to fig. 2, the system of the present embodiment may specifically include: session acquisition subsystem 2100, session processing subsystem 2200, session storage subsystem 2300, and tool extension subsystem 2400; the session acquisition subsystem 2100 is configured to acquire session data of at least one instant messaging tool accessed by the session storage system, and send the session data to the session processing subsystem 2200; the session processing subsystem 2200 is configured to receive session data, perform standardization processing on the session data, obtain standardized data, and send the standardized data to the session storage subsystem 2300; a session storage subsystem 2300 for receiving the standardized data and storing the standardized data; tool extension subsystem 2400 for determining a target extension tool in response to a tool extension instruction; performing access operation on the session storage system and the target extension tool; and updating at least one instant messaging tool according to the accessed target extension tool.
The tool expansion instruction is an instruction for indicating to expand the instant messaging tool; the tool extension instruction may be that an administrator managing the session storage system issues a tool extension instruction to the tool extension subsystem 2400 through a system management subsystem on the management side. A system management subsystem may be understood as a subsystem that can manage a session storage system; the system management subsystem may be located on the management side, so that a manager may manage the session storage system through the system management subsystem. The target extension tool is an instant messaging tool for extending the access of the demand into the session storage system.
In the embodiment of the invention, the session storage system can adapt to the instant messaging tools with different chat formats, so that the session storage system can provide pluggable services for different instant messaging tools, namely, the session storage system can provide adapting and accessing services and/or disconnection services for different instant messaging tools.
In an embodiment of the present invention, tool extension subsystem 2400 may determine a target extension tool from a tool extension instruction in response to the tool extension instruction; adapting and accessing the session storage system and the target extension tool; and updating at least one instant messaging tool according to the accessed target extension tool.
It should be noted that the tool extension subsystem 2400 may also determine a target deletion tool in response to a tool deletion instruction, where the tool deletion instruction is an instruction indicating disconnection of an instant messaging tool from the session storage system, and the target deletion tool is an instant messaging tool that requires disconnection from the session storage system; disconnecting the session storage system from the target deletion tool; and updating at least one instant messaging tool according to the disconnected target deletion tool.
According to the technical scheme of the embodiment of the invention, the session storage system further comprises: a tool expansion subsystem; determining a target expansion tool by the tool expansion subsystem in response to the tool expansion instruction; performing access operation on the session storage system and the target extension tool; and updating at least one instant messaging tool according to the accessed target extension tool. According to the technical scheme, the tool expansion subsystem can expand at least one instant messaging tool accessed to the session storage system, so that the expandability of the session storage system is improved.
Fig. 3 is a block diagram of still another session storage system provided in an embodiment of the present invention. The present embodiment is optimized based on the above technical solutions. In this embodiment, optionally, the session storage system further includes: a service extension subsystem; a service extension subsystem for: determining a target extension service in response to the service extension instruction; and updating at least one extension available service integrated in the service extension subsystem according to the target extension service. Wherein, the explanation of the same or corresponding terms as the above embodiments is not repeated herein.
Specifically, referring to fig. 3, the system of this embodiment may specifically include: session acquisition subsystem 3100, session processing subsystem 3200, session storage subsystem 3300, and service extension subsystem 3400; the session obtaining subsystem 3100 is configured to obtain session data of at least one instant messaging tool accessed by the session storage system, and send the session data to the session processing subsystem 3200; the session processing subsystem 3200 is configured to receive session data, perform standardization processing on the session data to obtain standardized data, and send the standardized data to the session storage subsystem 3300; a session storage subsystem 3300, configured to receive the standardized data and store the standardized data; a service extension subsystem 3400 for determining a target extension service in response to a service extension instruction; at least one extension available service integrated in the service extension subsystem 3400 is updated according to the target extension service.
Wherein the service extension instruction is an instruction indicating extension available services integrated in the extension service extension subsystem 3400; the service extension instruction may be that an administrator who manages the session storage system issues a service extension instruction to the service extension subsystem 3400 through a system management subsystem on the management side. The target extension service is an extension available service that the demand extension is integrated into the service extension subsystem 3400; the target extension service is, for example, a service obtained from a place other than the session storage system, and the target extension service may also be, for example, a service written by a relevant staff member of the session storage system.
In the embodiment of the invention, the session storage system can adapt to different types of extension available services, so that the session storage system can provide the extension available services in a pluggable manner.
In the embodiment of the present invention, the service extension subsystem 3400 may determine a target extension service according to a service extension instruction in response to the service extension instruction; integrating the target extension service into the service extension subsystem 3400; at least one extension available service integrated in the service extension subsystem 3400 is updated according to the target extension service.
It is noted that the service extension subsystem 3400 may also determine a target deletion service in response to a service deletion instruction, which is an instruction to instruct deletion of an extension usable service from the service extension subsystem 3400, the target deletion service being an extension usable service that requires deletion from the service extension subsystem 3400; deleting the target extension service from the service extension subsystem 3400; at least one of the extended services available is updated based on the deleted target deletion service.
In the embodiment of the present invention, the service extension subsystem 3400 may be further configured to determine, according to a service type of the target extension service, whether the target extension service needs to extend its corresponding database, add the corresponding database to the target extension service under the condition that the target extension service needs to extend its corresponding database, and add log generation and/or abnormal situation early warning functions to the database.
According to the technical scheme of the embodiment of the invention, the session storage system further comprises: a service extension subsystem; determining a target expansion service by the service expansion subsystem in response to the service expansion instruction; and updating at least one extension available service integrated in the service extension subsystem according to the target extension service. According to the technical scheme, at least one extension available service integrated in the service extension subsystem can be extended through the work service extension subsystem, so that the expandability of the session storage system is further improved.
An alternative solution, the at least one extended available service includes a session detection service; session detection service for: acquiring stored standardized data from a session storage subsystem; and detecting the standardized data according to a preset detection rule and/or a keyword rule to obtain a session detection result, and sending the session detection result to the session storage subsystem so that the session storage subsystem stores the session detection result.
In the embodiment of the present invention, referring to fig. 4, the detection rule is a rule for detecting normalized data, for example, the detection rule may be a rule that some sensitive words cannot be included in normalized data, for example, the detection rule may be a rule for reminding a video sender that video data is stored when video data exists in normalized data, and in the embodiment of the present invention, the content of the detection rule is not specifically limited; the manager can preset detection rules through the system management subsystem, or the user of the instant messaging tool can preset detection rules through the session detection service provided by the session storage system for the instant messaging tool, and the manager or the user can be reminded when the trigger detection rules exist in the standardized data. The keyword rule is a rule related to a keyword in the normalized data, for example, a manager can preset the keyword through a system management subsystem, or a user of the instant messaging tool can preset the keyword through a session detection service provided to the instant messaging tool by a session storage system, and the manager or the user can be reminded of the rule when the keyword appears in the normalized data, and the content of the keyword rule is not specifically limited in the embodiment of the invention. The session detection result is a result obtained by detecting the normalized data, and the session detection result may be, for example, that the normalized data does not contain sensitive words, keywords or keywords and/or sensitive words that the normalized data includes, etc., and in the embodiment of the present invention, the content of the session detection result is not specifically limited.
In the embodiment of the invention, the session storage system can provide a session detection function through a session detection service. For example, the session detection function may detect the session storage subsystem in real time, and after detecting that the session storage subsystem receives the normalized data and stores the normalized data, obtain the stored normalized data from the session storage subsystem; the session detection function may also be to acquire normalized data stored in a preset time period from the session storage subsystem at intervals of the preset time period; and detecting the normalized data according to a preset detection rule and/or a keyword rule to obtain a session detection result, and sending the session detection result to the session storage subsystem so that the session storage subsystem stores the session detection result.
In the embodiment of the invention, the session detection service can also detect the normalized data according to the preset detection rule, keyword rule, reminding rule and/or detection list to obtain a session detection result. The detection list may be understood as a list of session detection required, a list related to session time, a list related to a session receiver, and the like, and is not particularly limited herein.
In the embodiment of the invention, the normalized data can be detected according to the preset detection rule and/or keyword rule to obtain the session detection result, and the session detection result is sent to the session storage subsystem, so that the session storage subsystem stores the session detection result, thereby timely detecting the condition of detecting the requirement in the normalized data, and storing and backing up the session detection result, so that the detection condition of the normalized data can be checked at any time later.
Based on the above scheme, another optional technical scheme, the session storage system further includes: the system management subsystem is used for expanding available services and also comprises early warning services; the session detection service is also used for sending the session detection result to the early warning service; the early warning service is used for receiving the session detection result and sending the abnormal information to the system management subsystem under the condition that the abnormal information exists in the session detection result; and the system management subsystem is used for sending out risk early warning based on a preset risk early warning rule under the condition of receiving the abnormal information.
The abnormal information is information representing abnormal conditions of normalized data storage in the session detection result, and the abnormal information can be related information such as sensitive words or keywords of the normalized data, and in the embodiment of the invention, the content of the abnormal information is not specifically limited; the anomaly information may be associated with preset detection rules and/or keyword rules.
In the embodiment of the invention, the preset risk early warning rule may be a preset rule related to risk early warning, for example, the preset risk early warning rule may be that when the system management subsystem receives abnormal information, the abnormal information is displayed through a display interface; for different abnormal information, the preset risk early warning rules may be different, for example, the preset risk early warning rules may be that when the system management subsystem receives abnormal information including keywords, the keywords in the abnormal information are displayed through a display interface, and when the system management subsystem receives abnormal information including sensitive words, a risk early warning voice prompt is sent; it should be noted that the preset risk early warning rule may also be set by a manager through the system management subsystem. In the embodiment of the invention, the content of the preset risk early warning rule is not particularly limited.
In the embodiment of the invention, the risk early warning can be early warning of prompting risk to exist, which is sent to a management end corresponding to a manager and/or a sender of session data corresponding to the risk early warning; the risk early warning can be performed in a manner of displaying a page, prompting a buzzer, prompting a voice, and the like, and in the embodiment of the invention, the specific early warning manner of the risk early warning is not particularly limited.
In the embodiment of the invention, after the system management subsystem sends the risk early warning based on the preset risk early warning rule, the early warning service can also send the abnormal information to the session storage subsystem for storage, and/or the system management subsystem can also acquire related operations generated by management personnel aiming at the risk early warning through a display page of the system management subsystem and send the operation information of the related operations to the session storage subsystem for storage.
In the embodiment of the invention, the session detection service can also send the session detection result to the early warning service; the early warning service receives the session detection result and sends abnormal information to the system management subsystem under the condition that the abnormal information exists in the session detection result; the system management subsystem can send out risk early warning based on a preset risk early warning rule under the condition of receiving the abnormal information. According to the technical scheme, risk early warning can be timely carried out under the condition that abnormal session data exist, so that the safety of stored standardized data is improved.
Fig. 5 is a block diagram of still another session storage system provided in an embodiment of the present invention. The present embodiment is optimized based on the above technical solutions. In this embodiment, optionally, the session storage system further includes: a service extension subsystem; a service extension subsystem for: determining a target extension service in response to the service extension instruction; and updating at least one extension available service integrated in the service extension subsystem according to the target extension service. Wherein, the explanation of the same or corresponding terms as the above embodiments is not repeated herein.
Specifically, referring to fig. 5, the system of the present embodiment may specifically include: session acquisition subsystem 4100, session processing subsystem 4200, session storage subsystem 4300, tool extension subsystem 4400, and service extension subsystem 4500; the session acquisition subsystem 4100 is configured to acquire session data of at least one instant messaging tool accessed by the session storage system, and send the session data to the session processing subsystem 4200; the session processing subsystem 4200 is configured to receive session data, perform normalization processing on the session data to obtain normalized data, and send the normalized data to the session storage subsystem 4300; a session storage subsystem 4300 for receiving the standardized data and storing the standardized data; a tool extension subsystem 4400 for determining a target extension tool in response to a tool extension instruction; performing access operation on the session storage system and the target extension tool; updating at least one instant messaging tool according to the accessed target extension tool; a service extension subsystem 4500 for determining a target extension service in response to a service extension instruction; at least one of the extended available services integrated in the service extension subsystem 4500 is updated according to the target extended service.
According to the technical scheme of the embodiment of the invention, the session storage system further comprises: a tool extension subsystem and a service extension subsystem; determining a target expansion tool by the tool expansion subsystem in response to the tool expansion instruction; performing access operation on the session storage system and the target extension tool; updating at least one instant messaging tool according to the accessed target extension tool; determining a target expansion service by the service expansion subsystem in response to the service expansion instruction; and updating at least one extension available service integrated in the service extension subsystem according to the target extension service. By the technical scheme, the instant messaging tool and the extended available service can be extended, so that the expandability of the session storage system is further improved.
An optional technical solution, the session storage system further includes: a service exposure subsystem; and the service exposure subsystem is used for determining at least one target supporting service supported by the target extension tool from at least one extension available service after updating the at least one instant messaging tool according to the accessed target extension tool and carrying out service exposure processing on the target extension tool based on the at least one target supporting service.
It will be appreciated that the session storage system may also provide services to the target extension tool after updating the at least one instant messaging tool according to the accessed target extension tool, and thus the session storage system may further include a service exposure subsystem by which, after updating the at least one instant messaging tool according to the accessed target extension tool, at least one target support service supported by the target extension tool is determined from the at least one extension-available service, i.e., the target extension tool is determined to be available or in need of use from the at least one extension-available service and at least one target support service used is supported, and a service exposure process is performed for the target extension tool based on the at least one target support service, i.e., a process of providing the at least one target support service to the target extension tool for use.
In the embodiment of the invention, after updating at least one instant messaging tool according to the accessed target extension tool, the service exposure subsystem can determine at least one target support service supported by the target extension tool from at least one extension available service, and perform service exposure processing on the target extension tool based on the at least one target support service. By the aid of the scheme, supportable services can be provided and exposed for the target extension tool, and therefore user experience can be improved.
Fig. 6 is a block diagram of still another session storage system provided in an embodiment of the present invention. The present embodiment is optimized based on the above technical solutions. In this embodiment, optionally, the session storage subsystem includes a distributed storage database, where the distributed storage database includes a session storage module; a session storage module for: receiving standardized data, and performing data slicing operation on the standardized data to obtain at least one sliced data; at least one piece of sliced data is stored in slices. Wherein, the explanation of the same or corresponding terms as the above embodiments is not repeated herein.
Specifically, referring to fig. 6, the system of the present embodiment may specifically include: session acquisition subsystem 5100, session processing subsystem 5200, and session storage subsystem 5300, session storage subsystem 5300 comprising distributed storage database 5310, distributed storage database 5310 comprising session storage module 5311; the session obtaining subsystem 5100 is configured to obtain session data of at least one instant messaging tool accessed by the session storage system, and send the session data to the session processing subsystem 5200; the session processing subsystem 5200 is configured to receive session data, perform standardization processing on the session data to obtain standardized data, and send the standardized data to the session storage subsystem 5300; the session storage subsystem 5300 is configured to receive the standardized data and store the standardized data; session storage module 5311 for: receiving standardized data, and performing data slicing operation on the standardized data to obtain at least one sliced data; at least one piece of sliced data is stored in slices.
The slicing data is data obtained after data slicing operation is performed on the normalized data.
In an embodiment of the present invention, session storage subsystem 5300 may include a distributed storage database 5310, where distributed storage database 5310 may include session storage module 5311 for performing session data storage, and session storage module 5311 may also be understood as a relevant service or function in distributed storage database 5310 for performing session storage.
In the embodiment of the invention, the standardized data can be segmented according to the data type of the data in the standardized data, for example, the audio data in the standardized data can be segmented into the same segmented data; the standardized data can be fragmented according to the data size of the standardized data; etc. In the embodiment of the present invention, the slicing operation mode and the slicing operation basis of the data slicing operation are not particularly limited.
It will be appreciated that the database embedded in the IM tool is not maintained for a long time by the IM provider, which results in a large number of expired files not being available for file retooling, further processing and analysis of the session data being difficult, and that providing the database embedded in the IM tool by the IM provider requires a script of the database to be operated, which may present risks of tampering, loss, etc. of the data. The embodiment of the invention stores the normalized data through the distributed storage database 5310 in the session storage system, so that the session record and the incoming and outgoing files can be reserved for a long time, the problems that the session data after expiration cannot be retrieved and analyzed are avoided, and the risks of data tampering, loss and the like can be avoided.
According to the technical scheme, the session storage subsystem comprises a distributed storage database, and the distributed storage database comprises a session storage module; receiving normalized data through a session storage module, and performing data slicing operation on the normalized data to obtain at least one sliced data; at least one piece of data is stored in a sliced and persistent manner. According to the technical scheme, the reliability, availability and access efficiency of the session storage system can be improved through the mode of carrying out fragment storage on the normalized data.
An optional technical scheme, the session storage subsystem further comprises a session retrieval service, and the distributed storage database further comprises a session retrieval module; a session retrieval module for: responding to a session retrieval instruction sent by a target communication tool in at least one instant communication tool through a session retrieval service, and determining a retrieval dimension and a retrieval keyword; determining retrieval data from a session storage module according to the session retrieval dimension and the retrieval key; and sending the search data to the target communication tool through the session search service.
The session retrieval service is a service which can be used for providing an instant messaging tool capable of supporting the session retrieval service for performing session retrieval. The target communication tool is an instant communication tool which needs to search the conversation. The session retrieval instruction is an instruction instructing the session retrieval service to perform session retrieval.
In the embodiment of the invention, the session storage subsystem further comprises a session retrieval service for providing the instant messaging tool with session retrieval, the distributed storage database can comprise a session retrieval module for retrieving session data, and the session retrieval module can be understood as related services or functions for retrieving the session in the distributed storage database.
In the embodiment of the present invention, the search dimension is a dimension in which session search is required, referring to fig. 7, for example, may be a dimension of a sender, a receiver, a keyword, a chat type, and/or a time of session data generation, etc. The search keyword can be understood as a keyword requiring session search; the search key may be not only a key of the session content in the session data but also a sender nickname key, a receiver nickname key, and/or a specific time of session data generation, etc.
By way of example, the session storage subsystem may integrate a Hadoop distributed big data storage component and a big data analysis component to provide the session storage module and the session retrieval module in the distributed storage database with related functions, for example, the session retrieval module may use HQL language to retrieve the storage in the session storage module, so as to implement a large amount of data retrieval and achieve a second-level response.
In the embodiment of the invention, the session storage subsystem can also generate the month report according to at least one of access conditions, query conditions, tool expansion conditions, service expansion conditions, session detection conditions, early warning conditions, service exposure conditions, session retrieval conditions and the like of normalized data in the present month, and store the month report so as to facilitate a manager or a session participant to query the month report at any time. The session storage subsystem can also generate a log according to at least one of the access condition, the query condition, the tool expansion condition, the service expansion condition, the session detection condition, the early warning condition, the service exposure condition, the session retrieval condition and the like of the standardized data, and store the log so as to facilitate the manager or the session participant to query the log at any time.
In the embodiment of the invention, the session retrieval module can respond to a session retrieval instruction sent by a target communication tool in at least one instant communication tool through a session retrieval service, and determine a retrieval dimension and a retrieval keyword according to the session retrieval instruction; according to the conversation retrieval dimension and the retrieval key words, determining retrieval data from the data stored in the conversation storage module, wherein the retrieval data is the data retrieved from the conversation storage module for conversation retrieval; and sending the search data to the target communication tool through the session search service so that the target communication tool displays the search data. According to the technical scheme, the stored session data can be retrieved, so that the use experience of a user is improved.
For better understanding of the technical solution of the embodiment of the present invention described above, an alternative example is provided herein. For example, referring to fig. 8, a session storage system may include: session acquisition subsystem, session processing subsystem, session storage subsystem, service extension subsystem, and service exposure subsystem. The session acquisition subsystem comprises a distributable task scheduling module, at least one data acquisition service and a retry service; the session processing subsystem includes high availability message middleware and at least one data consumption service; the session storage subsystem comprises a distributed storage database in a sampling master-slave mode; the service extension subsystem may include an encryption configuration center, a service extension module, and a database extension module.
The distributed task scheduling module may determine, for each of the at least one instant messaging tool, a target acquisition service corresponding to the instant messaging tool from the at least one data acquisition service. The target acquisition service can acquire session data encrypted into ciphertext such as private chat records, group chat records, file information, voice information, picture information and/or video information of the instant messaging tool, and push the session data to the session processing subsystem. The retry service may instruct the distributed task scheduling module to re-determine the target acquisition service corresponding to the instant messaging tool for the instant messaging tool in the event that the acquisition of session data by the target acquisition service fails. The high availability message middleware may receive the session data, determine a target consumption service corresponding to the session data from the at least one data consumption service, and send the session data to the target consumption service. The target consumption service can normalize the received session data to obtain normalized data, and send the normalized data to the session storage subsystem for the session storage subsystem to write in the normalized data. The distributed storage database can receive the normalized data, perform data slicing operation on the normalized data to obtain at least one sliced data, and perform sliced storage on the at least one sliced data. The encryption configuration center may determine a target extension service in response to the service extension instruction. The service extension module may update at least one extension-available service integrated in the service extension subsystem according to the target extension service, which may include, for example, a speech recognition service, a character recognition (Optical Character Recognition, OCR) service, a whitelist service, and/or a sensitive word service, among others. The database expansion module can determine whether the target expansion service needs to expand the corresponding database according to the service type of the target expansion service, and add the corresponding database for the target expansion service and the functions of log generation, abnormal condition early warning and the like for the database under the condition that the target expansion service needs to expand the corresponding database. The service exposure subsystem may determine at least one target support service supported by the target extension tool from at least one extension available service and/or other services provided in the session storage system, such as a session retrieval service, after updating the at least one instant messaging tool according to the accessed target extension tool, and perform a service exposure process for the target extension tool based on the at least one target support service; services exposed for the target extension tool may be provided to the target extension tool for data review, distributed data computation, real-time session detection, and/or risk early warning, for example.
It should be noted that at least one of the extended services available and/or other services provided in the session storage system in the embodiments of the present invention may be used not only to provide services for at least one instant messaging tool and corresponding functions, but also to provide services for the extension and implementation of functions within the session storage system.
It should be appreciated that various forms of the flows shown above may be used to reorder, add, or delete steps. For example, the steps described in the present invention may be performed in parallel, sequentially, or in a different order, so long as the desired results of the technical solution of the present invention are achieved, and the present invention is not limited herein.
The above embodiments do not limit the scope of the present invention. It will be apparent to those skilled in the art that various modifications, combinations, sub-combinations and alternatives are possible, depending on design requirements and other factors. Any modifications, equivalent substitutions and improvements made within the spirit and principles of the present invention should be included in the scope of the present invention.

Claims (10)

1. A session storage system, comprising: a session acquisition subsystem, a session processing subsystem and a session storage subsystem; wherein,
The session acquisition subsystem is used for acquiring session data of at least one instant messaging tool accessed by the session storage system and transmitting the session data to the session processing subsystem;
the session processing subsystem is used for receiving the session data, carrying out standardized processing on the session data to obtain standardized data, and sending the standardized data to the session storage subsystem;
the session storage subsystem is used for receiving the standardized data and storing the standardized data.
2. The system of claim 1, further comprising: a tool expansion subsystem;
the tool extension subsystem is configured to:
determining a target extension tool in response to the tool extension instruction;
performing access operation on the session storage system and the target extension tool;
and updating the at least one instant messaging tool according to the accessed target extension tool.
3. The system according to claim 1 or 2, further comprising: a service extension subsystem;
the service extension subsystem is configured to:
determining a target extension service in response to the service extension instruction;
And updating at least one extension available service integrated in the service extension subsystem according to the target extension service.
4. The system of claim 3, wherein the at least one extended availability service comprises a session detection service;
the session detection service is configured to:
acquiring the stored standardized data from the session storage subsystem;
and detecting the standardized data according to a preset detection rule and/or a keyword rule to obtain a session detection result, and sending the session detection result to the session storage subsystem so that the session storage subsystem stores the session detection result.
5. The system of claim 4, further comprising: the system management subsystem is used for expanding available services and also comprises early warning services;
the session detection service is further used for sending the session detection result to the early warning service;
the early warning service is used for receiving the session detection result and sending the abnormal information to the system management subsystem under the condition that the abnormal information exists in the session detection result;
The system management subsystem is used for sending out risk early warning based on a preset risk early warning rule under the condition that the abnormal information is received.
6. A system according to claim 3, further comprising: a service exposure subsystem;
the service exposure subsystem is used for determining at least one target support service supported by the target extension tool from the at least one extension available service after the at least one instant messaging tool is updated according to the accessed target extension tool, and carrying out service exposure processing on the target extension tool based on the at least one target support service.
7. The system of claim 1, wherein the session acquisition subsystem comprises a distributed task scheduling module and at least one data acquisition service;
the distributed task scheduling module is configured to determine, for each instant messaging tool in the at least one instant messaging tool, a target acquisition service corresponding to the instant messaging tool from the at least one data acquisition service;
the target acquisition service is used for acquiring the session data of the instant messaging tool and sending the session data to the session processing subsystem.
8. The system of claim 7, wherein the session processing subsystem comprises message middleware and at least one data consumption service;
the message middleware is used for receiving the session data, determining a target consumption service corresponding to the session data from the at least one data consumption service, and sending the session data to the target consumption service;
the target consumption service is used for carrying out standardization processing on the received session data to obtain standardized data, and sending the standardized data to the session storage subsystem.
9. The system of claim 1, wherein the session storage subsystem comprises a distributed storage database comprising a session storage module;
the session storage module is configured to:
receiving the standardized data, and performing data slicing operation on the standardized data to obtain at least one piece of sliced data;
and storing the at least one piece of sliced data in a slicing way.
10. The system of claim 9, wherein the session storage subsystem further comprises a session retrieval service, and wherein the distributed storage database further comprises a session retrieval module;
The session retrieval module is used for:
responding to a session retrieval instruction sent by a target communication tool in the at least one instant communication tool through the session retrieval service, and determining a retrieval dimension and a retrieval keyword;
determining retrieval data from the session storage module according to the session retrieval dimension and the retrieval key;
and sending the search data to the target communication tool through the session search service.
CN202311150431.1A 2023-09-06 2023-09-06 Session storage system Pending CN117097692A (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN202311150431.1A CN117097692A (en) 2023-09-06 2023-09-06 Session storage system

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN202311150431.1A CN117097692A (en) 2023-09-06 2023-09-06 Session storage system

Publications (1)

Publication Number Publication Date
CN117097692A true CN117097692A (en) 2023-11-21

Family

ID=88775258

Family Applications (1)

Application Number Title Priority Date Filing Date
CN202311150431.1A Pending CN117097692A (en) 2023-09-06 2023-09-06 Session storage system

Country Status (1)

Country Link
CN (1) CN117097692A (en)

Similar Documents

Publication Publication Date Title
van Baar et al. Digital forensics as a service: A game changer
CN107465549B (en) Distributed message processing method and system
US9955004B2 (en) System and method for utilizing customer data in a communication system
US9001673B2 (en) Outgoing communications inventory
CN100483405C (en) Method and system for alert delivery architecture
US11888805B2 (en) Method and apparatus for storing email messages
CN102055826B (en) Method and system for maintaining multi-dimensional related information related to contacts in address list
US20120158837A1 (en) Method and system for establishing a notification service for a device
US8001150B2 (en) Device management method using nodes having additional attribute and device management client thereof
CN103490978A (en) Terminal, server and message monitoring method
US8402043B2 (en) Analytics of historical conversations in relation to present communication
CN112445870A (en) Knowledge graph string parallel case analysis method based on mobile phone evidence obtaining electronic data
CN116185802A (en) User risk behavior monitoring method and device
CN109583615B (en) Conference room booking method, conference room booking system, conference room booking server and computer readable storage medium
CN111884843B (en) Message processing method and device, electronic equipment and storage medium
CN110888790B (en) Log management method and device, electronic equipment and storage medium
US20050021651A1 (en) Method and system for identification and presentation of statistical usage data for messaging systems
US9722956B2 (en) Managing electronic mail for an end-user that is unavailable
CN117097692A (en) Session storage system
CN110569295A (en) Method for improving document early warning by positioning keywords
CN114663089A (en) Data processing method and device, electronic equipment and storage medium
Kruger et al. State of the art in digital forensics for the internet of things
CN113595886A (en) Instant messaging message processing method and device, electronic equipment and storage medium
CN111666525A (en) Information interception system and method
CN111954013A (en) Live broadcast interaction method and device, terminal equipment, server and storage medium

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination