CN114153845A - Data storage and reading method, device, equipment and medium - Google Patents

Data storage and reading method, device, equipment and medium Download PDF

Info

Publication number
CN114153845A
CN114153845A CN202111406260.5A CN202111406260A CN114153845A CN 114153845 A CN114153845 A CN 114153845A CN 202111406260 A CN202111406260 A CN 202111406260A CN 114153845 A CN114153845 A CN 114153845A
Authority
CN
China
Prior art keywords
information
server
data
article
message queue
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
CN202111406260.5A
Other languages
Chinese (zh)
Inventor
曹磊
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Beijing Pierbulaini Software Co ltd
Original Assignee
Beijing Pierbulaini Software Co ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Beijing Pierbulaini Software Co ltd filed Critical Beijing Pierbulaini Software Co ltd
Priority to CN202111406260.5A priority Critical patent/CN114153845A/en
Publication of CN114153845A publication Critical patent/CN114153845A/en
Pending legal-status Critical Current

Links

Images

Classifications

    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/20—Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
    • G06F16/22—Indexing; Data structures therefor; Storage structures
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/20—Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
    • G06F16/22—Indexing; Data structures therefor; Storage structures
    • G06F16/2282—Tablespace storage structures; Management thereof
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/20—Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
    • G06F16/23—Updating
    • G06F16/2365—Ensuring data consistency and integrity
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/20—Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
    • G06F16/25—Integrating or interfacing systems involving database management systems
    • G06F16/252—Integrating or interfacing systems involving database management systems between a Database Management System and a front-end application
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/90—Details of database functions independent of the retrieved data types
    • G06F16/95—Retrieval from the web
    • G06F16/953—Querying, e.g. by the use of web search engines
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F9/00—Arrangements for program control, e.g. control units
    • G06F9/06—Arrangements for program control, e.g. control units using stored programs, i.e. using an internal store of processing equipment to receive or retain programs
    • G06F9/46—Multiprogramming arrangements
    • G06F9/54—Interprogram communication
    • G06F9/546—Message passing systems or structures, e.g. queues
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F2209/00—Indexing scheme relating to G06F9/00
    • G06F2209/54—Indexing scheme relating to G06F9/54
    • G06F2209/548—Queue

Landscapes

  • Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • Databases & Information Systems (AREA)
  • Physics & Mathematics (AREA)
  • General Engineering & Computer Science (AREA)
  • General Physics & Mathematics (AREA)
  • Data Mining & Analysis (AREA)
  • Software Systems (AREA)
  • Computer Security & Cryptography (AREA)
  • Information Retrieval, Db Structures And Fs Structures Therefor (AREA)

Abstract

The invention discloses a data storage and reading method, which comprises the following steps: classifying the article data to acquire first information and second information of the article data; adding the first information into a Kafka message queue, and storing the first information into a first server after the first information is consumed by the Kafka message queue; respectively storing the second information into different data tables of a second server, adding style serialization data to the second information, generating third information and storing the third information into a third server; according to a set time threshold, respectively completing consistency comparison of the second server with the data stored in the first server and the third server; and acquiring first information from the first server according to different application program interfaces, or acquiring second information from the second server, or acquiring third information from the third server. The method and the device can realize safe storage of article data and provide efficient article data query.

Description

Data storage and reading method, device, equipment and medium
Technical Field
The present invention relates to the field of internet technologies, and in particular, to a method and an apparatus for storing and reading data, an electronic device, and a storage medium.
Background
The internet articles are more and more, the content is more and more abundant, the related server is required to stably store the article data and quickly and accurately provide the article information for the searching user, the server in the prior art generally directly stores the internet articles in the database and provides a data port for the user, and the user directly reads the corresponding article data from the database, so that the method can be used for small access amount, but the server is easy to crash when large user amount is accessed simultaneously.
For such a problem, in the prior art, different database types are generally used to improve the data access amount and the data storage security, but the space that can be improved by the method is relatively small, and the problem of server downtime cannot be substantially changed, and another technology is to store part of information in a cache to improve the efficiency of a user for accessing article data, but the time efficiency of the method is relatively poor, and with the increase of internet articles, the occupancy rate of a memory will be increased, which also affects the processing speed of a computer.
Therefore, there is a need for a method that can ensure the stability of article data storage by changing the storage manner of the article data, and at the same time, improve the fluency of the user in accessing and retrieving the article information quickly, without causing downtime.
Disclosure of Invention
To this end, the present invention provides a method, an apparatus, an electronic device and a storage medium for data storage and reading in an attempt to solve or at least alleviate at least one of the problems presented above.
According to one aspect of the present invention, a method for storing and reading data is provided, the method stores abstract information and full-text information of article data in different servers respectively, and realizes stable storage and fast reading of the article data, the method includes the steps of:
classifying the article data to acquire first information and second information of the article data, wherein the first information is abstract information of the article data, and the second information is full text information of the article data; adding the first information into a Kafka message queue according to the first information, and storing the first information into a first server after the Kafka message queue consumes the first information, wherein the first server is a search server ElasticSearch; respectively storing the second information into different data tables of a second server according to different purposes of the second information, adding style serialization data to the second information in the different data tables of the second server, generating third information and storing the third information into a third server, wherein the second server is a SqlServer cluster of a dual-active cluster, and the third server is a data server HBase; according to a set time threshold, consistency comparison of data stored in the first server and the second server and consistency comparison of data stored in the second server and the third server are respectively completed; and acquiring first information from the first server according to different application program interfaces, or acquiring second information from the second server, or acquiring third information from the third server.
Optionally, the step of classifying the article data and acquiring the first information and the second information of the article data includes: the method comprises the steps of obtaining article data issued by a merchant, wherein the article data comprises article titles, abstract text information, content text information, picture information, article serial numbers, merchant serial numbers and article data valid time information; according to the article data issued by the merchant, acquiring first information and second information in the article data, wherein the first information is abstract information of the article data, and the abstract information comprises: the article serial number, the abstract text information, the first picture in the picture information, the merchant serial number and the article data valid time information, wherein the second information is full text information of the article data, and the full text information comprises: the article information comprises article titles, content text information, picture information, article serial numbers, merchant serial numbers and article data valid time information.
Optionally, the step of adding the first information to a Kafka message queue according to the first information, and storing the first information in the first server after the Kafka message queue consumes the first information includes: adding the first information into a Kafka message queue to obtain a first information process list of the Kafka message queue; acquiring the consumed monitoring information of the first information process list of the Kafka message queue according to the first information process list of the Kafka message queue; according to the monitoring information consumed in the first information process list of the Kafka message queue, obtaining the data format of the consumed first information, converting the data format of the consumed first information into the data storage format of the first server, and storing the consumed first information into the first server, wherein the first server is a search server ElasticSearch.
Optionally, the step of adding the first information to a Kafka message queue according to the first information, and storing the first information in the first server after the Kafka message queue consumes the first information, further includes: adding one or more pieces of first information stored in the first server into a Kafka message queue to obtain a first information process list of the Kafka message queue; acquiring the consumed monitoring information of the first information process list of the Kafka message queue according to the first information process list of the Kafka message queue; and updating the first information consumed in the first server according to the monitoring information consumed in the first information process list of the Kafka message queue.
Optionally, the step of respectively storing the second information into different data tables of a second server according to different uses of the second information, and generating and storing third data into a third server after adding style serialization data to the second information in the different data tables of the second server includes: acquiring all application program interfaces connected with the second information and a data table of each application program interface in the second server; according to all application program interfaces connected with the second information and a data table of each application program interface in the second server, respectively storing the second information into the data table of the second server corresponding to the application program interfaces; adding style serialization data to the second information according to the second information stored in a data table of the second server by each application program interface to acquire third information, wherein the third information is suitable for the data format of the corresponding application program interface; and storing the third information into a third server corresponding to the application program interface.
Optionally, the second server is a data server SqlServer cluster of a dual active cluster, the data server SqlServer cluster of the dual active cluster is two sets of data server SqlServer clusters respectively deployed in two regions, the two sets of data server SqlServer clusters simultaneously store second information, of the two sets of data server SqlServer clusters, a first set of data server SqlServer cluster is a production cluster and is used for providing data read-write service, and a second set of data server SqlServer cluster is a backup cluster and is used for taking over data read service of the first set of data server SqlServer cluster when the first set of data server SqlServer cluster fails; the two sets of data server SqlServer clusters are in a master-slave mode and comprise a master server and a plurality of slave servers, wherein the master server provides a data writing operation for writing second information into the second server, and the slave servers provide a data reading operation for reading the second information from the second server.
Optionally, the step of comparing the consistency of the data stored in the first server and the second server includes: updating first information stored in the first server and second information stored in the second server; respectively acquiring first information from the first server and second information from the second server; judging whether the second information has corresponding first information or not; and if not, writing or deleting the first information which does not correspond to the second information in the first server.
Optionally, the step of comparing the consistency of the data stored in the second server with the consistency of the data stored in the third server includes: updating second information stored in the second server and third information stored in the third server; setting a timestamp, and acquiring second information in a set number of second servers and third information in a third server within a timestamp range; judging whether the second information has corresponding third information; and if not, writing or deleting third information which does not correspond to the second information in the third server. .
According to another aspect of the present invention, there is disclosed an apparatus for storing and reading data, which realizes stable storage and fast reading of article data by storing abstract information and full-text information of the article data in different servers, respectively, the apparatus comprising: the article data processing module is used for classifying article data to acquire first information and second information of the article data, wherein the first information is abstract information of the article data, and the second information is full text information of the article data; the information storage module is used for adding the first information into a Kafka message queue according to the first information, and storing the first information into a first server after the Kafka message queue consumes the first information, wherein the first server is a search server ElasticSearch; respectively storing the second information into different data tables of a second server according to different purposes of the second information, adding style serialization data to the second information in the different data tables of the second server, generating third information and storing the third information into a third server, wherein the second server is a SqlServer cluster of a dual-active cluster, and the third server is a data server HBase; the information comparison module is used for respectively finishing consistency comparison of the data stored in the first server and the second server and consistency comparison of the data stored in the second server and the data stored in the third server according to a set time threshold; and the information reading module is used for acquiring first information from the first server according to different application program interfaces, or acquiring second information from the second server, or acquiring third information from the third server.
According to yet another aspect of the present invention, there is provided a computing device comprising: one or more processors; and a memory; one or more programs, wherein the one or more programs are stored in the memory and configured to be executed by the one or more processors, the one or more programs including instructions for performing any of the methods of data storage and reading as described above.
According to a further aspect of the present invention there is provided a computer readable storage medium storing one or more programs, the one or more programs comprising instructions, which when executed by a computing device, cause the computing device to perform any of the methods of data storage and reading described above.
According to the scheme of data storage and reading, article data are classified to obtain first information and second information of the article data; adding the first information into a Kafka message queue, and storing the first information into a first server after the first information is consumed by the Kafka message queue; respectively storing the second information into different data tables of a second server, and generating third information and storing the third information into a third server after adding style serialization data to the second information in the different data tables of the second server; according to a set time threshold, consistency comparison of data stored in the first server and the second server and consistency comparison of data stored in the second server and the third server are respectively completed; and acquiring first information from the first server according to different application program interfaces, or acquiring second information from the second server, or acquiring third information from the third server. The method and the device can realize safe storage of article data and provide efficient article data query.
Drawings
To the accomplishment of the foregoing and related ends, certain illustrative aspects are described herein in connection with the following description and the annexed drawings, which are indicative of various ways in which the principles disclosed herein may be practiced, and all aspects and equivalents thereof are intended to be within the scope of the claimed subject matter. The above and other objects, features and advantages of the present disclosure will become more apparent from the following detailed description read in conjunction with the accompanying drawings. Throughout this disclosure, like reference numerals generally refer to like parts or elements.
FIG. 1 shows a schematic diagram of a configuration of a computing device 100 according to one embodiment of the invention; and
FIG. 2 illustrates a flow diagram of a method 200 of data storage and reading according to one embodiment of the invention; and
fig. 3 is a schematic structural diagram of an apparatus 300 for storing and reading data according to an embodiment of the present invention.
Detailed Description
Exemplary embodiments of the present disclosure will be described in more detail below with reference to the accompanying drawings. While exemplary embodiments of the present disclosure are shown in the drawings, it should be understood that the present disclosure may be embodied in various forms and should not be limited to the embodiments set forth herein. Rather, these embodiments are provided so that this disclosure will be thorough and complete, and will fully convey the scope of the disclosure to those skilled in the art.
Fig. 1 is a block diagram of an example computing device 100. In a basic configuration 102, computing device 100 typically includes system memory 106 and one or more processors 104. A memory bus 108 may be used for communication between the processor 104 and the system memory 106.
Depending on the desired configuration, the processor 104 may be any type of processing, including but not limited to: a microprocessor (μ P), a microcontroller (μ C), a Digital Signal Processor (DSP), or any combination thereof. The processor 104 may include one or more levels of cache, such as a level one cache 110 and a level two cache 112, a processor core 114, and registers 116. The example processor core 114 may include an Arithmetic Logic Unit (ALU), a Floating Point Unit (FPU), a digital signal processing core (DSP core), or any combination thereof. The example memory controller 118 may be used with the processor 104, or in some implementations the memory controller 118 may be an internal part of the processor 104.
Depending on the desired configuration, system memory 106 may be any type of memory, including but not limited to: volatile memory (such as RAM), non-volatile memory (such as ROM, flash memory, etc.), or any combination thereof. System memory 106 may include an operating system 120, one or more applications 122, and program data 124. In some embodiments, application 122 may be arranged to operate with program data 124 on an operating system. In some embodiments, the computing device 100 is configured to execute a method 200 of storing and reading data, the method 200 can realize stable storage and fast reading of the article data by storing abstract information and full-text information of the article data in different servers respectively, and the program data 124 includes instructions for executing the method 200.
Computing device 100 may also include an interface bus 140 that facilitates communication from various interface devices (e.g., output devices 142, peripheral interfaces 144, and communication devices 146) to the basic configuration 102 via the bus/interface controller 130. The example output device 142 includes a graphics processing unit 148 and an audio processing unit 150. They may be configured to facilitate communication with various external devices, such as a display or speakers, via one or more a/V ports 152. Example peripheral interfaces 144 may include a serial interface controller 154 and a parallel interface controller 156, which may be configured to facilitate communication with external devices such as input devices (e.g., keyboard, mouse, pen, voice input device, touch input device) or other peripherals (e.g., printer, scanner, etc.) via one or more I/O ports 158. An example communication device 146 may include a network controller 160, which may be arranged to facilitate communications with one or more other computing devices 162 over a network communication link via one or more communication ports 164.
A network communication link may be one example of a communication medium. Communication media may typically be embodied by computer readable instructions, data structures, program modules, and may include any information delivery media, such as carrier waves or other transport mechanisms, in a modulated data signal. A "modulated data signal" may be a signal that has one or more of its data set or its changes made in such a manner as to encode information in the signal. By way of non-limiting example, communication media may include wired media such as a wired network or private-wired network, and various wireless media such as acoustic, Radio Frequency (RF), microwave, Infrared (IR), or other wireless media. The term computer readable media as used herein may include both storage media and communication media. In some embodiments, one or more programs are stored in a computer readable medium, the one or more programs including instructions for performing certain methods, such as the method 200 for performing data storage and retrieval by the computing device 100 according to embodiments of the present invention.
Computing device 100 may be implemented as part of a small-form factor portable (or mobile) electronic device such as a cellular telephone, a Personal Digital Assistant (PDA), a personal media player device, a wireless web-watch device, a personal headset device, an application specific device, or a hybrid device that include any of the above functions. Computing device 100 may also be implemented as a personal computer including both desktop and notebook computer configurations.
FIG. 2 shows a flow diagram of a method 200 of data storage and reading according to one embodiment of the invention. As shown in fig. 2, the method 200 is to store abstract information and full-text information of article data in different servers respectively to achieve stable storage and fast reading of the article data, and the method 200 begins with step S210 to classify the article data and obtain first information and second information of the article data, where the first information is the abstract information of the article data, and the second information is the full-text information of the article data.
Specifically, the article data is an article about automobile information such as automobile sales, automobile product introduction and the like published by an automobile manufacturer or a seller on the internet, the article data contains a large number of words and pictures, each article data contains an article title and abstract words of the article, and the network automatically generates a serial number of the article, a serial number of a merchant and set article data effective time information, so that the article data can be divided into two parts for one article data, one part is used for simply obtaining the subject meaning of the article, namely the abstract information of the article, the other part is used for the full text data of the article, the full text information of the article data is used for the user to know the full text information of the article data, and the article data is divided into the abstract information and the full text information, which is helpful for improving the search efficiency of the user, for example, the user wants to search for folded article data of an automobile, the article data which the user wants can be obtained by retrieving the abstract information without obtaining the full-text information of the article data, so that on one hand, the retrieved data volume is greatly reduced, and on the other hand, the user can conveniently and quickly obtain the target article.
Specifically, in an embodiment of the present application, the step of classifying the article data and acquiring the first information and the second information of the article data includes:
the method comprises the steps of obtaining article data issued by a merchant, wherein the article data comprises article titles, abstract text information, content text information, picture information, article serial numbers, merchant serial numbers and article data valid time information; specifically, when a merchant publishes data on the internet through a background management system, the following article data content needs to be made: the article title is displayed at the top end of a corresponding webpage by a user, and the article title is generally a high summary of article contents; abstract text information, which is used for summarizing main text contents of article data in a short language and generally comprises dozens of characters; content text information, all text information of article data, and all contents of articles issued by merchants are described in detail; the picture information can comprise one or more pictures and is used for assisting to introduce the character information of articles published by merchants; the article serial number is generated automatically by the background management system when a merchant enters the background management system to release articles; the system comprises a merchant serial number, a background management system and a service platform, wherein the merchant serial number is used for automatically acquiring a unique serial number corresponding to a merchant after the merchant completes registration of corresponding content in the background management system of the Internet platform; the article data valid time information is set to be from the release time to the discount end time in order to improve the timeliness of issuing articles by merchants, for example, when a certain type of automobile is sold at a discount in a limited time, the article data valid time information is automatically deleted or corresponding content is not displayed to internet clients any more after the article data valid time information is reached.
According to the article data issued by the merchant, acquiring first information and second information in the article data, wherein the first information is abstract information of the article data, and the abstract information comprises: the article serial number, the abstract text information, the first picture in the picture information, the merchant serial number and the article data valid time information, wherein the second information is full text information of the article data, and the full text information comprises: the article information comprises article titles, content text information, picture information, article serial numbers, merchant serial numbers and article data valid time information. Specifically, after the article data is released by a merchant in a background management system of an internet platform, the article data can be divided into first information and second information according to a corresponding data module of the article data and stored respectively, the first information is abstract information of the article data, that is, core content of the article information can be known approximately through the first information, but detailed content cannot be known, and meanwhile, as the data contained in the first information is less, an internet user can search quickly and conveniently to obtain the core content of the article data, the second information is full-text information of the article data, which is detailed content of the article data, and after the internet user obtains the second information, the whole content of the article data can be known. In a specific implementation, for example, after a user searches a keyword, a first information list containing the keyword in the first information can be quickly obtained by the search system, because the data in the first information is less and the retrieval time of each first information is also less, the efficiency of retrieving the first information is greatly improved for retrieving the same number of first information lists and article data, the internet user can obtain the summary information which is interested by the internet user through the retrieved first information list, the second information corresponding to the first information can be obtained by clicking a certain first information list, namely the full text information of the article data is obtained, the directivity of the data link is strong, so that the speed of acquiring the second information is high, and the purpose of acquiring the target article data by the internet user is realized more quickly.
Through step S220, adding the first information into a Kafka message queue according to the first information, and storing the first information into a first server after the Kafka message queue consumes the first information, where the first server is a search server ElasticSearch.
Specifically, in order to improve the stability of data storage, first information is added into Kafka message queues, first information to be stored is queued through the Kafka message queues, after the first information in each Kafka message queue is consumed, the first information is stored into a first server, because the first information in the Kafka message queues is consumed one by one according to a queue mode, when a plurality of merchants simultaneously issue first information of a plurality of article data, the Kafka message queues add the first information into a list, so that the first information is stored one by one according to the list without confusion on storage when being stored, the first server is a search server, the search server is an elastic search server based on Lucene, which provides a full-text search engine with distributed multi-user capability, and based on a tful web interface, the search server is used as an open source code issuing clause under Apache license, is a popular enterprise-level search engine.
Specifically, in an embodiment of the present application, the step of adding the first information to a Kafka message queue according to the first information, and storing the first information in a first server after the Kafka message queue consumes the first information includes:
adding the first information into a Kafka message queue to obtain a first information process list of the Kafka message queue; specifically, after the first information is added to the Kafka message queue, the first information process list of the Kafka message queue to which the current first information is added can be acquired, when a plurality of first information are simultaneously added to the Kafka message queue, the Kafka message queue generates the first information process list according to a set rule, and the first information process list is used for queuing the plurality of first information to be stored, so that the first information waits for being processed according to the order of the process list.
Acquiring the consumed monitoring information of the first information process list of the Kafka message queue according to the first information process list of the Kafka message queue; specifically, the consumption of the first information process list means that a certain first information in the first information process list is processed, and the processing at this time is to notify the first information to perform a storage operation, because the first server does not know which first information in the Kafka message queue is consumed, it is necessary to set a process to monitor which first information in the first information process list is consumed in real time, and after the first server receives the monitored information in the first information process list of the Kafka message queue, the first server obtains the consumed first information through the information in the first information process list that is consumed.
According to the monitoring information consumed in the first information process list of the Kafka message queue, obtaining the data format of the consumed first information, converting the data format of the consumed first information into the data storage format of the first server, and storing the consumed first information into the first server, wherein the first server is a search server ElasticSearch. Specifically, after the first server acquires the first information consumed in the first information process list of the Kafka message queue, the content of the first information is acquired, the data format of the first information is converted into the data format stored by the first server, and after the format conversion is completed, the consumed first information can be stored in the first server.
Specifically, in an embodiment of the present application, the step of adding the first information to a Kafka message queue according to the first information, and storing the first information in the first server after the Kafka message queue consumes the first information further includes:
adding one or more pieces of first information stored in the first server into a Kafka message queue to obtain a first information process list of the Kafka message queue;
acquiring the consumed monitoring information of the first information process list of the Kafka message queue according to the first information process list of the Kafka message queue;
and updating the first information consumed in the first server according to the monitoring information consumed in the first information process list of the Kafka message queue.
Specifically, the above steps are that the merchant modifies or deletes the published article data, the merchant sends the first information to be modified or deleted to the Kafka message queue, because the article data has a corresponding article serial number, when one article data needs to be modified, only the article serial number needs to be acquired, after sending the modified or deleted first information to the Kafka message queue, the first information in the first information process list is consumed, and then the first information is stored in the first server again, the update of the first information of the same article serial number is completed, and if the first information is a deletion instruction, the first information of the corresponding article serial number stored in the first server is deleted.
Through step S230, according to different uses of the second information, the second information is respectively stored in different data tables of a second server, and after adding style serialization data to the second information in the different data tables of the second server, third information is generated and stored in a third server, where the second server is a SqlServer cluster of a dual active cluster, and the third server is a data server HBase.
Specifically, different terminal user interfaces need different data patterns, for example, the data patterns that can be received by a windows operating system, an andiron operating system and an IOS operating system are different, and the method further includes some special terminal devices, for each type of terminal, the second server sets a corresponding data table, the second server stores the second data into different data tables according to different terminal applications, the second information of each data table is added with pattern serialization data according to the corresponding terminal format to generate third information, the third information at this time is the data pattern that can be directly read by the corresponding terminal device, the third information is stored into the third server again, the second server is a data server SqlServer cluster of a dual-active cluster, that is, the first data server SqlServer cluster is set to store the second information, then, a second data server SqlServer cluster is arranged in a different place to serve as a backup of the first data server SqlServer cluster, and when the first data server SqlServer cluster fails to be used, the second data server SqlServer cluster takes over the first data server SqlServer cluster to provide data service. The third server is a data server HBase, and the data server HBase is a distributed and column-oriented open source database.
Specifically, in an embodiment of the present application, the step of respectively storing the second information into different data tables of a second server according to different uses of the second information, and after adding style serialization data to the second information in the different data tables of the second server, generating third data and storing the third data into a third server includes:
acquiring all application program interfaces connected with the second information and a data table of each application program interface in the second server; specifically, each application program interface corresponds to one terminal device, and therefore, the second server provides one data table for each application program interface according to different application program interfaces, that is, when the second server is connected to different application program interfaces, because the terminal devices connected to the application program interfaces are different and the data formats that can be received by different terminal devices may be different, the data formats that can be received by the corresponding application program interfaces are the same, and therefore, according to the types of the application program interfaces connected to the second server, the data tables with the same number of types of the application program interfaces are set, and each data table corresponds to one type of application program interface, so that the application program interface can obtain the second information of the data format adapted thereto.
According to all application program interfaces connected with the second information and a data table of each application program interface in the second server, respectively storing the second information into the data table of the second server corresponding to the application program interfaces; specifically, the second server sets a data table according to the style of each application program interface, and each application program interface is connected to a terminal device, so when a terminal device needs to acquire the second information in the second server, the second information needs to be stored in the data table of the second server corresponding to the application program interface connected to the terminal device.
Adding style serialization data to the second information according to the second information stored in a data table of the second server by each application program interface to acquire third information, wherein the third information is suitable for the data format of the corresponding application program interface; specifically, after the second information is stored in the data tables of the second servers in a classified manner, a storage area of a corresponding third server is set for each data table of the second server, and style serialization data is added to the second information stored in the data table of each second server to generate third information.
And storing the third information into a third server corresponding to the application program interface. Specifically, similar to the second server, the third server also provides a storage space for each style of application program interface, and stores the third information in the third server corresponding to the application program interface, that is, stores the third information in the storage space corresponding to the application program in the third server, so that the terminal device of the internet user can obtain the corresponding third information, that is, the article data, according to the corresponding application program interface. It should be noted that the data content between the second information and the third information is not changed, the second information and the third information are full-text information of the article data, the difference between the second information and the third information is that the data formats are different, the second information is only to store the full-text information of the article data in the data table of the second server corresponding to the application interface program, and the third information is to adaptively change the data format of the second information stored in the data table of the second server and the data format of the corresponding application interface program.
Specifically, in an embodiment of the present application, the second server is a SqlServer cluster of a dual active cluster, the SqlServer cluster of the dual active cluster is two sets of SqlServer clusters respectively deployed in two regions, the two sets of SqlServer clusters simultaneously store second information, and of the two sets of SqlServer clusters, a first set of SqlServer cluster is a production cluster and is used for providing data read-write service, and a second set of SqlServer cluster is a backup cluster and is used for taking over data read service of the first set of SqlServer cluster when the first set of SqlServer cluster fails;
the two sets of data server SqlServer clusters are in a master-slave mode and comprise a master server and a plurality of slave servers, wherein the master server provides a data writing operation for writing second information into the second server, and the slave servers provide a data reading operation for reading the second information from the second server.
Correspondingly, the third servers also comprise two sets of third servers, and the two sets of third servers respectively correspond to the two sets of second servers. Specifically, for example, when a merchant issues article data, second information of the article data is written into the main server; when the internet user reads the second information through the application interface program, the data is read from the server. In specific implementation, the number of slave servers can be set according to the size of the traffic, and a request for reading data is sent to one of the slave servers in a set distribution mode.
Through step S240, according to the set time threshold, consistency comparison between the data stored in the first server and the second server, and between the data stored in the second server and the data stored in the third server are respectively completed.
Specifically, the purpose of consistency comparison is to ensure that first information stored in a first server and second information stored in a second server are kept synchronous, and second information stored in the second server and third information stored in a third server are kept synchronous, so that article information stored in the first server, the second server and the third server is kept synchronous. Particularly, consistency comparison does not need to be performed in real time, because if real-time comparison is performed, the overhead of computer content is very large, which affects data processing efficiency, and the requirement of consistency comparison is not necessary, for example, even if consistency comparison is not performed, article data stored in a first server, a second server, and a third server are out of step, which may cause that an internet user may not obtain part of article data content in a certain server, and may not affect the article data itself or the server itself, but through consistency comparison, the internet user may obtain better service experience, and may obtain all article data.
Specifically, in an embodiment of the present application, the step of comparing the consistency of the data stored in the first server and the second server includes:
updating first information stored in the first server and second information stored in the second server;
respectively acquiring first information from the first server and second information from the second server;
judging whether the second information has corresponding first information or not;
and if not, writing or deleting the first information which does not correspond to the second information in the first server.
Specifically, in an embodiment of the present application, the step of comparing the consistency of the data stored in the second server with the consistency of the data stored in the third server includes:
updating second information stored in the second server and third information stored in the third server;
setting a timestamp, and acquiring second information in a set number of second servers and third information in a third server within a timestamp range; specifically, the purpose of setting the time stamp is to improve the performance of the server for storing data, and if the time stamp is not set, the second information stored by the second server and the third information stored by the third server are updated continuously, and the third information stored by the third server is generated after the second information is stored by the second server and the pattern serialization data is added to the third information, so that the problem that the third information stored in the third server does not correspond to the second information stored in the second server exists.
Judging whether the second information has corresponding third information;
and if not, writing or deleting third information which does not correspond to the second information in the third server.
Specifically, the first information in the first server, the third information in the third server and the second information in the second server are kept consistent through consistency comparison, so that the third information can be obtained after the internet user retrieves the first information.
In step S250, first information is obtained from the first server, or second information is obtained from the second server, or third information is obtained from the third server according to different application program interfaces.
Specifically, the different application program interfaces read the article data from the different servers, for example, if the application program interface is an article list, the first information, that is, the abstract of the article data, can be obtained from the first server, and if the application program interface is an application program interface of the full text of the article, the third information, that is, the full text information of the article data, can be obtained from the third server.
According to the scheme of data storage and reading, article data are classified to obtain first information and second information of the article data; adding the first information into a Kafka message queue, and storing the first information into a first server after the first information is consumed by the Kafka message queue; respectively storing the second information into different data tables of a second server, and generating third information and storing the third information into a third server after adding style serialization data to the second information in the different data tables of the second server; according to a set time threshold, consistency comparison of data stored in the first server and the second server and consistency comparison of data stored in the second server and the third server are respectively completed; and acquiring first information from the first server according to different application program interfaces, or acquiring second information from the second server, or acquiring third information from the third server. The method can realize the safe storage of the article data, provide efficient article data query, divide the article data into abstract information and full-text information, store the abstract information and the full-text information into different servers respectively, fully utilize the advantages of different servers, achieve the purposes of safe storage and quick access, ensure the data synchronization in each server through consistency comparison between the servers, and ensure the data server SqlServer cluster configuration of the dual-active cluster, so that when one data server SqlServer cluster fails, the other data server SqlServer cluster can take over the work, and ensure the safety of data storage.
It should be understood that, although the steps in the flowchart of fig. 2 are shown in order as indicated by the arrows, the steps are not necessarily performed in order as indicated by the arrows. The steps are not performed in the exact order shown and described, and may be performed in other orders, unless explicitly stated otherwise. Moreover, at least a portion of the steps in fig. 2 may include multiple sub-steps or multiple stages that are not necessarily performed at the same time, but may be performed at different times, and the order of performance of the sub-steps or stages is not necessarily sequential, but may be performed in turn or alternately with other steps or at least a portion of the sub-steps or stages of other steps.
In one embodiment, as shown in fig. 3, there is provided an apparatus 300 for storing and reading data, wherein the apparatus 300 realizes stable storage and fast reading of article data by storing abstract information and full-text information of the article data in different servers respectively, and the apparatus 300 comprises: the system comprises an article data processing module, an information storage module, an information comparison module and an information reading module.
The article data processing module is used for classifying article data to acquire first information and second information of the article data, wherein the first information is abstract information of the article data, and the second information is full text information of the article data;
the information storage module is used for adding the first information into a Kafka message queue according to the first information, and storing the first information into a first server after the Kafka message queue consumes the first information, wherein the first server is a search server ElasticSearch; respectively storing the second information into different data tables of a second server according to different purposes of the second information, adding style serialization data to the second information in the different data tables of the second server, generating third information and storing the third information into a third server, wherein the second server is a SqlServer cluster of a dual-active cluster, and the third server is a data server HBase;
the information comparison module is used for respectively finishing consistency comparison of the data stored in the first server and the second server and consistency comparison of the data stored in the second server and the data stored in the third server according to a set time threshold;
and the information reading module is used for acquiring first information from the first server according to different application program interfaces, or acquiring second information from the second server, or acquiring third information from the third server.
Specifically, in another embodiment of the present application, the article data processing module is configured to acquire article data issued by a merchant, where the article data includes article titles, abstract text information, content text information, picture information, article serial numbers, merchant serial numbers, and article data valid time information; according to the article data issued by the merchant, acquiring first information and second information in the article data, wherein the first information is abstract information of the article data, and the abstract information comprises: the article serial number, the abstract text information, the first picture in the picture information, the merchant serial number and the article data valid time information, wherein the second information is full text information of the article data, and the full text information comprises: the article information comprises article titles, content text information, picture information, article serial numbers, merchant serial numbers and article data valid time information.
Specifically, in another embodiment of the present application, the information storage module is configured to add the first information into a Kafka message queue, and obtain a first information process list of the Kafka message queue; acquiring the consumed monitoring information of the first information process list of the Kafka message queue according to the first information process list of the Kafka message queue; according to the monitoring information consumed in the first information process list of the Kafka message queue, obtaining the data format of the consumed first information, converting the data format of the consumed first information into the data storage format of the first server, and storing the consumed first information into the first server, wherein the first server is a search server ElasticSearch.
Specifically, in another embodiment of the present application, the information storage module is configured to add one or more pieces of first information stored in the first server into a Kafka message queue, and obtain a first information process list of the Kafka message queue; acquiring the consumed monitoring information of the first information process list of the Kafka message queue according to the first information process list of the Kafka message queue; and updating the first information consumed in the first server according to the monitoring information consumed in the first information process list of the Kafka message queue.
Specifically, in another embodiment of the present application, the information storage module is configured to obtain all application program interfaces connected to the second information and a data table of each application program interface in the second server; according to all application program interfaces connected with the second information and a data table of each application program interface in the second server, respectively storing the second information into the data table of the second server corresponding to the application program interfaces; adding style serialization data to the second information according to the second information stored in a data table of the second server by each application program interface to acquire third information, wherein the third information is suitable for the data format of the corresponding application program interface; and storing the third information into a third server corresponding to the application program interface.
Specifically, in another embodiment of the present application, the second server of the information storage module is a SqlServer cluster of a dual active cluster, the SqlServer cluster of the dual active cluster is two sets of SqlServer clusters respectively deployed in two regions, the two sets of SqlServer clusters simultaneously store second information, and of the two sets of SqlServer clusters, the first set of SqlServer cluster is a production cluster and is used for providing data read-write service, and the second set of SqlServer cluster is a backup cluster and is used for taking over data read service of the first set of SqlServer cluster when the first set of SqlServer cluster fails; the two sets of data server SqlServer clusters are in a master-slave mode and comprise a master server and a plurality of slave servers, wherein the master server provides a data writing operation for writing second information into the second server, and the slave servers provide a data reading operation for reading the second information from the second server.
Specifically, in another embodiment of the present application, the information comparison module is configured to update first information stored in the first server and second information stored in the second server; respectively acquiring first information from the first server and second information from the second server; judging whether the second information has corresponding first information or not; and if not, writing or deleting the first information which does not correspond to the second information in the first server.
Specifically, in another embodiment of the present application, the information comparing module is configured to update the second information stored in the second server and the third information stored in the third server; setting a timestamp, and acquiring second information in a set number of second servers and third information in a third server within a timestamp range; judging whether the second information has corresponding third information; and if not, writing or deleting third information which does not correspond to the second information in the third server.
According to the scheme of data storage and reading, article data are classified through an article data processing module, and first information and second information of the article data are acquired; adding the first information into a Kafka message queue through an information storage module according to the first information, and storing the first information into a first server after the first information is consumed by the Kafka message queue; respectively storing the second information into different data tables of a second server according to different purposes of the second information, and generating third information and storing the third information into a third server after adding style serialization data to the second information in the different data tables of the second server; the consistency comparison of the data stored in the first server and the second server and the consistency comparison of the data stored in the second server and the data stored in the third server are respectively completed through an information comparison module according to a set time threshold; and acquiring first information from the first server, or acquiring second information from the second server, or acquiring third information from the third server through an information reading module according to different application program interfaces. The method can realize the safe storage of the article data, provide efficient article data query, divide the article data into abstract information and full-text information, store the abstract information and the full-text information into different servers respectively, fully utilize the advantages of different servers, achieve the purposes of safe storage and quick access, ensure the data synchronization in each server through consistency comparison between the servers, and ensure the data server SqlServer cluster configuration of the dual-active cluster, so that when one data server SqlServer cluster fails, the other data server SqlServer cluster can take over the work, and ensure the safety of data storage.
A8, the method according to A1, wherein the step of consistency comparison of the data stored in the second server and the third server comprises: updating second information stored in the second server and third information stored in the third server; setting a timestamp, and acquiring second information in a set number of second servers and third information in a third server within a timestamp range; judging whether the second information has corresponding third information; and if not, writing or deleting third information which does not correspond to the second information in the third server.
It should be appreciated that in the foregoing description of exemplary embodiments of the invention, various features of the invention are sometimes grouped together in a single embodiment, figure, or description thereof for the purpose of streamlining the disclosure and aiding in the understanding of one or more of the various inventive aspects. However, the disclosed method should not be interpreted as reflecting an intention that: that the invention as claimed requires more features than are expressly recited in each claim. Rather, as the following claims reflect, inventive aspects lie in less than all features of a single foregoing disclosed embodiment. Thus, the claims following the detailed description are hereby expressly incorporated into this detailed description, with each claim standing on its own as a separate embodiment of this invention.
Those skilled in the art will appreciate that the modules or units or components of the devices in the examples disclosed herein may be arranged in a device as described in this embodiment or alternatively may be located in one or more devices different from the devices in this example. The modules in the foregoing examples may be combined into one module or may be further divided into multiple sub-modules.
Those skilled in the art will appreciate that the modules in the device in an embodiment may be adaptively changed and disposed in one or more devices different from the embodiment. The modules or units or components of the embodiments may be combined into one module or unit or component, and furthermore they may be divided into a plurality of sub-modules or sub-units or sub-components. All of the features disclosed in this specification (including any accompanying claims, abstract and drawings), and all of the processes or elements of any method or apparatus so disclosed, may be combined in any combination, except combinations where at least some of such features and/or processes or elements are mutually exclusive. Each feature disclosed in this specification (including any accompanying claims, abstract and drawings) may be replaced by alternative features serving the same, equivalent or similar purpose, unless expressly stated otherwise.
Furthermore, those skilled in the art will appreciate that while some embodiments described herein include some features included in other embodiments, rather than other features, combinations of features of different embodiments are meant to be within the scope of the invention and form different embodiments. For example, in the following claims, any of the claimed embodiments may be used in any combination.
Furthermore, some of the described embodiments are described herein as a method or combination of method elements that can be performed by a processor of a computer system or by other means of performing the described functions. A processor having the necessary instructions for carrying out the method or method elements thus forms a means for carrying out the method or method elements. Further, the elements of the apparatus embodiments described herein are examples of the following apparatus: the apparatus is used to implement the functions performed by the elements for the purpose of carrying out the invention.
As used herein, unless otherwise specified the use of the ordinal adjectives "first", "second", "third", etc., to describe a common object, merely indicate that different instances of like objects are being referred to, and are not intended to imply that the objects so described must be in a given sequence, either temporally, spatially, in ranking, or in any other manner.
While the invention has been described with respect to a limited number of embodiments, those skilled in the art, having benefit of this description, will appreciate that other embodiments can be devised which do not depart from the scope of the invention as described herein. Furthermore, it should be noted that the language used in the specification has been principally selected for readability and instructional purposes, and may not have been selected to delineate or circumscribe the inventive subject matter. Accordingly, many modifications and variations will be apparent to those of ordinary skill in the art without departing from the scope and spirit of the appended claims. The present invention has been disclosed in an illustrative rather than a restrictive sense, and the scope of the present invention is defined by the appended claims.

Claims (10)

1. A data storage and reading method, the said method realizes the stable storage and fast reading of article data by storing the abstract information and full text information of the article data in different servers respectively, the said method includes the step:
classifying the article data to acquire first information and second information of the article data, wherein the first information is abstract information of the article data, and the second information is full text information of the article data;
adding the first information into a Kafka message queue according to the first information, and storing the first information into a first server after the Kafka message queue consumes the first information, wherein the first server is a search server ElasticSearch;
respectively storing the second information into different data tables of a second server according to different purposes of the second information, adding style serialization data to the second information in the different data tables of the second server, generating third information and storing the third information into a third server, wherein the second server is a SqlServer cluster of a dual-active cluster, and the third server is a data server HBase;
according to a set time threshold, consistency comparison of data stored in the first server and the second server and consistency comparison of data stored in the second server and the third server are respectively completed;
and acquiring first information from the first server according to different application program interfaces, or acquiring second information from the second server, or acquiring third information from the third server.
2. The method of claim 1, wherein the step of classifying the article data and obtaining the first information and the second information of the article data comprises:
the method comprises the steps of obtaining article data issued by a merchant, wherein the article data comprises article titles, abstract text information, content text information, picture information, article serial numbers, merchant serial numbers and article data valid time information;
according to the article data issued by the merchant, acquiring first information and second information in the article data, wherein the first information is abstract information of the article data, and the abstract information comprises: the article serial number, the abstract text information, the first picture in the picture information, the merchant serial number and the article data valid time information, wherein the second information is full text information of the article data, and the full text information comprises: the article information comprises article titles, content text information, picture information, article serial numbers, merchant serial numbers and article data valid time information.
3. The method of claim 1, wherein said adding said first information to a Kafka message queue based on said first information and storing said first information in a first server after said Kafka message queue consumes said first information comprises:
adding the first information into a Kafka message queue to obtain a first information process list of the Kafka message queue;
acquiring the consumed monitoring information of the first information process list of the Kafka message queue according to the first information process list of the Kafka message queue;
according to the monitoring information consumed in the first information process list of the Kafka message queue, obtaining the data format of the consumed first information, converting the data format of the consumed first information into the data storage format of the first server, and storing the consumed first information into the first server, wherein the first server is a search server ElasticSearch.
4. The method of claim 3, wherein said step of adding said first information to a Kafka message queue based on said first information and storing said first information in a first server after said Kafka message queue consumes said first information further comprises:
adding one or more pieces of first information stored in the first server into a Kafka message queue to obtain a first information process list of the Kafka message queue;
acquiring the consumed monitoring information of the first information process list of the Kafka message queue according to the first information process list of the Kafka message queue;
and updating the first information consumed in the first server according to the monitoring information consumed in the first information process list of the Kafka message queue.
5. The method of claim 1, wherein the step of storing the second information in different data tables of a second server according to different purposes of the second information, and generating and storing third data in a third server after adding style serialization data to the second information in different data tables of the second server comprises:
acquiring all application program interfaces connected with the second information and a data table of each application program interface in the second server;
according to all application program interfaces connected with the second information and a data table of each application program interface in the second server, respectively storing the second information into the data table of the second server corresponding to the application program interfaces;
adding style serialization data to the second information according to the second information stored in a data table of the second server by each application program interface to acquire third information, wherein the third information is suitable for the data format of the corresponding application program interface;
and storing the third information into a third server corresponding to the application program interface.
6. The method of claim 1, wherein the second server is a SqlServer cluster of a dual active cluster, the SqlServer cluster of the dual active cluster is two sets of SqlServer clusters respectively deployed in two regions, the two sets of SqlServer clusters simultaneously store second information, and of the two sets of SqlServer clusters, a first set of SqlServer cluster is a production cluster and is used for providing data read-write services, and a second set of SqlServer cluster is a backup cluster and is used for taking over data read services of the first set of SqlServer cluster when the first set of SqlServer cluster fails;
the two sets of data server SqlServer clusters are in a master-slave mode and comprise a master server and a plurality of slave servers, wherein the master server provides a data writing operation for writing second information into the second server, and the slave servers provide a data reading operation for reading the second information from the second server.
7. The method of claim 1, wherein the step of consistency comparison of the data stored in the first server and the second server comprises:
updating first information stored in the first server and second information stored in the second server;
respectively acquiring first information from the first server and second information from the second server;
judging whether the second information has corresponding first information or not;
and if not, writing or deleting the first information which does not correspond to the second information in the first server.
8. An apparatus for storing and reading data, the apparatus realizes the stable storage and the fast reading of article data by respectively storing abstract information and full text information of the article data into different servers, the apparatus comprising:
the article data processing module is used for classifying article data to acquire first information and second information of the article data, wherein the first information is abstract information of the article data, and the second information is full text information of the article data;
the information storage module is used for adding the first information into a Kafka message queue according to the first information, and storing the first information into a first server after the Kafka message queue consumes the first information, wherein the first server is a search server ElasticSearch; respectively storing the second information into different data tables of a second server according to different purposes of the second information, adding style serialization data to the second information in the different data tables of the second server, generating third information and storing the third information into a third server, wherein the second server is a SqlServer cluster of a dual-active cluster, and the third server is a data server HBase;
the information comparison module is used for respectively finishing consistency comparison of the data stored in the first server and the second server and consistency comparison of the data stored in the second server and the data stored in the third server according to a set time threshold;
and the information reading module is used for acquiring first information from the first server according to different application program interfaces, or acquiring second information from the second server, or acquiring third information from the third server.
9. An electronic device, comprising:
one or more processors; and
a memory;
one or more programs, wherein the one or more programs are stored in the memory and configured to be executed by the one or more processors, the one or more programs comprising instructions for performing any of the methods of claims 1-7.
10. A computer readable storage medium storing one or more programs, the one or more programs comprising instructions, which when executed by a computing device, cause the computing device to perform any of the methods of claims 1-7.
CN202111406260.5A 2021-11-24 2021-11-24 Data storage and reading method, device, equipment and medium Pending CN114153845A (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN202111406260.5A CN114153845A (en) 2021-11-24 2021-11-24 Data storage and reading method, device, equipment and medium

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN202111406260.5A CN114153845A (en) 2021-11-24 2021-11-24 Data storage and reading method, device, equipment and medium

Publications (1)

Publication Number Publication Date
CN114153845A true CN114153845A (en) 2022-03-08

Family

ID=80457852

Family Applications (1)

Application Number Title Priority Date Filing Date
CN202111406260.5A Pending CN114153845A (en) 2021-11-24 2021-11-24 Data storage and reading method, device, equipment and medium

Country Status (1)

Country Link
CN (1) CN114153845A (en)

Similar Documents

Publication Publication Date Title
US9282153B2 (en) Content suggestion for posting on communication network
US20140114822A1 (en) Method and system for creating tax configuration templates
EP3188051B1 (en) Systems and methods for search template generation
JP2020074193A (en) Search method, device, facility, and non-volatile computer memory
US20210382896A1 (en) High Efficiency Data Querying
CN106326243B (en) Data processing method and device
US20200204688A1 (en) Picture book sharing method and apparatus and system using the same
CA3154763A1 (en) Data operation method, device and system
JP2017220204A (en) Method and system for matching images with content using whitelists and blacklists in response to search query
CN113377289B (en) Cache management method, system, computing device and readable storage medium
US11200201B2 (en) Metadata storage method, device and server
CN110955719B (en) Data access processing equipment, system and method
CN111241137A (en) Data processing method and device, electronic equipment and storage medium
CN113535650B (en) File naming method and computing device
CN105574010B (en) Data query method and device
CN111444448B (en) Data processing method, server and system
CN113434501A (en) Storage method and device of relational database table and readable storage medium
CN112883307B (en) Cache updating method and device and social network system
CN104615620A (en) Map search type identification method and device and map search method and system
CN114153845A (en) Data storage and reading method, device, equipment and medium
CN107463590B (en) Automatic session phase discovery
US20180074867A1 (en) Provide copy of notebook document
CN113821514A (en) Data splitting method and device, electronic equipment and readable storage medium
CN113194127B (en) Data storage method, data transmission method and computing equipment
CN112115163A (en) Data aggregation method and device, storage medium and electronic equipment

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination