CN111414387B - Method and equipment for querying streaming data based on full-memory calculation - Google Patents

Method and equipment for querying streaming data based on full-memory calculation Download PDF

Info

Publication number
CN111414387B
CN111414387B CN202010189737.8A CN202010189737A CN111414387B CN 111414387 B CN111414387 B CN 111414387B CN 202010189737 A CN202010189737 A CN 202010189737A CN 111414387 B CN111414387 B CN 111414387B
Authority
CN
China
Prior art keywords
stream
data
event
streaming data
event window
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
CN202010189737.8A
Other languages
Chinese (zh)
Other versions
CN111414387A (en
Inventor
刘睿民
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Beijing birui Data Technology Co.,Ltd.
Original Assignee
Weixun Boray Data Technology Beijing Co ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Weixun Boray Data Technology Beijing Co ltd filed Critical Weixun Boray Data Technology Beijing Co ltd
Priority to CN202010189737.8A priority Critical patent/CN111414387B/en
Publication of CN111414387A publication Critical patent/CN111414387A/en
Application granted granted Critical
Publication of CN111414387B publication Critical patent/CN111414387B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/20Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
    • G06F16/24Querying
    • G06F16/245Query processing
    • G06F16/2455Query execution
    • G06F16/24568Data stream processing; Continuous queries
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/20Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
    • G06F16/24Querying
    • G06F16/245Query processing
    • G06F16/2453Query optimisation

Landscapes

  • Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • Computational Linguistics (AREA)
  • Data Mining & Analysis (AREA)
  • Databases & Information Systems (AREA)
  • Physics & Mathematics (AREA)
  • General Engineering & Computer Science (AREA)
  • General Physics & Mathematics (AREA)
  • Information Retrieval, Db Structures And Fs Structures Therefor (AREA)

Abstract

The invention discloses a method and a device for inquiring streaming data based on full memory calculation, wherein the method comprises the following steps: the method comprises the steps of receiving a data query request sent by a user, determining a query result from an event window of a stream processing process of stream data according to the data query request, wherein the stream processing process is a stream adaptation process and a stream connection process, the event window is a window for receiving and accumulating the stream data in the stream connection process, and then returning the query result to the user.

Description

Method and equipment for querying streaming data based on full-memory calculation
Technical Field
The present application relates to the field of real-time stream data processing, and more particularly, to a method and an apparatus for querying stream data based on full memory computation.
Background
The stream data is a group of sequential, large-volume, rapid and continuous arriving data sequences, and generally, the stream data can be regarded as a dynamic data set which grows infinitely along with the time duration and is applied to the fields of network monitoring, sensor networks, aerospace, meteorological measurement and control, financial services and the like.
In the prior art, data processing is mainly divided into two modes of batch processing and micro-batch processing.
The batch processing technology based on the disk is mainly used for processing historical data, namely managing and operating "static" data, and mainly operates a large-capacity, bounded and persistent-storage static data set, and the processing mode has the following defects when oriented to stream data: firstly, the processed data is bounded, that is, the processed data is limited in amount and limited to a limited data set, and is not suitable for operation by unbounded stream data; secondly, batch processing depends heavily on persistent storage, each task needs to execute reading and writing operations for many times, frequently interacts with a disk, is limited by a certain time node or data scale during data processing, and returns a calculation result after the calculation process is completed, so that the query performance is low, the response speed is slow, the processing performance always has large delay, and the delay is continuously increased along with the continuous increase of the data amount.
In order to improve the processing efficiency of the streaming data, the continuous streaming data is processed by simulating streaming processing in a micro-batch processing mode. Despite the significant reduction in latency, the bounded nature of the amount of data processed remains unsolved, making it difficult to meet real-time (or near real-time) processing and analysis requirements for streaming data, especially where the amount of data is large and continues to increase, the latency becomes increasingly significant.
Therefore, in the prior art, when stream data is queried, only bounded data can be queried, the response speed is low, and the processing efficiency is low.
Disclosure of Invention
Aiming at the problems of limited data query, low response speed and low processing efficiency in the process of querying stream data in the prior art, the invention provides a method for querying stream data based on full-memory computation, which is applied to a memory system comprising a plurality of memory databases connected in parallel, and comprises the following steps:
receiving a data query request sent by a user;
determining a query result from an event window of a stream processing process of stream data according to the data query request, wherein the stream processing process is specifically a stream adaptation process and a stream connection process, and the event window is a window for receiving and accumulating the stream data in the stream connection process;
and returning the query result to the user.
Preferably, before receiving a data query request issued by a user, the method further comprises:
obtaining a notification including the amount of streaming data based on a listening streaming data event, the streaming data event being triggered when the streaming data enters the memory system;
establishing the stream processing progress matched with the number according to the notification;
writing the stream data into a preset named pipeline according to a preset format based on the stream adaptation process, wherein the stream adaptation process corresponds to the named pipeline one by one;
receiving and accumulating the stream data in the named pipe based on the event window, wherein the event window is established synchronously with the stream processing progress.
Preferably, after returning the query result to the user, the method further includes:
and deleting or storing the data in the query result.
Preferably, the preset format is comma separated value CSV format, and the named pipe is Linux named pipe.
Preferably, the event window is closed when there is no streaming data entering the memory system.
Correspondingly, the invention also provides a device for querying streaming data based on full-memory computing, which is applied to a memory system comprising a plurality of memory databases connected in parallel, and comprises:
the receiving module is used for receiving a data query request sent by a user;
a determining module, configured to determine a query result from an event window of a stream processing process of stream data according to the data query request, where the stream processing process is specifically a stream adaptation process and a stream connection process, and the event window is a window for receiving and accumulating the stream data in the stream connection process;
and the return module is used for returning the query result to the user.
Preferably, the method further comprises the following steps:
an obtaining module configured to obtain a notification including the number of the stream data based on a stream data monitoring event, where the stream data event is triggered when the stream data enters the memory system;
the writing module is used for writing the stream data into a preset named pipeline according to a preset format based on the stream adaptation process, and the stream adaptation process corresponds to the named pipeline one by one;
and the accumulation module is used for receiving and accumulating the stream data in the named pipeline based on the event window, and the event window is established synchronously with the stream processing process.
Preferably, the data processing module is further included for:
and deleting or storing the data in the query result.
Preferably, the preset format is a comma separated value CSV format, and the named pipe is a Linux named pipe.
Preferably, the system further comprises a closing module for:
and closing the event window when the streaming data entering the memory system does not exist.
The invention discloses a method and a device for inquiring streaming data based on full memory calculation, wherein the method comprises the following steps: the method comprises the steps of receiving a data query request sent by a user, determining a query result from an event window of a stream processing process of stream data according to the data query request, wherein the stream processing process is a stream adaptation process and a stream connection process, the event window is a window for receiving and accumulating the stream data in the stream connection process, and then returning the query result to the user.
Drawings
In order to more clearly illustrate the technical solutions in the embodiments of the present application, the drawings needed to be used in the description of the embodiments are briefly introduced below, and it is obvious that the drawings in the following description are only some embodiments of the present application, and it is obvious for those skilled in the art to obtain other drawings based on these drawings without creative efforts.
Fig. 1 is a schematic flowchart illustrating a method for querying streaming data based on full-memory computation according to an embodiment of the present application;
fig. 2 is a schematic flowchart illustrating a method for querying streaming data based on full-memory computation according to another embodiment of the present application;
fig. 3 is a schematic flowchart illustrating a method for querying streaming data based on full-memory computation according to yet another embodiment of the present application;
fig. 4 is a schematic flowchart illustrating a method for querying streaming data based on full-memory computation according to another embodiment of the present application;
fig. 5 is a schematic structural diagram illustrating a device for querying streaming data based on full-memory computation according to an embodiment of the present application;
FIG. 6 is a schematic diagram illustrating a prior art disk-based batch processing technique proposed by an embodiment of the present application;
fig. 7 is a schematic process diagram illustrating a method for querying streaming data based on full-memory computation according to an embodiment of the present application;
fig. 8 shows a schematic process diagram of the stream adaptation process delivering the stream data in the embodiment of the present application.
Detailed Description
The technical solutions in the embodiments of the present application will be clearly and completely described below with reference to the drawings in the embodiments of the present application, and it is obvious that the described embodiments are only a part of the embodiments of the present application, and not all of the embodiments. All other embodiments, which can be derived by a person skilled in the art from the embodiments given herein without making any creative effort, shall fall within the protection scope of the present application.
With the development of various industries in modern society, the information of stream data of various industries is more and more huge, and the processing of a set of data sequence which is sequentially, massively, rapidly and continuously arrived, such as stream data, is more and more important.
The inventor finds in research that processing of stream data in various industries is processing of historical data, data processed by a disk-based batch processing technology in the prior art is bounded and is limited to a limited data set, the disk-based batch processing technology depends heavily on persistent storage, each task needs to perform multiple read and write operations, the data processing is limited by a certain time node or data size, the result is returned after the calculation process is completed, the query performance is low, the response speed is slow, the processing performance is delayed greatly, and the delay is more obvious as the data amount is increased.
Specifically, as shown in fig. 6, in the batch processing technology based on a disk in the prior art, a received data stream is stored in the disk first, when an application sends an inquiry signal to a memory system, the memory system needs to load data from the disk first, and then the memory system performs calculation and returns a result to the application.
However, in the prior art, the micro batch processing method processes the continuous data stream by simulating stream processing, and also cannot solve the problem of the boundedness of the processed data, so that the real-time (or near real-time) processing and analyzing requirements of the stream data are difficult to meet.
Therefore, the inventor proposes a method for querying streaming data based on full memory computation, which can improve the above problems.
In order to further illustrate the technical idea of the present invention, embodiments of the present application will be specifically described below with reference to the accompanying drawings and specific application scenarios so as to explain the technical solution of the present invention.
Full memory, i.e., data, is not only computed in memory, but is also stored in memory. And (4) full-memory calculation, namely, data needs to be completely loaded into a memory for calculation, and the database based on the full-memory calculation is a full-memory database.
Referring to fig. 1, an embodiment of the present application provides a method for querying streaming data based on full-memory computation, which is applied to a memory system including a plurality of memory databases connected in parallel, where the method includes:
step S101: and receiving a data query request sent by a user.
It can be understood that, when inquiring streaming data, it is necessary to receive a data inquiry request from a user through a terminal device.
It should be noted that the memory system proposed in the present application is a memory system including a plurality of full memory databases connected in parallel, and the system further stores at least one full memory database instance operated by the plurality of memory databases in parallel, the terminal device may be different terminal devices such as a mobile phone and a personal computer, and the protection range of the present application is not affected by different devices applied by a user or different ways of sending a data query request.
Step S102: determining a query result from an event window of a stream processing process of stream data according to the data query request, wherein the stream processing process is specifically a stream adaptation process and a stream connection process, and the event window is a window for receiving and accumulating the stream data in the stream connection process.
In order to quickly query real-time stream data, an event window and its corresponding configuration, i.e. a stream processing process, are created for real-time query computation, and a stream adaptation process and a stream connection process in the stream processing process are created synchronously, wherein the event window receives and accumulates stream data and provides a query, and the size of the event window generally depends on the size of a stream data event.
Specifically, an event window is arranged in a stream processing process of the stream data, when the memory system provided by the application receives the stream data, the stream data is received and accumulated through the event window so as to facilitate subsequent query operation, after the memory system receives a data query request from a user in the above steps, the data query request is sent to the event window for access query, that is, the event window is used for receiving, accumulating and processing the stream data, and meanwhile, when the user sends the query request, the data accumulated in the event window is used for completing access query of the stream and returning a query result.
Step S103: and returning the query result to the user.
Specifically, as shown in fig. 7, after the user sends a data query request to the memory system provided in the present application, the user returns a query result to the user after completing the access query of the stream through the event window.
The method for inquiring the streaming data based on the full-memory calculation receives a data inquiry request sent by a user, determines an inquiry result from an event window of a streaming processing process of streaming data according to the data inquiry request, wherein the streaming processing process is a stream adaptation process and a stream connection process, the event window is a window for receiving and accumulating the streaming data in the stream connection process, and then returns the inquiry result to the user.
Referring to fig. 2, another embodiment of the present application provides a method for querying a data stream based on full memory computation, which is applied to a memory system including a plurality of memory databases connected in parallel, where the method includes:
step S201: obtaining a notification including the amount of streaming data based on a snoop streaming data event, the data event being triggered when the streaming data enters a memory system.
Specifically, the memory system provided by the present application may set a stream data event listener at a stream data receiving end, and once stream data enters, the stream data event listener may determine the amount of the stream data, and may send a determination result to the full memory database instance in the memory system of the present application in a form of notification, where the stream data event is triggered when the stream data enters the memory system of the present application.
Step S202: and establishing a stream processing process matched with the number according to the notification, wherein the stream processing process specifically comprises a stream adaptation process and a stream connection process.
Specifically, the full-memory stream database instance in the memory system receives a notification sent by a stream data event listener, determines the amount of stream data according to the notification, and then creates one or more stream data adapters and stream data connectors, i.e., a stream adaptation process and a stream connection process, according to the amount, where the stream adaptation process and the stream connection process are the stream processing process in the present application.
Step S203: and writing the stream data into a preset named pipeline according to a preset format based on the stream adaptation process, wherein the stream adaptation process corresponds to the named pipeline one by one.
Specifically, the stream adaptation process converts the stream data in the original format into the stream data in the preset format, and writes the converted stream data into a preset named pipeline, where the preset format may be a comma separated value CSV format, and the named pipeline may be a Linux pipeline.
Specifically, as shown in fig. 8, the stream adaptation process converts stream data from an original format into a data stream in a preset format, writes the stream data converted into the preset format into a preset naming pipeline, so as to perform data transmission, then connects the transmitted stream data with a stream connection process corresponding to the stream adaptation process, and the stream connection process processes the stream data after format conversion using an event window, and accumulates the stream data after format conversion in the event window, and once a user sends a query request, the data accumulated in the event window is used to complete an access query on the stream, where it is to be noted that the stream adaptation process is implemented by a stream adapter, and the stream connection process is implemented by a stream connector.
The stream adaptation processes are in one-to-one correspondence with the named pipes, and each stream adaptation process corresponds to one named pipe.
It should be noted that the preset format and the preset pipeline are not limited to the CSV format and the Linux pipeline of comma separated values, and the different formats and pipelines may be preset according to actual needs in a specific application scenario, and any changes that may be considered by those skilled in the art should be included in the scope of protection of the present application.
Step S204: receiving and accumulating the stream data in the named pipe based on an event window, wherein the event window is established synchronously with the stream processing progress.
Specifically, the stream join process receives and accumulates stream data delivered through the named pipe using an event window, and completes data query on the stream through data accumulated in the event window to obtain a data query result, and the event window is synchronously created when a stream process, that is, a stream adaptation process and a stream join process, are configured.
Step S205: and receiving a data query request sent by a user.
Step S206: and determining a query result from the event window according to the data query request.
Step S207: and returning the query result to the user.
The method for inquiring the streaming data based on the full-memory calculation receives a data inquiry request sent by a user, determines an inquiry result from an event window of a streaming processing process of streaming data according to the data inquiry request, wherein the streaming processing process is a stream adaptation process and a stream connection process, the event window is a window for receiving and accumulating the streaming data in the stream connection process, and then returns the inquiry result to the user.
Referring to fig. 3, another embodiment of the present invention provides a method for querying streaming data based on full-memory computation, which is applied to a memory system including a plurality of memory databases connected in parallel, and the method includes:
step S301: and receiving a data query request sent by a user.
Step S302: determining a query result from an event window of a stream processing process of stream data according to the data query request, wherein the stream processing process is specifically a stream adaptation process and a stream connection process, and the event window is a window for receiving and accumulating the stream data in the stream connection process.
Step S303: and returning the query result to the user.
Step S304: and deleting or storing the data in the query result.
Specifically, after the current data query request is completed and the query result is returned, the query result may be deleted or stored according to actual needs, and the event window continues to accumulate the stream data and waits for the next query.
The method for inquiring the streaming data based on the full-memory calculation receives a data inquiry request sent by a user, determines an inquiry result from an event window of a streaming processing process of streaming data according to the data inquiry request, wherein the streaming processing process is a stream adaptation process and a stream connection process, the event window is a window for receiving and accumulating the streaming data in the stream connection process, and then returns the inquiry result to the user.
Referring to fig. 4, a method for querying streaming data based on full-memory computation according to another embodiment of the present application is applied to a memory system including a plurality of memory databases connected in parallel, and the method includes:
step S401: and receiving a data query request sent by a user.
Step S402: determining a query result from an event window of a stream processing process of stream data according to the data query request, wherein the stream processing process is specifically a stream adaptation process and a stream connection process, and the event window is a window for receiving and accumulating the stream data in the stream connection process.
Step S403: and returning the query result to the user.
Step S404: and closing the event window when the streaming data entering the memory system does not exist.
Specifically, in order to save system resources, when there is no data query request and no stream data enters the memory system, the memory system closes the event window.
The method for inquiring the streaming data based on the full-memory calculation receives a data inquiry request sent by a user, determines an inquiry result from an event window of a streaming processing process of streaming data according to the data inquiry request, wherein the streaming processing process is a stream adaptation process and a stream connection process, the event window is a window for receiving and accumulating the streaming data in the stream connection process, and then returns the inquiry result to the user.
In order to achieve the above technical object, an embodiment of the present application further provides an apparatus for querying streaming data based on full-memory computation, which is applied to a memory system including a plurality of memory databases connected in parallel, and as shown in fig. 8, the apparatus includes:
the receiving module 501 is configured to receive a data query request sent by a user.
A determining module 502, configured to determine a query result from an event window of a stream processing process of stream data according to the data query request, where the stream processing process is specifically a stream adaptation process and a stream connection process, and the event window is a window for receiving and accumulating the stream data in the stream connection process.
A returning module 503, configured to return the query result to the user.
In a specific application scenario, the method further includes:
an obtaining module to obtain a notification including the amount of the streaming data based on a listening streaming data event, the streaming data event being triggered when the streaming data enters the memory system.
And the writing module is used for writing the stream data into a preset named pipeline according to a preset format based on the stream adaptation process, and the stream adaptation process corresponds to the named pipeline one by one.
And the accumulation module is used for receiving and accumulating the stream data in the named pipeline based on the event window, and the event window is established synchronously with the stream processing process.
In a specific application scenario, the system further comprises a data processing module, configured to:
and deleting or storing the data in the query result.
In a specific application scenario, the method further includes:
the preset format is a comma separated value CSV format, and the named pipeline is a Linux named pipeline.
In a specific application scenario, the system further comprises a closing module, configured to:
and closing the event window when the streaming data entering the memory system does not exist.
Those skilled in the art will appreciate that the figures are merely schematic representations of one preferred implementation scenario and that the blocks or flow diagrams in the figures are not necessarily required to practice the present invention.
Those skilled in the art will appreciate that the modules in the apparatus may be distributed in the apparatus according to the description of the implementation scenario, or may be located in one or more apparatuses different from the present implementation scenario with corresponding changes. The modules of the implementation scenario may be combined into one module, or may be further split into a plurality of sub-modules.
Finally, it should be noted that: the above embodiments are only used to illustrate the technical solutions of the present application, and not to limit the same; although the present application has been described in detail with reference to the foregoing embodiments, it will be understood by those of ordinary skill in the art that: the technical solutions described in the foregoing embodiments may still be modified, or some technical features may be equivalently replaced; such modifications and substitutions do not necessarily depart from the spirit and scope of the corresponding technical solutions in the embodiments of the present application.

Claims (10)

1. A method for querying streaming data based on full-memory computing is applied to a memory system comprising a plurality of memory databases connected in parallel, and is characterized in that the method comprises the following steps:
receiving a data query request sent by a user;
before receiving a data query request sent by a user, the method further comprises the following steps:
obtaining a notification including the amount of streaming data based on a listening streaming data event, the streaming data event being triggered when the streaming data enters the memory system;
establishing a stream processing process matched with the number according to the notification;
determining a query result from an event window of a stream processing process of stream data according to the data query request, wherein the stream processing process is specifically a stream adaptation process and a stream connection process, and the event window is a window for receiving and accumulating the stream data in the stream connection process;
and returning the query result to the user.
2. The method of claim 1, wherein the stream data is written in a preset format into a preset named pipe based on the stream adaptation process, and the stream adaptation process corresponds to the named pipe one to one;
receiving and accumulating the stream data in the named pipe based on the event window, wherein the event window is established synchronously with the stream processing progress.
3. The method of claim 1, after returning the query results to the user, further comprising:
and deleting or storing the data in the query result.
4. The method of claim 2, wherein the predetermined format is a comma separated values CSV format and the named pipe is a Linux named pipe.
5. The method of claim 1, further comprising closing the event window when there is no streaming data entering the memory system.
6. An apparatus for querying streaming data based on full-memory computation, applied to a memory system including a plurality of memory databases connected in parallel, the apparatus comprising:
the receiving module is used for receiving a data query request sent by a user;
a determining module, configured to determine a query result from an event window of a stream processing process of stream data according to the data query request, where the stream processing process is specifically a stream adaptation process and a stream connection process, and the event window is a window for receiving and accumulating the stream data in the stream connection process;
the return module is used for returning the query result to the user;
wherein the apparatus further comprises:
an obtaining module to obtain a notification including the amount of the streaming data based on a listening streaming data event, the streaming data event being triggered when the streaming data enters the memory system.
7. The apparatus of claim 6, further comprising:
the writing module is used for writing the stream data into a preset named pipeline according to a preset format based on the stream adaptation process, and the stream adaptation process corresponds to the named pipeline one by one;
and the accumulation module is used for receiving and accumulating the stream data in the named pipeline based on the event window, and the event window is established synchronously with the stream processing process.
8. The device of claim 6, further comprising a data processing module to:
and deleting or storing the data in the query result.
9. The apparatus of claim 7,
the preset format is a comma separated value CSV format, and the named pipeline is a Linux named pipeline.
10. The device of claim 6, further comprising a shutdown module to:
and closing the event window when the streaming data entering the memory system does not exist.
CN202010189737.8A 2020-03-18 2020-03-18 Method and equipment for querying streaming data based on full-memory calculation Active CN111414387B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN202010189737.8A CN111414387B (en) 2020-03-18 2020-03-18 Method and equipment for querying streaming data based on full-memory calculation

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN202010189737.8A CN111414387B (en) 2020-03-18 2020-03-18 Method and equipment for querying streaming data based on full-memory calculation

Publications (2)

Publication Number Publication Date
CN111414387A CN111414387A (en) 2020-07-14
CN111414387B true CN111414387B (en) 2021-11-12

Family

ID=71493086

Family Applications (1)

Application Number Title Priority Date Filing Date
CN202010189737.8A Active CN111414387B (en) 2020-03-18 2020-03-18 Method and equipment for querying streaming data based on full-memory calculation

Country Status (1)

Country Link
CN (1) CN111414387B (en)

Families Citing this family (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN111858655A (en) * 2020-07-21 2020-10-30 威讯柏睿数据科技(北京)有限公司 Static data query method and device based on memory calculation
CN112765218A (en) * 2021-01-29 2021-05-07 威讯柏睿数据科技(北京)有限公司 Multi-level security protection stream data processing method and system

Family Cites Families (14)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101119583A (en) * 2006-08-01 2008-02-06 华为技术有限公司 Multi-service flow transferring method, base station and subscriber terminal
US8122006B2 (en) * 2007-05-29 2012-02-21 Oracle International Corporation Event processing query language including retain clause
US8180801B2 (en) * 2009-07-16 2012-05-15 Sap Ag Unified window support for event stream data management
JP5396184B2 (en) * 2009-07-31 2014-01-22 株式会社日立製作所 Computer system and stream data distribution processing method using a plurality of computers
CN101996097A (en) * 2009-08-26 2011-03-30 鸿富锦精密工业(深圳)有限公司 Process management system
CN102096720B (en) * 2011-02-24 2013-06-05 天津书生投资有限公司 Document library system
CN102592192A (en) * 2011-12-27 2012-07-18 浙江省电力公司 Information operating maintenance and management system
CN103491078B (en) * 2013-09-11 2017-04-12 深圳市九洲电器有限公司 Multimedia gateway multichannel data access method and multimedia gateway
CN106649691A (en) * 2016-12-19 2017-05-10 雷桦松 Stream data storage method and device
US11132778B2 (en) * 2017-03-29 2021-09-28 Nec Corporation Image analysis apparatus, image analysis method, and recording medium
CN109213778B (en) * 2017-07-07 2023-07-18 北方工业大学 Stream data sliding window gathering query method
CN109614413B (en) * 2018-12-12 2023-03-24 上海金融期货信息技术有限公司 Memory flow type computing platform system
CN111400351A (en) * 2020-03-18 2020-07-10 威讯柏睿数据科技(北京)有限公司 Method and device for inquiring streaming data based on distributed parallel architecture
CN111414386B (en) * 2020-03-18 2021-06-18 威讯柏睿数据科技(北京)有限公司 Method and device for inquiring flow data based on distributed architecture

Also Published As

Publication number Publication date
CN111414387A (en) 2020-07-14

Similar Documents

Publication Publication Date Title
CN109803004B (en) Block chain intelligent contract management method and device, electronic equipment and storage medium
CN111414387B (en) Method and equipment for querying streaming data based on full-memory calculation
CN109710405B (en) Block chain intelligent contract management method and device, electronic equipment and storage medium
CN111414386B (en) Method and device for inquiring flow data based on distributed architecture
CN110737536B (en) Message storage method and message reading method based on shared memory
CN104584524A (en) Aggregating data in a mediation system
CN112506619B (en) Job processing method, job processing device, electronic equipment and storage medium
CN112328688B (en) Data storage method, device, computer equipment and storage medium
CN112559219A (en) Internet of things offline message management method, device, equipment and storage medium
CN112422485B (en) Communication method and device of transmission control protocol
CN111813666A (en) Memory leak positioning method, device, medium and electronic equipment
CN113778644B (en) Task processing method, device, equipment and storage medium
CN114265904A (en) Data processing method and cloud computing platform
CN111400351A (en) Method and device for inquiring streaming data based on distributed parallel architecture
CN109829014B (en) Method and device for acquiring test data
WO2023169251A1 (en) Index determination method and apparatus, and server and medium
CN114338472B (en) Capacity testing method, device, equipment, medium and product of map server
US9437205B2 (en) Method, application, and device for audio signal transmission
CN113691605A (en) Data transmission method and device, electronic equipment and storage medium
CN113094272A (en) Application testing method and device, electronic equipment and computer readable medium
CN105337778A (en) Internet of Things event-driven service management system
CN114449052B (en) Data compression method and device, electronic equipment and storage medium
CN114461146B (en) Cloud storage data processing method, device, system, equipment, medium and product
CN113225228B (en) Data processing method and device
CN115993942B (en) Data caching method, device, electronic equipment and computer readable medium

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant
CP03 Change of name, title or address

Address after: Room 701, floor 7, building 3, courtyard 6, lizexi street, Chaoyang District, Beijing 100102

Patentee after: Beijing birui Data Technology Co.,Ltd.

Address before: No. 201-a193, unit 1, building 17, yard 3, gaolizhang Road, Haidian District, Beijing 100095

Patentee before: WEIXUN BORAY DATA TECHNOLOGY (BEIJING) Co.,Ltd.

CP03 Change of name, title or address