US20120239681A1 - Scalable interactive display of distributed data - Google Patents

Scalable interactive display of distributed data Download PDF

Info

Publication number
US20120239681A1
US20120239681A1 US13/223,167 US201113223167A US2012239681A1 US 20120239681 A1 US20120239681 A1 US 20120239681A1 US 201113223167 A US201113223167 A US 201113223167A US 2012239681 A1 US2012239681 A1 US 2012239681A1
Authority
US
United States
Prior art keywords
event
references
computing devices
plurality
ordered
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Abandoned
Application number
US13/223,167
Inventor
Steve Yu Zhang
Stephen Phillip Sorkin
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Splunk Inc
Original Assignee
Splunk Inc
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Priority to US201161452591P priority Critical
Application filed by Splunk Inc filed Critical Splunk Inc
Priority to US13/223,167 priority patent/US20120239681A1/en
Assigned to SPLUNK INC. reassignment SPLUNK INC. ASSIGNMENT OF ASSIGNORS INTEREST (SEE DOCUMENT FOR DETAILS). Assignors: SORKIN, STEPHEN PHILLIP, ZHANG, STEVE YU
Publication of US20120239681A1 publication Critical patent/US20120239681A1/en
Application status is Abandoned legal-status Critical

Links

Images

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING; COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/20Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
    • G06F16/24Querying
    • G06F16/245Query processing
    • G06F16/2457Query processing with adaptation to user needs
    • G06F16/24578Query processing with adaptation to user needs using ranking
    • GPHYSICS
    • G06COMPUTING; CALCULATING; COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/10File systems; File servers
    • G06F16/18File system types
    • G06F16/182Distributed file systems
    • GPHYSICS
    • G06COMPUTING; CALCULATING; COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/20Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
    • G06F16/22Indexing; Data structures therefor; Storage structures
    • GPHYSICS
    • G06COMPUTING; CALCULATING; COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/20Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
    • G06F16/23Updating
    • G06F16/2308Concurrency control
    • G06F16/2315Optimistic concurrency control
    • G06F16/2322Optimistic concurrency control using timestamps
    • GPHYSICS
    • G06COMPUTING; CALCULATING; COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/20Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
    • G06F16/24Querying
    • GPHYSICS
    • G06COMPUTING; CALCULATING; COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/20Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
    • G06F16/24Querying
    • G06F16/245Query processing
    • G06F16/2455Query execution
    • GPHYSICS
    • G06COMPUTING; CALCULATING; COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/20Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
    • G06F16/24Querying
    • G06F16/245Query processing
    • G06F16/2455Query execution
    • G06F16/24553Query execution of query operations
    • GPHYSICS
    • G06COMPUTING; CALCULATING; COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/20Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
    • G06F16/24Querying
    • G06F16/245Query processing
    • G06F16/2455Query execution
    • G06F16/24553Query execution of query operations
    • G06F16/24554Unary operations; Data partitioning operations
    • GPHYSICS
    • G06COMPUTING; CALCULATING; COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/20Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
    • G06F16/24Querying
    • G06F16/245Query processing
    • G06F16/2457Query processing with adaptation to user needs
    • G06F16/24575Query processing with adaptation to user needs using context
    • GPHYSICS
    • G06COMPUTING; CALCULATING; COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/20Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
    • G06F16/24Querying
    • G06F16/245Query processing
    • G06F16/2458Special types of queries, e.g. statistical queries, fuzzy queries or distributed queries
    • G06F16/2471Distributed queries
    • GPHYSICS
    • G06COMPUTING; CALCULATING; COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/20Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
    • G06F16/24Querying
    • G06F16/245Query processing
    • G06F16/2458Special types of queries, e.g. statistical queries, fuzzy queries or distributed queries
    • G06F16/2477Temporal data queries
    • GPHYSICS
    • G06COMPUTING; CALCULATING; COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/20Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
    • G06F16/24Querying
    • G06F16/248Presentation of query results
    • GPHYSICS
    • G06COMPUTING; CALCULATING; COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/30Information retrieval; Database structures therefor; File system structures therefor of unstructured textual data
    • G06F16/33Querying
    • G06F16/3331Query processing
    • G06F16/334Query execution
    • GPHYSICS
    • G06COMPUTING; CALCULATING; COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/90Details of database functions independent of the retrieved data types
    • G06F16/903Querying
    • G06F16/9032Query formulation
    • G06F16/90324Query formulation using system suggestions
    • G06F16/90328Query formulation using system suggestions using search space presentation or visualization, e.g. category or range presentation and selection
    • GPHYSICS
    • G06COMPUTING; CALCULATING; COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/90Details of database functions independent of the retrieved data types
    • G06F16/903Querying
    • G06F16/9038Presentation of query results
    • GPHYSICS
    • G06COMPUTING; CALCULATING; COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/90Details of database functions independent of the retrieved data types
    • G06F16/95Retrieval from the web
    • G06F16/951Indexing; Web crawling techniques
    • GPHYSICS
    • G06COMPUTING; CALCULATING; COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/90Details of database functions independent of the retrieved data types
    • G06F16/95Retrieval from the web
    • G06F16/953Querying, e.g. by the use of web search engines
    • G06F16/9535Search customisation based on user profiles and personalisation
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04LTRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L41/00Arrangements for maintenance or administration or management of packet switching networks
    • H04L41/06Arrangements for maintenance or administration or management of packet switching networks involving management of faults or events or alarms
    • H04L41/0604Alarm or event filtering, e.g. for reduction of information
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04LTRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L41/00Arrangements for maintenance or administration or management of packet switching networks
    • H04L41/22Arrangements for maintenance or administration or management of packet switching networks using GUI [Graphical User Interface]
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04LTRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L67/00Network-specific arrangements or communication protocols supporting networked applications
    • H04L67/10Network-specific arrangements or communication protocols supporting networked applications in which an application is distributed across nodes in the network
    • H04L67/1097Network-specific arrangements or communication protocols supporting networked applications in which an application is distributed across nodes in the network for distributed storage of data in a network, e.g. network file system [NFS], transport mechanisms for storage area networks [SAN] or network attached storage [NAS]

Abstract

A method, system, and processor-readable storage medium are directed towards generating a report derived from data, such as event data, stored on a plurality of distributed nodes. In one embodiment the analysis is generated using a “divide and conquer” algorithm, such that each distributed node analyzes locally stored event data while an aggregating node combines these analysis results to generate the report. In one embodiment, each distributed node also transmits a list of event data references associated with the analysis result to the aggregating node. The aggregating node may then generate a global ordered list of data references based on the list of event data references received from each distributed node. Subsequently, in response to a user selection of a range of global event data, the report may dynamically retrieve event data from one or more distributed nodes for display according to the global order.

Description

    CROSS-REFERENCE TO RELATED APPLICATION
  • This utility patent application is based upon U.S. Provisional Patent Application No. 61/452,591 filed on Mar. 14, 2011, the benefit of which is hereby claimed under 35 U.S.C. §119(e) and incorporated herein by reference.
  • TECHNICAL FIELD
  • The present invention relates generally to generating reports and more particularly but not exclusively to reducing latency when generating interactive reports from data contained on a plurality of distributed computing nodes.
  • BACKGROUND
  • An increasing number of computing applications, particularly within the enterprise, entail analyzing distributed data. One type of analysis is report generation, such as generating a table, a chart, or a timeline from distributed data. Some reports are generated by copying all of the data from the plurality of distributed nodes to a single aggregating node for analysis. However, if the amount of data to be analyzed is large, then transmitting this data over a network can be prohibitively time consuming. Also, a single aggregating node may not contain the capacity necessary to store data received from a plurality of distributed nodes. Accordingly, efficiently generating reports that contain aggregate information as well as raw data is an ongoing challenge.
  • BRIEF DESCRIPTION OF THE DRAWINGS
  • Non-limiting and non-exhaustive embodiments are described with reference to the following drawings. In the drawings, like reference numerals refer to like parts throughout the various figures unless otherwise specified.
  • For a better understanding of the described embodiments, reference will be made to the following Detailed Description, which is to be read in association with the accompanying drawings, wherein:
  • FIG. 1 illustrates a system diagram of an environment in which embodiments of the invention may be implemented;
  • FIG. 2 illustrates an embodiment of a client device that may be included in a system such as that shown in FIG. 1;
  • FIG. 3 illustrates an embodiment of a network device that may be included in a system such as that shown in FIG. 1;
  • FIG. 4 illustrates a logical flow diagram showing one embodiment of a process for generating and displaying an interactive report;
  • FIG. 5 illustrates a logical flow diagram showing one embodiment of a process for analyzing raw data on a distributed node for display in an interactive report; and
  • FIG. 6 illustrates one non-limiting embodiment of an interactive report.
  • DETAILED DESCRIPTION OF THE INVENTION
  • Throughout the specification and claims, the following terms take the meanings explicitly associated herein, unless the context clearly dictates otherwise. The phrase “in one embodiment” as used herein does not necessarily refer to the same embodiment, though it may. Furthermore, the phrase “in another embodiment” as used herein does not necessarily refer to a different embodiment, although it may. Thus, as described below, various embodiments of the invention may be readily combined, without departing from the scope or spirit of the invention.
  • In addition, as used herein, the term “or” is an inclusive “or” operator, and is equivalent to the term “and/or,” unless the context clearly dictates otherwise. The term “based on” is not exclusive and allows for being based on additional factors not described, unless the context clearly dictates otherwise. In addition, throughout the specification, the meaning of “a,” “an,” and “the” include plural references. The meaning of “in” includes “in” and “on.”
  • As used herein, the term “event data” refers to computing data that is collected about a computing system, including, for example, an action, characteristic, condition (or state), or state change of the computing system. For example, such events may be about a computing system's performance, actions taken by the computing system, or the like. Event data may be obtained from various computing log files generated by the computer's operating system, and/or other monitoring application. However, event data is not restricted by a file format or structure from which the event data is obtained.
  • As used herein, an event record refers to data associated with a single event.
  • As used herein, the term “report” refers to one or more visualizations of search query results. For example, a report may include a table of data, a timeline, a chart, a “field picker” or the like. In one embodiment, the report is interactive, enabling a user to selectively view pieces of raw data used to generate the report. For example, if the report lists users sorted based on the number of times each user has logged into the system, each user is selectable to view detailed records of that user's login events.
  • Briefly described is a mechanism for generating a report derived from data, such as event data, stored on a plurality of distributed nodes. In one embodiment the analysis is generated using a “divide and conquer” algorithm, such that each distributed node analyzes locally stored event data while an aggregating node combines these analysis results to generate the report. In one embodiment, each distributed node also transmits a list of event data references associated with the analysis result to the aggregating node. The aggregating node may then generate a global ordered list of data references based on the list of event data references received from each distributed node. Subsequently, in response to a user selection of a range of global event data, the report may dynamically retrieve event data from one or more distributed nodes for display according to the global order.
  • Illustrative Operating Environment
  • FIG. 1 shows components of one embodiment of an environment in which the invention may be practiced. Not all the components may be required to practice the invention, and variations in the arrangement and type of the components may be made without departing from the spirit or scope of the invention. As shown, system 100 of FIG. 1 includes local area networks (“LANs”)/wide area networks (“WANs”)—(network) 107, client devices 101-103, and distributed search server 109.
  • One embodiment of client devices 101-103 is described in more detail below in conjunction with FIG. 2. Generally, however, client devices 101-103 may include virtually any computing device capable of communicating over a network to send and receive information, including a search query, analysis results of a search query, lists of event data references, collections of event data, and the like. Client devices 101-103 are referred to interchangeably herein as “distributed computing devices”, “distributed nodes”, or the like. In one embodiment, one or more of client devices 101-103 may be configured to operate within a business or other entity to perform a variety of services for the business or other entity. For example, client devices 101-103 may be configured to operate as a web server, an accounting server, a production server, an inventory server, or the like. However, client devices 101-103 are not constrained to these services and may also be employed, for example, as an end-user computing node, in other embodiments. Further, it should be recognized that more or less client devices may be included within a system such as described herein, and embodiments are therefore not constrained by the number or type of client devices employed.
  • The set of such client devices 101-103 may include devices that typically connect using a wired or wireless communications medium such as personal computers, servers, multiprocessor systems, microprocessor-based or programmable consumer electronics, network PCs, or the like. In one embodiment, at least some of client devices 101-103 may operate over wired and/or wireless network. In some embodiments, client devices 101-103 may include virtually any portable computing device capable of receiving and sending a message over a network, such as network 107.
  • Client devices 101-103 also may include at least one client application that is configured to capture and record event data and/or related metadata. However, the client application need not be limited to merely providing event data and related metadata, and may also provide other information, and/or provide for a variety of other services, including, for example, monitoring for events within and/or between client devices.
  • The client application may further provide information that identifies itself, including a type, capability, name, and the like. Such information may be provided in a network packet, or the like, sent between other client devices, distributed search server 109, or other computing devices.
  • Network 107 is configured to couple network devices with other computing devices, including distributed search server 109 and client devices 101-103. Network 107 is enabled to employ any form of computer readable media for communicating information from one electronic device to another. Also, network 107 can include the Internet in addition to local area networks (LANs), wide area networks (WANs), direct connections, such as through a universal serial bus (USB) port, other forms of computer-readable media, or any combination thereof. On an interconnected set of LANs, including those based on differing architectures and protocols, a router acts as a link between LANs, enabling messages to be sent from one to another. In addition, communication links within LANs typically include twisted wire pair or coaxial cable, while communication links between networks may utilize analog telephone lines, full or fractional dedicated digital lines including T1, T2, T3, and T4, and/or other carrier mechanisms including, for example, E-carriers, Integrated Services Digital Networks (ISDNs), Digital Subscriber Lines (DSLs), wireless links including satellite links, or other communications links known to those skilled in the art. Moreover, communication links may further employ any of a variety of digital signaling technologies, including without limit, for example, Digital Signal (DS)-0, DS-1, DS-2, DS-3, DS-4, Optical Carrier (OC)-3, OC-12, OC-48, or the like. Furthermore, remote computers and other related electronic devices could be remotely connected to either LANs or WANs via a modem and temporary telephone link. In one embodiment, network 107 may be configured to transport information of an Internet Protocol (IP). In essence, network 107 includes any communication method by which information may travel between computing devices.
  • Additionally, communication media typically embodies computer-readable instructions, data structures, program modules, or other transport mechanism and includes any information delivery media. By way of example, communication media includes wired media such as twisted pair, coaxial cable, fiber optics, wave guides, and other wired media and wireless media such as acoustic, Radio Frequency (RF), infrared, and other wireless media.
  • In some embodiments, network 107 may be further configurable as a wireless network, which may further employ a plurality of access technologies including 2nd (2G), 3rd (3G), 4th (4G) generation radio access for cellular systems, WLAN, Wireless Router (WR) mesh, and the like. In one non-limiting example, network 107, when configured as a wireless network, may enable a radio connection through a radio network access such as Global System for Mobile communication (GSM), General Packet Radio Services (GPRS), Enhanced Data GSM Environment (EDGE), Wideband Code Division Multiple Access (WCDMA), and the like.
  • Distributed search server 109 includes virtually any network device usable to receive a search query, distribute sub-queries of the search query among client devices 101-103, synthesize the results of the sub-queries, and display a report. Distributed search server 109 may, for example, be configured to merge lists of event data references into a global ordered list of event data references, enabling ranges of event data to be selectively retrieved from one or more distributed nodes.
  • Devices that may operate as distributed search server 109 include various network devices, including, but not limited to personal computers, desktop computers, multiprocessor systems, microprocessor-based or programmable consumer electronics, network PCs, server devices, network appliances, and the like.
  • Although FIG. 1 illustrates distributed search server 109 as a single computing device, the invention is not so limited. For example, one or more functions of the distributed search server 109 may be distributed across one or more distinct network devices. Moreover, distributed search server 109 is not limited to a particular configuration. Thus, in one embodiment, distributed search server 109 may contain a plurality of network devices to perform digest aggregation and calculation of approximate order statistics therefrom. Similarly, in another embodiment, distributed search server 109 may operate as a plurality of network devices within a cluster architecture, a peer-to-peer architecture, and/or even within a cloud architecture. Thus, the invention is not to be construed as being limited to a single environment, and other configurations, and architectures are also envisaged.
  • Illustrative Client Device
  • FIG. 2 shows one embodiment of client device 200 that may be included in a system implementing embodiments of the invention. Client device 200 may include many more or less components than those shown in FIG. 2. However, the components shown are sufficient to disclose an illustrative embodiment for practicing the present invention. Client device 200 may represent, for example, one embodiment of at least one of client devices 101-103 of FIG. 1.
  • As shown in the figure, client device 200 includes processing unit (CPU) 202 in communication with a mass memory 226 via a bus 234. Client device 200 also includes a power supply 228, one or more network interfaces 236, an audio interface 238, a display 240, and an input/output interface 248. Power supply 228 provides power to client device 200.
  • Network interface 236 includes circuitry for coupling client device 200 to one or more networks, and is constructed for use with one or more communication protocols and technologies including, but not limited to, global system for mobile communication (GSM), code division multiple access (CDMA), time division multiple access (TDMA), user datagram protocol (UDP), transmission control protocol/Internet protocol (TCP/IP), Short Message Service (SMS), general packet radio service (GPRS), Wireless Application Protocol (WAP), ultra wide band (UWB), Institute of Electrical and Electronics Engineers (IEEE) 802.16 Worldwide Interoperability for Microwave Access (WiMax), Session Initiation Protocol (SIP)/Real-time Transport Protocol (RTP), or any of a variety of other communication protocols. Network interface 236 is sometimes known as a transceiver, transceiving device, or network interface card (NIC).
  • Audio interface 238 is arranged to produce and receive audio signals such as the sound of a human voice. For example, audio interface 238 may be coupled to a speaker and microphone (not shown) to enable telecommunication with others and/or generate an audio acknowledgement for some action. Display 240 may be a liquid crystal display (LCD), gas plasma, light emitting diode (LED), or any other type of display used with a computing device. Display 240 may also include a touch sensitive screen arranged to receive input from an object such as a stylus or a digit from a human hand.
  • Client device 200 also comprises input/output interface 248 for communicating with external devices, such as a keyboard, or other input or output devices not shown in FIG. 2. Input/output interface 248 can utilize one or more communication technologies, such as USB, infrared, Bluetooth™, or the like.
  • Mass memory 226 includes a Random Access Memory (RAM) 204, a Read Only Memory (ROM) 222, and other storage means. Mass memory 226 illustrates an example of computer readable storage media (devices) for storage of information such as computer readable instructions, data structures, program modules or other data. Mass memory 226 stores a basic input/output system (“BIOS”) 224 for controlling low-level operation of client device 200. The mass memory also stores an operating system 206 for controlling the operation of client device 200. It will be appreciated that this component may include a general-purpose operating system such as a version of UNIX, or LINUX™, or a specialized client communication operating system such as Windows Mobile™, or the Symbian® operating system. The operating system may include, or interface with a Java virtual machine module that enables control of hardware components and/or operating system operations via Java application programs.
  • Mass memory 226 further includes one or more data storage 208, which can be utilized by client device 200 to store, among other things, applications 214 and/or other data. For example, data storage 208 may also be employed to store information that describes various capabilities of client device 200. The information may then be provided to another device based on any of a variety of events, including being sent as part of a header during a communication, sent upon request, or the like. At least a portion of the information may also be stored on a disk drive or other computer-readable storage device 230 within client device 200. Data storage 208 may further store event data and metadata 210 and local search results 212. Such event data and metadata 210 and local search results 212 may also be stored within any of a variety of other computer-readable storage devices, including, but not limited to a hard drive, a portable storage device, or the like, such as illustrated by computer-readable storage device 230.
  • Applications 214 may include computer executable instructions which, when executed by client device 200, transmit, receive, and/or otherwise process network data. Other examples of application programs include calendars, search programs, email clients, IM applications, SMS applications, Voice Over IP (VOIP) applications, contact managers, task managers, transcoders, database programs, word processing programs, security applications, spreadsheet programs, games, search programs, data log recording programs, and so forth. Applications 214 may include, for example, local search module 220. Local search module 220 may process a sub-query, returning analysis results and a list of event data references associated with the analysis results, as described herein.
  • Illustrative Network Device
  • FIG. 3 shows one embodiment of a network device 300, according to one embodiment of the invention. Network device 300 may include many more or less components than those shown. The components shown, however, are sufficient to disclose an illustrative embodiment for practicing the invention. Network device 300 may be configured to operate as a server, client, peer, or any other device. Network device 300 may represent, for example distributed search server 109 of FIG. 1.
  • Network device 300 includes processing unit 302, an input/output interface 332, video display adapter 336, and a mass memory, all in communication with each other via bus 326. The mass memory generally includes RAM 304, ROM 322 and one or more permanent mass storage devices, such as hard disk drive 334, tape drive, optical drive, and/or floppy disk drive. The mass memory stores operating system 306 for controlling the operation of network device 300. Any general-purpose operating system may be employed. Basic input/output system (“BIOS”) 324 is also provided for controlling the low-level operation of network device 300. As illustrated in FIG. 3, network device 300 also can communicate with the Internet, or some other communications network, via network interface unit 330, which is constructed for use with various communication protocols including the Transmission Control Protocol/Internet Protocol (TCP/IP) protocol. Network interface unit 330 is sometimes known as a transceiver, transceiving device, or network interface card (NIC).
  • Network device 300 also comprises input/output interface 332 for communicating with external devices, such as a keyboard, or other input or output devices not shown in FIG. 3. Input/output interface 332 can utilize one or more communication technologies, such as USB, infrared, Bluetooth™, or the like.
  • The mass memory as described above illustrates another type of computer-readable media, namely computer-readable storage media and/or processor-readable storage medium. Computer-readable storage media (devices) may include volatile, nonvolatile, removable, and non-removable media implemented in any method or technology for storage of information, such as computer readable instructions, data structures, program modules, or other data. Examples of computer readable storage media include RAM, ROM, EEPROM, flash memory or other memory technology, Compact Disc ROM (CD-ROM), digital versatile disks (DVD) or other optical storage, magnetic cassettes, magnetic tape, magnetic disk storage or other magnetic storage devices, or any other non-transitory physical medium which can be used to store the desired information and which can be accessed by a computing device.
  • As shown, data storage 308 may include a database, text, spreadsheet, folder, file, or the like, that may be configured to maintain and store user account identifiers, user profiles, email addresses, IM addresses, and/or other network addresses; or the like. Data stores 308 may further include program code, data, algorithms, and the like, for use by a processor, such as central processing unit (CPU) 302 to execute and perform actions. In one embodiment, at least some of data store 308 might also be stored on another component of network device 300, including, but not limited to computer-readable storage medium 328, hard disk drive 334, or the like. Data storage 308 may further store ordered list of event data references 310.
  • Ordered list of event data references 310 may include a list of event data references received from a plurality of distributed nodes. In one embodiment, the ordered list of event data references is generated by sorting data references received from each distributed node according to a common field, such as a timestamp, a number a string, or the like. In one embodiment, each element of the ordered list includes a reference to the distributed node the event data is stored on, an offset or other pointer to the event data on that distributed node, and optionally the value used to sort the ordered list.
  • The mass memory also stores program code and data. One or more applications 314 are loaded into mass memory and run on operating system 306. Examples of application programs may include transcoders, schedulers, calendars, database programs, word processing programs, Hyper Text Transfer Protocol (HTTP) programs, customizable user interface programs, Internet Protocol Security (IPSec) applications, encryption programs, security programs, SMS message servers, account managers, and so forth. Distributed search module 318 may also be included as application programs within applications 314.
  • Distributed search module 318 may be configured and arranged to receive a query, generate sub-queries for each of a specified set of distributed devices, and aggregate results of these sub-queries to generate a report, as described further herein.
  • Generalized Operation
  • The operation of certain aspects will now be described with respect to FIGS. 4-6. FIGS. 4-5 provide logical flow diagrams illustrating certain aspects, while FIG. 6 illustrates an example of a scalable interactive display of distributed data. FIG. 4 illustrates a logical flow diagram of one embodiment of a process for generating and displaying an interactive report. In one embodiment, process 400 may be implemented on distributed search server 109.
  • Process 400 begins, after a start block, at block 402, where a search query (hereinafter “query”) is received. In one embodiment, the received query targets data, such as “event data” (also referred to as “events”), that is distributed across a plurality of specified computing devices, such as client devices 101-103. In one embodiment, sub-queries are generated for each of the specified computing devices and submitted to each corresponding computing device for processing. For example, if the received query asks for a count of system log entries that contain the word “error”, then a sub-query is generated for each of the specified computing devices, where each sub-query counts the number of events derived from system log entries that contain the word “error” stored on that device.
  • The received query may specify which computing devices to search in a number of ways. In one embodiment, the received query specifies particular computing devices or groups of computing devices by name, network address, or the like. In another embodiment, computing devices are specified based on attributes, such as operating system, hardware components (e.g. CPU, web cam, network adapter, etc.), form factor (e.g. laptop, desktop, server, tablet, virtual machine, smartphone, etc.), and the like. In another embodiment, a query may specify all of the plurality of computing devices.
  • In one embodiment, the received query is received from a user, such as a system administrator. However, queries may also be automatically generated by a software agent. In one embodiment, a query may be automatically generated at periodic intervals, such as every hour or every Saturday night. In another embodiment, a query may be generated in response to an event, such as installation of a software patch, or in response to a metric crossing a threshold, such as an unusually large volume of network traffic.
  • The distributed data to be searched may be stored on the specified computing devices in many ways. In one embodiment, the distributed data may include events, as defined herein, that have been recorded and stored by each of the specified computing devices. However, the distributed data may be generated at any time and in any manner, including partitioning a data set across specified computing devices after the query has been received. Also, while in one embodiment the distributed data comprises “events” or “event data” as defined herein, the distributed data may include any kind of data, structured or unstructured.
  • The received query may include one or more analyses to be performed on the distributed event data by the computing devices storing that data. For example, an analysis may include counting the number of events that satisfy a condition, deriving statistical information about events (including distributions, histograms, Nth percentile rankings, and the like), grouping events, sorting events, and the like. That is, the analysis may be performed in response to the query.
  • In one embodiment, the received query may also specify the order of query results. For example, a query requesting system log entries that contain the word “error” may be ordered based on the time the system log entry was generated (timestamp). A similar query may order entries based on an error severity value field in the event derived from the system log entry. Multiple orderings and nested orderings are also contemplated, such as ordering first by an error severity value and then by a timestamp.
  • The process proceeds to block 404, where sub-query results are received from each of the specified computing devices. In one embodiment, the sub-query results include analysis results corresponding to the one or more analyses specified in the received query. In one embodiment, analysis results are derived from raw event data stored on each of the specified devices, but analysis results do not include the actual raw event data.
  • The sub-query results additionally include one or more lists of event references. In one embodiment, each event reference includes (1) an identifier that uniquely identifies the event on the computing device that generated it, and (2) a value usable to order the event (hereinafter “order value”). In one embodiment the unique identifier includes a serial number assigned to the event as the event is created. In this example, the unique identifier is unique to a given computing device—events from different computing devices may be assigned the same unique identifier. However, globally unique identifiers, such as GUIDs, are similarly contemplated.
  • In one embodiment, the order value of an event may be a timestamp, such as the time when an event was created. However, any value of any data type is similarly contemplated. Other examples of order values include integers, such as a severity of error, and a string, such as a username.
  • In one embodiment, a computing device creates an event reference for each event used to generate an analysis result. For example, consider three devices A, B, and C that contain 14, 37, and 94 system log events containing the word, “error”, respectively. If a query to count all of the system log events that contain the word “error” is received, device A will return a count of 14 as well as a list of 14 references, one reference for each of the 14 counted events. Similarly, device B will return a count of 37 as well as a list of 37 references, and device C will return a count of 94 and a list of 94 references. Note that at this time, none of the raw event data has been transmitted to the distributed search server.
  • The process proceeds to block 406, where a global ordered list of event references is generated based on each of the returned lists of event references. In one embodiment, each entry in the global ordered list includes the content of an event reference, as described above, as well as an identifier of the computing device that the event was found on.
  • Continuing the example above, consider if the first 7 of device A's events were the first to be recorded, followed by the first 50 of device C's, followed by all 37 of device B's, followed by the last 44 of device C, and finally the last 7 of device A. In this simple example, the global ordered list would include all 145 event references in this same order, where each event reference is fully qualified to include a computing device identifier in addition to that event's unique identifier. In this way, a user may select a range from the global ordered list of event references, and only the actual event data contained in the selected range is downloaded.
  • The process proceeds to block 408, where a request to display a range of events is received. Continuing the above example, the global ordered list includes 145 fully qualified event references. A request may be received to display the last 5 events, the second 50 events, the first event, all 145 of the events, or any other sub-range of the events.
  • The process proceeds to block 410, where event data is requested from one or more of the computing devices based on the range of event references requested from the global ordered list. For example, if the first 50 events are requested, then the first 50 entries in the global ordered list are retrieved. Continuing the example above, the first 7 events from device A would be requested, all 37 of the events from device B would be requested, and the first 6 events from device C would be requested. Thus a total of 50 events are retrieved from three different computing devices, without retrieving any unnecessary events. In one embodiment these requests are made in parallel, however requests may be submitted to individual devices serially. Also, in one embodiment, a range of events may be requested from a single computing device in a single network transaction, however requests may also be made individually.
  • The process proceeds to block 412, where the raw data is displayed. In one embodiment, event data retrieved from individual computing devices are displayed according to the global order. In one embodiment, the requested raw data is displayed with the one or more analysis results. In this way, a user may see the analysis results as well as portions of the underlying data. The process then proceeds to a return block.
  • FIG. 5 illustrates a logical flow diagram generally showing one embodiment of a process an individual computing device may perform in the course of performing a distributed search query. In one embodiment, process 500 is performed by one of client devices 101-103.
  • Process 500 begins, after a start block, at block 502, where a sub-query is received from a distributed search server. The process then proceeds to block 504, where data such as events are analyzed according to the received sub-query. In one embodiment, as events are analyzed, events that contribute to the requested analysis are referenced in a list of event references.
  • The process then proceeds to block 506, where the results of the analysis and the list of event references are transmitted to the computing device that submitted the sub-query. In one embodiment, this device is distributed search server 109.
  • The process then proceeds to block 508, where a request for one or more pieces of event data is received. In one embodiment, the request includes a contiguous range of event data. In another embodiment, individual pieces of event data are individually requested. The process then proceeds to block 510, where the requested pieces of event data are transmitted to the requestor. The process then proceeds to a return block.
  • FIG. 6 illustrates one non-limiting example of an interactive report 600; however, other layouts containing other types of information are similarly contemplated. The interactive report was generated based on a search query 602 of all domain name system (dns) lookups the specified clients performed “yesterday”. The report is broken into three sections—a timeline 604, a field picker 606, and an event data view 608. The timeline includes a bar graph 610 depicting how many dns lookups were performed each hour. Field picker 606 is generally used to select fields 612 from all of the fields available on a given type of event. In this example, field picker 606 has been used to select two of the 24 fields associated with dns lookup events: client host and client IP. Thus, the event data displayed in the event data view will contain only these two fields. Finally, the event data view 608 displays raw event data, currently 50 results per page. A total of 562 events were gathered from 79 clients. However, only the first 50 events have been downloaded to the distributed search server at the time this display was generated. If the user were to select another range of 50 events, the distributed search server could retrieve these 50 events from one or more of the clients in real-time as discussed above in conjunction with FIGS. 4 and 5.
  • It will be understood that figures, and combinations of steps in the flowchart-like illustrations, can be implemented by computer program instructions. These program instructions may be provided to a processor to produce a machine, such that the instructions, which execute on the processor, create means for implementing the actions specified in the flowchart block or blocks. The computer program instructions may be executed by a processor to cause a series of operational steps to be performed by the processor to produce a computer implemented process such that the instructions, which execute on the processor to provide steps for implementing the actions specified in the flowchart block or blocks. These program instructions may be stored on a computer readable medium or machine readable medium, such as a computer readable storage medium.
  • Accordingly, the illustrations support combinations of means for performing the specified actions, combinations of steps for performing the specified actions and program instruction means for performing the specified actions. It will also be understood that each block of the flowchart illustration, and combinations of blocks in the flowchart illustration, can be implemented by modules such as special purpose hardware-based systems which perform the specified actions or steps, or combinations of special purpose hardware and computer instructions.
  • The above specification, examples, and data provide a complete description of the manufacture and use of the composition of the described embodiments. Since many embodiments can be made without departing from the spirit and scope of this description, the embodiments reside in the claims hereinafter appended.

Claims (20)

1. A method comprising:
receiving a query to search a plurality of event records that are stored across a plurality of computing devices;
submitting a sub-query derived from the received query to each of the plurality of computing devices, wherein each of the plurality of computing devices analyzes event records stored on that computing device, based on the sub-query, to generate one or more event references and to generate an analysis result;
receiving one or more event references from each of the plurality of computing devices, wherein each event reference includes a unique event record identifier and an event order value;
combining the one or more event references from each of the plurality of computing devices into a list of event references ordered by event order value;
providing the ordered list of event references in response to the query;
receiving a request for event records associated with a contiguous subset of the ordered list of event references;
requesting event records from one or more of the plurality of computing devices by sending each unique event record identifier included in the requested contiguous subset of the ordered list of event references to the corresponding computing device; and
providing the requested event records and the analysis result to a display device for display.
2. The method of claim 1, wherein each event reference of the ordered list of event references includes an identifier of the computing device that provided the event reference, and wherein retrieving event records associated with an event reference includes retrieving an event record from the computing device associated with the event reference.
3. The method of claim 1, wherein event records are analyzed by parsing a log file containing event records and returning event references for each event record satisfying the sub-query.
4. The method of claim 1, wherein sub-queries are submitted to computing devices that match a criteria included in the query.
5. The method of claim 1, wherein the event references are ordered based on an order indicated in the query.
6. The method of claim 1, wherein the query includes a first and a second ordering indication, wherein event references include a first order value and a second order value, wherein event references are ordered first by the first ordering indication, and wherein any event references that have the same first order value are ordered by the second order value.
7. The method of claim 1, wherein an event record includes raw event data, the unique event record identifier, and the event order value, and wherein the event references do not include raw event data.
8. An apparatus comprising:
a processor; and
a memory storing instructions that when executed by the processor cause actions to be performed, including:
receiving one or more event references from each of a plurality of computing devices, wherein each event reference includes an identifier of a source computing device, an index into an array of event records stored on the source computing device, and an event order value;
combining the one or more event references from each of the plurality of computing devices into a list of event references ordered by event order value;
receiving a request for event records associated with a contiguous range of the ordered list of event references;
retrieving event records from one or more of the plurality of computing devices by sending the index to the corresponding source computing device for each event reference in the requested contiguous range of the ordered list of event references; and
providing the requested event records to a display device for display.
9. The apparatus of claim 8, wherein the contiguous range of the ordered list of event references is selected from an interactive report displayed at the display device.
10. The apparatus of claim 8, wherein the one or more event references are received in response to a query received from the display device.
11. The apparatus of claim 8, wherein the plurality of computing devices are selected based on one or more of a form factor, an operating system, or a hardware component.
12. The apparatus of claim 8, wherein each computing device orders the one or more event references based on the event order value.
13. A non-transitory processor readable storage device storing instructions that cause a processor to perform actions, comprising:
receiving one or more event references from each of a plurality of computing devices, wherein each event reference includes an identifier of a source computing device, an index into an array of event records stored on the source computing device, and an event order value;
receiving, in response to a query request, statistical information from each of the plurality of computing devices, where the statistical information is generated by each of the plurality of computing devices performing an analysis of event records stored on that computing device;
combining the one or more event references from each of the plurality of computing devices into a list of event references, ordered by event order value;
combining the statistical information from each of the computing devices into an aggregated statistical information;
receiving a request for event records associated with a portion of the aggregated statistical information;
retrieving the requested event records from the plurality of computing devices by sending, for each event reference associated with the portion of the aggregated statistical information, the index into the array of event records stored on the source computing device to the corresponding source computing device; and
providing the requested event records to a display device for display.
14. The processor readable storage device of claim 13, wherein the statistical information includes an order statistic or an approximate order statistic.
15. The processor readable storage device of claim 13, wherein the statistical information includes a count of the number of event records matching a criteria included in a query received from the display device.
16. A system comprising:
a plurality of computing devices storing event records;
a first computing device configured to perform actions comprising:
receiving one or more event references from each of the plurality of computing devices, wherein each event reference includes a unique event record identifier and an event order value;
combining the one or more event references from each of the plurality of computing devices into a list of event references ordered by event order value;
receiving a request for event records associated with a contiguous range of ordered event references;
retrieving event records from one or more of the plurality of computing devices by sending each unique event record identifier included in the requested contiguous range of ordered event references to the corresponding computing device; and
providing the requested event records for display.
17. The system of claim 16, wherein each event reference of the ordered list of event references includes an identifier of the computing device that provided the event reference, and wherein retrieving event records associated with an event reference includes retrieving an event record from the computing device associated with the event reference.
18. The system of claim 16, the actions further comprising:
parsing a log file containing event records to generate a statistical analysis; and
providing the statistical analysis event references for each event record that satisfy a query.
19. The system of claim 16, wherein an event record includes data collected about a computing system and is stored on the same computing system.
20. The system of claim 16, wherein the ordered list of event references is ordered by a first order value and a second order value, wherein event references are ordered first by the first order value, and wherein any event references that have the same first order value are ordered by the second order value.
US13/223,167 2011-03-14 2011-08-31 Scalable interactive display of distributed data Abandoned US20120239681A1 (en)

Priority Applications (2)

Application Number Priority Date Filing Date Title
US201161452591P true 2011-03-14 2011-03-14
US13/223,167 US20120239681A1 (en) 2011-03-14 2011-08-31 Scalable interactive display of distributed data

Applications Claiming Priority (16)

Application Number Priority Date Filing Date Title
US13/223,167 US20120239681A1 (en) 2011-03-14 2011-08-31 Scalable interactive display of distributed data
PCT/US2012/028922 WO2012125634A1 (en) 2011-03-14 2012-03-13 Scalable interactive display of distributed data
US13/660,845 US8751529B2 (en) 2011-03-14 2012-10-25 Scalable interactive display of distributed data
US14/158,421 US8990245B2 (en) 2011-03-14 2014-01-17 Determination and display of the number of unique values for a field defined for events in a distributed data store
US14/266,838 US9245039B2 (en) 2011-03-14 2014-05-01 Event record tracking across multiple search sessions
US14/530,680 US9129028B2 (en) 2011-03-14 2014-10-31 Event field distributed search display
US14/530,689 US10380122B2 (en) 2011-03-14 2014-10-31 Interactive display of search result information
US14/530,692 US10162863B2 (en) 2011-03-14 2014-11-01 Interactive display of aggregated search result information
US14/815,978 US9430574B2 (en) 2011-03-14 2015-08-01 Display for a number of unique values for an event field
US15/006,055 US10318535B2 (en) 2011-03-14 2016-01-25 Displaying drill-down event information using event identifiers
US15/224,657 US10061821B2 (en) 2011-03-14 2016-07-31 Extracting unique field values from event fields
US16/041,550 US10339149B2 (en) 2011-03-14 2018-07-20 Determining and providing quantity of unique values existing for a field
US16/193,781 US20190155811A1 (en) 2011-03-14 2018-11-16 Interactive display of aggregated search result information
US16/396,569 US20190251091A1 (en) 2011-03-14 2019-04-26 Determining indications of unique values for fields
US16/397,429 US20190251092A1 (en) 2011-03-14 2019-04-29 Providing Interactive Search Results From a Distributed Search System
US16/455,193 US20190317943A1 (en) 2011-03-14 2019-06-27 Interactive display of search result information

Related Child Applications (1)

Application Number Title Priority Date Filing Date
US13/660,845 Continuation US8751529B2 (en) 2011-03-14 2012-10-25 Scalable interactive display of distributed data

Publications (1)

Publication Number Publication Date
US20120239681A1 true US20120239681A1 (en) 2012-09-20

Family

ID=46829320

Family Applications (15)

Application Number Title Priority Date Filing Date
US13/223,167 Abandoned US20120239681A1 (en) 2011-03-14 2011-08-31 Scalable interactive display of distributed data
US13/660,845 Active US8751529B2 (en) 2011-03-14 2012-10-25 Scalable interactive display of distributed data
US14/158,421 Active US8990245B2 (en) 2011-03-14 2014-01-17 Determination and display of the number of unique values for a field defined for events in a distributed data store
US14/266,838 Active US9245039B2 (en) 2011-03-14 2014-05-01 Event record tracking across multiple search sessions
US14/530,680 Active US9129028B2 (en) 2011-03-14 2014-10-31 Event field distributed search display
US14/530,689 Active 2033-10-10 US10380122B2 (en) 2011-03-14 2014-10-31 Interactive display of search result information
US14/530,692 Active 2034-04-24 US10162863B2 (en) 2011-03-14 2014-11-01 Interactive display of aggregated search result information
US14/815,978 Active US9430574B2 (en) 2011-03-14 2015-08-01 Display for a number of unique values for an event field
US15/006,055 Active 2032-07-25 US10318535B2 (en) 2011-03-14 2016-01-25 Displaying drill-down event information using event identifiers
US15/224,657 Active 2031-10-06 US10061821B2 (en) 2011-03-14 2016-07-31 Extracting unique field values from event fields
US16/041,550 Active US10339149B2 (en) 2011-03-14 2018-07-20 Determining and providing quantity of unique values existing for a field
US16/193,781 Pending US20190155811A1 (en) 2011-03-14 2018-11-16 Interactive display of aggregated search result information
US16/396,569 Pending US20190251091A1 (en) 2011-03-14 2019-04-26 Determining indications of unique values for fields
US16/397,429 Pending US20190251092A1 (en) 2011-03-14 2019-04-29 Providing Interactive Search Results From a Distributed Search System
US16/455,193 Pending US20190317943A1 (en) 2011-03-14 2019-06-27 Interactive display of search result information

Family Applications After (14)

Application Number Title Priority Date Filing Date
US13/660,845 Active US8751529B2 (en) 2011-03-14 2012-10-25 Scalable interactive display of distributed data
US14/158,421 Active US8990245B2 (en) 2011-03-14 2014-01-17 Determination and display of the number of unique values for a field defined for events in a distributed data store
US14/266,838 Active US9245039B2 (en) 2011-03-14 2014-05-01 Event record tracking across multiple search sessions
US14/530,680 Active US9129028B2 (en) 2011-03-14 2014-10-31 Event field distributed search display
US14/530,689 Active 2033-10-10 US10380122B2 (en) 2011-03-14 2014-10-31 Interactive display of search result information
US14/530,692 Active 2034-04-24 US10162863B2 (en) 2011-03-14 2014-11-01 Interactive display of aggregated search result information
US14/815,978 Active US9430574B2 (en) 2011-03-14 2015-08-01 Display for a number of unique values for an event field
US15/006,055 Active 2032-07-25 US10318535B2 (en) 2011-03-14 2016-01-25 Displaying drill-down event information using event identifiers
US15/224,657 Active 2031-10-06 US10061821B2 (en) 2011-03-14 2016-07-31 Extracting unique field values from event fields
US16/041,550 Active US10339149B2 (en) 2011-03-14 2018-07-20 Determining and providing quantity of unique values existing for a field
US16/193,781 Pending US20190155811A1 (en) 2011-03-14 2018-11-16 Interactive display of aggregated search result information
US16/396,569 Pending US20190251091A1 (en) 2011-03-14 2019-04-26 Determining indications of unique values for fields
US16/397,429 Pending US20190251092A1 (en) 2011-03-14 2019-04-29 Providing Interactive Search Results From a Distributed Search System
US16/455,193 Pending US20190317943A1 (en) 2011-03-14 2019-06-27 Interactive display of search result information

Country Status (2)

Country Link
US (15) US20120239681A1 (en)
WO (1) WO2012125634A1 (en)

Cited By (16)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20150058325A1 (en) * 2011-03-14 2015-02-26 Splunk Inc. Interactive Display of Search Result Information
CN104969185A (en) * 2013-04-29 2015-10-07 惠普发展公司,有限责任合伙企业 Recording unstructured events in context
US20150295796A1 (en) * 2014-04-15 2015-10-15 Splunk Inc. Adjusting network data storage based on event stream statistics
US20150341212A1 (en) * 2014-04-15 2015-11-26 Splunk Inc. Visualizations of statistics associated with captured network data
US20160100009A1 (en) * 2014-10-03 2016-04-07 Fair Isaac Corporation Cloud process for rapid data investigation and data integrity analysis
US20160110770A1 (en) * 2013-03-15 2016-04-21 Facebook, Inc. Generating metrics for content items presented in an online system
CN105574010A (en) * 2014-10-13 2016-05-11 阿里巴巴集团控股有限公司 Data querying method and device
US9596253B2 (en) 2014-10-30 2017-03-14 Splunk Inc. Capture triggers for capturing network data
US9762443B2 (en) 2014-04-15 2017-09-12 Splunk Inc. Transformation of network data at remote capture agents
US9838512B2 (en) 2014-10-30 2017-12-05 Splunk Inc. Protocol-based capture of network data using remote capture agents
US9923767B2 (en) 2014-04-15 2018-03-20 Splunk Inc. Dynamic configuration of remote capture agents for network data capture
US10127273B2 (en) * 2014-04-15 2018-11-13 Splunk Inc. Distributed processing of network data using remote capture agents
US10334085B2 (en) 2015-01-29 2019-06-25 Splunk Inc. Facilitating custom content extraction from network packets
US10360196B2 (en) 2014-04-15 2019-07-23 Splunk Inc. Grouping and managing event streams generated from captured network data
US10366101B2 (en) 2014-04-15 2019-07-30 Splunk Inc. Bidirectional linking of ephemeral event streams to creators of the ephemeral event streams
US10523521B2 (en) 2014-04-15 2019-12-31 Splunk Inc. Managing ephemeral event streams generated from captured network data

Families Citing this family (14)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US9594814B2 (en) 2012-09-07 2017-03-14 Splunk Inc. Advanced field extractor with modification of an extracted field
US10394946B2 (en) 2012-09-07 2019-08-27 Splunk Inc. Refining extraction rules based on selected text within events
US8879718B2 (en) 2012-12-04 2014-11-04 Genesys Telecommunications Laboratories, Inc. Distributed event delivery
US20140208217A1 (en) 2013-01-22 2014-07-24 Splunk Inc. Interface for managing splittable timestamps across event records
US8751499B1 (en) 2013-01-22 2014-06-10 Splunk Inc. Variable representative sampling under resource constraints
US8682906B1 (en) 2013-01-23 2014-03-25 Splunk Inc. Real time display of data field values based on manual editing of regular expressions
US8751963B1 (en) 2013-01-23 2014-06-10 Splunk Inc. Real time indication of previously extracted data fields for regular expressions
US8909642B2 (en) 2013-01-23 2014-12-09 Splunk Inc. Automatic generation of a field-extraction rule based on selections in a sample event
US9152929B2 (en) 2013-01-23 2015-10-06 Splunk Inc. Real time display of statistics and values for selected regular expressions
US10073754B2 (en) * 2013-09-13 2018-09-11 Assurant, Inc. Systems and methods for collecting, tracking, and storing system performance and event data for computing devices
US9436454B1 (en) * 2013-10-01 2016-09-06 Google Inc. Scalable systems and methods for providing ordered update delivery
US10095878B2 (en) 2015-06-02 2018-10-09 ALTR Solutions, Inc. Internal controls engine and reporting of events generated by a network or associated applications
CN105260401A (en) * 2015-09-17 2016-01-20 国网北京市电力公司 Method and device for querying and storing electric data
US10326511B1 (en) 2018-01-12 2019-06-18 Samsung Electronics Co., Ltd Apparatus and method of non-iterative singular-value decomposition

Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20040088405A1 (en) * 2002-11-01 2004-05-06 Vikas Aggarwal Distributing queries and combining query responses in a fault and performance monitoring system using distributed data gathering and storage
US20060101101A1 (en) * 2002-02-13 2006-05-11 Microsoft Corporation System and Method for Storing Events to Enhance Intrusion Detection
US20120054246A1 (en) * 2010-08-27 2012-03-01 SCR Technologies, Inc. Sequential chain registry for event awareness

Family Cites Families (64)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US4625081A (en) * 1982-11-30 1986-11-25 Lotito Lawrence A Automated telephone voice service system
US8505108B2 (en) * 1993-11-18 2013-08-06 Digimarc Corporation Authentication using a digital watermark
US6920468B1 (en) * 1998-07-08 2005-07-19 Ncr Corporation Event occurrence detection method and apparatus
US7143153B1 (en) * 2000-11-09 2006-11-28 Ciena Corporation Internal network device dynamic health monitoring
US7020696B1 (en) 2000-05-20 2006-03-28 Ciena Corp. Distributed user management information in telecommunications networks
US6725341B1 (en) 2000-06-28 2004-04-20 Intel Corporation Cache line pre-load and pre-own based on cache coherence speculation
US7200671B1 (en) * 2000-08-23 2007-04-03 Mks Instruments, Inc. Method and apparatus for monitoring host to tool communications
US7668740B1 (en) * 2000-09-22 2010-02-23 Ita Software, Inc. Method, system, and computer program product for interfacing with information sources
US7885981B2 (en) 2000-10-31 2011-02-08 Michael Philip Kaufman System and method for generating automatic user interface for arbitrarily complex or large databases
US7296070B2 (en) * 2000-12-22 2007-11-13 Tier-3 Pty. Ltd. Integrated monitoring system
US6842753B2 (en) * 2001-01-12 2005-01-11 Microsoft Corporation Sampling for aggregation queries
US6634732B2 (en) 2001-09-11 2003-10-21 Hewlett-Packard Development Company, L.P. Thermoplastic polymer film sealing of nozzles on fluid ejection devices and method
US7185087B2 (en) 2001-10-26 2007-02-27 Telefonaktiebolaget Lm Ericsson (Publ) Maintenance of third party service's subscription information
US7484097B2 (en) * 2002-04-04 2009-01-27 Symantec Corporation Method and system for communicating data to and from network security devices
US7219239B1 (en) * 2002-12-02 2007-05-15 Arcsight, Inc. Method for batching events for transmission by software agent
US7650638B1 (en) 2002-12-02 2010-01-19 Arcsight, Inc. Network security monitoring system employing bi-directional communication
EP1577783A4 (en) * 2002-12-26 2008-04-16 Fujitsu Ltd Operation managing method and operation managing server
US7451224B1 (en) 2003-04-23 2008-11-11 Cisco Technology, Inc. Method and apparatus for automatically synchronizing a unique identifier of a network device
US7219090B2 (en) 2003-04-25 2007-05-15 Overture Services, Inc. Method and system for blending search engine results from disparate sources into one search result
US7457872B2 (en) * 2003-10-15 2008-11-25 Microsoft Corporation On-line service/application monitoring and reporting system
US8234256B2 (en) * 2003-11-26 2012-07-31 Loglogic, Inc. System and method for parsing, summarizing and reporting log data
US7420456B2 (en) * 2004-03-19 2008-09-02 Sentri Lock, Inc. Electronic lock box with multiple modes and security states
US7581227B1 (en) 2004-03-31 2009-08-25 Google Inc. Systems and methods of synchronizing indexes
US7499958B1 (en) 2004-03-31 2009-03-03 Google Inc. Systems and methods of replicating all or part of a data store
US7146237B2 (en) * 2004-04-07 2006-12-05 Mks Instruments, Inc. Controller and method to mediate data collection from smart sensors for fab applications
JP4564052B2 (en) 2004-04-08 2010-10-20 サンガモ バイオサイエンシズ インコーポレイテッド Methods and compositions for modulating myocardial contractility
US7464077B1 (en) 2004-07-29 2008-12-09 Starview Technology, Inc. Queryable cache in real-time data management system
US7475964B2 (en) 2004-08-06 2009-01-13 Hewlett-Packard Development Company, L.P. Electrical contact encapsulation
JP4988606B2 (en) * 2005-02-28 2012-08-01 サンガモ バイオサイエンシズ インコーポレイテッド Anti-angiogenic methods and compositions
US20060277282A1 (en) * 2005-06-02 2006-12-07 International Business Machines Corporation Federated scheduling method and system
US20060287765A1 (en) 2005-06-20 2006-12-21 Kraft Harold H Privacy Information Reporting Systems with Broad Search Scope and Integration
US7937344B2 (en) * 2005-07-25 2011-05-03 Splunk Inc. Machine data web
US7756898B2 (en) 2006-03-31 2010-07-13 Isilon Systems, Inc. Systems and methods for notifying listeners of events
US7558823B2 (en) 2006-05-31 2009-07-07 Hewlett-Packard Development Company, L.P. System and method for managing virtual collaboration systems
CN101641674B (en) * 2006-10-05 2012-10-10 斯普兰克公司 Time series search engine
US20080104542A1 (en) 2006-10-27 2008-05-01 Information Builders, Inc. Apparatus and Method for Conducting Searches with a Search Engine for Unstructured Data to Retrieve Records Enriched with Structured Data and Generate Reports Based Thereon
NO325864B1 (en) 2006-11-07 2008-08-04 Fast Search & Transfer Asa A method of calculating the summary information and a search engine for supporting and implementing the method
US8380530B2 (en) 2007-02-02 2013-02-19 Webmd Llc. Personalized health records with associative relationships
US8306967B2 (en) * 2007-10-02 2012-11-06 Loglogic, Inc. Searching for associated events in log data
WO2009100373A1 (en) 2008-02-08 2009-08-13 Sangamo Biosciences, Inc. Treatment of chronic pain with zinc finger proteins
US9378512B2 (en) * 2008-04-02 2016-06-28 Microsoft Technology Licensing, Llc Interaction between ads and applications
EP2283445A1 (en) * 2008-05-19 2011-02-16 F. Hoffmann-La Roche AG Computer research tool for the organization, visualization and analysis of metabolic-related clinical data and method thereof
US8490021B2 (en) 2008-06-20 2013-07-16 Microsoft Corporation User interface for navigating large scale hierarchical namespaces
US8630888B2 (en) * 2008-07-31 2014-01-14 Siemens Aktiengesellschaft Systems and methods for analyzing a potential business partner
US7996383B2 (en) * 2008-08-15 2011-08-09 Athena A. Smyros Systems and methods for a search engine having runtime components
US8416812B2 (en) * 2008-09-22 2013-04-09 Codrut Radu Radulescu Network timing synchronization systems
US8214325B2 (en) 2008-11-20 2012-07-03 Sap Ag Federating business event data within an enterprise network
WO2010090744A1 (en) * 2009-02-04 2010-08-12 Sangamo Biosciences, Inc. Methods and compositions for treating neuropathies
US9234016B2 (en) 2009-07-28 2016-01-12 Sangamo Biosciences, Inc. Engineered zinc finger proteins for treating trinucleotide repeat disorders
US8438500B2 (en) 2009-09-25 2013-05-07 Apple Inc. Device, method, and graphical user interface for manipulation of user interface objects with activation regions
US20110099500A1 (en) 2009-10-27 2011-04-28 Jared Smith Historical network event viewing
US8819041B2 (en) * 2009-12-22 2014-08-26 Business Objects Software Limited Analyzing data within a data report
WO2011097524A1 (en) 2010-02-04 2011-08-11 Snap-On Incorporated Nested controls in a user interface
US8994311B1 (en) 2010-05-14 2015-03-31 Amdocs Software Systems Limited System, method, and computer program for segmenting a content stream
US8510284B2 (en) * 2010-12-20 2013-08-13 Microsoft Corporation Large-scale event evaluation using realtime processors
EP2472448A1 (en) 2010-12-28 2012-07-04 Hasso-Plattner-Institut für Softwaresystemtechnik GmbH A communication protocol for a communication-aware discovery service
US8699948B2 (en) * 2011-01-25 2014-04-15 Sony Corporation Connection method for near field communication
US8412696B2 (en) * 2011-01-31 2013-04-02 Splunk Inc. Real time searching and reporting
US8589375B2 (en) * 2011-01-31 2013-11-19 Splunk Inc. Real time searching and reporting
US20120239681A1 (en) 2011-03-14 2012-09-20 Splunk Inc. Scalable interactive display of distributed data
US8713693B2 (en) * 2011-07-26 2014-04-29 Salesforce.Com, Inc. Secure access to customer log data in a multi-tenant environment
US8788525B2 (en) 2012-09-07 2014-07-22 Splunk Inc. Data model for machine data for semantic search
US9081826B2 (en) * 2013-01-07 2015-07-14 Facebook, Inc. System and method for distributed database query engines
US9922099B2 (en) 2014-09-30 2018-03-20 Splunk Inc. Event limited field picker

Patent Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20060101101A1 (en) * 2002-02-13 2006-05-11 Microsoft Corporation System and Method for Storing Events to Enhance Intrusion Detection
US20040088405A1 (en) * 2002-11-01 2004-05-06 Vikas Aggarwal Distributing queries and combining query responses in a fault and performance monitoring system using distributed data gathering and storage
US20120054246A1 (en) * 2010-08-27 2012-03-01 SCR Technologies, Inc. Sequential chain registry for event awareness

Non-Patent Citations (1)

* Cited by examiner, † Cited by third party
Title
Nisheeth Shrivastava, "Medians and Beyond: New Aggregation Techniques for Sensor Networks," November 3-5, 2004 SenSys'04, Pages 1-11 *

Cited By (32)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US10162863B2 (en) 2011-03-14 2018-12-25 Splunk Inc. Interactive display of aggregated search result information
US10380122B2 (en) * 2011-03-14 2019-08-13 Splunk Inc. Interactive display of search result information
US10339149B2 (en) 2011-03-14 2019-07-02 Splunk Inc. Determining and providing quantity of unique values existing for a field
US10318535B2 (en) 2011-03-14 2019-06-11 Splunk Inc. Displaying drill-down event information using event identifiers
US20150058325A1 (en) * 2011-03-14 2015-02-26 Splunk Inc. Interactive Display of Search Result Information
US20160110770A1 (en) * 2013-03-15 2016-04-21 Facebook, Inc. Generating metrics for content items presented in an online system
US10013706B2 (en) * 2013-03-15 2018-07-03 Facebook, Inc. Generating metrics for content items presented in an online system
CN104969185A (en) * 2013-04-29 2015-10-07 惠普发展公司,有限责任合伙企业 Recording unstructured events in context
US20150341212A1 (en) * 2014-04-15 2015-11-26 Splunk Inc. Visualizations of statistics associated with captured network data
US9762443B2 (en) 2014-04-15 2017-09-12 Splunk Inc. Transformation of network data at remote capture agents
US10374883B2 (en) 2014-04-15 2019-08-06 Splunk Inc. Application-based configuration of network data capture by remote capture agents
US10366101B2 (en) 2014-04-15 2019-07-30 Splunk Inc. Bidirectional linking of ephemeral event streams to creators of the ephemeral event streams
US10360196B2 (en) 2014-04-15 2019-07-23 Splunk Inc. Grouping and managing event streams generated from captured network data
US9923767B2 (en) 2014-04-15 2018-03-20 Splunk Inc. Dynamic configuration of remote capture agents for network data capture
US10462004B2 (en) * 2014-04-15 2019-10-29 Splunk Inc. Visualizations of statistics associated with captured network data
US10127273B2 (en) * 2014-04-15 2018-11-13 Splunk Inc. Distributed processing of network data using remote capture agents
US10348583B2 (en) 2014-04-15 2019-07-09 Splunk Inc. Generating and transforming timestamped event data at a remote capture agent
US20150295796A1 (en) * 2014-04-15 2015-10-15 Splunk Inc. Adjusting network data storage based on event stream statistics
US10257059B2 (en) 2014-04-15 2019-04-09 Splunk Inc. Transforming event data using remote capture agents and transformation servers
US10523521B2 (en) 2014-04-15 2019-12-31 Splunk Inc. Managing ephemeral event streams generated from captured network data
US10367888B2 (en) * 2014-10-03 2019-07-30 Fair Isaac Corporation Cloud process for rapid data investigation and data integrity analysis
US9774681B2 (en) * 2014-10-03 2017-09-26 Fair Isaac Corporation Cloud process for rapid data investigation and data integrity analysis
US20160100009A1 (en) * 2014-10-03 2016-04-07 Fair Isaac Corporation Cloud process for rapid data investigation and data integrity analysis
WO2016054599A1 (en) * 2014-10-03 2016-04-07 Fair Isaac Corporation Cloud process for rapid data investigation and data integrity analysis
CN105574010A (en) * 2014-10-13 2016-05-11 阿里巴巴集团控股有限公司 Data querying method and device
US10193916B2 (en) 2014-10-30 2019-01-29 Splunk Inc. Configuring the generation of event data based on a triggering search query
US10264106B2 (en) 2014-10-30 2019-04-16 Splunk Inc. Configuring generation of multiple event streams from a packet flow
US10382599B2 (en) 2014-10-30 2019-08-13 Splunk Inc. Configuring generation of event streams by remote capture agents
US9596253B2 (en) 2014-10-30 2017-03-14 Splunk Inc. Capture triggers for capturing network data
US9843598B2 (en) 2014-10-30 2017-12-12 Splunk Inc. Capture triggers for capturing network data
US9838512B2 (en) 2014-10-30 2017-12-05 Splunk Inc. Protocol-based capture of network data using remote capture agents
US10334085B2 (en) 2015-01-29 2019-06-25 Splunk Inc. Facilitating custom content extraction from network packets

Also Published As

Publication number Publication date
US20140317111A1 (en) 2014-10-23
US20190251092A1 (en) 2019-08-15
US20150058326A1 (en) 2015-02-26
US20190155811A1 (en) 2019-05-23
US20130073542A1 (en) 2013-03-21
US20190317943A1 (en) 2019-10-17
US20150058375A1 (en) 2015-02-26
US20150058325A1 (en) 2015-02-26
US20140136529A1 (en) 2014-05-15
US8751529B2 (en) 2014-06-10
US20160140181A1 (en) 2016-05-19
US20160342601A1 (en) 2016-11-24
WO2012125634A1 (en) 2012-09-20
WO2012125634A8 (en) 2012-11-22
US10318535B2 (en) 2019-06-11
US10380122B2 (en) 2019-08-13
US10061821B2 (en) 2018-08-28
US9245039B2 (en) 2016-01-26
US20180329915A1 (en) 2018-11-15
US10339149B2 (en) 2019-07-02
US20150347526A1 (en) 2015-12-03
US10162863B2 (en) 2018-12-25
US20190251091A1 (en) 2019-08-15
US9129028B2 (en) 2015-09-08
US8990245B2 (en) 2015-03-24
US9430574B2 (en) 2016-08-30

Similar Documents

Publication Publication Date Title
EP2659620B1 (en) Systems and methods for scalable n-core statistics aggregation
US10423582B2 (en) System and method for investigating large amounts of data
US9762602B2 (en) Generating row-based and column-based chunks
AU2007339801B2 (en) Storing log data efficiently while supporting querying to assist in computer network security
US20070104113A1 (en) Determining whether to compress data transmitted over a network
US9432269B2 (en) Systems and methods for exporting application details using appflow
US9589029B2 (en) Systems and methods for database proxy request switching
US20130246335A1 (en) System and method for providing data protection workflows in a network environment
US8682925B1 (en) Distributed high performance analytics store
US9565076B2 (en) Distributed network traffic data collection and storage
US9130828B2 (en) Content delivery network with customized tracking of delivery data
US10423595B2 (en) Query handling for field searchable raw machine data and associated inverted indexes
US8037097B2 (en) Universal device identifier for globally identifying and binding disparate device identifiers to the same mobile device
US20160357424A1 (en) Collapsing and placement of applications
US10462004B2 (en) Visualizations of statistics associated with captured network data
EP2580692B1 (en) Query pipeline
US20120265805A1 (en) Event management for hosted applications
US8266274B2 (en) Method and apparatus for data processing
US8788526B2 (en) Data model for machine data for semantic search
US8793312B2 (en) Bridging social silos for knowledge discovery and sharing
US10264106B2 (en) Configuring generation of multiple event streams from a packet flow
US9372901B2 (en) Searching for software applications based on application attributes
US9984129B2 (en) Managing data searches using generation identifiers
US8589375B2 (en) Real time searching and reporting
US8412696B2 (en) Real time searching and reporting

Legal Events

Date Code Title Description
AS Assignment

Owner name: SPLUNK INC., CALIFORNIA

Free format text: ASSIGNMENT OF ASSIGNORS INTEREST;ASSIGNORS:ZHANG, STEVE YU;SORKIN, STEPHEN PHILLIP;SIGNING DATES FROM 20110727 TO 20110810;REEL/FRAME:026841/0120

STCB Information on status: application discontinuation

Free format text: ABANDONED -- FAILURE TO RESPOND TO AN OFFICE ACTION