WO2006050342A2 - Managing related data objects - Google Patents
Managing related data objects Download PDFInfo
- Publication number
- WO2006050342A2 WO2006050342A2 PCT/US2005/039425 US2005039425W WO2006050342A2 WO 2006050342 A2 WO2006050342 A2 WO 2006050342A2 US 2005039425 W US2005039425 W US 2005039425W WO 2006050342 A2 WO2006050342 A2 WO 2006050342A2
- Authority
- WO
- WIPO (PCT)
- Prior art keywords
- data objects
- data
- action
- actions
- relationship type
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Ceased
Links
Classifications
-
- G—PHYSICS
- G06—COMPUTING OR CALCULATING; COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/20—Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
- G06F16/24—Querying
- G06F16/242—Query formulation
- G06F16/2433—Query languages
- G06F16/2445—Data retrieval commands; View definitions
-
- G—PHYSICS
- G06—COMPUTING OR CALCULATING; COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/20—Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
- G06F16/24—Querying
- G06F16/242—Query formulation
- G06F16/2428—Query predicate definition using graphical user interfaces, including menus and forms
-
- G—PHYSICS
- G06—COMPUTING OR CALCULATING; COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/20—Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
- G06F16/28—Databases characterised by their database models, e.g. relational or object models
- G06F16/289—Object oriented databases
Definitions
- the invention relates to managing and providing an interface to related data objects.
- Data in a storage device is typically organized according to a file system.
- a file system typically organizes data (e.g., files) in a hierarchy of directories that can each contain a group of files and/or other directories.
- the hierarchy of directories can be navigated using a path that implicitly or explicitly identifies a starting location and identifies one or more files and/or directories relative to the starting location.
- a file system hierarchy can be represented as a tree of nodes, where a directory is a node with a branch for each item in the directory and a file is a leaf node.
- a branch between a node and its child represents a "contained in" relationship between the nodes.
- a path can include expressions including wildcards that filter a set of selected nodes.
- Other data systems can " be used to navigate a tree structured hierarchy of data objects.
- Xpath can be used to navigate among portions of an XML document.
- XPath models an XML document as a tree of nodes.
- One type of expression that is used for navigation in Xpath is a location path.
- a location path selects a set of nodes relative to a context node.
- the result of evaluating a location path is a set of nodes selected by the location path.
- Location paths can also include expressions that are used to filter a selected set of nodes.
- the invention features a method and corresponding software and a system for determining information related to a first set of one or more data objects of a plurality of data objects in a database.
- a composition of one or more actions is applied to determine the information related to the first set of one or more data objects.
- At least one of the actions includes a navigation action that maps a set of data objects to another set of data objects related according to a relationship type determined from a specification of the navigation action.
- aspects of the invention can include one or more of the following features:
- Applying the composition of one or more actions includes recursive application of the navigation action.
- Recursive application of the navigation action can include recursive application of a composition of navigation actions that includes the navigation action.
- Applying the composition of one or more actions can. include identifying data objects found in the recursive application of the navigation action, and/or identifying data objects found at the end of the recursive application of the navigation action.
- a specification of a visual representation of information about data objects in the database is accepted.
- the specification includes a specification of the composition of one or more actions.
- the visual representation including tlxe information related to the first set of one or more data objects is presented to a user.
- the specification of the navigation action includes a function whos-e arguments include a category of data objects and a name of an annotation male specifying the relationship type.
- the actions include a second action that performs a function based values associated with the data objects returned by the navigation action, where each value represents an attribute of the associated data object.
- the function can incliide filtering the returned set of data objects based on the values to generate a subset of the returned set, sorting the returned set of data objects, an arithmetic function of at lea.st some of the values, and/or a logical function of at least some of the values.
- the relationship type corresponds to one of multiple relationship t ⁇ es, such as categories of data objects.
- the relationship type identifies a value associated with a first data, object that refers to a value associated with a second data object
- the first data object is in a first category and the second data object is in a second category.
- the value associated with the first data object is a foreign-key and the value associated with the second data object is a primary-key.
- the techniques described herein enable navigation among data objects in a database (an object oriented relational database) that are potentially related by multiple types of relationships (e.g., multiple types of primary-key/foreign-key relationships).
- a specification of a navigation action determines a relationship type
- the navigation action can be used to locate a set of data objects related according to that relationship type.
- Recursive application of a navigation action enables greater flexibility in locating related data objects.
- the ability to perform a function based attribute values associated with data objects also enables greater flexibility in extracting desired information from the database.
- FIG. IA is a block diagram of a computing system.
- FIG. IB is a block diagram of a metadata repository.
- FIG. 2 is an entity-relationship diagram of an exemplary base schema.
- FIG. 3 is a rendered page for a View.
- FIG. IA is a block diagram showing the interrelationship of parts of a computing system 100 for developing, executing and managing graph-based computations.
- a graph-based computation is implemented using a "data flow graph" that is represented by a directed graph, with vertices in the graph representing components (either data files or processes), and the directed links or "edges" in the graph representing flows of data between components.
- a graphic development environment (GDE) 102 provides a user interface for specifying executable graphs and defining parameters for the graph components.
- the GDE may be, for example, the COOPERATING SYSTEM® GDE available from the assignee of the present invention.
- the GDE 102 communicates with a repository 104 and a parallel operating environment 106. Also coupled to the repository 104 and the parallel operating environment 106 are a User Interface module 108 and an executive 110.
- the repository 104 preferably is a scalable object-oriented database system designed to support the development and execution of graph-based applications and the interchange of metadata between the graph-based applications and other systems (e.g., other operating systems).
- the repository 104 is a storage system for all kinds of metadata, including documentation, record formats (e.g., fields and data types of records in a table), transform functions, graphs, jobs, and monitoring information.
- the repository 104 also stores data objects that represent actual data to be processed by the computing system 100 including data stored in an external data store 112.
- the parallel operating environment 106 accepts a specification of a data flow graph generated in the GDE 102 and generates computer instructions that correspond to the processing logic and resources defined by the graph. The parallel operating environment 106 then typically executes those instructions on a plurality of processors (which need not be homogeneous).
- a suitable parallel operating environment is the COOPERATING SYSTEM® available from the assignee of the present invention.
- the User Interface module 108 provides a web-browser-based view of the contents of the repository 104. Using the User Interface module 108, a user may browse objects, create new objects, alter existing objects, specify application parameters, schedule jobs, etc. The User Interface module 108 generates forms-based browser screens for a user to search for and view objects and information about objects stored in the repository 104.
- the executive 110 is an optional repository-based job scheduling system accessed through the User Interface module 108. The executive 110 maintains jobs and job queues as objects within the repository 104, and the User Interface module 108 provides a view of and facilities to manipulate jobs and job queues.
- the repository 104 stores metadata including data objects for graph-based applications including graph components and other functional objects for building computation graphs. Metadata stored in the repository 104 can also include, for example, "technical” metadata (e.g., application-related business rules, record formats, and execution statistics) and "enterprise” or "business” metadata (e.g., user- defined documentation of job functions, roles, and responsibilities).
- “technical” metadata e.g., application-related business rules, record formats, and execution statistics
- enterprise or business metadata e.g., user- defined documentation of job functions, roles, and responsibilities
- the information stored in the repository 104 in the form of data objects enables various kinds of analysis about applications and the data processed by those applications. For example, a user can obtain answers to questions about data lineage (e.g., Where did a given value come from? How was the output value compixted? Which applications produce and depend on this data?). A developer can understand the consequences of proposed modifications (e.g., If this piece changes, what else will be affected? If this source format changes, which applications will be affected?). A user/developer can also obtain questions to answers involving both technical metadata and business metadata (e.g., Which groups are responsible for producing and. using this data? Who changed this application last? What changes did they make?).
- the repository 104 is able to track the state of stored data. Data objects stored in the repository 104 are versioned, making it possible to examine the state of things as of last week, last month, or last year, and to compare it with the state of things today.
- the repository 104 collects job-tracking, or execution information which enables trend analysis (e.g., How fast is our data growing?) and capacity planning (e.g., How long did that application take to run? How much data did it process, and at what rate? What resources did the application consume? Wh.en will we need to add another server?).
- a user can view (and optionally, edit) information contained in and/or associated with the stored data objects through the User Interface module 108.
- a -user can define one or more "Views," which provide information about a relevant subset of the data objects in a Web page.
- a View is defined using a syntax for selecting one or more data objects based on relationships among those objects, as described in more detail below.
- FIG. 2 sho ⁇ vs selected categories in a base schema 200 for metadata associated with a company, represented as an entity-relationship diagram.
- the base schema 2OO defines the underlining relational structure of the metadata that is stored in the repository 104.
- the entity types in the base schema 200 are called "categories.” Each category represents a class of data objects. Each category includes a set of "annotation rules.”
- An annotation rule of a category is similar to a column definition of a table, as described in more detail below.
- a user can extend the base schema 200 by adding user-defined categories.
- a user is able to add a "child" category based on an already existing "parent" category.
- the child category includes the annotation rules of the parent category and optionally includes further annotation rules specific to the child category.
- Data objects can be stored in the repository 104 as members of a category.
- ⁇ data object that is a member of a category is similar to a row in a table.
- a member data object e.g., a data structure that contains information about an employee
- a member data object can be associated with a category through a reference within the data object.
- a data object that is a member of a category stores values associated with the annotation rules defined for that category.
- a "primary-key” for a category is an annotation rule (or rules) whose value (or values taken together) uniquely identifies each data object in the category.
- a first data object has a primary-key/foreign-key relationship to a second data object (in a different category or in the same category) when the second data object has an annotation rule value that references a. primary- key value of the first data object.
- This annotation rule for the second data object is called a "foreign-key.”
- a primary-key that is made up of more than one annotation rule value is called a "composite-key.”
- the base schema 200 depicts potential relationships that can exist between data objects belonging to various categories.
- a line connecting two categories represents the "connectivity" of potential relationships between data objects of the respective categories.
- the basic types of connectivity between categories are: one-to-one, one-to-many, and many-to-many.
- a one-to-one connectivity exists when at most one data object in category A is related to one data object in category B.
- an "Employee" category 202 represents employees in a company, with each data object in the category representing an employee.
- An "Office” category 204 represents occupied offices in a building, with each data object representing an office. If each employee is assigned their own office, the corresponding data objects would have a one-to-one foreign-key relationship.
- a one-to-one connectivity is depicted in FIG. 2 as a line.
- a one-to-many connectivity exists when, for one data object in category A, there are zero, one, or many related data objects in category B, and for one data object in category B, there is one related data object in category A.
- the "Employee” category 202 represents employees in a company.
- a "Department” category 206 represents departments in the company. Each employee is related to one department, and each department is related to many employees. Therefore, the data objects corresponding respectively to "Department” and "Employee” have a one-to- many foreign-key relationship.
- a one-to-many connectivity is depicted in FIG. 2 as a line ending with a crow's foot.
- a many-to-many connectivity exists when, for one data object in category A, there are zero, one, or many related data objects in category B, and for one data object in category B there are zero, one, or many related data objects in category A.
- employees can be assigned to any number of projects at the same time, and a project (a data object in the "Project” category 208) can have any number of employees assigned to it.
- Corresponding data objects from the "Employee" and "Project" categories would have a many-to-many foreign-key relationship.
- a many-to-many connectivity is depicted in FIG. 2 as a line beginning and ending with a crow's foot.
- Annotation rules define various characteristics of values that can be associated with the data objects that are members of a given category.
- An annotation rule can be single-valued or multi-valued.
- Each annotation rule has a unique name by which it is identified.
- Multiple categories can have one or more annotation rules in cormnon. hi one implementation there are four types of annotation rules that provide a user (e.g., an application developer) the ability to constrain the number and kirxds
- annotation rules data types of values that can be associated with a data object (e.g., by an end user).
- the four types of annotation rules are: string, choice, reference and record.
- the characteristics of the four types of annotation rules are as follows.
- a string-type annotation rule associates a data object with one or more strings (e.g., an ASCII string). One or more strings are attached to the data object and associated with the name of the annotation rule.
- a string-type annotation rule that has one string value is single-valued. For example, an Employees data object can have a single-valued "Social Security number" string-type annotation rule, since an employee has one Social Security number.
- a string annotation rule that has more than one string value is multi-valued. For example, an Employees data object can have a multi-valued "phone number" string-type annotation rule, since an employee can have more than one phone number.
- a choice-type annotation rule associates a data object with one or more values that are chosen by a user from a list of possible values. For example, a choice-type rule can be used when there is an expectation about the valid values that an annotation rule may have. For a single-valued choice-type annotation rule, an end user may only select one of a number of choices. An example of a single-valued choice-type annotation rule is a value that represents an answer to a question having only one of two possible answers: "yes" or "no.”
- an end user may select any number of values from a list of possible values. For example, an employee might work in two departments: “Development” and "QA.”
- a choice-type "Department” annotation rule would allow an end user to select the appropriate values from a list of departments: "Finance,” “Development,” “Operations,” “Documentation”, “QA,” and “Executive.”
- the list of possible values can be limited to a predefined list of values defined by a user.
- an end user is able to specify a value that is not in the predefined list of values.
- the end user is able to add that value to the predefined list of values so that otrier end users can see that value as an option.
- the unlisted value can be saved in the repository 104, but not displayed as an option for other end users.
- a reference-type annotation rule associates a first data object with one or more other data objects.
- the data object can be a member of the same category or of a different category as th.e first data object.
- a multi-valued reference-type annotation rule can refer to multiple data objects.
- the reference-type annotation rule can be used to indicate primary- key/foreign-key relationships between data objects.
- the value of the reference-type annotation rule can be a foreign-key value that refers to a primary-key valixe of a data object in a different category.
- an annotation rule of a data object in the "Employee” category Includes a reference-type annotation rule "departmentKEY” that has a value that matches the value of a string-type annotation rule "key” that uniquely identifies a data object in the "Department” category.
- the unique object identifier "key” acts as a primary key.
- a data object can have multiple reference-type annotation rules that each represents a different relationship type.
- a data object in the "'Employee” category also includes a reference-type annotation rule "officeKEY” that lias a value that matches the values of a string-type annotation rule "key” that uniquely identifies a data object in the "Office” category.
- a record-type annotation rule associates a data object with a set of annotation rule values from an object in another category.
- the value of an "email_info" annotation rule of the "Employee” category includes all of the values of the annotation rules defined for an "Email Info” category (not shown).
- a data object in the "Email Info” category has a string-type annotation rule “home_email” with a value of "joe@home.com” and a string-type annotation rule “work_email” with a value of "joe@work.com,” then a data object in the "Employees” category can reference that data object to associate the values "joe@home.com” and “joe@home.com” with “email_info.” 2.2.5 Examples
- each category in the base schema 200 has 2 annotation rules in common: key, and name. Descriptions of these annotation rules are given below.
- key a string uniquely identifying each data object in the repository.
- name the name of the data object
- Each category can also have annotation rules that are specific to that category. For example, some of the annotation rules for the categories "Employee” and “Department” in the base schema 200 are given below.
- Annotation rules for the "Employee” category representing an employee in a company include: start _date: the date on which the employee began employment. name: the name of the employee. start_date: the gender of the employee "F” for female, "M” for male. managed JyyKEY: this value refers to the key value of another employee who is the employee's manager. departmentKEY: this value refers to a key value for a member of the Department category representing the department in which the employee works.
- email _info represents email information for an employee.
- projectlCEY this value refers to a key value for a member of the Project category representing a project to which the employee is assigned.
- officeK ⁇ Y this value refers to a key value for a member of the Office category representing trie office in which the employee works.
- Annotation rules for the "Department" category representing a department within a company include: name: refers to the name of the department. location: refers to the location of the offices for the department. 3 Views
- a user can view (and optionally, edit) metadata in the repository 104 using a user-defined View presented to the user in a Web browser through fixe User Interface module 108.
- the metadata repository 104 includes relational data 150 defining data object categories and annotation rules, data objects 152 that correspond to instances of the objects defined by relational data 150, and stored Views 154 that are defined by a user for accessing desired information contained in and/or associated with the data objects 152.
- the User Interface module 108 accesses the appropriate data objects from the repository 104 according to a View and renders an HTML page with the desired information C e -g-> a label for a.
- Each View is associated with a category and includes one or more "View- elements" that define metadata to be rendered.
- Each View-element includes an element-descriptor that enables retrieval of metadata based on one or more data objects in the associated category or in a category that is related to the associated category through one or more primary-key/foreign-key relationships.
- FIG. 3 shows an example of a rendered HTML page 300 for a View.
- the page 300 includes a header 302 that includes a navigation bar, a content section 304, and a footer 306.
- the content section 304 includes a name 308 of the category for which the View is defined (e.g., Employee) and a name 310 of a primary data object in the category with which the information in the View is associated.
- the content section 3O4 also includes information associated with the primary data object such as a user-dejfined label 312, and a value 314 of annotation rule for the primary data object.
- the page 300 also includes View-elements that are able to display information associated with other data objects related to the primary data obj ect.
- the page 300 includes a View-element 318 that displays "Applications this employee is responsible for" (members of an "Applications” category), and a View-element 320 that displays "Data files this employee is responsible for" (members of a "Data Files” category).
- View-elements There are three types of View-elements: simple, view, decorate.
- a simple- type View-element includes metadata based on annotation rule values of data objects in the associated category or in a category that is related to the associated category through one or more primary-key/foreign-key relationships.
- a view-type View- element includes metadata specified within a previously defined View for a category that is related to the associated category through one or more primary-key/foreign-key relationships.
- a decorate-type View-element includes text (e.g., an introduction to the Web page) to be rendered on the Web page for the View.
- the add-view-element command is used to define one or more view-elements and associate them with an existing View on a specified category.
- a user adds the view-elements in the order in which they are to be displayed in the User Interface module 108.
- the syntax for the command is: add-view-element category view element-type label element-descriptor element-view.
- the command argruments are defined as follows: category: the name of an existing category.
- view the name of an existing View defined on category to which this View- element is to be added.
- element-type specifies one of: simple-type, vzew-type, or decorate-type.
- label text string that describes a metadata item.
- element-descriptor describes the metadata to be retrieved (except for decorate-type ⁇ .
- element-view (only used if element-type is vzew-type) the name of the View to be included.
- the User Interface module 108 provides a syntax for a user to specify an element-descriptor that enables the User Interface module 108 to retrieve the desired metadata.
- the element-descriptor includes a composition of actions.
- the User Interface module 108 performs the composition of actions relative to a starting context that identifies a set of one or more data objects.
- starting context may include a data object that is selected by a user through an on-screen link, or a starting context may include a set of data objects associated with a user-selected category.
- the first action operates on this starting set of data object(s).
- Each subsequent action (if any) operates on the output returned from the preceding action.
- the output returned from an action can include a set of one or more data objects (e.g., in the form of primary-key values for the data objects), one or more values of annotation rules, or the results of a computation (e.g., a count of the number of data objects output form the preceding action).
- a returned set of one or more data objects and/or annotation rule values become a "starting set" for a subsequent action.
- composition of actions includes an action identifier (a keyword identifying the action) plus any arguments (some actions have no arguments).
- a sequence of action identifiers representing a corresponding composition of actions can optionally include a single action or multiple actions separated by a period (a ".” symbol), for example: action 1 ( ⁇ arg ⁇ ments>).action2( ⁇ argwnents>).action3()
- a “stroll” is a composition of one or more "navigation actions” that represents a specification of navigating from a starting set of one or more data objects to a destination set of one or more data objects.
- Navigation actions include a walk action and an inv_walk action defined as: walkfarule, cat): returns the data objects in category cat that are referenced by the annotation rule arule for each starting data object.
- invjwalk (arule, cat): returns the data objects in category cat that have an annotation rule anile that references any member of the set of starting data objects.
- the starting object is a manager and the desired data are the employees that report directly to that manager
- the corresponding element-descriptor is the following stroll having a single navigation action: inv_walk(managed_byKEY, Employee)
- the starting object is a project and the desired data are all the managers of employees working on that project
- the corresponding element-descriptor is the following stroll having multiple navigation actions: inv_walk(projectKEY, Employee). ⁇ walk(managed_byKEY,Employee)
- This example illustrates the use of the backslash (a " ⁇ " symbol) to indicate the continuation of an element-descriptor on a new line.
- Some navigation actions navigate among data objects by performing a specified stroll recursively.
- two recursive navigation actions are: gather _all and find ' ultimate, described below.
- gather _all (stroll): performs the navigation actions specified by stroll recursively and returns all the data objects found at each step of the recursion.
- findjultimate (stroll): performs the navigation actions specified by stroll recursively and returns all the "leaf node" data objects found at the end of the recursion (data objects for which the specified navigation actions return a null output).
- Some actions operate on a starting set using an "expression" similar to those used in scripting languages such as Python.
- the following are examples of expression actions that operate on a starting set of one or more starting data objects and/or annotation rale values.
- sort returns the starting set sorted by the expression expr (e.g., a python expression).
- rsort (expr) returns the starting set sorted in reverse order by the expression expr.
- avg (expr) returns the average of the expression expr over the starting set.
- countQ returns the number of items in the starting set.
- an expression can include functional syntax (e.g., keywords) that can perform functions on the starting set.
- functional syntax e.g., keywords
- the keyword ami is combined with an annotation rule arule as ann.arule to return values of the annotation rale arule.
- ann.key occurring in an expression expr returns the value of the key annotation rale of a data ob>j ect to which the expression applies.
- the keyword position occurring in an expression applied to each item in a starting set returns the position of each item within an ordered list of items in the starting set. For example, the following element-descriptor returns the five most senior employees from the starting set: sort(ann.start_date).filter(position ⁇ 5)
- the sort action arranges the start dates, a list of values, in ascending order.
- the filter action applies the expression 'position ⁇ 5' to the list of values returned by sort and returns the first five values (in positions 0 to 4).
- the keyword look_ahead provides the ability to filter based on data objects that are not directly available in a starting set.
- the expression look_ahead(strol ⁇ ) included within a filter action applies the navigation actions in stroll to each data object in the starting set and returns a set of data objects that can be used to filter the data objects in the starting set. If a filter action contains only the look _ahead(str -oil) expression, then a starting data object in the starting set is filtered based on whether the navigation actions in stroll return any data objects from that starting data object. If so, the filter returns the starting data object. If not, the filter does not return (“filters out”) the starting data object.
- a view for the "Employee" category may include information about employees' managers.
- a filter would use the keyword lookjihead to see information about the employee's managers.
- An element-descriptor describing the set of all employees who have at least two levels of management above them would be: f ⁇ lter(look_ahead(walk(managed_byKEY, Employee). ⁇ walk(managed_byKEY, Employee) .count ()) > 0)
- An element-descriptor for retrieving the number of employees in an employee's department starting from a context including the employee is: walk(departmentKEY, Department). inv_walk(departmentKEY, Employee). count ()
- the walk navigation action finds the Department object that includes this employee.
- the inv_walk navigation action finds all Employees who are in that Department. Then the count action finds the number of such graphs.
- the navigation finds the most senior employee in a the Department given in the starting context.: inv_walk(departmentKEY, Employee). sort(ann.start_date). ⁇ filter (position ⁇ 1)
- the invjvalk navigation action follows the depatrtmentKEY annotation rule backward to all employees in that department. Then the rsort action reverse sorts these employees by their start date — from oldest to most recent. Then the filter action acts on the sorted list of employees, selecting only the first object in the list. The result is the most senior employee in the department.
- This example includes an additional filter action. After finding all the employees in the department, the first filter action selects the female employees. Then sort performs a reverse sort on the list of female employees— arranging the employees from most senior to most recent. Operating on the sorted female employees, the second filter action discards all but the most senior employee.
- obtaining desired information includes filtering on a value that is not directly available in a given context for an element-descriptor. For example, given a set of employees, a list of the managers of those employees may be desired. Information such as the gender of the managers can be obtained from these manager data objects. To support these kinds of queries, the filter action can be used with the keyword look_ahead as described above.
- the following exemplary element- descriptor uses a. filter action with the lookjxhe ⁇ d keyword from a starting context including all employees to find the employees whose managers are male:
- look_ahead keyword The stroll passed into lookjihead describes a series of one or more navigation actions that can be used to reach the data object(s) of interest. In this case, a first walk action in the stroll follows the employee data object's managed JbyKEY annotation rule. The next walk action filters these objects by the value of the gender annotation rule. If the employees' managers are not male, they are filtered out of the result set.
- the "+" symbol aggregates the results of multiple strolls.
- the first stroll is similar to Example 4, but the set of all employees whose managers are male is further filtered to return only the female employees in the set.
- the second stroll finds all employees whose managers are female, then filters this set to return only the employees that are male.
- gather_all navigation action gather_all(inv_walk(managed_byKEY, Employee))
- the stroll is from a set of employees to all the employees managed by them.
- the gather _all action causes this stroll to be performed recursively, so that the answer set is the set of all employees "below" the starting set of employees in the company hierarchy.
- the data object management techniques described above can be implemented using software for execution on a computer.
- the software forms procedures in one or more computer programs that execute on one or more programmed or programmable computer systems (which may be of various architectures such as distributed, client/server, or grid) each including at least one processor, at least one data storage system (including volatile and non- volatile memory and/or storage elements), at least one input device or port, and at least one output device or port.
- the software may form one or more modules of a larger program, for example, that provides other services related to the design and configuration of computation graphs.
- the nodes and elements of the graph can be implemented as data structures stored in a computer readable medium or other organized data conforming to a data model stored in a data repository.
- the software may be provided on a medium, such as a CD-ROM, readable by a general or special purpose programmable computer or delivered (encoded in a propagated signal) over a network to the computer where it is executed. All of the functions may be performed on a special purpose computer, or using special-purpose hardware, such as coprocessors.
- the software may be implemented in a distributed manner in which different parts of the computation specified by the software are performed by different computers.
- Each such computer program is preferably stored on or downloaded to a storage media or device (e.g., solid state memory or media, or magnetic or optical media) readable by a general or special purpose programmable computer, for configuring and operating the computer when the storage media or device is read by the computer system to perform the procedures described herein.
- the inventive system may also be considered to be implemented as a computer- readable storage medium, configured with a computer program, where the storage medium so configured causes a computer system to operate in a specific and predefined manner to perform the functions described herein.
Landscapes
- Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- Physics & Mathematics (AREA)
- Databases & Information Systems (AREA)
- General Physics & Mathematics (AREA)
- Data Mining & Analysis (AREA)
- General Engineering & Computer Science (AREA)
- Computational Linguistics (AREA)
- Mathematical Physics (AREA)
- Human Computer Interaction (AREA)
- Information Retrieval, Db Structures And Fs Structures Therefor (AREA)
- User Interface Of Digital Computer (AREA)
- Navigation (AREA)
Priority Applications (5)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| AU2005302270A AU2005302270B2 (en) | 2004-11-02 | 2005-11-01 | Managing related data objects |
| CN200580037483.1A CN101438280B (zh) | 2004-11-02 | 2005-11-01 | 管理相关数据对象 |
| JP2007540368A JP4879908B2 (ja) | 2004-11-02 | 2005-11-01 | 関係データオブジェクトの管理 |
| CA2584326A CA2584326C (en) | 2004-11-02 | 2005-11-01 | Managing related data objects |
| EP05825020A EP1815363A4 (en) | 2004-11-02 | 2005-11-01 | MANAGEMENT OF RELATED DATA OBJECTS |
Applications Claiming Priority (2)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| US10/979,742 US7899833B2 (en) | 2004-11-02 | 2004-11-02 | Managing related data objects |
| US10/979,742 | 2004-11-02 |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| WO2006050342A2 true WO2006050342A2 (en) | 2006-05-11 |
| WO2006050342A3 WO2006050342A3 (en) | 2009-04-09 |
Family
ID=36263329
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| PCT/US2005/039425 Ceased WO2006050342A2 (en) | 2004-11-02 | 2005-11-01 | Managing related data objects |
Country Status (7)
| Country | Link |
|---|---|
| US (1) | US7899833B2 (https=) |
| EP (1) | EP1815363A4 (https=) |
| JP (1) | JP4879908B2 (https=) |
| CN (1) | CN101438280B (https=) |
| AU (1) | AU2005302270B2 (https=) |
| CA (1) | CA2584326C (https=) |
| WO (1) | WO2006050342A2 (https=) |
Cited By (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| JP2011517352A (ja) * | 2008-02-26 | 2011-06-02 | アビニシオ テクノロジー エルエルシー | データ関連性のグラフ表現 |
Families Citing this family (77)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| GB9903474D0 (en) * | 1999-02-17 | 1999-04-07 | Univ Newcastle | Process for the conversion of a fluid phase substrate by dynamic heterogenous contact with an agent |
| US20060161471A1 (en) * | 2005-01-19 | 2006-07-20 | Microsoft Corporation | System and method for multi-dimensional average-weighted banding status and scoring |
| US20070156680A1 (en) * | 2005-12-21 | 2007-07-05 | Microsoft Corporation | Disconnected authoring of business definitions |
| US8261181B2 (en) * | 2006-03-30 | 2012-09-04 | Microsoft Corporation | Multidimensional metrics-based annotation |
| US20070233925A1 (en) * | 2006-03-31 | 2007-10-04 | Sap Ag | Centralized management of data nodes |
| US7743041B2 (en) * | 2006-04-07 | 2010-06-22 | Lawson Software, Inc. | Data oriented navigation within software applications |
| US8190992B2 (en) * | 2006-04-21 | 2012-05-29 | Microsoft Corporation | Grouping and display of logically defined reports |
| US20080172287A1 (en) * | 2007-01-17 | 2008-07-17 | Ian Tien | Automated Domain Determination in Business Logic Applications |
| US9058307B2 (en) | 2007-01-26 | 2015-06-16 | Microsoft Technology Licensing, Llc | Presentation generation using scorecard elements |
| US8321805B2 (en) | 2007-01-30 | 2012-11-27 | Microsoft Corporation | Service architecture based metric views |
| US8495663B2 (en) | 2007-02-02 | 2013-07-23 | Microsoft Corporation | Real time collaboration using embedded data visualizations |
| US8069129B2 (en) | 2007-04-10 | 2011-11-29 | Ab Initio Technology Llc | Editing and compiling business rules |
| US8954482B2 (en) * | 2007-09-20 | 2015-02-10 | Ab Initio Technology Llc | Managing data flows in graph-based computations |
| KR20090052673A (ko) * | 2007-11-21 | 2009-05-26 | 엘지전자 주식회사 | 단말기, 그 제어 방법 및 이를 위한 기록 매체 |
| WO2010002919A1 (en) * | 2008-06-30 | 2010-01-07 | Ab Initio Software Llc | Data logging in graph-based computations |
| CA2744881C (en) * | 2008-12-02 | 2020-03-10 | Ab Initio Technology Llc | Mapping instances of a dataset within a data management system |
| KR20150042868A (ko) * | 2008-12-02 | 2015-04-21 | 아브 이니티오 테크놀로지 엘엘시 | 데이터 유지 시스템 |
| KR101639292B1 (ko) * | 2008-12-02 | 2016-07-13 | 아브 이니티오 테크놀로지 엘엘시 | 데이터 요소 사이의 관계를 시각화하는 방법 |
| AU2010208112B2 (en) | 2009-01-30 | 2015-05-28 | Ab Initio Technology Llc | Processing data using vector fields |
| KR20150038757A (ko) * | 2009-02-13 | 2015-04-08 | 아브 이니티오 테크놀로지 엘엘시 | 데이터 저장 시스템과의 통신 |
| US8205113B2 (en) | 2009-07-14 | 2012-06-19 | Ab Initio Technology Llc | Fault tolerant batch processing |
| US9146735B2 (en) * | 2009-07-23 | 2015-09-29 | International Business Machines Corporation | Associating workflows with code sections in a document control system |
| AU2010295547B2 (en) | 2009-09-16 | 2015-05-07 | Ab Initio Technology Llc | Mapping dataset elements |
| WO2011081776A1 (en) * | 2009-12-14 | 2011-07-07 | Ab Initio Technology Llc | Specifying user interface elements |
| US20110145240A1 (en) * | 2009-12-15 | 2011-06-16 | International Business Machines Corporation | Organizing Annotations |
| US9665620B2 (en) * | 2010-01-15 | 2017-05-30 | Ab Initio Technology Llc | Managing data queries |
| US9280574B2 (en) | 2010-09-03 | 2016-03-08 | Robert Lewis Jackson, JR. | Relative classification of data objects |
| AU2011323773B2 (en) | 2010-10-25 | 2015-07-23 | Ab Initio Technology Llc | Managing data set objects in a dataflow graph that represents a computer program |
| US9349115B2 (en) * | 2011-01-11 | 2016-05-24 | International Business Machines Corporation | Data management and control using data importance levels |
| US9418095B2 (en) | 2011-01-14 | 2016-08-16 | Ab Initio Technology Llc | Managing changes to collections of data |
| US9116759B2 (en) | 2011-02-18 | 2015-08-25 | Ab Initio Technology Llc | Restarting data processing systems |
| US9021299B2 (en) | 2011-02-18 | 2015-04-28 | Ab Initio Technology Llc | Restarting processes |
| US9116955B2 (en) | 2011-05-02 | 2015-08-25 | Ab Initio Technology Llc | Managing data queries |
| US8548973B1 (en) * | 2012-05-15 | 2013-10-01 | International Business Machines Corporation | Method and apparatus for filtering search results |
| US8843483B2 (en) | 2012-05-29 | 2014-09-23 | International Business Machines Corporation | Method and system for interactive search result filter |
| JP6338579B2 (ja) * | 2012-07-24 | 2018-06-06 | アビニシオ テクノロジー エルエルシー | データモデルにおけるエンティティのマッピング |
| US9430548B1 (en) * | 2012-09-25 | 2016-08-30 | Emc Corporation | Generating context tree data based on a tailored data model |
| US9852153B2 (en) | 2012-09-28 | 2017-12-26 | Ab Initio Technology Llc | Graphically representing programming attributes |
| US10489360B2 (en) | 2012-10-17 | 2019-11-26 | Ab Initio Technology Llc | Specifying and applying rules to data |
| CN104756107B (zh) | 2012-10-22 | 2019-01-01 | 起元科技有限公司 | 采用位置信息剖析数据 |
| US9703822B2 (en) | 2012-12-10 | 2017-07-11 | Ab Initio Technology Llc | System for transform generation |
| US9116603B2 (en) | 2012-12-26 | 2015-08-25 | Ab Initio Technology Llc | Managing interactions with data having membership in multiple groupings |
| US9811233B2 (en) | 2013-02-12 | 2017-11-07 | Ab Initio Technology Llc | Building applications for configuring processes |
| US9348888B1 (en) * | 2013-09-24 | 2016-05-24 | Emc Corporation | Iterative filter expression processing for filtering embedded data objects |
| EP3049913B1 (en) | 2013-09-27 | 2022-05-11 | Ab Initio Technology LLC | Evaluating rules applied to data |
| US9891901B2 (en) | 2013-12-06 | 2018-02-13 | Ab Initio Technology Llc | Source code translation |
| US8949283B1 (en) | 2013-12-23 | 2015-02-03 | Google Inc. | Systems and methods for clustering electronic messages |
| US9767189B2 (en) | 2013-12-30 | 2017-09-19 | Google Inc. | Custom electronic message presentation based on electronic message category |
| US9015192B1 (en) | 2013-12-30 | 2015-04-21 | Google Inc. | Systems and methods for improved processing of personalized message queries |
| US9542668B2 (en) | 2013-12-30 | 2017-01-10 | Google Inc. | Systems and methods for clustering electronic messages |
| US9124546B2 (en) | 2013-12-31 | 2015-09-01 | Google Inc. | Systems and methods for throttling display of electronic messages |
| US9306893B2 (en) | 2013-12-31 | 2016-04-05 | Google Inc. | Systems and methods for progressive message flow |
| US10033679B2 (en) | 2013-12-31 | 2018-07-24 | Google Llc | Systems and methods for displaying unseen labels in a clustering in-box environment |
| US9152307B2 (en) | 2013-12-31 | 2015-10-06 | Google Inc. | Systems and methods for simultaneously displaying clustered, in-line electronic messages in one display |
| JP6609262B2 (ja) | 2014-03-14 | 2019-11-20 | アビニシオ テクノロジー エルエルシー | キー指定される実体の属性のマッピング |
| WO2015191845A1 (en) * | 2014-06-11 | 2015-12-17 | Rengaswamy Mohan | Methods and apparatus for harmonization of data stored in multiple databases using concept-based analysis |
| CN106796513B (zh) | 2014-07-18 | 2020-12-11 | 起元科技有限公司 | 管理沿袭信息 |
| US9626393B2 (en) | 2014-09-10 | 2017-04-18 | Ab Initio Technology Llc | Conditional validation rules |
| US10055333B2 (en) | 2014-11-05 | 2018-08-21 | Ab Initio Technology Llc | Debugging a graph |
| US10437819B2 (en) | 2014-11-14 | 2019-10-08 | Ab Initio Technology Llc | Processing queries containing a union-type operation |
| US9875288B2 (en) | 2014-12-01 | 2018-01-23 | Sap Se | Recursive filter algorithms on hierarchical data models described for the use by the attribute value derivation |
| US10176228B2 (en) * | 2014-12-10 | 2019-01-08 | International Business Machines Corporation | Identification and evaluation of lexical answer type conditions in a question to generate correct answers |
| US10417281B2 (en) | 2015-02-18 | 2019-09-17 | Ab Initio Technology Llc | Querying a data source on a network |
| US9684526B2 (en) | 2015-05-15 | 2017-06-20 | Ab Initio Technology Llc | Techniques for configuring a generic program using controls |
| US10127264B1 (en) | 2015-09-17 | 2018-11-13 | Ab Initio Technology Llc | Techniques for automated data analysis |
| WO2017132717A1 (en) * | 2016-02-01 | 2017-08-10 | Global Software Innovation Pty Ltd | Graph-based operations on an entity-relationship database |
| US9959154B2 (en) * | 2016-02-16 | 2018-05-01 | International Business Machines Corporation | Identifying defunct nodes in data processing systems |
| CN108090078B (zh) * | 2016-11-22 | 2021-11-30 | 北京京东尚科信息技术有限公司 | 文档在线预览方法及装置、存储介质、电子设备 |
| CA3045810A1 (en) | 2016-12-01 | 2018-06-07 | Ab Initio Technology Llc | Generating, accessing, and displaying lineage metadata |
| US11423083B2 (en) | 2017-10-27 | 2022-08-23 | Ab Initio Technology Llc | Transforming a specification into a persistent computer program |
| US11068540B2 (en) | 2018-01-25 | 2021-07-20 | Ab Initio Technology Llc | Techniques for integrating validation results in data profiling and related systems and methods |
| US11010456B2 (en) | 2018-04-17 | 2021-05-18 | Adp, Llc | Information access in a graph database |
| US11755754B2 (en) * | 2018-10-19 | 2023-09-12 | Oracle International Corporation | Systems and methods for securing data based on discovered relationships |
| US11093223B2 (en) | 2019-07-18 | 2021-08-17 | Ab Initio Technology Llc | Automatically converting a program written in a procedural programming language into a dataflow graph and related systems and methods |
| CN112257401B (zh) * | 2020-12-22 | 2021-03-19 | 畅捷通信息技术股份有限公司 | 一种数据对象的自适应扩展方法、装置及存储介质 |
| CA3209125A1 (en) | 2021-01-31 | 2022-08-04 | Ab Initio Technology Llc | Data processing system with manipulation of logical dataset groups |
| JP7832951B2 (ja) | 2021-01-31 | 2026-03-18 | アビニシオ テクノロジー エルエルシー | データ処理システム用のデータセットマルチプレクサ |
Family Cites Families (8)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US5596746A (en) * | 1991-10-21 | 1997-01-21 | General Electric Company | Method for transforming relational data base schemas into object models using ideal table meta models |
| US5701453A (en) * | 1993-07-01 | 1997-12-23 | Informix Software, Inc. | Logical schema to allow access to a relational database without using knowledge of the database structure |
| US5734886A (en) * | 1994-11-16 | 1998-03-31 | Lucent Technologies Inc. | Database dependency resolution method and system for identifying related data files |
| JP3492246B2 (ja) * | 1999-07-16 | 2004-02-03 | 富士通株式会社 | Xmlデータ検索処理方法および検索処理システム |
| US6609132B1 (en) * | 2000-04-11 | 2003-08-19 | Revelink, Inc. | Object data model for a framework for creation, update and view navigation of data objects and textual annotations of relations between data objects |
| US6763515B1 (en) * | 2000-06-05 | 2004-07-13 | National Instruments Corporation | System and method for automatically generating a graphical program to perform an image processing algorithm |
| US7164422B1 (en) * | 2000-07-28 | 2007-01-16 | Ab Initio Software Corporation | Parameterized graphs with conditional components |
| US20050257193A1 (en) * | 2004-05-13 | 2005-11-17 | Alexander Falk | Method and system for visual data mapping and code generation to support data integration |
-
2004
- 2004-11-02 US US10/979,742 patent/US7899833B2/en not_active Expired - Lifetime
-
2005
- 2005-11-01 CN CN200580037483.1A patent/CN101438280B/zh not_active Expired - Lifetime
- 2005-11-01 EP EP05825020A patent/EP1815363A4/en not_active Ceased
- 2005-11-01 JP JP2007540368A patent/JP4879908B2/ja not_active Expired - Lifetime
- 2005-11-01 CA CA2584326A patent/CA2584326C/en not_active Expired - Lifetime
- 2005-11-01 AU AU2005302270A patent/AU2005302270B2/en not_active Expired
- 2005-11-01 WO PCT/US2005/039425 patent/WO2006050342A2/en not_active Ceased
Non-Patent Citations (1)
| Title |
|---|
| None |
Cited By (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| JP2011517352A (ja) * | 2008-02-26 | 2011-06-02 | アビニシオ テクノロジー エルエルシー | データ関連性のグラフ表現 |
| KR101510355B1 (ko) * | 2008-02-26 | 2015-04-14 | 아브 이니티오 테크놀로지 엘엘시 | 데이터 관계의 그래픽 표현 |
| KR101517460B1 (ko) | 2008-02-26 | 2015-05-15 | 아브 이니티오 테크놀로지 엘엘시 | 데이터 관계의 그래픽 표현 |
| US9760612B2 (en) | 2008-02-26 | 2017-09-12 | Ab Initio Technology, Llc | Graphic representations of data relationships |
| US9910901B2 (en) | 2008-02-26 | 2018-03-06 | Ab Initio Technology Llc | Graphic representations of data relationships |
| US10685030B2 (en) | 2008-02-26 | 2020-06-16 | Ab Initio Technology Llc | Graphic representations of data relationships |
Also Published As
| Publication number | Publication date |
|---|---|
| JP2008524671A (ja) | 2008-07-10 |
| AU2005302270A1 (en) | 2006-05-11 |
| EP1815363A4 (en) | 2011-08-03 |
| US20060095466A1 (en) | 2006-05-04 |
| CA2584326A1 (en) | 2006-05-11 |
| WO2006050342A3 (en) | 2009-04-09 |
| CN101438280B (zh) | 2016-01-13 |
| CA2584326C (en) | 2013-09-03 |
| US7899833B2 (en) | 2011-03-01 |
| JP4879908B2 (ja) | 2012-02-22 |
| CN101438280A (zh) | 2009-05-20 |
| AU2005302270B2 (en) | 2011-08-11 |
| EP1815363A2 (en) | 2007-08-08 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US7899833B2 (en) | Managing related data objects | |
| US10685030B2 (en) | Graphic representations of data relationships | |
| Yan et al. | Business process model repositories–Framework and survey | |
| US8356029B2 (en) | Method and system for reconstruction of object model data in a relational database | |
| US8352478B2 (en) | Master data framework | |
| US8140545B2 (en) | Data organization and evaluation using a two-topology configuration | |
| US20110087708A1 (en) | Business object based operational reporting and analysis | |
| US20030208493A1 (en) | Object relational database management system | |
| US9495475B2 (en) | Method of representing an XML schema definition and data within a relational database management system using a reusable custom-defined nestable compound data type | |
| US20030074419A1 (en) | System and method for non-programmers to dynamically manage multiple sets of XML document data | |
| US7693857B2 (en) | Clinical genomics merged repository and partial episode support with support abstract and semantic meaning preserving data sniffers | |
| Rizzolo et al. | The conceptual integration modeling framework: Abstracting from the multidimensional model | |
| Eichler | Metadata management in the data lake architecture | |
| Gruenberg | Multi-Model Snowflake Schema Creation | |
| Salles | Pay-as-you-go information integration in personal and social dataspaces | |
| Lin | Object-oriented database systems: A survey | |
| Lanin et al. | Storing Multifaceted Ontologies with Natural Language Addressing | |
| Kaufmann et al. | Database Languages | |
| Lungu et al. | A new approach to adaptive data models. | |
| Fasel | Implementation of Fuzzy Data Warehouse | |
| de Wouters | Principles of Database Management |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| WWE | Wipo information: entry into national phase |
Ref document number: 200580037483.1 Country of ref document: CN |
|
| AK | Designated states |
Kind code of ref document: A2 Designated state(s): AE AG AL AM AT AU AZ BA BB BG BR BW BY BZ CA CH CN CO CR CU CZ DE DK DM DZ EC EE EG ES FI GB GD GE GH GM HR HU ID IL IN IS JP KE KG KM KN KP KR KZ LC LK LR LS LT LU LV LY MA MD MG MK MN MW MX MZ NA NG NI NO NZ OM PG PH PL PT RO RU SC SD SE SG SK SL SM SY TJ TM TN TR TT TZ UA UG US UZ VC VN YU ZA ZM ZW |
|
| AL | Designated countries for regional patents |
Kind code of ref document: A2 Designated state(s): BW GH GM KE LS MW MZ NA SD SL SZ TZ UG ZM ZW AM AZ BY KG KZ MD RU TJ TM AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HU IE IS IT LT LU LV MC NL PL PT RO SE SI SK TR BF BJ CF CG CI CM GA GN GQ GW ML MR NE SN TD TG |
|
| 121 | Ep: the epo has been informed by wipo that ep was designated in this application | ||
| WWE | Wipo information: entry into national phase |
Ref document number: 2005302270 Country of ref document: AU |
|
| WWE | Wipo information: entry into national phase |
Ref document number: 2584326 Country of ref document: CA |
|
| WWE | Wipo information: entry into national phase |
Ref document number: 2005825020 Country of ref document: EP Ref document number: 3094/DELNP/2007 Country of ref document: IN |
|
| WWE | Wipo information: entry into national phase |
Ref document number: 2007540368 Country of ref document: JP |
|
| NENP | Non-entry into the national phase |
Ref country code: DE |
|
| ENP | Entry into the national phase |
Ref document number: 2005302270 Country of ref document: AU Date of ref document: 20051101 Kind code of ref document: A |
|
| WWP | Wipo information: published in national office |
Ref document number: 2005825020 Country of ref document: EP |