CN117216137A - Multidimensional information fusion display method and device - Google Patents
Multidimensional information fusion display method and device Download PDFInfo
- Publication number
- CN117216137A CN117216137A CN202311110613.6A CN202311110613A CN117216137A CN 117216137 A CN117216137 A CN 117216137A CN 202311110613 A CN202311110613 A CN 202311110613A CN 117216137 A CN117216137 A CN 117216137A
- Authority
- CN
- China
- Prior art keywords
- employee
- data
- identifier
- post
- department
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
- 238000000034 method Methods 0.000 title claims abstract description 40
- 230000004927 fusion Effects 0.000 title claims abstract description 31
- 238000012545 processing Methods 0.000 claims abstract description 58
- 238000006243 chemical reaction Methods 0.000 claims description 9
- 238000013075 data extraction Methods 0.000 claims description 7
- 238000004590 computer program Methods 0.000 claims description 6
- 230000008569 process Effects 0.000 abstract description 9
- 230000004044 response Effects 0.000 abstract description 7
- 238000010586 diagram Methods 0.000 description 7
- 238000013468 resource allocation Methods 0.000 description 2
- 238000013475 authorization Methods 0.000 description 1
- 230000009286 beneficial effect Effects 0.000 description 1
- 230000006870 function Effects 0.000 description 1
- 238000012986 modification Methods 0.000 description 1
- 230000004048 modification Effects 0.000 description 1
- 238000012546 transfer Methods 0.000 description 1
- 238000012800 visualization Methods 0.000 description 1
Landscapes
- Information Retrieval, Db Structures And Fs Structures Therefor (AREA)
Abstract
The application provides a multidimensional information fusion display method and a multidimensional information fusion display device, which relate to the field of data processing, and the multidimensional information fusion display method and the multidimensional information fusion display device receive employee related data sent by an external system in a plurality of dimensions based on a message queue, wherein the plurality of dimensions comprise a post dimension, a department dimension and a project dimension; storing employee related data in a database, and processing the employee related data in the database to obtain a plurality of data pairs corresponding to each employee; storing the data pairs in a distributed file system, and further processing all the data pairs in the distributed file system to obtain a result data set corresponding to each employee, wherein the result data set corresponding to any employee comprises the data pairs of the employee in all dimensions; the resulting dataset is stored to a database for subsequent data presentation. The application can rapidly and reliably process a large amount of data from different dimensions, has high response speed, and is convenient for subsequent data display and real-time query operation.
Description
Technical Field
The application relates to the technical field of data processing, in particular to a multidimensional information fusion display method and a multidimensional information fusion display device.
Background
Currently, in most systems, personnel information is stored in multiple departments for part-time, which results in one person corresponding to multiple post information. In addition, a single person can also participate in different line work of a plurality of projects, such as cost consultation, engineering supervision and the like. Because of the many-to-many relationship, the personnel information corresponds to a plurality of post information, which in turn corresponds to a plurality of project information, so that a system administrator or company leader cannot intuitively understand the responsibilities of the company staff and the ongoing project information.
The real-time data displayed to the user by the current system mostly comes from an external system, but the speed of acquiring the information through many-to-many inquiry is very slow, so that the memory and CPU performance of the system are seriously affected, and the normal operation of the system is further affected. In the related technology, a plurality of table data are adopted to carry out batch processing in a combined query mode, but the efficiency is low, the query result set is frequently wrong, and the working condition of staff can not be accurately reflected. In addition, query response is slow, and only t+1 non-real-time queries can be supported.
Disclosure of Invention
The disclosure provides a multidimensional information fusion display method and a multidimensional information fusion display device, which at least solve the problems that in the related art, the efficiency of inquiring multidimensional data acquired based on an external system is low, an inquiry result set is frequently wrong, the working condition of staff cannot be accurately reflected, and the inquiry response is slow.
An embodiment of a first aspect of the present application provides a multidimensional information fusion display method, including: receiving employee related data sent by an external system in a plurality of dimensions based on a message queue mode, wherein the plurality of dimensions comprise a post dimension, a department dimension and a project dimension, and the employee related data comprise employee post data, employee department data and employee project post data; storing employee related data in a database, and processing the employee related data in the database to obtain a plurality of data pairs corresponding to each employee; storing the data pairs in a distributed file system, and further processing all the data pairs in the distributed file system to obtain a result data set corresponding to each employee, wherein the result data set corresponding to any employee comprises the data pairs of the employee in all dimensions; the resulting dataset is stored to a database for subsequent data presentation.
According to one embodiment of the present application, receiving employee related data in multiple dimensions sent by an external system based on a message queue includes: receiving employee post data sent by a human system based on a message queue mode, wherein the employee post data comprises at least one post data corresponding to each employee; receiving employee department data sent by a department system based on a message queue mode, wherein the employee department data comprises at least one department data corresponding to each employee; and receiving employee project post data sent by the project system in a message queue mode, wherein the employee project post data comprises at least one project data corresponding to each employee and post data acted by each employee in each corresponding project.
According to one embodiment of the application, the processing of employee related data in the database to obtain a plurality of data pairs corresponding to each employee includes: acquiring employee identifiers corresponding to each employee; acquiring a post identifier corresponding to each post, a department identifier corresponding to each department and an item identifier corresponding to each item; and carrying out data extraction, data conversion and data processing on employee related data in the database based on the employee identifier, the post identifier, the department identifier and the project identifier so as to acquire a plurality of data pairs corresponding to each employee.
According to one embodiment of the application, the plurality of data pairs includes: at least one data pair between an employee identifier and a post identifier; at least one data pair between an employee identifier and a department identifier; at least one data pair between the employee identifier and the item identifier; at least one employee identifier, a project identifier and a post identifier corresponding to the employee under the project identifier.
According to one embodiment of the present application, further processing is performed on all data pairs in the distributed file system to obtain a corresponding result data set for each employee, including: all data pairs in the distributed file system are subjected to slicing, grouping, processing and flattening so as to obtain a result data set corresponding to each employee.
According to one embodiment of the application, storing the resulting dataset into a database for subsequent data presentation comprises: storing the result dataset to a database; acquiring a target employee identifier of an employee to be queried; and based on the target employee identifier, retrieving a target result data set corresponding to the target employee identifier from all candidate result data sets in the database, and displaying the target result data set on a screen.
According to one embodiment of the present application, the multidimensional information fusion display method further includes: acquiring a target employee identifier of an employee to be queried; and based on the target employee identifier, retrieving a data pair corresponding to the target employee identifier from the distributed file system, and displaying the data pair on a screen.
An embodiment of a second aspect of the present application provides a multidimensional information fusion display apparatus, including: the data receiving module is used for receiving employee related data sent by an external system in a plurality of dimensions based on a message queue mode, wherein the plurality of dimensions comprise a post dimension, a department dimension and an item dimension, and the employee related data comprise employee post data, employee department data and employee item post data; the first processing module is used for storing employee related data in a database and processing the employee related data in the database to obtain a plurality of data pairs corresponding to each employee; the second processing module is used for storing the data pairs in the distributed file system and further processing all the data pairs in the distributed file system to obtain a result data set corresponding to each employee, wherein the result data set corresponding to any employee comprises the data pairs of the employee in all dimensions; and the data display module is used for storing the result data set into a database for subsequent data display.
According to one embodiment of the application, the data receiving module is further configured to: receiving employee post data sent by a human system based on a message queue mode, wherein the employee post data comprises at least one post data corresponding to each employee; receiving employee department data sent by a department system based on a message queue mode, wherein the employee department data comprises at least one department data corresponding to each employee; and receiving employee project post data sent by the project system in a message queue mode, wherein the employee project post data comprises at least one project data corresponding to each employee and post data acted by each employee in each corresponding project.
According to one embodiment of the application, the first processing module is further configured to: acquiring employee identifiers corresponding to each employee; acquiring a post identifier corresponding to each post, a department identifier corresponding to each department and an item identifier corresponding to each item; and carrying out data extraction, data conversion and data processing on employee related data in the database based on the employee identifier, the post identifier, the department identifier and the project identifier so as to acquire a plurality of data pairs corresponding to each employee.
According to one embodiment of the application, the plurality of data pairs includes: at least one data pair between an employee identifier and a post identifier; at least one data pair between an employee identifier and a department identifier; at least one data pair between the employee identifier and the item identifier; at least one employee identifier, a project identifier and a post identifier corresponding to the employee under the project identifier.
According to one embodiment of the application, the second processing module is further configured to: all data pairs in the distributed file system are subjected to slicing, grouping, processing and flattening so as to obtain a result data set corresponding to each employee.
According to one embodiment of the application, the data presentation module is further configured to: storing the result dataset to a database; acquiring a target employee identifier of an employee to be queried; and based on the target employee identifier, retrieving a target result data set corresponding to the target employee identifier from all candidate result data sets in the database, and displaying the target result data set on a screen.
According to one embodiment of the application, the data presentation module is further configured to: acquiring a target employee identifier of an employee to be queried; and based on the target employee identifier, retrieving a data pair corresponding to the target employee identifier from the distributed file system, and displaying the data pair on a screen.
An embodiment of a third aspect of the present application provides an electronic device, including: at least one processor; and a memory communicatively coupled to the at least one processor; the memory stores instructions executable by the at least one processor to implement a multi-dimensional information fusion display method according to an embodiment of the first aspect of the present application.
An embodiment of a fourth aspect of the present application proposes a non-transitory computer readable storage medium storing computer instructions for implementing a multidimensional information fusion presentation method according to an embodiment of the first aspect of the present application.
An embodiment of a fifth aspect of the present application proposes a computer program product comprising a computer program which, when executed by a processor, implements a multi-dimensional information fusion presentation method according to an embodiment of the first aspect of the present application.
The technical scheme provided by the embodiment of the disclosure at least brings the following beneficial effects:
the application can rapidly and reliably process a large amount of data from different dimensions (posts, departments and projects) by using the message queue to receive the employee related data sent by the external system, improves the performance and response speed of the system, stores the employee related data in the database, processes the data, can better organize and manage the data, and improves the accessibility and usability of the data.
The application can further optimize the storage, retrieval and analysis processes of the data by converting the data into the data pairs and storing the data pairs in the distributed file system, and acquire the result data set of each employee in all dimensions by processing the data pairs in the distributed file system, so that the related information of each employee in different dimensions including posts, departments, projects and the like can be comprehensively known. The result data set is stored in the database, so that the subsequent data display and query operation is convenient. By storing and processing employee data, the system is able to provide more accurate and comprehensive employee information so that administrators, corporate leaders, and other related personnel can more intuitively and in real time learn key information about the employee's responsibilities, departments and projects involved, which facilitates more informed decisions and efficient resource allocation.
It is to be understood that both the foregoing general description and the following detailed description are exemplary and explanatory only and are not restrictive of the disclosure.
Drawings
The foregoing and/or additional aspects and advantages of the application will become apparent and readily appreciated from the following description of the embodiments, taken in conjunction with the accompanying drawings, in which:
fig. 1 is a schematic diagram of an exemplary embodiment of a multi-dimensional information fusion presentation method according to the present application.
Fig. 2 is a schematic diagram of an exemplary embodiment of another multi-dimensional information fusion presentation method shown in the present application.
Fig. 3 is a flow chart of a multidimensional information fusion display method according to the present application.
Fig. 4 is a schematic diagram of a multidimensional information fusion display apparatus according to the present application.
Fig. 5 is a schematic diagram of an electronic device according to an embodiment of the application.
Detailed Description
Embodiments of the present application are described in detail below, examples of which are illustrated in the accompanying drawings, wherein like or similar reference numerals refer to like or similar elements or elements having like or similar functions throughout. The embodiments described below by referring to the drawings are illustrative and intended to explain the present application and should not be construed as limiting the application.
It should be noted that, in the present disclosure, all the actions of obtaining information and authority and providing services are performed under the premise of conforming to the corresponding data protection rule policy of the country of the location and obtaining the authorization given by the owner of the corresponding device, which all conform to the rules of the related laws and regulations and do not violate the popular regulations.
Fig. 1 is a schematic diagram of an exemplary embodiment of a multi-dimensional information fusion presentation method according to the present application, as shown in fig. 1, including the steps of:
s101, receiving employee related data sent by an external system in a plurality of dimensions based on a message queue mode, wherein the plurality of dimensions comprise a post dimension, a department dimension and an item dimension, and the employee related data comprises employee post data, employee department data and employee item post data.
Since the information of multiple dimensions to be obtained in the present application may come from one or more external systems, in the present application, a message queuing system such as ActiveMQ is used for receiving the subject or queue of employee related data sent by the external system. For each dimension (post, department, and project), a corresponding topic or queue may be created.
The staff post data refers to the corresponding relationship data between staff and post, for example, staff A can correspond to post A and post B.
The employee department data refers to the corresponding relationship data between the employee and the department, for example, the employee A can be assigned to the department A and the department B at the same time.
The staff project position data refers to the corresponding relation between staff and projects, and the corresponding relation data of the specific position of the staff on the corresponding projects, for example, staff A can be used as a position A on the project A and also used as a position B on the project B.
S102, storing employee related data in a database, and processing the employee related data in the database to obtain a plurality of data pairs corresponding to each employee.
And storing the related data of the staff in a database, and extracting, converting and processing the data through a keyle (open source data conversion tool) to obtain a plurality of data pairs corresponding to each staff in different dimensions.
For example, for employee A, the corresponding plurality of data pairs for employee A in different dimensions may be represented as:
staff a to post a;
staff a to post B;
staff a to department a;
staff a to department B;
staff A to project A to post A;
staff a to project B to post B.
And S103, storing the data pairs in a distributed file system, and further processing all the data pairs in the distributed file system to obtain a result data set corresponding to each employee, wherein the result data set corresponding to any employee comprises the data pairs of the employee in all dimensions.
For each employee's data pair, it is converted into a format suitable for distributed file system storage, such as JSON or CSV. The data pairs may then be stored in the appropriate locations of the distributed file system, possibly requiring the use of appropriate naming and directory structures.
All data pairs in the distributed file system are further processed using a distributed computing framework (e.g., apache Spark) or other suitable tool to obtain a result dataset for each employee.
For example, for employee A, the result dataset for employee A may be expressed as:
staff A- (position A+position B), which means that staff A takes part in position A and position B at the same time;
employee A-department A+department B-represents that employee A is assigned to both department A and department B;
staff a to (project a, project a+project B, project B) indicate that staff a is also in project B, while in project a, is in project a.
It should be noted that the above-mentioned number of posts, number of departments and number of projects corresponding to the employee A are all illustrative, and do not limit the present application.
And S104, storing the result data set into a database for subsequent data display.
The data may be extracted and presented using SQL query statements, visualization tools, or programming languages, as desired.
According to the embodiment of the application, the message queue is used for receiving the employee related data sent by the external system, so that a large amount of data from different dimensions (posts, departments and projects) can be processed quickly and reliably, the performance and response speed of the system are improved, the employee related data are stored in the database and processed, the data can be organized and managed better, and the accessibility and usability of the data are improved.
The embodiment of the application can further optimize the storage, retrieval and analysis processes of the data by converting the data into the data pairs and storing the data pairs in the distributed file system, and acquire the result data set of each employee in all dimensions by processing the data pairs in the distributed file system, so that the associated information of each employee in different dimensions including posts, departments, projects and the like can be comprehensively known. The result data set is stored in the database, so that the subsequent data display and query operation is convenient. By storing and processing employee data, the system is able to provide more accurate and comprehensive employee information so that administrators, corporate leaders, and other related personnel can more intuitively and in real time learn key information about the employee's responsibilities, departments and projects involved, which facilitates more informed decisions and efficient resource allocation.
Fig. 2 is a schematic diagram of an exemplary embodiment of another multi-dimensional information fusion presentation method according to the present application, as shown in fig. 2, including the steps of:
s201, receiving employee post data sent by the human system based on a message queue mode, wherein the employee post data comprises at least one post data corresponding to each employee.
Using a message queue system similar to ActiveMQ, setting a theme or queue for receiving employee position data, processing the received employee position data message, parsing the message content, and extracting at least one position data corresponding to each employee.
Illustratively, the positions a and B corresponding to the employee a may be obtained by parsing the received employee position data message queue sent by the human system.
S202, receiving employee department data sent by a department system based on a message queue mode, wherein the employee department data comprises at least one department data corresponding to each employee.
Using a message queue system similar to ActiveMQ, setting a theme or queue for receiving employee department data, processing the received employee department data message, parsing the message content, and extracting at least one department data corresponding to each employee.
Illustratively, the employee A may be acquired with respect to the departments A and B by parsing the received employee department data message queues sent by the department system.
S203, receiving employee project post data sent by the project system based on a message queue mode, wherein the employee project post data comprises at least one project data corresponding to each employee and post data acted by each employee in each corresponding project.
Using a message queue system similar to ActiveMQ, setting a theme or queue for receiving employee project position data, processing the received employee project position data, parsing the message content, and extracting at least one project data corresponding to each employee, and the position data each employee takes in each project corresponding to each employee.
Illustratively, by parsing the received employee project job data message queue sent by the project system, data of employee A on project A as job A can be obtained, and data of employee A on project B as job B can be obtained.
S204, storing employee related data in a database.
S205, an employee identifier corresponding to each employee, a post identifier corresponding to each post, a department identifier corresponding to each department and an item identifier corresponding to each item are obtained.
S206, carrying out data extraction, data conversion and data processing on employee related data in the database based on the employee identifier, the post identifier, the department identifier and the project identifier so as to acquire a plurality of data pairs corresponding to each employee.
Wherein the plurality of data pairs comprises: at least one data pair between an employee identifier and a post identifier; at least one data pair between an employee identifier and a department identifier; at least one data pair between the employee identifier and the item identifier; at least one employee identifier, a project identifier and a post identifier corresponding to the employee under the project identifier.
For example, for employee A, the corresponding plurality of data pairs for employee A in different dimensions may be represented as:
staff a identifier-post a identifier;
staff a identifier-post B identifier;
employee A identifier-department A identifier;
employee A identifier-department B identifier;
employee A identifier-project A identifier-post A identifier;
employee A identifier-project B identifier-post B identifier.
S207, storing the data pairs in a distributed file system.
S208, slicing, grouping, processing and flattening all the data pairs in the distributed file system to obtain a result data set corresponding to each employee.
The result data set corresponding to any employee comprises data pairs of the employee in all dimensions.
And S209, storing the result data set into a database.
S210, acquiring a target employee identifier of the employee to be queried.
When information inquiry needs to be carried out on a certain employee, the employee identifier corresponding to the employee is obtained through user input or other modes and is used as a target employee identifier.
S211, based on the target employee identifier, retrieving a target result data set corresponding to the target employee identifier from all candidate result data sets in the database, and displaying the target result data set on a screen.
Using the target employee identifier as a condition, the result dataset table is queried in the database to find the record that the target employee identifier matches, i.e., the target result dataset. The target result dataset is suitably processed and transformed and then presented on the screen. In particular, the data may be processed using an appropriate programming language and library, and formatted and presented as needed.
The embodiment of the application can rapidly and reliably process a large amount of data from different dimensions, has high response speed, and is convenient for subsequent data display and real-time query operation.
Furthermore, the application also supports the acquisition of the target employee identifier of the employee to be queried; based on the target employee identifier, the data pair corresponding to the target employee identifier is fetched from the distributed file system through the hive, and the data pair is displayed on a screen for real-time query.
Fig. 3 is a flow chart of a multi-dimensional information fusion display method shown in the present application, and as shown in fig. 3, the multi-dimensional information fusion display method includes the following steps:
and receiving employee post data sent by the human system based on the message queue mode, wherein the employee post data comprises at least one post data corresponding to each employee.
And receiving employee department data sent by the department system based on a message queue mode, wherein the employee department data comprises at least one department data corresponding to each employee.
And receiving employee project post data sent by the project system in a message queue mode, wherein the employee project post data comprises at least one project data corresponding to each employee and post data acted by each employee in each corresponding project.
And storing the employee related data in a mysql database, and adopting a keyle (open source data conversion tool) to perform data extraction, data conversion and data processing on the employee related data in the database so as to acquire a plurality of data pairs corresponding to each employee.
The transfer of data pairs to the distributed file system (Hadoop Distributed File System, HDFS) is performed by kafka (open source streaming platform tool).
The data on the HDFS is sliced, grouped, processed and flattened by a spark (big data processing tool) to obtain a result dataset corresponding to each employee.
The resulting dataset is stored to a database by kafka for subsequent data presentation.
The embodiment of the application can rapidly and reliably process a large amount of data from different dimensions, has high response speed, and is convenient for subsequent data display and real-time query operation.
Fig. 4 is a schematic diagram of a multidimensional information fusion display apparatus according to the present application, as shown in fig. 4, the multidimensional information fusion display apparatus 400 includes a data receiving module 401, a first processing module 402, a second processing module 403, and a data display module 404, wherein:
the data receiving module 401 is configured to receive employee related data sent by an external system in multiple dimensions based on a message queue, where the multiple dimensions include a post dimension, a department dimension, and an item dimension, and the employee related data includes employee post data, employee department data, and employee item post data.
The first processing module 402 is configured to store employee related data in a database, and process the employee related data in the database to obtain a plurality of data pairs corresponding to each employee.
A second processing module 403, configured to store the data pairs in the distributed file system, and further process all the data pairs in the distributed file system to obtain a result data set corresponding to each employee, where, for any employee, the result data set corresponding to the employee includes the data pairs of the employee in all dimensions.
The data display module 404 is configured to store the result data set in a database for subsequent data display.
Further, the data receiving module 401 is further configured to: receiving employee post data sent by a human system based on a message queue mode, wherein the employee post data comprises at least one post data corresponding to each employee; receiving employee department data sent by a department system based on a message queue mode, wherein the employee department data comprises at least one department data corresponding to each employee; and receiving employee project post data sent by the project system in a message queue mode, wherein the employee project post data comprises at least one project data corresponding to each employee and post data acted by each employee in each corresponding project.
Further, the first processing module 402 is further configured to: acquiring employee identifiers corresponding to each employee; acquiring a post identifier corresponding to each post, a department identifier corresponding to each department and an item identifier corresponding to each item; and carrying out data extraction, data conversion and data processing on employee related data in the database based on the employee identifier, the post identifier, the department identifier and the project identifier so as to acquire a plurality of data pairs corresponding to each employee.
Further, the plurality of data pairs in the first processing module 402 include: at least one data pair between an employee identifier and a post identifier; at least one data pair between an employee identifier and a department identifier; at least one data pair between the employee identifier and the item identifier; at least one employee identifier, a project identifier and a post identifier corresponding to the employee under the project identifier.
Further, the second processing module 403 is further configured to: all data pairs in the distributed file system are subjected to slicing, grouping, processing and flattening so as to obtain a result data set corresponding to each employee.
Further, the data presentation module 404 is further configured to: storing the result dataset to a database; acquiring a target employee identifier of an employee to be queried; and based on the target employee identifier, retrieving a target result data set corresponding to the target employee identifier from all candidate result data sets in the database, and displaying the target result data set on a screen.
Further, the data presentation module 404 is further configured to: acquiring a target employee identifier of an employee to be queried; and based on the target employee identifier, retrieving a data pair corresponding to the target employee identifier from the distributed file system, and displaying the data pair on a screen.
In order to implement the foregoing embodiments, an embodiment of the present application further proposes an electronic device 500, as shown in fig. 5, where the electronic device 500 includes: the processor 501 is communicatively connected to a memory 502, where the memory 502 stores instructions executable by at least one processor, and the instructions are executed by at least one processor 501 to implement a multi-dimensional information fusion presentation method as in the above-described embodiments.
In order to implement the above embodiment, the embodiment of the present application further proposes a non-transitory computer-readable storage medium storing computer instructions for causing a computer to implement a multidimensional information fusion presentation method as shown in the above embodiment.
In order to implement the above embodiments, the embodiments of the present application further provide a computer program product, including a computer program, which when executed by a processor implements a multidimensional information fusion presentation method as shown in the above embodiments.
In the description of the present application, it should be understood that the terms "center", "longitudinal", "lateral", "length", "width", "thickness", "upper", "lower", "front", "rear", "left", "right", "vertical", "horizontal", "top", "bottom", "inner", "outer", "clockwise", "counterclockwise", "axial", "radial", "circumferential", etc. indicate orientations or positional relationships based on the orientations or positional relationships shown in the drawings are merely for convenience in describing the present application and simplifying the description, and do not indicate or imply that the device or element being referred to must have a specific orientation, be configured and operated in a specific orientation, and therefore should not be construed as limiting the present application.
Furthermore, the terms "first," "second," and the like, are used for descriptive purposes only and are not to be construed as indicating or implying a relative importance or implicitly indicating the number of technical features indicated. Thus, a feature defining "a first" or "a second" may explicitly or implicitly include one or more such feature. In the description of the present application, the meaning of "a plurality" is two or more, unless explicitly defined otherwise.
In the description of the present specification, a description referring to terms "one embodiment," "some embodiments," "examples," "specific examples," or "some examples," etc., means that a particular feature, structure, material, or characteristic described in connection with the embodiment or example is included in at least one embodiment or example of the present application. In this specification, schematic representations of the above terms are not necessarily directed to the same embodiment or example. Furthermore, the particular features, structures, materials, or characteristics described may be combined in any suitable manner in any one or more embodiments or examples. Furthermore, the different embodiments or examples described in this specification and the features of the different embodiments or examples may be combined and combined by those skilled in the art without contradiction.
While embodiments of the present application have been shown and described above, it will be understood that the above embodiments are illustrative and not to be construed as limiting the application, and that variations, modifications, alternatives and variations may be made to the above embodiments by one of ordinary skill in the art within the scope of the application.
Claims (17)
1. The multidimensional information fusion display method is characterized by comprising the following steps of:
receiving employee related data sent by an external system in a plurality of dimensions based on a message queue, wherein the plurality of dimensions comprise a post dimension, a department dimension and an item dimension, and the employee related data comprise employee post data, employee department data and employee item post data;
storing the employee related data in a database, and processing the employee related data in the database to obtain a plurality of data pairs corresponding to each employee;
storing the data pairs in a distributed file system, and further processing all the data pairs in the distributed file system to obtain a result data set corresponding to each employee, wherein for any employee, the result data set corresponding to the employee comprises the data pairs of the employee in all dimensions;
and storing the result data set to the database for subsequent data display.
2. The method of claim 1, wherein the message queue-based manner of receiving employee-related data in multiple dimensions sent by an external system comprises:
receiving employee post data sent by a human system based on a message queue mode, wherein the employee post data comprises at least one post data corresponding to each employee;
receiving employee department data sent by a department system based on a message queue mode, wherein the employee department data comprises at least one department data corresponding to each employee;
and receiving employee project post data sent by the project system in a message queue mode, wherein the employee project post data comprises at least one project data corresponding to each employee and post data acted by each employee in each corresponding project.
3. A method as claimed in claim 2, wherein said processing of said employee-related data in said database to obtain a plurality of data pairs for each employee comprises:
acquiring employee identifiers corresponding to each employee;
acquiring a post identifier corresponding to each post, a department identifier corresponding to each department and an item identifier corresponding to each item;
and carrying out data extraction, data conversion and data processing on the employee related data in the database based on the employee identifier, the post identifier, the department identifier and the project identifier so as to acquire a plurality of data pairs corresponding to each employee.
4. The method of claim 3, wherein the plurality of data pairs comprises:
at least one data pair between an employee identifier and a post identifier;
at least one data pair between an employee identifier and a department identifier;
at least one data pair between the employee identifier and the item identifier;
at least one employee identifier, a project identifier and a post identifier corresponding to the employee under the project identifier.
5. The method of claim 4, wherein the further processing of all pairs of data in the distributed file system to obtain a corresponding result data set for each employee comprises:
and slicing, grouping, processing and flattening all the data pairs in the distributed file system to obtain a result data set corresponding to each employee.
6. The method of claim 5, wherein storing the result data set to the database for subsequent data presentation comprises:
storing the result dataset to the database;
acquiring a target employee identifier of an employee to be queried;
and based on the target employee identifier, retrieving a target result data set corresponding to the target employee identifier from all candidate result data sets in the database, and displaying the target result data set on a screen.
7. The method of claim 6, wherein the method further comprises:
acquiring a target employee identifier of an employee to be queried;
and based on the target employee identifier, retrieving a data pair corresponding to the target employee identifier from the distributed file system, and displaying the data pair on a screen.
8. A multi-dimensional information fusion display device, comprising:
the system comprises a data receiving module, a data processing module and a data processing module, wherein the data receiving module is used for receiving employee related data sent by an external system in a plurality of dimensions based on a message queue, the plurality of dimensions comprise a post dimension, a department dimension and a project dimension, and the employee related data comprises employee post data, employee department data and employee project post data;
the first processing module is used for storing the employee related data in a database and processing the employee related data in the database to obtain a plurality of data pairs corresponding to each employee;
the second processing module is used for storing the data pairs in the distributed file system and further processing all the data pairs in the distributed file system to obtain a result data set corresponding to each employee, wherein the result data set corresponding to any employee comprises the data pairs of the employee in all dimensions;
and the data display module is used for storing the result data set into the database for subsequent data display.
9. The apparatus of claim 8, wherein the data receiving module is further configured to:
receiving employee post data sent by a human system based on a message queue mode, wherein the employee post data comprises at least one post data corresponding to each employee;
receiving employee department data sent by a department system based on a message queue mode, wherein the employee department data comprises at least one department data corresponding to each employee;
and receiving employee project post data sent by the project system in a message queue mode, wherein the employee project post data comprises at least one project data corresponding to each employee and post data acted by each employee in each corresponding project.
10. The apparatus of claim 9, wherein the first processing module is further configured to:
acquiring employee identifiers corresponding to each employee;
acquiring a post identifier corresponding to each post, a department identifier corresponding to each department and an item identifier corresponding to each item;
and carrying out data extraction, data conversion and data processing on the employee related data in the database based on the employee identifier, the post identifier, the department identifier and the project identifier so as to acquire a plurality of data pairs corresponding to each employee.
11. The apparatus of claim 10, wherein the plurality of data pairs comprises:
at least one data pair between an employee identifier and a post identifier;
at least one data pair between an employee identifier and a department identifier;
at least one data pair between the employee identifier and the item identifier;
at least one employee identifier, a project identifier and a post identifier corresponding to the employee under the project identifier.
12. The apparatus of claim 11, wherein the second processing module is further configured to:
and slicing, grouping, processing and flattening all the data pairs in the distributed file system to obtain a result data set corresponding to each employee.
13. The apparatus of claim 12, wherein the data presentation module is further configured to:
storing the result dataset to the database;
acquiring a target employee identifier of an employee to be queried;
and based on the target employee identifier, retrieving a target result data set corresponding to the target employee identifier from all candidate result data sets in the database, and displaying the target result data set on a screen.
14. The apparatus of claim 13, wherein the data presentation module is further configured to:
acquiring a target employee identifier of an employee to be queried;
and based on the target employee identifier, retrieving a data pair corresponding to the target employee identifier from the distributed file system, and displaying the data pair on a screen.
15. An electronic device, comprising:
at least one processor; and
a memory communicatively coupled to the at least one processor; wherein,
the memory stores instructions executable by the at least one processor to enable the at least one processor to perform the method of any one of claims 1-7.
16. A non-transitory computer readable storage medium storing computer instructions for causing the computer to perform the method of any one of claims 1-7.
17. A computer program product comprising a computer program which, when executed by a processor, implements the steps of any of claims 1-7.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202311110613.6A CN117216137B (en) | 2023-08-30 | 2023-08-30 | Multidimensional information fusion display method and device |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202311110613.6A CN117216137B (en) | 2023-08-30 | 2023-08-30 | Multidimensional information fusion display method and device |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN117216137A true CN117216137A (en) | 2023-12-12 |
| CN117216137B CN117216137B (en) | 2024-04-26 |
Family
ID=89041686
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202311110613.6A Active CN117216137B (en) | 2023-08-30 | 2023-08-30 | Multidimensional information fusion display method and device |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN117216137B (en) |
Citations (8)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN106326457A (en) * | 2016-08-29 | 2017-01-11 | 山大地纬软件股份有限公司 | Construction method and system of human society person portfolio database on the basis of big data |
| US20180218042A1 (en) * | 2017-01-31 | 2018-08-02 | Unifi Software, Inc. | System facilitating user access to enterprise related data and methods thereof |
| WO2019033519A1 (en) * | 2017-08-17 | 2019-02-21 | 平安科技（深圳）有限公司 | User permission data query method and apparatus, electronic device, and medium |
| CN110895552A (en) * | 2018-08-22 | 2020-03-20 | 北京国双科技有限公司 | Personnel information acquisition method and device |
| CN113283683A (en) * | 2020-02-19 | 2021-08-20 | 长城汽车股份有限公司 | Post qualification management method and system |
| CN114612061A (en) * | 2022-03-09 | 2022-06-10 | 前锦网络信息技术(上海)有限公司 | Human resource information processing system and method |
| CN115330226A (en) * | 2022-08-19 | 2022-11-11 | 合众新能源汽车有限公司 | Digital research and development method and platform based on middle station |
| CN116186136A (en) * | 2023-01-06 | 2023-05-30 | 三峡高科信息技术有限责任公司 | Engineering construction implementation stage data processing method and system |
-
2023
- 2023-08-30 CN CN202311110613.6A patent/CN117216137B/en active Active
Patent Citations (8)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN106326457A (en) * | 2016-08-29 | 2017-01-11 | 山大地纬软件股份有限公司 | Construction method and system of human society person portfolio database on the basis of big data |
| US20180218042A1 (en) * | 2017-01-31 | 2018-08-02 | Unifi Software, Inc. | System facilitating user access to enterprise related data and methods thereof |
| WO2019033519A1 (en) * | 2017-08-17 | 2019-02-21 | 平安科技（深圳）有限公司 | User permission data query method and apparatus, electronic device, and medium |
| CN110895552A (en) * | 2018-08-22 | 2020-03-20 | 北京国双科技有限公司 | Personnel information acquisition method and device |
| CN113283683A (en) * | 2020-02-19 | 2021-08-20 | 长城汽车股份有限公司 | Post qualification management method and system |
| CN114612061A (en) * | 2022-03-09 | 2022-06-10 | 前锦网络信息技术(上海)有限公司 | Human resource information processing system and method |
| CN115330226A (en) * | 2022-08-19 | 2022-11-11 | 合众新能源汽车有限公司 | Digital research and development method and platform based on middle station |
| CN116186136A (en) * | 2023-01-06 | 2023-05-30 | 三峡高科信息技术有限责任公司 | Engineering construction implementation stage data processing method and system |
Also Published As
| Publication number | Publication date |
|---|---|
| CN117216137B (en) | 2024-04-26 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| EP3214559A1 (en) | Data graphing method, device and database server | |
| US10922361B2 (en) | Identifying and structuring related data | |
| US9910870B2 (en) | System and method for creating data models from complex raw log files | |
| CN111339171B (en) | Data query method, device and equipment | |
| CN106156088B (en) | Index data processing method, data query method and device | |
| KR101475335B1 (en) | Enhancing an inquiry for a search of a database | |
| CN112765152B (en) | Method and apparatus for merging data tables | |
| CN111930823A (en) | Data query method and device, data center station and storage medium | |
| CN117216137B (en) | Multidimensional information fusion display method and device | |
| KR102282284B1 (en) | Method, apparatus, device, and storage medium for providing visual representation of set of objects | |
| EP4216076A1 (en) | Method and apparatus of processing an observation information, electronic device and storage medium | |
| CN110515979B (en) | Data query method, device, equipment and storage medium | |
| CN110704481B (en) | Method and device for displaying data | |
| US20180173776A1 (en) | Mapping 1:Many Relationships for Elements in a Database System | |
| CN109697234B (en) | Multi-attribute information query method, device, server and medium for entity | |
| EP2830289A1 (en) | Adaptable reporting in a multi-client telecommunication network | |
| CN106446080B (en) | Data query method, query service equipment, client equipment and data system | |
| CN111143356B (en) | Report retrieval method and device | |
| US10296503B2 (en) | System and method for efficient database transactions | |
| US20130024761A1 (en) | Semantic tagging of user-generated content | |
| CN111291271A (en) | Data processing method, device, equipment and storage medium | |
| CN110851543A (en) | Data modeling method, device, equipment and storage medium | |
| CN111914190A (en) | Method for realizing point marking of complaint address in GIS graphical mode | |
| CN112000669A (en) | Environment monitoring data processing method and device, storage medium and terminal | |
| CN111143328A (en) | Agile business intelligent data construction method, system, equipment and storage medium |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |