CN111414410B - Data processing method, device, equipment and storage medium - Google Patents
Data processing method, device, equipment and storage medium Download PDFInfo
- Publication number
- CN111414410B CN111414410B CN201910012851.0A CN201910012851A CN111414410B CN 111414410 B CN111414410 B CN 111414410B CN 201910012851 A CN201910012851 A CN 201910012851A CN 111414410 B CN111414410 B CN 111414410B
- Authority
- CN
- China
- Prior art keywords
- data
- interface
- fields
- data table
- field
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/20—Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
- G06F16/26—Visual data mining; Browsing structured data
-
- Y—GENERAL TAGGING OF NEW TECHNOLOGICAL DEVELOPMENTS; GENERAL TAGGING OF CROSS-SECTIONAL TECHNOLOGIES SPANNING OVER SEVERAL SECTIONS OF THE IPC; TECHNICAL SUBJECTS COVERED BY FORMER USPC CROSS-REFERENCE ART COLLECTIONS [XRACs] AND DIGESTS
- Y02—TECHNOLOGIES OR APPLICATIONS FOR MITIGATION OR ADAPTATION AGAINST CLIMATE CHANGE
- Y02D—CLIMATE CHANGE MITIGATION TECHNOLOGIES IN INFORMATION AND COMMUNICATION TECHNOLOGIES [ICT], I.E. INFORMATION AND COMMUNICATION TECHNOLOGIES AIMING AT THE REDUCTION OF THEIR OWN ENERGY USE
- Y02D10/00—Energy efficient computing, e.g. low power processors, power management or thermal management
Abstract
A data processing method, apparatus, device and storage medium, the data processing method includes: determining a data table corresponding to the keywords according to the acquired keywords; determining the mapping relation between the fields in the data table and the system interface of the service system; and displaying a system interface corresponding to the selected field according to the selected field and the mapping relation in the fields of the data table. According to the data processing method provided by the embodiment of the invention, the information redundancy can be reduced, and the application efficiency and accuracy of the service party for applying the service system data can be improved.
Description
Technical Field
The present invention relates to the field of computers, and in particular, to a data processing method, apparatus, device, and storage medium.
Background
When various business system data is stored in a database, the database may be Mysql, SQL Server, oracle, or the like. In order to integrate data distributed in each IT system, all data needs to be exported from the corresponding database of each IT system and then imported into a unified database, i.e. a data warehouse. A data warehouse is built for reporting and analysis requirements.
The data warehouse has a large number of data detail tables which are cleaned and integrated, and can be used for inquiring, aggregating, analyzing and the like of each dimension and inquiring the data in the metadata management system on the basis of the data detail tables. Metadata management systems are systems that manage and present table structure information, blood-related information, upstream and downstream dependent use, lifecycle, etc. of a data warehouse. The metadata management system contains table names, table notes, column names and column notes.
Since the metadata management system includes more information, excessive unnecessary information is displayed when the metadata management system is queried, and thus there is a technical problem of information redundancy.
Disclosure of Invention
The embodiment of the invention provides a data processing method, a device, equipment and a storage medium, which display necessary information when inquiring a metadata management system, so that the technical problem of information redundancy is solved.
According to an aspect of an embodiment of the present invention, there is provided a data processing method, including:
determining the mapping relation between the fields in the data table and the system interface of the service system; and determining a system interface corresponding to the selected field according to the selected field and the mapping relation in the fields of the data table.
According to another aspect of an embodiment of the present invention, there is provided a data processing apparatus including:
the mapping relation determining module is used for determining the mapping relation between the fields in the data table and the system interface of the service system; and the system interface determining module is used for determining a system interface corresponding to the selected field according to the selected field and the mapping relation in the fields of the data table.
According to still another aspect of an embodiment of the present invention, there is provided a data processing apparatus including: a memory and a processor; the memory is used for storing programs; the processor is configured to read executable program code stored in the memory to perform the data processing method described above.
According to still another aspect of the embodiments of the present invention, there is provided a computer-readable storage medium having stored therein instructions which, when executed on a computer, cause the computer to perform the data processing method of the above aspects.
According to the data processing method, the device, the equipment and the computer storage medium, according to the mapping relation between the data table structure and the system interface, a service party can clearly know which fields in the data table are in use and which fields are abandoned through the picture preview established according to the mapping relation, and the data table to be applied and the specific fields in the data table to be applied are clear, so that unnecessary information is filtered, the information redundancy problem is solved, and the application efficiency and the accuracy of the service party to apply for service system data are improved.
Drawings
The invention will be better understood from the following description of specific embodiments thereof taken in conjunction with the accompanying drawings in which like or similar reference characters designate like or similar features.
FIG. 1 is a schematic diagram illustrating the architecture of a data processing system involved in a data processing method according to an embodiment of the present invention;
FIG. 2 is a diagram showing a query result presentation by a business party using a metadata management system, as an example in the prior art;
FIG. 3 is a diagram showing information of a data detail table in a query result of one example of the prior art;
FIG. 4 is a schematic diagram showing a mapping relationship between fields in a data table and fields in a business system page established in a data processing method according to an embodiment of the present invention;
fig. 5 is a schematic diagram showing the effect of previewing the fields in the data table according to the mapping relationship between the fields in the data table and the fields in the system interface of the service system in the embodiment of the present invention;
FIG. 6 is a flow diagram illustrating a data processing method according to an embodiment of the present invention;
fig. 7 is a schematic diagram showing the structure of a data processing apparatus according to an embodiment of the present invention;
FIG. 8 is a block diagram of an exemplary hardware architecture of a computing device in which data processing methods and apparatus according to embodiments of the invention may be implemented.
Detailed Description
Features and exemplary embodiments of various aspects of the present invention will be described in detail below, and in order to make the objects, technical solutions and advantages of the present invention more apparent, the present invention will be described in further detail below with reference to the accompanying drawings and examples. It should be understood that the specific embodiments described herein are merely configured to illustrate the invention and are not configured to limit the invention. It will be apparent to one skilled in the art that the present invention may be practiced without some of these specific details. The following description of the embodiments is merely intended to provide a better understanding of the invention by showing examples of the invention.
It is noted that relational terms such as first and second, and the like are used solely to distinguish one entity or action from another entity or action without necessarily requiring or implying any actual such relationship or order between such entities or actions. Moreover, the terms "comprises," "comprising," or any other variation thereof, are intended to cover a non-exclusive inclusion, such that a process, method, article, or apparatus that comprises a list of elements does not include only those elements but may include other elements not expressly listed or inherent to such process, method, article, or apparatus. Without further limitation, an element defined by the phrase "comprising … …" does not exclude the presence of other like elements in a process, method, article or apparatus that comprises the element.
FIG. 1 is a schematic diagram illustrating the architecture of a data processing system involved in a data processing method according to an embodiment of the present invention. As shown in FIG. 1, in an embodiment of the present invention, a data processing system 100 may include a data warehouse 10 and a metadata management system 20.
In one embodiment, the data warehouse 10 is a data set of all business system databases, through which multiple business system databases can be integrated; the metadata management system 20 is used to manage the data warehouse 10 and may open the data warehouse 10 to business parties to provide the business parties with data included in the business system database through the data warehouse 10.
In one embodiment, the business system databases may include, for example, database 1, databases 2, … …, and database n. Database 1, databases 2, … …, and database n may each be used to store business data in different business systems.
In one embodiment, the business system may comprise an information technology system. The information technology system may be simply referred to as an IT system. As one example, an IT system may include an IT system asset and configuration management system, an IT integrated business monitoring system, an IT integrated monitoring system, a business process management platform, an IT operation and maintenance process management, and the like.
In one embodiment, the type of the business system database is not particularly limited. The database 1, the databases 2, … …, or the database n may be, for example, mysql database, SQL Server database, oracle database, hadoop database, or the like.
As an example, for any developed data list in the business system database integrated by the data warehouse, the business party may, for example, apply for the list rights to access the data list.
In one embodiment, the service party may include a service management system for use by the user, which may be running on the terminal device. As shown in fig. 1, when a user 1 needs to access a certain data detail table in a data warehouse, a corresponding table access authority may be firstly applied to a metadata management system 20 through a service party 21; the metadata management system 20 opens corresponding table access rights to the service party 21; the service party 21 accesses the data list according to the obtained list access authority, for example, performs inquiry, aggregation and analysis of each dimension and the like on the basis of the data list.
The following describes a specific procedure of a prior art service party applying a service table using a metadata management system with reference to fig. 2 and 3. FIG. 2 is a diagram showing a query result presentation by a business party using a metadata management system, as an example in the prior art; FIG. 3 shows a schematic representation of presentation information of a data detail table in a query result of one example of the prior art.
As shown in fig. 2, the metadata management system may provide a search and result display page for a user, query a data table related to a keyword in a data warehouse according to a keyword input by a service party in the search and result display page, and display basic information of the data table related to the queried keyword, where the displayed basic information includes, but is not limited to, table name, table description information, field number, reading times, application to which the data table belongs, data development responsible person, and the like.
In one embodiment, the metadata management system can generally query to obtain a plurality of data tables based on keywords input by a service party, and the description mode of basic information of the data tables in the query result is often technical or not processed by human beings.
As an example, in fig. 2, the metadata management system queries the data warehouse based on the keyword "credential row information" entered by the business party, resulting in query results such as data detail table 1 and data detail table 2.
As can be seen from fig. 2, the service party cannot determine which service-related information corresponding to the input keyword exists in the table data of the data list according to the basic information shown in the data list 1 and the data list 2 in the query result, and thus cannot determine which data list to select.
In order to determine which service-related information corresponding to the keywords exists in the table data of the data detail table, a service party often needs to view the display information of each data detail table in the query result.
As shown in fig. 3, in the presentation information of the data detail table, the field information of the data detail table may include a service data class field, such as information of a field name, a field type, a field description, and the like. Because the description modes of information such as field names, field types, field descriptions and the like are also technical or not manually processed, a service party cannot easily understand the mapping relation between the service information stored in each field and the system application interface, and the service party cannot judge which fields are in use and which fields are abandoned due to the large number of field names.
With continued reference to FIG. 3, the field information of the data detail table may also include technical class fields, such as information of a primary key, a foreign key, an enumeration value code, and the like of the data detail table. The technical field forms information redundancy, which increases the use cost of the business party.
The embodiment of the invention provides a data processing method, which is characterized in that a metadata management system inquires a data table in an inquiry result of a data warehouse, a service party obtains accurate system product information according to the inquiry result of the table by establishing the mapping relation between the data table and/or a table field of the data table and a service system and a system page of the service system, and the service party can independently apply for the data detail table according to the provided accurate system product information, so that the application efficiency of a user for applying for service system data is improved.
In the following, in connection with fig. 4, it is described in detail how a mapping relationship between fields in a data table and fields in a business system page is established. Fig. 4 is a schematic diagram illustrating a mapping relationship between fields in a data table and fields in a service system page in a data processing method according to an embodiment of the present invention.
First, as shown in S410 of fig. 4, a data table to be exposed and fields in the data table are determined in the query result of the metadata management system to the data warehouse.
In the embodiment of the invention, a large amount of data exists in the data warehouse, different types of data can have different processing logics, and the architecture of the data warehouse can adopt a layered structure in order to improve the data processing efficiency and reduce the huge workload when the whole data is frequently processed.
In one embodiment, in accordance with the hierarchy of the data warehouse, the data warehouse may include: an operations data (Operational Data Store, ODS) layer, a detail data (Data Warehouse Detail, DWD) layer, a summary data (Data Warehouse Service, DWS) layer, and an application data (Application Data Store, ADS) layer. The conversion from data assets to information assets is achieved through data processing between different levels of the data warehouse, and metadata management is performed on the whole data processing.
In one embodiment, according to a table name specification in a data warehouse, the ODS layer may include a data table whose table name starts with "ODS"; the DWD layer may include a data table with a table name beginning with "DWD"; the DWS layer may include a data table with table names beginning with "DWS"; and the ADS layer may include a data table with table names beginning with "ADS".
In the embodiment of the invention, in the query result of the metadata management system to the data warehouse, the data table displayed to the user can be determined according to the table naming specification in the data warehouse. As one example, the ODS layer is typically used to store raw data tables in a data warehouse, while the data in the raw data tables is typically less reference to the business side than the DWD layer, DWS layer, and ADS layer. Accordingly, the table information of the data table beginning with dwd, dws, ads can be presented for use by the user.
As an example, assume that the metadata management system filters the query results of the data warehouse according to the keywords input by the user, including table 1, table 2, and table 3, according to the table name specifications in the data warehouse, to obtain the data tables shown in the query results, such as table 1 and table 2 shown in fig. 4, and the fields included in table 1 and the fields included in table 2.
Next, as shown in S420 of fig. 4, a mapping relationship between fields in the data table and fields in a system interface of the service system may be established.
In one embodiment, the following system information for each business system may be pre-recorded: the method comprises the steps of information such as a service system name, a system interface and an interface name of the service system, fields and field names in the system interface of the service system, interface screen shots and interface screen shot names corresponding to the system interface of the service system, and the area positions of the fields in the system interface of the service system in the interface screen shots.
In this embodiment, a corresponding system list may be respectively established for each service system, and the system information of the service system may be recorded using the corresponding system list.
As an example, as shown in fig. 4, field 1 in table 1 has a mapping relationship with the credential number of the credential entry interface of the ledger system. That is, corresponding to field 1 of table 1 is a field of the service system name "general ledger", and of the system interface name "credential entry", a field of the field name "credential number".
Next, as shown in S430 in fig. 4, the fields in the data table are previewed according to the mapping relationship between the fields in the data table and the fields in the system interface of the service system and the location of the fields in the region in the interface screenshot corresponding to the system interface.
In one embodiment, the user may customize the interface screenshot name according to the interface screenshot corresponding to the system interface of the business system.
As one example, referring to fig. 4, for a system interface with an interface name "credential entry," an interface screenshot with an interface screenshot name "credential screenshot" may be corresponded;
for a system interface with an interface name of "order purchase", an interface screenshot with an interface screenshot name of "purchase order screenshot" can be corresponded;
for a system interface with an interface name of "payment bill information", an interface screenshot with an interface screenshot name of "payment bill screenshot" can be corresponded; or alternatively
For a system interface with an interface name of "payment order information", an interface screenshot with an interface screenshot name of "payment order screenshot" may be corresponded.
In the embodiment of the invention, when a service party obtains a data table in a query result of a data warehouse, the mapping relation between fields in the data table and fields in a system interface of a service system can be used in the system interface, for example, the fields are used in a system page of which service system, and the positions of the fields in the system page and the displayed field names are displayed through picture preview; thereby determining an in-use field and a discard field in the data table. The usability of the query result of the data warehouse is increased, and the visual query result is provided for the business party, so that the business party can quickly and accurately select the data table and the fields in the data table according to the preview result.
Fig. 5 shows an effect diagram of previewing fields in a data table according to a mapping relationship between the fields in the data table and fields in a system interface of a service system in an embodiment of the present invention. As shown in fig. 5, the metadata management system may query the data repository according to the keywords input by the service party, and display the data table in the query result.
In the data table displayed by the query result of the data warehouse, the service party can preview the fields in the system interface of the service system according to the table names of the data table in the query result and the mapping relation between the fields in the data table and the fields in the system interface of the service system.
As an example, when the business side moves the mouse to one of the data tables in the query result of the data warehouse, the system automatically displays the region position of the field in the data table in the interface screenshot corresponding to the system interface according to the mapping relation.
With continued reference to fig. 5, in one embodiment, the interface screen shot of the system interface corresponding to the target table selected by the business party may include a field name area and a system screen shot area. The field name area of the interface screenshot is used for displaying the fields in the system interface of the business system with the mapping relation with the fields in the target table; the system screenshot area is used for displaying the interface screenshot corresponding to the field in the data table in the system interface.
In this embodiment, the field names of the fields in the system interface may be derived from the annotation information of the fields in the data table, and when the annotation information of the fields in the data table is null, the field names of the fields in the system interface may be the field names of the fields in the data table.
In one embodiment, when a business party points to any one of the field names displayed in the field name area of the interface screenshot, the system screenshot area displays a corresponding system screenshot in which the pointed field name and the field names of other fields in the same data table of the field corresponding to the pointed field name are displayed.
In one embodiment, a user may customize the display mode and display effect of fields in the target table in a system interface of a service system having a mapping relationship.
Specifically, the display modes may include: sequentially displaying or carousel displaying a plurality of system screenshots corresponding to the target table; the display effect may include: highlighting marks are added to the field in the target table in the region where the field is displayed in the system screenshot, for example, the field is added with an outer frame with a specified color and/or filled with a background color with the specified color.
As shown in fig. 5, when the user mouse moves to a certain field in the field name area of the interface screenshot, a corresponding system screenshot is popped up in the system screenshot area, and the area where the field in the data table displayed in the system screenshot is located is filled with yellow color except for a red frame for strengthening display.
It can be seen from fig. 5 that after the mapping relationship is generated between the table structure and the system interface, the fields used in the service system are displayed in the screenshot of the system interface, but the abandoned fields are not displayed, so that the service party can clearly know which fields of which table should be applied to complete self-service application, thereby solving the technical problem of information redundancy and improving the efficiency of applying for the table.
The following describes in detail a specific flow of a data processing method according to an embodiment of the present invention with reference to fig. 6. Fig. 6 shows a flow diagram of a data processing method according to an embodiment of the invention. As shown in fig. 6, in one embodiment, a data processing method 600 may include:
step S610, determining the mapping relation between the fields in the data table and the system interface of the service system;
step S620, determining a system interface corresponding to the selected field according to the selected field and the mapping relation in the fields of the data table.
In one embodiment, step S610 may specifically include:
in step S611, a data table corresponding to the keyword is determined according to the acquired keyword.
Step S612, determining the mapping relation between the fields in the corresponding data table and the system interface of the service system.
In this embodiment, the keyword may be acquired through the user's input in the metadata management system, and the data table corresponding to the input keyword may be determined.
In one embodiment, step S611 may specifically include:
step S611-01, inquiring a data warehouse according to the keywords to obtain a data table related to the keywords in the data warehouse;
step S611-02, according to the list name specification of the data warehouse, screening the data list corresponding to the keywords, and taking the screened data list as the data list corresponding to the keywords of the service system.
In one embodiment, the data warehouse includes one or more of the following hierarchies: a detail data layer, a summary data layer and an application data layer; the filtered data table includes one or more of the following data tables: a data table of a detail data layer, a data table of a summary data layer and a data table of an application data layer.
In one embodiment, step S620 may specifically include:
step S11, obtaining a field with a mapping relation in the fields of the data table, and selecting the field from the fields with the mapping relation;
step S12, obtaining an interface screenshot of a system interface corresponding to the selected field;
step S13, determining the interface screenshot of the system interface corresponding to the selected field according to the selected field and the mapping relation.
In one embodiment, the number of system interfaces corresponding to the selected field is greater than 1. In this embodiment, step S620 may specifically include:
and determining a system interface corresponding to the selected fields according to the designated sequence according to the selected fields and the mapping relation in the fields of the data table.
In one embodiment, step S620 may specifically include:
step S21, determining a system interface with a mapping relation with the selected field, and acquiring an interface screenshot of the system interface;
step S22, adding a highlighting mark for a screenshot area corresponding to the selected field in the interface screenshot of the system interface;
step S23, determining an interface screenshot of a system interface corresponding to the selected field.
In one embodiment, the data processing method 600 may further include:
step S630, displaying the system interface corresponding to the selected field.
Specifically, according to the above embodiment, step S630 may specifically include: and displaying the interface screenshot of the system interface corresponding to the selected field.
In the embodiment of the invention, the mapping relation is established according to the data table structure and the system interface, and a service party can clearly know which fields in the data table are in use and which fields are abandoned and clearly determine the data table to be applied and the specific fields in the data table to be applied through the picture preview established according to the mapping relation, so that the application efficiency and the accuracy of the user to apply for the service system data are improved.
A data processing apparatus according to an embodiment of the present invention is described below with reference to fig. 7. Fig. 7 shows a schematic structural diagram of a data processing apparatus according to an embodiment of the present invention. As shown in fig. 7, a data processing apparatus 700 according to an embodiment of the present invention may include:
a mapping relation determining module 710, configured to determine a mapping relation between a field in the data table and a system interface of the service system;
the system interface determining module 720 is configured to display a system interface corresponding to the selected field according to the selected field and the mapping relationship in the fields of the data table.
In one embodiment, the mapping determining module 710 may specifically include:
the data table acquisition unit is used for determining a data table corresponding to the keyword according to the acquired keyword; the mapping relation determining module 710 may be further configured to determine a mapping relation between a field in the corresponding data table and a system interface of the service system.
In one embodiment, the data table obtaining unit may specifically include:
the data table inquiring subunit is used for inquiring the data warehouse according to the keywords to obtain a data table related to the keywords in the data warehouse;
and the data table screening subunit is used for screening the data table corresponding to the keywords according to the table name specification of the data warehouse, and taking the screened data table as the data table corresponding to the keywords of the service system.
In one embodiment, the data warehouse includes one or more of the following hierarchies: a detail data layer, a summary data layer and an application data layer;
the filtered data table includes one or more of the following data tables: a data table of a detail data layer, a data table of a summary data layer and a data table of an application data layer.
In one embodiment, the system interface determining module 720 may specifically include:
a field selection unit, configured to obtain a field having a mapping relationship from fields of the data table, and select a field from the fields having a mapping relationship;
the screenshot obtaining unit is used for obtaining the interface screenshot of the system interface corresponding to the selected field;
and the screenshot display unit is used for determining the interface screenshot of the system interface corresponding to the selected field according to the selected field and the mapping relation.
In one embodiment, the number of system interfaces corresponding to the selected field is greater than 1;
the system interface determining module is specifically configured to determine, according to a specified order, a system interface corresponding to the selected field according to the selected field and the mapping relationship from the fields of the data table.
In the step, if the number of the system interfaces corresponding to the selected field is greater than 1, the corresponding system interfaces are ranked, and the ranked system interfaces corresponding to the selected field are determined.
In one embodiment, the ranking may be performed according to the generation time of the system interface, or from high to low according to the service priority corresponding to the system interface. In practical application, the ordering rule of the system interface can be determined according to the user requirement, so that the data processing efficiency of the user is improved.
In one embodiment, the system interface determining module 730 may specifically include:
the screenshot obtaining unit is used for determining a system interface with a mapping relation with the selected field and obtaining an interface screenshot of the system interface;
the mark adding unit is used for adding a highlighting mark to a screenshot area corresponding to the selected field in the interface screenshot of the system interface;
and the screenshot display unit is used for determining the interface screenshot of the system interface corresponding to the selected field.
In one embodiment, the data processing apparatus 700 may further include:
and the system interface display module is used for displaying the system interface corresponding to the selected field.
In one embodiment, the system interface display module is specifically further configured to display an interface screenshot of a system interface corresponding to the selected field.
It should be clear that the invention is not limited to the specific arrangements and processes described in the foregoing embodiments and shown in the drawings. For convenience and brevity of description, detailed descriptions of known methods are omitted herein, and specific working processes of the systems, modules and units described above may refer to corresponding processes in the foregoing method embodiments, which are not repeated herein.
FIG. 8 is a block diagram illustrating an exemplary hardware architecture of a computing device capable of implementing data processing methods and apparatus according to embodiments of the invention.
As shown in fig. 8, computing device 800 includes an input device 801, an input interface 802, a central processor 803, a memory 804, an output interface 805, and an output device 806. The input interface 802, the central processor 803, the memory 804, and the output interface 805 are connected to each other through a bus 810, and the input device 801 and the output device 806 are connected to the bus 810 through the input interface 802 and the output interface 805, respectively, and further connected to other components of the computing device 800.
Specifically, the input device 801 receives input information from outside (e.g., an external input device of a business side), and transmits the input information to the central processor 803 through the input interface 802; the central processor 803 processes the input information based on computer executable instructions stored in the memory 804 to generate output information, temporarily or permanently stores the output information in the memory 804, and then transmits the output information to the output device 806 through the output interface 805; output device 806 outputs the output information to the outside of computing device 800 for use by a user.
That is, the computing device shown in FIG. 8 may also be implemented to include: a memory storing computer-executable instructions; and a processor that, when executing computer-executable instructions, may implement the data processing methods and apparatus described in connection with fig. 1-7.
In one embodiment, computing device 800 shown in FIG. 8 may be implemented as a data processing device that may include: a memory configured to store a program; and a processor configured to execute the program stored in the memory to perform the data processing method described in the above embodiment.
The processes described above with reference to flowcharts may be implemented as computer software programs according to embodiments of the present invention. For example, embodiments of the present invention include a computer program product comprising a computer program tangibly embodied on a machine-readable medium, the computer program comprising program code for performing the method shown in the flowchart. In such embodiments, the computer program may be downloaded and installed from a network, and/or installed from a removable storage medium.
In the above embodiments, it may be implemented in whole or in part by software, hardware, firmware, or any combination thereof. When implemented in software, may be implemented in whole or in part in the form of a computer program product. The computer program product comprises one or more computer instructions which, when run on a computer, cause the computer to perform the methods described in the various embodiments above. When loaded and executed on a computer, produces a flow or function in accordance with embodiments of the present invention, in whole or in part. The computer may be a general purpose computer, a special purpose computer, a computer network, or other programmable apparatus. The computer instructions may be stored in or transmitted from one computer-readable storage medium to another, for example, by wired (e.g., coaxial cable, optical fiber, digital Subscriber Line (DSL)), or wireless (e.g., infrared, wireless, microwave, etc.). The computer readable storage medium may be any available medium that can be accessed by a computer or a data storage device such as a server, data center, etc. that contains an integration of one or more available media. The usable medium may be a magnetic medium (e.g., floppy disk, hard disk, magnetic tape), an optical medium (e.g., DVD), or a semiconductor medium (e.g., solid state disk), etc.
The apparatus embodiments described above are merely illustrative, wherein the elements illustrated as separate elements may or may not be physically separate, and the elements shown as elements may or may not be physical elements, may be located in one place, or may be distributed over a plurality of network elements. Some or all of the modules may be selected according to actual needs to achieve the purpose of the solution of this embodiment. Those of ordinary skill in the art will understand and implement the present invention without undue burden.
Finally, it should be noted that: the above embodiments are only for illustrating the technical solution of the present invention, and not for limiting the same; although the invention has been described in detail with reference to the foregoing embodiments, it will be understood by those of ordinary skill in the art that: the technical scheme described in the foregoing embodiments can be modified or some or all of the technical features thereof can be replaced by equivalents; such modifications and substitutions do not depart from the spirit of the corresponding technical solutions from the scope of the technical solutions of the embodiments of the present invention.
Claims (10)
1. A method of data processing, comprising:
determining the mapping relation between the fields in the data table and the system interface of the service system;
acquiring a field with the mapping relation in the fields of the data table, and selecting a field from the fields with the mapping relation;
acquiring an interface screenshot of a system interface corresponding to the selected field;
and determining an interface screenshot of a system interface corresponding to the selected field according to the selected field and the mapping relation, wherein the interface screenshot is used for determining the system interface of a service system using the selected field, the position of the selected field in the system interface and the displayed field name so as to determine the field in use and the abandoned field in the data table.
2. The method for processing data according to claim 1, wherein determining the mapping relationship between the fields in the data table and the system interface of the service system comprises:
determining a data table corresponding to the keywords according to the acquired keywords;
and determining the mapping relation between the fields in the corresponding data table and the system interface of the service system.
3. The data processing method according to claim 2, wherein the determining a data table corresponding to the keyword based on the acquired keyword includes:
inquiring a data warehouse according to the keywords to obtain a data table related to the keywords in the data warehouse;
and screening the data table corresponding to the keywords according to the table name specification of the data warehouse, and taking the screened data table as the data table corresponding to the keywords of the service system.
4. A data processing method according to claim 3, wherein,
the data warehouse includes one or more of the following hierarchies: a detail data layer, a summary data layer and an application data layer;
the screened data table comprises one or more of the following data tables: the data table of the detail data layer, the data table of the summary data layer and the data table of the application data layer.
5. The data processing method according to claim 1, wherein the number of interface shots of the system interface corresponding to the selected field is greater than 1;
and determining an interface screenshot of a system interface corresponding to the selected field according to the selected field and the mapping relation, wherein the interface screenshot comprises the following steps:
and determining the interface screenshot of the system interface corresponding to the selected fields according to the specified sequence according to the selected fields in the fields of the data table and the mapping relation.
6. The data processing method according to claim 1, wherein the determining the screenshot of the system interface corresponding to the selected field includes:
adding a highlighting mark for a screenshot area corresponding to the selected field in the interface screenshot of the system interface;
and determining the interface screenshot of the system interface corresponding to the selected field.
7. The data processing method according to claim 1, characterized by further comprising:
and displaying a system interface corresponding to the selected field.
8. A data processing apparatus, comprising:
the mapping relation determining module is used for determining the mapping relation between the fields in the data table and the system interface of the service system;
the system interface determining module is used for acquiring the fields with the mapping relation in the fields of the data table and selecting the fields from the fields with the mapping relation; acquiring an interface screenshot of a system interface corresponding to the selected field; and determining an interface screenshot of a system interface corresponding to the selected field according to the selected field and the mapping relation, wherein the interface screenshot is used for determining the system interface of a service system using the selected field, the position of the selected field in the system interface and the displayed field name so as to determine the field in use and the abandoned field in the data table.
9. A data processing apparatus, comprising:
a memory for storing a program;
a processor for executing the program stored in the memory to perform the data processing method according to any one of claims 1 to 7.
10. A computer readable storage medium, on which computer program instructions are stored, which computer program instructions, when executed by a processor, implement a data processing method according to any of claims 1-7.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201910012851.0A CN111414410B (en) | 2019-01-07 | 2019-01-07 | Data processing method, device, equipment and storage medium |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201910012851.0A CN111414410B (en) | 2019-01-07 | 2019-01-07 | Data processing method, device, equipment and storage medium |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN111414410A CN111414410A (en) | 2020-07-14 |
| CN111414410B true CN111414410B (en) | 2023-07-14 |
Family
ID=71490713
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201910012851.0A Active CN111414410B (en) | 2019-01-07 | 2019-01-07 | Data processing method, device, equipment and storage medium |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN111414410B (en) |
Families Citing this family (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN114519090B (en) * | 2020-11-20 | 2023-11-21 | 马上消费金融股份有限公司 | Method and device for managing stop words and electronic equipment |
| CN112528613A (en) * | 2020-12-21 | 2021-03-19 | 金蝶软件（中国）有限公司 | Data table generation method and related equipment thereof |
| CN113377924A (en) * | 2021-06-28 | 2021-09-10 | 北京百度网讯科技有限公司 | Data processing method, device, equipment and storage medium |
| CN115757400B (en) * | 2022-11-07 | 2023-06-13 | 北京国电通网络技术有限公司 | Data table processing method, device, electronic equipment and computer readable medium |
Citations (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| EP1571547A1 (en) * | 2004-02-27 | 2005-09-07 | Research In Motion Limited | System and method for building wireless applications with intelligent mapping between user interface and data components |
| CN108509485A (en) * | 2018-02-07 | 2018-09-07 | 深圳壹账通智能科技有限公司 | Preprocess method, device, computer equipment and the storage medium of data |
Family Cites Families (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US8356252B2 (en) * | 2009-09-02 | 2013-01-15 | Synchronoss Technologies, Inc. | System and method for providing a computer display form layout |
| US9460415B2 (en) * | 2011-11-10 | 2016-10-04 | Sap Se | Determining semantic information of business applications |
-
2019
- 2019-01-07 CN CN201910012851.0A patent/CN111414410B/en active Active
Patent Citations (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| EP1571547A1 (en) * | 2004-02-27 | 2005-09-07 | Research In Motion Limited | System and method for building wireless applications with intelligent mapping between user interface and data components |
| CN108509485A (en) * | 2018-02-07 | 2018-09-07 | 深圳壹账通智能科技有限公司 | Preprocess method, device, computer equipment and the storage medium of data |
Also Published As
| Publication number | Publication date |
|---|---|
| CN111414410A (en) | 2020-07-14 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN111414410B (en) | Data processing method, device, equipment and storage medium | |
| JP6192800B2 (en) | Method, apparatus, and computer-readable medium for performing efficient operations on individual data values | |
| US9218408B2 (en) | Method for automatically creating a data mart by aggregated data extracted from a business intelligence server | |
| US20190026358A1 (en) | Big data-based method and device for calculating relationship between development objects | |
| US9116899B2 (en) | Managing changes to one or more files via linked mapping records | |
| JP6434154B2 (en) | Identifying join relationships based on transaction access patterns | |
| US20110288956A1 (en) | Using model information groups in searching | |
| US9495282B2 (en) | Method and systems for a dashboard testing framework in an online demand service environment | |
| US10223388B2 (en) | Avoid double counting of mapped database data | |
| CN102541867A (en) | Data dictionary generating method and system | |
| US20150019535A1 (en) | System, Method, and Data Structure for Automatically Generating Database Queries Which Are Data Model Independent and Cardinality Independent | |
| CN105989082A (en) | Report view generation method and apparatus | |
| JP5624674B2 (en) | How to improve queries for searching databases | |
| US11727129B2 (en) | Data security using semantic services | |
| US20210165816A1 (en) | Digital Duplicate | |
| US11868406B2 (en) | Smart interactions for a digital duplicate | |
| US9652740B2 (en) | Fan identity data integration and unification | |
| US10552423B2 (en) | Semantic tagging of nodes | |
| CN110442791A (en) | Data push method and system | |
| US6732115B2 (en) | Chameleon measure and metric calculation | |
| JP4059970B2 (en) | Information source recommendation device | |
| WO2009006028A2 (en) | Explaining changes in measures thru data mining | |
| US11636421B1 (en) | Model driven reporting | |
| US20210397745A1 (en) | Data providing server device and data providing method | |
| JP2005190212A (en) | Database system, data processing method and program |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |