CN111414410A - Data processing method, device, equipment and storage medium - Google Patents

Data processing method, device, equipment and storage medium Download PDF

Info

Publication number
CN111414410A
CN111414410A CN201910012851.0A CN201910012851A CN111414410A CN 111414410 A CN111414410 A CN 111414410A CN 201910012851 A CN201910012851 A CN 201910012851A CN 111414410 A CN111414410 A CN 111414410A
Authority
CN
China
Prior art keywords
data
data table
fields
field
determining
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Granted
Application number
CN201910012851.0A
Other languages
Chinese (zh)
Other versions
CN111414410B (en
Inventor
吴俊东
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Alibaba Group Holding Ltd
Original Assignee
Alibaba Group Holding Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Alibaba Group Holding Ltd filed Critical Alibaba Group Holding Ltd
Priority to CN201910012851.0A priority Critical patent/CN111414410B/en
Publication of CN111414410A publication Critical patent/CN111414410A/en
Application granted granted Critical
Publication of CN111414410B publication Critical patent/CN111414410B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/20Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
    • G06F16/26Visual data mining; Browsing structured data
    • YGENERAL TAGGING OF NEW TECHNOLOGICAL DEVELOPMENTS; GENERAL TAGGING OF CROSS-SECTIONAL TECHNOLOGIES SPANNING OVER SEVERAL SECTIONS OF THE IPC; TECHNICAL SUBJECTS COVERED BY FORMER USPC CROSS-REFERENCE ART COLLECTIONS [XRACs] AND DIGESTS
    • Y02TECHNOLOGIES OR APPLICATIONS FOR MITIGATION OR ADAPTATION AGAINST CLIMATE CHANGE
    • Y02DCLIMATE CHANGE MITIGATION TECHNOLOGIES IN INFORMATION AND COMMUNICATION TECHNOLOGIES [ICT], I.E. INFORMATION AND COMMUNICATION TECHNOLOGIES AIMING AT THE REDUCTION OF THEIR OWN ENERGY USE
    • Y02D10/00Energy efficient computing, e.g. low power processors, power management or thermal management

Abstract

A data processing method, apparatus, device and storage medium, the data processing method comprising: determining a data table corresponding to the keywords according to the acquired keywords; determining a mapping relation between a field in a data table and a system interface of a service system; and displaying a system interface corresponding to the selected field according to the field selected from the fields of the data table and the mapping relation. According to the data processing method provided by the embodiment of the invention, the information redundancy can be reduced, and the application efficiency and the accuracy of the business party for applying the business system data are improved.

Description

Data processing method, device, equipment and storage medium
Technical Field
The present invention relates to the field of computers, and in particular, to a data processing method, apparatus, device, and storage medium.
Background
In order to integrate data scattered in each IT system, all data need to be exported from the database corresponding to each IT system first and then imported into a unified database, namely a data warehouse.
The data warehouse has a large number of cleaned and integrated data lists, and can inquire, aggregate and analyze dimensions and the like on the basis of the data lists and inquire data in the metadata management system. The metadata management system is a system that manages and presents table structure information, blood relationship information, upstream and downstream dependent usage, life cycle, and the like of a data warehouse. The metadata management system contains table names, table annotations, column names, and column annotations.
Since the metadata management system includes much information, too much unnecessary information is displayed when the metadata management system is queried, and thus there is a technical problem of information redundancy.
Disclosure of Invention
Embodiments of the present invention provide a data processing method, apparatus, device, and storage medium, which display necessary information when querying a metadata management system, thereby solving the technical problem of information redundancy.
According to an aspect of the embodiments of the present invention, there is provided a data processing method, including:
determining a mapping relation between a field in a data table and a system interface of a service system; and determining a system interface corresponding to the selected field according to the field selected from the fields of the data table and the mapping relation.
According to another aspect of the embodiments of the present invention, there is provided a data processing apparatus including:
the mapping relation determining module is used for determining the mapping relation between the fields in the data table and the system interface of the service system; and the system interface determining module is used for determining the system interface corresponding to the selected field according to the field selected from the fields of the data table and the mapping relation.
According to still another aspect of embodiments of the present invention, there is provided a data processing apparatus including: a memory and a processor; the memory is used for storing programs; the processor is used for reading the executable program codes stored in the memory to execute the data processing method.
According to still another aspect of embodiments of the present invention, there is provided a computer-readable storage medium having stored therein instructions that, when executed on a computer, cause the computer to perform the data processing method of the above-described aspects.
According to the data processing method, the data processing device, the data processing equipment and the computer storage medium, according to the mapping relation established between the data table structure and the system interface, a business side can clearly know which fields in the data table are in use and which fields are abandoned through the picture preview established according to the mapping relation, and the data table to be applied and the specific fields in the data table to be applied are clear, so that unnecessary information is filtered, the problem of information redundancy is solved, and the application efficiency and the accuracy of the business side for applying for business system data are improved.
Drawings
The present invention will be better understood from the following description of specific embodiments thereof taken in conjunction with the accompanying drawings, in which like or similar reference characters designate like or similar features.
FIG. 1 is a block diagram illustrating an architecture of a data processing system in which a data processing method according to an embodiment of the present invention is involved;
FIG. 2 is a query result presentation diagram illustrating the use of a metadata management system by a business party, one example of which is known in the art;
FIG. 3 is a diagram illustrating presentation information of a data list in a query result according to an example in the prior art;
fig. 4 is a schematic diagram illustrating that a mapping relationship between fields in a data table and fields in a service system page is established in the data processing method according to the embodiment of the present invention;
FIG. 5 is a schematic diagram illustrating an effect of previewing fields in a data table according to a mapping relationship between the fields in the data table and fields in a system interface of a business system in the embodiment of the present invention;
FIG. 6 is a flow chart diagram illustrating a data processing method according to an embodiment of the present invention;
fig. 7 is a schematic configuration diagram showing a data processing apparatus according to an embodiment of the present invention;
fig. 8 is a block diagram of an exemplary hardware architecture of a computing device in which data processing methods and apparatus according to embodiments of the present invention may be implemented.
Detailed Description
Features and exemplary embodiments of various aspects of the present invention will be described in detail below, and in order to make objects, technical solutions and advantages of the present invention more apparent, the present invention will be further described in detail below with reference to the accompanying drawings and embodiments. It should be understood that the specific embodiments described herein are merely illustrative of the invention and are not to be construed as limiting the invention. It will be apparent to one skilled in the art that the present invention may be practiced without some of these specific details. The following description of the embodiments is merely intended to provide a better understanding of the present invention by illustrating examples of the present invention.
It is noted that, herein, relational terms such as first and second, and the like may be used solely to distinguish one entity or action from another entity or action without necessarily requiring or implying any actual such relationship or order between such entities or actions. Also, the terms "comprises," "comprising," or any other variation thereof, are intended to cover a non-exclusive inclusion, such that a process, method, article, or apparatus that comprises a list of elements does not include only those elements but may include other elements not expressly listed or inherent to such process, method, article, or apparatus. Without further limitation, an element defined by the phrase "comprising … …" does not exclude the presence of other identical elements in a process, method, article, or apparatus that comprises the element.
Fig. 1 is a schematic diagram showing an architecture of a data processing system according to a data processing method according to an embodiment of the present invention. As shown in FIG. 1, in an embodiment of the present invention, a data processing system 100 may include a data warehouse 10 and a metadata management system 20.
In one embodiment, the data warehouse 10 is a data set of all business system databases, and multiple business system databases can be integrated through the data warehouse; the metadata management system 20 is used to manage the data warehouse 10, and may open the data warehouse 10 to a business party to provide data included in the business system database to the business party through the data warehouse 10.
In one embodiment, the business system databases may include, for example, database 1, database 2, … …, and database n. Database 1, database 2, … …, and database n may be used to store business data in different business systems, respectively.
In one embodiment, the business system may comprise an information technology system. The information technology system may be referred to as an IT system for short. As one example, the IT system may include an IT system asset and configuration management system, an IT integrated business monitoring system, an IT integrated monitoring system, a business process management platform, an IT operation and maintenance process management, and the like.
Database 1, database 2, … …, or database n may be, for example, a Mysql database, SQ L Server database, Oracle database, Hadoop, etc. database.
As an example, for any developed and completed data detail table in the business system database integrated by the data warehouse, the business party may apply for the table right to access the data detail table, for example.
In one embodiment, the service party may include a service management system used by the user, and the service management system may be run on the terminal device. As shown in fig. 1, when a user 1 needs to access a data detail table in a data warehouse, a corresponding table access right may be applied to a metadata management system 20 through a service party 21; the metadata management system 20 opens the corresponding table access authority to the service party 21; the service party 21 accesses the data list according to the obtained list access authority, for example, performs query, aggregation and analysis of each dimension, and the like on the basis of the data list.
The following describes a specific process of applying for a service table by a service party using a metadata management system in the prior art with reference to fig. 2 and fig. 3. FIG. 2 is a diagram illustrating a query result presentation using a metadata management system by a business party, an example of which is known in the art; fig. 3 is a schematic diagram illustrating presentation information of a data list in a query result according to an example in the prior art.
As shown in fig. 2, the metadata management system may provide a search and result presentation page to a user, query a data table related to a keyword in a data warehouse according to the keyword input by a service party on the search and result presentation page, and present basic information of the data table related to the keyword obtained by the query, where the presented basic information includes, but is not limited to, a table name, table description information, a number of fields, a number of reads, an application to which the data table belongs, a data development manager, and the like.
In one embodiment, the metadata management system can generally obtain a plurality of data tables by querying based on keywords input by a business party, and the description mode of the basic information of the data tables in the query result is often technical or not processed by human.
As an example, in fig. 2, the metadata management system queries the data warehouse according to the keyword "credential row information" input by the business party, and obtains query results such as data detail table 1 and data detail table 2.
As can be seen from fig. 2, according to the basic information shown in the data detail table 1 and the data detail table 2 in the query result, the service party cannot determine which service-related information corresponding to the input keyword exists in the table data of the data detail table, and thus cannot determine which data detail table is selected.
In order to determine which service-related information corresponding to the keyword exists in the table data of the data detail table, a service party often needs to check the display information of each data detail table in the query result.
As shown in fig. 3, in the presentation information of the data detail table, the field information of the data detail table may include a service data class field, such as field name, field type, field description, and so on. Because the description mode of the field name, the field type, the field description and other information is also technical or not processed by human, the business party cannot easily understand the mapping relationship between the business information stored in each field and the system application interface, and the field names are numerous, and the business party cannot judge which fields are in use and which fields are abandoned.
With continued reference to FIG. 3, the field information of the data list may also include technology class fields, such as information for the primary key, foreign key, enumerated value code, etc. of the data list. The technical field forms information redundancy, which increases the use cost of the service party.
The embodiment of the invention provides a data processing method, which is characterized in that for a data table in a query result of a metadata management system query data warehouse, a mapping relation between the data table and/or a table field of the data table and a service system and a system page of the service system is established, so that a service party can acquire accurate system product information according to the query result of the table, the service party can independently apply for a data detail table according to the provided accurate system product information, and the application efficiency of a user for applying for the service system data is improved.
How to establish the mapping relationship between the fields in the data table and the fields in the service system page is described in detail below with reference to fig. 4. Fig. 4 is a schematic diagram illustrating that a mapping relationship between fields in a data table and fields in a service system page is established in the data processing method according to the embodiment of the present invention.
First, as shown in S410 in fig. 4, the data table and the field in the data table to be exposed in the query result of the metadata management system to the data warehouse are determined.
In the embodiment of the invention, a large amount of data exists in the data warehouse, different types of data can have different processing logics, and the architecture of the data warehouse can adopt a layered structure in order to improve the data processing efficiency and reduce the huge workload when the whole data is frequently processed.
In one embodiment, the data warehouse may include, in accordance with a hierarchy of data warehouses: an Operational Data Store (ODS) layer, a Detail Data (DWD) layer, a summary Data Service (DWS) layer, and an Application Data Store (ADS) layer. The conversion from the data assets to the information assets is realized through the data processing process among different levels of the data warehouse, and the metadata management is carried out on the whole data processing process.
In one embodiment, the ODS layer may include data tables with table names beginning with an "ODS", according to a table name specification in the data warehouse; the DWD layer may include a data table with table names beginning with "DWD"; the DWS layer may include a data table with table names beginning with "DWS"; and the ADS layer may include a data table with table names beginning with "ADS".
In the embodiment of the invention, in the query result of the metadata management system to the data warehouse, the data table displayed to the user can be determined according to the table naming specification in the data warehouse. As an example, the ODS layer is typically used to store the original data tables in the data warehouse, and the data in the original data tables are typically less meaningful to the business side than the data tables of the DWD layer, the DWS layer, and the ADS layer. Therefore, the table information of the data table beginning with dwd, dws, ads can be presented to the user for use.
As an example, it is assumed that the metadata management system includes table 1, table 2, and table 3 for the query result of the data warehouse according to the keyword input by the user, and filters the query result according to the table name specification in the data warehouse to obtain the data tables shown in the query result, such as table 1 and table 2 shown in fig. 4, and the fields included in table 1 and the fields included in table 2.
Second, as shown in S420 in fig. 4, a mapping relationship between fields in the data table and fields in the system interface of the business system may be established.
In one embodiment, the following system information for each business system may be pre-recorded: the system interface of the business system comprises information such as the name of the business system, the system interface and the interface name of the business system, the name of a field and a field in the system interface of the business system, an interface screenshot and an interface screenshot name corresponding to the system interface of the business system, and the area position of the field in the system interface of the business system in the interface screenshot.
In this embodiment, a corresponding system list may be respectively established for each service system, and the system information of the service system may be recorded by using the corresponding system list.
As an example, as shown in fig. 4, field 1 in table 1 has a mapping relationship with the credential number of the credential entry interface of the ledger system. That is, corresponding to field 1 of table 1 is a field having a field name of "credential number" in the business system having a business system name of "general ledger", in the system interface having an interface name of "credential entry".
Next, as shown in S430 in fig. 4, previewing the field in the data table according to the mapping relationship between the field in the data table and the field in the system interface of the service system, and the area position of the field in the interface screenshot corresponding to the system interface.
In one embodiment, a user may customize an interface screenshot name according to an interface screenshot corresponding to a system interface of a business system.
As an example, referring to fig. 4, for a system interface with an interface name of "credential entry," an interface screenshot with an interface screenshot name of "credential screenshot" may be corresponded;
for a system interface with an interface name of 'order purchase', an interface screenshot with an interface screenshot name of 'purchase order screenshot' can be corresponded;
for a system interface with an interface name of 'pay bill information', the interface screenshot with an interface screenshot name of 'pay bill screenshot' can be corresponded; or
For a system interface with the interface name of 'payment order information', the interface screenshot with the interface screenshot name of 'payment order screenshot' can be corresponded.
In the embodiment of the present invention, when a business party obtains a data table in a query result of a data warehouse, a mapping relationship between a field in the data table and a field in a system interface of a business system may be used to determine, through picture preview, a use condition of the field in the data table in the system interface, for example, in which system page of which business system the field is used, and display, through picture preview, a position of the field in the system page and a displayed field name; thereby identifying the in-use and obsolete fields in the data table. The usability of the query result of the data warehouse is improved, the visual query result is provided for the business side, and the business side can quickly and accurately select the data table and the fields in the data table according to the preview result.
Fig. 5 is a schematic diagram illustrating an effect of previewing a field in a data table according to a mapping relationship between the field in the data table and a field in a system interface of a business system in the embodiment of the present invention. As shown in fig. 5, the metadata management system may query the data warehouse according to the keywords input by the business party, and display the data table in the query result.
In the data table displayed by the query result of the data warehouse, the business party can preview the field in the system interface of the business system according to the table name of the data table in the query result and the mapping relation between the field in the data table and the field in the system interface of the business system.
As an example, when the service party moves the mouse to one of the data tables in the query result of the data warehouse, the system automatically displays the area position of the field in the data table in the interface screenshot corresponding to the system interface according to the mapping relationship.
With continued reference to FIG. 5, in one embodiment, the interface screenshot of the system interface corresponding to the target table selected by the business party may include a field name area and a system screenshot area. The field name area of the interface screenshot is used for displaying fields in a system interface of a service system which have a mapping relation with fields in a target table; and the system screenshot area is used for displaying an interface screenshot corresponding to the field in the data table on the system interface.
In this embodiment, the field names of the fields in the system interface may be derived from the annotation information of the fields in the data table, and when the annotation information of the fields in the data table is empty, the field names of the fields in the system interface may be the field names of the fields in the data table.
In one embodiment, when the business side points to any one of the field names displayed in the field name area of the interface screenshot, the system screenshot area displays the corresponding system screenshot, and the pointed field name and the field names of the other fields of the field corresponding to the pointed field name in the same data table are displayed in the system screenshot.
In one embodiment, a user can customize the display mode and display effect of the fields in the target table in the system interface of the business system with the mapping relation.
Specifically, the display mode may include: sequentially displaying or alternately displaying a plurality of system screenshots corresponding to the target table; the display effect may include: and adding a highlighting mark to the area where the field in the target table is displayed in the system screenshot, for example, adding an outer frame of a specified color to the area where the field is positioned and/or filling a background color of the specified color.
As shown in fig. 5, when the user mouse moves to a certain field in the field name area of the interface screenshot, a corresponding system screenshot pops up in the system screenshot area, and except for a red box in the area where the field in the data table displayed in the system screenshot is located, yellow is filled in the background color for enhanced display.
It can be seen from fig. 5 that, after the table structure and the system interface generate a mapping relationship, all fields used in the service system are displayed in the screenshot of the system interface, but the discarded fields are not displayed, and the service party can clearly know which fields of which table should be applied to complete self-service application, thereby solving the technical problem of information redundancy and improving the efficiency of applying for the table.
The following describes a specific flow of the data processing method according to the embodiment of the present invention in detail with reference to fig. 6. Fig. 6 shows a flow diagram of a data processing method according to an embodiment of the invention. As shown in FIG. 6, in one embodiment, a data processing method 600 may comprise:
step S610, determining the mapping relation between the fields in the data table and the system interface of the service system;
and S620, determining a system interface corresponding to the selected field according to the field selected from the fields of the data table and the mapping relation.
In an embodiment, step S610 may specifically include:
step S611, determining a data table corresponding to the keyword according to the acquired keyword.
Step S612, determining a mapping relationship between the fields in the corresponding data table and the system interface of the service system.
In this embodiment, a keyword may be obtained by a user's input in the metadata management system, and a data table corresponding to the input keyword is determined.
In an embodiment, step S611 may specifically include:
step S611-01, inquiring a data warehouse according to the keywords to obtain a data table related to the keywords in the data warehouse;
and S611-02, screening a data table corresponding to the keyword according to the table name specification of the data warehouse, and taking the screened data table as the data table corresponding to the keyword of the service system.
In one embodiment, the data warehouse includes one or more of the following hierarchical structures: a detail data layer, a summary data layer and an application data layer; the screened data table comprises one or more of the following data tables: a data table of the detail data layer, a data table of the summary data layer and a data table of the application data layer.
In an embodiment, step S620 may specifically include:
step S11, acquiring the fields with mapping relation in the fields of the data table, and selecting the fields from the fields with mapping relation;
step S12, acquiring an interface screenshot of the system interface corresponding to the selected field;
and step S13, determining the interface screenshot of the system interface corresponding to the selected field according to the selected field and the mapping relation.
In one embodiment, the number of system interfaces corresponding to the selected field is greater than 1. In this embodiment, step S620 may specifically include:
and determining the system interface corresponding to the selected fields according to the fields selected from the fields of the data table and the mapping relation and according to the specified sequence.
In an embodiment, step S620 may specifically include:
step S21, determining a system interface having a mapping relation with the selected field, and acquiring an interface screenshot of the system interface;
step S22, adding a highlight mark to a screenshot area corresponding to the selected field in the interface screenshot of the system interface;
and step S23, determining the interface screenshot of the system interface corresponding to the selected field.
In one embodiment, the data processing method 600 may further include:
and step S630, displaying the system interface corresponding to the selected field.
Specifically, according to the above embodiment, step S630 may specifically include: and displaying the interface screenshot of the system interface corresponding to the selected field.
In the embodiment of the invention, the mapping relation is established according to the data table structure and the system interface, and a service party can clearly know which fields in the data table are used and which fields are abandoned through the picture preview established according to the mapping relation, so that the data table to be applied and the specific fields in the data table to be applied are clear, and the application efficiency and the accuracy of the user for applying the service system data are improved.
A data processing apparatus according to an embodiment of the present invention is described below with reference to fig. 7. Fig. 7 shows a schematic configuration of a data processing apparatus according to an embodiment of the present invention. As shown in fig. 7, a data processing apparatus 700 according to an embodiment of the present invention may include:
a mapping relation determining module 710, configured to determine a mapping relation between a field in the data table and a system interface of the service system;
and the system interface determining module 720 is configured to display a system interface corresponding to the selected field according to the field selected from the fields of the data table and the mapping relationship.
In an embodiment, the mapping relationship determining module 710 may specifically include:
the data table acquisition unit is used for determining a data table corresponding to the keyword according to the acquired keyword; the mapping relationship determining module 710 may be further configured to determine a mapping relationship between a field in the corresponding data table and a system interface of the service system.
In an embodiment, the data table obtaining unit may specifically include:
the data table query subunit is used for querying the data warehouse according to the key words to obtain data tables related to the key words in the data warehouse;
and the data table screening subunit is used for screening the data table corresponding to the keyword according to the table name specification of the data warehouse, and taking the screened data table as the data table corresponding to the keyword of the service system.
In one embodiment, the data warehouse includes one or more of the following hierarchical structures: a detail data layer, a summary data layer and an application data layer;
the screened data table comprises one or more of the following data tables: a data table of the detail data layer, a data table of the summary data layer and a data table of the application data layer.
In an embodiment, the system interface determining module 720 may specifically include:
the field selection unit is used for acquiring fields with mapping relations in the fields of the data table and selecting the fields from the fields with the mapping relations;
the screenshot obtaining unit is used for obtaining an interface screenshot of the system interface corresponding to the selected field;
and the screenshot display unit is used for determining the interface screenshot of the system interface corresponding to the selected field according to the selected field and the mapping relation.
In one embodiment, the number of system interfaces corresponding to the selected field is greater than 1;
and the system interface determining module is specifically used for determining the system interface corresponding to the selected fields according to the fields selected from the fields of the data table and the mapping relation and according to the specified sequence.
In this step, if the number of the system interfaces corresponding to the selected field is greater than 1, sorting the corresponding system interfaces, and determining the sorted system interfaces corresponding to the selected field.
In one embodiment, the ordering may be performed according to the generation time of the system interface, or may be performed from high to low according to the service priority corresponding to the system interface. In practical application, the sequencing rule of the system interface can be determined according to the user requirements, and the data processing efficiency of the user is improved.
In an embodiment, the system interface determining module 730 may specifically include:
the screenshot obtaining unit is used for determining a system interface which has a mapping relation with the selected field and obtaining an interface screenshot of the system interface;
the mark adding unit is used for adding a highlight mark to a screenshot area corresponding to the selected field in the interface screenshot of the system interface;
and the screenshot display unit is used for determining the interface screenshot of the system interface corresponding to the selected field.
In one embodiment, the data processing apparatus 700 may further include:
and the system interface display module is used for displaying the system interface corresponding to the selected field.
In an embodiment, the system interface display module is further specifically configured to display an interface screenshot of the system interface corresponding to the selected field.
It is to be understood that the invention is not limited to the particular arrangements and instrumentality described in the above embodiments and shown in the drawings. For convenience and brevity of description, detailed description of a known method is omitted here, and for the specific working processes of the system, the module and the unit described above, reference may be made to corresponding processes in the foregoing method embodiments, which are not described herein again.
Fig. 8 is a block diagram illustrating an exemplary hardware architecture of a computing device capable of implementing a data processing method and apparatus according to embodiments of the present invention.
As shown in fig. 8, computing device 800 includes an input device 801, an input interface 802, a central processor 803, a memory 804, an output interface 805, and an output device 806. The input interface 802, the central processing unit 803, the memory 804, and the output interface 805 are connected to each other via a bus 810, and the input device 801 and the output device 806 are connected to the bus 810 via the input interface 802 and the output interface 805, respectively, and further connected to other components of the computing device 800.
Specifically, the input device 801 receives input information from the outside (for example, an external input device of a business side), and transmits the input information to the central processor 803 through the input interface 802; the central processor 803 processes input information based on computer-executable instructions stored in the memory 804 to generate output information, temporarily or permanently stores the output information in the memory 804, and then transmits the output information to the output device 806 via the output interface 805; output device 806 outputs output information external to computing device 800 for use by a user.
That is, the computing device shown in fig. 8 may also be implemented to include: a memory storing computer-executable instructions; and a processor which, when executing computer executable instructions, may implement the data processing methods and apparatus described in connection with fig. 1-7.
In one embodiment, the computing device 800 shown in FIG. 8 may be implemented as a data processing device that may include: a memory configured to store a program; a processor configured to execute the program stored in the memory to perform the data processing method described in the above embodiments.
According to an embodiment of the invention, the process described above with reference to the flow chart may be implemented as a computer software program. For example, embodiments of the invention include a computer program product comprising a computer program tangibly embodied on a machine-readable medium, the computer program comprising program code for performing the method illustrated in the flow chart. In such an embodiment, the computer program may be downloaded and installed from a network, and/or installed from a removable storage medium.
The computer instructions may be stored in or transmitted from one computer-readable storage medium to another computer-readable storage medium, e.g., a website, computer, server, or data center, via a wired (e.g., coaxial cable, optical fiber, digital L)) or wireless (e.g., infrared, wireless, website, microwave, etc.) manner, may be transmitted to another website, computer, server, or data center via a solid state medium such as a semiconductor-readable storage medium, a solid state medium such as a floppy disk, a solid state medium such as a semiconductor-readable storage medium, a floppy disk, a magnetic tape, or the like, (e.g., a hard disk-readable storage medium, a magnetic tape, or the like).
The above-described embodiments of the apparatus are merely illustrative, and the units described as separate parts may or may not be physically separate, and parts displayed as units may or may not be physical units, may be located in one place, or may be distributed on a plurality of network units. Some or all of the modules may be selected according to actual needs to achieve the purpose of the solution of the present embodiment. One of ordinary skill in the art can understand and implement it without inventive effort.
Finally, it should be noted that: the above embodiments are only used to illustrate the technical solution of the present invention, and not to limit the same; while the invention has been described in detail and with reference to the foregoing embodiments, it will be understood by those skilled in the art that: the technical solutions described in the foregoing embodiments may still be modified, or some or all of the technical features may be equivalently replaced; and the modifications or the substitutions do not make the essence of the corresponding technical solutions depart from the scope of the technical solutions of the embodiments of the present invention.

Claims (11)

1. A data processing method, comprising:
determining a mapping relation between a field in a data table and a system interface of a service system;
and determining a system interface corresponding to the selected field according to the field selected from the fields of the data table and the mapping relation.
2. The data processing method of claim 1, wherein the determining a mapping relationship between fields in the data table and a system interface of the business system comprises:
determining a data table corresponding to the keywords according to the acquired keywords;
and determining the mapping relation between the fields in the corresponding data table and the system interface of the service system.
3. The data processing method according to claim 2, wherein the determining a data table corresponding to the keyword according to the obtained keyword comprises:
inquiring a data warehouse according to the key words to obtain a data table related to the key words in the data warehouse;
and screening the data table corresponding to the keyword according to the table name specification of the data warehouse, and taking the screened data table as the data table of the business system corresponding to the keyword.
4. The data processing method of claim 3,
the data warehouse comprises one or more of the following hierarchical structures: a detail data layer, a summary data layer and an application data layer;
the screened data table comprises one or more of the following data tables: the data table of the detail data layer, the data table of the summary data layer and the data table of the application data layer.
5. The data processing method according to claim 1, wherein the determining a system interface corresponding to a selected field according to the field selected from the fields of the data table and the mapping relationship comprises:
acquiring fields with the mapping relation in fields of the data table, and selecting the fields from the fields with the mapping relation;
acquiring an interface screenshot of a system interface corresponding to the selected field;
and determining an interface screenshot of the system interface corresponding to the selected field according to the selected field and the mapping relation.
6. The data processing method of claim 1, wherein the number of system interfaces corresponding to the selected field is greater than 1;
determining an interface screenshot corresponding to the selected field according to the field selected by the user in the fields of the list, wherein the interface screenshot comprises:
and determining a system interface corresponding to the selected field according to the field selected from the fields of the data table and the mapping relation and according to a specified sequence.
7. The data processing method according to claim 1, wherein the determining a system interface corresponding to a selected field according to the field selected from the fields of the data table and the mapping relationship comprises:
determining a system interface having the mapping relation with the selected field, and acquiring an interface screenshot of the system interface;
adding a highlight mark to a screenshot area corresponding to the selected field in the interface screenshot of the system interface;
and determining an interface screenshot of the system interface corresponding to the selected field.
8. The data processing method of claim 1, further comprising:
and displaying a system interface corresponding to the selected field.
9. A data processing apparatus, comprising:
the mapping relation determining module is used for determining the mapping relation between the fields in the data table and the system interface of the service system;
and the system interface determining module is used for determining the system interface corresponding to the selected field according to the field selected from the fields of the data table and the mapping relation.
10. A data processing apparatus, characterized by comprising:
a memory for storing a program;
a processor for executing the program stored in the memory to perform the data processing method of any of claims 1-8.
11. A computer-readable storage medium, on which computer program instructions are stored, which, when executed by a processor, implement a data processing method according to any one of claims 1 to 8.
CN201910012851.0A 2019-01-07 2019-01-07 Data processing method, device, equipment and storage medium Active CN111414410B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201910012851.0A CN111414410B (en) 2019-01-07 2019-01-07 Data processing method, device, equipment and storage medium

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201910012851.0A CN111414410B (en) 2019-01-07 2019-01-07 Data processing method, device, equipment and storage medium

Publications (2)

Publication Number Publication Date
CN111414410A true CN111414410A (en) 2020-07-14
CN111414410B CN111414410B (en) 2023-07-14

Family

ID=71490713

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201910012851.0A Active CN111414410B (en) 2019-01-07 2019-01-07 Data processing method, device, equipment and storage medium

Country Status (1)

Country Link
CN (1) CN111414410B (en)

Cited By (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN112528613A (en) * 2020-12-21 2021-03-19 金蝶软件(中国)有限公司 Data table generation method and related equipment thereof
CN113377924A (en) * 2021-06-28 2021-09-10 北京百度网讯科技有限公司 Data processing method, device, equipment and storage medium
CN114519090A (en) * 2020-11-20 2022-05-20 马上消费金融股份有限公司 Stop word management method and device and electronic equipment
CN115757400A (en) * 2022-11-07 2023-03-07 北京国电通网络技术有限公司 Data table processing method and device, electronic equipment and computer readable medium

Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
EP1571547A1 (en) * 2004-02-27 2005-09-07 Research In Motion Limited System and method for building wireless applications with intelligent mapping between user interface and data components
US20110055737A1 (en) * 2009-09-02 2011-03-03 Vinod Kumar Raman System and method for providing a computer display form layout
US20130125053A1 (en) * 2011-11-10 2013-05-16 Frank Brunswig Determining semantic information of business applications
CN108509485A (en) * 2018-02-07 2018-09-07 深圳壹账通智能科技有限公司 Preprocess method, device, computer equipment and the storage medium of data

Patent Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
EP1571547A1 (en) * 2004-02-27 2005-09-07 Research In Motion Limited System and method for building wireless applications with intelligent mapping between user interface and data components
US20110055737A1 (en) * 2009-09-02 2011-03-03 Vinod Kumar Raman System and method for providing a computer display form layout
US20130125053A1 (en) * 2011-11-10 2013-05-16 Frank Brunswig Determining semantic information of business applications
CN108509485A (en) * 2018-02-07 2018-09-07 深圳壹账通智能科技有限公司 Preprocess method, device, computer equipment and the storage medium of data

Cited By (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN114519090A (en) * 2020-11-20 2022-05-20 马上消费金融股份有限公司 Stop word management method and device and electronic equipment
CN114519090B (en) * 2020-11-20 2023-11-21 马上消费金融股份有限公司 Method and device for managing stop words and electronic equipment
CN112528613A (en) * 2020-12-21 2021-03-19 金蝶软件(中国)有限公司 Data table generation method and related equipment thereof
CN113377924A (en) * 2021-06-28 2021-09-10 北京百度网讯科技有限公司 Data processing method, device, equipment and storage medium
CN115757400A (en) * 2022-11-07 2023-03-07 北京国电通网络技术有限公司 Data table processing method and device, electronic equipment and computer readable medium
CN115757400B (en) * 2022-11-07 2023-06-13 北京国电通网络技术有限公司 Data table processing method, device, electronic equipment and computer readable medium

Also Published As

Publication number Publication date
CN111414410B (en) 2023-07-14

Similar Documents

Publication Publication Date Title
CN111414410A (en) Data processing method, device, equipment and storage medium
CN110019396A (en) A kind of data analysis system and method based on distributed multidimensional analysis
US9116899B2 (en) Managing changes to one or more files via linked mapping records
CN105740333A (en) Visual advertisement management platform, and implementation method thereof
CN109284323A (en) The management method and device of detection data
US9727663B2 (en) Data store query prediction
CN108074033A (en) Processing method, system, electronic equipment and the storage medium of achievement data
CN114428822B (en) Data processing method and device, electronic equipment and storage medium
CN111159563A (en) Method, device and equipment for determining user interest point information and storage medium
US9727666B2 (en) Data store query
US8707262B2 (en) Code scoring
CN110928903A (en) Data extraction method and device, equipment and storage medium
CN108154024A (en) A kind of data retrieval method, device and electronic equipment
US20180121526A1 (en) Method, apparatus, and computer-readable medium for non-structured data profiling
CN109189810B (en) Query method, query device, electronic equipment and computer-readable storage medium
CN111144987A (en) Abnormal shopping behavior limiting method, limiting assembly and shopping system
US20110231360A1 (en) Persistent flow method to define transformation of metrics packages into a data store suitable for analysis by visualization
US20210397745A1 (en) Data providing server device and data providing method
CN110020166A (en) A kind of data analysing method and relevant device
CN114741392A (en) Data query method and device, electronic equipment and storage medium
CN113553341A (en) Multidimensional data analysis method, multidimensional data analysis device, multidimensional data analysis equipment and computer readable storage medium
CN115017185A (en) Data processing method, device and storage medium
CN113010208A (en) Version information generation method, version information generation device, version information generation equipment and storage medium
CN111143328A (en) Agile business intelligent data construction method, system, equipment and storage medium
CN111045983A (en) Nuclear power station electronic file management method and device, terminal equipment and medium

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant