CN111428090A - Method and device for realizing data processing, computer storage medium and terminal - Google Patents
Method and device for realizing data processing, computer storage medium and terminal Download PDFInfo
- Publication number
- CN111428090A CN111428090A CN202010162517.6A CN202010162517A CN111428090A CN 111428090 A CN111428090 A CN 111428090A CN 202010162517 A CN202010162517 A CN 202010162517A CN 111428090 A CN111428090 A CN 111428090A
- Authority
- CN
- China
- Prior art keywords
- data
- processing
- public opinion
- preset
- map information
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/90—Details of database functions independent of the retrieved data types
- G06F16/901—Indexing; Data structures therefor; Storage structures
- G06F16/9024—Graphs; Linked lists
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/90—Details of database functions independent of the retrieved data types
- G06F16/904—Browsing; Visualisation therefor
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06Q—INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
- G06Q10/00—Administration; Management
- G06Q10/06—Resources, workflows, human or project management; Enterprise or organisation planning; Enterprise or organisation modelling
- G06Q10/063—Operations research, analysis or management
- G06Q10/0637—Strategic management or analysis, e.g. setting a goal or target of an organisation; Planning actions based on goals; Analysis or evaluation of effectiveness of goals
Abstract
A method, a device, a computer storage medium and a terminal for realizing data processing comprise: processing the source data according to a preset logic model to generate asset data; fusing the generated asset data through one or more preset service topics to generate public opinion map information; wherein the assets data comprises: and data generated by the catalog constructed by the preset labels. The embodiment of the invention processes data through the logic model, thereby improving the processing efficiency of the service data.
Description
Technical Field
The present disclosure relates to, but not limited to, data processing technology, and more particularly, to a method, an apparatus, a computer storage medium, and a terminal for implementing data processing.
Background
In order to serve business deciders to make decisions, data warehouse construction is mainly based on established business data generated by a plurality of business dimensions.
At present, a data warehouse is difficult to rapidly adjust to obtain business data when a business model changes, and how to improve the obtaining efficiency of the business data becomes a technical problem to be solved.
Disclosure of Invention
The following is a summary of the subject matter described in detail herein. This summary is not intended to limit the scope of the claims.
Embodiments of the present invention provide a method, an apparatus, a computer storage medium, and a terminal for implementing data processing, which can improve the processing efficiency of service data.
The embodiment of the invention provides a method for realizing data processing, which comprises the following steps:
processing the source data according to a preset logic model to generate asset data;
fusing the generated asset data through one or more preset service topics to generate public opinion map information;
wherein the assets data comprises: and data generated by the catalog constructed by the preset labels.
In an exemplary embodiment, the public opinion map information includes information of one or any combination of the following: public opinion trend graph, public opinion emotion statistics and public opinion figure portraits.
In an exemplary embodiment, before the processing the source data according to the preset logical model, the method further includes:
editing the logical model through metadata;
wherein the editing comprises one or any combination of the following processes: adding, adjusting and deleting.
In an exemplary embodiment, the processing includes one or any combination of the following:
pooling, washing and standardization.
In an exemplary embodiment, when the source data includes data of one or more business systems, after the generating public opinion graph information, the method further includes:
acquiring event related parameters of one or more events from data of a business system from the public opinion map information;
comparing the acquired relevant parameters of each event with corresponding event index thresholds respectively;
and when the event related parameters are larger than the corresponding event index threshold values, feeding back the decision related information of the event in a preset mode.
In an exemplary embodiment, when the business topic is adjusted, after the generating public opinion map information, the method further includes:
and re-fusing the asset data according to the adjusted business theme.
On the other hand, the embodiment of the present invention further provides a computer storage medium, in which a computer program is stored, and the computer program, when executed by a processor, implements the above method for implementing data processing.
In another aspect, an embodiment of the present invention further provides a terminal, including: a memory and a processor, the memory having a computer program stored therein; wherein the content of the first and second substances,
the processor is configured to execute the computer program in the memory;
the computer program, when executed by the processor, implements a method of implementing data processing as described above.
In another aspect, an embodiment of the present invention further provides an apparatus for implementing data processing, where the apparatus includes: a processing unit and a generating unit; wherein the content of the first and second substances,
the processing unit is used for: processing the source data according to a preset logic model to generate asset data;
the generation unit is used for: fusing the generated asset data through one or more preset service topics to generate public opinion map information;
wherein the assets data comprises: and data generated by the catalog constructed by the preset labels.
In an exemplary embodiment, the apparatus further comprises an editing unit for:
editing the logical model through metadata;
wherein the editing comprises one or any combination of the following processes: adding, adjusting and deleting.
Compared with the related art, the technical scheme of the application comprises the following steps: processing the source data according to a preset logic model to generate asset data; fusing the generated asset data through one or more preset service topics to generate public opinion map information; wherein the assets data comprises: and data generated by the catalog constructed by the preset labels. The embodiment of the invention processes data through the logic model, thereby improving the processing efficiency of the service data.
Additional features and advantages of the invention will be set forth in the description which follows, and in part will be obvious from the description, or may be learned by practice of the invention. The objectives and other advantages of the invention will be realized and attained by the structure particularly pointed out in the written description and claims hereof as well as the appended drawings.
Drawings
The accompanying drawings are included to provide a further understanding of the invention and are incorporated in and constitute a part of this specification, illustrate embodiments of the invention and together with the example serve to explain the principles of the invention and not to limit the invention.
FIG. 1 is a flow chart of a method for implementing data processing according to an embodiment of the present invention;
fig. 2 is a block diagram of an apparatus for implementing data processing according to an embodiment of the present invention.
Detailed Description
In order to make the objects, technical solutions and advantages of the present invention more apparent, embodiments of the present invention will be described in detail below with reference to the accompanying drawings. It should be noted that the embodiments and features of the embodiments in the present application may be arbitrarily combined with each other without conflict.
The steps illustrated in the flow charts of the figures may be performed in a computer system such as a set of computer-executable instructions. Also, while a logical order is shown in the flow diagrams, in some cases, the steps shown or described may be performed in an order different than here.
Fig. 1 is a flowchart of a method for implementing data processing according to an embodiment of the present invention, as shown in fig. 1, including:
wherein the assets data comprises: data generated by a directory constructed by preset tags;
the logic model of the embodiment of the invention includes but is not limited to any one of the following existing models: a hierarchical data model, a mesh data model, a relational data model, or an object-oriented model, which are well-known definitions of those skilled in the art, are not described herein; the embodiment of the invention can be analyzed and set by a person skilled in the art according to the kind and structure of the source data to be used for processing the logical model of the source data.
In an exemplary embodiment, the processing includes one or any combination of the following:
pooling, washing and standardization.
With a data center as a processing platform of source data, assuming that aggregation, cleaning and standardization processing are performed on the source data, and an adopted logical model is any existing model of the above examples, such as a relational data model (data is abstracted into a structured two-dimensional table form), the processing process of the source data according to the embodiment of the present invention includes: the source data are converged to a data center station, and the data are converged to a convergence layer of the data center station through a relational data model; reading the data gathered in the gathering layer, cleaning the data according to a set cleaning rule, and storing the cleaned data according to a relational data model; and processing the stored cleaned data according to a set standardized format, and storing the data according to a relational data model. The embodiment of the invention synchronizes the edited logic model to each stage of aggregation, cleaning and standardization for physical modeling, and can process stock and incremental source data according to the edited logic model.
In an exemplary embodiment, before processing the source data according to the preset logical model, the method in an embodiment of the present invention further includes:
editing the logic model through metadata;
wherein editing comprises processing of one or any combination of the following: adding, adjusting and deleting.
The embodiment of the invention can be realized by editing the logic model through the metadata according to the conventional technical means of technicians in the field, for example, a plurality of parameters in the metadata define the newly added logic model, the logic model is adjusted by adjusting one or more parameters, the related parameters of the logic model are deleted, and the logic model is deleted; the logic model is edited according to the metadata, so that the processing efficiency of the source data when the logic model is changed is improved;
in an exemplary embodiment, source data of an embodiment of the present invention includes one or more of the following data: data of a business system, data of an industry theme forum and data of a public opinion website;
after the source data are processed through the logic model, a catalogue can be built based on the labels added to the data table and/or the fields, and the asset data are generated according to the built catalogue; the tag may include: data keywords, business topics, etc.
in an exemplary embodiment, the business topics of the embodiment of the present invention include, but are not limited to: procurement, sale, after-sale, inventory, etc.
In an exemplary embodiment, the public opinion map information includes information of one or any combination of the following: public opinion trend graph, public opinion emotion statistics and public opinion figure portraits. Taking the car sales system as an example, the public opinion map information of the embodiment of the present invention may include, but is not limited to: spare part sales and inventory statistical information, associated vehicle type statistical information and sales area statistical information, sales volume time dimension statistical information and sales volume area statistical information and the like.
It should be noted that, after determining the business topic, the embodiments of the present invention may refer to the related technology to fuse the generated asset data; for example, when the business topic is sales, the embodiment of the present invention may determine the sales information according to the catalogue of the capitalized data, and then fuse the sales information in the capitalized data by using a related technology to obtain public opinion map information related to sales, which is a conventional technical means of those skilled in the art and will not be described herein.
In one exemplary embodiment, when the assets-oriented data is fused, when the assets-oriented data comprises two or more identical data, one of the data is selected and reserved according to a preset strategy; in an exemplary embodiment, the reliability of the data may be determined based on the source of the data, in conjunction with empirical or historical information as is known in the art, with one of the pieces of data being retained based on the reliability of the data.
In an exemplary embodiment, after generating the public opinion graph information when the source data includes data of one or more business systems, a method according to an embodiment of the present invention further includes:
acquiring event related parameters of one or more events from data of a business system from public opinion map information;
comparing the acquired relevant parameters of each event with corresponding event index thresholds respectively;
and when the event related parameters are compared to be larger than the corresponding event index threshold values, the decision related information of the event is fed back in a preset mode.
The decision related information of the embodiment of the invention can comprise: the decision-making related information can help the management layer to reach consensus and make correct decisions such as after-sales, public opinion processing, regional policy adjustment and the like in response to the key information of the current event. Key information to cope with the current event includes but is not limited to: processing information of a previous event similar to the current event. In addition, the decision related information can be directly fed back to the management layer account through the service system, and can also be sent to the management layer through the mailbox and the instant messaging application. According to the embodiment of the invention, the event needing attention can be supervised by setting the event index threshold, and data support is provided for finding and deciding the related event.
In an exemplary embodiment, when the business topic is adjusted, after generating the public opinion map information, a method according to an embodiment of the present invention further includes:
and re-fusing the asset data according to the adjusted business theme.
The embodiment of the invention fuses the asset data again, and can quickly obtain the public opinion map information obtained corresponding to the adjusted business theme.
The application includes: processing the source data according to a preset logic model to generate asset data; fusing the generated asset data through one or more preset service topics to generate public opinion map information; wherein the assets data comprises: and data generated by the catalog constructed by the preset labels. The embodiment of the invention processes data through the logic model, thereby improving the processing efficiency of the service data.
The embodiment of the invention also provides a computer storage medium, wherein a computer program is stored in the computer storage medium, and the method for realizing data processing is realized when the computer program is executed by a processor.
An embodiment of the present invention further provides a terminal, including: a memory and a processor, the memory having a computer program stored therein; wherein the content of the first and second substances,
the processor is configured to execute the computer program in the memory;
the computer program, when executed by the processor, implements a method of implementing data processing as described above.
Fig. 2 is a block diagram of an apparatus for implementing data processing according to an embodiment of the present invention, as shown in fig. 2, including: a processing unit and a generating unit; wherein the content of the first and second substances,
the processing unit is used for: processing the source data according to a preset logic model to generate asset data;
the generation unit is used for: fusing the generated asset data through one or more preset service topics to generate public opinion map information;
wherein the assets data comprises: and data generated by the catalog constructed by the preset labels.
In an exemplary embodiment, the apparatus further comprises an editing unit for:
editing the logic model through metadata;
wherein editing comprises processing of one or any combination of the following: adding, adjusting and deleting.
In one exemplary embodiment, business topics include, but are not limited to: subject of purchase, sale, after-sale, inventory, etc.
In an exemplary embodiment, the processing unit is specifically configured to: processing the source data through a logic model, wherein the processing is performed by one or any combination of the following items: pooling, washing and standardization.
In an exemplary embodiment, the apparatus further comprises a feedback unit for:
acquiring event related parameters of one or more events related in data of a service system from public opinion map information;
comparing the acquired relevant parameters of each event with corresponding event index thresholds respectively;
and when the event related parameters are compared to be larger than the corresponding event index threshold values, the decision related information of the event is fed back in a preset mode.
The decision related information of the embodiment of the invention can comprise: the decision-making related information can help the management layer to reach consensus and make correct decisions such as after-sales, public opinion processing, regional policy adjustment and the like in response to the key information of the current event. Key information to cope with the current event includes but is not limited to: processing information of a previous event similar to the current event.
In an exemplary embodiment, the generating unit is further configured to:
and when the business theme is adjusted, re-fusing the asset data according to the adjusted business theme.
The application includes: processing the source data according to a preset logic model to generate asset data; fusing the generated asset data through one or more preset service topics to generate public opinion map information; wherein the assets data comprises: and data generated by the catalog constructed by the preset labels. The embodiment of the invention processes data through the logic model, thereby improving the processing efficiency of the service data.
"one of ordinary skill in the art will appreciate that all or some of the steps of the methods, systems, functional modules/units in the devices disclosed above may be implemented as software, firmware, hardware, and suitable combinations thereof. In a hardware implementation, the division between functional modules/units mentioned in the above description does not necessarily correspond to the division of physical components; for example, one physical component may have multiple functions, or one function or step may be performed by several physical components in cooperation. Some or all of the components may be implemented as software executed by a processor, such as a digital signal processor or microprocessor, or as hardware, or as an integrated circuit, such as an application specific integrated circuit. Such software may be distributed on computer readable media, which may include computer storage media (or non-transitory media) and communication media (or transitory media). The term computer storage media includes volatile and nonvolatile, removable and non-removable media implemented in any method or technology for storage of information such as computer readable instructions, data structures, program modules or other data, as is well known to those of ordinary skill in the art. Computer storage media includes, but is not limited to, RAM, ROM, EEPROM, flash memory or other memory technology, CD-ROM, Digital Versatile Disks (DVD) or other optical disk storage, magnetic cassettes, magnetic tape, magnetic disk storage or other magnetic storage devices, or any other medium which can be used to store the desired information and which can accessed by a computer. In addition, communication media typically embodies computer readable instructions, data structures, program modules or other data in a modulated data signal such as a carrier wave or other transport mechanism and includes any information delivery media "as is well known to those of ordinary skill in the art.
Claims (10)
1. A method of implementing data processing, comprising:
processing the source data according to a preset logic model to generate asset data;
fusing the generated asset data through one or more preset service topics to generate public opinion map information;
wherein the assets data comprises: and data generated by the catalog constructed by the preset labels.
2. The method of claim 1, wherein the public opinion graph information comprises information of one or any combination of the following: public opinion trend graph, public opinion emotion statistics and public opinion figure portraits.
3. The method of claim 1, wherein before processing the source data according to the preset logical model, the method further comprises:
editing the logical model through metadata;
wherein the editing comprises one or any combination of the following processes: adding, adjusting and deleting.
4. The method according to any one of claims 1 to 3, wherein the treatment comprises one or any combination of:
pooling, washing and standardization.
5. The method as claimed in any one of claims 1 to 3, wherein when the source data includes data of one or more business systems, after the generating public opinion map information, the method further comprises:
acquiring event related parameters of one or more events from data of a business system from the public opinion map information;
comparing the acquired relevant parameters of each event with corresponding event index thresholds respectively;
and when the event related parameters are larger than the corresponding event index threshold values, feeding back the decision related information of the event in a preset mode.
6. The method according to any one of claims 1 to 3, wherein when the business topic is adjusted, after the generating public opinion map information, the method further comprises:
and re-fusing the asset data according to the adjusted business theme.
7. A computer storage medium having stored thereon a computer program which, when executed by a processor, implements a method of implementing data processing as claimed in any one of claims 1 to 6.
8. A terminal, comprising: a memory and a processor, the memory having a computer program stored therein; wherein the content of the first and second substances,
the processor is configured to execute the computer program in the memory;
the computer program, when executed by the processor, implements a method of implementing data processing as recited in any of claims 1-6.
9. An apparatus for implementing data processing, comprising: a processing unit and a generating unit; wherein the content of the first and second substances,
the processing unit is used for: processing the source data according to a preset logic model to generate asset data;
the generation unit is used for: fusing the generated asset data through one or more preset service topics to generate public opinion map information;
wherein the assets data comprises: and data generated by the catalog constructed by the preset labels.
10. The apparatus according to claim 9, further comprising an editing unit configured to: editing the logical model through metadata;
wherein the editing comprises one or any combination of the following processes: adding, adjusting and deleting.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202010162517.6A CN111428090A (en) | 2020-03-10 | 2020-03-10 | Method and device for realizing data processing, computer storage medium and terminal |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202010162517.6A CN111428090A (en) | 2020-03-10 | 2020-03-10 | Method and device for realizing data processing, computer storage medium and terminal |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN111428090A true CN111428090A (en) | 2020-07-17 |
Family
ID=71547467
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202010162517.6A Pending CN111428090A (en) | 2020-03-10 | 2020-03-10 | Method and device for realizing data processing, computer storage medium and terminal |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN111428090A (en) |
Citations (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN109800278A (en) * | 2018-12-29 | 2019-05-24 | 亚信科技（南京）有限公司 | Data assets map application method, device, computer equipment and storage medium |
| CN110197280A (en) * | 2019-05-20 | 2019-09-03 | 中国银行股份有限公司 | A kind of knowledge mapping construction method, apparatus and system |
| CN110377696A (en) * | 2019-06-19 | 2019-10-25 | 新华智云科技有限公司 | A kind of commodity future news the analysis of public opinion method and system |
| US20190347668A1 (en) * | 2018-05-10 | 2019-11-14 | Hubspot, Inc. | Multi-client service system platform |
| CN110704455A (en) * | 2019-10-17 | 2020-01-17 | 北京中油瑞飞信息技术有限责任公司 | Method, device, terminal and storage medium for generating data asset directory |
| CN110866126A (en) * | 2019-11-22 | 2020-03-06 | 福建工程学院 | College online public opinion risk assessment method |
-
2020
- 2020-03-10 CN CN202010162517.6A patent/CN111428090A/en active Pending
Patent Citations (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20190347668A1 (en) * | 2018-05-10 | 2019-11-14 | Hubspot, Inc. | Multi-client service system platform |
| CN109800278A (en) * | 2018-12-29 | 2019-05-24 | 亚信科技（南京）有限公司 | Data assets map application method, device, computer equipment and storage medium |
| CN110197280A (en) * | 2019-05-20 | 2019-09-03 | 中国银行股份有限公司 | A kind of knowledge mapping construction method, apparatus and system |
| CN110377696A (en) * | 2019-06-19 | 2019-10-25 | 新华智云科技有限公司 | A kind of commodity future news the analysis of public opinion method and system |
| CN110704455A (en) * | 2019-10-17 | 2020-01-17 | 北京中油瑞飞信息技术有限责任公司 | Method, device, terminal and storage medium for generating data asset directory |
| CN110866126A (en) * | 2019-11-22 | 2020-03-06 | 福建工程学院 | College online public opinion risk assessment method |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN107944868A (en) | A kind of electronics deposit system and management method based on block chain intelligence contract | |
| CN111008069B (en) | Service processing method, device, computer equipment and storage medium | |
| CN101730099B (en) | Terminal management method based on authority control and device | |
| CN103577483A (en) | Data storage method, data storage system, data access method and data access system | |
| CN110888837A (en) | Object storage small file merging method and device | |
| JP2008519361A (en) | How to enforce application specific management policies on content addressed storage devices | |
| CN111083179A (en) | Internet of things cloud platform, and equipment interaction method and device based on same | |
| CN114066401A (en) | Order processing method, device, system, equipment and computer readable storage medium | |
| CN106095511A (en) | A kind of server updating method and apparatus | |
| CN105407005A (en) | Content distribution method and device | |
| CN111428090A (en) | Method and device for realizing data processing, computer storage medium and terminal | |
| CN110489416B (en) | Information storage method based on data processing and related equipment | |
| CN106570005A (en) | Database cleaning method and device | |
| CN107870978A (en) | Relational network topological method and application server | |
| CN103778231A (en) | Method and system for managing operation record information, of databank | |
| CN115129781A (en) | Data processing method and device, electronic equipment and storage medium | |
| CN108667893A (en) | Data recommendation method, device and electronic equipment | |
| CN110704450B (en) | Method and device for realizing data processing, computer storage medium and terminal | |
| CN109783559B (en) | Method and device for acquiring real estate transaction data, electronic equipment and storage medium | |
| CN110457332B (en) | Information processing method and related equipment | |
| CN115080504A (en) | File management method, terminal and storage medium | |
| CN111881134A (en) | Data warehouse management method and system | |
| US10019248B2 (en) | System and method for service matching of instant message software | |
| CN110837345A (en) | Bad block table storage method and device | |
| CN108595924A (en) | A kind of service authority management method, device, computer equipment and storage medium |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination |