CN109522133B - Data splicing method and device, electronic equipment and storage medium - Google Patents
Data splicing method and device, electronic equipment and storage medium Download PDFInfo
- Publication number
- CN109522133B CN109522133B CN201811437134.4A CN201811437134A CN109522133B CN 109522133 B CN109522133 B CN 109522133B CN 201811437134 A CN201811437134 A CN 201811437134A CN 109522133 B CN109522133 B CN 109522133B
- Authority
- CN
- China
- Prior art keywords
- data
- events
- splicing
- display page
- commodity display
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F9/00—Arrangements for program control, e.g. control units
- G06F9/06—Arrangements for program control, e.g. control units using stored programs, i.e. using an internal store of processing equipment to receive or retain programs
- G06F9/46—Multiprogramming arrangements
- G06F9/50—Allocation of resources, e.g. of the central processing unit [CPU]
- G06F9/5005—Allocation of resources, e.g. of the central processing unit [CPU] to service a request
- G06F9/5027—Allocation of resources, e.g. of the central processing unit [CPU] to service a request the resource being a machine, e.g. CPUs, Servers, Terminals
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06Q—INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
- G06Q30/00—Commerce
- G06Q30/02—Marketing; Price estimation or determination; Fundraising
- G06Q30/0201—Market modelling; Market analysis; Collecting market data
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F2209/00—Indexing scheme relating to G06F9/00
- G06F2209/50—Indexing scheme relating to G06F9/50
- G06F2209/5017—Task decomposition
Landscapes
- Engineering & Computer Science (AREA)
- Business, Economics & Management (AREA)
- Accounting & Taxation (AREA)
- Development Economics (AREA)
- Finance (AREA)
- Strategic Management (AREA)
- Theoretical Computer Science (AREA)
- Physics & Mathematics (AREA)
- Software Systems (AREA)
- Entrepreneurship & Innovation (AREA)
- General Physics & Mathematics (AREA)
- Game Theory and Decision Science (AREA)
- General Business, Economics & Management (AREA)
- Marketing (AREA)
- Economics (AREA)
- Data Mining & Analysis (AREA)
- General Engineering & Computer Science (AREA)
- Information Transfer Between Computers (AREA)
Abstract
The disclosure discloses a data splicing method, a data splicing device, electronic equipment and a storage medium. Wherein, the method comprises the following steps: acquiring monitoring data of at least two events triggered on each commodity display page; fragmenting the acquired monitoring data to obtain a preset number of fragmented data packets; and sending the fragment data packets to corresponding data splicing servers so that each data splicing server respectively performs data splicing on the monitoring data in the fragment data packets to obtain data splicing results. The data splicing method and the data splicing system solve the problems that according to a data splicing scheme in the prior art, when the data volume of monitored data is very large, server burden is large, server congestion is caused easily, the splicing and storage processes of the data are affected, the data splicing tasks can be distributed by fragmenting the data, each server only needs to be responsible for the corresponding data splicing tasks, server burden is small, server congestion can be avoided, and system stability is effectively improved.
Description
Technical Field
The present disclosure relates to data processing technologies, and in particular, to a data splicing method and apparatus, an electronic device, and a storage medium.
Background
After different commodity display pages are released, a plurality of events of each commodity display page are monitored, and monitoring data corresponding to the events are obtained. For example, click events, purchase events, and fee deduction events for each merchandise display page are monitored. In order to facilitate analysis and statistics of data of each commodity display page, all monitoring data corresponding to each commodity display page need to be spliced to form a data table, namely, a data table corresponding to each commodity display page.
In the prior art, the monitoring data of each commodity display page is usually obtained and then directly spliced. Because the data volume of the monitored data is huge, the server is heavy in load, the server is easy to jam, and the data processing and storing process is influenced.
Disclosure of Invention
The disclosure provides a data splicing method and device, electronic equipment and a storage medium, so that a data splicing task is distributed, server congestion is avoided, and system stability is improved.
In a first aspect, an embodiment of the present disclosure provides a data splicing method, including:
acquiring monitoring data of at least two events triggered on each commodity display page;
fragmenting the acquired monitoring data to obtain a preset number of fragmented data packets;
and sending the fragment data packets to corresponding data splicing servers so that each data splicing server respectively performs data splicing on the monitoring data in the fragment data packets to obtain data splicing results.
In the foregoing scheme, optionally, the fragmenting is performed on the acquired monitoring data to obtain fragmented data packets of a preset number, and includes:
determining the number of events triggered on each commodity display page;
aiming at each fragment data packet, distributing the monitoring data of all events triggered on the same commodity display page into the same fragment data packet;
summarizing the fragmented data packets to obtain a preset number of fragmented data packets; and the number of events corresponding to the monitoring data in the fragment data packet is equal to the number of events triggered on at least one commodity display page.
In the above scheme, optionally, the event includes a click event, a purchase event, and a fee deduction event;
determining the number of events triggered on each commodity display page, including:
respectively acquiring the number of click events, the number of purchase events and the number of fee deduction events triggered on each commodity display page, and summing the numbers;
and taking the summation result as the number of events triggered on each commodity display page.
In the foregoing scheme, optionally, the preset number is equal to the number of the data splicing servers.
In the foregoing scheme, optionally, before acquiring the monitoring data of at least two events triggered on each commodity display page, the method further includes:
monitoring at least two events triggered on each commodity display page to generate corresponding monitoring data;
and storing the monitoring data.
In the foregoing scheme, optionally, the method further includes:
and acquiring data splicing results generated by the data splicing servers, and storing the data splicing results.
In a second aspect, an embodiment of the present disclosure further provides a data splicing apparatus, including:
the data acquisition module is used for acquiring monitoring data of at least two events triggered on each commodity display page;
the data fragmentation module is used for fragmenting the acquired monitoring data to obtain a preset number of fragmented data packets;
and the data packet sending module is used for sending the fragment data packets to the corresponding data splicing servers so that the data splicing servers respectively perform data splicing on the monitoring data in the fragment data packets to obtain data splicing results.
In the foregoing scheme, optionally, the data slicing module includes:
the event quantity determining unit is used for determining the quantity of the events triggered on each commodity display page;
the data distribution unit is used for distributing the monitoring data of all events triggered on the same commodity display page to the same fragmented data packet aiming at each fragmented data packet;
the data packet summarizing unit is used for summarizing the fragmented data packets to obtain a preset number of fragmented data packets; and the number of events corresponding to the monitoring data in the fragment data packet is equal to the number of events triggered on at least one commodity display page.
In the above scheme, optionally, the event includes a click event, a purchase event, and a fee deduction event;
the event number determination unit includes:
the quantity summing subunit is used for respectively acquiring the quantity of click events, the quantity of purchase events and the quantity of fee deduction events triggered on each commodity display page and summing the quantities;
and the quantity determining subunit is used for taking the summation result as the quantity of the events triggered on each commodity display page.
In the foregoing scheme, optionally, the preset number is equal to the number of the data splicing servers.
In the foregoing scheme, optionally, the method further includes:
the data detection module is used for monitoring at least two events triggered on each commodity display page and generating corresponding monitoring data;
and the data storage module is used for storing the monitoring data.
In the foregoing scheme, optionally, the method further includes:
and the result storage module is used for acquiring the data splicing results generated by the data splicing servers and storing the data splicing results.
In a third aspect, an embodiment of the present disclosure further provides an electronic device, including:
one or more processors;
a storage device for storing one or more programs,
when the one or more programs are executed by the one or more processors, the one or more processors implement the data splicing method according to the embodiment of the present disclosure.
In a fourth aspect, the disclosed embodiments also provide a computer-readable storage medium, on which a computer program is stored, where the computer program, when executed by a processor, implements the data splicing method according to the disclosed embodiments.
The embodiment of the disclosure obtains monitoring data of at least two events triggered on each commodity display page, and then fragments the obtained monitoring data to obtain a preset number of fragment data packets, and sends the fragment data packets to corresponding data splicing servers, so that each data splicing server performs data splicing on the monitoring data in the fragment data packets respectively, and a data splicing result is obtained.
Drawings
Fig. 1 is a flowchart of a data splicing method provided in an embodiment of the present disclosure;
fig. 2 is a flowchart of a data splicing method provided in an embodiment of the present disclosure;
fig. 3 is a flowchart of a data splicing method provided in an embodiment of the present disclosure;
fig. 4 is a schematic structural diagram of a data splicing apparatus according to an embodiment of the present disclosure;
fig. 5 is a schematic structural diagram of an electronic device according to an embodiment of the present disclosure.
Detailed Description
The present disclosure is described in further detail below with reference to the accompanying drawings and examples. It is to be understood that the specific embodiments described herein are merely illustrative of the disclosure and are not limiting of the disclosure. It should be further noted that, for the convenience of description, only some of the structures relevant to the present disclosure are shown in the drawings, not all of them.
Fig. 1 is a flowchart of a data splicing method provided in an embodiment of the present disclosure, where the present embodiment is applicable to a case of splicing data, the method may be executed by a data splicing apparatus, the apparatus may be implemented in a software and/or hardware manner, and the apparatus may be configured in an electronic device, for example, a terminal device or a server. As shown in fig. 1, the method may include the steps of:
At least two events triggered on each commodity display page are monitored, and monitoring data corresponding to each event are generated. The monitoring data is data related to the event. The event can be a click event, a purchase event or a fee deduction event triggered on each commodity display page. The click event is an event related to a click operation of the user on each commodity display page. The monitoring data corresponding to the click event may include a click position and a click time at which the user performs a click operation on the goods presentation page. The purchase event is an event related to a purchase operation of the user on each merchandise display page. The monitoring data corresponding to the purchase event may include a payment time and a payment amount for the user to perform the purchase operation on the merchandise display page. The fee deduction event is an event for deducting fee based on the operation of the user on each commodity display page. The monitoring data corresponding to the purchase event may include a debit time and a debit amount.
And 102, fragmenting the acquired monitoring data to obtain a preset number of fragmented data packets.
After the monitoring data corresponding to each commodity display page is obtained, the obtained monitoring data are fragmented to obtain fragmented data packets with the preset number. Alternatively, the preset number may be equal to the number of data splicing servers. The data splicing server is used for splicing the monitoring data in the fragment data packet. That is, the number of the fragmented data packets is consistent with the number of the data splicing servers. Each data splicing server can acquire one fragment data packet for data splicing.
In a specific example, the number of events triggered on each commodity display page is determined according to the acquired monitoring data. And then, fragmenting the monitoring data based on the number of events triggered according to each commodity display page through a greedy algorithm: and distributing the monitoring data of all events triggered on the same commodity display page into the same fragment data packet, and enabling the difference value between the number of the events corresponding to the monitoring data in each fragment data packet to be within a preset difference value range. And summarizing the fragmented data packets to obtain a preset number of fragmented data packets.
The basic idea of the greedy algorithm is to proceed step by step from a certain initial solution of the problem, and according to a certain optimization measure, each step is required to ensure that a local optimal solution can be obtained. Only one data is considered in each step, and the selection of the data should meet the condition of local optimization. If the next data and partial optimal solution are no longer feasible solutions to join, the data is not added to the partial solution until all the data is enumerated, or the algorithm can no longer be added. According to the method and the device, the optimal scheme that the acquired monitoring data are segmented by means of greedy algorithm iterative computation is utilized, the monitoring data corresponding to the same commodity display page are distributed into the same segment data packet, and the number of events corresponding to the monitoring data in each segment data packet is basically consistent.
And 103, sending the fragmented data packets to corresponding data splicing servers, so that each data splicing server performs data splicing on the monitoring data in the fragmented data packets respectively to obtain data splicing results.
And sending the fragment data packet to a corresponding data splicing server. For example, the preset number is equal to the number of data splicing servers. The number of data splicing servers is 5. And sending the obtained 5 fragmented data packets to corresponding data splicing servers, so that each data splicing server obtains one fragmented data packet.
Data splicing is an operation of integrating several data stored in different cells (tables) into one cell (table) in a vertical direction. After each data splicing server acquires the fragment data packets, data splicing is carried out on the acquired monitoring data of the fragment data packets, and data splicing results are obtained.
In a specific example, the fragmented data packet sent to the data splicing server only includes monitoring data of all events triggered on one commodity display page. And the data splicing server for acquiring the fragment data packet performs data splicing on the acquired monitoring data of the fragment data packet to obtain a data splicing result of the commodity display page. Namely, all monitoring data corresponding to a commodity display page are spliced to obtain a data table corresponding to the commodity display page.
In another embodiment, the fragmented data packet sent to the data splicing server includes monitoring data of all events triggered on the multiple merchandise display pages. After the data splicing server of the fragment data packet acquires the monitoring data of the acquired fragment data packet, the monitoring data of all events triggered by a plurality of commodity display pages are distinguished according to the identification information of each commodity display page, and data splicing is respectively carried out to obtain the data splicing result corresponding to each commodity display page. That is, all the monitoring data of the plurality of commodity display pages included in the fragmented data packet are spliced to obtain a data table corresponding to each commodity display page.
Therefore, each data splicing server only needs to be responsible for the corresponding data splicing task, and the problems that when the data volume of the monitored data is huge, the server is overloaded, the server is blocked, and the data splicing and storing process is affected are solved.
In the technical scheme of the embodiment, by acquiring the monitoring data of at least two events triggered on each commodity display page, then the acquired monitoring data is fragmented to obtain a preset number of fragmented data packets, and the fragmented data packets are sent to corresponding data splicing servers, so that each data splicing server respectively performs data splicing on the monitoring data in the fragmented data packets to obtain data splicing results, and solves the problems that when the data volume of the monitoring data is huge in the data splicing scheme in the prior art, the server is heavy in burden, the server is easy to be jammed, the problems of data splicing and storing processes are influenced, the data splicing tasks can be distributed by fragmenting the data, each server only needs to be responsible for the corresponding data splicing tasks, the server burden is small, the server congestion can be avoided, and the stability of the system is effectively improved.
Fig. 2 is a flowchart of a data splicing method provided in an embodiment of the present disclosure, where this embodiment may be combined with various optional solutions in one or more embodiments, in this embodiment, the fragmenting the acquired monitoring data to obtain a preset number of fragmented data packets includes: determining the number of events triggered on each commodity display page; aiming at each fragment data packet, distributing the monitoring data of all events triggered on the same commodity display page into the same fragment data packet; summarizing the fragmented data packets to obtain a preset number of fragmented data packets; and the number of events corresponding to the monitoring data in the fragment data packet is equal to the number of events triggered on at least one commodity display page.
And before acquiring monitoring data of at least two events triggered on each commodity display page, the method may further include: monitoring at least two events triggered on each commodity display page to generate corresponding monitoring data; and storing the monitoring data.
And, further comprising: and acquiring data splicing results generated by the data splicing servers, and storing the data splicing results.
As shown in fig. 2, the method may include the steps of:
Wherein the monitoring data corresponding to each event is stored to a database.
And step 203, acquiring monitoring data of at least two events triggered on each commodity display page.
And step 204, determining the number of events triggered on each commodity display page.
After the monitoring data of at least two events triggered on each commodity display page are obtained, the monitoring data of at least two events triggered on each commodity display page are distinguished according to the identification information of each commodity display page, and then the number of the events triggered on each commodity display page is respectively determined.
For example, events include click events, purchase events, and debit events. According to the monitoring data of the click events, the purchase events and the fee deduction events triggered on a certain commodity display page, the number of the click events triggered on the commodity display page is 20, the number of the triggered purchase events is 15, and the number of the triggered fee deduction events is 5. The number of events triggered on the commodity display page is the sum of the number of the events. I.e. the number of events triggered on the merchandise display page is 40.
The monitoring data are segmented based on the number of events triggered by each commodity display page: and distributing the monitoring data of all events triggered on the same commodity display page into the same fragment data packet, and enabling the difference value between the number of the events corresponding to the monitoring data in each fragment data packet to be within a preset difference value range. That is, it is ensured that the monitoring data corresponding to the same commodity display page is distributed into the same fragmented data packet, and the number of events corresponding to the monitoring data in each fragmented data packet is substantially consistent.
After the monitoring data of at least two events triggered on each commodity display page are distributed to each fragment data packet, summarizing each fragment data packet to obtain a preset number of fragment data packets. The preset number is equal to the number of data splicing servers. The monitoring data of all events triggered on the same commodity display page are distributed into the same fragment data packet, so that the number of events corresponding to the monitoring data in the fragment data packet is equal to the number of events triggered on at least one commodity display page.
And step 207, sending the fragmented data packets to corresponding data splicing servers, so that each data splicing server performs data splicing on the monitoring data in the fragmented data packets respectively to obtain data splicing results.
And 208, acquiring the data splicing result generated by each data splicing server, and storing the data splicing result.
The data splicing results generated by the data splicing servers are obtained, and are stored in a unified mode, so that the data of the commodity display pages can be analyzed and counted subsequently.
According to the technical scheme, the number of the events triggered on each commodity display page is determined, the monitoring data of all the events triggered on the same commodity display page are distributed into the same fragment data packet for each fragment data packet, then the fragment data packets are collected to obtain the preset number of fragment data packets, the number of the events corresponding to the monitoring data in the fragment data packets is equal to the number of the events triggered on at least one commodity display page, the monitoring data can be fragmented according to the events triggered on each commodity display page, and therefore the data splicing task is distributed.
Fig. 3 is a flowchart of a data splicing method provided in an embodiment of the present disclosure, which may be combined with various alternatives in one or more embodiments described above, where in the embodiment, the event includes a click event, a purchase event, and a fee deduction event.
And determining the number of events triggered on each commodity display page, including: respectively acquiring the number of click events, the number of purchase events and the number of fee deduction events triggered on each commodity display page, and summing the numbers; and taking the summation result as the number of events triggered on each commodity display page.
As shown in fig. 3, the method may include the steps of:
In one embodiment, it is determined that the number of click events, the number of triggered purchase events and the number of triggered deduction events on a certain merchandise display page are 20, 15 and 5, respectively, according to the monitoring data of the click events, the purchase events and the deduction events triggered on the merchandise display page. The above numbers of events are summed and the result is 40.
And step 303, taking the summation result as the number of events triggered on each commodity display page.
And step 304, distributing the monitoring data of all events triggered on the same commodity display page to the same fragment data packet aiming at each fragment data packet.
And step 306, sending the fragmented data packets to corresponding data splicing servers, so that each data splicing server performs data splicing on the monitoring data in the fragmented data packets respectively to obtain data splicing results.
According to the technical scheme of the embodiment, the monitoring data of the click event, the purchase event and the fee deduction event triggered on each commodity display page are acquired, then the number of the click events, the number of the purchase events and the number of the fee deduction events triggered on each commodity display page are acquired respectively and summed, and the summed result is used as the number of the events triggered on each commodity display page, so that the monitoring data of the click event, the purchase event and the fee deduction event triggered on each commodity display page can be sliced, and therefore the data splicing task is distributed.
Fig. 4 is a schematic structural diagram of a data splicing apparatus provided in the embodiment of the present disclosure, which is applicable to a situation of splicing data. The apparatus can be implemented in software and/or hardware, and the apparatus can be configured in an electronic device. As shown in fig. 4, the apparatus may include: a data acquisition module 401, a data fragmentation module 402 and a data packet transmission module 403.
The data acquisition module 401 is configured to acquire monitoring data of at least two events triggered on each commodity display page; a data fragmentation module 402, configured to fragment the acquired monitoring data to obtain a preset number of fragmented data packets; the data packet sending module 403 is configured to send the fragmented data packets to corresponding data splicing servers, so that each data splicing server performs data splicing on the monitoring data in the fragmented data packets, respectively, to obtain a data splicing result.
In the technical scheme of the embodiment, by acquiring the monitoring data of at least two events triggered on each commodity display page, then the acquired monitoring data is fragmented to obtain a preset number of fragmented data packets, and the fragmented data packets are sent to corresponding data splicing servers, so that each data splicing server respectively performs data splicing on the monitoring data in the fragmented data packets to obtain data splicing results, and solves the problems that when the data volume of the monitoring data is huge in the data splicing scheme in the prior art, the server is heavy in burden, the server is easy to be jammed, the problems of data splicing and storing processes are influenced, the data splicing tasks can be distributed by fragmenting the data, each server only needs to be responsible for the corresponding data splicing tasks, the server burden is small, the server congestion can be avoided, and the stability of the system is effectively improved.
Optionally, on the basis of the foregoing technical solution, the data slicing module 402 may include: the event quantity determining unit is used for determining the quantity of the events triggered on each commodity display page; the data distribution unit is used for distributing the monitoring data of all events triggered on the same commodity display page to the same fragmented data packet aiming at each fragmented data packet; the data packet summarizing unit is used for summarizing the fragmented data packets to obtain a preset number of fragmented data packets; and the number of events corresponding to the monitoring data in the fragment data packet is equal to the number of events triggered on at least one commodity display page.
Optionally, on the basis of the above technical solution, the event includes a click event, a purchase event, and a fee deduction event; the event number determination unit may include: the quantity summing subunit is used for respectively acquiring the quantity of click events, the quantity of purchase events and the quantity of fee deduction events triggered on each commodity display page and summing the quantities; and the quantity determining subunit is used for taking the summation result as the quantity of the events triggered on each commodity display page.
Optionally, on the basis of the above technical solution, the preset number is equal to the number of the data splicing servers.
Optionally, on the basis of the above technical solution, the method may further include: the data detection module is used for monitoring at least two events triggered on each commodity display page and generating corresponding monitoring data; and the data storage module is used for storing the monitoring data.
Optionally, on the basis of the above technical solution, the method may further include: and the result storage module is used for acquiring the data splicing results generated by the data splicing servers and storing the data splicing results.
The data splicing device provided by the embodiment of the disclosure can execute the data splicing method provided by the embodiment of the disclosure, and has corresponding functional modules and beneficial effects of the execution method.
Referring now to fig. 5, a schematic diagram of an electronic device (e.g., a terminal device or a server) 500 suitable for use in implementing embodiments of the present disclosure is shown. The terminal device in the embodiments of the present disclosure may include, but is not limited to, a mobile terminal such as a mobile phone, a notebook computer, a digital broadcast receiver, a PDA (personal digital assistant), a PAD (tablet computer), a PMP (portable multimedia player), a vehicle terminal (e.g., a car navigation terminal), and the like, and a stationary terminal such as a digital TV, a desktop computer, and the like. The electronic device shown in fig. 5 is only an example, and should not bring any limitation to the functions and the scope of use of the embodiments of the present disclosure.
As shown in fig. 5, electronic device 500 may include a processing means (e.g., central processing unit, graphics processor, etc.) 501 that may perform various appropriate actions and processes in accordance with a program stored in a Read Only Memory (ROM)502 or a program loaded from a storage means 508 into a Random Access Memory (RAM) 503. In the RAM 503, various programs and data necessary for the operation of the electronic apparatus 500 are also stored. The processing device 501, the ROM 502, and the RAM 503 are connected to each other through a bus 504. An input/output (I/O) interface 505 is also connected to bus 504.
Generally, the following devices may be connected to the I/O interface 505: input devices 506 including, for example, a touch screen, touch pad, keyboard, mouse, camera, microphone, accelerometer, gyroscope, etc.; output devices 507 including, for example, a Liquid Crystal Display (LCD), speakers, vibrators, and the like; storage devices 508 including, for example, magnetic tape, hard disk, etc.; and a communication device 509. The communication means 509 may allow the electronic device 500 to communicate with other devices wirelessly or by wire to exchange data. While fig. 5 illustrates an electronic device 500 having various means, it is to be understood that not all illustrated means are required to be implemented or provided. More or fewer devices may alternatively be implemented or provided.
In particular, according to an embodiment of the present disclosure, the processes described above with reference to the flowcharts may be implemented as computer software programs. For example, embodiments of the present disclosure include a computer program product comprising a computer program embodied on a computer readable medium, the computer program comprising program code for performing the method illustrated in the flow chart. In such an embodiment, the computer program may be downloaded and installed from a network via the communication means 509, or installed from the storage means 508, or installed from the ROM 502. The computer program performs the above-described functions defined in the methods of the embodiments of the present disclosure when executed by the processing device 501.
It should be noted that the computer readable medium in the present disclosure can be a computer readable signal medium or a computer readable storage medium or any combination of the two. A computer readable storage medium may be, for example, but not limited to, an electronic, magnetic, optical, electromagnetic, infrared, or semiconductor system, apparatus, or device, or any combination of the foregoing. More specific examples of the computer readable storage medium may include, but are not limited to: an electrical connection having one or more wires, a portable computer diskette, a hard disk, a Random Access Memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), an optical fiber, a portable compact disc read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination of the foregoing. In the present disclosure, a computer readable storage medium may be any tangible medium that can contain, or store a program for use by or in connection with an instruction execution system, apparatus, or device. In contrast, in the present disclosure, a computer readable signal medium may comprise a propagated data signal with computer readable program code embodied therein, either in baseband or as part of a carrier wave. Such a propagated data signal may take many forms, including, but not limited to, electro-magnetic, optical, or any suitable combination thereof. A computer readable signal medium may also be any computer readable medium that is not a computer readable storage medium and that can communicate, propagate, or transport a program for use by or in connection with an instruction execution system, apparatus, or device. Program code embodied on a computer readable medium may be transmitted using any appropriate medium, including but not limited to: electrical wires, optical cables, RF (radio frequency), etc., or any suitable combination of the foregoing.
The computer readable medium may be embodied in the electronic device; or may exist separately without being assembled into the electronic device.
The computer readable medium carries one or more programs which, when executed by the electronic device, cause the electronic device to: acquiring monitoring data of at least two events triggered on each commodity display page; fragmenting the acquired monitoring data to obtain a preset number of fragmented data packets; and sending the fragment data packets to corresponding data splicing servers so that each data splicing server respectively performs data splicing on the monitoring data in the fragment data packets to obtain data splicing results.
Computer program code for carrying out operations for aspects of the present disclosure may be written in any combination of one or more programming languages, including an object oriented programming language such as Java, Smalltalk, C + +, and conventional procedural programming languages, such as the "C" programming language or similar programming languages. The program code may execute entirely on the user's computer, partly on the user's computer, as a stand-alone software package, partly on the user's computer and partly on a remote computer or entirely on the remote computer or server. In the case of a remote computer, the remote computer may be connected to the user's computer through any type of network, including a Local Area Network (LAN) or a Wide Area Network (WAN), or the connection may be made to an external computer (for example, through the Internet using an Internet service provider).
The flowchart and block diagrams in the figures illustrate the architecture, functionality, and operation of possible implementations of methods and computer program products according to various embodiments of the present disclosure. In this regard, each block in the flowchart or block diagrams may represent a module, segment, or portion of code, which comprises one or more executable instructions for implementing the specified logical function(s). It should also be noted that, in some alternative implementations, the functions noted in the block may occur out of the order noted in the figures. For example, two blocks shown in succession may, in fact, be executed substantially concurrently, or the blocks may sometimes be executed in the reverse order, depending upon the functionality involved. It will also be noted that each block of the block diagrams and/or flowchart illustration, and combinations of blocks in the block diagrams and/or flowchart illustration, can be implemented by special purpose hardware-based systems which perform the specified functions or acts, or combinations of special purpose hardware and computer instructions.
The modules and units described in the embodiments of the present disclosure may be implemented by software or hardware. The names of the modules and units do not limit the modules or units, for example, the data acquisition module may be further described as a "module for acquiring monitoring data of at least two events triggered on each merchandise display page", and the event number determination unit may be further described as a "unit for determining the number of events triggered on each merchandise display page".
The foregoing description is only exemplary of the preferred embodiments of the disclosure and is illustrative of the principles of the technology employed. It will be appreciated by those skilled in the art that the scope of the disclosure herein is not limited to the particular combination of features described above, but also encompasses other embodiments in which any combination of the features described above or their equivalents does not depart from the spirit of the disclosure. For example, the above features and (but not limited to) the features disclosed in this disclosure having similar functions are replaced with each other to form the technical solution.
Claims (8)
1. A method for data splicing, comprising:
acquiring monitoring data of at least two events triggered on each commodity display page, wherein the events comprise click events, purchase events and/or fee deduction events;
determining the number of events triggered on each commodity display page;
aiming at each fragment data packet, distributing the monitoring data of all events triggered on the same commodity display page into the same fragment data packet;
summarizing the fragment data packets to obtain a preset number of fragment data packets; the event number corresponding to the monitoring data in the fragment data packet is equal to the event number triggered on at least one commodity display page;
and sending the fragment data packets to corresponding data splicing servers so that each data splicing server respectively performs data splicing on the monitoring data in the fragment data packets to obtain data splicing results.
2. The method of claim 1, wherein the events include click events, purchase events, and debit events;
the determining the number of events triggered on each commodity display page includes:
respectively acquiring the number of click events, the number of purchase events and the number of fee deduction events triggered on each commodity display page, and summing the numbers;
and taking the summation result as the number of events triggered on each commodity display page.
3. The method of claim 1, wherein the preset number is equal to the number of data splicing servers.
4. The method of claim 1, prior to obtaining monitoring data for at least two events triggered at each merchandise display page, further comprising:
monitoring at least two events triggered on each commodity display page to generate corresponding monitoring data;
and storing the monitoring data.
5. The method of claim 1, further comprising:
and acquiring data splicing results generated by the data splicing servers, and storing the data splicing results.
6. A data stitching device, comprising:
the data acquisition module is used for acquiring monitoring data of at least two events triggered on each commodity display page, wherein the events comprise click events, purchase events and/or fee deduction events;
the data fragmentation module is used for fragmenting the acquired monitoring data to obtain a preset number of fragmented data packets;
the data packet sending module is used for sending the fragment data packets to corresponding data splicing servers so that each data splicing server can respectively perform data splicing on the monitoring data in the fragment data packets to obtain data splicing results;
the data slicing module comprises:
the event quantity determining unit is used for determining the quantity of the events triggered on each commodity display page;
the data distribution unit is used for distributing the monitoring data of all events triggered on the same commodity display page to the same fragmented data packet aiming at each fragmented data packet;
the data packet summarizing unit is used for summarizing the fragmented data packets to obtain a preset number of fragmented data packets; and the number of events corresponding to the monitoring data in the fragment data packet is equal to the number of events triggered on at least one commodity display page.
7. An electronic device, characterized in that the electronic device comprises:
one or more processors;
a storage device for storing one or more programs,
when executed by the one or more processors, cause the one or more processors to implement a data stitching method as claimed in any one of claims 1-5.
8. A computer-readable storage medium, on which a computer program is stored, which, when being executed by a processor, carries out the data stitching method according to one of the claims 1 to 5.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201811437134.4A CN109522133B (en) | 2018-11-28 | 2018-11-28 | Data splicing method and device, electronic equipment and storage medium |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201811437134.4A CN109522133B (en) | 2018-11-28 | 2018-11-28 | Data splicing method and device, electronic equipment and storage medium |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN109522133A CN109522133A (en) | 2019-03-26 |
| CN109522133B true CN109522133B (en) | 2020-10-02 |
Family
ID=65794782
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201811437134.4A Active CN109522133B (en) | 2018-11-28 | 2018-11-28 | Data splicing method and device, electronic equipment and storage medium |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN109522133B (en) |
Families Citing this family (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN112817965B (en) * | 2019-11-18 | 2023-10-17 | 百度在线网络技术（北京）有限公司 | Data splicing method and device, electronic equipment and storage medium |
Citations (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US6573091B1 (en) * | 1997-11-19 | 2003-06-03 | Nature Technology Corporation | Chimeric viral packaging signal without gag gene sequences |
| CN103226520A (en) * | 2013-04-02 | 2013-07-31 | 中国科学院信息工程研究所 | Self-adaptive cluster memory management method and server clustering system |
| CN104731569A (en) * | 2013-12-23 | 2015-06-24 | 华为技术有限公司 | Data processing method and relevant equipment |
| CN105354203A (en) * | 2014-08-21 | 2016-02-24 | 阿里巴巴集团控股有限公司 | Information display method and apparatus |
| CN106488330A (en) * | 2015-09-01 | 2017-03-08 | 天脉聚源（北京）科技有限公司 | A kind of Online Video trade shows method and system |
| US9830369B1 (en) * | 2013-05-14 | 2017-11-28 | Jsonar, Inc. | Processor for database analytics processing |
Family Cites Families (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US10169072B2 (en) * | 2009-09-23 | 2019-01-01 | Nvidia Corporation | Hardware for parallel command list generation |
| CN204375055U (en) * | 2015-02-03 | 2015-06-03 | 青岛易触数码科技有限公司 | A kind of automatic vending machine with handset Wechat shopping way |
| CN105068737B (en) * | 2015-07-29 | 2018-09-28 | 中国地质科学院地质力学研究所 | Multi-scale rock sectioning image manages the application method of system |
| KR101865845B1 (en) * | 2016-06-30 | 2018-07-23 | (주)블루와이즈 | System for promotion page production of custom-made |
-
2018
- 2018-11-28 CN CN201811437134.4A patent/CN109522133B/en active Active
Patent Citations (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US6573091B1 (en) * | 1997-11-19 | 2003-06-03 | Nature Technology Corporation | Chimeric viral packaging signal without gag gene sequences |
| CN103226520A (en) * | 2013-04-02 | 2013-07-31 | 中国科学院信息工程研究所 | Self-adaptive cluster memory management method and server clustering system |
| US9830369B1 (en) * | 2013-05-14 | 2017-11-28 | Jsonar, Inc. | Processor for database analytics processing |
| CN104731569A (en) * | 2013-12-23 | 2015-06-24 | 华为技术有限公司 | Data processing method and relevant equipment |
| CN105354203A (en) * | 2014-08-21 | 2016-02-24 | 阿里巴巴集团控股有限公司 | Information display method and apparatus |
| CN106488330A (en) * | 2015-09-01 | 2017-03-08 | 天脉聚源（北京）科技有限公司 | A kind of Online Video trade shows method and system |
Also Published As
| Publication number | Publication date |
|---|---|
| CN109522133A (en) | 2019-03-26 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN109299348B (en) | Data query method and device, electronic equipment and storage medium | |
| CN110213614B (en) | Method and device for extracting key frame from video file | |
| CN111784380B (en) | Advertisement putting attribution method and device | |
| CN111198859B (en) | Data processing method, device, electronic equipment and computer readable storage medium | |
| WO2020119231A1 (en) | Electronic certificate pushing method and apparatus based on position information, and electronic device | |
| CN112379982B (en) | Task processing method, device, electronic equipment and computer readable storage medium | |
| CN113505302A (en) | Method, device and system for supporting dynamic acquisition of buried point data and electronic equipment | |
| CN111596991A (en) | Interactive operation execution method and device and electronic equipment | |
| CN111163324A (en) | Information processing method and device and electronic equipment | |
| CN110008345A (en) | Platform service firm industry data aggregate analysis method, device, medium and equipment | |
| CN113297277B (en) | Test statistic determining method and device, readable medium and electronic equipment | |
| CN111581356A (en) | User behavior path analysis method and device | |
| CN110059064B (en) | Log file processing method and device and computer readable storage medium | |
| CN109902726B (en) | Resume information processing method and device | |
| CN109522133B (en) | Data splicing method and device, electronic equipment and storage medium | |
| CN111596992B (en) | Navigation bar display method and device and electronic equipment | |
| CN112884376A (en) | Work order processing method and device, electronic equipment and computer readable storage medium | |
| CN111274104B (en) | Data processing method, device, electronic equipment and computer readable storage medium | |
| CN111241368B (en) | Data processing method, device, medium and equipment | |
| CN113485890B (en) | Service monitoring method, device, equipment and storage medium for flight inquiry system | |
| CN110633182B (en) | System, method and device for monitoring server stability | |
| CN109614137B (en) | Software version control method, device, equipment and medium | |
| CN109542921B (en) | Data checking method and device, electronic equipment and storage medium | |
| CN112100159A (en) | Data processing method and device, electronic equipment and computer readable medium | |
| CN111092758A (en) | Method and device for reducing alarm and recovering false alarm and electronic equipment |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant | ||
| TR01 | Transfer of patent right |
Effective date of registration: 20210305 Address after: Room 802, Information Building, 13 Linyin North Street, Pinggu District, Beijing, 101299 Patentee after: Beijing youzhuju Network Technology Co.,Ltd. Address before: Room b-0035, 2 / F, building 3, yard 30, Shixing street, Shijingshan District, Beijing 100080 Patentee before: BEIJING BYTEDANCE NETWORK TECHNOLOGY Co.,Ltd. |
|
| TR01 | Transfer of patent right |