CN109345081A - A kind of collecting method, device and electronic equipment - Google Patents
A kind of collecting method, device and electronic equipment Download PDFInfo
- Publication number
- CN109345081A CN109345081A CN201811041165.8A CN201811041165A CN109345081A CN 109345081 A CN109345081 A CN 109345081A CN 201811041165 A CN201811041165 A CN 201811041165A CN 109345081 A CN109345081 A CN 109345081A
- Authority
- CN
- China
- Prior art keywords
- target data
- sub
- acquisition
- data
- collecting flowchart
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06Q—INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
- G06Q10/00—Administration; Management
- G06Q10/06—Resources, workflows, human or project management; Enterprise or organisation planning; Enterprise or organisation modelling
- G06Q10/063—Operations research, analysis or management
- G06Q10/0631—Resource planning, allocation, distributing or scheduling for enterprises or organisations
- G06Q10/06316—Sequencing of tasks or work
Abstract
This application discloses a kind of collecting method, device and electronic equipments, this method comprises: obtaining the target data collecting flowchart to match with the acquisition demand of the target data from preset data acquisition configuration strategy；Wherein, the target data collecting flowchart includes that at least one sub-step and at least one sub-step execute sequence, and at least there are a sub-steps, multiple subtasks comprising capableing of parallel processing at least one described sub-step；According to the sequence that executes of at least one sub-step, at least one subtask that every sub-steps include in the target data collecting flowchart is successively executed parallel, to complete the acquisition demand of target data.
Description
Technical field
This application involves field of computer technology more particularly to a kind of collecting methods, device and electronic equipment.
Background technique
Currently, developer can be acquired based on the data of data requirements side and be needed to acquire convenient for the data of data requirements side
Seek the data acquisition flow for formulating a set of customization.
In above-mentioned scene, when data requirements side proposes a kind of data acquisition demand, developer is required again
Formulate a set of data acquisition flow.
Obviously, the prior art all needs every time when the data for data requirements side acquire demand and formulate data acquisition flow
Labor intensive resource is wanted to go to develop.
Summary of the invention
The embodiment of the present application provides a kind of collecting method, device and electronic equipment, in the prior art to solve
Data Data acquisition method needs the problem of expending a large amount of human resources.
In order to solve the above technical problems, the embodiment of the present application is achieved in that
In a first aspect, proposing a kind of collecting method, comprising:
The number of targets to match with the acquisition demand of the target data is obtained from preset data acquisition configuration strategy
According to collecting flowchart；Wherein, the target data collecting flowchart includes at least one sub-step and at least one sub-step
Sequence is executed, and at least there are a sub-steps at least one described sub-step, multiple sons comprising capableing of parallel processing are appointed
Business；
According to the sequence that executes of at least one sub-step, successively execute parallel every in the target data collecting flowchart
At least one subtask that sub-steps include, to complete the acquisition demand of target data.
Second aspect proposes a kind of data acquisition device, comprising:
Acquiring unit obtains from preset data acquisition configuration strategy and matches with the acquisition demand of the target data
Target data collecting flowchart；Wherein, the target data collecting flowchart include at least one sub-step and it is described at least one
Sub-step executes sequence, and at least there are a sub-steps at least one described sub-step, comprising capableing of parallel processing
Multiple subtasks；
Execution unit successively executes the target data parallel and adopts according to the sequence that executes of at least one sub-step
At least one subtask that every sub-steps include in collection process, to complete the acquisition demand of target data.
The third aspect proposes a kind of electronic equipment, which includes:
Processor；And
It is arranged to the memory of storage computer executable instructions, the executable instruction makes the place when executed
It manages device and executes following operation:
The number of targets to match with the acquisition demand of the target data is obtained from preset data acquisition configuration strategy
According to collecting flowchart；Wherein, the target data collecting flowchart includes at least one sub-step and at least one sub-step
Sequence is executed, and at least there are a sub-steps at least one described sub-step, multiple sons comprising capableing of parallel processing are appointed
Business；
According to the sequence that executes of at least one sub-step, successively execute parallel every in the target data collecting flowchart
At least one subtask that sub-steps include, to complete the acquisition demand of target data.
Fourth aspect proposes a kind of computer readable storage medium, the computer-readable recording medium storage one
Or multiple programs, one or more of programs are when the electronic equipment for being included multiple application programs executes, so that the electricity
Sub- equipment executes following operation:
The number of targets to match with the acquisition demand of the target data is obtained from preset data acquisition configuration strategy
According to collecting flowchart；Wherein, the target data collecting flowchart includes at least one sub-step and at least one sub-step
Sequence is executed, and at least there are a sub-steps at least one described sub-step, multiple sons comprising capableing of parallel processing are appointed
Business；
According to the sequence that executes of at least one sub-step, successively execute parallel every in the target data collecting flowchart
At least one subtask that sub-steps include, to complete the acquisition demand of target data.
The embodiment of the present application at least can achieve following technical effects by adopting the above technical scheme:
Matched due to that can be obtained first from preset data acquisition configuration strategy with the acquisition demand of target data
Target data collecting flowchart, which includes at least one sub-step and the execution of at least one sub-step
Sequentially, and at least one sub-step at least there are a sub-steps, then multiple subtasks comprising capableing of parallel processing are pressed
According to the sequence that executes of at least one sub-step, successively every sub-steps include at least in parallel performance objective data acquisition flow
One subtask, to complete the acquisition demand of target data.
In this way after getting the target data acquisition demand of data requirements side's proposition, can acquire the data is needed
It asks and matches with preset data acquisition configuration strategy, obtain the data acquisition flow to match with data acquisition demand, and
The subtask that can include based on the sub-step and sub-step for including in the data acquisition flow, successively each height of parallel processing
Subtask in step, so that entire data acquisition does not need developer and requires efforts participations, while parallel processing is sub
Multiple subtasks in step also improve data acquisition efficiency.
Detailed description of the invention
The drawings described herein are used to provide a further understanding of the present application, constitutes part of this application, this Shen
Illustrative embodiments and their description please are not constituted an undue limitation on the present application for explaining the application.In the accompanying drawings:
Fig. 1 is a kind of implementation process schematic diagram for collecting method that this specification one embodiment provides；
Fig. 2 is that the collecting method that this specification one embodiment provides applies the realization stream in a kind of actual scene
Journey schematic diagram；
Fig. 3 is a kind of structural schematic diagram for data acquisition device that this specification one embodiment provides；
Fig. 4 is the structural schematic diagram for a kind of electronic equipment that this specification one embodiment provides.
Specific embodiment
To keep the purposes, technical schemes and advantages of the application clearer, below in conjunction with the application specific embodiment and
Technical scheme is clearly and completely described in corresponding attached drawing.Obviously, described embodiment is only the application one
Section Example, instead of all the embodiments.Based on the embodiment in the application, those of ordinary skill in the art are not doing
Every other embodiment obtained under the premise of creative work out, shall fall in the protection scope of this application.
Below in conjunction with attached drawing, the technical scheme provided by various embodiments of the present application will be described in detail.
To solve the problems, such as that Data Data acquisition method in the prior art needs to expend a large amount of human resources, this explanation
Book embodiment provides a kind of collecting method.This specification embodiment provide collecting method executing subject can with but
Being not limited to server etc. can be configured as executing at least one of party's subtraction unit provided in an embodiment of the present invention.
For ease of description, hereafter executing subject in this way is to be able to carry out for the server of this method, to the party
The embodiment of method is introduced.It is appreciated that it is a kind of illustrative explanation that the executing subject of this method, which is server, and
It should not be construed as the restriction to this method.
Specifically, a kind of realization of the recognition methods for low-carbon consumer behavior that this specification one or more embodiment provides
Flow diagram is as shown in Figure 1, comprising:
Step 110, the mesh to match with the acquisition demand of target data is obtained from preset data acquisition configuration strategy
Mark data acquisition flow；
Wherein, target data collecting flowchart includes the sequence that executes of at least one sub-step and at least one sub-step, and
At least there are a sub-steps, multiple subtasks comprising capableing of parallel processing at least one sub-step.
In the prior art, when user's data acquisition demand twice or several times is there are when some relevances, such as first
Secondary data acquisition demand be legal person A under one's name all companies (such as the tax information including company a, company b and company c), the
Secondary data acquisition demand is then senior executive's information of legal person A all companies under one's name, then number of the prior art for first time
Developer is then wanted to formulate respective data acquisition flow respectively according to acquisition demand and secondary data acquisition demand.Obviously,
Formulating twice in data acquisition flow, will first obtain legal person A under one's name and have which company (company a, company b and company c), then
Senior executive's information of the tax information and company a, company b and company c of acquisition company a, company b and company c.If formulating respectively
Two data acquisition flows, it is clear that the first step, which company acquisition legal person A has under one's name, and (company a, company b and company c) are to repeat
, then will have the waste of some resources, and the efficiency of data acquisition is lower.
Optionally, in order to solve this problem, this specification one or more embodiment is matched from the acquisition of preset data
After setting the target data collecting flowchart for obtaining in strategy and matching with the acquisition demand of target data, the target can also be determined
Whether adopted between data acquisition flow and historical data collecting flowchart with the presence or absence of some relevances or the target data
Collected.It specifically, can firstly, if there are relevances between target data collecting flowchart and historical data collecting flowchart
To be based on relevance, simplify target data collecting flowchart；Then, it is based on simplified target data collecting flowchart, to number of targets
According to being acquired, to complete the acquisition demand of target data.
Optionally, if there are relevances between target data collecting flowchart and historical data collecting flowchart, based on association
Property, simplify target data collecting flowchart, is associated with if existing between specific target data collecting flowchart and historical data collecting flowchart
Property, then can obtain that there are the sub-steps of relevance and right with target data collecting flowchart first from historical data collecting flowchart
The subtask answered；Then, based in historical data collecting flowchart with target data collecting flowchart there are the sub-step of relevance and
Corresponding subtask simplifies target data collecting flowchart.
Optionally, based on there are the sub-steps of relevance and right with target data collecting flowchart in historical data collecting flowchart
The subtask answered, simplify target data collecting flowchart, specifically can with firstly, obtain historical data collecting flowchart in target data
There are the implementing results of the sub-step of relevance and corresponding subtask for collecting flowchart；Based in historical data collecting flowchart with mesh
Marking data acquisition flow, there are the implementing results of the sub-step of relevance and corresponding subtask, simplify target data acquisition stream
Journey.
It is described in detail below with specific example based on relevance, simplifies the realization process of target data collecting flowchart.
Assuming that the acquisition demand of target data is to acquire the academic information of the legal person A senior executive of all companies under one's name, then base
In the acquisition demand of this target data, then can be obtained from preset data acquisition configuration strategy and the acquisition of the target data
The target data collecting flowchart that demand matches, it is assumed that the target data collecting flowchart includes:
Sub-step a1, obtains which company legal person A has under one's name, then sub-step a1 may include a subtask a11, i.e.,
Obtain which company legal person A has under one's name using information such as the names of legal person A as keyword；
Sub-step a2, the company obtained based on sub-step a1, it is assumed that there are company a, company b and public affairs in the company of legal person A under one's name
C is taken charge of, obtains in company a, company b and company c have which senior executive respectively, then sub-step a2 may include that 3 sons are appointed
(subtask a21, obtains which senior executive company a has, and subtask a22 obtains which senior executive company b has, and subtask a23 is obtained for business
Which senior executive company c has)；
Sub-step a3, the senior executive obtained based on sub-step a2, it is assumed that senior executive includes 1~senior executive of senior executive 12, then
The academic information of 1~senior executive of senior executive 12 is obtained respectively, then sub-step a3 may include that (subtask a31 is obtained for 12 subtasks
The academic information ... ... of senior executive 1, subtask a312 obtain the academic information of senior executive 12).
Assuming that historical data acquisition demand includes the tax information of legal person A all companies under one's name, then corresponding history number
Then include: according to collecting flowchart
Sub-step b1, obtains which company legal person A has under one's name, then sub-step b1 may include a subtask b11, i.e.,
Obtain which company legal person A has under one's name using information such as the names of legal person A as keyword；
Sub-step b2, the company obtained based on sub-step b1, it is assumed that there are company a, company b and public affairs in the company of legal person A under one's name
C is taken charge of, obtains the tax information of company a, company b and company c respectively, then sub-step b2 may include that (son is appointed for 3 subtasks
Be engaged in b21, obtains the tax information of company a, and subtask b22 obtains the tax information of company b, and subtask b23 obtains company c's
Tax information).
Obviously, above-mentioned sub-step a1 and corresponding subtask a11 is adopted with what sub-step b1 and corresponding subtask b11 was executed
Set task be it is identical, i.e., there are some relevances between above-mentioned target data collecting flowchart and historical data collecting flowchart, that
It is based on the relevance, can obtain that there are the sub-steps of relevance with target data collecting flowchart from historical data collecting flowchart
Rapid and corresponding subtask, i.e. sub-step b1 and corresponding subtask b11, it is then possible to based on there are the sub-steps of relevance
B1 and corresponding subtask b11, simplifies target data collecting flowchart.Historical data acquisition stream can specifically be directly acquired
With target data collecting flowchart there are the implementing result of the sub-step of relevance and corresponding subtask in journey, i.e. sub-step b1 and
The implementing result of corresponding subtask b11, is then based on the implementing result, simplifies to target data collecting flowchart
To execute sub-step a2 and corresponding subtask a21 on the basis of the implementing result of sub-step b1 and corresponding subtask b11
~a23 and sub-step a3 and corresponding subtask a31~a312, without being opened again from step a1 and corresponding subtask a11
Begin to execute.
It assumes again that, if the acquisition demand of target data is the company's information of legal person A under one's name, history can be called directly and adopted
The data of collection improve the efficiency of data acquisition to greatly save resource.
Optionally, for convenient for being next time that new data acquire demand and determine matched data acquisition flow, so that really
Can more it simplify in fixed data acquisition flow, not comprising the data that history acquired, then being based on simplified target
Data acquisition flow is acquired target data, can also be by target data after the acquisition demand to complete target data
And there are the corresponding historical datas of the history of relevance acquisition data flow to merge between target data collecting flowchart.
Continue by taking above-mentioned example as an example, is acquisition legal person A all companies under one's name in the acquisition demand for completing target data
After the academic information of senior executive, then the collection result of the target data and historical data collection result can be merged, i.e.,
Legal person A will be acquired, and there are the academic information of which senior executive and these senior executives and legal person A all companies under one's name in all companies under one's name
Tax information merges, and specifically can store in a file or database.So, if next time gets and the method again
After other relevant data of people A, the data newly obtained and these historical datas can also be merged.
It optionally, is the data acquisition flow convenient for being quickly determined for compliance with the acquisition demand of target data, this specification one
The collecting flowchart formulation that a or multiple embodiments can be in advance based on a large amount of historical data meets different data acquisition demand
Data acquisition flow pre-establishes out preset data acquisition configuration strategy, wrap in the preset data acquisition configuration strategy
Include the corresponding relationship of data acquisition demand and data acquisition flow, wherein include at least one sub-step in data acquisition flow
And at least one sub-step executes sequence, and at least there are a sub-steps at least one sub-step, comprising can be parallel
Multiple subtasks of processing.
Step 120, successively every in parallel performance objective data acquisition flow according to the sequence that executes of at least one sub-step
At least one subtask that sub-steps include, to complete the acquisition demand of target data.
Optionally, entire to promote in order to determine whether every sub-steps are completed its corresponding data acquisition session
Target data collecting flowchart, then including executing sub-step parallel for every sub-steps in target data collecting flowchart
At least one subtask after, can be firstly, obtaining the implementing result of sub-step at least one subtask for including；So
Afterwards, the implementing result at least one subtask for including by sub-step merges；Finally, having been determined if being based on amalgamation result
It, then can be with next sub-steps of performance objective data acquisition flow at the acquisition tasks of sub-step.
Specifically, will can include in every kind of data acquisition flow when formulating preset data acquisition configuration strategy
Each sub-steps set some acquisition targets, can specifically realize in the form of fields, for example different data acquire mesh
The corresponding different types of field of mark can then determine the acquisition for completing the sub-step when collecting the field of the condition of satisfaction
Target completes the acquisition tasks of the sub-step.
Below by taking Fig. 2 as an example, the collecting method application that this specification one or more embodiment provides is described in detail
Implementation process schematic diagram in actual scene, as shown in Fig. 2, including following key steps:
Step 21, the acquisition demand of target data is obtained；
Step 22, the mesh to match with the acquisition demand of the target data is obtained from preset data acquisition configuration strategy
Mark data acquisition flow；
Wherein, target data collecting flowchart includes the sequence that executes of at least one sub-step and at least one sub-step, and
At least there are a sub-steps, multiple subtasks comprising capableing of parallel processing at least one sub-step.
In order to improve the collecting efficiency of target data, simplifies the collecting flowchart of target data, acquired from preset data
After obtaining the target data collecting flowchart to match with the acquisition demand of the target data in configuration strategy, this can also be determined
It whether there is relevance between target data collecting flowchart and history collecting flowchart, if target data collecting flowchart and history acquire
There are relevances between process, then can be based on the relevance, simplify target data collecting flowchart.
In this case, then it can obtain to exist with target data collecting flowchart from historical data collecting flowchart and be associated with
Property sub-step and corresponding subtask, and obtain in the historical data collecting flowchart with target data collecting flowchart exist be associated with
The sub-step of property and the implementing result of corresponding subtask, can finally adopt in the historical data collecting flowchart with target data
Collect process there are on the basis of the sub-step of relevance and the implementing result of corresponding subtask to target data collecting flowchart into
Row simplifies.
Step 23, sequence is executed according at least one sub-step, started in parallel performance objective data acquisition flow
Multiple subtasks (i.e. subtask 11, subtask 12, subtask 13 ...) that one sub-steps include；
Step 24, the processing result for multiple subtasks that step 23 executes is merged into processing；
Step 25, the amalgamation result of the subtask based on step 24, it is determined whether the acquisition tasks of the sub-step are completed, if
The acquisition tasks for completing the sub-step then follow the steps 26, continue to execute step if the acquisition tasks for not completing the sub-step
23；
Step 26, next sub-steps are executed；
……
Step 27, the acquisition demand of target data is completed.
After determining the collection result for completing all sub-steps, these collection results are merged, to complete target
The acquisition demand of data.
Matched due to that can be obtained first from preset data acquisition configuration strategy with the acquisition demand of target data
Target data collecting flowchart, which includes at least one sub-step and the execution of at least one sub-step
Sequentially, and at least one sub-step at least there are a sub-steps, then multiple subtasks comprising capableing of parallel processing are pressed
According to the sequence that executes of at least one sub-step, successively every sub-steps include at least in parallel performance objective data acquisition flow
One subtask, to complete the acquisition demand of target data.
In this way after getting the target data acquisition demand of data requirements side's proposition, can acquire the data is needed
It asks and matches with preset data acquisition configuration strategy, obtain the data acquisition flow to match with data acquisition demand, and
The subtask that can include based on the sub-step and sub-step for including in the data acquisition flow, successively each height of parallel processing
Subtask in step, so that entire data acquisition does not need developer and requires efforts participations, while parallel processing is sub
Multiple subtasks in step also improve data acquisition efficiency.
Fig. 3 is the structural schematic diagram for the data acquisition device 300 that this specification provides.Referring to FIG. 3, real in a kind of software
It applies in mode, data acquisition device 300 may include acquiring unit 301, execution unit 302, in which:
Acquiring unit 301 obtains the acquisition demand phase with the target data from preset data acquisition configuration strategy
Matched target data collecting flowchart；Wherein, the target data collecting flowchart include at least one sub-step and it is described at least
One sub-steps execute sequence, and at least there are a sub-steps at least one described sub-step, comprising that can locate parallel
Multiple subtasks of reason；
Execution unit 302 successively executes the target data according to the sequence that executes of at least one sub-step parallel
At least one subtask that every sub-steps include in collecting flowchart, to complete the acquisition demand of target data.
Since acquiring unit 301 can obtain and the acquisition of target data first from preset data acquisition configuration strategy
The target data collecting flowchart that demand matches, the target data collecting flowchart include at least one sub-step and at least one son
Step executes sequence, and at least there are a sub-steps, multiple sons comprising capableing of parallel processing at least one sub-step
Task, then execution unit 302 can be according to the sequence that executes of at least one sub-step, successively parallel performance objective data acquisition
At least one subtask that every sub-steps include in process, to complete the acquisition demand of target data.
In this way after getting the target data acquisition demand of data requirements side's proposition, can acquire the data is needed
It asks and matches with preset data acquisition configuration strategy, obtain the data acquisition flow to match with data acquisition demand, and
The subtask that can include based on the sub-step and sub-step for including in the data acquisition flow, successively each height of parallel processing
Subtask in step, so that entire data acquisition does not need developer and requires efforts participations, while parallel processing is sub
Multiple subtasks in step also improve data acquisition efficiency.
Optionally, in one embodiment, for every sub-steps in the target data collecting flowchart, described
After execution unit 302 executes at least one subtask that the sub-step includes parallel, described device further include:
First acquisition unit 303 obtains the implementing result at least one subtask that the sub-step includes；
First combining unit 304, the implementing result at least one subtask that the sub-step includes is merged；
First execution unit 305 determines the acquisition tasks for completing the sub-step, then holds if being based on the amalgamation result
Next sub-steps of the row target data collecting flowchart.
Optionally, in one embodiment, it is obtained from preset data acquisition configuration strategy in the acquiring unit 301
After taking the target data collecting flowchart to match with the acquisition demand of the target data, described device further include:
Simplified element 306, if there are relevance between the target data collecting flowchart and historical data collecting flowchart,
Based on the relevance, simplify the target data collecting flowchart；
Acquisition unit 307 is based on the simplified target data collecting flowchart, adopts to the target data
Collection, to complete the acquisition demand of the target data.
Optionally, in one embodiment, the simplified element 306,
If there are relevances between the target data collecting flowchart and historical data collecting flowchart, from the history number
According to obtaining in collecting flowchart, there are the sub-steps of relevance and corresponding subtask with the target data collecting flowchart；
Based in the historical data collecting flowchart with the target data collecting flowchart there are the sub-step of relevance and
Corresponding subtask simplifies the target data collecting flowchart.
Optionally, in one embodiment, the simplified element 306,
Obtain in the historical data collecting flowchart with the target data collecting flowchart there are the sub-step of relevance and
The implementing result of corresponding subtask；
Based in the historical data collecting flowchart with the target data collecting flowchart there are the sub-step of relevance and
The implementing result of corresponding subtask simplifies the target data collecting flowchart.
Optionally, in one embodiment, the simplified target data is based in the simplified element 306
Collecting flowchart is acquired the target data, and after the acquisition demand to complete the target data, described device is also wrapped
It includes:
Second combining unit 308, by the target data and between the target data collecting flowchart exist be associated with
Property the corresponding historical data of history acquisition data flow merge.
It optionally, in one embodiment, include that data acquire demand in the preset data acquisition configuration strategy
With the corresponding relationship of data acquisition flow, wherein in data acquisition flow include at least one sub-step and it is described at least one
Sub-step executes sequence, and at least there are a sub-steps at least one described sub-step, comprising capableing of parallel processing
Multiple subtasks.
The method that data acquisition device 300 can be realized the embodiment of the method for FIG. 1 to FIG. 2, specifically refers to FIG. 1 to FIG. 2
The collecting method of illustrated embodiment, repeats no more.
Fig. 4 is the structural schematic diagram for the electronic equipment that one embodiment of this specification provides.Referring to FIG. 4, in hardware
Level, the electronic equipment include processor, optionally further comprising internal bus, network interface, memory.Wherein, memory can
It can include memory, such as high-speed random access memory (Random-Access Memory, RAM), it is also possible to further include non-easy
The property lost memory (non-volatile memory), for example, at least 1 magnetic disk storage etc..Certainly, which is also possible to
Including hardware required for other business.
Processor, network interface and memory can be connected with each other by internal bus, which can be ISA
(Industry Standard Architecture, industry standard architecture) bus, PCI (Peripheral
Component Interconnect, Peripheral Component Interconnect standard) bus or EISA (Extended Industry Standard
Architecture, expanding the industrial standard structure) bus etc..The bus can be divided into address bus, data/address bus, control always
Line etc..Only to be indicated with a four-headed arrow in Fig. 4, it is not intended that an only bus or a type of convenient for indicating
Bus.
Memory, for storing program.Specifically, program may include program code, and said program code includes calculating
Machine operational order.Memory may include memory and nonvolatile memory, and provide instruction and data to processor.
Processor is from the then operation into memory of corresponding computer program is read in nonvolatile memory, in logical layer
Data acquisition device is formed on face.Processor executes the program that memory is stored, and is specifically used for executing following operation:
Request is identified in response to the low-carbon goods for consumption of the user, obtains the image of the goods for consumption of the scanning input
Information；
The number of targets to match with the acquisition demand of the target data is obtained from preset data acquisition configuration strategy
According to collecting flowchart；Wherein, the target data collecting flowchart includes at least one sub-step and at least one sub-step
Sequence is executed, and at least there are a sub-steps at least one described sub-step, multiple sons comprising capableing of parallel processing are appointed
Business；
According to the sequence that executes of at least one sub-step, successively execute parallel every in the target data collecting flowchart
At least one subtask that sub-steps include, to complete the acquisition demand of target data.
Collecting method disclosed in the above-mentioned FIG. 1 to FIG. 2 illustrated embodiment such as this specification can be applied in processor,
Or it is realized by processor.Processor may be a kind of IC chip, the processing capacity with signal.In the process of realization
In, each step of the above method can be complete by the integrated logic circuit of the hardware in processor or the instruction of software form
At.Above-mentioned processor can be general processor, including central processing unit (Central Processing Unit, CPU),
Network processing unit (Network Processor, NP) etc.；It can also be digital signal processor (Digital Signal
Processor, DSP), it is specific integrated circuit (Application Specific Integrated Circuit, ASIC), existing
It is field programmable gate array (Field-Programmable Gate Array, FPGA) or other programmable logic device, discrete
Door or transistor logic, discrete hardware components.It may be implemented or execute in this specification one or more embodiment
Disclosed each method, step and logic diagram.General processor can be microprocessor or the processor is also possible to appoint
What conventional processor etc..The step of method in conjunction with disclosed in this specification one or more embodiment, can be embodied directly in
Hardware decoding processor executes completion, or in decoding processor hardware and software module combination execute completion.Software mould
Block can be located at random access memory, flash memory, read-only memory, programmable read only memory or electrically erasable programmable storage
In the storage medium of this fields such as device, register maturation.The storage medium is located at memory, and processor reads the letter in memory
Breath, in conjunction with the step of its hardware completion above method.
The electronic equipment can also carry out the collecting method of FIG. 1 to FIG. 2, and details are not described herein for this specification.
Certainly, other than software realization mode, other implementations are not precluded in the electronic equipment of this specification, such as
Logical device or the mode of software and hardware combining etc., that is to say, that the executing subject of following process flow is not limited to each
Logic unit is also possible to hardware or logical device.
In short, being not intended to limit the protection of this specification the foregoing is merely the preferred embodiment of this specification
Range.With within principle, made any modification, changes equivalent replacement all spirit in this specification one or more embodiment
Into etc., it should be included within the protection scope of this specification one or more embodiment.
System, device, module or the unit that above-described embodiment illustrates can specifically realize by computer chip or entity,
Or it is realized by the product with certain function.It is a kind of typically to realize that equipment is computer.Specifically, computer for example may be used
Think personal computer, laptop computer, cellular phone, camera phone, smart phone, personal digital assistant, media play
It is any in device, navigation equipment, electronic mail equipment, game console, tablet computer, wearable device or these equipment
The combination of equipment.
Computer-readable medium includes permanent and non-permanent, removable and non-removable media can be by any method
Or technology come realize information store.Information can be computer readable instructions, data structure, the module of program or other data.
The example of the storage medium of computer includes, but are not limited to phase change memory (PRAM), static random access memory (SRAM), moves
State random access memory (DRAM), other kinds of random access memory (RAM), read-only memory (ROM), electric erasable
Programmable read only memory (EEPROM), flash memory or other memory techniques, read-only disc read only memory (CD-ROM) (CD-ROM),
Digital versatile disc (DVD) or other optical storage, magnetic cassettes, tape magnetic disk storage or other magnetic storage devices
Or any other non-transmission medium, can be used for storage can be accessed by a computing device information.As defined in this article, it calculates
Machine readable medium does not include temporary computer readable media (transitory media), such as the data-signal and carrier wave of modulation.
It should also be noted that, the terms "include", "comprise" or its any other variant are intended to nonexcludability
It include so that the process, method, commodity or the equipment that include a series of elements not only include those elements, but also to wrap
Include other elements that are not explicitly listed, or further include for this process, method, commodity or equipment intrinsic want
Element.In the absence of more restrictions, the element limited by sentence "including a ...", it is not excluded that including described want
There is also other identical elements in the process, method of element, commodity or equipment.
All the embodiments in this specification are described in a progressive manner, same and similar portion between each embodiment
Dividing may refer to each other, and each embodiment focuses on the differences from other embodiments.Especially for system reality
For applying example, since it is substantially similar to the method embodiment, so being described relatively simple, related place is referring to embodiment of the method
Part explanation.
Claims (10)
1. a kind of collecting method, comprising:
The target data to match with the acquisition demand of the target data is obtained from preset data acquisition configuration strategy to adopt
Collect process；Wherein, the target data collecting flowchart includes the execution of at least one sub-step and at least one sub-step
Sequentially, and at least one described sub-step at least there are a sub-steps, multiple subtasks comprising capableing of parallel processing；
According to the sequence that executes of at least one sub-step, every height in the target data collecting flowchart is successively executed parallel
At least one subtask that step includes, to complete the acquisition demand of target data.
2. the method as described in claim 1 is executing every sub-steps in the target data collecting flowchart parallel
After at least one subtask that the sub-step includes, the method also includes:
Obtain the implementing result at least one subtask that the sub-step includes；
The implementing result at least one subtask that the sub-step includes is merged；
If being based on the amalgamation result, the acquisition tasks for completing the sub-step are determined, then execute the target data acquisition stream
Next sub-steps of journey.
3. the method as described in claim 1 is obtaining and the target data from preset data acquisition configuration strategy
After the target data collecting flowchart that acquisition demand matches, the method also includes:
If there are relevances between the target data collecting flowchart and historical data collecting flowchart, it is based on the relevance,
Simplify the target data collecting flowchart；
Based on the simplified target data collecting flowchart, the target data is acquired, to complete the mesh
Mark the acquisition demand of data.
4. method as claimed in claim 3, if existing between the target data collecting flowchart and historical data collecting flowchart
Relevance is then based on the relevance, simplifies the target data collecting flowchart, comprising:
If there are relevances between the target data collecting flowchart and historical data collecting flowchart, adopted from the historical data
Collecting acquisition in process, there are the sub-steps of relevance and corresponding subtask with the target data collecting flowchart；
Based on there are the sub-steps of relevance and corresponding with the target data collecting flowchart in the historical data collecting flowchart
Subtask, simplify the target data collecting flowchart.
5. method as claimed in claim 4 is based in the historical data collecting flowchart and the target data collecting flowchart
There are the sub-steps of relevance and corresponding subtask, simplify the target data collecting flowchart, comprising:
Obtain in the historical data collecting flowchart that there are the sub-steps of relevance and corresponding with the target data collecting flowchart
Subtask implementing result；
Based on there are the sub-steps of relevance and corresponding with the target data collecting flowchart in the historical data collecting flowchart
Subtask implementing result, simplify the target data collecting flowchart.
6. method as claimed in claim 3 is being based on the simplified target data collecting flowchart, to the target
Data are acquired, after the acquisition demand to complete the target data, the method also includes:
There are the history of relevance to acquire data flow by the target data and between the target data collecting flowchart
Corresponding historical data merges.
It include that data acquire 7. the method as described in any in claim 1~6, in the preset data acquisition configuration strategy
The corresponding relationship of demand and data acquisition flow, wherein in data acquisition flow include at least one sub-step and it is described at least
One sub-steps execute sequence, and at least there are a sub-steps at least one described sub-step, comprising that can locate parallel
Multiple subtasks of reason.
8. a kind of data acquisition device, comprising:
Acquiring unit obtains the mesh to match with the acquisition demand of the target data from preset data acquisition configuration strategy
Mark data acquisition flow；Wherein, the target data collecting flowchart includes at least one sub-step and at least one described sub-step
Rapid executes sequence, and at least there are a sub-steps at least one described sub-step, comprising capableing of the multiple of parallel processing
Subtask；
Execution unit successively executes the target data acquisition stream according to the sequence that executes of at least one sub-step parallel
At least one subtask that every sub-steps include in journey, to complete the acquisition demand of target data.
9. a kind of electronic equipment, comprising:
Processor；And
It is arranged to the memory of storage computer executable instructions, the executable instruction makes the processor when executed
Execute following operation:
Obtain the acquisition demand of target data；
Based on the feature of the target data, the relevance of the target data and history acquisition data is determined；
Data acquisition flow corresponding with the acquisition demand of the target data is obtained from preset data acquisition configuration strategy；
Wherein, the preset data acquisition configuration strategy includes the corresponding relationship of data acquisition demand and data acquisition flow；
Based on the target data and the history acquisition relevance of data and corresponding with the acquisition demand of the target data
Data acquisition flow determines the data acquisition flow of the target data.
10. a kind of computer readable storage medium, the computer-readable recording medium storage one or more program, described one
A or multiple programs are when the electronic equipment for being included multiple application programs executes, so that the electronic equipment executes following behaviour
Make:
Obtain the acquisition demand of target data；
Based on the feature of the target data, the relevance of the target data and history acquisition data is determined；
Data acquisition flow corresponding with the acquisition demand of the target data is obtained from preset data acquisition configuration strategy；
Wherein, the preset data acquisition configuration strategy includes the corresponding relationship of data acquisition demand and data acquisition flow；
Based on the target data and the history acquisition relevance of data and corresponding with the acquisition demand of the target data
Data acquisition flow determines the data acquisition flow of the target data.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201811041165.8A CN109345081B (en) | 2018-09-07 | 2018-09-07 | Data acquisition method and device and electronic equipment |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201811041165.8A CN109345081B (en) | 2018-09-07 | 2018-09-07 | Data acquisition method and device and electronic equipment |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN109345081A true CN109345081A (en) | 2019-02-15 |
| CN109345081B CN109345081B (en) | 2021-10-29 |
Family
ID=65304889
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201811041165.8A Active CN109345081B (en) | 2018-09-07 | 2018-09-07 | Data acquisition method and device and electronic equipment |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN109345081B (en) |
Cited By (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN112738137A (en) * | 2021-03-30 | 2021-04-30 | 深圳红途创程科技有限公司 | Data acquisition and link processing method and device, computer equipment and storage medium |
| CN114242192A (en) * | 2021-11-24 | 2022-03-25 | 长沙都正生物科技股份有限公司 | Clinical test data acquisition method and device and terminal equipment |
| CN116320019A (en) * | 2023-05-16 | 2023-06-23 | 荣耀终端有限公司 | Data acquisition method, medium and electronic equipment |
Citations (10)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101840432A (en) * | 2010-05-11 | 2010-09-22 | 同方知网(北京)技术有限公司 | Data mining device based on Deep Web deep dynamic data and method thereof |
| CN103927367A (en) * | 2014-04-22 | 2014-07-16 | 上海数据分析与处理技术研究所 | Microblog acquisition system and method based on events |
| CN104063411A (en) * | 2013-09-12 | 2014-09-24 | 江苏金鸽网络科技有限公司 | Enterprise intelligence gathering method based on Michael Porter's Five Forces Model |
| CN104239048A (en) * | 2014-09-09 | 2014-12-24 | 中国长江三峡集团公司 | Multiplexing method for business logics of Oracle Forms information system |
| CN105204922A (en) * | 2014-06-30 | 2015-12-30 | 金电联行（北京）信息技术有限公司 | Collecting method of client terminal of data collecting platform |
| US20160041843A1 (en) * | 2009-08-03 | 2016-02-11 | Oracle International Corporation | Invocation of web services based on a policy file including processes of workflow associated with user roles |
| CN107018046A (en) * | 2017-06-06 | 2017-08-04 | 上海鋆创信息技术有限公司 | A kind of collecting method, device, terminal and storage medium |
| CN107274023A (en) * | 2017-06-20 | 2017-10-20 | 阿里巴巴集团控股有限公司 | Flow of insuring generation method, insure request processing method and device and electronic equipment |
| CN107679700A (en) * | 2017-09-08 | 2018-02-09 | 阿里巴巴集团控股有限公司 | Business flow processing method, apparatus and server |
| CN108256716A (en) * | 2016-12-29 | 2018-07-06 | 同方威视技术股份有限公司 | The method and apparatus of flow and/or atom flow is configured/performed based on table |
-
2018
- 2018-09-07 CN CN201811041165.8A patent/CN109345081B/en active Active
Patent Citations (10)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20160041843A1 (en) * | 2009-08-03 | 2016-02-11 | Oracle International Corporation | Invocation of web services based on a policy file including processes of workflow associated with user roles |
| CN101840432A (en) * | 2010-05-11 | 2010-09-22 | 同方知网(北京)技术有限公司 | Data mining device based on Deep Web deep dynamic data and method thereof |
| CN104063411A (en) * | 2013-09-12 | 2014-09-24 | 江苏金鸽网络科技有限公司 | Enterprise intelligence gathering method based on Michael Porter's Five Forces Model |
| CN103927367A (en) * | 2014-04-22 | 2014-07-16 | 上海数据分析与处理技术研究所 | Microblog acquisition system and method based on events |
| CN105204922A (en) * | 2014-06-30 | 2015-12-30 | 金电联行（北京）信息技术有限公司 | Collecting method of client terminal of data collecting platform |
| CN104239048A (en) * | 2014-09-09 | 2014-12-24 | 中国长江三峡集团公司 | Multiplexing method for business logics of Oracle Forms information system |
| CN108256716A (en) * | 2016-12-29 | 2018-07-06 | 同方威视技术股份有限公司 | The method and apparatus of flow and/or atom flow is configured/performed based on table |
| CN107018046A (en) * | 2017-06-06 | 2017-08-04 | 上海鋆创信息技术有限公司 | A kind of collecting method, device, terminal and storage medium |
| CN107274023A (en) * | 2017-06-20 | 2017-10-20 | 阿里巴巴集团控股有限公司 | Flow of insuring generation method, insure request processing method and device and electronic equipment |
| CN107679700A (en) * | 2017-09-08 | 2018-02-09 | 阿里巴巴集团控股有限公司 | Business flow processing method, apparatus and server |
Non-Patent Citations (1)
| Title |
|---|
| 张晓翊 等: ""基于Multi_Agent的竞争情报智能采集模型研究"", 《情报科学》 * |
Cited By (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN112738137A (en) * | 2021-03-30 | 2021-04-30 | 深圳红途创程科技有限公司 | Data acquisition and link processing method and device, computer equipment and storage medium |
| CN112738137B (en) * | 2021-03-30 | 2021-06-11 | 深圳红途创程科技有限公司 | Data acquisition and link processing method and device, computer equipment and storage medium |
| CN114242192A (en) * | 2021-11-24 | 2022-03-25 | 长沙都正生物科技股份有限公司 | Clinical test data acquisition method and device and terminal equipment |
| CN116320019A (en) * | 2023-05-16 | 2023-06-23 | 荣耀终端有限公司 | Data acquisition method, medium and electronic equipment |
| CN116320019B (en) * | 2023-05-16 | 2023-10-27 | 荣耀终端有限公司 | Data acquisition method, medium and electronic equipment |
Also Published As
| Publication number | Publication date |
|---|---|
| CN109345081B (en) | 2021-10-29 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN109347787B (en) | Identity information identification method and device | |
| TWI743773B (en) | Method and device for identifying abnormal collection behavior based on privacy data protection | |
| WO2020253059A1 (en) | Method and apparatus for implementing multi-stage linkage drop-down box, and computer device | |
| TWI764148B (en) | Risk prediction and training method, device and electronic device for risk prediction model | |
| CN107644286A (en) | Workflow processing method and device | |
| CN108563680A (en) | Resource recommendation method and device | |
| CN109345081A (en) | A kind of collecting method, device and electronic equipment | |
| CN108550046A (en) | A kind of resource and market recommendation method, apparatus and electronic equipment | |
| CN109408522A (en) | A kind of update method and device of user characteristic data | |
| CN110674188A (en) | Feature extraction method, device and equipment | |
| CN110175201A (en) | Business data processing method, system, device and electronic equipment | |
| TW202032466A (en) | User age prediction method, apparatus, and device | |
| US10762089B2 (en) | Open ended question identification for investigations | |
| CN114996125A (en) | Test case generation method, device, equipment and storage medium | |
| WO2013173194A1 (en) | A user recommendation method and device | |
| CN113343109A (en) | List recommendation method, computing device and computer storage medium | |
| CN113408254A (en) | Page form information filling method, device, equipment and readable medium | |
| CN111177562B (en) | Recommendation ordering processing method and device for target object and server | |
| US20150331889A1 (en) | Method of Image Tagging for Identifying Regions and Behavior Relationship between Different Objects | |
| CN112258295A (en) | Recording processing method, device and equipment | |
| US20200090245A1 (en) | Touch and Pressure-Based Apparel Image Searching | |
| CN110020780A (en) | The method, apparatus and electronic equipment of information output | |
| CN109542775A (en) | A kind of generation and execution method and device of test script | |
| CN111461346B (en) | Network node characterization method, device and equipment | |
| CN114331602A (en) | Model training method based on transfer learning, information recommendation method and device |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| TA01 | Transfer of patent application right | ||
| TA01 | Transfer of patent application right |
Effective date of registration: 20200924 Address after: Cayman Enterprise Centre, 27 Hospital Road, George Town, Grand Cayman, British Islands Applicant after: Innovative advanced technology Co.,Ltd. Address before: Cayman Enterprise Centre, 27 Hospital Road, George Town, Grand Cayman, British Islands Applicant before: Advanced innovation technology Co.,Ltd. Effective date of registration: 20200924 Address after: Cayman Enterprise Centre, 27 Hospital Road, George Town, Grand Cayman, British Islands Applicant after: Advanced innovation technology Co.,Ltd. Address before: A four-storey 847 mailbox in Grand Cayman Capital Building, British Cayman Islands Applicant before: Alibaba Group Holding Ltd. |
|
| GR01 | Patent grant | ||
| GR01 | Patent grant |