CN1851702A - Localized data acquisition method and system - Google Patents

Localized data acquisition method and system Download PDF

Info

Publication number
CN1851702A
CN1851702A CN 200610011984 CN200610011984A CN1851702A CN 1851702 A CN1851702 A CN 1851702A CN 200610011984 CN200610011984 CN 200610011984 CN 200610011984 A CN200610011984 A CN 200610011984A CN 1851702 A CN1851702 A CN 1851702A
Authority
CN
China
Prior art keywords
data
description
local
test
base
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Granted
Application number
CN 200610011984
Other languages
Chinese (zh)
Other versions
CN100465959C (en
Inventor
丘嘉宜
江炜斌
邝嘉升
周尚勤
林艳椿
郑子柔
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Industrial and Commercial Bank of China Ltd ICBC
Original Assignee
Industrial and Commercial Bank of China Ltd ICBC
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Industrial and Commercial Bank of China Ltd ICBC filed Critical Industrial and Commercial Bank of China Ltd ICBC
Priority to CNB2006100119849A priority Critical patent/CN100465959C/en
Publication of CN1851702A publication Critical patent/CN1851702A/en
Application granted granted Critical
Publication of CN100465959C publication Critical patent/CN100465959C/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Landscapes

  • Information Retrieval, Db Structures And Fs Structures Therefor (AREA)
  • Debugging And Monitoring (AREA)

Abstract

The present invention discloses a data acquisition system for data gathering from test data base to local data base, including data description managing device for generating data description having preset characteristic data item; data acquisition unit for according to said data description collecting relevant data item from test data base to data base in wholesale mode. Said invention can avoid repeat environmental data preparation and raise efficiency, to proceed secondary allocation to collected data without data uses collision.

Description

Localized data acquisition method and system
Technical field
The present invention relates to network and computer software technology, particularly the automatic test of computer software is a kind of localized data acquisition method concretely.
Technical background
The first input of automatic test is 3 to 10 times of manual test.If automatic test is only done once, not as good as test by hand.Same automatic test carries out repeatedly, faces the preparation and the recovery problem of test environment inevitably.The way that general static data are prepared is to produce data that meet current test by doing a transaction, note by staff, after this test, change has taken place in the state of these data, no longer be fit to this test, when carrying out this test once more, need this process of repetition to produce data that meet this test again.Lift a simple example: test the cancellation transaction of a current account, so at first just need the current account of a normal condition.What this account come from, and you need do the transaction of opening an account of a current account and leave the current account of a normal condition, and write down this account's account number.Begin to carry out the test of cancellation transaction then, after the Transaction Success, this current account has just become an account of cancellation state, can not be used for testing cancellation again and conclude the business, and needs newly to open again an account.Automatic test will be done a lot of tests in advance and prepare data, and the attributes such as state of the data that begin to prepare are changed, and needs to prepare again data when carry out automatic test next time again.The way of at present a lot of companies is to adopt the preceding backup of test, the way of test back restore data realizes automatic test and regression test, but it is unrealistic that this way realizes on comparatively complicated server environment, carrying out test owing to all have a plurality of projects on every cover test environment, the start and end time point of projects is impossible identical, if minority environment recovery several times may the tester can also be accepted reluctantly once in a while, but the backup of doing environment for a long time recovers to be certain to bring significant impact to the sundry item testing progress.
Summary of the invention
The present invention has overcome the deficiency of existing automatization testing technique in data and environmental preparation, provides a kind of realization simple, and implementation cost is low, can effectively avoid repeating to prepare the method for data.
In one aspect of the invention, provide a kind of be used for from test database that the data acquisition system (DAS) of data acquisition to local data base comprised: the data description management devices is used to produce the data description of the data item with predetermined characteristic; And data collector, be used for corresponding data item being collected the local data base from test database in mode in batches according to described data description.
According to embodiments of the invention, this system also comprises: the environment setting device is used to set the test data lab environment that carries out data acquisition, and the parameter value of each test data lab environment is kept in the table of local data base.
According to embodiments of the invention, this system also comprises: data acquisition machine people device, be used for detecting in real time the number of local data base and the corresponding data item of data description of predetermined characteristic, and from test database, gather data item under less than the situation of predetermined threshold value with described predetermined characteristic at described number.
According to embodiments of the invention, this system also comprises: the local data distributor is used for each data item of local data base is distributed to application corresponding.
According to embodiments of the invention, described data description management devices comprises: SQL assists generating apparatus, is used for converting Chinese to English name to generate the required SQL statement of data description; SQL nonproductive poll device is used for described SQL statement is sent to test database to verify the correctness of described SQL statement.
According to embodiments of the invention, described data description management devices also comprises: data description increases device newly, the data volume that the user gathers by the newly-increased device input data description title of described data description, state, expection is to produce new data description in local data base.
According to embodiments of the invention, described data collector comprises: data acquisition master control device is used to control the batch data gatherer process under each thread; Data acquisition thread device, be used for with an environment under the corresponding data item of all data descriptions collect local data base in batches.
According to embodiments of the invention, described data acquisition machine people device comprises: data decryptor/pick-up unit is used for detecting at set intervals the quantity available of each data description of local data base, with the data description of the data item determining to lack; And the data collector of individual data description, be used for gathering the data item that lacks the local data base from test database.
In another aspect of this invention, provide a kind of be used for that the collecting method of data acquisition to local data base comprised step: the data description that produces data item in this locality with predetermined characteristic from test database; And corresponding data item is collected in the local data base from test database in batches mode according to described data description.
According to embodiments of the invention, this method also comprises step: set and carry out the test data lab environment of data acquisition, and the parameter value of each test data lab environment is kept in the table of local data base.
According to embodiments of the invention, this method also comprises step: detect in the local data base number with the corresponding data item of data description of predetermined characteristic in real time, and gather the data item with described predetermined characteristic at described number under less than the situation of predetermined threshold value from test database.
According to embodiments of the invention, this method also comprises step: each data item in the local data base is distributed to application corresponding.
According to embodiments of the invention, this method also comprises step: convert Chinese to English name to generate the required SQL statement of data description; Described SQL statement is sent to test database to verify the correctness of described SQL statement.
According to embodiments of the invention, this method also comprises step: the data volume that input data description title, state, expection are gathered, and in local data base, to produce new data description.
According to embodiments of the invention, described acquisition step comprises: will collect local data base in batches with the corresponding data item of all data descriptions under the environment.
According to embodiments of the invention, this method also comprises step: detect the quantity available of each data description in local data base at set intervals, with the data description of the data item determining to lack; And the data item that from test database, lacks in the collection local data base.
According to said method of the present invention and system, utilize data description to carry out data acquisition, can realize preparing data description one time, later on data that just can this type of repeated acquisition are avoided repeating to do loaded down with trivial details environmental data preparation, have improved efficient.In addition, carry out secondary distribution, avoid data to use conflict collecting data.
Description of drawings
Fig. 1 is the structural representation of localized data acquisition;
Fig. 2 is the structural representation of data description management devices;
Fig. 3 is the structural representation of data collector;
Fig. 4 is a structural representation of data acquisition machine people device;
Fig. 5 is the process flow diagram of data acquisition master control device;
Fig. 6 is the process flow diagram of a data collecting thread;
Fig. 7 is the process flow diagram of data acquisition machine people device.
Embodiment
To contrast accompanying drawing below, specific embodiments of the invention will be elaborated.
As shown in Figure 1, the test database of being gathered 1 is in the test environment of an environment relative complex, for various application provide Data Source.In other words, the data storage that be gathered is in this test database 1.This test environment can be a large scale computer, equally also can expand to general small-sized, micro server, prerequisite is the recovery that this server is not suitable for carrying out continually environment.
Local data base 2 is one and follows data collector 7 to be in the interior database of same LAN (Local Area Network), therefore is referred to as local data base.It can be DB2, ORACLE, various relational databases such as SQLSERVER.Local data base 2 the insides mainly contain: environment table, DDT (data structure table 1), local data table (data structure table 2).
The structure that following table 1 and table 2 show DDT 1 and local data table.
Table 1, DDT (DATADESC)
Field name Definition Type Explanation
Data description ID DATADESC_ID ?NUMBER(10) PK
The data description title DATADESC_NAME ?VARchar2(50) Chinese is described
The data description state DATADESC_STATUS ?VARchar2(1) 0-need not, 1-is effective
The data description SQL of band parameter DATADESC_SQL ? ?VARchar2(1000) ? The SQL of band parameter
The SQL statement detected state ISTEST ? ? ?VARchar2(1) ? ? 0-does not detect, and 1-detects and passes through, and 2-detects and do not pass through
Expection image data amount EXPECT_DATA_COUNT ?NUMBER(10) Expection image data amount
Table 2, local data table (LOCAL_DATA)
Field name Definition Type Explanation
Data description ID ?DATADESC_ID ?NUMBER(10) PK1
Test environment ID ?ENV_ID ?NUMBER(10) PK2
Sequence number ID ?DATA_ID ?NUMBER(10) PK3
Data value ?DATA ?VARchar2(1000)
Data were used state the same day ?ISUSETODAY ? ? ?VARchar2(1) ? ? Data were used state (0-does not use, and 1-uses) same day
End user ID ?USER_ID ? ?NUMBER(10) ? If the assigner is ID=0, represent that these data are public
Use the date ?OPR_DATE ?DATETIME
In table 1, data description is meant some descriptions in detail and clearly to the data of test cases needs of predefined.For example: " normal Renminbi current account ", " the well-informed card card number of having reported the loss ", these all are data description for " remaining sums greater than 100,000 yuan normal dollar toward vostro account ", and correspondence leaves the DATADESC_NAME field of data structure table 1 (DATADESC) in.
The data description SQL of band parameter is meant the corresponding SQL that can get this categorical data from test database of each data description meeting, all all use parametric representation with the relevant place of the parameter value of actual environment among this SQL, therefore be called the data description SQL that is with parameter, leave the DATADESC_SQL field of data structure table 1 (DATADESC) in.
Executable data description SQL is meant that this SQL has been exactly executable SQL after the parameter among the data description SQL of band parameter is replaced by the environmental parameter value of reality.
Inner/outer network 3 can be internal network: the LAN (Local Area Network) of enterprise, and Ethernet (Ethernet), other LAN is as Fiber Distributed Data Interface (FDDI), token ring (Token-Ring) etc.It can be simultaneously outside network: internet (Internet) or other extranet (Extranet).Mainly whether being in same internal network on the test database of being gathered 1 with other device decides.
Internal network 4 is the LAN (Local Area Network) of enterprise, can be Ethernet (Ethernet), also can be other LAN, as Fiber Distributed Data Interface (FDDI), token ring (Token-Ring) etc.
Environment setting device 5 is clients that provide the interface to be provided with the test environment to application-specific to the user, it is kept at the specific data structure of local data base to some parameter values of each environment---and in the environment table, confession data collector 7 is used for replacing the parameter among the data description SQL that is with parameter.Parameter value is different along with the difference of each concrete test environment, but can the feature of each environment of clear description in test database.
Data description management devices 6 is one provides the interface can allow the user increase newly, revises copy, the client that deleted data is described.The data description that data description management devices 6 generates is inserted in the DDT (data structure table 1) of local data base, and for data collector 7, local data distributor 8 and data acquisition machine people device 9 use.
Data description management devices 6 comprises 6 parts shown in Figure 2.
The auxiliary generating apparatus 61 of SQL is that a usefulness is helped the instrument that the user produces the required SQL of data description.Because the table of test database is a lot, the user need can not all can both to remember the table name, field name of the table of inquiry etc., produces data description SQL and has certain difficulty.And use SQL to assist generating apparatus 61, the user only need select the Chinese name of the table of needs inquiry, the Chinese Fields name of table, and some functions commonly used, operational symbol etc., just can carry out the various conversions such as Chinese and English conversion of test database table name and each field name, produce SQL statement by the auxiliary generating apparatus 61 of SQL.
SQL nonproductive poll device 62 is instruments that offer the SQL statement that the auxiliary generating apparatus 61 of the hand-written or SQL of user rs authentication oneself produces.It is that a SQL carries out client.The user only need just can directly serve test database to SQL by an inquire button, and whether SQL is wrong for the checking of pass test data storehouse return message.
The newly-increased device 63 of data description provides an interface to allow user input data describe title, select the data description state, by the parameter value with environmental correclation among the SQL of hand-written or auxiliary generating apparatus 61 generations of SQL is become parameter, produce the data description SQL of band parameter, and select SQL statement whether to detect and pass through, insert the data volume that expection is gathered, generate data by the newly-increased device 63 of data description according to database sequence at last and describe ID, respective field among the DDT DATADESC (data structure table 1) of insertion local data base, so far, a data description increases newly successfully.
Data description modifier 64 provides an interface to allow the user that each attribute of the data description of newly-increased device 63 generations of data description is made amendment.
Data description copy device 65 provides a function of duplicating already present data description, and purpose is to describe in order to allow the user duplicate data, makes amendment on this basis, quickens to generate close or similar data description.
Data description delete device 66 provides the function of deletion by the data description of newly-increased device 63 of data description and 65 generations of data description copy device.
Data collector 7 is that the data according to each environment of data description batch collecting test database arrive local device.It can be to connect the database that drives target test environment in (ODBC, JDBC etc.) connection by any database.For example, use the direct-connected ODBC of DB2 to drive and connect upward target test environment.It is combined into the SQL statement that can carry out by the data description SQL of band parameter that data description management devices 6 is produced and the parameter value of the concrete environment that environment setting device 5 produces, and adopts multithreading to serve test database and carries out data acquisition.
Data collector 7 comprises two parts shown in Figure 3.
Data acquisition master control device 71 is parts of a responsible control data collecting thread device 72 and whole collecting flowchart.Data acquisition thread device 72 is that all data descriptions to an environment of a reality are carried out the parts that batch data is gathered.
See the concrete operations flow process of data acquisition master control device 71 earlier, as shown in Figure 5:
Step 10: data acquisition master control device 71 carries out the initial work of some accessing databases, startup thread etc. earlier, and the thread counter variable is changed to 0.
Step 11:, obtain the data set of entire environment parameter value by the environment table of SQL statement inquiry local data base.
Step 12: judge that whether the environmental data collection is empty, if empty, then finishes the whole data collection flow process.If be not empty, then forward step 13 to.
Step 13: data acquisition master control device 71 is concentrated the concrete parameter value of getting an environment from environmental data earlier.
Step 14: start a data collecting thread, the parameter value of this environment is imported in the thread, simultaneously thread counter is added 1, and the flow process of beginning data acquisition thread device 72.For the speed of accelerating to gather, the database of also avoiding simultaneously connecting test environment connects too much, therefore through weighing, adopts multithreading here, and each environment will play a thread all active datas descriptions are gathered.The corresponding database of thread connects.
Step 15: the vernier that environmental data is concentrated moves down one.
Step 16: judge whether to arrive the ending of environmental data collection, if otherwise forward step 13 to; If then forward step 17 to.
Step 17: wait for the end of all threads.When each thread finishes, all thread counter can be subtracted 1.
Step 18: judge whether thread counter is 0, sees whether thread is all over, if, termination routine then, otherwise turn to step 17 to continue to wait for.
The concrete operations flow process of data acquisition thread device 72 is described below, as shown in Figure 6:
Step 20: obtain the parameter value of the environment that data acquisition master control device 71 imports into, be saved in each variable.
Step 21: taking out all data description state (DATADESC_STATUS) values from the DDT (DATADESC) of local data base is 1---effective and SQL statement detected state (ISTEST) value is 1---, and it is concentrated to detect data description to a data of passing through.
Step 22: whether the judgment data descriptor data set is empty, if for sky then forward step 29 to, if for sky then forward step 23 to.
Step 23: get a data description record from the data description data set, comprise the data description id field in the table 1, data description SQL statement field, expection image data amount field.
Step 24: data description SQL and expection image data amount with the band parameter of the environmental parameter value of step 20 and step 21 are combined into an executable SQL statement.This process is exactly with the environmental parameter value parameter among the data description SQL of band parameter to be replaced, and uses a condition restriction that the image data quantitative change is become SQL statement.For example 100 data are gathered in expection, are " FETCH FIRST 100 ROWS ONLY " in DB2, and other databases have similar usage.To send test database to inquire about on this executable SQL statement then.
Step 25: judged whether to collect qualified data, if otherwise forward step 27 to.If then forward step 26 to.
Step 26: data that collect and data description ID, the test database environment ID is inserted in data structure table 2 local data table (LOCAL_DATA), and the data that wherein collect are placed in the DATA field.
Step 27: the vernier of data description data set is moved down one.
Step 28: judge whether to arrive the ending of data description data set, be then to forward step 20 to, otherwise forward step 23 to.
Step 29: thread counter is subtracted 1, do the tailing in work that some threads finish simultaneously.
So far, a collecting thread finishes.
Local data distributor 8 is distributors of the application of data that collect at each use, and it can carry out a kind of restriction to the use of data, avoids using conflict.Its realization can be that an interface should be used for calling to each, after each is used and follows concrete data description to carry out a kind of association, in the time of need using the data of this data description, call this interface, in local data table 2 (LOCAL_DATA), select a suitable data by local data distributor 8 according to the environmental parameter of using, simultaneously the value of the ISUSETODAY field of these data in table 2 local data table (LOCAL_DATA) is set to 1-and uses, and the end user, upgrade into corresponding USER_ID and OPR_DATE field in the local data table (table 2) service time.
Data acquisition machine people device 9 is one and avoids the local data robot program that use the back does not have data to use that finishes using.Its realization principle is by not stopping to detect the amount of available data of each data description in the local data table 2 (LOCAL_DATA), when finding to exist amount of available data less than the data description of a certain specified threshold, obtain this (these) data description ID, empty these class data description data in the local data table 2 (LOCAL_DATA), gather the data of some to local data table 2 (LOCAL_DATA) from test database separately again.
Data acquisition machine people device 9 comprises data volume monitoring/pick-up unit 91 shown in Figure 4 and 92 two parts of individual data data of description harvester.
It can be the quantity available that detects each data description in the local database table 2 (LOCAL_DATA) at set intervals that data volume is monitored pick-up unit 91.Actually can take different ways according to the difference of database, what for example present embodiment adopted is the ORACLE database, can realize with ORACLE AQ (senior formation) and ORACLE job and storing process.ORACLE job regularly calls a storing process that detects the quantity available of every kind of data description in the local data table, if find the numerical value of quantity available less than a certain appointment, in the senior queue table of ORACLE, insert a record, the USER_DATA field record of record the ID of data description.
Data volume is monitored pick-up unit 91 and is monitored senior queue table by using ORACLE OCI, in case find the inside record is arranged, record in the senior formation will be fallen out, obtain the data description ID that lacks data, turn to individual data data of description harvester 92 to gather then.
What individual data data of description harvester 92 and data collector 7 were different is that data collector 7 is that all data descriptions of all environment are carried out batch collection; Individual data data of description harvester 92 then just is described in all environment individual data and gathers.
Data acquisition machine people device 9 flow process as shown in Figure 7:
Step 30; Data volume monitoring/pick-up unit 91 does not stop to monitor local data table 2 (LOCAL_DATA).
Step 31: judge whether to exist the data description of amount of available data less than designated value.If exist then forward step 32 to.If there is no then forward step 30 to and continue monitoring/detection.
Step 32: obtain amount of available data each property value, for example with data description SQL of parameter etc. less than this data description of designated value.
Step 33: this data description is in the data of each environment in the deletion local data table 2 (local_data), and the data that assurance data acquisition machine people device 9 collects can be inserted local data table 2 smoothly.
Step 34: from the environment table, obtain the data set that contains each environmental parameter value of test database.
Step 35: judge that whether the environmental data collection is empty, if for sky then forward step 30 to and continue to monitor.If be not sky then forward step 36 to.
Step 36: the parameter value of getting an environment.
Step 37: data description SQL and expection image data amount with the band parameter of the environmental parameter value of step 36 and step 32 are combined into an executable SQL statement.To send test database to inquire about on this executable SQL statement then.
Step 38: judged whether to collect qualified data, if otherwise forward step 40 to.If then forward step 39 to.
Step 39: data that collect and data description ID, the test database environment ID is inserted in table 2 local data table (LOCAL_DATA), and the data that wherein collect are placed in the DATA field.
Step 40: the vernier that environmental data is concentrated moves down one.
Step 41: judge whether to arrive the ending of environmental data collection, continue to monitor if then forward step 30 to.If otherwise forward step 36 to.
Therefore, different with general static data preparation method is that localized data acquisition and distribution method that the present invention adopts are a kind of dynamic methods.Its implementation is the parameter value that sets environment by the environment setting device, leaves in the environment table of local data base.Pre-define the needed data description of automatic test by data description management devices 6, be placed in the DDT of local data base.Obtain data according to the last test database of the SQL of more predefined data description correspondences in the DDT, but because platform is with mutual too many between the test database, influence efficient easily, so gather a collection of data of data description condition that meet according to the data description SQL of band parameter and the concrete parameter value of environment to the local data table of local data base from test database during initial environment.Not directly to specify to need some concrete data when using data, need the described data of any data description, from these class data, get the used data of no one on the same day by local data distributor 8 but specify.Simultaneously, localized data acquisition robot device (robot) 9 ceaselessly detects the amount of available data of each data description in the local data table, when finding that this numerical value is lower than some setting values, gather a collection of data of this data description that meet to local data table from test database again automatically.At a test data lab environment through the long period operation, various types of data all should be existing certain quantity, meet and use this data localized data acquisition method that distributes to this locality by the data description image data, and at long application week after date, various types of data should tend to balance.
In addition, because data are present in test database 1 and two databases 2 of local data base, the result who collects is to a test database snapshot sometime.The inconsistent possibility of data is sure existence, but in the application of reality, even the inconsistent situation of some data mode occurs, also can be failure to this record mark, continue to carry out following test cases or re-execute test, in addition, mass data on the test database 1 and above-mentioned data collector 7 and data acquisition machine people device 9 will guarantee that the setup test in the local data base 2 can satisfy the data volume requirement of automatic test with data, can't influence actual test effect.
The above; only be the embodiment among the present invention, but protection scope of the present invention is not limited thereto, anyly is familiar with the people of this technology in the disclosed technical scope of the present invention; the conversion that can expect easily or replacement all should be encompassed in of the present invention comprising within the scope.Therefore, protection scope of the present invention should be as the criterion with the protection domain of claims.

Claims (16)

1. one kind is used for from test database the data acquisition system (DAS) of data acquisition to local data base comprised:
The data description management devices is used to produce the data description of the data item with predetermined characteristic; And
Data collector is used for from test database corresponding data item being collected the local data base in mode in batches according to described data description.
2. data acquisition system (DAS) as claimed in claim 1 also comprises:
The environment setting device is used to set the test data lab environment that carries out data acquisition, and the parameter value of each test data lab environment is kept in the table of local data base.
3. data acquisition system (DAS) as claimed in claim 2 also comprises:
Data acquisition machine people device, be used for detecting in real time the number of local data base and the corresponding data item of data description of predetermined characteristic, and from test database, gather data item under less than the situation of predetermined threshold value with described predetermined characteristic at described number.
4. data acquisition system (DAS) as claimed in claim 3 also comprises:
The local data distributor is used for each data item of local data base is distributed to application corresponding.
5. data acquisition system (DAS) as claimed in claim 1, wherein said data description management devices comprises:
SQL assists generating apparatus, is used for converting Chinese to English name to generate the required SQL statement of data description;
SQL nonproductive poll device is used for described SQL statement is sent to test database to verify the correctness of described SQL statement.
6. data acquisition system (DAS) as claimed in claim 5, wherein said data description management devices also comprises:
Data description increases device newly, and the data volume that the user gathers by the newly-increased device input data description title of described data description, state, expection is to produce new data description in local data base.
7. data acquisition system (DAS) as claimed in claim 1, wherein said data collector comprises:
Data acquisition master control device is used to control the batch data gatherer process under each thread;
Data acquisition thread device, be used for with an environment under the corresponding data item of all data descriptions collect local data base in batches.
8. data acquisition system (DAS) as claimed in claim 3, wherein said data acquisition machine people device comprises:
Data decryptor/pick-up unit is used for detecting at set intervals the quantity available of each data description of local data base, with the data description of the data item determining to lack; And
The data collector that individual data is described is used for gathering the data item that lacks the local data base from test database.
9. one kind is used for from test database the collecting method of data acquisition to local data base comprised step:
Produce the data description of data item with predetermined characteristic in this locality; And
From test database, corresponding data item is collected in the local data base in mode in batches according to described data description.
10. collecting method as claimed in claim 9 also comprises step:
The test data lab environment of data acquisition is carried out in setting, and the parameter value of each test data lab environment is kept in the table of local data base.
11. collecting method as claimed in claim 10 also comprises step:
Detect in real time in the local data base number with the corresponding data item of data description of predetermined characteristic, and from test database, gather data item under less than the situation of predetermined threshold value with described predetermined characteristic at described number.
12. collecting method as claimed in claim 11 also comprises step:
Each data item in the local data base is distributed to application corresponding.
13. collecting method as claimed in claim 9 also comprises step:
Convert Chinese to English name to generate the required SQL statement of data description;
Described SQL statement is sent to test database to verify the correctness of described SQL statement.
14. collecting method as claimed in claim 13 also comprises step:
The data volume that input data description title, state, expection are gathered is to produce new data description in local data base.
15. collecting method as claimed in claim 9, described acquisition step comprises:
To collect local data base in batches with the corresponding data item of all data descriptions under the environment.
16. collecting method as claimed in claim 11 wherein also comprises step:
Detect the quantity available of each data description in local data base at set intervals, with the data description of the data item determining to lack; And
From test database, gather the data item that lacks in the local data base.
CNB2006100119849A 2006-05-25 2006-05-25 Localized data acquisition method and system Active CN100465959C (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CNB2006100119849A CN100465959C (en) 2006-05-25 2006-05-25 Localized data acquisition method and system

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CNB2006100119849A CN100465959C (en) 2006-05-25 2006-05-25 Localized data acquisition method and system

Publications (2)

Publication Number Publication Date
CN1851702A true CN1851702A (en) 2006-10-25
CN100465959C CN100465959C (en) 2009-03-04

Family

ID=37133181

Family Applications (1)

Application Number Title Priority Date Filing Date
CNB2006100119849A Active CN100465959C (en) 2006-05-25 2006-05-25 Localized data acquisition method and system

Country Status (1)

Country Link
CN (1) CN100465959C (en)

Cited By (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN108268543A (en) * 2016-12-31 2018-07-10 中国移动通信集团江西有限公司 Database acquisition method and device
CN108737503A (en) * 2018-04-25 2018-11-02 江苏鸣鹤云科技有限公司 A kind of efficient big data distributed transmission system and method

Families Citing this family (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN103778151B (en) * 2012-10-23 2017-06-09 阿里巴巴集团控股有限公司 The method and device and searching method and device of a kind of identification feature colony

Family Cites Families (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US5838964A (en) * 1995-06-26 1998-11-17 Gubser; David R. Dynamic numeric compression methods
US6006232A (en) * 1997-10-21 1999-12-21 At&T Corp. System and method for multirecord compression in a relational database
JP2001282820A (en) * 2000-01-25 2001-10-12 Sony Corp Data compression method, retrieval method and device, data packet signal and recording medium

Cited By (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN108268543A (en) * 2016-12-31 2018-07-10 中国移动通信集团江西有限公司 Database acquisition method and device
CN108268543B (en) * 2016-12-31 2021-04-06 中国移动通信集团江西有限公司 Database acquisition method and device
CN108737503A (en) * 2018-04-25 2018-11-02 江苏鸣鹤云科技有限公司 A kind of efficient big data distributed transmission system and method

Also Published As

Publication number Publication date
CN100465959C (en) 2009-03-04

Similar Documents

Publication Publication Date Title
CN1278266C (en) System and method for mining work flow
CN110347662B (en) Multi-center medical data structure standardization system based on universal data model
US7406477B2 (en) Database system with methodology for automated determination and selection of optimal indexes
CN101042673A (en) Software testing system and testing method
US20120089612A1 (en) Flexible fully integrated real-time document indexing
US7472108B2 (en) Statistics collection using path-value pairs for relational databases
CN1804840A (en) Data access layer class generator
CN102638378B (en) Mass storage system monitoring method integrating heterogeneous storage devices
CN1858704A (en) Method of upgrading sequence
CN1610902A (en) Method and system for updating a remote database
CN1885325A (en) Work breakdown structure design manager, design tool and method thereof
CN101040280A (en) Metadata management
CN1670708A (en) Management method for computer log
CN1897025A (en) Parallel ETL technology of multi-thread working pack in mass data process
CN106095878A (en) The database manipulation device and method of table is divided based on point storehouse
CN1097796C (en) Method for presenting information on display devices of varying sizes
CN103559025A (en) Software refactoring method through clustering
CN1848851A (en) Computer and method for establishing light weight catalog access data protocol exchange format fragment
CN1645372A (en) Universal constraining realizing method for real-time internal memory database
CN1851702A (en) Localized data acquisition method and system
CN1275160C (en) Databank back-up method
US9117005B2 (en) Statistics collection using path-value pairs for relational databases
CN1635497A (en) Hardware-level based test script automatic generating system and method
CN101931525B (en) Information security management resource positioning method and system
US8229924B2 (en) Statistics collection using path-identifiers for relational databases

Legal Events

Date Code Title Description
C06 Publication
PB01 Publication
C10 Entry into substantive examination
SE01 Entry into force of request for substantive examination
C14 Grant of patent or utility model
GR01 Patent grant