CN101598940A

CN101598940A - A kind of data processing method and system

Info

Publication number: CN101598940A
Application number: CNA200810114344XA
Authority: CN
Inventors: 杨水淼; 潘川; 谢丁生; 刘超
Original assignee: Peking University Founder Group Co Ltd; Shenzhen Founder Microelectronics Co Ltd
Current assignee: Peking University Founder Group Co Ltd; Shenzhen Founder Microelectronics Co Ltd
Priority date: 2008-06-04
Filing date: 2008-06-04
Publication date: 2009-12-09

Abstract

The invention discloses a kind of data processing method, may further comprise the steps: at the data setting input/output condition that is about to input; According to input/output condition image data input from production line, and the storage original input data; According to input/output condition original input data is carried out computing and obtain computing result and storage; Behind user's input search condition, search out the original input data corresponding or computing result according to search condition and give the user, or generate the figure corresponding to the user after searching out original input data or computing result with original input data that searches out or computing result with search condition; The invention also discloses a kind of data handling system, this system comprises: condition enactment module, data acquisition module, data input module, data processing module, data memory module, data outputting module.Utilize the present invention, the data and the data-handling efficiency height, convenient when checking data that can calculate on the production line in real time to be gathered.

Description

A kind of data processing method and system

Technical field

The present invention relates to data processing technique, refer in particular to a kind of data processing method and system.

Background technology

As everyone knows, statistical Process Control (SPC, Statistical Process Control) data acquisition and processing (DAP) is a universal demand of manufacturing industry.

The traditional data acquisition and the method for processing generally have two kinds: a kind of for adopting the data that produce on the Hard copy record production line, carry out storage and uniform; In needs, browse these Hard copy records, manually calculate and analyze.There is the risk that may cause recording section to be lost because of the physical damage of Hard copy in this method, and has that artificial computation process repeats, shortcoming loaded down with trivial details, consuming time, so real-time is very poor.

Another kind of data acquisition and processing (DAP) method mainly may further comprise the steps as shown in Figure 1:

Step 11, the data that each production stage produced on the production line are recorded in the specific computing machine by Web browser.

Here, be stored in the specific computing machine and be meant: when checking in the step 13, only store the data computing machine corresponding data just can be provided.

Step 12, carry out manually-operated as required, the data of input computer handled, and with the computing outcome record that obtains in computing machine.

Step 13, work as the user, when checking data result, check to the computing machine of storage computation result as engineering staff or managerial personnel etc.

As seen, adopt the method for the data that produce on traditional computer recording production line, need carry out manually-operated and come computational data, low, the poor practicability of data-handling efficiency, and, limited user's checking to a great extent to the data result because data result is stored on the specific computing machine.

In sum, traditional method exist data acquisition with handle on time and space separate, real-time is poor, data-handling efficiency is low, check shortcomings such as data result is limited.As seen, seek a kind of real-time, data-handling efficiency is high and when checking data convenient data processing method will seem very crucial.

Summary of the invention

In view of this, fundamental purpose of the present invention is to provide a kind of data processing method and system, utilizes the present invention, the data and the data-handling efficiency height, convenient when checking data that can calculate on the production line in real time to be gathered.

For achieving the above object, technical scheme of the present invention is achieved in that

A kind of data processing method, this method may further comprise the steps:

A, setting input/output condition;

B, according to described input/output condition image data and with the data input of gathering from production line;

C, original input data is handled in real time, obtained result and storage according to input/output condition.

A kind of data handling system, this system comprise with lower module: condition enactment module, data input module, data processing module, data memory module, data outputting module, wherein,

The condition enactment module is used at the data setting data input/output condition that is about to input;

Data input module, be used for and issue data processing module according to the data of the data input/output condition collection that sets;

Data processing module, be used for the original input data that collects being handled and result being issued data memory module store according to input/output condition;

Data memory module, be used for the result that storage draws through data processing module according to the input/output condition that sets.

Data processing method of the present invention and system, because traditional SPC data processing is combined with computer network, can on any computing machine, import data, data are in case input, can be to the data real-time calculating of concentrating of input, the user of any networking can be real-time check the data plot that calculate to generate, therefore to data handle real-time, data-handling efficiency is high and the user is convenient when checking data; In addition, the present invention sets input/output condition earlier, then according to input/output condition input data, can be according to user's needs image data, according to input/output condition storage data, avoided the generation of junk data simultaneously, be convenient to storage and management simultaneously data; Owing in data output is set, increased the Email setting, in case the data of being imported are not in the normal value scope, promptly the alert message that carries the input data can be sent to selected mailbox user in the Email setting, mailbox user generally all is slip-stick artist or product expert, these slip-stick artists or product expert can carry out analyzing and processing to the data of being sent, can in time analyze abnormal data, avoided same abnormal cause to cause a large amount of product loss, and, promoted the improvement of product processes better to the analysis of misdata; Software of the present invention has: WEB service software: Apache, program language interpretation software: PHP, database software: MySQL, service end are used operating system platform: Linux/Unix/Windows etc., client software: web browser, as Internet Explorer, Firefox, Opera, safari etc., these softwares mostly are open source software, cost is all quite cheap, and therefore realization cost of the present invention is also very low.

Description of drawings

Fig. 1 is data aggregation and a process flow synoptic diagram in the prior art;

Fig. 2 is an apparatus structure synoptic diagram of the present invention;

Fig. 3 gathers computing plan (EDCOP) for project data of the present invention and sets the interface synoptic diagram;

Fig. 4 is the detailed setting interface synoptic diagram of data output map of the present invention;

Fig. 5 is the method flow synoptic diagram of data processing of the present invention;

Fig. 6 is the method flow synoptic diagram of one embodiment of the invention;

Fig. 7 is that the EDCOP of one embodiment of the invention sets the interface synoptic diagram;

Fig. 8 is the detailed setting interface synoptic diagram of the data output map of one embodiment of the invention.

Embodiment

Basic thought of the present invention is: traditional SPC data processing is combined with computer network, based on the WEB server, in advance to being about to the data setting input/output condition of input, gather data on the production line in real time according to the input/output condition that sets, and these data are calculated in real time and handle, generate data plot, the user only needs input search condition, just can check the data plot corresponding with search condition in real time.

Below in conjunction with accompanying drawing to of the present invention specifically be to implement to be further described in detail:

Data Collection ﹠ Processing System of the present invention comprises as shown in Figure 2 with lower module: condition enactment module 21, data acquisition module 22, data input module 23, data processing module 24, data memory module 25, data outputting module 26, wherein,

Condition enactment module 21 is used at the data setting data input/output condition that is about to input.

Here, the condition that input and output set at data comprises two kinds: a kind of EDCOP of being sets, and mainly comprises: the EDCOP title; EDCOP describes; The type of input data; Key point is set, and comprising: the input point number is set or is claimed that data are imported number setting, the prompting of input point number scope, the input point prompting is set or title data input prompt setting; The data output map is set, and comprising: the title of each figure that data output map number is set, data output map number scope is pointed out, data are exported, the data allocations rule of each figure etc., specifically as shown in Figure 3.Wherein, the type of data input mainly contains two kinds, online (In-line) and off-line (Off-line), In-line represents that data and the product imported have direct relation, as the length of product, attribute etc., Off-line represents that data and the product imported do not have direct relation, and relevant with environment or equipment, as producing the required environment temperature of product etc.; The source, position that expression will be imported data is set in the input point prompting; Data output map number is decided according to the type of the figure of data output, the type difference, the number of the figure that the data of importing will be exported is also inequality, and different data will be from different figure output, this depends on the setting and the EDCOP title of data allocations rule, the data of identical EDCOP title will be exported from same figure, and concrete output decides according to the data allocations rule.

Another kind is that the data output map is set in detail, comprise: the output point number that the type of data output map title, the description of data output map, data output map, the type of data output map shape, the type of input data, monitoring project, needs show, the setting of input data standard value scope, Email setting etc., specifically as shown in Figure 4.Wherein, the type of data output map has: XbarR, XbarS, Trend, X-MR etc., wherein, XbarR represents to export respectively mean value (Xbar) figure of the raw data of being imported, and the maximal value in the raw data of being imported and the absolute value (Range) of minimum difference are schemed this two figure; XbarS represents to export the mean value figure of the raw data of being imported respectively, and these two figure of moving range figure of the raw data of being imported; Trend represents to export the overall trend figure of the raw data of being imported; X-MR represents the absolute value figure of difference between original input point and the consecutive point thereof; The normal value scope that the data that the setting of input data standard value scope is about to import should satisfy, because data represented monitoring project value of input, any monitoring project value all should have a normal value scope, if the monitoring project value that is collected has exceeded the normal value scope, the data that collect with regard to thinking belong to abnormal data, may in production stage or link abnormal conditions appear then, need check production stage or link, as measure the live width of certain product, according to Theoretical Calculation and estimation of error, the normal value scope of the width of this product is 5.21～5.25mm, if the data that collect are then thought to occur unusual at production stage or link for less than the value of 5.21mm or greater than the value of 5.25mm; The type of data output map shape has: broken line graph, histogram, box palpus figure, big pie chart etc.; Monitoring project is represented the attribute of the data of current needs; Email sets, and has set Product Data Engineer or expert's email address, can play the warning effect to the abnormal data of input, in case the data of input surpass the normal value scope, the data of being imported will be sent to the email address in the Email setting.

Except that above input and output are set, can also carry out other setting according to concrete needs, special circumstances that need write down as each input data or the like do not repeat them here.

Data acquisition module 22, this module is optional module, can manually gather the useful data that obtains on the production line, giving data processing module 24 by data input module 23 with the useful data that is obtained then handles, perhaps obtain needed data the input/output condition according to the input/output condition that the condition enactment module sets from production line, and the data that obtained are sent to data input module 23 by this module.

In image data, mainly be to come image data according to the monitoring project in the input/output condition.

Data input module 23, the data or the artificial data of gathering that are used for data acquisition module 22 is gathered are issued data processing module 24; Also be used for the search condition of user's needs is issued data processing module 24.

Here, generally by Web browser input data.In the input data, the data parameters such as product category of time, the input data person of data input, the batch number of importing data, the product step number of importing data, input data are imported in the lump.

Data processing module 24 is used for the original input data that will collect and the parameter of importing in the lump together with original input data directly sends to data memory module 25; Be used for determining that the data of being imported exceed sends the alert message that carries the input data after the normal value scope that sets and set determined mailbox user to Email; The data output map type that also is used for the data input/output condition that sets according to condition enactment module 21 is carried out computing to original input data, and the computing result is issued data memory module 25; Data processing module 24 also is used for searching out the original input data corresponding with search condition or computing result according to the search condition of user input from data memory module 25 and issues data outputting module 26 and maybe the original input data that searches out or computing result are generated corresponding figure and issue data outputting module 26.

Here, 24 pairs of original input datas of data processing module carry out the type that data output map in the data input/output condition is depended in which kind of calculating, for example the type of data output map is XbarR, then data processing module will and obtain mean value figure to the raw data calculating mean value imported and be stored in the data memory module herein, and search out maximal value and minimum value in the raw data of being imported, calculate maximal value and minimum value difference absolute value and obtain absolute value figure and be stored in the data memory module 25.

In addition, what export to the user is original input data, or the computing result, or the figure corresponding with original input data or computing result depends on the search condition that the user imports, if what the user needed is original input data, then export original input data; If that the user needs is the computing result, then export the computing result; If that the user needs is figure, then output and original input data or the figure corresponding with the computing result.

Data memory module 25 is used for the original input data or the computing result that send according to the EDCOP name class storage data processing module 24 of input/output condition; The batch number of the time of the data input of importing in the lump when also being used for, input data person, input data, the product step number of input data, the parameters such as product category of input data according to the EDCOP name storage of input/output condition input raw data.

When original input data that data processing module 24 is sent or the parameter of importing in the lump together with original input data or computing result store, carry out classification and storage according to the EDCOP title in the input/output condition, all data that promptly have identical EDCOP title are stored in the data memory module 25 as a class.To the classification and storage of data, convenient when can make the logarithm certificate manage with output data, junk data can not appear.

Here, the function of data processing module 24 and data memory module 25 is by the client Web browser, as client software such as Internet Explorer, Firefox, Opera, safari and service end Web server mutual after, transfer to the MySQL database and finish on the backstage.Wherein, the framework process of Web server is as follows: the Redhat (SuSE) Linux OS is installed earlier, also operating systems such as Unix or Windows can be installed, adopt the source code compile mode that Apache, PHP, MySQL server software are installed in this operating system the inside then, editor Apache configuration file, with the module operation of PHP as Apache, editor PHP configuration file is enabled the MySQL interface function among the PHP.Wherein, program language interpretation software PHP is the script that the Web service end is explained, can be with service end and WEB service software, as the Apache combination, adopt the client of the interpretation of programs of PHP language compilation then, present to the terminal user for the transmission of standard html language.

Data outputting module 26, be used for data processing module 24 is exported to the user from original input data or the computing result that data memory module 25 searches out, or the generation figure corresponding with original input data that searches out or computing result exports to the user after searching out original input data or computing result.

Here, search condition comprises the title of the figure that the user need obtain at least, further comprise the user wish to obtain data time range and or the shape type of data output map, when promptly searching for, the title of figure is necessary, and other conditions are optionally, and it is fixed to come according to user's needs.

Data acquisition of the present invention and disposal route may further comprise the steps as shown in Figure 5:

Step 51, at the data setting input/output condition that is about to input.

Wherein, the see before explanation of face of the particular content that input is set and output is set does not repeat them here.

Step 52, according to input/output condition image data from production line, can be automatic collection, also can be artificial collection.

Step 53, with the data of being gathered input computing machine.

Here, in the time of data that input is gathered, time of data inputs, input data person, the batch number of input data, the product step number of input data, the parameters such as product category of input data are imported in the lump and stored.

Whether the data that step 54, judgement are imported exceed the normal value scope that sets, if surpass, the alert message that then will carry the data of importing sends to the email address that sets in the input/output condition with the mail form, and execution in step 55 then; Otherwise direct execution in step 55.

Step 55, according to input/output condition original input data is stored after, original input data is carried out computing obtains computing result and storage.

Here, no matter be to the storage of original input data or to computing result's storage, all to carry out according to the EDCOP title in the input/output condition, all data storage with identical EDCOP title are a class, are convenient to the management of data.

Step 56, the real-time input search condition of user, system searches out the original input data corresponding with search condition or computing result according to search condition and gives the user, searches out to generate the figure corresponding with original input data that searches out or computing result behind original input data or the computing result and export to the user.

Further specify concrete enforcement of the present invention with In-line XbarR figure (Chart) as one embodiment of the invention below, this embodiment method flow mainly may further comprise the steps as shown in Figure 6:

Step 61, at the data setting input/output condition that is about to input.

Here, comprise two kinds of settings, a kind of for EDCOP sets, as shown in Figure 7, set the EDCOP name and be called: ATESTEDCOPA; EDCOP is described as: a kind of EDCOP test, i.e. A Test EDCOP; The type of input data is: In-line; The input point number is set at: 5, and expression has 5 data to need input; Input point number scope prompts for: please import the some number between the 1-20, the main clause of input can not be more than 20 successively in expression; The input point prompting is set at: Point1:Point1, Point2:Point2, Point3:Point3, Point4:Point4, Point5:Point5; Data output map number is: 1, and 5 data will importing will some or all ofly enter 1 figure above the expression, depend on that specifically data export the setting of first rule map; Data output map number scope prompts for: please import the figure number less than 4, once the figure of output can not be more than 4 in expression; The name that data are exported first figure is called: ATESTCHARTA; Data are exported first rule map: 1,2,3,4,5, and 5 data that expression is set above will all enter this figure that name is called ATESTCHARTA.

Another setting is that the data output map is set in detail, as shown in Figure 8, mainly comprises following setting: data output map name is called: ATESTCHARTA, and the unique name of representing this figure is ATESTCHARTA; The data output map is described: about the test pattern of online acquisition, i.e. and Atest chart for in-line collect; The type of data output map is: XbarR, and expression is respectively once the mean value (Xbar) of one group of original input data of input and two figure of absolute value (Range) of maximal value and minimum difference with output; The type of data output map shape is: broken line graph; The type of input data: In-line, the data and the product of expression input have direct relation; Monitoring project is: live width (CD), the critical size of expression product; The output point number that needs to show is: 50; Input data standard value scope does not repeat them here; Email sets, and has selected email address and has been: Zhangsan@163.comThe user, the expression email address be Zhangsan@163.comThe user can receive the alert message that carries the input data exceed the normal value scope time in the data point of input.

Step 62, according to input/output condition image data and with the data input of being gathered from the production line.

Here, generally be to gather according to monitoring project, be products C D as test item, then according to the CD of the every setting in the input/output condition of above-mentioned setting from production line collection product, present embodiment need be gathered 5 data.In the input data, time of data inputs, input data person, the batch number of input data, the product step number of input data, the data parameters such as product category of input data are imported in the lump, convenient when being convenient to the user and checking.

Equally, in the time of data that input is gathered, time of data inputs, input data person, the batch number of input data, the product step number of input data, the parameters such as product category of input data are imported in the lump and stored.

Step 63, determine the data that collect all after within the normal value scope, after according to input/output condition original input data being stored, original input data handled in real time obtaining computing result and storage.

Because the type of data output map was XbarR during input and output were set, so collect 5 products C D from production line, to these 5 products C D calculating of the absolute value of the value of averaging and maximal value and minimum difference respectively, result of calculation is stored according to the EDCOP name class, is a class with all data storage of EDCOP title.

Step 64, the above-mentioned same method of employing are gathered the data on each production line of different time and are carried out computing and storage.

Step 65, user's input search condition, search out the original input data corresponding or computing result according to search condition and give the user, or search out and generate the figure corresponding behind original input data or the computing result and export to the user with original input data that searches out or computing result with search condition.

The search condition of supposing user's input is: time range is on May 15,15 days to 2008 April in 2008, the map title is called ATESTCHARTA, then can export two parts figure in a figure: a part is the mean value figure of the raw data of each time point input of products C D during April 15 to 15 days Mays in 2008 in 2008, another part is the absolute value figure of the difference of the maximal value of the raw data of each time point input of products C D during April 15 to 15 days Mays in 2008 in 2008 and minimum value, if the array of gathering during April 15 to 15 days Mays in 2008 in 2008 surpasses 50, then only show the absolute value of the difference of the mean value of the raw data of calculating 50 groups of inputs forward on May 15th, 2008 or maximal value and minimum value among the figure.And the previous data output map shape of setting is a broken line graph, so no matter be that mean value figure or absolute value figure are broken line graph.

This shows, the present invention combines traditional SPC data processing with computer network, has the distributed data input, centralized calculation and storage, the characteristics of distributed output make the user as long as networking just can use the WEB browser to check the data plot that is generated, need not to design in addition extra client end program, have the real-time height, software cost is low, characteristics easy to use.

The above is preferred embodiment of the present invention only, is not to be used to limit protection scope of the present invention.

Claims

1, a kind of data processing method is characterized in that, this method may further comprise the steps:

A, setting input/output condition;

2, method according to claim 1 is characterized in that, after the step B, this method further comprises: original input data is stored.

3, method according to claim 2, it is characterized in that, after the step C, this method further comprises step D: behind user's input search condition, search out the original input data corresponding or result according to search condition and give the user with search condition, or after searching out original input data or result corresponding, generate the figure corresponding and give the user with original input data that searches out or result with search condition.

4, method according to claim 1 is characterized in that, described data input/output condition comprises: project data is gathered computing plan EDCOP setting and the data output map is set in detail, and described EDCOP sets and comprises: the EDCOP title; EDCOP describes; The type of input data; Key point is set, and comprising: the input point number is set or is claimed that data are imported number setting, the prompting of input point number scope, the input point prompting is set or title data input prompt setting; The data output map is set, and comprising: the title of each figure that data output map number is set, data output map number scope is pointed out, data are exported, the data allocations rule of each figure; Described data output map is set in detail and comprised: the output point number that the type of data output map title, the description of data output map, data output map, the type of data output map shape, the type of input data, monitoring project, needs show, input data standard value scope are set, the Email setting.

5, method according to claim 4, it is characterized in that, before the step C, this method further comprises: judge according to input/output condition whether the data of being imported exceed input data standard value scope, if surpass, then send carry the data of importing alert message to selected email address in the Email setting, otherwise do not carry out any operation.

6, method according to claim 4, it is characterized in that, when importing the data of being gathered among the step B, the product category parameter of time, the input data person of data input, the batch number of importing data, the product step number of importing data, input data is imported in the lump, and above-mentioned parameter is stored according to the EDCOP title in the input/output condition.

7, method according to claim 4 is characterized in that, is treated to described in the step C: the type according to data output map in the data input/output condition is carried out computing to original input data, and accordingly, described result is the computing result.

8, method according to claim 7 is characterized in that, is stored as described in the step C: according to data input/output condition EDCOP title the computing result is carried out classification and storage.

9, method according to claim 3 is characterized in that, described search condition comprises the title of the figure that the user need obtain at least, further comprise the user wish to obtain data time range and or the shape type of data output map.

10, a kind of data handling system is characterized in that, this system comprises with lower module: condition enactment module, data input module, data processing module, data memory module, data outputting module, wherein,

11, system according to claim 10 is characterized in that, described data processing module is further used for the original input data that collects is issued data memory module;

Accordingly, described data memory module is further used for storing according to the original input data that the input/output condition that sets is sent the data processing module.

12, system according to claim 11 is characterized in that, described data input module is further used for user's search condition is issued data processing module;

Accordingly, described data processing module is further used for and will searches out original input data corresponding with search condition or result from data memory module, or be used to search out original input data corresponding or computing result, and generate and original input data that searches out or the corresponding figure of computing result with search condition;

Accordingly, this system further comprises data outputting module, and the original input data or the result that are used for data processing module is searched out are exported to the user, or the figure that data processing module is generated exports to the user.

13, system according to claim 10 is characterized in that, this system further comprises: data acquisition module, be used for gathering the data that produce on the production line according to the data input/output condition of condition enactment module settings.

14, system according to claim 10 is characterized in that, described data input/output condition comprises: project data is gathered computing plan EDCOP setting and the data output map is set in detail, and described EDCOP sets and comprises: the EDCOP title; EDCOP describes; The type of input data; Key point is set, and comprising: the input point number is set or is claimed that data are imported number setting, the prompting of input point number scope, the input point prompting is set or title data input prompt setting; The data output map is set, and comprising: the title of each figure that data output map number is set, data output map number scope is pointed out, data are exported, the data allocations rule of each figure; Described data output map is set in detail and comprised: the output point number that the type of data output map title, the description of data output map, data output map, the type of data output map shape, the type of input data, monitoring project, needs show, input data standard value scope are set, the Email setting.

15, system according to claim 14, it is characterized in that, described data processing module is further used for judging according to input/output condition whether the data of being imported exceed input data standard value scope, if surpass, then be used for sending the alert message that carries the data of importing and set selected email address to Email.

16, system according to claim 14, it is characterized in that, when described data input module is issued data processing module with the data of gathering, be further used for the product category parameter of time, the input data person of data input, the batch number of importing data, the product step number of importing data, input data is issued data processing module in the lump;

Accordingly, described data processing module is further used for above-mentioned parameter is issued data memory module;

Described data memory module is further used for according to the EDCOP name storage above-mentioned parameter in the input/output condition.

17, system according to claim 14, it is characterized in that, described data processing module is treated to the data that collect according to input/output condition: the type according to the data output map in the input/output condition is calculated the data of being imported, accordingly, described result is the computing result.

18, system according to claim 17, it is characterized in that described data memory module is stored as the computing result according to input/output condition: the computing result that the data processing module obtains is carried out classification and storage according to the EDCOP title in the input/output condition.

19, method according to claim 12, it is characterized in that, the user search condition of described data input module input comprises the title of the figure that the user need obtain at least, further comprise the user wish to obtain data time range and or the shape type of data output map.