CN106503166A - Date storage method and device - Google Patents
Date storage method and device Download PDFInfo
- Publication number
- CN106503166A CN106503166A CN201610930769.2A CN201610930769A CN106503166A CN 106503166 A CN106503166 A CN 106503166A CN 201610930769 A CN201610930769 A CN 201610930769A CN 106503166 A CN106503166 A CN 106503166A
- Authority
- CN
- China
- Prior art keywords
- data
- identification
- cluster
- data identification
- tables
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/20—Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
- G06F16/28—Databases characterised by their database models, e.g. relational or object models
- G06F16/283—Multi-dimensional databases or data warehouses, e.g. MOLAP or ROLAP
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/20—Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
- G06F16/22—Indexing; Data structures therefor; Storage structures
- G06F16/2282—Tablespace storage structures; Management thereof
Abstract
This application discloses date storage method and device.One specific embodiment of methods described includes：Obtain the first Data Identification and initial data corresponding with the first Data Identification that first user is provided, and the first Data Identification and initial data are stored in as data record in the original row cluster of the tables of data for pre-building, growth data and growth data corresponding second Data Identification are then obtained, last consistent with the first Data Identification in response to the second Data Identification, growth data is stored in the extension columns cluster of tables of data in data record corresponding with the first Data Identification, the embodiment achieves the extension to initial data, initial data is stored in same table with growth data simultaneously, avoid conjunctive query, improve search efficiency.
Description
Technical field
The application is related to field of computer technology, more particularly to date storage method and device.
Background technology
At present, for initial data that is collecting device collection or obtaining by other means, except carrying out conventional depositing
Storage is outer, is usually also required to be extended which, and growth data is included for illustrating that the data in initial data source, initial data are passed
The data such as transmission speed that produce during defeated or other users are to labeled data of initial data etc..
Existing Data expansion mode is mainly created view, the definition of modification table, newly-increased table and is associated by key,
But create view existing field can only be mapped in view, it is impossible to new field；Modification table definition can affect initial data,
Cause data contamination；Newly-increased table and by key be associated inquiry when need to carry out conjunctive query, have a strong impact on query performance.
Content of the invention
The purpose of the application is to propose a kind of improved date storage method and device, solves background above technology department
Divide the technical problem that mentions.
In a first aspect, this application provides improved date storage method, methods described includes：Obtain first user to provide
The first Data Identification and initial data corresponding with first Data Identification；By first Data Identification and described
Initial data is stored in as data record in the original row cluster of the tables of data for pre-building, wherein, the tables of data includes original
Beginning row cluster and at least one extension columns cluster；Obtain growth data and corresponding second Data Identification of the growth data；Ring
Second Data Identification described in Ying Yu is consistent with first Data Identification, the expansion that the growth data is stored in the tables of data
In exhibition row cluster in data record corresponding with first Data Identification.
In certain embodiments, methods described also includes the step of pre-building tables of data, described pre-builds tables of data
The step of, including：Setting up includes the tables of data of original row cluster and at least one extension columns cluster；By other in addition to first user
User is set to read-only to the operating right of the original row cluster；By the other users in addition to first user to the extension columns cluster
Operating right be set to readable writeable.
In certain embodiments, the acquisition growth data and corresponding second Data Identification of the growth data, bag
Include：Obtain the transmission data and corresponding second Data Identification of the transmission data produced during original data transmissions, wherein, institute
State the corresponding Data Identification of initial data that corresponding second Data Identification of transmission data is transmission, the transmission data include with
Descend at least one：Operation account information, transmission equipment information, transmission speed information.
In certain embodiments, the acquisition growth data and corresponding second Data Identification of the growth data, bag
Include：Obtain labeled data and corresponding second Data Identification of the labeled data that second user is provided, wherein, the mark
Data second user mark initial data and obtain, corresponding second Data Identification of the labeled data is mark
The corresponding Data Identification of initial data.
In certain embodiments, the initial data include following at least one：The data text of data acquisition equipment collection
Part, collecting device information, acquisition time information, collection positional information.
Second aspect, this application provides a kind of data storage device, described device includes：First acquisition unit, is used for
Obtain the first Data Identification and initial data corresponding with first Data Identification that first user is provided；First storage is single
Unit, for being stored in the tables of data for pre-building using first Data Identification and the initial data as data record
In original row cluster, wherein, the tables of data includes original row cluster and at least one extension columns cluster；Second acquisition unit, is used for
Obtain growth data and corresponding second Data Identification of the growth data；Second memory cell, in response to described
Two Data Identifications are consistent with first Data Identification, by the growth data be stored in the extension columns cluster of the tables of data with
In the corresponding data record of first Data Identification.
In certain embodiments, described device also includes that tables of data sets up unit, and the tables of data sets up unit, further
It is configured to：Setting up includes the tables of data of original row cluster and at least one extension columns cluster；By other use in addition to first user
Family is set to read-only to the operating right of the original row cluster；By the other users in addition to first user to the extension columns cluster
Operating right is set to readable writeable.
In certain embodiments, the second acquisition unit, is further configured to：Produce when obtaining original data transmissions
Transmission data and corresponding second Data Identification of the transmission data, wherein, corresponding second data of the transmission data
Be designated the corresponding Data Identification of initial data of transmission, the transmission data include following at least one：Operation account information,
Transmission equipment information, transmission speed information.
In certain embodiments, the second acquisition unit, is further configured to：Obtain the mark that second user is provided
Data and corresponding second Data Identification of the labeled data, wherein, the labeled data is that second user mark is former
Beginning data and obtain, corresponding second Data Identification of the labeled data is the corresponding Data Identification of initial data of mark.
In certain embodiments, the initial data include following at least one：The data text of data acquisition equipment collection
Part, collecting device information, acquisition time information, collection positional information.
The application provide date storage method and device, by obtain first user provide the first Data Identification and
Initial data corresponding with the first Data Identification, and the first Data Identification and initial data are stored in as data record pre-
In the original row cluster of the tables of data that first sets up, growth data and corresponding second Data Identification of growth data is then obtained, most
Consistent with the first Data Identification in response to the second Data Identification afterwards, growth data is stored in the extension columns cluster of tables of data and
In the corresponding data record of one Data Identification, it is achieved that the extension to initial data, while initial data is stored with growth data
In the same table, it is to avoid conjunctive query, search efficiency is improve.
Description of the drawings
By reading the detailed description made by non-limiting example made with reference to the following drawings, the application other
Feature, objects and advantages will become more apparent upon：
Fig. 1 is that the application can apply to exemplary system architecture figure therein；
Fig. 2 is the flow chart of one embodiment of the date storage method according to the application；
Fig. 3 is the schematic diagram of application scenarios of the date storage method according to the application；
Fig. 4 is the flow chart of another embodiment of the date storage method according to the application；
Fig. 5 is the structural representation of one embodiment of the data storage device of the application according to the application；
Fig. 6 is adapted for the structural representation of the computer system of the equipment for realizing the embodiment of the present application.
Specific embodiment
With reference to the accompanying drawings and examples the application is described in further detail.It is understood that this place is retouched
The specific embodiment that states is used only for explaining related invention, rather than the restriction to the invention.It also should be noted that, in order to
Be easy to describe, illustrate only in accompanying drawing to about the related part of invention.
It should be noted that in the case where not conflicting, the feature in embodiment and embodiment in the application can phase
Mutually combine.Below with reference to the accompanying drawings and in conjunction with the embodiments describing the application in detail.
Fig. 1 shows the exemplary system architecture of the embodiment of the date storage method or device that can apply the application
100.
As shown in figure 1, system architecture 100 can include equipment 101, equipment 102, server 103 and network 104.Network
104 in order between equipment 101, equipment 102 and server 103 provide communication link medium.Network 104 can include various
Connection type, for example wired, wireless communication link or fiber optic cables etc..
Equipment 101, equipment 102 are the equipment that can obtain initial data or the equipment for being previously stored with initial data,
Can be with the computer of data acquisition, data grabber, or data storage function, server or other equipment.
Server 103 can be data warehouse management system operation server thereon, for example, IDC (Internet
Data Center, Internet data center) in be responsible for receiving the data to be stored that other equipment transmission comes, and wait to deposit by described
The server of storage data storage to storage cluster.Data warehouse can be based on HBase (Hadoop Database, Ha Dupu numbers
According to storehouse) set up, HBase is a distributed PostgreSQL database towards row, using HDFS (Hadoop
Distributed File System, Ha Dupu distributed file systems) as its document storage system.Specifically, server
103 the first Data Identifications that first user offer can be provided and initial data corresponding with the first Data Identification, and by the
One Data Identification and initial data are stored in as data record in the original row cluster of the tables of data for pre-building, are then obtained
Growth data and corresponding second Data Identification of growth data, finally in response to the second Data Identification and the first Data Identification one
Cause, growth data is stored in the extension columns cluster of tables of data in data record corresponding with the first Data Identification.
It should be noted that the date storage method provided by the embodiment of the present application is typically executed by server 103, accordingly
Ground, data storage device are generally positioned in server 103.
It should be understood that the number of the equipment, server in Fig. 1 is only schematically.According to needs are realized, can have
Any number of equipment, server.
With continued reference to Fig. 2, the flow process 200 of one embodiment of date storage method according to the application is shown.Described
Date storage method, comprise the following steps：
Step 201, obtains the first Data Identification and original number corresponding with the first Data Identification that first user is provided
According to.
In the present embodiment, date storage method operation electronic equipment (server for example shown in Fig. 1) thereon can
To obtain the first Data Identification and the initial data corresponding with the first Data Identification that first user is provided.User is that data are deposited
The user of storage system, above-mentioned electronic equipment can be directed to different user and arrange different access limits.First Data Identification can
To be data ID, generated according to the coding rule for pre-setting.Initial data is a relative concept, it can be understood as directly
The data for getting, such as collecting device are collected, or data grabber instrument is grabbed, and these data are relative to process
Data after calculating or other processing modes are processed are initial data.For first user, which can be pre-established with
Original table, stores its initial data for obtaining.
In some optional implementations of the present embodiment, initial data can include following at least one：Data are adopted
The data file of collection equipment collection, collecting device information, acquisition time information, collection positional information.I.e. initial data can be
One or more corresponding data, such as initial data can be the data files that collecting device is collected, it is also possible to while bag
Include the data file that collecting device is collected and the acquisition time being acquired, collecting location, collecting device etc..
Step 202, the first Data Identification and initial data are stored in the tables of data for pre-building as data record
Original row cluster in.
In the present embodiment, above-mentioned electronic equipment can be by the first Data Identification obtained in step 201 and original number
According to being stored in as data record in the original row cluster of the tables of data for pre-building.Wherein, tables of data include original row cluster and
At least one extension columns cluster.Row cluster is the set of row, as a example by adopting the data warehouse (HBase) by row storage, by original number
According to being stored in growth data respectively among the different lines cluster of data warehouse, data isolation can be played a part of, be protected original
Data are not modified.For traditional SQL (Structured Query Language, SQL) databases or
Person other databases that increases income also can be made a distinction to initial data column and growth data column according to this logic,
Physical store and treat with a certain discrimination in terms of being subsequently related to the operational controls such as priority assignation.
Step 203, obtains growth data and corresponding second Data Identification of growth data.
In the present embodiment, above-mentioned electronic equipment can obtain growth data and the corresponding second data mark of growth data
Know.Growth data is also a relative concept, is the data obtained after initial data extends.Can be that initial data is carried out
The data that mark is obtained, that is, provide the user of initial data or other users can add mark on the expansion table of initial data
When information, such as traffic lights, the scene information of unmanned vehicle etc., or data sharing, original number by way of expansion table
According to other users use is supplied to, other users have certain modification authority to growth data, and do not interfere with initial data.
In some optional implementations of the present embodiment, the transmission data produced during original data transmissions can be obtained
And corresponding second Data Identification of the transmission data, wherein, corresponding second Data Identification of the transmission data is transmission
The corresponding Data Identification of initial data, the transmission data include following at least one：Operation account information, transmission equipment letter
Breath, transmission speed information.
In some optional implementations of the present embodiment, it is also possible to obtain second user offer labeled data and
Corresponding second Data Identification of the labeled data, wherein, the labeled data is for the second user marks initial data
Obtain, corresponding second Data Identification of the labeled data is the corresponding Data Identification of initial data of mark.Second user
Can identical from first user can also be different with first user.
Step 204, consistent with the first Data Identification in response to the second Data Identification, growth data is stored in tables of data
In extension columns cluster in data record corresponding with the first Data Identification.
In the present embodiment, above-mentioned electronic equipment can be in response to the second Data Identification of acquisition and step in step 203
The first Data Identification obtained in 201 is consistent, and the growth data obtained in step 203 is stored in the extension columns cluster of tables of data
In data record corresponding with the first Data Identification.Second Data Identification is consistent with the first Data Identification illustrate growth data be with
Be present corresponding relation in initial data, can be stored in the extension columns cluster of tables of data and the first Data Identification pair growth data
In the data record that answers.Meanwhile, if there is no the second Data Identification consistent with the first Data Identification, then not by growth data
Be stored in the extension columns cluster of tables of data in data record corresponding with the first Data Identification, i.e., can only increase newly in original table have right
The record that should exist.
In some optional implementations of the present embodiment, described the step of pre-build tables of data, can include building
The vertical table data for including original row cluster and at least one extension columns cluster；By the other users in addition to first user to described original
The operating right of row cluster is set to read-only；Other users in addition to first user are arranged to the operating right of the extension columns cluster
For readable writeable.
In some optional implementations of the present embodiment, the self-defining field of tables of data can cover determining for original table
Justice.The original row cluster of the corresponding physical store of original table, for depositing initial data, such as original table and tables of data is defined simultaneously
" starting time " field, then under default situations, tables of data can only see the starting time of oneself, rather than original table.
With continued reference to Fig. 3, Fig. 3 is a schematic diagram 300 of the application scenarios according to the present embodiment date storage method.?
In the application scenarios of Fig. 3, automatic driving vehicle 301, server 303 and network 302 can be included.Automatic driving vehicle 301 can
To include sampler 3011 and Vehicle Controller 3012.Network 302 in order to automatic driving vehicle 301 and server 303 it
Between provide communication link medium.Network 302 can include various connection types, for example wired, wireless communication link or light
Fiber-optic cable etc..Server 303 can be to provide the server of various services, for example, can receive and store automatic driving vehicle
301 data for uploading simultaneously are stored to the server of storage cluster.Sampler can be installed on automatic driving vehicle 301
3011, sampler can be camera, radar or other sensors.Sampler 3011 can pass through various communication modes
(for example wired, wireless communication link etc.) is by the data is activation for gathering to Vehicle Controller 3012.Vehicle Controller 3012 can be with
It is the calculating such as vehicle-mounted brain or processing equipment, ambient condition information and high accuracy map etc. can be gathered by sampler 3011
Data.The data for collecting are initial data, and as shown in table 1, server 303 is pre-established with including original row initial data
Cluster and the tables of data of extension columns cluster, after getting initial data, are stored to original row cluster, and initial data is uploaded from unmanned vehicle
To transmission information can be produced during server, the operator message, IDC information and transmission speed such as in table 2, using these information as
Extension information Store into extension columns cluster, i.e., in table 2, data ID, driver, collecting location, starting time, end time, number
Original row cluster is constituted according to the corresponding row of file field, the row of operator message, IDC information and transmission speed field constitute extension columns
Cluster.
Table 1
| Data ID | Collecting location | Driver | Starting time | End time | Data file |
| XXX | XXX | XX | XXX | XXXX | XXXX |
Table 2
The number of automatic driving vehicle, sampler, Vehicle Controller and background server in Fig. 3 is only schematically
's.
The application provide date storage method and device, by obtain first user provide the first Data Identification and
Initial data corresponding with the first Data Identification, and the first Data Identification and initial data are stored in as data record pre-
In the original row cluster of the tables of data that first sets up, growth data and corresponding second Data Identification of growth data is then obtained, most
Consistent with the first Data Identification in response to the second Data Identification afterwards, growth data is stored in the extension columns cluster of tables of data and
In the corresponding data record of one Data Identification, it is achieved that the extension to initial data, while initial data is stored with growth data
In the same table, it is to avoid conjunctive query, search efficiency is improve.
With further reference to Fig. 4, the flow process 400 of another embodiment of date storage method is it illustrates.The data storage
The flow process 400 of method, comprises the following steps：
Step 401, setting up includes the tables of data of original row cluster and at least one extension columns cluster.
In the present embodiment, date storage method operation electronic equipment thereon can initially set up one including original
Row cluster and the tables of data of at least one extension columns cluster.Initial data and growth data are stored in different lines cluster and can be played
Data isolation, protection initial data are not modified.Original table, the primary tabulation cluster of corresponding physical store, for depositing original number
According to.The definition that original row cluster and extension columns cluster obtain tables of data can be merged, tables of data can inherit initial data from original table
Field, the field in the extension columns cluster of tables of data only needed for storage growth data.
Step 402, the other users in addition to first user is set to the operating right of original row cluster read-only.
In the present embodiment, date storage method operation electronic equipment thereon can be by other in addition to first user
User is set to read-only to the operating right of original row cluster in the tables of data of foundation in step 401.So, other users can be looked into
Asking initial data protects initial data to be not modified again.
Step 403, the other users in addition to first user is set to the operating right of extension columns cluster readable writeable.
In the present embodiment, date storage method operation electronic equipment thereon can be by other in addition to first user
User is set to readable writeable to the operating right of extension columns cluster in the tables of data of foundation in step 401.With this, other users are only
The field in extension columns cluster can be changed, and the data that inherits in original row cluster can not be changed.
Step 404, obtains the first Data Identification and original number corresponding with the first Data Identification that first user is provided
According to.
In the present embodiment, date storage method operation electronic equipment (server for example shown in Fig. 1) thereon can
To obtain the first Data Identification and the initial data corresponding with the first Data Identification that first user is provided.First Data Identification
And initial data corresponding with the first Data Identification can tentatively store the original table for completing.
Step 405, the first Data Identification and initial data are stored in the tables of data for pre-building as data record
Original row cluster in.
In the present embodiment, above-mentioned electronic equipment can be by the first Data Identification obtained in step 403 and original number
According to being stored in as data record in the original row cluster of the tables of data for pre-building.Wherein, tables of data include original row cluster and
At least one extension columns cluster.Row cluster is the set of row, as a example by adopting the data warehouse (HBase) by row storage, by original number
According to being stored in growth data respectively among the different lines cluster of data warehouse, data isolation can be played a part of, be protected original
Data are not modified.Step 406, obtains growth data and corresponding second Data Identification of growth data.
In the present embodiment, above-mentioned electronic equipment can obtain growth data and the corresponding second data mark of growth data
Know.
Step 407, consistent with the first Data Identification in response to the second Data Identification, growth data is stored in tables of data
In extension columns cluster in data record corresponding with the first Data Identification.
In the present embodiment, above-mentioned electronic equipment can be in response to the second Data Identification of acquisition and step in step 406
The first Data Identification obtained in 403 is consistent, and the growth data obtained in step 406 is stored in the extension columns cluster of tables of data
In data record corresponding with the first Data Identification.
Figure 4, it is seen that from unlike the corresponding embodiments of Fig. 2, being increased in this real-time example first and setting up number
The step of according to table, and the setting of access limit has been carried out to different lines cluster, initial data can be extended with this, again will not
Initial data is affected, while initial data and growth data are stored in same table, it is to avoid conjunctive query, improve inquiry
Efficiency.
With further reference to Fig. 5, as the realization to method shown in above-mentioned each figure, this application provides a kind of data storage dress
The one embodiment that puts, the device embodiment are corresponding with the embodiment of the method shown in Fig. 2, and the device specifically can apply to respectively
Plant in electronic equipment.
As shown in figure 5, the data storage device 500 described in the present embodiment includes：First acquisition unit 501, for obtaining
The first Data Identification and initial data corresponding with first Data Identification that first user is provided；First memory cell
502, for first Data Identification and the initial data are stored in the tables of data for pre-building as data record
Original row cluster in, wherein, the tables of data includes original row cluster and at least one extension columns cluster；Second acquisition unit 503,
For obtaining growth data and corresponding second Data Identification of the growth data；Second memory cell 504, in response to
Second Data Identification is consistent with first Data Identification, the extension columns that the growth data is stored in the tables of data
In cluster in data record corresponding with first Data Identification.
In the present embodiment, first acquisition unit 501, the first memory cell 502, second acquisition unit 503 and second
The concrete process of memory cell 504 may be referred to the corresponding embodiment steps 201 of Fig. 2, step 202, step 203 and step 204
Describe in detail, will not be described here.
In some optional implementations of the present embodiment, described device also includes that tables of data sets up unit, the number
Unit is set up according to table, is further configured to：Setting up includes the tables of data of original row cluster and at least one extension columns cluster；To remove
Other users outside first user are set to read-only to the operating right of the original row cluster；By other use in addition to first user
Family is set to readable writeable to the operating right of the extension columns cluster.
In some optional implementations of the present embodiment, the second acquisition unit 503 is further configured to：
The transmission data and corresponding second Data Identification of the transmission data produced during original data transmissions is obtained, wherein, described
Corresponding second Data Identification of transmission data is the corresponding Data Identification of the initial data that transmits, and the transmission data includes following
At least one：Operation account information, transmission equipment information, transmission speed information.
In some optional implementations of the present embodiment, the second acquisition unit 503 is further configured to：
Obtain labeled data and corresponding second Data Identification of the labeled data that second user is provided, wherein, the mark number
Initial data is marked according to the second user and is obtained, corresponding second Data Identification of the labeled data is the original of mark
The corresponding Data Identification of beginning data.
In some optional implementations of the present embodiment, the initial data include following at least one：Data are adopted
The data file of collection equipment collection, collecting device information, acquisition time information, collection positional information.
Below with reference to Fig. 6, the knot of the computer system 600 for being suitable to the equipment for realizing the embodiment of the present application is it illustrates
Structure schematic diagram.
As shown in fig. 6, computer system 600 includes CPU (CPU) 601, which can be read-only according to being stored in
Program in memory (ROM) 602 or be loaded into the program in random access storage device (RAM) 603 from storage part 608 and
Execute various appropriate actions and process.In RAM 603, the system that is also stored with 600 operates required various programs and data.
CPU 601, ROM 602 and RAM 603 are connected with each other by bus 604.Input/output (I/O) interface 605 is also connected to always
Line 604.
I/O interfaces 605 are connected to lower component：Importation 606 including keyboard, mouse etc.；Including such as liquid crystal
Show the output par, c 607 of device (LCD) etc. and loudspeaker etc.；Storage part 608 including hard disk etc.；And including such as LAN
The communications portion 609 of the NIC of card, modem etc..Communications portion 609 is executed via the network of such as internet
Communication process.Driver 610 is also according to needing to be connected to I/O interfaces 605.Detachable media 611, such as disk, CD, magneto-optic
Disk, semiconductor memory etc., as needed on driver 610, in order to the computer program root for reading from it
Part 608 is stored according to needing to be mounted into.
Especially, in accordance with an embodiment of the present disclosure, the process above with reference to flow chart description may be implemented as computer
Software program.For example, embodiment of the disclosure includes a kind of computer program, and which includes being tangibly embodied in machine readable
Computer program on medium, the computer program include the program code for the method shown in execution flow chart.At this
In the embodiment of sample, the computer program can be downloaded and installed from network by communications portion 609, and/or from removable
Unload medium 611 to be mounted.When the computer program is executed by CPU (CPU) 601, execute in the present processes
The above-mentioned functions of restriction.
Flow chart and block diagram in accompanying drawing, it is illustrated that according to the system of the various embodiments of the application, method and computer journey
The architectural framework in the cards of sequence product, function and operation.At this point, each square frame in flow chart or block diagram can generation
A part for table one module, program segment or code, a part for the module, program segment or code is comprising one or more
For realizing the executable instruction of the logic function of regulation.It should also be noted that in some are as the realization that replaces, institute in square frame
The function of mark can also occur with the order for being different from marked in accompanying drawing.For example, the two square frame reality for succeedingly representing
On can execute substantially in parallel, they can also be executed sometimes in the opposite order, and this is depending on involved function.Also to
It is noted that the combination of block diagram and/or each square frame and block diagram and/or the square frame in flow chart in flow chart, Ke Yiyong
Execute the function of regulation or the special hardware based system of operation to realize, or can be referred to computer with specialized hardware
The combination of order is realizing.
It is described in involved unit in the embodiment of the present application to realize by way of software, it is also possible to by hard
The mode of part is realizing.Described unit can also be arranged within a processor, for example, it is possible to be described as：A kind of processor bag
Include first acquisition unit, the first memory cell, second acquisition unit and the second memory cell.Wherein, the title of these units
Do not constituted to the unit restriction of itself under certain conditions, for example, first acquisition unit is also described as " obtaining the
The first Data Identification and the unit of initial data corresponding with first Data Identification that one user provides ".
As on the other hand, present invention also provides a kind of nonvolatile computer storage media, the non-volatile calculating
Machine storage medium can be the nonvolatile computer storage media described in above-described embodiment included in device；Can also be
Individualism, without the nonvolatile computer storage media that allocates in terminal.Above-mentioned nonvolatile computer storage media is deposited
One or more program is contained, when one or more of programs are executed by an equipment so that the equipment：Obtain
The first Data Identification and initial data corresponding with first Data Identification that first user is provided；By first data
Mark and the initial data are stored in as data record in the original row cluster of the tables of data for pre-building, wherein, described
Tables of data includes original row cluster and at least one extension columns cluster；Obtain growth data and the growth data corresponding second
Data Identification；Consistent with first Data Identification in response to second Data Identification, the growth data is stored in institute
State in the extension columns cluster of tables of data in data record corresponding with first Data Identification.
Above description is only the preferred embodiment and the explanation to institute's application technology principle of the application.People in the art
Member should be appreciated that involved invention scope in the application, however it is not limited to the technology of the particular combination of above-mentioned technical characteristic
Scheme, while should also cover in the case of without departing from the inventive concept, is carried out by above-mentioned technical characteristic or its equivalent feature
Other technical schemes for being combined and being formed.Such as features described above has similar work(with (but not limited to) disclosed herein
The technical scheme that the technical characteristic of energy is replaced mutually and formed.
Claims (10)
1. a kind of date storage method, it is characterised in that methods described includes：
Obtain the first Data Identification and initial data corresponding with first Data Identification that first user is provided；
The original that first Data Identification and the initial data are stored in the tables of data for pre-building as data record
In beginning row cluster, wherein, the tables of data includes original row cluster and at least one extension columns cluster；
Obtain growth data and corresponding second Data Identification of the growth data；
Consistent with first Data Identification in response to second Data Identification, the growth data is stored in the data
In the extension columns cluster of table in data record corresponding with first Data Identification.
2. method according to claim 1, it is characterised in that methods described also includes the step of pre-building tables of data,
Described the step of pre-build tables of data, including：
Setting up includes the tables of data of original row cluster and at least one extension columns cluster；
Other users in addition to first user are set to the operating right of the original row cluster read-only；
Other users in addition to first user are set to the operating right of the extension columns cluster readable writeable.
3. method according to claim 1 and 2, it is characterised in that the acquisition growth data and the growth data
Corresponding second Data Identification, including：
The transmission data and corresponding second Data Identification of the transmission data produced during original data transmissions is obtained, wherein,
Corresponding second Data Identification of the transmission data is the corresponding Data Identification of initial data of transmission, and the transmission data includes
Below at least one：Operation account information, transmission equipment information, transmission speed information.
4. method according to claim 1 and 2, it is characterised in that the acquisition growth data and the growth data
Corresponding second Data Identification, including：
Obtain labeled data and corresponding second Data Identification of the labeled data that second user is provided, wherein, the mark
Note data second user mark initial data and obtain, corresponding second Data Identification of the labeled data is mark
The corresponding Data Identification of initial data.
5. method according to claim 1 and 2, it is characterised in that the initial data include following at least one：Data
The data file of collecting device collection, collecting device information, acquisition time information, collection positional information.
6. a kind of data storage device, it is characterised in that described device includes：
First acquisition unit, for obtaining first Data Identification and corresponding with first Data Identification of first user offer
Initial data；
First memory cell, for first Data Identification and the initial data to be stored in as data record in advance
In the original row cluster of the tables of data of foundation, wherein, the tables of data includes original row cluster and at least one extension columns cluster；
Second acquisition unit, for obtaining growth data and corresponding second Data Identification of the growth data；
Second memory cell, for consistent with first Data Identification in response to second Data Identification, by the extension
Data storage is in the extension columns cluster of the tables of data in data record corresponding with first Data Identification.
7. device according to claim 6, it is characterised in that described device also includes that tables of data sets up unit, the number
Unit is set up according to table, is further configured to：
Setting up includes the tables of data of original row cluster and at least one extension columns cluster；
Other users in addition to first user are set to the operating right of the original row cluster read-only；
Other users in addition to first user are set to the operating right of the extension columns cluster readable writeable.
8. the device according to claim 6 or 7, it is characterised in that the second acquisition unit, is further configured to：
The transmission data and corresponding second Data Identification of the transmission data produced during original data transmissions is obtained, wherein,
Corresponding second Data Identification of the transmission data is the corresponding Data Identification of initial data of transmission, and the transmission data includes
Below at least one：Operation account information, transmission equipment information, transmission speed information.
9. the device according to claim 6 or 7, it is characterised in that the second acquisition unit, is further configured to：
Obtain labeled data and corresponding second Data Identification of the labeled data that second user is provided, wherein, the mark
Note data second user mark initial data and obtain, corresponding second Data Identification of the labeled data is mark
The corresponding Data Identification of initial data.
10. the device according to claim 6 or 7, it is characterised in that the initial data include following at least one：Number
According to the data file of collecting device collection, collecting device information, acquisition time information, collection positional information.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201610930769.2A CN106503166A (en) | 2016-10-31 | 2016-10-31 | Date storage method and device |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201610930769.2A CN106503166A (en) | 2016-10-31 | 2016-10-31 | Date storage method and device |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN106503166A true CN106503166A (en) | 2017-03-15 |
Family
ID=58318813
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201610930769.2A Pending CN106503166A (en) | 2016-10-31 | 2016-10-31 | Date storage method and device |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN106503166A (en) |
Cited By (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN109445704A (en) * | 2018-10-29 | 2019-03-08 | 南京录信软件技术有限公司 | A method of it is comprehensive to store mass data using plurality of devices |
| CN113051301A (en) * | 2021-03-08 | 2021-06-29 | 网宿科技股份有限公司 | Object storage method, system and equipment |
| CN114979289A (en) * | 2022-05-19 | 2022-08-30 | 北京达佳互联信息技术有限公司 | Data distribution method, apparatus, system, device, medium, and program product |
Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101610464A (en) * | 2008-06-18 | 2009-12-23 | 联想(北京)有限公司 | A kind of method and apparatus of transfer of data |
| CN103473362A (en) * | 2013-09-26 | 2013-12-25 | 杭州意能软件有限公司 | Data migration method and system and receiving port module |
| CN104216989A (en) * | 2014-09-09 | 2014-12-17 | 广东电网公司中山供电局 | Method for storing transmission line integrated data based on HBase |
| CN104820700A (en) * | 2015-05-08 | 2015-08-05 | 中国南方电网有限责任公司电网技术研究中心 | Processing method of unstructured data of transformer substation |
-
2016
- 2016-10-31 CN CN201610930769.2A patent/CN106503166A/en active Pending
Patent Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101610464A (en) * | 2008-06-18 | 2009-12-23 | 联想(北京)有限公司 | A kind of method and apparatus of transfer of data |
| CN103473362A (en) * | 2013-09-26 | 2013-12-25 | 杭州意能软件有限公司 | Data migration method and system and receiving port module |
| CN104216989A (en) * | 2014-09-09 | 2014-12-17 | 广东电网公司中山供电局 | Method for storing transmission line integrated data based on HBase |
| CN104820700A (en) * | 2015-05-08 | 2015-08-05 | 中国南方电网有限责任公司电网技术研究中心 | Processing method of unstructured data of transformer substation |
Cited By (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN109445704A (en) * | 2018-10-29 | 2019-03-08 | 南京录信软件技术有限公司 | A method of it is comprehensive to store mass data using plurality of devices |
| CN113051301A (en) * | 2021-03-08 | 2021-06-29 | 网宿科技股份有限公司 | Object storage method, system and equipment |
| CN114979289A (en) * | 2022-05-19 | 2022-08-30 | 北京达佳互联信息技术有限公司 | Data distribution method, apparatus, system, device, medium, and program product |
| CN114979289B (en) * | 2022-05-19 | 2024-03-19 | 北京达佳互联信息技术有限公司 | Data distribution method, apparatus, system, device, medium and program product |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN116339277A (en) | Over The Air (OTA) mobile service platform | |
| US9207090B2 (en) | System and method for dynamic path optimization | |
| DE202011110851U1 (en) | Device of route guidance | |
| US9607091B2 (en) | Methods, systems, and computer program products for implementing intelligent agent services | |
| US20200128033A1 (en) | Attack situation visualization device, attack situation visualization method and recording medium | |
| US10931779B2 (en) | Systems and methods for data processing | |
| US20200334246A1 (en) | Information processing device, combination condition generation method, and combination condition generation program | |
| CN106503202A (en) | The Dynamic Configuration that a kind of data drawing list linkage shows | |
| CN106503166A (en) | Date storage method and device | |
| CN103164529B (en) | A kind of anti-k nearest neighbor query method based on Voronoi diagram | |
| CN107657357B (en) | Data processing method and device | |
| US20230375363A1 (en) | Map tile update method and apparatus | |
| JP6480263B2 (en) | Software distribution management system and software distribution management method | |
| CN106919590A (en) | A kind of multi-business multiplexing processing method, device and system | |
| CN109783589B (en) | Method, device and storage medium for resolving address of electronic map | |
| CN103365886A (en) | Method for querying space events in internet of vehicles and optimizing querier | |
| CN107071036A (en) | A kind of method, the webserver and system for downloading driving file | |
| US20200341965A1 (en) | Data Tokenization System Maintaining Data Integrity | |
| CN113285960B (en) | Data encryption method and system for service data sharing cloud platform | |
| CN110334065A (en) | A kind of document handling method and system | |
| CN114860806A (en) | Data query method and device of block chain, computer equipment and storage medium | |
| CN114661736A (en) | Electronic map updating method and device, electronic equipment, storage medium and product | |
| US20200191579A1 (en) | Method and apparatus for processing positioning data, device, storage medium and vehicle | |
| CN110363515B (en) | Rights and interests card account information inquiry method, system, server and readable storage medium | |
| US20160191602A1 (en) | System and method for automating the transfer of data from a web interface to a database or another web interface |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| RJ01 | Rejection of invention patent application after publication |
Application publication date: 20170315 |
|
| RJ01 | Rejection of invention patent application after publication |