CN106227899A - The storage of the big data of a kind of internet of things oriented and querying method - Google Patents
The storage of the big data of a kind of internet of things oriented and querying method Download PDFInfo
- Publication number
- CN106227899A CN106227899A CN201610797518.1A CN201610797518A CN106227899A CN 106227899 A CN106227899 A CN 106227899A CN 201610797518 A CN201610797518 A CN 201610797518A CN 106227899 A CN106227899 A CN 106227899A
- Authority
- CN
- China
- Prior art keywords
- data
- storage
- internet
- things
- access
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/30—Information retrieval; Database structures therefor; File system structures therefor of unstructured textual data
- G06F16/33—Querying
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/20—Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
- G06F16/27—Replication, distribution or synchronisation of data between databases or within a distributed database system; Distributed database system architectures therefor
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/20—Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
- G06F16/28—Databases characterised by their database models, e.g. relational or object models
- G06F16/284—Relational databases
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L67/00—Network arrangements or protocols for supporting network services or applications
- H04L67/01—Protocols
- H04L67/10—Protocols in which an application is distributed across nodes in the network
- H04L67/1097—Protocols in which an application is distributed across nodes in the network for distributed storage of data in networks, e.g. transport arrangements for network file system [NFS], storage area networks [SAN] or network attached storage [NAS]
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L67/00—Network arrangements or protocols for supporting network services or applications
- H04L67/50—Network services
- H04L67/56—Provisioning of proxy services
- H04L67/568—Storing data temporarily at an intermediate stage, e.g. caching
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L67/00—Network arrangements or protocols for supporting network services or applications
- H04L67/50—Network services
- H04L67/56—Provisioning of proxy services
- H04L67/568—Storing data temporarily at an intermediate stage, e.g. caching
- H04L67/5683—Storage of data provided by user terminals, i.e. reverse caching
Abstract
The invention belongs to design and application of software technical field, be specifically related to storage and the querying method of the big data of a kind of internet of things oriented, its application suiting field, smart city is actual, has powerful application prospect.The method comprises the steps: step S1: gathered data by sensor device layer；Step S2: carry out data parsing by data parsing；Step S3: carry out data storage by data storage layer；Step S4: carry out data query by data query layer；Compared with prior art, the present invention provides a kind of high speed storing at Internet of Things big market demand FIELD Data and the method for inquiry, it is possible to overcome the shortcoming and defect based on traditional data library storage and inquiry.
Description
Technical field
The invention belongs to design and application of software technical field, be specifically related to the big data of a kind of internet of things oriented storage and
Querying method, its application suiting field, smart city is actual, has powerful application prospect.
Background technology
Being the epoch from Internet era to Internet of Things now, Internet of Things is continue computer, the Internet and mobile logical
The revolutionary development of the information industry again after letter.Internet of Things is the extension on Internet basic and extension, passes through intelligence
Can perception, identify that technology communicates with general fit calculation etc. cognition technology, be widely used in the fusion of network.Appearing as of Internet of Things
Innovation and the development in the fields such as smart city provide technical support.Along with the scope of technology of Internet of things application constantly expands, thing
The data that networking produces also constantly are expanding, and huge the arriving of its involved data volume cannot be by current main software work
Tool reaches to capture within the rational time, manage, process and provide useful information based on this, thus define the Internet of Things epoch with
The fusion of big data age.The feature of the big data of Internet of Things has the following aspects.First, the data volume in Internet of Things is more
Greatly, one of main feature of Internet of Things is the magnanimity of node, in addition to people and server, and article, equipment, Sensor Network etc.
Being all the composition node of Internet of Things, its quantity size is much larger than the Internet；Meanwhile, the data genaration frequency of Internet of things node is the highest
In the Internet, as sensing node majority is in full-time state, datastream source source is continuous.Second, the data speed in Internet of Things
Rate is higher, on the one hand, in Internet of Things, data magnanimity inevitable requirement backbone network converges more data, and the transfer rate of data is wanted
Ask higher；On the other hand, due to Internet of Things and real physical world direct correlation, a lot of in the case of need real time access, control
Corresponding node and equipment, it is therefore desirable to high data rate supports corresponding real-time.3rd, the data in Internet of Things
More diversified, what Internet of Things related to has wide range of applications, from smart city, wisdom traffic, wisdom logistics, commodity trace to the source, arrive
Smart Home, intelligent medical treatment, safety monitoring etc., none is not Internet of Things application category；In different field, different industries, need
In the face of dissimilar, the application data of different-format, therefore in Internet of Things, data diversity is the most prominent.
Comprehensive above analysis is it can be seen that big data are necessary key technologies in Internet of Things, and the combination of the two can be
The development of Internet of things system and application brings superior technique basis.Therefore, in the urgent need to the storage for the big data of Internet of Things
With inquiry problem, through practice and the application of wisdom pipe network project, it is proposed that the big data store query of a kind of internet of things oriented
Technology and method, it is adaptable to the Internet of Things applications such as wisdom pipe network.
Summary of the invention
(1) to solve the technical problem that
The technical problem to be solved in the present invention is: how to overcome based on traditional data library storage and the shortcoming of inquiry and not
Foot, it is provided that a kind of high speed storing at Internet of Things big market demand FIELD Data and the method for inquiry.
(2) technical scheme
For solving above-mentioned technical problem, the present invention provides storage and the querying method of the big data of a kind of internet of things oriented, its
Being characterised by, it comprises the steps:
Step S1: gathered data by sensor device layer；
The data source of Internet of Things application both is from and the sensor device of various specialties；Thing in sensor device layer
Connection detecting sensor is responsible for that original agreement packet is sent to upper strata and is carried out data parsing；
Step S2: carry out data parsing by data parsing；
Owing to Internet of Things detecting sensor collection the data that report are data based on its specific protocol, at Web communication layer
From the point of view of face, the data of transmission belong to raw data packets, it is impossible to be pushed directly in system application directly apply, need to set according to this
Standby communication protocol carries out resolving the data of form format to initial data message；Owing to different sensor applications differs
Sample, the data form that sensing data is formed after resolving is divided into structural data, semi-structured data, unstructured data；Its
In,
Structural data: the data obtained during for resolving most sensing data are all structural datas, including
Temperature sensor, the data message reporting a certain moment contains device numbering, equipment vendors, device protocol after resolving, sets
Standby operation conditions, temperature data, the temporal information of generation data, the form of these information is all changeless, thus in accordance with
Traditional relational data processing mode, creates temperature sensor data table, by above business information according to corresponding field letter
Breath storage；
Semi-structured data: in the Internet of Things of some particular demands, special scenes is applied, though the data of some sensor
It is so structurized, but its structure is not permanent, but there is diversity and the variability of structure；This kind of data include
City Buried Pipeline water supply professional monitoring station data, although be the Monitoring Data of same specialty, but owing to this specialty makes
With different equipment, causing the data uploaded is inconsistent from a structural point, and such data belong to semi-structured number
According to；
Unstructured data: unstructured data is the information that cannot directly know its content, including view data, sound
Data, video data；For an important application photographic head in Internet of Things, this equipment produce data be exactly image,
Sound and video, these data store in relevant database the most relatively difficult when inquiring about and check；
Step S3: carry out data storage by data storage layer；
Data storage layer is responsible for storing the data processed through data parsing layer, and the type for different pieces of information uses different
Storage strategy solves the storage problem of data diversity；Store in relevant database for structural data, for half
Structural data stores in distributed data base, stores in DFS for unstructured data；Wherein,
RDBMS: due to current RDBMS range than wide, mature ratio is higher, so knot
Structure data store in relevant database RDBMS, including Oracle, MySQL；
Distributed data base: for semi-structured data, due to the uncertain and variational feature of structure,
RDBMS technical system is difficult to process the change of such structure, but in popular big data technique, based on row storage
Distributed data base technique be applicable to list structure uncertain and change scene；Row storage is gained the name and is derived from its storage data
Be not both maximum with RDBMS of mode stores data according to row, and it is to facilitate storage organizationization and half that row store maximum feature
Structurized data, conveniently do data compression, for having the biggest IO advantage for the inquiry of certain string or a few row；
DFS: for unstructured data, if using RDBMS to store image, sound and video, general does
Method is to set up one to comprise numbering, content description, the table of tri-fields of content blob, and unstructured data is saved in content blob
In field, so storage for a large amount of unstructured datas is a great challenge；For this problem, use distributed
Non-structured data are stored in a file system by file system DFS, and distributed Technical Architecture can well solve
The certainly storage problem of magnanimity unstructured data；
Step S4: carry out data query by data query layer；
Data query is to be stored as basis with the data of lower floor, provides data fast and efficiently to look into for upper system application
Ask service；By using query caching technology to solve the quick indexing of mass data, access the access controlling to be used for limiting data
Authority, the access mode of data uses the form issuing data, services；Specifically include: query caching, access control, data clothes
Business；
Query caching: owing to the huge of Internet of Things data volume and system access the frequent degree height of data, reading data
Time disk I/O operation frequently, but the speed of disk I/O is slow, efficiency is low, and the reading efficiency causing data is low；Use caching
Technology can allow internal storage data read replacement disk and read, and the reading speed of internal storage data reads far faster than disk, thus improves
The efficiency of digital independent；
Query caching diversity group's distributed caching and local cache；Owing to bottom storage uses distributed computing technology, reading
If node is found in turn during certain data, search efficiency will certainly be affected.Distributed caching can high-performance ground read data,
Can dynamically extend cache node, can automatically find and switch failure node, can automatic equalization data partition, Er Qieneng
Enough provide patterned administration interface for user, dispose and maintenance is quite convenient to；Local cache refers to client computer local
Physical memory mark off a part of space and be written back to the data of server for buffering client computer, by the data of client computer write-back
The most first write server hard disc, but write-back is first write local write-back buffer, when spatial cache reaches certain valve
During value, then by write back data to server；After having had local write-back buffer function, can be substantially reduced server read-write pressure and
Offered load；
Access and control: access controls to be responsible for application system and enters the access rights of system when sending data access request
The management function of row authentication vs. authorization；
Data, services: provide data access interface to application system by the way of issuing data, services, this interface realizes
The concordance of interface when accessing isomeric data, user is without being concerned about that data are stored in RDBMS or distributed data base still
DFS。
(3) beneficial effect
Compared with prior art, the present invention provide a kind of high speed storing at Internet of Things big market demand FIELD Data and
The method of inquiry, it is possible to overcome the shortcoming and defect based on traditional data library storage and inquiry.
Accompanying drawing explanation
Fig. 1 is the principle schematic of technical solution of the present invention.
Detailed description of the invention
For making the purpose of the present invention, content and advantage clearer, below in conjunction with the accompanying drawings and embodiment, to the present invention's
Detailed description of the invention is described in further detail.
For solving problem of the prior art, the present invention provides storage and the querying method of the big data of a kind of internet of things oriented,
As it is shown in figure 1, it specifically includes following steps:
Step S1: gathered data by sensor device layer；
The data source of Internet of Things application both typically is from and the sensor device of various specialties；With City Buried Pipeline
As a example by integrated management application, the sensor installed on each special pipelines, such as temperature sensor, pressure transducer, flow
The most all ruuning situation of each parameter index upload data in monitoring pipeline such as sensor, different equipment uses not
Same agreement, then the form of data source, the reception mode of data all can be very different.Internet of Things sense in sensor device layer
Know that sensor is responsible for that original agreement packet is sent to upper strata and is carried out data parsing；
Step S2: carry out data parsing by data parsing；
Owing to Internet of Things detecting sensor collection the data that report are data based on its specific protocol, at Web communication layer
From the point of view of face, the data of transmission belong to raw data packets, it is impossible to be pushed directly in system application directly apply, need to set according to this
Standby communication protocol carries out resolving the data of form format to initial data message；Owing to different sensor applications differs
Sample, the data form that sensing data is formed after resolving can be divided into structural data, semi-structured data, destructuring number
According to；Wherein,
Structural data: the data obtained during for resolving most sensing data are all structural datas, including
Temperature sensor, the data message reporting a certain moment contains device numbering, equipment vendors, device protocol after resolving, sets
Standby operation conditions, temperature data, time etc. information of generation data, the form of these information is all changeless, thus
According to traditional relational data processing mode, create temperature sensor data table, by above business information according to corresponding word
Segment information stores；
Semi-structured data: in the Internet of Things of some particular demands, special scenes is applied, though the data of some sensor
It is so structurized, but its structure is not permanent, but there is diversity and the variability of structure；This kind of data include
City Buried Pipeline water supply professional monitoring station data, although be the Monitoring Data of same specialty, but owing to this specialty makes
With different equipment, causing the data uploaded is inconsistent from a structural point, and such data belong to semi-structured number
According to；
Unstructured data: unstructured data is the information that cannot directly know its content, including view data, sound
Data, video data；For an important application photographic head in Internet of Things, this equipment produce data be exactly image,
Sound and video, these data store in relevant database the most relatively difficult when inquiring about and check；
Step S3: carry out data storage by data storage layer；
Data storage layer is responsible for storing the data processed through data parsing layer, and the type for different pieces of information uses difference
Storage strategy solve the storage problem of data diversity；Store in relevant database for structural data, for
Semi-structured data stores in distributed data base, stores in DFS for unstructured data；Wherein,
RDBMS: due to current RDBMS range than wide, mature ratio is higher, so knot
Structure data store in relevant database RDBMS, including Oracle, MySQL；And in the face of the big data problem of Internet of Things,
I.e. data scale and the huge problem of magnitude, the relevant database such as Oracle, MySQL also provides distributed type assemblies etc. and solves
Scheme；
Distributed data base: for semi-structured data, due to the uncertain and variational feature of structure,
RDBMS technical system is difficult to process the change of such structure, but in popular big data technique, based on row storage
Distributed data base technique be applicable to list structure uncertain and change scene；Row storage is gained the name and is derived from its storage data
Be not both maximum with RDBMS of mode stores data according to row, and it is to facilitate storage organizationization and half that row store maximum feature
Structurized data, conveniently do data compression, for having the biggest IO advantage for the inquiry of certain string or a few row；
DFS: for unstructured data, if using RDBMS to store image, sound and video, general does
Method is to set up one to comprise numbering, content description, the table of tri-fields of content blob, and unstructured data is saved in content blob
In field, so storage for a large amount of unstructured datas is a great challenge；For this problem, use distributed
Non-structured data are stored in a file system by file system DFS, and distributed Technical Architecture can well solve
The certainly storage problem of magnanimity unstructured data；
Step S4: carry out data query by data query layer；
Data query is to be stored as basis with the data of lower floor, provides data fast and efficiently to look into for upper system application
Ask service；By using query caching technology to solve the quick indexing of mass data, access the access controlling to be used for limiting data
Authority, the access mode of data uses the form issuing data, services；Specifically include: query caching, access control, data clothes
Business；
Query caching: owing to the huge of Internet of Things data volume and system access the frequent degree height of data, reading data
Time disk I/O operation frequently, but the speed of disk I/O is slow, efficiency is low, and the reading efficiency causing data is low；Use caching
Technology can allow internal storage data read replacement disk and read, and the reading speed of internal storage data reads far faster than disk, thus improves
The efficiency of digital independent；
Query caching diversity group's distributed caching and local cache；Owing to bottom storage uses distributed computing technology, reading
If node is found in turn during certain data, search efficiency will certainly be affected.Distributed caching can high-performance ground read data,
Can dynamically extend cache node, can automatically find and switch failure node, can automatic equalization data partition, Er Qieneng
Enough provide patterned administration interface for user, dispose and maintenance is quite convenient to；Local cache refers to client computer local
Physical memory mark off a part of space and be written back to the data of server for buffering client computer, this technology is by client computer write-back
Data the most first write server hard disc, but write-back is first write local write-back buffer, when spatial cache reaches one
During fixed threshold values, then by write back data to server；After having had local write-back buffer function, server read-write can be substantially reduced
Pressure and offered load；
Access and control: access controls to be responsible for application system and enters the access rights of system when sending data access request
The management function of row authentication vs. authorization；
Data, services: provide data access interface to application system by the way of issuing data, services, this interface realizes
The concordance of interface when accessing isomeric data, user is without being concerned about that data are stored in RDBMS or distributed data base still
DFS。
The above is only the preferred embodiment of the present invention, it is noted that for the ordinary skill people of the art
For Yuan, on the premise of without departing from the technology of the present invention principle, it is also possible to make some improvement and deformation, these improve and deformation
Also should be regarded as protection scope of the present invention.
Claims (1)
1. the storage of the big data of internet of things oriented and querying method, it is characterised in that it comprises the steps:
Step S1: gathered data by sensor device layer；
The data source of Internet of Things application both is from and the sensor device of various specialties；Internet of Things sense in sensor device layer
Know that sensor is responsible for that original agreement packet is sent to upper strata and is carried out data parsing；
Step S2: carry out data parsing by data parsing；
Owing to Internet of Things detecting sensor collection the data that report are data based on its specific protocol, come in network service aspect
Say that the data of transmission belong to raw data packets, it is impossible to be pushed directly in system application directly apply, need according to this equipment
Communication protocol carries out resolving the data of form format to initial data message；Owing to different sensor applications is different, pass
The data form formed after sensor data parsing is divided into structural data, semi-structured data, unstructured data；Wherein,
Structural data: the data obtained during for resolving most sensing data are all structural datas, including temperature
Sensor, the data message reporting a certain moment contains device numbering, equipment vendors, device protocol, equipment fortune after resolving
Row situation, temperature data, the temporal information of generation data, the form of these information is all changeless, thus in accordance with tradition
Relational data processing mode, create temperature sensor data table, above business information deposited according to corresponding field information
Storage；
Semi-structured data: in the Internet of Things of some particular demands, special scenes is applied, although the data of some sensor are
Structurized, but its structure is not permanent, but there is diversity and the variability of structure；This kind of data include city
Underground utilities water supply professional monitoring station data, although be the Monitoring Data of same specialty, but owing to this specialty employs
Different equipment, causing the data uploaded is inconsistent from a structural point, and such data belong to semi-structured data；
Unstructured data: unstructured data is the information that cannot directly know its content, including view data, sound number
According to, video data；For an important application photographic head in Internet of Things, the data that this equipment produces are exactly image, sound
Sound and video, these data store in relevant database the most relatively difficult when inquiring about and check；
Step S3: carry out data storage by data storage layer；
Data storage layer is responsible for storing the data processed through data parsing layer, and the type for different pieces of information uses different storages
Strategy solves the storage problem of data diversity；Store in relevant database for structural data, for half structure
Change data and store in distributed data base, unstructured data is stored in DFS；Wherein,
RDBMS: due to current RDBMS range than wide, mature ratio is higher, so structuring
Data store in relevant database RDBMS, including Oracle, MySQL；
Distributed data base: for semi-structured data, due to the uncertain and variational feature of structure,
RDBMS technical system is difficult to process the change of such structure, but in popular big data technique, based on row storage
Distributed data base technique be applicable to list structure uncertain and change scene；Row storage is gained the name and is derived from its storage data
Be not both maximum with RDBMS of mode stores data according to row, and it is to facilitate storage organizationization and half that row store maximum feature
Structurized data, conveniently do data compression, for having the biggest IO advantage for the inquiry of certain string or a few row；
DFS: for unstructured data, if using RDBMS to store image, sound and video, general way is
Setting up one and comprise numbering, content description, the table of tri-fields of content blob, unstructured data is saved in content blob field
In, so storage for a large amount of unstructured datas is a great challenge；For this problem, use distributed document
Non-structured data are stored in a file system by system DFS, and distributed Technical Architecture can well solve sea
The storage problem of amount unstructured data；
Step S4: carry out data query by data query layer；
Data query is to be stored as basis with the data of lower floor, provides data query clothes fast and efficiently for upper system application
Business；By using query caching technology to solve the quick indexing of mass data, access the access rights controlling to be used for limiting data,
The access mode of data uses the form issuing data, services；Specifically include: query caching, access control, data, services；
Query caching: owing to the huge of Internet of Things data volume and system access the frequent degree height of data, reading data time-frequency
Numerous disk I/O operation, but the speed of disk I/O is slow, efficiency is low, the reading efficiency causing data is low；Use caching technology
Internal storage data can be allowed to read replaces disk to read, and the reading speed of internal storage data reads far faster than disk, thus improves data
The efficiency read；
Query caching diversity group's distributed caching and local cache；Owing to bottom storage uses distributed computing technology, reading certain
If node is found in turn during data, search efficiency will certainly be affected.Distributed caching can high-performance ground read data, can
Dynamically extend cache node, can automatically find and switch failure node, can automatic equalization data partition, and can be
User provides patterned administration interface, disposes and maintenance is quite convenient to；Local cache refers to the thing local by client computer
Reason internal memory marks off a part of space and is written back to the data of server for buffering client computer, by the data of client computer write-back no longer
First write server hard disc, but write-back is first write local write-back buffer, when spatial cache reaches certain threshold values,
Again by write back data to server；After having had local write-back buffer function, server read-write pressure and network can be substantially reduced
Load；
Access and control: access controls to be responsible for application system and tests the access rights of system when sending data access request
Card and the management function authorized；
Data, services: provide data access interface to application system by the way of issuing data, services, this interface realizes accessing
The concordance of interface during isomeric data, user is without being concerned about that data are stored in RDBMS or distributed data base or DFS.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201610797518.1A CN106227899A (en) | 2016-08-31 | 2016-08-31 | The storage of the big data of a kind of internet of things oriented and querying method |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201610797518.1A CN106227899A (en) | 2016-08-31 | 2016-08-31 | The storage of the big data of a kind of internet of things oriented and querying method |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN106227899A true CN106227899A (en) | 2016-12-14 |
Family
ID=58075401
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201610797518.1A Pending CN106227899A (en) | 2016-08-31 | 2016-08-31 | The storage of the big data of a kind of internet of things oriented and querying method |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN106227899A (en) |
Cited By (22)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN106845202A (en) * | 2017-03-09 | 2017-06-13 | 北京旷视科技有限公司 | File access method, device and system for face identification system |
| CN107016056A (en) * | 2017-03-07 | 2017-08-04 | 西安电子科技大学 | The distributed memory system and method for magnanimity heterogeneous sensor data in a kind of Internet of Things |
| CN108197261A (en) * | 2017-12-30 | 2018-06-22 | 北京通途永久科技有限公司 | A kind of wisdom traffic operating system |
| CN108416067A (en) * | 2018-03-29 | 2018-08-17 | 重庆大学 | Mass data processing and the optimization of storing process execute evaluation method in industrial process |
| CN108536823A (en) * | 2018-04-10 | 2018-09-14 | 北京工业大学 | A kind of caching design and querying method of Internet of Things perception big data |
| CN108650292A (en) * | 2018-03-27 | 2018-10-12 | 吉旗（成都）科技有限公司 | A kind of internet of things equipment message can quick locating query storage method |
| CN108763534A (en) * | 2018-05-31 | 2018-11-06 | 北京百度网讯科技有限公司 | Method and apparatus for handling information |
| CN109104710A (en) * | 2018-06-29 | 2018-12-28 | 湖北海纳天鹰科技发展有限公司 | It is a kind of based on the air quality of NBiot network and MQTT agreement inquiry and distributing device |
| CN109224999A (en) * | 2018-09-29 | 2019-01-18 | 湖北航鹏化学动力科技有限责任公司 | Vibration mixing apparatus control method and system based on Internet of Things |
| CN109639790A (en) * | 2018-12-06 | 2019-04-16 | 上海美亦健健康管理有限公司 | A kind of distributed Internet of Things software architecture |
| CN110275771A (en) * | 2018-03-15 | 2019-09-24 | 中国移动通信集团有限公司 | A kind of method for processing business, Internet of Things billing infrastructure system and storage medium |
| CN110336851A (en) * | 2019-05-06 | 2019-10-15 | 腾讯科技（深圳）有限公司 | Access to content processing method, device, computer equipment and storage medium |
| CN110688391A (en) * | 2019-09-17 | 2020-01-14 | 中盈优创资讯科技有限公司 | Massive Internet of things terminal query system, cloud database and side controller |
| CN111177765A (en) * | 2020-01-06 | 2020-05-19 | 广州知弘科技有限公司 | Financial big data processing method, storage medium and system |
| CN111611266A (en) * | 2019-02-22 | 2020-09-01 | 通用电气公司 | Knowledge-driven joint big data query and analysis platform |
| CN111665773A (en) * | 2020-07-02 | 2020-09-15 | 长沙钛合电子设备有限公司 | Internet of things system and construction method |
| CN112214469A (en) * | 2020-10-29 | 2021-01-12 | 北京红山信息科技研究院有限公司 | Drive test data processing method, device, server and storage medium |
| CN112688921A (en) * | 2020-12-09 | 2021-04-20 | 浙江蓝卓工业互联网信息技术有限公司 | Industrial data acquisition system |
| CN113253685A (en) * | 2021-05-31 | 2021-08-13 | 航天中认软件测评科技（北京）有限责任公司 | Industrial data acquisition method, device, equipment and medium |
| CN114162106A (en) * | 2021-12-24 | 2022-03-11 | 大秦铁路股份有限公司科学技术研究所 | Intelligent monitoring system and method for heavy-duty vehicle braking |
| CN116738157A (en) * | 2023-08-09 | 2023-09-12 | 柏森智慧空间科技集团有限公司 | Method for preprocessing data in property management platform |
| CN114162106B (en) * | 2021-12-24 | 2024-05-03 | 大秦铁路股份有限公司科学技术研究所 | Intelligent monitoring system and method for braking of heavy-duty vehicle |
Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN103678665A (en) * | 2013-12-24 | 2014-03-26 | 焦点科技股份有限公司 | Heterogeneous large data integration method and system based on data warehouses |
| CN104410662A (en) * | 2014-10-23 | 2015-03-11 | 山东大学 | Parallel mass data transmitting middleware of Internet of things and working method thereof |
| CN105868395A (en) * | 2016-04-19 | 2016-08-17 | 武汉邮电科学研究院 | Event driven based smart city big data system and processing method |
| CN104820670B (en) * | 2015-03-13 | 2018-11-06 | 华中电网有限公司 | A kind of acquisition of power information big data and storage method |
-
2016
- 2016-08-31 CN CN201610797518.1A patent/CN106227899A/en active Pending
Patent Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN103678665A (en) * | 2013-12-24 | 2014-03-26 | 焦点科技股份有限公司 | Heterogeneous large data integration method and system based on data warehouses |
| CN104410662A (en) * | 2014-10-23 | 2015-03-11 | 山东大学 | Parallel mass data transmitting middleware of Internet of things and working method thereof |
| CN104820670B (en) * | 2015-03-13 | 2018-11-06 | 华中电网有限公司 | A kind of acquisition of power information big data and storage method |
| CN105868395A (en) * | 2016-04-19 | 2016-08-17 | 武汉邮电科学研究院 | Event driven based smart city big data system and processing method |
Cited By (28)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN107016056A (en) * | 2017-03-07 | 2017-08-04 | 西安电子科技大学 | The distributed memory system and method for magnanimity heterogeneous sensor data in a kind of Internet of Things |
| CN106845202B (en) * | 2017-03-09 | 2020-06-02 | 北京旷视科技有限公司 | File access method, device and system for face recognition system |
| CN106845202A (en) * | 2017-03-09 | 2017-06-13 | 北京旷视科技有限公司 | File access method, device and system for face identification system |
| CN108197261A (en) * | 2017-12-30 | 2018-06-22 | 北京通途永久科技有限公司 | A kind of wisdom traffic operating system |
| CN110275771A (en) * | 2018-03-15 | 2019-09-24 | 中国移动通信集团有限公司 | A kind of method for processing business, Internet of Things billing infrastructure system and storage medium |
| CN110275771B (en) * | 2018-03-15 | 2021-12-14 | 中国移动通信集团有限公司 | Service processing method, Internet of things charging infrastructure system and storage medium |
| CN108650292A (en) * | 2018-03-27 | 2018-10-12 | 吉旗（成都）科技有限公司 | A kind of internet of things equipment message can quick locating query storage method |
| CN108416067A (en) * | 2018-03-29 | 2018-08-17 | 重庆大学 | Mass data processing and the optimization of storing process execute evaluation method in industrial process |
| CN108536823A (en) * | 2018-04-10 | 2018-09-14 | 北京工业大学 | A kind of caching design and querying method of Internet of Things perception big data |
| CN108536823B (en) * | 2018-04-10 | 2022-02-15 | 北京工业大学 | Cache design and query method for sensing big data of Internet of things |
| CN108763534B (en) * | 2018-05-31 | 2019-10-18 | 北京百度网讯科技有限公司 | Method and apparatus for handling information |
| CN108763534A (en) * | 2018-05-31 | 2018-11-06 | 北京百度网讯科技有限公司 | Method and apparatus for handling information |
| CN109104710A (en) * | 2018-06-29 | 2018-12-28 | 湖北海纳天鹰科技发展有限公司 | It is a kind of based on the air quality of NBiot network and MQTT agreement inquiry and distributing device |
| CN109224999A (en) * | 2018-09-29 | 2019-01-18 | 湖北航鹏化学动力科技有限责任公司 | Vibration mixing apparatus control method and system based on Internet of Things |
| CN109639790A (en) * | 2018-12-06 | 2019-04-16 | 上海美亦健健康管理有限公司 | A kind of distributed Internet of Things software architecture |
| CN111611266A (en) * | 2019-02-22 | 2020-09-01 | 通用电气公司 | Knowledge-driven joint big data query and analysis platform |
| CN110336851A (en) * | 2019-05-06 | 2019-10-15 | 腾讯科技（深圳）有限公司 | Access to content processing method, device, computer equipment and storage medium |
| CN110688391A (en) * | 2019-09-17 | 2020-01-14 | 中盈优创资讯科技有限公司 | Massive Internet of things terminal query system, cloud database and side controller |
| CN111177765A (en) * | 2020-01-06 | 2020-05-19 | 广州知弘科技有限公司 | Financial big data processing method, storage medium and system |
| CN111665773B (en) * | 2020-07-02 | 2021-10-26 | 长沙钛合电子设备有限公司 | Internet of things system and construction method |
| CN111665773A (en) * | 2020-07-02 | 2020-09-15 | 长沙钛合电子设备有限公司 | Internet of things system and construction method |
| CN112214469A (en) * | 2020-10-29 | 2021-01-12 | 北京红山信息科技研究院有限公司 | Drive test data processing method, device, server and storage medium |
| CN112688921A (en) * | 2020-12-09 | 2021-04-20 | 浙江蓝卓工业互联网信息技术有限公司 | Industrial data acquisition system |
| CN113253685A (en) * | 2021-05-31 | 2021-08-13 | 航天中认软件测评科技（北京）有限责任公司 | Industrial data acquisition method, device, equipment and medium |
| CN113253685B (en) * | 2021-05-31 | 2021-09-24 | 航天中认软件测评科技（北京）有限责任公司 | Industrial data acquisition method, device, equipment and medium |
| CN114162106A (en) * | 2021-12-24 | 2022-03-11 | 大秦铁路股份有限公司科学技术研究所 | Intelligent monitoring system and method for heavy-duty vehicle braking |
| CN114162106B (en) * | 2021-12-24 | 2024-05-03 | 大秦铁路股份有限公司科学技术研究所 | Intelligent monitoring system and method for braking of heavy-duty vehicle |
| CN116738157A (en) * | 2023-08-09 | 2023-09-12 | 柏森智慧空间科技集团有限公司 | Method for preprocessing data in property management platform |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN106227899A (en) | The storage of the big data of a kind of internet of things oriented and querying method | |
| CN105354247B (en) | It is a kind of to support to deposit the geographical video data tissue management method for calculating linkage | |
| CN103020204B (en) | A kind of method and its system carrying out multi-dimensional interval query to distributed sequence list | |
| CN103116661B (en) | A kind of data processing method of database | |
| CN107038162A (en) | Real time data querying method and system based on database journal | |
| CN100583050C (en) | Method for protecting and recovering continuous data based on time stamp diary memory | |
| US20150106578A1 (en) | Systems, methods and devices for implementing data management in a distributed data storage system | |
| CN106815338A (en) | A kind of real-time storage of big data, treatment and inquiry system | |
| WO2011108695A1 (en) | Parallel data processing system, parallel data processing method and program | |
| CN107807787B (en) | Distributed data storage method and system | |
| CN109522283B (en) | Method and system for deleting repeated data | |
| CN105630810B (en) | A method of mass small documents are uploaded in distributed memory system | |
| CN103617007B (en) | Multistage intelligent Realization of Storing and system | |
| US11429658B1 (en) | Systems and methods for content-aware image storage | |
| CN101986655A (en) | Storage network and data reading and writing method thereof | |
| CN107958079A (en) | Aggregate file delet method, system, device and readable storage medium storing program for executing | |
| CN102932846A (en) | Data management system for distributed heterogeneous sensing network and data management method for data management system | |
| CN103023995A (en) | Hadoop-based distributive type cloud storage type automatic grading data managing system | |
| CN109598156A (en) | Engine snapshot stream method is redirected when one kind is write | |
| WO2011131079A1 (en) | Event processing method and system for distributed control system | |
| CN102722450B (en) | Storage method for redundancy deletion block device based on location-sensitive hash | |
| CN104536700B (en) | Quick storage/the read method and system of a kind of bit stream data | |
| CN103442056B (en) | A kind of intelligent shoe cabinet control system based on cloud platform | |
| CN102722373A (en) | Method for recording painting process of a player by Flash painting software | |
| WO2014094303A1 (en) | Monitoring record management method and device |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| RJ01 | Rejection of invention patent application after publication | ||
| RJ01 | Rejection of invention patent application after publication |
Application publication date: 20161214 |