CN106528649A - Massive data storage and retrieval system and massive data storage and retrieval methods for new energy vehicles - Google Patents
Massive data storage and retrieval system and massive data storage and retrieval methods for new energy vehicles Download PDFInfo
- Publication number
- CN106528649A CN106528649A CN201610897954.6A CN201610897954A CN106528649A CN 106528649 A CN106528649 A CN 106528649A CN 201610897954 A CN201610897954 A CN 201610897954A CN 106528649 A CN106528649 A CN 106528649A
- Authority
- CN
- China
- Prior art keywords
- data
- input
- output
- retrieval
- file
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/90—Details of database functions independent of the retrieved data types
- G06F16/903—Querying
Landscapes
- Engineering & Computer Science (AREA)
- Databases & Information Systems (AREA)
- Theoretical Computer Science (AREA)
- Computational Linguistics (AREA)
- Data Mining & Analysis (AREA)
- Physics & Mathematics (AREA)
- General Engineering & Computer Science (AREA)
- General Physics & Mathematics (AREA)
- Information Retrieval, Db Structures And Fs Structures Therefor (AREA)
Abstract
The invention discloses a massive data storage and retrieval system and massive data storage and retrieval methods for new energy vehicles. The system comprises a vehicle-mounted terminal, a load balance server, a cache server, a regular archiving scheduling module, a distributed file manager and a retrieval request module, wherein the output of the vehicle-mounted terminal is connected with the input of the load balance server; the output of the load balance server is connected with the input of the cache server; the output of the cache server is connected with the inputs of the regular archiving scheduling module and the retrieval request module; the output of the regular archiving scheduling module is connected with the input of the distributed file manager; and the output of the distributed file manager is connected with the input of the retrieval request module. The invention provides a storage system for massive internet-of-vehicles real-time data of the new energy vehicles to solve the problems of finite system capacity, low storage and retrieval speeds and archived data storage and retrieval of a conventional database.
Description
Technical field
The invention belongs to data processing field, the mass data storage searching system of more particularly to a kind of new-energy automobile and
Method.
Background technology
With the development and the raising of automatization level of computer technology, many accesses and management to data are occurred in that
Application with time-constrain, such as electric power system dispatching, Industry Control, securities trading, Aero-Space etc..These applications are logical
Often need to sample to understand system operation latest Status equipment in real time, thus frequency acquisition is very high, reach per second 25,
50 or even 100 frames；Simultaneously, it is intended that all data in the time completely must be preserved, so as to needing to safeguard the data of magnanimity；And
Requirement is acquired, processes and makes correct response within specified moment or time range to data, with obvious timeliness
Property.Such magnanimity, the real-time, data of high frequency, traditional relevant database is either stored or retrieval all seems that catching the flap sees
Elbow, it is difficult to meet the demand of these applications.In recent years, the appearance of real-time data base is so that being implemented as these application demands can
Energy.Real-time data base is specially to be designed to process the data base management system with time series characteristic, and it is right that the system is used for
Above-mentioned field is real-time, high frequency, mass data carry out storage management.Meanwhile, in order to improve the autgmentability of system, fault-tolerance and deposit
Storage retrieval rate, by real-time dataBase system distributedization.
Traditional new-energy automobile data acquisition management system, with traditional Relational DataBase as data storage basis, though
Can so undertake data storage read-write search function, but be difficult to meet 100TB levels large-scale data upload retrieval data capacity and
The demand of read or write speed, while in periodic data backup filing, traditional data library storage has historical data to be archived
Difficulty is separated, performance meets production environment demand with speed is more difficult.
The content of the invention
In view of this, it is an object of the invention to provide a kind of storage system of magnanimity new-energy automobile car networking real time data
System, to solve conventional database systems finite capacity, storage and retrieval rate is not prompt enough and the storage and inspection of filing data
The problem of rope.
For reaching above-mentioned purpose, the invention provides a kind of mass data storage searching system of new-energy automobile, including
Car-mounted terminal, load-balanced server, caching server, timing filing scheduler module, distributed file management device and retrieval please
Modulus block, wherein,
The output of the car-mounted terminal is connected with the input of load-balanced server；The output of the load-balanced server
It is connected with the input of caching server；The output of the caching server and timing filing scheduler module and retrieval request module
Input connect respectively；The output of the timing filing scheduler module is connected with the input of distributed file management device；Described point
The output of cloth file manager is connected with the input of retrieval request module.
Preferably, the caching server includes memory queue, measurement processor, index file storehouse and data library,
The input of the memory queue is connected with the output of the load-balanced server；The memory queue is defeated with measurement processor
Enter connection；The output of the measurement processor is connected respectively with the input in index file storehouse, data library and retrieval request module
Connect.
Preferably, the distributed file management device includes cold data library, Hadoop modules and distributed document collection
Group, the input of the cold data library are connected with timing filing scheduler module, and output is connected with the input of Hadoop modules；
The output of Hadoop modules is connected with the input of distributed document cluster；The output of distributed document cluster and retrieval request module
Connection.
Based on above-mentioned purpose, present invention also offers a kind of mass data storage retrieval system based on above-mentioned new-energy automobile
The date storage method of system, comprises the following steps：
The real time data that car-mounted terminal is uploaded is received by load-balanced server, vehicle real time data is according to GB or various places
Square standard agreement form, gathers the real time data of new-energy automobile；
The real-time stream for receiving is pre-processed in being relayed to caching server, and sets up the reality of connection vehicle in internal memory
When data buffer storage；Terminal device information and real-time data types are obtained according to protocol analysis data flow head；Caching server
The data for receiving and corresponding device information and type are loaded into into the corresponding producer data queue in caching；
In detection caching, whether data packet number reaches configuration threshold value；
If reaching threshold value, according to real time data searching data type, device number and the year for receiving in caching server
The index file of part, determines whether newest real time data；
If not up to threshold value, is stored in the memory queue of caching server；
If newest real time data, then new index file and data file is generated, and is stored；
If not newest real time data, updates the item of index record end position in index file according to write data volume
Mesh, removes by rewriting data and from internal memory；
Periodically judge whether data file is cold data according to default time threshold；
If cold data, then after file dsc data, fragmentation is stored in distributed file management device, forms cold data
Archive file；
If not cold data, then do not carry out cold data archive operation, be still stored in caching server.
Preferably, the caching server includes memory queue, measurement processor, index file storehouse and data library,
The input of the memory queue is connected with the output of the load-balanced server；The memory queue is defeated with measurement processor
Enter connection；The output of the measurement processor is connected respectively with the input in index file storehouse, data library and retrieval request module
Connect.
Preferably, the distributed file management device includes cold data library, Hadoop modules and distributed document collection
Group, the input of the cold data library are connected with timing filing scheduler module, and output is connected with the input of Hadoop modules；
The output of Hadoop modules is connected with the input of distributed document cluster；The output of distributed document cluster and retrieval request module
Connection.
Based on above-mentioned purpose, present invention also offers a kind of mass data storage retrieval system based on above-mentioned new-energy automobile
The data retrieval method of system, comprises the following steps：
Retrieval request module sends data retrieval instructions to caching server；
Whether judge retrieval request is real time data；
If real time data, then the newest real time data of the equipment is returned to caching server request；
If not real time data, then whether judge request is cold data；
If cold data, then distributed file management device is retrieved, the cold data of filing is read；
If not cold data, then obtain the index of the equipment the type according to the data affiliated time period asked in instruction,
Data are obtained according to the position of index file from corresponding data file；
After screening to data according to command request, result is sent to retrieval request module.
Preferably, the caching server includes memory queue, measurement processor, index file storehouse and data library,
The input of the memory queue is connected with the output of the load-balanced server；The memory queue is defeated with measurement processor
Enter connection；The output of the measurement processor is connected respectively with the input in index file storehouse, data library and retrieval request module
Connect.
Preferably, the distributed file management device includes cold data library, Hadoop modules and distributed document collection
Group, the input of the cold data library are connected with timing filing scheduler module, and output is connected with the input of Hadoop modules；
The output of Hadoop modules is connected with the input of distributed document cluster；The output of distributed document cluster and retrieval request module
Connection.
The beneficial effects of the present invention is：Present invention proposition is a kind of new to be adopted based on the data of distributed cloud platform technology
Collection, storage, the system and method for retrieval, compared with the existing non-distributed processing system based on database or XML file, pin
The characteristics of to the automobile real time data in car networking field, it is proposed that exclusive file memory format and process, search method, greatly
Improve data storage efficiency and flexibility ratio, there is provided perfect data backup, archival interface, in the situation of partial service failure
In the case of losing with data local, data storage service and recovery then can be normally provided.Because employing the text of uniqueness
Part form and unique file index technology, retrieval and the Strategic data-Planning almost direct correlation of historical data, in 100TB data
The middle real time data for searching certain car certain timing node possesses same ageing with retrieving in 100MB data, safely may be used
Lean on, greatly enhance efficiency.
Description of the drawings
In order that the purpose of the present invention, technical scheme and beneficial effect are clearer, the present invention provides drawings described below and carries out
Explanation：
Mass data storage searching system structural representations of the Fig. 1 for a kind of new-energy automobile of the embodiment of the present invention 1；
Mass data storage searching system structural representations of the Fig. 2 for a kind of new-energy automobile of the embodiment of the present invention 2；
Mass data storage searching system structural representations of the Fig. 3 for a kind of new-energy automobile of the embodiment of the present invention 3；
The step of Fig. 4 is a kind of mass data storage means of new-energy automobile of embodiment of the present invention flow chart；
The step of Fig. 5 is a kind of searching mass data method of new-energy automobile of embodiment of the present invention flow chart.
Specific embodiment
Below in conjunction with accompanying drawing, the preferred embodiments of the present invention are described in detail.
Embodiment 1
Referring to Fig. 1, a kind of mass data storage searching system structure of new-energy automobile of the embodiment of the present invention 1 is shown
Schematic diagram, a kind of mass data storage searching system of new-energy automobile, including car-mounted terminal 11, load-balanced server 12,
Caching server 13, timing filing scheduler module 14, distributed file management device 15 and retrieval request module 16, wherein,
The output of car-mounted terminal 11 is connected with the input of load-balanced server 12；The output of load-balanced server 12 with
The input connection of caching server 13；The output of caching server 13 and timing filing scheduler module 14, and retrieval request module
16 input connects respectively；The output of timing filing scheduler module 14 is connected with the input of distributed file management device 15；Distribution
The output of formula file manager 15 is connected with the input of retrieval request module 16.
By the mass data storage searching system of the new-energy automobile of above-mentioned setting, using caching server 13, timing
Filing scheduler module 14 and distributed file management device 15 coordinate, the mass data of new-energy automobile, including vehicle essential information,
Information about power, mileage information, GPS position information, vehicle alarm information and electrokinetic cell real time data, electrokinetic cell real time data
Including battery cell management system information, battery module monomer information, battery cell information and electrokinetic cell warning message, will
Above-mentioned data carry out real-time processing, data backup, timing filing.
Embodiment 2
Referring to Fig. 2, a kind of mass data storage searching system structure of new-energy automobile of the embodiment of the present invention is shown
Schematic diagram.
Caching server 13 includes memory queue 131, measurement processor 132, index file storehouse 133 and data library
134, the input of memory queue 131 is connected with the output of load-balanced server 12；Memory queue 131 and measurement processor 132
Input connection；The output of measurement processor 132 and index file storehouse 133, data library 134 and retrieval request module 16
Input connects respectively.
Above-mentioned measurement processor 132 writes with a brush dipped in Chinese ink threshold value according to default data, judges the data packet number of memory queue 131
Whether threshold value is reached；And analyse whether as real time data, history number when retrieval request module 16 proposes data retrieval instructions
According to and cold data, if request retrieval for real time data, retrieval returned data in memory queue 131；If request retrieval
For historical data, then the time period according to the data asked in search instruction obtain the rope of the type vehicles identifications
Draw, further according to index record position from corresponding data file acquisition data in data library 134；If request retrieval for cold
Data, then in distributed file management device 15, retrieval obtains cold data.The form of real data files in data library 134
For type-vehicles identifications-days, real-time vehicle data, alert data, position data is specifically respectively from top to bottom, is followed with this
Ring, the record content of real-time vehicle data is：Starting character, order unit, vehicles identifications VIN codes, cipher mode, data cell are long
Degree, motor data, vehicle status data, battery bag real time data, battery bag extreme value data；Rope in index file storehouse 133
The form of quotation part is type-vehicles identifications-year, is made up of some index blocks, and each index block record content is：Date, note
Record start sequence number and end of record sequence number.
Embodiment 3
Referring to Fig. 3, a kind of mass data storage searching system structure of new-energy automobile of the embodiment of the present invention is shown
Schematic diagram.
Distributed file management device 15 includes cold data library 151, Hadoop modules 152 and distributed document cluster
153, the input of cold data library 151 is connected with timing filing scheduler module 14, and output is connected with the input of Hadoop modules 152
Connect；The output of Hadoop modules is connected with the input of distributed document cluster 153；The output and inspection of distributed document cluster 153
Rope request module 16 connects.
When timing filing scheduler module 14 is judged as cold data to the data file inspection in data library 134, will
Which is transferred to cold data library 151, will be the data in cold data library 151 broken by the Hadoop frameworks of Hadoop modules
Piece is stored in distributed document cluster 153, forms the archive file of cold data, so that retrieval request module 16 is asking cold
Call during data.
It is corresponding with above-mentioned search data memory system, present invention also offers a kind of date storage method, embodiment ginseng
See Fig. 4, the flow chart the step of mass data storage means of the new-energy automobile for showing the embodiment of the present invention, including following step
Suddenly：
S101, receives the real time data that car-mounted terminal is uploaded by load-balanced server, and vehicle real time data is according to GB
Or each place standard agreement form, gather the real time data of new-energy automobile；
S102, the real-time stream for receiving are pre-processed in being relayed to caching server, and set up connection car in internal memory
Real time data caching；Terminal device information and real-time data types are obtained according to protocol analysis data flow head；Caching
The data for receiving and corresponding device information and type are loaded into the corresponding producer data queue in caching by server；
S103, in detection caching, whether data packet number reaches configuration threshold value；
S104, if reaching threshold value, according to the real time data searching data type, device number for receiving in caching server
With the index file in time, newest real time data is determined whether；
S105, if not up to threshold value, is stored in the memory queue of caching server；
S106, if newest real time data, then generates new index file and data file, and stores；
S107, if not newest real time data, updates index record end position in index file according to write data volume
Project, remove by rewriting data and from internal memory；
According to default time threshold, S108, periodically judges whether data file is cold data；
S109, if cold data, then after file dsc data, fragmentation is stored in distributed file management device, is formed
Cold data archive file；
S110, if not cold data, then do not carry out cold data archive operation, be still stored in caching server.
Specific embodiment will not be described here with reference to said system embodiment.
It is corresponding with above-mentioned search data memory system, present invention also offers a kind of data retrieval method, embodiment ginseng
See Fig. 5, flow chart the step of the searching mass data method of the new-energy automobile for showing the embodiment of the present invention, including following step
Suddenly：
S201, retrieval request module send data retrieval instructions to caching server；
S202, whether judge retrieval request is real time data；
S203, if real time data, then returns the newest real time data of the equipment to caching server request；
S204, if not real time data, then whether judge request is cold data；
S205, if cold data, then retrieves distributed file management device, reads the cold data of filing；
S206, if not cold data, then obtain the equipment the type according to the data affiliated time period asked in instruction
Index, obtains data according to the position of index file from corresponding data file；
S207, after screening to data according to command request, sends result to retrieval request module.
Specific embodiment will not be described here with reference to said system embodiment.
Finally illustrate, preferred embodiment above is only unrestricted to illustrate technical scheme, although logical
Cross above preferred embodiment to be described in detail the present invention, it is to be understood by those skilled in the art that can be
Various changes are made in form and to which in details, without departing from claims of the present invention limited range.
Claims (9)
1. the mass data storage searching system of a kind of new-energy automobile, it is characterised in that equal including car-mounted terminal (11), load
Weighing apparatus server (12), caching server (13), timing filing scheduler module (14), distributed file management device (15) and retrieval please
Modulus block (16), wherein,
The output of car-mounted terminal (11) is connected with the input of load-balanced server (12)；The load-balanced server
(12) output is connected with the input of caching server (13)；The output of caching server (13) and timing filing scheduling mould
The input of block (14) and retrieval request module (16) connects respectively；The output of timing filing scheduler module (14) with it is distributed
The input connection of file manager (15)；The output of distributed file management device (15) is defeated with retrieval request module (16)
Enter connection.
2. the mass data storage searching system of new-energy automobile according to claim 1, it is characterised in that the caching
Server (13) includes memory queue (131), measurement processor (132), index file storehouse (133) and data library (134),
The input of memory queue (131) is connected with the output of the load-balanced server (12)；Memory queue (131) with
The input connection of measurement processor (132)；The output of measurement processor (132) and index file storehouse (133), data file
The input in storehouse (134) and retrieval request module (16) connects respectively.
3. the mass data storage searching system of new-energy automobile according to claim 1, it is characterised in that the distribution
Formula file manager (15) includes cold data library (151), Hadoop modules (152) and distributed document cluster (153), institute
The input for stating cold data library (151) is connected with timing filing scheduler module (14), is exported defeated with Hadoop modules (152)
Enter connection；The output of Hadoop modules is connected with the input of distributed document cluster (153)；Distributed document cluster (153)
Output is connected with retrieval request module (16).
4. a kind of data storage side of the mass data storage searching system of the new-energy automobile based on one of claim 1-3
Method, it is characterised in that comprise the following steps：
The real time data that car-mounted terminal is uploaded is received by load-balanced server, vehicle real time data is marked according to GB or each place
Quasi- protocol format, gathers the real time data of new-energy automobile；
The real-time stream for receiving is pre-processed in being relayed to caching server, and sets up the real-time number of connection vehicle in internal memory
According to caching；Terminal device information and real-time data types are obtained according to protocol analysis data flow head；Caching server will be received
To data and corresponding device information and type be loaded into the corresponding producer data queue in caching；
In detection caching, whether data packet number reaches configuration threshold value；
If reaching threshold value, according to real time data searching data type, device number and the time for receiving in caching server
Index file, determines whether newest real time data；
If not up to threshold value, is stored in the memory queue of caching server；
If newest real time data, then new index file and data file is generated, and is stored；
If not newest real time data, updates the project of index record end position in index file according to write data volume, will
Rewriting data is simultaneously removed from internal memory；
Periodically judge whether data file is cold data according to default time threshold；
If cold data, then after file dsc data, fragmentation is stored in distributed file management device, forms cold data filing
File；
If not cold data, then do not carry out cold data archive operation, be still stored in caching server.
5. date storage method according to claim 4, it is characterised in that the caching server include memory queue,
Measurement processor, index file storehouse and data library, the input of the memory queue are defeated with the load-balanced server
Go out connection；The memory queue is connected with the input of measurement processor；The output of the measurement processor and index file storehouse, number
Connect according to the input of library and retrieval request module respectively.
6. date storage method according to claim 4, it is characterised in that the distributed file management device includes cold number
According to library, Hadoop modules and distributed document cluster, input and the timing filing scheduler module of the cold data library
Connection, output are connected with the input of Hadoop modules；The output of Hadoop modules is connected with the input of distributed document cluster；Point
The output of cloth file cluster is connected with retrieval request module.
7. a kind of data retrieval side of the mass data storage searching system of the new-energy automobile based on one of claim 1-3
Method, it is characterised in that comprise the following steps：
Retrieval request module sends data retrieval instructions to caching server；
Whether judge retrieval request is real time data；
If real time data, then the newest real time data of the equipment is returned to caching server request；
If not real time data, then whether judge request is cold data；
If cold data, then distributed file management device is retrieved, the cold data of filing is read；
If not cold data, then obtain the index of the equipment the type according to the data affiliated time period asked in instruction, according to
The position of index file obtains data from corresponding data file；
After screening to data according to command request, result is sent to retrieval request module.
8. data retrieval method according to claim 4, it is characterised in that the caching server include memory queue,
Measurement processor, index file storehouse and data library, the input of the memory queue are defeated with the load-balanced server
Go out connection；The memory queue is connected with the input of measurement processor；The output of the measurement processor and index file storehouse, number
Connect according to the input of library and retrieval request module respectively.
9. data retrieval method according to claim 4, it is characterised in that the distributed file management device includes cold number
According to library, Hadoop modules and distributed document cluster, input and the timing filing scheduler module of the cold data library
Connection, output are connected with the input of Hadoop modules；The output of Hadoop modules is connected with the input of distributed document cluster；Point
The output of cloth file cluster is connected with retrieval request module.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201610897954.6A CN106528649B (en) | 2016-10-14 | 2016-10-14 | mass data storage and retrieval system and method for new energy automobile |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201610897954.6A CN106528649B (en) | 2016-10-14 | 2016-10-14 | mass data storage and retrieval system and method for new energy automobile |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN106528649A true CN106528649A (en) | 2017-03-22 |
| CN106528649B CN106528649B (en) | 2019-12-13 |
Family
ID=58332166
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201610897954.6A Active CN106528649B (en) | 2016-10-14 | 2016-10-14 | mass data storage and retrieval system and method for new energy automobile |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN106528649B (en) |
Cited By (8)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN108549721A (en) * | 2018-04-24 | 2018-09-18 | 上汽通用五菱汽车股份有限公司 | Synchronous updating method, server and the readable storage medium storing program for executing of vehicle mileage data |
| CN109684416A (en) * | 2018-11-13 | 2019-04-26 | 国电南京自动化股份有限公司 | A kind of high concurrent real-time history data storage system |
| CN110109870A (en) * | 2018-01-24 | 2019-08-09 | 江苏友上科技实业有限公司 | A kind of mass data quick retrieval system based on Solr |
| CN111367880A (en) * | 2020-02-05 | 2020-07-03 | 北京华电天仁电力控制技术有限公司 | Universal real-time data storage management system and implementation method thereof |
| CN111460236A (en) * | 2020-04-26 | 2020-07-28 | 天津七一二通信广播股份有限公司 | Big data acquisition administers quick retrieval system based on data lake |
| CN111666260A (en) * | 2019-03-08 | 2020-09-15 | 杭州海康威视数字技术股份有限公司 | Data processing method and device |
| CN115695551A (en) * | 2021-07-22 | 2023-02-03 | 海信集团控股股份有限公司 | Vehicle data sending method and system, cache server and intermediate server |
| CN117533251A (en) * | 2024-01-08 | 2024-02-09 | 知迪汽车技术(北京)有限公司 | Distributed file system for vehicle-mounted bus data recorder |
Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN103020078A (en) * | 2011-09-24 | 2013-04-03 | 国家电网公司 | Distributed real-time database data hierarchical indexing method |
| CN202854794U (en) * | 2012-06-21 | 2013-04-03 | 深圳市谷米科技有限公司 | Mass data storage device |
| CN103747060A (en) * | 2013-12-26 | 2014-04-23 | 惠州华阳通用电子有限公司 | Distributed monitor system and method based on streaming media service cluster |
| US9298828B1 (en) * | 2011-11-04 | 2016-03-29 | Google Inc. | Supplementing search results with historically selected search results of related queries |
-
2016
- 2016-10-14 CN CN201610897954.6A patent/CN106528649B/en active Active
Patent Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN103020078A (en) * | 2011-09-24 | 2013-04-03 | 国家电网公司 | Distributed real-time database data hierarchical indexing method |
| US9298828B1 (en) * | 2011-11-04 | 2016-03-29 | Google Inc. | Supplementing search results with historically selected search results of related queries |
| CN202854794U (en) * | 2012-06-21 | 2013-04-03 | 深圳市谷米科技有限公司 | Mass data storage device |
| CN103747060A (en) * | 2013-12-26 | 2014-04-23 | 惠州华阳通用电子有限公司 | Distributed monitor system and method based on streaming media service cluster |
Cited By (9)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN110109870A (en) * | 2018-01-24 | 2019-08-09 | 江苏友上科技实业有限公司 | A kind of mass data quick retrieval system based on Solr |
| CN108549721A (en) * | 2018-04-24 | 2018-09-18 | 上汽通用五菱汽车股份有限公司 | Synchronous updating method, server and the readable storage medium storing program for executing of vehicle mileage data |
| CN109684416A (en) * | 2018-11-13 | 2019-04-26 | 国电南京自动化股份有限公司 | A kind of high concurrent real-time history data storage system |
| CN111666260A (en) * | 2019-03-08 | 2020-09-15 | 杭州海康威视数字技术股份有限公司 | Data processing method and device |
| CN111367880A (en) * | 2020-02-05 | 2020-07-03 | 北京华电天仁电力控制技术有限公司 | Universal real-time data storage management system and implementation method thereof |
| CN111460236A (en) * | 2020-04-26 | 2020-07-28 | 天津七一二通信广播股份有限公司 | Big data acquisition administers quick retrieval system based on data lake |
| CN115695551A (en) * | 2021-07-22 | 2023-02-03 | 海信集团控股股份有限公司 | Vehicle data sending method and system, cache server and intermediate server |
| CN117533251A (en) * | 2024-01-08 | 2024-02-09 | 知迪汽车技术(北京)有限公司 | Distributed file system for vehicle-mounted bus data recorder |
| CN117533251B (en) * | 2024-01-08 | 2024-05-10 | 知迪科技(安徽)有限公司 | Distributed file system for vehicle-mounted bus data recorder |
Also Published As
| Publication number | Publication date |
|---|---|
| CN106528649B (en) | 2019-12-13 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN106528649A (en) | Massive data storage and retrieval system and massive data storage and retrieval methods for new energy vehicles | |
| CN107391744B (en) | Data storage method, data reading method, data storage device, data reading device and equipment | |
| CN111427844B (en) | Data migration system and method for file hierarchical storage | |
| CN105303456A (en) | Method for processing monitoring data of electric power transmission equipment | |
| CN103744913A (en) | Database retrieval method based on search engine technology | |
| CN103702053A (en) | Video storage and search method and system as well as monitoring system | |
| CN103529761B (en) | A kind of new energy vehicle fault data acquisition method and apparatus | |
| CN104239377A (en) | Platform-crossing data retrieval method and device | |
| CN103973791A (en) | Rapid uniform storage system of internet of things | |
| WO2020143181A1 (en) | Data storage method, apparatus, computer device and storage medium | |
| CN108319652A (en) | A kind of the column document storage system and method for the elevator data based on HDFS | |
| CN111949751A (en) | Intelligent ship track visualization method and system | |
| CN115344207A (en) | Data processing method and device, electronic equipment and storage medium | |
| CN112597348A (en) | Method and device for optimizing big data storage | |
| CN117493340A (en) | Multi-mode data integration fusion analysis system oriented to public safety field | |
| CN109523791B (en) | Early warning analysis method and device for retained vehicle | |
| CN110377598B (en) | Multi-source heterogeneous data storage method based on intelligent manufacturing process | |
| KR101666440B1 (en) | Data processing method in In-memory Database System based on Circle-Queue | |
| CN106781497A (en) | Online vehicle running state detection method and system based on the analysis of point of proximity position | |
| CN108073705B (en) | Distributed mass data aggregation acquisition method | |
| CN112463542B (en) | Log abnormality cause diagnosis method, device, computer equipment and storage medium | |
| CN103399904A (en) | Data processing method and data processing system | |
| CN109739854A (en) | A kind of date storage method and device | |
| WO2023241388A1 (en) | Model training method and apparatus, energy replenishment intention recognition method and apparatus, device, and medium | |
| CN109213760A (en) | The storage of high load business and search method of non-relation data storage |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |