CN111241172B - Data storage method, device, terminal and computer readable medium - Google Patents
Data storage method, device, terminal and computer readable medium Download PDFInfo
- Publication number
- CN111241172B CN111241172B CN201911368979.7A CN201911368979A CN111241172B CN 111241172 B CN111241172 B CN 111241172B CN 201911368979 A CN201911368979 A CN 201911368979A CN 111241172 B CN111241172 B CN 111241172B
- Authority
- CN
- China
- Prior art keywords
- target data
- data
- thread
- type
- target
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/20—Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
- G06F16/25—Integrating or interfacing systems involving database management systems
- G06F16/258—Data format conversion from or to a database
-
- Y—GENERAL TAGGING OF NEW TECHNOLOGICAL DEVELOPMENTS; GENERAL TAGGING OF CROSS-SECTIONAL TECHNOLOGIES SPANNING OVER SEVERAL SECTIONS OF THE IPC; TECHNICAL SUBJECTS COVERED BY FORMER USPC CROSS-REFERENCE ART COLLECTIONS [XRACs] AND DIGESTS
- Y02—TECHNOLOGIES OR APPLICATIONS FOR MITIGATION OR ADAPTATION AGAINST CLIMATE CHANGE
- Y02D—CLIMATE CHANGE MITIGATION TECHNOLOGIES IN INFORMATION AND COMMUNICATION TECHNOLOGIES [ICT], I.E. INFORMATION AND COMMUNICATION TECHNOLOGIES AIMING AT THE REDUCTION OF THEIR OWN ENERGY USE
- Y02D10/00—Energy efficient computing, e.g. low power processors, power management or thermal management
Landscapes
- Engineering & Computer Science (AREA)
- Databases & Information Systems (AREA)
- Theoretical Computer Science (AREA)
- Data Mining & Analysis (AREA)
- Physics & Mathematics (AREA)
- General Engineering & Computer Science (AREA)
- General Physics & Mathematics (AREA)
- Information Retrieval, Db Structures And Fs Structures Therefor (AREA)
Abstract
The application provides a data storage method, a data storage device, a terminal and a computer readable medium, wherein the method comprises the following steps: receiving a data storage request sent by a terminal; acquiring the target data from the terminal according to the data storage request, and acquiring a target data type of the target data from a configuration file of the terminal; converting the target data from a target data type to a preset data type through a data processing cluster; the invention can complete the data transmission of a plurality of devices by only adopting one data interface, thereby avoiding the maintenance of a plurality of data interfaces and saving manpower and material resources.
Description
Technical Field
The present disclosure relates to the field of data transmission technologies, and in particular, to a data storage method, a data storage device, a terminal, and a computer readable medium.
Background
In the process of building a digital factory, various devices need to transmit data to a database for storage, and because the data types of different devices are different, a corresponding service interface needs to be developed for each data type, a large number of service interfaces are generated, and accordingly maintenance complexity of the service interfaces is high.
Disclosure of Invention
An objective of the embodiments of the present application is to provide a data storage method, so as to solve the problem of complex maintenance of multiple data interfaces. The specific technical scheme is as follows:
in a first aspect, there is provided a data storage method, the method comprising:
receiving a data storage request sent by a terminal;
acquiring target data from the terminal according to the data storage request, and acquiring a target data type of the target data from a configuration file of the terminal;
converting the target data from the target data type to a preset data type through a data processing cluster;
and transmitting the target data of the preset data type to a storage system for storage.
Optionally, the converting, by the data processing cluster, the target data from the target data type to a preset data type includes:
according to the data storage request, transmitting the target data to the data processing cluster through a thread;
and converting the target data from the target data type to the preset data type through the data processing cluster.
Optionally, said transferring, by a thread, said target data to said data processing cluster according to said data storage request includes:
determining the number of the acquired target data according to the data storage request;
establishing a corresponding number of threads according to the number of the target data;
activating the thread to cause the thread to pass the target data to the data processing cluster;
after the thread finishes transmitting the target data, acquiring feedback information of the thread, and sending the feedback information to the terminal, wherein the feedback information is used for informing the terminal of the transmission condition of the target data;
and after the feedback information is sent to the terminal, recovering the thread.
Optionally, the activating the thread to cause the thread to pass the target data to the data processing cluster includes:
checking whether the target data transferred by the thread is correct;
under the condition that the target data transferred by the thread is correct, acquiring the actual data type of the target data, and confirming whether the actual data type of the target data is the same as the target data type in the configuration file;
and under the condition that the actual data type of the target data is the same as the target data type in the configuration file, converting the target data from the target data type to the preset data type.
Optionally, the converting the target data from the target type to the preset data type includes:
converting the acquired target data type of the target data into an Object;
and converting the Object into the preset data type through an embedded Object.
Optionally, the checking whether the target data transferred by the thread is correct includes:
acquiring target data transmitted by the thread;
comparing the target data with standard data according to the target data type;
and if the target data are the same as the standard data, determining that the target data transmitted by the thread are correct.
In a second aspect, a data storage device, the device comprising:
the receiving module is used for receiving a data storage request sent by the terminal;
the acquisition module is used for acquiring target data from the terminal according to the data storage request and acquiring a target data type of the target data from a configuration file of the terminal;
the conversion module is used for converting the target data from the target data type to a preset data type through the data processing cluster;
and the transmission module is used for transmitting the target data of the preset data type to a storage system for storage.
Optionally, the conversion module includes:
the transfer unit is used for transferring the target data to the data processing cluster through threads according to the data storage request;
and the conversion unit is used for converting the target data from the target data type to the preset data type through the data processing cluster.
In a third aspect, an electronic device is provided, which includes a processor, a communication interface, a memory, and a communication bus, where the processor, the communication interface, and the memory perform communication with each other through the communication bus;
a memory for storing a computer program;
and a processor for implementing any of the method steps when executing the program stored on the memory.
In a fourth aspect, a computer-readable storage medium is provided, wherein a computer program is stored in the computer-readable storage medium, which computer program, when being executed by a processor, implements any of the method steps.
The beneficial effects of the embodiment of the application are that:
the embodiment of the application provides a data interface, the type of data is written into a configuration file in advance, then the data interface converts target data in the configuration file from the target data type into a preset data type and then transmits the preset data type to a storage system, and by adopting the method, the data transmission of a plurality of devices can be completed by adopting only one data interface, so that the maintenance of the plurality of data interfaces is avoided, and manpower and material resources are saved. Of course, not all of the above-described advantages need be achieved simultaneously in practicing any one of the products or methods of the present application.
Drawings
In order to more clearly illustrate the embodiments of the present application or the technical solutions in the prior art, the drawings that are required to be used in the description of the embodiments or the prior art will be briefly described below, and it will be obvious to those skilled in the art that other drawings can be obtained from these drawings without inventive effort.
FIG. 1 is a flowchart of a data storage method according to an embodiment of the present application;
FIG. 2 is a flowchart of a method for converting data types according to an embodiment of the present application;
FIG. 3 is a flowchart of a method for transferring target data by a thread according to an embodiment of the present application;
FIG. 4 is a flowchart of a method for processing target data by a data processing cluster according to an embodiment of the present application;
fig. 5 is a system schematic diagram of a data storage method according to an embodiment of the present application
FIG. 6 is a schematic structural diagram of a data storage device according to an embodiment of the present disclosure;
fig. 7 is a schematic structural diagram of an electronic device according to an embodiment of the present application.
1. Terminal, 2, server, 3, data processing cluster, 4, memory system.
Detailed Description
The following description of the embodiments of the present invention will be made clearly and completely with reference to the accompanying drawings, in which it is apparent that the embodiments described are only some embodiments of the present invention, but not all embodiments. All other embodiments, which can be made by those skilled in the art based on the embodiments of the invention without making any inventive effort, are intended to be within the scope of the invention.
The embodiment of the application provides a data storage method which can be applied to a server, and the server can adopt one data interface to butt-joint a plurality of devices, so that the situation that one data interface is respectively arranged for each device is avoided, the number of the data interfaces is reduced, and the complexity of interface maintenance is reduced.
The following will describe a data storage method provided in the embodiment of the present application in detail with reference to the specific implementation manner, as shown in fig. 1, the specific steps are as follows:
step 101: and receiving a data storage request sent by the terminal.
In the embodiment of the invention, different terminals are butted with the same data interface. When the terminal stores data into the storage system through the server, a data storage request is sent to the server, and the server receives the data storage request sent by the terminal.
Step 102: according to the data storage request, target data are acquired from the terminal, and target data types of the target data are acquired from the configuration file of the terminal.
In the embodiment of the invention, the server sends a data acquisition storage request to the terminal according to the received data storage request sent by the terminal, and the terminal sends target data corresponding to the data acquisition storage request to the server after receiving the data acquisition storage request. The embodiment of the invention also comprises a configuration file, wherein the configuration file comprises terminal identifiers of all terminals and data types corresponding to all terminals, the configuration file is stored in a server, the server acquires the terminal identifiers from the data storage request, and then the corresponding target data types are found according to the terminal identifiers.
Step 103: and converting the target data from the target data type to a preset data type through the data processing cluster.
In the embodiment of the invention, the server converts the target data from the target data type to the unified data type and then converts the unified data type to the preset data type through the data processing cluster, wherein the storage system only can store the data of the preset data type, so that the target data type of the target data is converted to the preset data type.
Specifically, the server converts the acquired target data from the target data type into a unified data type Object through the data processing cluster, and then converts the unified data type Object into a preset data type through the built-in Object. For example, the predetermined data type is a binary data type.
Step 104: and transmitting target data of a preset data type to a storage system for storage.
In the embodiment of the invention, the server transmits target data of a preset data type to the storage system for storage.
Optionally, as shown in fig. 2, converting, by the data processing cluster, the target data from the target data type to the preset data type includes:
step 201: the target data is transferred to the data processing cluster by the thread according to the data storage request.
In the embodiment of the invention, after the server acquires the target data according to the data storage request, a plurality of threads are established, wherein the threads are used for respectively transmitting the target data to the data processing cluster.
Step 202: and converting the target data from the target data type to a preset data type through the data processing cluster.
In the embodiment of the invention, after the data processing cluster receives the target data sent by the working thread, the target data is converted from the target data type into the unified data type, and the unified signature type is converted into the preset data type.
Specifically, the data processing cluster converts the acquired target data from the target data type into a unified data type Object through a preset protocol according to the acquired target data and the corresponding target data type, and then converts the unified data type Object into a preset data type through a built-in Object.
Optionally, as shown in fig. 3, passing the target data to the data processing cluster by the thread according to the data storage request includes:
step 301: according to the data storage request, the number of acquired target data is determined.
In the embodiment of the invention, a server receives data storage requests sent by one or more terminals, acquires one or more target data according to the received one or more data storage requests, and then determines the quantity of the target data.
In the embodiment of the invention, a server receives a plurality of data storage requests sent by a plurality of terminals, acquires a plurality of target data according to the received plurality of data storage requests, and then determines the quantity of the plurality of target data.
Step 302: and establishing a corresponding number of threads according to the number of the target data.
In the embodiment of the invention, the server establishes a corresponding number of threads according to the number of the target data, wherein the number of the threads is the same as the number of all the target data, so that each thread only transmits one item of target data. After the server establishes the threads, determining the target data type corresponding to each thread, so as to transmit the target data of the corresponding target data type through each thread.
Step 303: the thread is activated such that the thread passes the target data to the data processing cluster.
In the embodiment of the invention, after the corresponding number of threads are established, the server activates the preset number of threads and transmits the target data to the data processing cluster through the activated threads.
Step 304: after the thread transmits the data, acquiring feedback information of the thread, and sending the feedback information to the terminal, wherein the feedback information is used for informing the terminal of the transmission condition of target data.
In the embodiment of the invention, after the process of transferring the data is finished, the server acquires feedback information of the thread and sends the feedback information to the terminal so that the terminal knows the progress of data transmission, wherein the feedback information is used for informing the terminal of the transfer condition of target data, specifically, the transfer condition comprises that the target data is successfully transferred to a storage system or the target data fails to be transferred to the storage system.
Step 305: and after the feedback information is sent to the terminal, recovering the thread.
In the embodiment of the invention, after the server feedback information is sent to the terminal, the thread is recovered to release the storage space of the server.
The process of the thread transferring the target data to the data processing cluster is as follows: the server determines the number of acquired target data according to the data storage request, then establishes a corresponding number of threads according to the number of the target data, after the server establishes the threads, suspends all the threads to wait for tasks, and because the capacity of the server for transmitting and processing the data is limited, the server activates the preset number of threads each time, other threads are queued to wait for activation, the server transmits the target data to the data processing cluster through the activated threads, after the activated threads transmit the data, the server recovers the threads to release the storage space of the server, activates the next preset number of threads to start transmitting the data, and recovers the threads after the transmission is finished until the recovery of all the threads is completed.
The server establishes a plurality of threads, so that the threads can transmit data to the data processing cluster at the same time, and the data transmission efficiency is improved.
For example, there are a hundred terminals, the server receives a data storage request sent by one hundred terminals, then determines the number of target data to be one hundred, and establishes one hundred threads, because the server can only transmit and process ten target data at a time, the server activates ten threads, each thread transmits one data, the remaining ninety lines wait for processing, and after the data transmission of ten threads is finished, the server recovers ten threads to release the storage space, then establishes ten threads to start the transmission of another ten data, and recovers the ten threads after the transmission is finished until the recovery of one hundred threads is finished.
Optionally, as shown in fig. 4, activating the thread to cause the thread to pass the target data to the data processing cluster includes:
step 401: and checking whether the target data transferred by the thread is correct.
In the embodiment of the invention, the thread transmits the target data to the service monitoring module of the data processing cluster, and after the service monitoring module receives the target data, whether the target data is correct or not is checked, specifically, the service monitoring module acquires the target data type of the target data, and compares the target data with standard data of the same data type in the database to determine the integrity and the correctness of the target data, such as whether the data length of the target data is correct or not.
In the embodiment of the present invention, if the formats of the target data and the standard data are the same, if the data lengths of the target data and the standard data are the same, it indicates that the target data received by the data processing cluster is correct, and step 402 is entered; if the target data is different from the standard data, the target data received by the data processing cluster is incorrect, and the incorrect target data is rejected.
In one example, the embodiment of the present invention adopts CRC (Cyclical Redundancy Check, cyclic redundancy check) to check the integrity and correctness of the target data, and the present invention is not limited to a specific checking manner.
Step 402: and under the condition that the target data transferred by the thread is correct, acquiring the actual data type of the target data, and confirming whether the actual data type of the target data is the same as the target data type in the configuration file.
In the embodiment of the invention, under the condition that the service monitoring module judges that the target data transmitted by the thread is correct, the service monitoring module transmits the target data to the authentication module of the data processing cluster, and the authentication module acquires the actual data type of the target data and compares the actual data type with the target data type in the configuration file.
In the embodiment of the invention, if the actual data type of the target data is the same as the target data type in the configuration file, the target data is further proved to be correct; if the actual data type of the target data is different from the target data type in the configuration file, eliminating the target data, setting the next access time of the target data, and specifically setting the next access time of the target data as the time when the server notifies the terminal to send the data storage request next. The authentication module rejects the wrong target data, so that the data safety can be ensured, and meanwhile, the next access time of the wrong target data is set, so that the access data storage request quantity of the server can be reduced, the high concurrent data condition is relieved, and the collapse of the server due to the excessively high access data storage request quantity is avoided.
Step 403: and converting the target data from the target data type to a preset data type under the condition that the actual data type of the target data is the same as the target data type in the configuration file.
In the embodiment of the invention, when the authentication module determines that the actual data type of the target data is the same as the target type in the configuration file, the authentication module transmits the target data to the information processing module of the data processing cluster, and the information processing module converts the target data from the target data type to the preset data type.
Specifically, the information processing module converts the acquired target data from the target data type into a unified data type Object through a preset protocol according to the acquired target data and the corresponding target data type, and then converts the unified data type Object into a preset data type through a built-in Object.
In the embodiment of the invention, after the information processing module converts the target data from the target data type to the preset data type, the target data is sent to the updating module of the data processing cluster, and the updating module sends feedback information to the terminal through the thread on one hand, so that the terminal knows the transmission condition of the target data, and on the other hand, the target data is transmitted to the storage system for storage through the unified data access layer.
Specifically, after receiving target data sent to the data processing cluster by the preset number of threads, the updating module sends feedback information to the terminal through the threads on one hand, so that the terminal knows the transmission condition of the target data, wherein the feedback information is used for informing the terminal of the transmission condition of the preset number of target data. After the updating module sends feedback information to the terminal through the thread, the server recovers the thread to release the storage space of the server, and on the other hand, the updating module transmits target data with preset quantity to the storage system through the unified data access layer for storage. The embodiment of the invention adopts the distributed transaction to update the information, so that the coupling degree among the modules can be reduced.
In the embodiment of the invention, the service monitoring module, the authentication module, the information processing module and the updating module of the data processing cluster can exist in the same server or can exist in different servers respectively. In the embodiment of the invention, the data interface, the thread and the data processing cluster can exist in the same server, or the data interface and the thread exist in one server, and the data processing cluster exists in another server.
The embodiment of the invention also provides a data transmission system, in which a data interface and a thread exist in one server, and a data processing cluster exists in another server, as shown in fig. 5, the system comprises a terminal 1, a server 2, a data processing cluster 3 and a storage system 4, wherein the terminal 1 is used for sending a data storage request to the server 2 and receiving feedback data returned from the server 2; the server 2 is used for acquiring target data from the terminal 1 and acquiring target data types of all target data from the configuration file, then transmitting the acquired target data and the target data types to the data processing cluster 3 through threads, and sending feedback data received from the data processing cluster 3 to the terminal 1; the method comprises the steps of carrying out a first treatment on the surface of the The data processing cluster 3 is configured to receive target data from the server 2, process the target data, transmit the processed target data to the storage system 4, and send feedback information received from the storage system 4 to the server 2; the storage system 4 is configured to receive the processed target data transferred by the data processing cluster 3, and send feedback information to the data processing cluster 3.
Based on the same technical concept, the embodiment of the present application further provides a data transmission device, as shown in fig. 6, including:
a receiving module 601, configured to receive a data storage request sent by a terminal;
an obtaining module 602, configured to obtain, according to the data storage request, the target data from the terminal, and obtain a target data type of the target data from a configuration file of the terminal;
the conversion module 603 is configured to convert, by the data processing cluster, the target data from a target data type to a preset data type;
and the transmitting module 604 is configured to transmit the target data of the preset data type to a storage system for storage.
Optionally, the conversion module 603 includes:
the transfer unit is used for transferring the target data to a data processing cluster through threads according to the data storage request;
and the conversion unit is used for converting the target data from the target data type to the preset data type through the data processing cluster.
Optionally, the transfer unit includes:
an acquisition subunit, configured to determine, according to the data storage request, the number of acquired target data;
the establishing subunit is used for establishing threads with corresponding numbers according to the number of the target data;
an activation subunit, configured to activate the thread to cause the thread to pass the target data to a data processing cluster;
and the sending subunit is used for acquiring feedback information of the thread after the thread transmits the data, and sending the feedback information to the terminal, wherein the feedback information is used for informing the terminal of the transmission condition of the target data.
And the recovery subunit is used for recovering the thread after the feedback information is sent to the terminal.
Optionally, the activating subunit includes:
a checking section for checking whether or not the target data transferred by the thread is correct;
a confirmation part, configured to acquire an actual data type of the target data and confirm whether the actual data type of the target data is the same as the target data type in the configuration file when the target data transferred by the thread is correct;
and the conversion part is used for converting the target data from the target data type to a preset data type under the condition that the actual data type of the target data is the same as the target type in the configuration file.
Optionally, the conversion moiety comprises:
a first transformer section for transforming the target data type of the acquired target data into an Object;
and a second converter part for converting the Object into a preset data type through the built-in Object.
Optionally, the inspecting part includes:
an acquisition sub-part for acquiring target data transferred by the thread;
a comparison sub-section for comparing the target data with standard data according to the target data type;
and the determining sub-part is used for determining that the target data transferred by the thread is correct if the target data is the same as the standard data.
The embodiment of the application provides a data interface, the type of data is written into a configuration file in advance, then the data interface converts target data in the configuration file from the target data type into a preset data type and then transmits the preset data type to a storage system, and by adopting the method, the data transmission of a plurality of devices can be completed by adopting only one data interface, so that the maintenance of the plurality of data interfaces is avoided, and manpower and material resources are saved. Of course, not all of the above-described advantages need be achieved simultaneously in practicing any one of the products or methods of the present application.
Based on the same technical concept, the embodiment of the present invention further provides an electronic device, as shown in fig. 7, including a processor 701, a communication interface 702, a memory 703 and a communication bus 704, where the processor 701, the communication interface 702, and the memory 703 complete communication with each other through the communication bus 704,
a memory 703 for storing a computer program;
the processor 701 is configured to implement the above method steps when executing the program stored in the memory 703.
The communication bus mentioned above for the electronic devices may be a peripheral component interconnect standard (Peripheral Component Interconnect, PCI) bus or an extended industry standard architecture (Extended Industry Standard Architecture, EISA) bus, etc. The communication bus may be classified as an address bus, a data bus, a control bus, or the like. For ease of illustration, the figures are shown with only one bold line, but not with only one bus or one type of bus.
The communication interface is used for communication between the electronic device and other devices.
The Memory may include random access Memory (Random Access Memory, RAM) or may include Non-Volatile Memory (NVM), such as at least one disk Memory. Optionally, the memory may also be at least one memory device located remotely from the aforementioned processor.
The processor may be a general-purpose processor, including a central processing unit (Central Processing Unit, CPU), a network processor (Network Processor, NP), etc.; but also digital signal processors (Digital Signal Processing, DSP), application specific integrated circuits (Application Specific Integrated Circuit, ASIC), field programmable gate arrays (Field-Programmable Gate Array, FPGA) or other programmable logic devices, discrete gate or transistor logic devices, discrete hardware components.
In yet another embodiment of the present invention, there is also provided a computer readable storage medium having stored therein a computer program which when executed by a processor implements the steps of any of the data storage methods described above.
In yet another embodiment of the present invention, there is also provided a computer program product containing instructions that, when run on a computer, cause the computer to perform any of the data storage methods of the above embodiments.
In the above embodiments, it may be implemented in whole or in part by software, hardware, firmware, or any combination thereof. When implemented in software, may be implemented in whole or in part in the form of a computer program product. The computer program product includes one or more computer instructions. When loaded and executed on a computer, produces a flow or function in accordance with embodiments of the present invention, in whole or in part. The computer may be a general purpose computer, a special purpose computer, a computer network, or other programmable apparatus. The computer instructions may be stored in or transmitted from one computer-readable storage medium to another, for example, by wired (e.g., coaxial cable, optical fiber, digital Subscriber Line (DSL)), or wireless (e.g., infrared, wireless, microwave, etc.). The computer readable storage medium may be any available medium that can be accessed by a computer or a data storage device such as a server, data center, etc. that contains an integration of one or more available media. The usable medium may be a magnetic medium (e.g., floppy Disk, hard Disk, magnetic tape), an optical medium (e.g., DVD), or a semiconductor medium (e.g., solid State Disk (SSD)), etc.
It should be noted that in this document, relational terms such as "first" and "second" and the like are used solely to distinguish one entity or action from another entity or action without necessarily requiring or implying any actual such relationship or order between such entities or actions. Moreover, the terms "comprises," "comprising," or any other variation thereof, are intended to cover a non-exclusive inclusion, such that a process, method, article, or apparatus that comprises a list of elements does not include only those elements but may include other elements not expressly listed or inherent to such process, method, article, or apparatus. Without further limitation, an element defined by the phrase "comprising one … …" does not exclude the presence of other like elements in a process, method, article, or apparatus that comprises the element.
The foregoing is merely a specific embodiment of the application to enable one skilled in the art to understand or practice the application. Various modifications to these embodiments will be readily apparent to those skilled in the art, and the generic principles defined herein may be applied to other embodiments without departing from the spirit or scope of the application. Thus, the present application is not intended to be limited to the embodiments shown herein but is to be accorded the widest scope consistent with the principles and novel features disclosed herein.
Claims (8)
1. A method of data storage, the method comprising:
receiving a data storage request sent by a terminal;
acquiring target data from the terminal according to the data storage request, and acquiring a target data type of the target data from a configuration file of the terminal;
converting the target data from the target data type to a preset data type through a data processing cluster;
transmitting the target data of the preset data type to a storage system for storage;
the converting, by the data processing cluster, the target data from the target data type to a preset data type includes:
determining the number of the acquired target data according to the data storage request;
establishing a corresponding number of threads according to the number of the target data;
activating the thread to cause the thread to pass the target data to the data processing cluster;
and converting the target data from the target data type to the preset data type through the data processing cluster.
2. The method of claim 1, wherein after activating the thread to cause the thread to pass the target data to the data processing cluster, the method further comprises:
after the thread finishes transmitting the target data, acquiring feedback information of the thread, and sending the feedback information to the terminal, wherein the feedback information is used for informing the terminal of the transmission condition of the target data;
and after the feedback information is sent to the terminal, recovering the thread.
3. The method of claim 2, wherein the activating the thread to cause the thread to pass the target data to the data processing cluster comprises:
checking whether the target data transferred by the thread is correct;
under the condition that the target data transferred by the thread is correct, acquiring the actual data type of the target data, and confirming whether the actual data type of the target data is the same as the target data type in the configuration file;
and under the condition that the actual data type of the target data is the same as the target data type in the configuration file, converting the target data from the target data type to the preset data type.
4. A method according to claim 3, wherein said converting said target data from said target type to said preset data type comprises:
converting the acquired target data type of the target data into an Object;
and converting the Object into the preset data type through an embedded Object.
5. A method according to claim 3, wherein said verifying whether the target data passed by the thread is correct comprises:
acquiring target data transmitted by the thread;
comparing the target data with standard data according to the target data type;
and if the target data are the same as the standard data, determining that the target data transmitted by the thread are correct.
6. A data storage device, the device comprising:
the receiving module is used for receiving a data storage request sent by the terminal;
the acquisition module is used for acquiring target data from the terminal according to the data storage request and acquiring a target data type of the target data from a configuration file of the terminal;
the conversion module is used for converting the target data from the target data type to a preset data type through the data processing cluster;
the transmission module is used for transmitting the target data of the preset data type to a storage system for storage;
wherein, the conversion module is used for:
determining the number of the acquired target data according to the data storage request;
establishing a corresponding number of threads according to the number of the target data;
activating the thread to cause the thread to pass the target data to the data processing cluster;
and converting the target data from the target data type to the preset data type through the data processing cluster.
7. The electronic equipment is characterized by comprising a processor, a communication interface, a memory and a communication bus, wherein the processor, the communication interface and the memory are communicated with each other through the communication bus;
a memory for storing a computer program;
a processor for implementing the method of any of claims 1-5 when executing a program stored on a memory.
8. A computer readable storage medium, characterized in that the computer readable storage medium has stored therein a computer program which, when executed by a processor, implements the method of any of claims 1-5.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201911368979.7A CN111241172B (en) | 2019-12-26 | 2019-12-26 | Data storage method, device, terminal and computer readable medium |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201911368979.7A CN111241172B (en) | 2019-12-26 | 2019-12-26 | Data storage method, device, terminal and computer readable medium |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN111241172A CN111241172A (en) | 2020-06-05 |
| CN111241172B true CN111241172B (en) | 2023-05-26 |
Family
ID=70864011
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201911368979.7A Active CN111241172B (en) | 2019-12-26 | 2019-12-26 | Data storage method, device, terminal and computer readable medium |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN111241172B (en) |
Families Citing this family (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN112307064A (en) * | 2020-10-29 | 2021-02-02 | 上海达梦数据库有限公司 | Data management system, method and storage medium |
| CN114640632B (en) * | 2022-03-25 | 2023-12-15 | 北京奇艺世纪科技有限公司 | Data aggregation method, system, device, equipment and storage medium |
Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| EP1940133A1 (en) * | 2006-12-31 | 2008-07-02 | Societé Française du Radiotéléphone | System and method for reachability management through at least one communication network |
| CN107277050A (en) * | 2017-07-27 | 2017-10-20 | 维沃移动通信有限公司 | A kind of data processing method, server, terminal and computer-readable recording medium |
| CN109413154A (en) * | 2018-09-26 | 2019-03-01 | 平安普惠企业管理有限公司 | Conversion method of data format, device, computer equipment and storage medium |
| WO2019075978A1 (en) * | 2017-10-16 | 2019-04-25 | 平安科技（深圳）有限公司 | Data transmission method and apparatus, computer device, and storage medium |
-
2019
- 2019-12-26 CN CN201911368979.7A patent/CN111241172B/en active Active
Patent Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| EP1940133A1 (en) * | 2006-12-31 | 2008-07-02 | Societé Française du Radiotéléphone | System and method for reachability management through at least one communication network |
| CN107277050A (en) * | 2017-07-27 | 2017-10-20 | 维沃移动通信有限公司 | A kind of data processing method, server, terminal and computer-readable recording medium |
| WO2019075978A1 (en) * | 2017-10-16 | 2019-04-25 | 平安科技（深圳）有限公司 | Data transmission method and apparatus, computer device, and storage medium |
| CN109413154A (en) * | 2018-09-26 | 2019-03-01 | 平安普惠企业管理有限公司 | Conversion method of data format, device, computer equipment and storage medium |
Non-Patent Citations (2)
| Title |
|---|
| 李日永 ; 金芳 ; 郑绪刚 ; .测控数据传输服务系统设计与实现.计算机与网络.2016,(10),全文. * |
| 高梦超 ; 胡庆宝 ; 程耀东 ; 周旭 ; 李海波 ; 杜然 ; .基于众包的社交网络数据采集模型设计与实现.计算机工程.2015,(04),全文. * |
Also Published As
| Publication number | Publication date |
|---|---|
| CN111241172A (en) | 2020-06-05 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN111241172B (en) | Data storage method, device, terminal and computer readable medium | |
| CN111324363A (en) | Equipment upgrading method, upgrading terminal, equipment and storage medium | |
| CN111400777B (en) | Network storage system, user authentication method, device and equipment | |
| CN110851290A (en) | Data synchronization method and device, electronic equipment and storage medium | |
| US9537940B2 (en) | Exchange of information between processing servers | |
| CN112698640B (en) | ECU upgrading test system | |
| CN112804682B (en) | Data transmission method and device, readable medium and electronic equipment | |
| CN107968717B (en) | Processing method of interface control command and Modem device | |
| CN111125168B (en) | Data processing method and device, electronic equipment and storage medium | |
| US20100020817A1 (en) | Transmission path selecting apparatus and method | |
| CN115335803A (en) | Equipment upgrading method, intelligent equipment and computer readable storage medium | |
| CN115357266A (en) | CAN bus-based airborne equipment upgrading method and device and storage medium | |
| CN115037653A (en) | Service flow monitoring method and device, electronic equipment and storage medium | |
| CN114116262A (en) | Processing method, device, medium and equipment for distributed asynchronous data communication | |
| CN114327542B (en) | Service equipment updating method and device, electronic equipment and storage medium | |
| CN115086214B (en) | System and method for detecting set, electronic equipment and storage medium | |
| CN114328227A (en) | Method and device for carrying out automatic test scheduling | |
| JP6343991B2 (en) | Communication system, communication control method, and communication control program | |
| CN110098860B (en) | Unmanned aerial vehicle data transmission system and data transmission method based on block chain technology | |
| CN111371900B (en) | Method and system for monitoring health state of synchronous link | |
| CN116048859B (en) | Distributed database fault diagnosis method and device, electronic equipment and storage medium | |
| CN110909171B (en) | Data scheduling method, device, terminal and storage medium | |
| CN114342449B (en) | Interface establishing method, device, electronic equipment and computer readable storage medium | |
| US20140289861A1 (en) | System and method for provisioning license keys | |
| CN115357265A (en) | Airborne equipment upgrading system based on CAN bus |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |