CN114896193A - Data recording and storing device and method - Google Patents
Data recording and storing device and method Download PDFInfo
- Publication number
- CN114896193A CN114896193A CN202210416221.1A CN202210416221A CN114896193A CN 114896193 A CN114896193 A CN 114896193A CN 202210416221 A CN202210416221 A CN 202210416221A CN 114896193 A CN114896193 A CN 114896193A
- Authority
- CN
- China
- Prior art keywords
- data
- vpx
- main control
- playback
- board
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
- 238000000034 method Methods 0.000 title claims abstract description 15
- 230000003993 interaction Effects 0.000 claims abstract description 15
- 239000013307 optical fiber Substances 0.000 claims description 71
- 239000007787 solid Substances 0.000 claims description 10
- 238000013480 data collection Methods 0.000 claims 2
- 230000005540 biological transmission Effects 0.000 abstract description 27
- 238000013500 data storage Methods 0.000 description 23
- 238000010586 diagram Methods 0.000 description 9
- 230000006872 improvement Effects 0.000 description 8
- 230000006870 function Effects 0.000 description 5
- 238000012986 modification Methods 0.000 description 4
- 230000004048 modification Effects 0.000 description 4
- 238000013461 design Methods 0.000 description 2
- 238000009434 installation Methods 0.000 description 2
- 238000012545 processing Methods 0.000 description 2
- 238000012546 transfer Methods 0.000 description 2
- 238000004891 communication Methods 0.000 description 1
- 238000013523 data management Methods 0.000 description 1
- 230000007547 defect Effects 0.000 description 1
- 238000011161 development Methods 0.000 description 1
- 238000005516 engineering process Methods 0.000 description 1
- 230000008569 process Effects 0.000 description 1
- 238000006467 substitution reaction Methods 0.000 description 1
- 238000011144 upstream manufacturing Methods 0.000 description 1
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F13/00—Interconnection of, or transfer of information or other signals between, memories, input/output devices or central processing units
- G06F13/38—Information transfer, e.g. on bus
- G06F13/42—Bus transfer protocol, e.g. handshake; Synchronisation
- G06F13/4282—Bus transfer protocol, e.g. handshake; Synchronisation on a serial bus, e.g. I2C bus, SPI bus
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F13/00—Interconnection of, or transfer of information or other signals between, memories, input/output devices or central processing units
- G06F13/38—Information transfer, e.g. on bus
- G06F13/40—Bus structure
- G06F13/4063—Device-to-bus coupling
- G06F13/4068—Electrical coupling
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/06—Digital input from, or digital output to, record carriers, e.g. RAID, emulated record carriers or networked record carriers
- G06F3/0601—Interfaces specially adapted for storage systems
- G06F3/0602—Interfaces specially adapted for storage systems specifically adapted to achieve a particular effect
- G06F3/061—Improving I/O performance
- G06F3/0611—Improving I/O performance in relation to response time
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/06—Digital input from, or digital output to, record carriers, e.g. RAID, emulated record carriers or networked record carriers
- G06F3/0601—Interfaces specially adapted for storage systems
- G06F3/0628—Interfaces specially adapted for storage systems making use of a particular technique
- G06F3/0655—Vertical data movement, i.e. input-output transfer; data movement between one or more hosts and one or more storage devices
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/06—Digital input from, or digital output to, record carriers, e.g. RAID, emulated record carriers or networked record carriers
- G06F3/0601—Interfaces specially adapted for storage systems
- G06F3/0628—Interfaces specially adapted for storage systems making use of a particular technique
- G06F3/0655—Vertical data movement, i.e. input-output transfer; data movement between one or more hosts and one or more storage devices
- G06F3/0656—Data buffering arrangements
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/06—Digital input from, or digital output to, record carriers, e.g. RAID, emulated record carriers or networked record carriers
- G06F3/0601—Interfaces specially adapted for storage systems
- G06F3/0668—Interfaces specially adapted for storage systems adopting a particular infrastructure
- G06F3/0671—In-line storage system
- G06F3/0683—Plurality of storage devices
- G06F3/0689—Disk arrays, e.g. RAID, JBOD
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F2213/00—Indexing scheme relating to interconnection of, or transfer of information or other signals between, memories, input/output devices or central processing units
- G06F2213/0026—PCI express
-
- Y—GENERAL TAGGING OF NEW TECHNOLOGICAL DEVELOPMENTS; GENERAL TAGGING OF CROSS-SECTIONAL TECHNOLOGIES SPANNING OVER SEVERAL SECTIONS OF THE IPC; TECHNICAL SUBJECTS COVERED BY FORMER USPC CROSS-REFERENCE ART COLLECTIONS [XRACs] AND DIGESTS
- Y02—TECHNOLOGIES OR APPLICATIONS FOR MITIGATION OR ADAPTATION AGAINST CLIMATE CHANGE
- Y02D—CLIMATE CHANGE MITIGATION TECHNOLOGIES IN INFORMATION AND COMMUNICATION TECHNOLOGIES [ICT], I.E. INFORMATION AND COMMUNICATION TECHNOLOGIES AIMING AT THE REDUCTION OF THEIR OWN ENERGY USE
- Y02D10/00—Energy efficient computing, e.g. low power processors, power management or thermal management
Abstract
The invention discloses a data recording and storing device and a method, the device comprises a main control unit, a VPX back plate, at least 2 acquisition and playback units and at least 2 storage units, wherein the main control unit is connected with each acquisition and playback unit and the storage units through the VPX back plate, the main control unit is connected with the VPX back plate through a PCIe3.0X16 bus, each acquisition and playback unit is respectively connected with the VPX back plate through 2 PCIe3.0X8 buses, and each storage unit is respectively connected with the VPX back plate through 4 PCIe3.0X4 buses. The equipment expands a PCIe3.0X16 bus interface of the main control unit into 4 PCIe3.0X8 buses and 8 PCIe3.0X4 buses through a VPX back plate, and ultra-high-speed data transmission interaction between the main control unit, the acquisition and playback unit and the storage unit is realized, so that the purpose of ultrahigh data acquisition, recording and storage rate is achieved.
Description
Technical Field
The invention belongs to the technical field of data recording and storing, relates to a data recording and storing device and method, and particularly relates to a device and method capable of improving the real-time data transmission rate and recording and storing performance and meeting the application requirements of real-time acquisition, recording and storing of massive optical fiber data.
Background
The acquisition, recording and storage of high-speed data are always upgraded in the direction of faster and higher requirements, but there are many limiting factors for real-time acquisition, recording and storage of mass data, including how to transmit the acquired data at high speed, how to realize real-time large-bandwidth recording of the high-speed data, and the like, which are all problems that must be faced in the application scenario of high-performance and high-requirement data acquisition, recording and storage.
In the conventional data acquisition and recording product at present, a high-performance CPU is used as an equipment core controller, and then data acquisition and storage are realized by mounting a data acquisition function board card and a data storage function board card, but the original PCIe3.0 bus resource of a general CPU processor is limited, and the bus interfaces of the connected data acquisition function board card and the data storage function board card cannot achieve higher throughput, generally can only achieve the capability of PCIe3.0X8, that is, the instantaneous bandwidth capability of real-time data recording and storage is about 3.5 GB/s. Therefore, limited CPU resources and expansion capabilities have limited the development of higher bandwidth data transfer capabilities. Because the high-speed data transmission link interface of the conventional data acquisition and recording product is limited, only a single-function board card configuration can be adopted in the equipment capability, and the data acquisition capability or the data storage capability cannot be further expanded, so that the high-speed data transmission link interface cannot adapt to various different application scenes. For a conventional data acquisition recording product, in the data acquisition process, because a high-speed bus interface from a data acquisition function board card to a CPU (central processing unit) end of a main control computer is limited, more data cannot be transmitted to the main control computer board, that is, a data acquisition application scene with higher speed and more data volume cannot be met.
Data record storage is also one of the most critical components in conventional data acquisition record products, and is also an important condition for determining the speed of data record storage. In order to meet the requirement of recording and storing high-capacity high-speed data, a RAID array card is generally adopted at present, a plurality of hard disks are mounted on the RAID array card to form a high-capacity disk array, and the requirement of recording capacity of mass data is met, but the RAID array card is connected with a main control computer through pci e3.0X8, so that the real-time data recording and storing speed of the RAID array card is difficult to reach more than 4GB/s, and more data cannot be recorded in real time.
Based on the current practical problems, it is necessary to develop a super-high speed data recording and storing device and method to meet the application requirements of transmitting and recording more data in real time.
Disclosure of Invention
The technical problem to be solved by the invention is to overcome the defects of the prior art and provide a data recording and storing device and a data recording and storing method with good transmission stability and high transmission efficiency.
In order to solve the technical problems, the invention adopts the following technical scheme:
the utility model provides a data recording storage device, includes main control unit, VPX backplate, at least 2 gather playback unit and at least 2 memory cell, and the main control unit passes through the VPX backplate and every gathers playback unit and memory cell connection, the main control unit passes through PCIe3.0X16 bus and VPX backplate connection, and every gathers playback unit and connects through 2 PCIe3.0X8 bus and VPX backplate respectively, and every memory cell passes through 4 PCIe3.0X4 buses and VPX backplate connection respectively.
As a further improvement of the invention: the VPX back plate is provided with a PCIe3.0 Switch exchange chip, the PCIe3.0 Switch exchange chip is connected to the main control unit through a PCIe3.0X16 bus, connected with the acquisition playback unit through a PCIe3.0X8 bus, and connected with the storage unit through a PCIe3.0X4 bus.
As a further improvement of the invention: the PCIe3.0 Switch exchange chip is a 96-channel PCIe3.0 Switch exchange chip.
As a further improvement of the invention: the VPX back board is also provided with an interface board which is provided with a ten-gigabit Ethernet interface and used for transferring data to other equipment.
As a further improvement of the invention: the acquisition playback unit is an optical fiber data acquisition playback board, 1 or 2 FPGA processors are arranged on the optical fiber data acquisition playback board, the FPGA processors are connected with external acquisition equipment through an optical fiber acquisition channel and are connected with external playback equipment through an optical fiber playback channel, and each FPGA processor is connected to the VPX backboard through a 1-way PCIe3.0X8 interface to realize data interaction with the main control unit.
As a further improvement of the invention: the storage unit is a hard disk array formed by a plurality of NVMe solid-state disks, and each NVMe solid-state disk is connected to the VPX backplane through a 1-way PCIe3.0X4 bus respectively, so that data interaction with the main control unit is realized.
As a further improvement of the invention: the NVMe solid-state disk is an NVMe U.2 solid-state disk, and the capacity can be 2TB or 4TB or 6TB or 8 TB.
As a further improvement of the invention: the main control unit is a main control computer board, and a CPU on the main control computer board is a processor with 16 cores and 32 threads.
As a further improvement of the invention: the master computer board is designed according to the VITA46 standard.
As a general inventive concept, the present invention also provides a data record storage method applied to the above data record storage device, including the steps of:
s1, the acquisition playback unit sends the acquired data to a VPX back panel through a corresponding PCIe3.0X8 bus, and the VPX back panel forwards the acquired data to the main control unit through the PCIe3.0X16 bus;
s2, the main control unit obtains data from a VPX back plate, after the data are cached, the data are sent to the VPX back plate through PCIe3.0X16 buses, and the VPX back plate forwards the data to a corresponding storage unit through each PCIe3.0X4 bus;
and S3, the storage unit acquires the data from the VPX backplane and stores the data.
Compared with the prior art, the invention has the advantages that:
(1) the data recording and storing device of the invention expands the PCIe3.0X16 bus interface of the main control unit into 4 PCIe3.0X8 buses and 8 PCIe3.0X4 buses through the VPX back board, the main control unit interacts with the acquisition and playback unit through the 4 PCIe3.0X8 buses and interacts with the storage unit through the 8 PCIe3.0X4 buses, thereby realizing the ultra-high speed data transmission interaction between the main control unit and the acquisition and playback unit and the storage unit, and further achieving the purpose of ultra-high data acquisition, recording and storing speed.
(2) The data recording and storing device can support 4 optical fiber data acquisition and playback devices, and transmission channels of the optical fiber data acquisition and playback devices are mutually independent, so that flexible configuration is facilitated according to application requirements.
(3) The data recording and storing device can support a disk array consisting of 8 solid-state disks, the instantaneous data read-write speed is from 2.0GB/s to 10GB/s, and the requirements of most data acquisition and recording application scenes can be met.
(4) The data recording and storing device provided by the invention is provided with a gigabit Ethernet interface, and can rapidly transfer data to other devices through the gigabit Ethernet interface.
Drawings
Fig. 1 is a block diagram illustrating an overall hardware configuration of a data recording and storing apparatus according to embodiment 1 of the present invention.
Fig. 2 is a topology diagram of internal pci e3.0 bus of the data recording and storing device in embodiment 1 of the present invention.
Fig. 3 is a schematic diagram of the connection of the whole hardware bus resources of the data recording and storing device in embodiment 1 of the present invention.
Fig. 4 is a schematic diagram of an optical fiber data acquisition and playback block in a data recording and storing device according to embodiment 1 of the present invention.
Fig. 5 is a flowchart of a data record storage method according to embodiment 1 of the present invention.
Fig. 6 is a schematic diagram of a data transmission process of the data recording and storing device according to embodiment 1 of the present invention.
Illustration of the drawings: 1. a main control unit; 2. a VPX backplane; 3. a collection playback unit; 4. and a memory unit.
Detailed Description
The invention is further described below with reference to the drawings and specific preferred embodiments of the description, without thereby limiting the scope of protection of the invention.
The data recording and storing equipment comprises a main control unit 1, a VPX back plate 2, at least 2 acquisition and playback units 3 and at least 2 storage units 4, wherein the main control unit 1 is connected with each acquisition and playback unit 3 and each storage unit 4 through the VPX back plate 2, the main control unit 1 is connected with the VPX back plate 2 through a PCIe3.0X16 bus, each acquisition and playback unit 3 is respectively connected with the VPX back plate 2 through 2 PCIe3.0X8 buses, and each storage unit 4 is respectively connected with the VPX back plate 2 through 4 PCIe3.0X4 buses. The device expands a PCIe3.0X16 bus interface of a main control unit 1 into 4 PCIe3.0X8 buses and 8 PCIe3.0X4 buses through a VPX back plate 2, the main control unit 1 interacts with an acquisition playback unit 3 through 4 PCIe3.0X8 buses and interacts with a storage unit 4 through 8 PCIe3.0X4 buses, ultra-high speed data transmission interaction between the main control unit 1 and the acquisition playback unit 3 and the storage unit 4 is realized, and the purpose of ultra-high data acquisition, recording and storage rate is achieved.
The VPX backplane 2 is provided with a pci 3.0 Switch chip, the pci 3.0 Switch chip is connected to the main control unit 1 through a pci 3.0X16 bus, connected to the acquisition playback unit 3 through a pci 3.0X8 bus, and connected to the storage unit 4 through a pci 3.0X4 bus.
The PCIe3.0 Switch chip is a 96-channel PCIe3.0 Switch chip.
The VPX backplane 2 is further provided with an interface board, and the interface board is provided with a gigabit ethernet interface for transferring data to other devices.
The acquisition playback unit 3 is an optical fiber data acquisition playback board, 1 or 2 pieces of FPGA processors are arranged on the optical fiber data acquisition playback board, the FPGA processors are connected with external acquisition equipment such as a sensor and a camera through an optical fiber acquisition channel, and are connected with external playback equipment such as a video player through an optical fiber playback channel, and each piece of FPGA processor is connected to the VPX backboard 2 through 1 path of PCIe3.0X8 interface, so that data interaction with the main control unit 1 is realized. The device can support 4 optical fiber data acquisition and playback devices, and transmission channels of the optical fiber data acquisition and playback devices are mutually independent, so that flexible configuration is facilitated according to application requirements.
The storage unit 4 is a hard disk array composed of a plurality of NVMe solid-state disks, and each NVMe solid-state disk is connected to the VPX backplane 2 through 1 channel of pci 3.0 × 4 bus, so as to realize data interaction with the main control unit 1.
NVMe solid-state disk is NVMe U.2 solid-state disk, and the capacity can be 2TB or 4TB or 6TB or 8 TB.
The device can support a disk array consisting of 8 solid-state disks, the instantaneous data read-write speed is from 2.0GB/s to 10GB/s, and the requirements of most data acquisition and recording application scenes can be met.
The main control unit 1 is a main control computer board, and a CPU on the main control computer board is a processor with 16 cores and 32 threads. And the VPX back plate is provided with a power supply board card for supplying power to each functional board card.
The optical fiber data acquisition playback board, the data storage board, the main control computer board, the VPX backboard 2, the power supply board and the interface board are all designed according to the VITA46 standard, the VPX backboard 2 is designed into a 6-slot 6U VPX backboard, the optical fiber data acquisition playback board, the data storage board, the main control computer board and the power supply board are full-length VPX boards and are installed on the VPX backboard 2 in a front-mounted installation mode, and the interface board is designed according to a half-length VPX board and is installed from the back of a chassis.
The data record storage method of the invention is applied to the data record storage device, and comprises the following steps:
s1, the acquisition playback unit 3 sends the acquired data to the VPX backplane 2 through the corresponding PCIe3.0X8 bus, and the VPX backplane 2 forwards the data to the main control unit 1 through the PCIe3.0X16 bus;
s2, the main control unit 1 obtains the data from the VPX backplane 2, after caching the data, the data is sent to the VPX backplane 2 through the PCIe3.0X16 bus, and the VPX backplane 2 forwards the data to the corresponding storage unit 4 through each PCIe3.0X4 bus;
s3, the storage unit 4 acquires data from the VPX backplane 2 and stores the data.
Aiming at the problem of ultra-large recording bandwidth of data recording and storage, the invention adopts a PCIe3.0 high-speed serial data transmission bus technology to design hardware board cards such as an optical fiber data acquisition playback board, a data storage board, a main control computer board, a VPX back board, an interface board, a power supply board and the like, and adopts a PCIe Switch chip on the VPX back board to design, so that the data between the optical fiber data acquisition playback board, the data storage board and the main control computer board are stably transmitted at high speed, the PCIe3.0X16 bus interface resources of the main control computer board are fully expanded, the transmission of ultra-high speed data and the data recording and storage are met, the transmission length and the transmission energy loss of a PCIe3.0 bus are reduced, the number of external PCIe3.0 buses is greatly expanded, and the equipment is ensured to have good enough expandability. The ultra-high speed data recording and storing device can be applied to application scenes of higher data transmission and faster real-time data recording.
Example 1:
the present embodiment provides a data recording and storing device, as shown in fig. 1, the device includes two optical fiber data acquisition playback boards, two data storage boards, a main control computer board, a VPX backplane 2, a power board, and an interface board, each of the functional boards is installed on the VPX backplane 2, in order to satisfy high-speed data transmission between the optical fiber data acquisition playback boards and the main control computer board, a pci 3.0 Switch chip is designed on the VPX backplane 2, and a pci 3.0X16 bus on the main control computer board can be extended to connect more optical fiber data acquisition playback boards and data storage boards, thereby implementing real-time transmission and recording of high-speed data.
The single optical fiber data acquisition playback board realizes the acquisition and playback of 2 groups of 12 paths of optical fiber data, and performs data interaction with the main control computer board through a PCIe3.0 bus; the data storage board mainly comprises an NVMe U.2 solid-state disk and is mainly responsible for recording and storing optical fiber data in real time; the main control computer board is used for deploying optical fiber data acquisition recording management software, and realizing acquisition and playback control, data management, data transmission cache and the like of optical fiber data; the VPX backplane 2 is mainly used for the interface interconnection among all the functional board cards to realize the data interaction and power supply in the equipment; the power panel provides necessary power supply for each functional board card; the interface board is used for expanding the conventional universal interfaces of the external communication of the main control computer board, and comprises a USB interface, a gigabit network interface, a tera network interface and the like.
Inside the data recording and storing device, the optical fiber data acquisition playback board, the data storage board, the main control computer board, the VPX back board 2, the power supply board and the interface board are all designed according to the VITA46 standard, the VPX back board 2 is designed into a 6-slot 6U VPX back board, the optical fiber data acquisition playback board, the data storage board, the main control computer board and the power supply board are full-length VPX board cards and are installed on the VPX back board 2 in a front-mounted installation mode, and the interface board is designed according to a half-length VPX board card and is installed from the back of a chassis.
Fig. 2 is a topology diagram of a pci 3.0 bus in the data recording and storing device of this embodiment, and as shown in fig. 2, in order to meet the requirement of high-speed data transmission, the optical fiber data acquisition playback board and the data storage board are all interconnected with the main control computer board according to the pci 3.0 high-speed serial bus. A96-channel PCIe3.0 Switch exchange chip is designed on the VPX backplane 2, and the chip is a core hub of data interaction inside the device. The master control computer board is an upstream device, and is connected to the pci 3.0 Switch chip through a pci 3.0X16 bus, the optical fiber data acquisition playback board and the data storage board are downstream devices for the pci 3.0 Switch chip, the two optical fiber data acquisition playback boards are connected to the pci 3.0 Switch chip through 4 pci 3.0X8 buses, and the two data storage boards are connected to the pci 3.0 Switch chip through 8 pci 3.0X4 buses. In this embodiment, the pci 3.0 bus is expanded and interconnected through the pci 3.0 Switch chip, so that high-speed data transmission interaction between the main control computer and the optical fiber data acquisition playback board and between the main control computer and the data storage board is realized, and the purpose of higher data acquisition, recording and storage rate is achieved.
Fig. 3 is a schematic diagram of the connection of the whole hardware bus resources of the data recording and storing device of this embodiment. As shown in fig. 3, there are two optical fiber data acquisition playback boards inside the device, two high-performance FPGA processors are designed on the optical fiber data acquisition playback boards, each FPGA processor realizes acquisition and playback of 12 paths of optical fiber data, that is, the FPGA processor is connected to an external acquisition device (such as a sensor and a camera) through an optical fiber acquisition channel, and is connected to an external playback device (such as a video player) through an optical fiber playback channel, and each FPGA processor is connected to a pci 3.0 Switch chip on a backplane through 1 path of pci 3.0X8 interface, so as to realize data interaction with a main control computer board. In this embodiment, two FPGA processors on the optical fiber data acquisition playback board are of the same type, and 2 groups of 12 optical fiber data acquisition playback channels are all the same, so for the optical fiber data acquisition playback board card presented by the main control computer board, every 1 group of 12 optical fiber acquisition playback channels constitutes one optical fiber data acquisition playback device, at most 4 optical fiber data acquisition playback devices can be supported and installed inside the data recording storage device of this embodiment, and each optical fiber data acquisition playback device is mutually independent, and in practical application, 1 or at most 4 optical fiber data acquisition playback devices can be selectively configured as required.
Similarly, the data recording and storing device of this embodiment has two data storage boards, the data storage boards are designed by using high-performance NVMe U.2 solid state disks, each data storage board has 4 NVMe U.2 solid state disks, and each solid state disk is connected to the main control computer board through 1-way pci 3.0X4 bus, so as for the main control computer board, each solid state disk directly appears as 1 storage device. In practical application, the capacity of the solid state disk can be selected according to requirements, the capacity of the solid state disk can be selected from various specifications such as 2TB, 4TB, 6TB or 8TB, the number of the installed solid state disks can also be selected according to real-time data bandwidth in practical application scenes, at least 1 or at most 8 solid state disks can be selected to be installed, 1 large disk array is built in the main control computer, and extremely flexible selective configuration can be achieved according to user requirements. The number of the solid-state disks and the capacity of the single disk determine the speed of whole disk array, namely the speed of real-time data recording, and the instantaneous data read-write speed of the whole disk array is from 2.0GB/s to 10GB/s, so that the requirements of most data acquisition and recording application scenes can be met.
Fig. 4 is a schematic diagram of an optical fiber data acquisition playback block in the data recording and storing device of this embodiment, as shown in the figure, after acquiring and receiving optical fiber data, an FPGA processor on the optical fiber data acquisition playback board caches in a DDR cache mounted on the optical fiber data acquisition playback board, then transmits the data to a main control computer board through a pci 3.0X8 bus, and writes the data into a data storage board after caching the data in an internal memory of the main control computer board, thereby implementing acquisition, recording and storing of the optical fiber data.
In order to better ensure real-time transmission and recording of ultra-high-speed data, the data recording and storing device of the embodiment is designed by adopting a high-performance server main control computer board, a CPU on the main control computer board is a high-performance processor with 16 cores and 32 threads, and strong processing capacity meets the requirement of real-time transmission, recording and storing of ultra-high-speed mass data, so that high-speed data transmission interaction between the main control computer board and the optical fiber data acquisition playback board and between the main control computer board and the data storage board is ensured.
In addition, the data recording and storing device of the embodiment further includes a 1-channel 40G gigabit ethernet interface, and data can be transferred to other devices through the gigabit ethernet interface.
A data recording and storing method of the present embodiment is applied to the data recording and storing device of the present embodiment, as shown in fig. 5, and includes the following steps:
s1, the optical fiber data acquisition playback board sends the acquired data to a PCIe3.0 Switch exchange chip through a corresponding PCIe3.0X8 bus, and the PCIe3.0 Switch exchange chip forwards the data to the master control computer board through the PCIe3.0X16 bus;
s2, the master control computer board obtains data sent by the PCIe3.0 Switch chip, after the data are cached, the data are sent to the PCIe3.0 Switch chip through a PCIe3.0X16 bus, and the PCIe3.0 Switch chip forwards the data to the corresponding NVMe U.2 solid-state disk through each PCIe3.0X4 bus;
the S3 and NVMe U.2 solid-state disks acquire and store data sent by the pci 3.0 Switch chip.
Fig. 6 is a schematic diagram of a data transmission process of the data recording and storing device in this embodiment, as shown in the figure, an upper computer sends a related instruction to control a main control computer board through optical fiber data recording management software;
when an optical fiber data acquisition instruction is sent, the main control computer board controls the optical fiber data acquisition playback board to acquire data according to the received instruction, then the optical fiber data acquisition playback board is connected to a PCIe Switch chip through 4 PCIe3.0X8 bus links, then the optical fiber data is transmitted to the main control computer board through 1 PCIe X16 bus link, the main control computer board caches the optical fiber data and then transmits the optical fiber data to the PCIe Switch chip, and the optical fiber data is recorded and stored to the data storage board through 8 PCIe3.0X4 bus links, so that the real-time transmission, recording and storage of mass data are completed;
when an optical fiber data playback instruction is sent, the main control computer board controls the data storage board to transmit the stored data to the PCIe Switch chip through 8 PCIe3.0X4 bus links according to the received instruction, then transmits the optical fiber data to the main control computer board through 1 PCIe X16 bus link, and then transmits the optical fiber data to the PCIe Switch chip, and transmits the optical fiber data to the optical fiber data acquisition playback board through 4 PCIe3.0X8 bus links, and transmits the optical fiber data to external playback equipment through an optical fiber playback channel therein, so that real-time transmission and playback of mass data are completed.
Although the present invention has been described with reference to the preferred embodiments, it is not intended to be limited thereto. Those skilled in the art can make many possible variations and modifications to the disclosed embodiments, or equivalent modifications, without departing from the spirit and scope of the invention, using the methods and techniques disclosed above. Therefore, any simple modifications, equivalent substitutions, equivalent changes and modifications made to the above embodiments according to the technical essence of the present invention are within the scope of the technical scheme of the present invention.
Claims (10)
1. The data recording and storing device is characterized by comprising a main control unit (1), a VPX back plate (2), at least 2 acquisition and playback units (3) and at least 2 storage units (4), wherein the main control unit (1) is connected with each acquisition and playback unit (3) and each storage unit (4) through the VPX back plate (2), the main control unit (1) is connected with the VPX back plate (2) through a PCIe3.0X16 bus, each acquisition and playback unit (3) is connected with the VPX back plate (2) through 2 PCIe3.0X8 buses, and each storage unit (4) is connected with the VPX back plate (2) through 4 PCIe3.0X4 buses.
2. The data recording and storing device as claimed in claim 1, wherein a pci 3.0 Switch chip is disposed on the VPX backplane, the pci 3.0 Switch chip is connected to the main control unit (1) through a pci 3.0X16 bus, the collection and playback unit (3) is connected through a pci 3.0X8 bus, and the storage unit (4) is connected through a pci 3.0X4 bus.
3. The data recording and storing device of claim 2, wherein the pci 3.0 Switch chip is a 96-channel pci 3.0 Switch chip.
4. The data record storage device according to claim 2, wherein the VPX backplane (2) is further provided with an interface board, and the interface board is provided with a gigabit ethernet interface for forwarding data to other devices.
5. The data recording and storing device according to claim 1, wherein the collection and playback unit (3) is an optical fiber data collection and playback board, 1 or 2 pieces of FPGA processors are disposed on the optical fiber data collection and playback board, the FPGA processors are connected to external collection devices through optical fiber collection channels and to external playback devices through optical fiber playback channels, and each piece of FPGA processor is connected to the VPX backplane (2) through 1 path of pci 3.0X8 interface, so as to realize data interaction with the main control unit (1).
6. The data recording and storing device according to claim 1, wherein the storage unit (4) is a hard disk array composed of a plurality of NVMe solid-state disks, and each NVMe solid-state disk is connected to the VPX backplane (2) through a 1-way pci 3.0X4 bus, so as to realize data interaction with the main control unit (1).
7. The data recording and storing device of claim 6, wherein the NVMe solid state disk is an NVMe U.2 solid state disk with a capacity of 2TB or 4TB or 6TB or 8 TB.
8. The data record storage device according to any one of claims 1 to 7, wherein the master control unit (1) is a master control computer board, and a CPU on the master control computer board is a processor of 16-core 32-thread.
9. The data record storage device of claim 8 wherein said master computer board is designed in accordance with the VITA46 standard.
10. A data record storage method applied to the data record storage device of any one of claims 1 to 9, comprising the steps of:
s1, the acquisition playback unit (3) sends the acquired data to a VPX back panel (2) through a corresponding PCIe3.0X8 bus, and the VPX back panel (2) forwards the data to the main control unit (1) through the PCIe3.0X16 bus;
s2, the main control unit (1) acquires data from a VPX backplane (2), after the data are cached, the data are sent to the VPX backplane (2) through a PCIe3.0X16 bus, and the VPX backplane (2) forwards the data to the corresponding storage unit (4) through each PCIe3.0X4 bus;
s3, the storage unit (4) acquires the data from the VPX backboard (2) and stores the data.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202210416221.1A CN114896193A (en) | 2022-04-20 | 2022-04-20 | Data recording and storing device and method |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202210416221.1A CN114896193A (en) | 2022-04-20 | 2022-04-20 | Data recording and storing device and method |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN114896193A true CN114896193A (en) | 2022-08-12 |
Family
ID=82716896
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202210416221.1A Pending CN114896193A (en) | 2022-04-20 | 2022-04-20 | Data recording and storing device and method |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN114896193A (en) |
Citations (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN105335326A (en) * | 2015-10-10 | 2016-02-17 | 广州慧睿思通信息科技有限公司 | PCIE-SATA interface array device based on FPGA |
| CN106453018A (en) * | 2016-11-28 | 2017-02-22 | 天津光电通信技术有限公司 | Communication platform based on PCIe Switch and communication method |
| CN109613491A (en) * | 2018-12-24 | 2019-04-12 | 上海威固信息技术股份有限公司 | A kind of high-speed signal acquisition storage and playback system based on FPGA |
| CN109783418A (en) * | 2018-12-21 | 2019-05-21 | 中北大学 | A kind of broadband signal high speed acquisition and Waveform storage analysis system |
| CN211427336U (en) * | 2019-12-17 | 2020-09-04 | 长沙湘计海盾科技有限公司 | Embedded VPX calculation module |
| CN113268445A (en) * | 2021-03-25 | 2021-08-17 | 长沙瑞腾信息技术有限公司 | Method for realizing domestic dual-control hybrid storage control module based on VPX architecture |
| CN216014252U (en) * | 2021-07-20 | 2022-03-11 | 湖南艾科诺维科技有限公司 | Multi-channel data acquisition, storage and playback card and system based on HP interface |
-
2022
- 2022-04-20 CN CN202210416221.1A patent/CN114896193A/en active Pending
Patent Citations (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN105335326A (en) * | 2015-10-10 | 2016-02-17 | 广州慧睿思通信息科技有限公司 | PCIE-SATA interface array device based on FPGA |
| CN106453018A (en) * | 2016-11-28 | 2017-02-22 | 天津光电通信技术有限公司 | Communication platform based on PCIe Switch and communication method |
| CN109783418A (en) * | 2018-12-21 | 2019-05-21 | 中北大学 | A kind of broadband signal high speed acquisition and Waveform storage analysis system |
| CN109613491A (en) * | 2018-12-24 | 2019-04-12 | 上海威固信息技术股份有限公司 | A kind of high-speed signal acquisition storage and playback system based on FPGA |
| CN211427336U (en) * | 2019-12-17 | 2020-09-04 | 长沙湘计海盾科技有限公司 | Embedded VPX calculation module |
| CN113268445A (en) * | 2021-03-25 | 2021-08-17 | 长沙瑞腾信息技术有限公司 | Method for realizing domestic dual-control hybrid storage control module based on VPX architecture |
| CN216014252U (en) * | 2021-07-20 | 2022-03-11 | 湖南艾科诺维科技有限公司 | Multi-channel data acquisition, storage and playback card and system based on HP interface |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN105335327B (en) | Restructural based on Soc/dual redundant VPX3U signal transacting support plates | |
| CN111581153A (en) | Radar signal processing device based on Open VPX | |
| US20130159622A1 (en) | Chained, scalable storage devices | |
| JP2008546049A (en) | Destination disk access method, disk capacity expansion system, and disk array | |
| CN105824366A (en) | Large-capacity high-speed recording board card on basis of Rapid IO (Input-Output) | |
| CN113448402B (en) | Server supporting multi-backboard cascade | |
| CN101178634A (en) | Knife blade server and storage realization method therefor | |
| US10318473B2 (en) | Inter-device data-transport via memory channels | |
| EP2765501A1 (en) | Chained, scalable storage devices | |
| CN109933554A (en) | A kind of NVMe hard disk expansion apparatus based on GPU server | |
| CN113590528A (en) | Multi-channel data acquisition, storage and playback card, system and method based on HP interface | |
| CN210639614U (en) | NVME hard disk backboard system supporting various bandwidths | |
| CN109189347A (en) | A kind of sharing storage module, server and system | |
| US20110283063A1 (en) | Disk array device, a disk array device control method and a disk array device control program | |
| CN204557308U (en) | A kind of high density Novel cutter flap-type server based on fusion architecture | |
| CN112636932B (en) | Dynamic adjustment method and system for equipment power consumption | |
| CN105511990B (en) | Device based on fusion architecture dual redundant degree storage control node framework | |
| CN111475459A (en) | 9U VPX data storage server and data processing method | |
| CN116700445A (en) | Full flash ARM storage server based on distributed storage hardware architecture | |
| CN100541387C (en) | A kind of server system based on the Opteron processor | |
| CN114896193A (en) | Data recording and storing device and method | |
| US20120207153A1 (en) | Information processing system, relay device, and communication control method | |
| CN107391428B (en) | Novel framework four-way server | |
| CN216014252U (en) | Multi-channel data acquisition, storage and playback card and system based on HP interface | |
| CN212484353U (en) | Radar signal processing device based on Open VPX |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination |