CN114116567A - Big data calculation analysis system and method - Google Patents

Big data calculation analysis system and method Download PDF

Info

Publication number
CN114116567A
CN114116567A CN202111430683.0A CN202111430683A CN114116567A CN 114116567 A CN114116567 A CN 114116567A CN 202111430683 A CN202111430683 A CN 202111430683A CN 114116567 A CN114116567 A CN 114116567A
Authority
CN
China
Prior art keywords
analysis
calculation
data
unit
processing unit
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
CN202111430683.0A
Other languages
Chinese (zh)
Inventor
袁赫
王兴旭
杨毅
孟庆禹
李常礼
邵志鹏
闫永明
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Liaoning Shenzhou Beidou Technology Co ltd
Original Assignee
Liaoning Shenzhou Beidou Technology Co ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Liaoning Shenzhou Beidou Technology Co ltd filed Critical Liaoning Shenzhou Beidou Technology Co ltd
Priority to CN202111430683.0A priority Critical patent/CN114116567A/en
Publication of CN114116567A publication Critical patent/CN114116567A/en
Pending legal-status Critical Current

Links

Images

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F13/00Interconnection of, or transfer of information or other signals between, memories, input/output devices or central processing units
    • G06F13/38Information transfer, e.g. on bus
    • G06F13/382Information transfer, e.g. on bus using universal interface adapter
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F13/00Interconnection of, or transfer of information or other signals between, memories, input/output devices or central processing units
    • G06F13/38Information transfer, e.g. on bus
    • G06F13/42Bus transfer protocol, e.g. handshake; Synchronisation
    • G06F13/4282Bus transfer protocol, e.g. handshake; Synchronisation on a serial bus, e.g. I2C bus, SPI bus
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04LTRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L67/00Network arrangements or protocols for supporting network services or applications
    • H04L67/14Session management
    • H04L67/141Setup of application sessions

Abstract

The invention provides a big data calculation and analysis system and a method, which relate to the technical field of data processing, and the system comprises a processing unit, a switch unit and a plurality of calculation and analysis units, wherein the processing unit divides data to be processed sent by a remote server into a plurality of subdata and respectively transmits the plurality of subdata to the corresponding calculation and analysis units through the switch unit, the calculation and analysis units perform data calculation and analysis on the received subdata and return the obtained analysis data to the processing unit through the switch unit, and the processing unit is also used for receiving and summarizing the analysis data returned by each calculation and analysis unit and transmitting the summarized analysis data to the remote server. The big data calculation and analysis system and the big data calculation and analysis method provided by the invention can efficiently and quickly calculate and analyze data, ensure the real-time property of transmission, have high cost performance, and bring a low-investment and high-performance calculation and analysis system for big data.

Description

Big data calculation analysis system and method
Technical Field
The invention relates to the technical field of data processing, in particular to a big data calculation analysis system and a big data calculation analysis method.
Background
With the development of data processing technology, technology for monitoring data processing has also developed.
In the industries of electric power, traffic and the like, a large number of high-definition monitoring devices are used for detecting the real-time dynamic state of a field, and a large amount of data is generated along with the high-definition monitoring devices, so that a large-scale server device is needed for processing the large amount of data.
However, the large server in the prior art is not only large in size, but also expensive in manufacturing cost, and although the processing speed is guaranteed, the cost is too high. Although the small server is low in cost, the data processing speed is low, and the small server is not suitable for a large amount of high-definition monitoring data generated in real time.
Disclosure of Invention
In view of this, the present invention provides a big data calculation and analysis system, which calculates and analyzes data efficiently and quickly, realizes real-time transmission, reduces the volume, and improves the cost performance, thereby providing a low-investment and high-performance calculation and analysis system for big data.
In a first aspect, an embodiment of the present invention provides a big data computation analysis system, including a processing unit, a switch unit, and multiple computation analysis units;
the processing unit is respectively connected with each calculation analysis unit through the switch unit, and is used for splitting data to be processed sent by a remote server into a plurality of subdata and respectively transmitting the plurality of subdata to the corresponding calculation analysis units through the switch unit; the calculation analysis unit is used for performing data calculation analysis on the received subdata and returning the obtained analysis data to the processing unit through the switch unit; the processing unit is also used for receiving and summarizing the analytic data returned by each calculation analytic unit and transmitting the summarized analytic data to the remote server.
Furthermore, the processing unit is an ARM processor, the calculation and analysis unit comprises an NX module and a solid state disk which are interconnected, and the ARM processor is connected with the NX module through the switch unit;
the big data calculation analysis system further comprises a wide area network interface connected with the processing unit, and the wide area network interface is used for being in communication connection with the remote server.
Furthermore, the ARM processor is also connected with the NX module through a serial port, and the ARM processor is used for configuring parameters of the NX module through the serial port.
Furthermore, the big data calculation and analysis system also comprises a single chip microcomputer which is respectively connected with each calculation and analysis unit; the single chip microcomputer is used for controlling handshake response starting required by each calculation analysis unit when the calculation analysis unit is started.
Furthermore, the big data calculation analysis system further comprises a local area network interface, the local area network interface is connected with each calculation analysis unit through the switch unit, and the local area network interface is used for providing a debugging and upgrading interface for each calculation analysis unit.
Furthermore, the big data calculation and analysis system further comprises a multimedia interface connected with the processing unit, and the multimedia interface is used for connecting a display device.
Furthermore, the big data calculation and analysis system further comprises a USB interface connected with the processing unit, and the USB interface is used for connecting an input device and/or an external storage device.
Furthermore, the big data calculation and analysis system further comprises an RS485 interface and a digital input port which are respectively connected with the processing unit, wherein the RS485 interface is used for carrying out data communication with the connected sensing equipment, and the digital input port is used for acquiring input and output signals of the connected sensing equipment.
Furthermore, the big data calculation and analysis system also comprises a digital output port connected with the processing unit, and the digital output port is used for carrying out output control on the connected external equipment.
In a second aspect, an embodiment of the present invention further provides a big data calculation and analysis method applied to the big data calculation and analysis system in the first aspect, where the method includes:
the processing unit divides the data to be processed sent by the remote server into a plurality of subdata and respectively transmits the plurality of subdata to the corresponding calculation analysis units through the switch unit;
the calculation analysis unit performs data calculation analysis on the received subdata and returns the obtained analysis data to the processing unit through the switch unit;
and the processing unit receives and summarizes the analytic data returned by each calculation and analysis unit and transmits the summarized analytic data to the remote server.
The big data calculation and analysis system and the big data calculation and analysis method provided by the embodiment of the invention comprise a processing unit, a switch unit and a plurality of calculation and analysis units, wherein the processing unit divides data to be processed sent by a remote server into a plurality of subdata and respectively transmits the plurality of subdata to the corresponding calculation and analysis units through the switch unit, the calculation and analysis units perform data calculation and analysis on the received subdata and return the obtained analysis data to the processing unit through the switch unit, and the processing unit is also used for receiving and summarizing the analysis data returned by each calculation and analysis unit and transmitting the summarized analysis data to the remote server. According to the big data calculation and analysis system and method, a plurality of calculation and analysis units are adopted, so that data can be calculated and analyzed efficiently and quickly; the processing unit is connected with the plurality of calculation analysis units through the network by adopting the switch unit, so that the real-time property of transmission is ensured; the chip-level and module-level devices are adopted, the size is small, the price is low, the integration level is high, compared with the prior art, the size is reduced, the cost performance is improved, the problems of high cost, difficulty in installation and the like are effectively solved, and therefore the low-investment and high-performance computing and analyzing system is provided for big data.
Drawings
In order to more clearly illustrate the embodiments of the present invention or the technical solutions in the prior art, the drawings used in the description of the embodiments or the prior art will be briefly described below, and it is obvious that the drawings in the following description are some embodiments of the present invention, and other drawings can be obtained by those skilled in the art without creative efforts.
Fig. 1 is a schematic structural diagram of a big data computing and parsing system according to an embodiment of the present invention;
FIG. 2 is a schematic structural diagram of another big data calculation and parsing system according to an embodiment of the present invention;
FIG. 3 is a schematic structural diagram of another big data calculation and parsing system according to an embodiment of the present invention;
fig. 4 is a schematic flow chart of a big data calculation and analysis method according to an embodiment of the present invention.
Icon: 101-a processing unit; 102-ARM processor; 201-remote server; 301-a switch unit; 303-a calculation analysis unit; 401-single chip microcomputer; 402-local area network interface; 403-wide area network interface; 404-a multimedia interface; 405-a USB interface; 406-RS485 interface; 407-digital input port; 408-a digital output port; 501-solid state disk; 502-NX module; 601-a power supply unit; 602-clock unit.
Detailed Description
To make the objects, technical solutions and advantages of the embodiments of the present invention clearer, the technical solutions of the present invention will be clearly and completely described below with reference to the accompanying drawings, and it is apparent that the described embodiments are some, but not all embodiments of the present invention. All other embodiments, which can be derived by a person skilled in the art from the embodiments given herein without making any creative effort, shall fall within the protection scope of the present invention.
At present, a large amount of high-definition data are processed by large-scale server equipment, the server is large in size and high in price, and a small-scale server with low price is small in size, but the processing speed is too low, so that data blockage can be caused, and the server is not suitable for the large amount of high-definition data. Based on this, the big data calculation and analysis system and method provided by the invention divide the data to be processed sent by the remote server into a plurality of subdata through the processing unit, and the subdata is respectively transmitted to the plurality of corresponding calculation and analysis units through the switch unit, the plurality of calculation and analysis units respectively calculate and analyze the plurality of subdata and return the analyzed data to the processing unit through the switch unit, and finally the processing unit summarizes and transmits the data to the remote server. Therefore, data can be efficiently and quickly calculated and analyzed, the real-time performance of transmission is guaranteed, the data can be conveniently searched and called, the cost performance is high, and a low-investment high-performance calculation analysis system is provided for big data.
For the convenience of understanding the embodiment, a detailed description will be given to a big data calculation and analysis system and method disclosed in the embodiment of the present invention.
The embodiment of the invention provides a big data calculation and analysis sheet system which comprises a processing unit, a switch unit and a plurality of computer units.
Specifically, referring to a schematic structural diagram of a big data computation and analysis system shown in fig. 1, the processing unit 101 is connected to each computation and analysis unit 303 through the switch unit 301.
The processing unit 101 is configured to split data to be processed, which is sent by the remote server 201, into a plurality of pieces of sub-data, and transmit the plurality of pieces of split sub-data to the corresponding calculation and analysis unit 303 through the switch unit.
The calculation and analysis unit 303 is configured to perform calculation and analysis on the received sub-data, and return the obtained analysis data to the processing unit 101 through the switch unit 301, and the processing unit 101 is further configured to receive and summarize the analysis data returned by each calculation and analysis unit 303, and transmit the summarized analysis data to the remote server 201.
In the big data calculation and analysis system provided by the embodiment of the present invention, the to-be-processed data sent by the remote server 201 is split into the plurality of pieces of sub-data, and the plurality of pieces of sub-data after being split are respectively transmitted to the corresponding calculation and analysis units 303 through the switch unit, the calculation and analysis units 303 perform calculation and analysis on the received sub-data, and return the obtained analysis data to the processing unit 101 through the switch unit 301, and the processing unit 101 receives and summarizes the analysis data returned by each calculation and analysis unit 303, and transmits the data to the remote server 201. Compared with the prior art, the big data calculation and analysis system and the big data calculation and analysis method adopt a plurality of calculation and analysis units, and can calculate and analyze data efficiently and quickly; the processing unit is connected with the plurality of calculation analysis units through the network by adopting the switch unit, so that the real-time property of transmission is ensured; the chip-level and module-level devices are adopted, the size is small, the price is low, the integration level is high, compared with the prior art, the size is reduced, the cost performance is improved, the problems of high cost, difficulty in installation and the like are effectively solved, and therefore the low-investment and high-performance computing and analyzing system is provided for big data.
Alternatively, as shown in fig. 3, the processing unit 101 may be an ARM (advanced RISC machines) processor 102, for example, a quad-core ARM low-power high-performance processor, which is smooth in operation. The ARM processor 102 detects communication of each unit in the system after being powered on, if a certain unit has a fault or is abnormal in communication, the communication can be displayed on a connected display, the ARM processor 102 classifies a large amount of data transmitted from a remote server, and if one NX module 502 is detected to be idle, the data is sent to the past for calculation and analysis.
Alternatively, as shown in fig. 3, the calculation and analysis unit 303 may include a solid state disk 501 and an NX module 502 that are interconnected, the solid state disk 501 is used to store data before and after the analysis by the NX module 502, the storage capacity of each solid state disk 501 may be as high as 1TB, the NX module 502 may calculate and analyze a large amount of data, may run a modern neural network in parallel and process data from a plurality of high resolution sensors, and this may make the calculation and analysis unit 303 perform as much as the operation capability of a supercomputer. The ARM processor 102 can perform 1000M network connection with the NX module 502 through the switch unit 301, so as to realize real-time transmission without affecting transmission speed.
Optionally, as shown in fig. 3, the NX modules 502 are further connected to the ARM processor 102 through serial interfaces, respectively, after power is turned on, the ARM processor 102 will automatically read information such as an IP Address (Internet Protocol Address) of the NX module 502, and if the information is found to be incorrect, the ARM processor 102 corrects the information through the serial interface.
Optionally, as shown in fig. 2 and fig. 3, the system further includes a wide Area network interface 403 connected to the processing unit 101, where the wide Area network interface 403 is a wan (wide Area network) interface, and the wide Area network interface 403 is used for communicating with the remote server 201.
Optionally, as shown in fig. 3, the ARM processor 102 is further connected to the NX module 502 through a serial port, the ARM processor 102 is configured to perform parameter configuration on the NX module 502 through the serial port, in addition, after the power is turned on, the ARM processor 102 may automatically read information such as an IP address of the NX module 502, and if the information is incorrect, the ARM processor 102 changes the information correctly through the serial port.
Optionally, as shown in fig. 2 and fig. 3, the system further includes a single chip microcomputer 401 connected to each calculation and analysis unit 303, the single chip microcomputer 401 is connected to each NX module 502 in the calculation and analysis unit, and the single chip microcomputer 401 is configured to control handshake response start required by each calculation and analysis unit 303 when the single chip microcomputer is started.
Optionally, as shown in fig. 2 and fig. 3, the system further includes a local Area network interface 402, where the local Area network interface 402 is a lan (local Area network) interface, the local Area network interface 402 is connected to the NX modules 502 in each computation analysis unit 303 through the switch unit 301, and may be connected to one of the NX modules 502 at will, and the local Area network interface 402 is configured to provide a debugging and upgrading interface for the NX module 502 in each computation analysis unit 303.
Optionally, as shown in fig. 2 and fig. 3, the system further includes a Multimedia Interface 404 connected to the processing unit 101, where the Multimedia Interface 404 is a (High Definition Multimedia Interface) Interface, and the Multimedia Interface 404 is used for connecting to a display device, and can display the system Interface of the processing unit 101 through the display device, so as to facilitate operation.
Optionally, as shown in fig. 2 and fig. 3, the system further includes a USB interface 405 connected to the processing unit 101, where the USB interface 405 is a (Universal Serial Bus) interface, the USB interface 405 is used to connect an input device and an external storage device, and transmit information in the input device and the external storage device to the processing unit 101, the input device may control the processing unit 101, and the external storage device may store and transfer data parsed by the system.
Optionally, as shown in fig. 2 and fig. 3, the system further includes an RS485 interface 406 and a digital input port 407, which are respectively connected to the processing unit 101, where the digital input port 407 is a di (digital in) port, the RS485 interface 406 is used for performing data communication with a connected sensing device, monitoring information of the sensing device is input to the processing unit 101 through the RS485 interface 406, then the processing unit 101 classifies the data information input by the sensing device, and then transmits the data information to the calculation and analysis unit 303, and the digital input port 407 is used for acquiring an input signal of the connected sensing device and transmitting the input signal to the processing unit 101.
Optionally, as shown in fig. 2 and fig. 3, the system further includes a digital output port 408 connected to the processing unit 101, where the digital output port 408 is a do (digital out) port, the processing unit 101 issues a control instruction, and the digital output port 408 performs output control on the connected external device.
Optionally, as shown in fig. 2 and fig. 3, the system further includes a power supply unit 601 and a clock unit 602, where the clock unit 602 is configured to display the current time and may also be configured to provide time for the stored data. The power supply unit 601 is used for providing a stable and reliable power supply for the whole system, and ensuring the normal operation of the system.
In the big data calculation and analysis system provided by this embodiment, the data to be processed sent by the remote server 201 is split into a plurality of pieces of sub-data, and the plurality of pieces of sub-data after being split are respectively transmitted to the corresponding calculation and analysis units 303 through the switch unit, each calculation and analysis unit 303 includes the solid state disk 501 and the NX module 502, wherein the solid state disk 501 is used for storing data before and after being analyzed by the NX module 502, the NX module 502 analyzes data transmitted by an external device, and returns the obtained analysis data to the processing unit 101 through the switch unit 301, and the processing unit 101 receives and summarizes the analysis data returned by each calculation and analysis unit 303, and transmits the data to the remote server 201.
The system can achieve the performance of a plurality of supercomputers through a plurality of NX modules 502 and solid state disks 501, each NX module 502 is provided with one large-capacity solid state disk 501, and the capacity of the system is far higher than that of a common computer.
The system adopts the switch unit 301 to connect a plurality of NX modules 502 with the ARM processor 102 through a network, thereby realizing the real-time transmission without influencing the operation and transmission speed of the system.
In the system, a plurality of NX modules 502 are connected with the ARM processor 102 through a serial interface, when the system is powered on, the ARM processor 102 can detect the IP address information of the NX modules 502, and if the IP address information is found to be incorrect, the IP address information can be corrected through the serial interface, so that the system can be monitored.
The system adopts the quad-core ARM low-power-consumption processor, the performance is high, the operation is smooth, the ARM processor 102 can detect each unit of the system after being electrified, if a certain unit fails, the failure can be displayed on a connected external display through the multimedia interface 404, and the troubleshooting is convenient.
In the system, the ARM processor 102 classifies a large amount of data transmitted from a remote server, when a certain NX module 502 is detected to be idle, the data is transmitted to the NX module 502 for calculation and analysis, after the NX module 502 unit completes data analysis, the data is transmitted to the remote server through the ARM processor 102, and the ARM processor 102 decomposes the calculation capacity into the NX modules 502, so that the calculation capacity of the system is improved to the greatest extent.
The system is provided with the RS485 interface 406, the digital input port 407 and the digital output port 408, and can be directly connected with the sensor equipment, so that a one-level acquisition controller between the server and the sensor equipment is saved, the installation space is reduced, and the cost is reduced.
The system is also provided with a multimedia interface 404 which can be connected with a display, a USB interface 405 which can be connected with external equipment such as a mouse, a keyboard and the like, and the system is convenient to operate and control.
The system adopts chip-level and module-level devices, has high integration level, extremely small occupied space, high performance and lower price, and fundamentally reduces the cost.
For convenience of understanding, an embodiment of the present invention further provides a big data calculation and analysis method, where the method is applied to the big data calculation and analysis system, and refer to a flow diagram of a big data calculation and analysis method shown in fig. 4, where the method mainly includes the following steps:
step S701, a processing unit splits data to be processed sent by a remote server into a plurality of subdata;
step S702, the switch unit transmits the plurality of subdata to the corresponding calculation analysis units respectively;
step S703, the calculation and analysis unit calculates and analyzes the data of the received subdata;
step S704, the switch unit returns the obtained analysis data to the processing unit;
step S705, the processing unit receives and summarizes the analytic data returned by each calculation analytic unit;
step S706, the collected analysis data is transmitted to a remote server.
According to the big data calculation and analysis method, data are calculated and analyzed through the plurality of calculation and analysis units, and the data can be calculated and analyzed efficiently and quickly; the processing unit is connected with the plurality of calculation analysis units through the network by adopting the switch unit, so that the real-time property of transmission is ensured; the chip-level and module-level devices are adopted, the size is small, the price is low, the integration level is high, compared with the prior art, the size is reduced, the cost performance is improved, the problems of high cost, difficulty in installation and the like are effectively solved, and therefore the low-investment and high-performance computing and analyzing system is provided for big data.
The method provided by the embodiment has the same implementation principle and technical effect as the system embodiment, and for the sake of brief description, reference may be made to the corresponding content in the system embodiment for the part where the method embodiment is not mentioned.
It should be noted that: like reference numbers and letters refer to like items in the following figures, and thus, once an item is defined in one figure, it need not be further defined and explained in subsequent figures.
In addition, in the description of the embodiments of the present invention, unless otherwise explicitly specified or limited, the terms "mounted," "connected," and "connected" are to be construed broadly, e.g., as meaning either a fixed connection, a removable connection, or an integral connection; can be mechanically or electrically connected; they may be connected directly or indirectly through intervening media, or they may be interconnected between two elements. The specific meanings of the above terms in the present invention can be understood in specific cases to those skilled in the art.
In the description of the present invention, it should be noted that the terms "center", "upper", "lower", "left", "right", "vertical", "horizontal", "inner", "outer", etc., indicate orientations or positional relationships based on the orientations or positional relationships shown in the drawings, and are only for convenience of description and simplicity of description, but do not indicate or imply that the device or element being referred to must have a particular orientation, be constructed and operated in a particular orientation, and thus, should not be construed as limiting the present invention. Furthermore, the terms "first," "second," and "third" are used for descriptive purposes only and are not to be construed as indicating or implying relative importance.
Finally, it should be noted that: the above embodiments are only used to illustrate the technical solution of the present invention, and not to limit the same; while the invention has been described in detail and with reference to the foregoing embodiments, it will be understood by those skilled in the art that: the technical solutions described in the foregoing embodiments may still be modified, or some or all of the technical features may be equivalently replaced; and the modifications or the substitutions do not make the essence of the corresponding technical solutions depart from the scope of the technical solutions of the embodiments of the present invention.

Claims (10)

1. A big data calculation analysis system is characterized by comprising a processing unit, a switch unit and a plurality of calculation analysis units;
the processing unit is respectively connected with each calculation analysis unit through the switch unit, and is used for splitting data to be processed sent by a remote server into a plurality of subdata and respectively transmitting the plurality of subdata to the corresponding calculation analysis units through the switch unit; the calculation analysis unit is used for performing data calculation analysis on the received subdata and returning the obtained analysis data to the processing unit through the switch unit; the processing unit is also used for receiving and summarizing the analytic data returned by each calculation analytic unit and transmitting the summarized analytic data to the remote server.
2. The big data computing and analyzing system of claim 1, wherein the processing unit is an ARM processor, the computing and analyzing unit comprises an NX module and a solid state disk which are interconnected, and the ARM processor is connected with the NX module through the switch unit;
the big data calculation analysis system further comprises a wide area network interface connected with the processing unit, and the wide area network interface is used for being in communication connection with the remote server.
3. The big data computing and parsing system of claim 2, wherein the ARM processor is further connected to the NX module through a serial port, and the ARM processor is configured to perform parameter configuration on the NX module through the serial port.
4. The big data calculation and analysis system according to claim 1, further comprising a single chip microcomputer connected to each calculation and analysis unit; the single chip microcomputer is used for controlling handshake response starting required by each calculation analysis unit when the calculation analysis unit is started.
5. The big data computing and parsing system according to claim 1, further comprising a local area network interface, wherein the local area network interface is connected to each computing and parsing unit through the switch unit, and the local area network interface is configured to provide a debugging and upgrading interface for each computing and parsing unit.
6. The big data computing analytic system of claim 1, further comprising a multimedia interface connected with the processing unit, the multimedia interface for connecting with a display device.
7. The big data computing and parsing system of claim 1, further comprising a USB interface connected to the processing unit, the USB interface for connecting to an input device and/or an external storage device.
8. The big data calculation and analysis system according to claim 1, further comprising an RS485 interface and a digital input port, wherein the RS485 interface and the digital input port are respectively connected to the processing unit, the RS485 interface is used for data communication with the connected sensing devices, and the digital input port is used for collecting input and output signals of the connected sensing devices.
9. The big data computing and parsing system of claim 1, further comprising a digital output port connected with the processing unit, the digital output port being used for output control of a connected external device.
10. A big data calculation analysis method applied to the big data calculation analysis system of any one of claims 1-9, the method comprising:
the processing unit divides the data to be processed sent by the remote server into a plurality of subdata and respectively transmits the plurality of subdata to the corresponding calculation analysis units through the switch unit;
the calculation analysis unit performs data calculation analysis on the received subdata and returns the obtained analysis data to the processing unit through the switch unit;
and the processing unit receives and summarizes the analytic data returned by each calculation and analysis unit and transmits the summarized analytic data to the remote server.
CN202111430683.0A 2021-11-29 2021-11-29 Big data calculation analysis system and method Pending CN114116567A (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN202111430683.0A CN114116567A (en) 2021-11-29 2021-11-29 Big data calculation analysis system and method

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN202111430683.0A CN114116567A (en) 2021-11-29 2021-11-29 Big data calculation analysis system and method

Publications (1)

Publication Number Publication Date
CN114116567A true CN114116567A (en) 2022-03-01

Family

ID=80371069

Family Applications (1)

Application Number Title Priority Date Filing Date
CN202111430683.0A Pending CN114116567A (en) 2021-11-29 2021-11-29 Big data calculation analysis system and method

Country Status (1)

Country Link
CN (1) CN114116567A (en)

Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2009223543A (en) * 2008-03-14 2009-10-01 Kansai Electric Power Co Inc:The Network system, status output device, status output program, and status output method
CN107315975A (en) * 2017-06-01 2017-11-03 华南理工大学 Principal and subordinate's cooperative control system and method in a kind of large-scale card maker of IC-card
CN108764456A (en) * 2018-04-03 2018-11-06 北京环境特性研究所 Airborne target identification model construction platform, airborne target recognition methods and equipment
CN110557460A (en) * 2019-09-23 2019-12-10 优刻得科技股份有限公司 Monitoring system for infrastructure equipment of data center
CN111665771A (en) * 2020-07-02 2020-09-15 东莞深证通信息技术有限公司 Infrastructure monitoring system and monitoring method
CN112968818A (en) * 2021-04-14 2021-06-15 中车青岛四方车辆研究所有限公司 Train Ethernet abnormal data detection system, equipment and method

Patent Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2009223543A (en) * 2008-03-14 2009-10-01 Kansai Electric Power Co Inc:The Network system, status output device, status output program, and status output method
CN107315975A (en) * 2017-06-01 2017-11-03 华南理工大学 Principal and subordinate's cooperative control system and method in a kind of large-scale card maker of IC-card
CN108764456A (en) * 2018-04-03 2018-11-06 北京环境特性研究所 Airborne target identification model construction platform, airborne target recognition methods and equipment
CN110557460A (en) * 2019-09-23 2019-12-10 优刻得科技股份有限公司 Monitoring system for infrastructure equipment of data center
CN111665771A (en) * 2020-07-02 2020-09-15 东莞深证通信息技术有限公司 Infrastructure monitoring system and monitoring method
CN112968818A (en) * 2021-04-14 2021-06-15 中车青岛四方车辆研究所有限公司 Train Ethernet abnormal data detection system, equipment and method

Similar Documents

Publication Publication Date Title
CN103117879B (en) A kind of computer hardware operational factor network monitoring system
US8875154B2 (en) Interface specific and parallel IPMI message handling at baseboard management controller
US20160352565A1 (en) Measurement system having a plurality of sensors
CN103116531A (en) Storage system failure predicting method and storage system failure predicting device
CN109547240B (en) Intelligent device based on edge calculation and access and device analysis method
CN201859389U (en) Reset management chip and reset system
CN116719700B (en) Method and device for monitoring hardware partition of server host system
US10298479B2 (en) Method of monitoring a server rack system, and the server rack system
CN114528234B (en) Out-of-band management method and device for multi-path server system
CN115878356A (en) Disk failure prediction method and device
CN114116567A (en) Big data calculation analysis system and method
CN115543872A (en) Equipment management method and device and computer storage medium
CN106706000B (en) Theodolite intelligent network monitoring method and system
CN203870749U (en) Sensor-based forest fire-prevention monitoring and patrolling system
CN113542026A (en) Internet of things equipment fault positioning method, device, equipment and storage medium
DK177849B1 (en) Device, system and method for an interface connector
CN109542691A (en) A method of improving IPMI management software reliability
CN115543707A (en) Hard disk fault detection method, system and device, storage medium and electronic device
CN114584593A (en) Data acquisition system and method based on cluster state perception
CN209786878U (en) Intelligent power distribution room online monitoring system
CN113630288A (en) Intelligent network card fault information collection method, device, terminal and storage medium
CN112414475A (en) Detection device and method for capacitance bottle of transformer substation, electronic equipment and medium
JPH0936859A (en) Monitoring information repeating method and device therefor
CN109450683A (en) Fault detection method, device and application system and storage medium
CN107846456A (en) A kind of data collecting system based on WiFi

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination