CN108536485A - Big data platform configuration inspection method, apparatus, terminal and readable storage medium storing program for executing - Google Patents
Big data platform configuration inspection method, apparatus, terminal and readable storage medium storing program for executing Download PDFInfo
- Publication number
- CN108536485A CN108536485A CN201810294547.5A CN201810294547A CN108536485A CN 108536485 A CN108536485 A CN 108536485A CN 201810294547 A CN201810294547 A CN 201810294547A CN 108536485 A CN108536485 A CN 108536485A
- Authority
- CN
- China
- Prior art keywords
- big data
- data platform
- checked
- node
- information
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F9/00—Arrangements for program control, e.g. control units
- G06F9/06—Arrangements for program control, e.g. control units using stored programs, i.e. using an internal store of processing equipment to receive or retain programs
- G06F9/44—Arrangements for executing specific programs
- G06F9/445—Program loading or initiating
- G06F9/44505—Configuring for program initiating, e.g. using registry, configuration files
- G06F9/4451—User profiles; Roaming
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F9/00—Arrangements for program control, e.g. control units
- G06F9/06—Arrangements for program control, e.g. control units using stored programs, i.e. using an internal store of processing equipment to receive or retain programs
- G06F9/44—Arrangements for executing specific programs
- G06F9/445—Program loading or initiating
- G06F9/44521—Dynamic linking or loading; Link editing at or after load time, e.g. Java class loading
- G06F9/44526—Plug-ins; Add-ons
Landscapes
- Engineering & Computer Science (AREA)
- Software Systems (AREA)
- Theoretical Computer Science (AREA)
- Physics & Mathematics (AREA)
- General Engineering & Computer Science (AREA)
- General Physics & Mathematics (AREA)
- Debugging And Monitoring (AREA)
Abstract
The present invention provides a kind of big data platform configuration inspection method, apparatus, terminal and readable storage medium storing program for executing, wherein this method comprises the following steps：Obtain the component profile information of each node of big data platform to be checked；Component profile information is carried out comparison and generate configuration inspection result with template is checked.This method is compared by the component profile information of acquisition platform with inspection template, realizes the automation inspection for meeting platform assembly configuration situation, is reduced conjunction and is advised inspection workload, saves the review time, improve and check efficiency and accuracy.
Description
Technical field
The present invention relates to Auditing Information System fields, and in particular to a kind of big data platform configuration inspection method, apparatus, end
End and readable storage medium storing program for executing.
Background technology
The explosive growth of data has started the research boom of big data, and more and more business are related to the processing of big data
And storage, in order to excavate the knowledge hidden in big data, various big data products and technology are come into being, a series of about big number
It is published according to the component of increasing income of processing and storage.Be at the beginning of big data product design in order to realize big data processing function, it is past
Toward deficiency from the aspect of safe design.The characteristics such as big data platform component is more, difference in version is big make enterprise using big number
When according to platform, the difficulty of information system management and audit increases.Especially global or nationwide large enterprise, although company
Information-based department may formulate stringent regulation, established big data platform according to own service feature and information security demand
Configuration baseline, but different branch companies are when practical big data platform is built, it would still be possible to there is component composition and security configuration does not conform to
The case where rule.Technical staff against inspection template close advising by hand checks that heavy workload, time-consuming, and is susceptible to mistake
Accidentally.
Invention content
Therefore, the technical problem to be solved in the present invention is to overcome in the prior art by manually carrying out big data platform
Configuration inspection, heavy workload, the problem that time-consuming, error-prone.
For this purpose, the present invention provides the following technical solutions：
First aspect present invention provides a kind of big data platform configuration inspection method, includes the following steps：It obtains to be checked
Big data platform each node component profile information；The component profile information is carried out with template is checked
Comparison generates configuration inspection result.
Optionally, the component profile information for obtaining each node of big data platform to be checked includes：Obtain institute
State one or more check item checked in template；Corresponding component Configuration is inquired according to one or more of check items
Fileinfo.
Optionally, before the component profile information for obtaining each node of big data platform to be checked, further include：
Obtain the complement version information of each node of big data platform to be checked；Determine the complement version information and default version
Unanimously.
Optionally, the component profile information compare before generating configuration inspection result with template is checked,
Further include：Obtain the complement version information of each node of big data platform to be checked；Determine the complement version information with
Default version is consistent；Check item is obtained according to the complement version information；It is determined according to the check item and checks template.
Optionally, the complement version information for obtaining each node of big data platform to be checked includes：It obtains to be checked
Big data platform each node data information；The component version letter of each node is obtained according to the data information
Breath.
Optionally, the data information includes IP address, login username and entry password.
Second aspect of the present invention provides a kind of big data platform configuration inspection device, including：First acquisition module, is used for
Obtain the component profile information of each node of big data platform to be checked；First processing module, for by described group
Part profile information carries out comparison and generates configuration inspection result with template is checked.
Optionally, first acquisition module includes：First acquisition unit, for obtaining one in the inspection template
Or multiple check items；First processing units, for inquiring corresponding component Configuration according to one or more of check items
Fileinfo.
Optionally, further include：Second acquisition module, the component of each node for obtaining big data platform to be checked
Version information；Second processing module, for determining that the complement version information is consistent with default version.
Optionally, further include：Second acquisition module, the component of each node for obtaining big data platform to be checked
Version information；Second processing module, for determining that the complement version information is consistent with default version；Third acquisition module is used
According to complement version information acquisition check item；Third processing module checks template for being determined according to the check item.
Optionally, second acquisition module includes：Second acquisition unit, for obtaining big data platform to be checked
The data information of each node；Second processing unit, the component version for obtaining each node according to the data information
This information.
Third aspect present invention provides a kind of terminal, including：At least one processor, and at least one place
Manage the memory of device communication connection, wherein the memory is stored with the instruction that can be executed by least one processor, institute
It states instruction to be executed by least one processor, so that any at least one processor execution first aspect present invention
The big data platform configuration inspection method.
Fourth aspect present invention provides a kind of computer readable storage medium, the computer-readable recording medium storage
There are computer instruction, the computer instruction to be used to make the computer to execute any big number in first aspect present invention
According to platform configuration inspection method.
Technical solution of the present invention has the following advantages that：
1. big data platform configuration inspection method provided by the invention, includes the following steps：Obtain big data to be checked
The component profile information of each node of platform；Component profile information is carried out comparison and generate configuration with template is checked
Inspection result.This method is compared with template is checked, is realized to platform group by the component profile information of acquisition platform
Part configures the automation inspection for meeting situation, reduces conjunction rule and checks workload, saves the review time, improve inspection efficiency
And accuracy.
2. big data platform configuration inspection method provided by the invention obtains each node of big data platform to be checked
Component profile information include：Obtain one or more check item in the inspection template；According to one or
The multiple check items of person inquire corresponding component profile information.Searching for profile information can be targetedly carried out in this way
Rope and inspection improve inspection efficiency.
3. big data platform configuration inspection method provided by the invention obtains each node of big data platform to be checked
Component profile information before, further include：Obtain the complement version information of each node of big data platform to be checked；
Determine that the complement version information is consistent with default version.Configuration inspection not only includes the inspection of component profile, further includes
The inspection of component version so that more comprehensive to the inspection of big data platform.
4. big data platform configuration inspection method provided by the invention, by the component profile information and inspection template
Before carrying out comparison generation configuration inspection result, further include：Obtain the component version of each node of big data platform to be checked
This information；Determine that the complement version information is consistent with default version；Check item is obtained according to the complement version information；According to
The check item, which determines, checks template.Each check item under the component version is obtained according to complement version information, and according to inspection
It looks into item and generates inspection template so that check that template is simplified, check that the setting of template is more flexible, further increase inspection effect
Rate.
5. big data platform configuration inspection method provided by the invention obtains each node of big data platform to be checked
Complement version information include：Obtain the data information of each node of big data platform to be checked；Believed according to the data
Breath obtains the complement version information of each node.It is obtained according to the data information of each node of big data platform to be checked
Take complement version information so that configuration inspection is more intelligent, improves the degree of automation.
Description of the drawings
It, below will be to specific in order to illustrate more clearly of the specific embodiment of the invention or technical solution in the prior art
Embodiment or attached drawing needed to be used in the description of the prior art are briefly described, it should be apparent that, in being described below
Attached drawing is some embodiments of the present invention, for those of ordinary skill in the art, before not making the creative labor
It puts, other drawings may also be obtained based on these drawings.
Fig. 1 is the flow chart of a specific example of big data platform configuration inspection method in the embodiment of the present invention；
Fig. 2 is the flow chart of another specific example of big data platform configuration inspection method in the embodiment of the present invention；
Fig. 3 is each of the acquisition big data platform to be checked of big data platform configuration inspection method in the embodiment of the present invention
The flow chart of the specific example of the step of complement version information of a node；
Fig. 4 is each of the acquisition big data platform to be checked of big data platform configuration inspection method in the embodiment of the present invention
The flow chart of the specific example of the step of component profile information of a node；
Fig. 5 is the block diagram of a specific example of big data platform configuration inspection device in the embodiment of the present invention；
Fig. 6 is the structural schematic diagram of terminal in the embodiment of the present invention.
Specific implementation mode
Technical scheme of the present invention is clearly and completely described below in conjunction with attached drawing, it is clear that described implementation
Example is a part of the embodiment of the present invention, instead of all the embodiments.Based on the embodiments of the present invention, ordinary skill
The every other embodiment that personnel are obtained without making creative work, shall fall within the protection scope of the present invention.
In the description of the present invention, it should be noted that term "center", "upper", "lower", "left", "right", "vertical",
The orientation or positional relationship of the instructions such as "horizontal", "inner", "outside" be based on the orientation or positional relationship shown in the drawings, merely to
Convenient for the description present invention and simplify description, do not indicate or imply the indicated device or element must have a particular orientation,
With specific azimuth configuration and operation, therefore it is not considered as limiting the invention.In addition, term " first ", " second ",
" third " is used for description purposes only, and is not understood to indicate or imply relative importance.
In the description of the present invention, it should be noted that unless otherwise clearly defined and limited, term " installation ", " phase
Even ", " connection " shall be understood in a broad sense, for example, it may be being fixedly connected, may be a detachable connection, or be integrally connected；It can
Can also be electrical connection to be mechanical connection；It can be directly connected, can also indirectly connected through an intermediary, it can be with
It is the connection inside two elements, can be wirelessly connected, can also be wired connection.For those of ordinary skill in the art
For, the concrete meaning of above-mentioned term in the present invention can be understood with concrete condition.
As long as in addition, technical characteristic involved in invention described below different embodiments non-structure each other
It can be combined with each other at conflict.
A kind of big data platform configuration inspection method is present embodiments provided, big data platform configuration inspection is used for, to subtract
Few workload improves and checks that efficiency, the flow chart of this method are as shown in Figure 1.As a preferred embodiment of the present embodiment,
Flow chart is as shown in Fig. 2, include the following steps：
S1：Obtain the complement version information of each node of big data platform to be checked.
In the present embodiment, as shown in figure 3, step S1 specifically includes step S11-S12：
S11：Obtain the data information of each node of big data platform to be checked.In the present embodiment, individual node
Specially single operating checks each software of the installation in each operating system, checks whether to meet big number
According to the configuration requirement of platform.In the present embodiment, data information includes IP address, login username and entry password；Certainly, exist
In other embodiments, data information can also include the address of each component profile, if not in accordance with silent when component is installed
Recognize address installation, needs the installation addresses of securing component configuration file.In the present embodiment, big data platform to be checked is obtained
After the IP address of each node, login username and entry password, each node is logged in, with forming the IP of big data platform to be checked
Location list.Certainly, in other embodiments, can also obtain first the host node of big data platform to be checked IP address,
Login username and entry password；Then, the IP for obtaining other nodes of big data platform to be checked by accessing host node
Address forms the IP address list of big data platform；Finally, the login user of other nodes of big data platform to be checked is obtained
Name and password, form the IP address list of big data platform to be checked.
S12：The complement version information of each node is obtained according to data information.In the present embodiment, it logs in be checked
Each node of big data platform checks the component installed on each node, obtains each complement version information of big data platform and records,
Such as typical component includes HBase, HDFS, Hive, Spark, and corresponding typical components version has HBase 1.2.0, HDFS
2.6.0、Hive 1.1.0、Spark 1.6.0；Certainly, in other embodiments, can also be not necessarily to log in acquisition group after each node
Part version information, but complement version information is directly acquired according to the component version that big data platform to be checked provides.
S2：Determine that complement version information is consistent with default version.The foundation of big data platform audit is big data platform institute
In the standard or regulation that tissue has to comply with, the requirements to big data platform are specified in standard or regulation.According to known
Standard or prescribed requirement determine the big data platform scope of examination, wherein tissue where known standard or regulation should be check object must
Must in accordance with standard or administrative provisions, such as must use certain versions big data platform component.Default version is flat for big data
The component version determined in standard or regulation that tissue where platform has to comply with, as the big data platform of certain tissue uses standard gauge
Fixed, the unit big data platforms at different levels of the tissue need uniform logical framework, can only be using following version such as lower component：HBase
1.2.0、HDFS 2.6.0、Hive 1.1、Hue 3.9.0、Impala 2.5.0、Oozie 4.0.1、Redis 3.2.1、
Sentry 1.5.1、ZooKeeper 3.4.5、Spark 1.6.0、Storm 1.0.1.It accesses each node and obtains on each node
The complement version information of acquisition is compared by the version information of component with the default version of the component, and inspection meets situation.
S3：Check item is obtained according to complement version information.Big data platform configuration inspection range includes to big data platform
The compliance inspection of the compliance inspection and big data platform component Configuration content of component version, big data platform component version
The compliance scope of examination is identical for the same tissue, and the compliance inspection of big data platform component Configuration content must be according to
Requirement in the big data platform component version of acquisition, reference standard or regulation, determines the check item of each component.For each
The big data platform of a component, the tissue defines detailed configuration requirement using standard, in the present embodiment, for
The configuration inspection item of Hive1.1 is as shown in table 1, and check item includes following 3, respectively HiveServer service simulations certification,
It enables HiveServer2SSL communication encryptions and connects time-out with setting Hive Metastore；Certainly, in other embodiments, also
It may include other check items, such as check that entitled HiveServer opens kerberos certifications；The scope of examination is to check
The value of hive.server2.authentication configuration items in the configuration file hive-site.xml of HiveServer is
No is KERBEROS, then indicates to use KERBEROS certifications when the value of configuration item is KERBEROS, meets safety requirements.
Wherein, each single item includes check item title, the scope of examination, examined configuration file, examined configuration content and to matching
Set the requirement of content；In other embodiments, it may also include configuration security hardening suggestion, as needed rationally setting.
The configuration inspection item of 1 Hive1.1 of table
S4：It is determined according to check item and checks template.The check item for being directed to different inspection requirements every time determines inspection template.
Check item can be added, changed, deleted and combined in checking template, formed and check template.
In the present embodiment, according to above-mentioned check item determine the tissue include component version inspection and Hive1.1 components
The inspection template of inspection is as shown in table 2.
Table 2 checks template
Inspection template for actual inspection is made of check item.In the present embodiment, check item is added,
Modification deletes and combines formation inspection template, and check item includes at least check item title, the scope of examination, examined configuration
File, examined configuration content, the requirement to configuring content.If the component structure of the big data platform of different tissues prescribed requirement
At different with version, different organization prescribeds can be directed to and require establish check item respectively, formed and check template；If different tissues
The component Configuration of the big data platform of prescribed requirement requires difference, can be directed to different organization prescribeds and require to establish respectively, select
With combination check item, is formed and check template.Certainly, in other embodiments, step S3 and S4 can also be omitted, directly according to group
Part version, which determines, checks template, and in this case, each component version corresponds to an inspection template, checks that template is relatively solid
Fixed, flexibility outline is weaker；It can also omit step S1-S4, when big data platform configuration inspection, shares an inspection template,
The inspection template includes every scope of examination of the version information and component profile information of all components, in this way
It is longer to carry out required time when configuration inspection, rationally setting as needed.
S5：Obtain the component profile information of each node of big data platform to be checked.In the present embodiment, it steps on
Each node is recorded, the check item of check and inspection template finds corresponding configuration file and content, is carried out to the actual content of configuration item
Record；Certainly, in other embodiments, can also be not necessarily to log in securing component profile information after each node, but according to
The configuration file that big data platform to be checked provides directly acquires component profile information.
In the present embodiment, as shown in figure 4, step S5 specifically includes step S51-S52：
S51：Obtain one or more check item checked in template.
S52：Corresponding component profile information is inquired according to one or more check item.
The configuration file that component is accessed according to big data platform component default installation address, compares in selected inspection template
Check item, check that configuration content meets situation.The case where not being default installation address for component installation file address, needs
After obtaining profile address, then carry out file access and Content inspection.Such as the configuration file hive-site.xml of Hive
Default installation address is /etc/hive/conf.dist/.The default installation address of component has carried out matching in advance in systems
It sets, if the non-default installation of component, also can voluntarily obtain file address.
S6：Component profile information is carried out comparison and generate configuration inspection result with template is checked.Check and inspection template,
It checks whether complement version information meets the requirement of template check item, checks whether configuration file content meets template check item and want
It asks, inspection result is recorded.
S7：Configuration inspection report is formed according to configuration inspection result, illustrates big data platform to be checked and checks template
Meet situation.The inspection result of component version inspection and configuration file inspection is formed and is reported by check and inspection template, with report
Form the inspection result of check item is illustrated one by one, illustrate to meet situation and provide the improving suggestions of Non-Compliance.
The inspection result of component version inspection and configuration file inspection is formed and is reported, report content includes to be checked big
The basic conditions such as the node IP address of data platform, the component of each node installation and component version；Component version and inspection template
It is required that meet situation；Component Configuration with check template require meet situation, Non-Compliance improving suggestions.For component version
This inspection and component Configuration inspection can be respectively formed report.
Hive provides service by http, but without enabling HiveServer2SSL communication encryptions,
The value of hive.server2.use.SSL configuration items is false.Improving suggestions are to open SSL traffic encryption, which is become
More true.While setting hive.server2.keystore.path configuration items in the path of secret key storage, and
Password is set on hive.server2.keystore.password configuration items.
Above-mentioned big data platform configuration inspection method is believed by the complement version information and component profile that obtain platform
It is compared with template is checked, realizes the automation inspection configured to platform assembly by breath；Also, check that template can basis
It needs flexibly to be arranged, reduces conjunction rule and check workload, save the review time, improve and check efficiency and accuracy.
The present embodiment also provides a kind of big data platform configuration inspection device, and the device is for realizing the implementation in embodiment
Mode had carried out repeating no more for explanation.The software of predetermined function may be implemented in term " module " as used below
And/or the combination of hardware.Although device described in following embodiment is preferably realized with software, hardware or soft
The realization of the combination of part and hardware is also that may and be contemplated.
Big data platform configuration inspection device provided in this embodiment is as shown in figure 5, include：
Second acquisition module 51, the complement version information of each node for obtaining big data platform to be checked.
In the present embodiment, the second acquisition module 51 includes：Second acquisition unit 511, for obtaining each of big data platform to be checked
The data information of a node, in the present embodiment, data information include IP address, login username and entry password；At second
Unit 512 is managed, the complement version information for obtaining each node according to data information logs in be checked in the present embodiment
Each node of big data platform check the component installed on each node, obtain each complement version information of big data platform and remember
Record, such as typical component includes HBase, HDFS, Hive, Spark, corresponding typical components version have HBase 1.2.0,
HDFS 2.6.0、Hive 1.1.0、Spark 1.6.0。
Second processing module 52, for determining that complement version information is consistent with default version.Default version is flat for big data
The component version determined in standard or regulation that tissue where platform has to comply with, as the big data platform of certain tissue uses standard gauge
Fixed, the unit big data platforms at different levels of the tissue need uniform logical framework, can only be using following version such as lower component：HBase
1.2.0、HDFS 2.6.0、Hive 1.1、Hue 3.9.0、Impala 2.5.0、Oozie 4.0.1、Redis 3.2.1、
Sentry 1.5.1、ZooKeeper 3.4.5、Spark 1.6.0、Storm 1.0.1。
Third acquisition module 53, for obtaining check item according to complement version information.In the present embodiment, for
The configuration inspection item of Hive1.1 is as shown in table 1, and check item includes following 3, respectively HiveServer service simulations certification,
It enables HiveServer2 SSL traffics encryption and connects time-out with setting Hive Metastore.
Third processing module 54 checks template for being determined according to check item.In the present embodiment, according to above-mentioned check item
Determine that the inspection template comprising component version inspection and Hive1.1 component inspections of the tissue is as shown in table 2, including component version
The inspection of the inspection and component profile information of information.
First acquisition module 55, the component profile letter of each node for obtaining big data platform to be checked
Breath.In the present embodiment, the first acquisition module 55 includes：First acquisition unit 551, for obtains inspection template in one or
The multiple check items of person；First processing units 552, for inquiring corresponding component profile according to one or more check item
Information.
First processing module 56, for carrying out comparison and generating configuration inspection knot component profile information with template is checked
Fruit.
Fourth processing module 57, for forming configuration inspection report according to configuration inspection result.
The further function of above-mentioned modules describes same as the previously described embodiments, and details are not described herein.
Above-mentioned big data platform configuration inspection device has the advantages that check efficient.
The present embodiment also provides a kind of terminal, as shown in fig. 6, including：At least one processor 601, such as CPU
(Central Processing Unit, central processing unit), at least one communication interface 603, memory 604 are at least one logical
Believe bus 602.Wherein, communication bus 602 is for realizing the connection communication between these components.Wherein, communication interface 603 can be with
Including display screen (Display), keyboard (Keyboard), optional communication interface 603 can also include wireline interface, the nothing of standard
Line interface.Memory 604 can be high-speed RAM memory (Ramdom Access Memory, effumability random access memory
Device), can also be non-labile memory (non-volatile memory), for example, at least a magnetic disk storage.Storage
Device 604 optionally can also be at least one storage device for being located remotely from aforementioned processor 601.Wherein processor 601 can be with
Big data platform configuration inspection device described in conjunction with Figure 5 stores batch processing code, and processor 601 in memory 604
The program code stored in memory 604 is called, for executing a kind of big data platform configuration inspection method, that is, is used to execute
Such as the big data platform configuration inspection method in Fig. 1-Fig. 4 embodiments.
Wherein, communication bus 602 can be Peripheral Component Interconnect standard (peripheral component
Interconnect, abbreviation PCI) bus or expanding the industrial standard structure (extended industry standard
Architecture, abbreviation EISA) bus etc..Communication bus 602 can be divided into address bus, data/address bus, controlling bus etc..
For ease of indicating, only indicated with a thick line in Fig. 6, it is not intended that an only bus or a type of bus.
Wherein, memory 604 may include volatile memory (English：Volatile memory), such as arbitrary access
Memory (English：Random-access memory, abbreviation：RAM)；Memory can also include nonvolatile memory (English
Text：Non-volatile memory), such as flash memory (English：Flash memory), hard disk (English：hard disk
Drive, abbreviation：HDD) or solid state disk is (English：Solid-state drive, abbreviation：SSD)；Memory 604 can also wrap
Include the combination of the memory of mentioned kind.
Wherein, processor 601 can be central processing unit (English：Central processing unit, abbreviation：
CPU), network processing unit (English：Network processor, abbreviation：) or the combination of CPU and NP NP.
Wherein, processor 601 can further include hardware chip.Above-mentioned hardware chip can be application-specific integrated circuit
(English：Application-specific integrated circuit, abbreviation：ASIC), programmable logic device (English：
Programmable logic device, abbreviation：PLD) or combinations thereof.Above-mentioned PLD can be Complex Programmable Logic Devices
(English：Complex programmable logic device, abbreviation：CPLD), field programmable gate array (English：
Field-programmable gate array, abbreviation：FPGA), Universal Array Logic (English：generic array
Logic, abbreviation：GAL) or it is arbitrarily combined.
Optionally, memory 604 is additionally operable to storage program instruction.Processor 601 can be instructed with caller, be realized such as this
Apply for big data platform configuration inspection method shown in Fig. 1-Fig. 4 embodiments.
The embodiment of the present invention also provides a kind of computer readable storage medium, and meter is stored on computer readable storage medium
Calculation machine executable instruction, the computer executable instructions can perform the configuration inspection of the big data platform in above-mentioned any means embodiment
Checking method.Wherein, the storage medium can be magnetic disc, CD, read-only memory (Read-Only Memory, abbreviation：
ROM), random access memory (Random Access Memory, abbreviation：RAM), flash memory (Flash Memory),
Hard disk (Hard Disk Drive, abbreviation：HDD) or solid state disk (Solid-State Drive, abbreviation：SSD) etc.；It is described to deposit
Storage media can also include the combination of the memory of mentioned kind.
It should be understood by those skilled in the art that, the embodiment of the present invention can be provided as method, apparatus or computer program
Product.Therefore, complete hardware embodiment, complete software embodiment or reality combining software and hardware aspects can be used in the present invention
Apply the form of example.Moreover, the present invention can be used in one or more wherein include computer usable program code computer
The computer program production implemented in usable storage medium (including but not limited to magnetic disk storage, CD-ROM, optical memory etc.)
The form of product.
The present invention be with reference to according to the method for the embodiment of the present invention, the flow of equipment (system) and computer program product
Figure and/or block diagram describe.It should be understood that can be realized by computer program instructions every first-class in flowchart and/or the block diagram
The combination of flow and/or box in journey and/or box and flowchart and/or the block diagram.These computer programs can be provided
Instruct the processor of all-purpose computer, special purpose computer, Embedded Processor or other programmable data processing devices to produce
A raw machine so that the instruction executed by computer or the processor of other programmable data processing devices is generated for real
The device for the function of being specified in present one flow of flow chart or one box of multiple flows and/or block diagram or multiple boxes.
These computer program instructions, which may also be stored in, can guide computer or other programmable data processing devices with spy
Determine in the computer-readable memory that mode works so that instruction generation stored in the computer readable memory includes referring to
Enable the manufacture of device, the command device realize in one flow of flow chart or multiple flows and/or one box of block diagram or
The function of being specified in multiple boxes.
These computer program instructions also can be loaded onto a computer or other programmable data processing device so that count
Series of operation steps are executed on calculation machine or other programmable devices to generate computer implemented processing, in computer or
The instruction executed on other programmable devices is provided for realizing in one flow of flow chart or multiple flows and/or block diagram one
The step of function of being specified in a box or multiple boxes.
Obviously, the above embodiments are merely examples for clarifying the description, and does not limit the embodiments.It is right
For those of ordinary skill in the art, can also make on the basis of the above description it is other it is various forms of variation or
It changes.There is no necessity and possibility to exhaust all the enbodiments.And thus amplify out it is obvious variation or
It changes still within the protection scope of the invention.
Claims (13)
1. a kind of big data platform configuration inspection method, which is characterized in that include the following steps：
Obtain the component profile information of each node of big data platform to be checked；
The component profile information is carried out comparison and generate configuration inspection result with template is checked.
2. big data platform configuration inspection method according to claim 1, which is characterized in that obtain big data to be checked
The component profile information of each node of platform includes：
Obtain one or more check item in the inspection template；
Corresponding component profile information is inquired according to one or more of check items.
3. big data platform configuration inspection method according to claim 1, which is characterized in that obtain big data to be checked
Before the component profile information of each node of platform, further include：
Obtain the complement version information of each node of big data platform to be checked；
Determine that the complement version information is consistent with default version.
4. big data platform configuration inspection method according to claim 1, which is characterized in that by the component profile
Information compare before generating configuration inspection result with template is checked, further includes：
Obtain the complement version information of each node of big data platform to be checked；
Determine that the complement version information is consistent with default version；
Check item is obtained according to the complement version information；
It is determined according to the check item and checks template.
5. the big data platform configuration inspection method according to claim 3 or 4, which is characterized in that obtain to be checked
The complement version information of each node of big data platform includes：
Obtain the data information of each node of big data platform to be checked；
The complement version information of each node is obtained according to the data information.
6. big data platform configuration inspection method according to claim 5, which is characterized in that the data information includes IP
Address, login username and entry password.
7. a kind of big data platform configuration inspection device, which is characterized in that including：
First acquisition module, the component profile information of each node for obtaining big data platform to be checked；
First processing module, for carrying out comparison and generating configuration inspection knot the component profile information with template is checked
Fruit.
8. big data platform configuration inspection device according to claim 7, which is characterized in that the first acquisition module packet
It includes：
First acquisition unit, for obtaining one or more check item in the inspection template；
First processing units, for inquiring corresponding component profile information according to one or more of check items.
9. big data platform configuration inspection device according to claim 7, which is characterized in that further include：
Second acquisition module, the complement version information of each node for obtaining big data platform to be checked；
Second processing module, for determining that the complement version information is consistent with default version.
10. big data platform configuration inspection device according to claim 7, which is characterized in that further include：
Second acquisition module, the complement version information of each node for obtaining big data platform to be checked；
Second processing module, for determining that the complement version information is consistent with default version；
Third acquisition module, for obtaining check item according to the complement version information；
Third processing module checks template for being determined according to the check item.
11. the big data platform configuration inspection device according to claim 9 or 10, which is characterized in that described second obtains
Modulus block includes：
Second acquisition unit, the data information of each node for obtaining big data platform to be checked；
Second processing unit, the complement version information for obtaining each node according to the data information.
12. a kind of terminal, which is characterized in that including：At least one processor, and connect at least one processor communication
The memory connect, wherein the memory is stored with the instruction that can be executed by least one processor, and described instruction is by institute
It states at least one processor to execute, so that big described in any at least one processor execution the claims 1-6
Data platform configuration inspection method.
13. a kind of computer readable storage medium, which is characterized in that the computer-readable recording medium storage has computer to refer to
It enables, the computer instruction is used to make any big data platform in the computer execution the claims 1-6 to match
Set inspection method.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201810294547.5A CN108536485A (en) | 2018-03-30 | 2018-03-30 | Big data platform configuration inspection method, apparatus, terminal and readable storage medium storing program for executing |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201810294547.5A CN108536485A (en) | 2018-03-30 | 2018-03-30 | Big data platform configuration inspection method, apparatus, terminal and readable storage medium storing program for executing |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN108536485A true CN108536485A (en) | 2018-09-14 |
Family
ID=63482416
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201810294547.5A Pending CN108536485A (en) | 2018-03-30 | 2018-03-30 | Big data platform configuration inspection method, apparatus, terminal and readable storage medium storing program for executing |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN108536485A (en) |
Cited By (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN110880990A (en) * | 2019-11-29 | 2020-03-13 | 北京神州绿盟信息安全科技股份有限公司 | Configuration checking method and device for big data cluster component and computing equipment |
| CN111782607A (en) * | 2020-07-13 | 2020-10-16 | 网易（杭州）网络有限公司 | Method and device for processing combined graph, storage medium and electronic device |
| CN112241353A (en) * | 2019-07-16 | 2021-01-19 | 腾讯科技（深圳）有限公司 | Running state checking method and device, terminal and storage medium |
| CN113824717A (en) * | 2021-09-18 | 2021-12-21 | 北京天融信网络安全技术有限公司 | Configuration checking method and device |
| CN114070737A (en) * | 2021-11-26 | 2022-02-18 | 中国工商银行股份有限公司 | Method and device for checking configuration data of equipment, storage medium and electronic equipment |
Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US7568183B1 (en) * | 2005-01-21 | 2009-07-28 | Microsoft Corporation | System and method for automation testing and validation |
| CN101968765A (en) * | 2010-09-21 | 2011-02-09 | 北京航空航天大学 | Software version detection method of large sized weaponry informatization system |
| CN105975284A (en) * | 2016-05-31 | 2016-09-28 | 京东方科技集团股份有限公司 | Automatic software version checking device and method |
| CN106407125A (en) * | 2016-11-15 | 2017-02-15 | 中国银行股份有限公司 | Mainframe environment detection method and device |
-
2018
- 2018-03-30 CN CN201810294547.5A patent/CN108536485A/en active Pending
Patent Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US7568183B1 (en) * | 2005-01-21 | 2009-07-28 | Microsoft Corporation | System and method for automation testing and validation |
| CN101968765A (en) * | 2010-09-21 | 2011-02-09 | 北京航空航天大学 | Software version detection method of large sized weaponry informatization system |
| CN105975284A (en) * | 2016-05-31 | 2016-09-28 | 京东方科技集团股份有限公司 | Automatic software version checking device and method |
| CN106407125A (en) * | 2016-11-15 | 2017-02-15 | 中国银行股份有限公司 | Mainframe environment detection method and device |
Non-Patent Citations (1)
| Title |
|---|
| 王琨等: ""大数据组件安全基线自动化检查"", 《网络安全和信息化》 * |
Cited By (10)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN112241353A (en) * | 2019-07-16 | 2021-01-19 | 腾讯科技（深圳）有限公司 | Running state checking method and device, terminal and storage medium |
| CN112241353B (en) * | 2019-07-16 | 2023-10-13 | 腾讯科技（深圳）有限公司 | Method, device, terminal and storage medium for checking running state |
| CN110880990A (en) * | 2019-11-29 | 2020-03-13 | 北京神州绿盟信息安全科技股份有限公司 | Configuration checking method and device for big data cluster component and computing equipment |
| CN110880990B (en) * | 2019-11-29 | 2022-08-23 | 绿盟科技集团股份有限公司 | Configuration checking method and device for big data cluster component and computing equipment |
| CN111782607A (en) * | 2020-07-13 | 2020-10-16 | 网易（杭州）网络有限公司 | Method and device for processing combined graph, storage medium and electronic device |
| CN111782607B (en) * | 2020-07-13 | 2024-03-22 | 网易（杭州）网络有限公司 | Method and device for processing graphics, storage medium and electronic device |
| CN113824717A (en) * | 2021-09-18 | 2021-12-21 | 北京天融信网络安全技术有限公司 | Configuration checking method and device |
| CN113824717B (en) * | 2021-09-18 | 2023-04-18 | 北京天融信网络安全技术有限公司 | Configuration checking method and device |
| CN114070737A (en) * | 2021-11-26 | 2022-02-18 | 中国工商银行股份有限公司 | Method and device for checking configuration data of equipment, storage medium and electronic equipment |
| CN114070737B (en) * | 2021-11-26 | 2024-03-08 | 中国工商银行股份有限公司 | Method and device for checking configuration data of equipment, storage medium and electronic equipment |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN108536485A (en) | Big data platform configuration inspection method, apparatus, terminal and readable storage medium storing program for executing | |
| US10616237B2 (en) | Trust relationships in a computerized system | |
| CN106936817B (en) | Operation execution method, board jump machine, cluster authentication server and bastion machine system | |
| US20180115538A1 (en) | Methods And Apparatus For Recording A Change Of Authorisation State Of One Or More Authorisation Agents | |
| US10140453B1 (en) | Vulnerability management using taxonomy-based normalization | |
| US8978134B2 (en) | Security configuration verification device and method and network system employing the same | |
| WO2020259268A1 (en) | Information sharing method, platform, and computing device | |
| US7925747B2 (en) | System and method for sharing web performance monitoring data | |
| CN104506351B (en) | On-line Full configuration compliance method for auditing safely and system | |
| KR102545124B1 (en) | Automated Packetless Network Reachability Analysis | |
| CN102045337A (en) | Apparatus and methods for managing network resources | |
| US9292706B2 (en) | Customer data management for data analytics outsourcing | |
| US10951657B2 (en) | Systems and methods for authenticating platform trust in a network function virtualization environment | |
| CN110336675B (en) | Monitoring method and device for digital certificate expiration date | |
| US11245577B2 (en) | Template-based onboarding of internet-connectible devices | |
| CN110232068A (en) | Data sharing method and device | |
| CN116074843A (en) | Zero trust security trusted audit method for 5G dual-domain private network | |
| CN106302479B (en) | A kind of single-point logging method and system for multi-service internet site | |
| JP2021077941A (en) | Generation device, generation method, and verification device | |
| CN116455869A (en) | Method and system for efficiently configuring public network domain name based on Kubernetes | |
| US11880717B1 (en) | Methods and apparatus for a multi-tenant computer system for producing service results by matching and resolving conflicts of service requests from client compute devices | |
| Wallace et al. | Practical and secure trust anchor management and usage | |
| EP4362413A1 (en) | Diagnostic device and diagnosis method | |
| CN117319021A (en) | Authorization method, device and equipment for container cloud platform built based on k8s | |
| CN113435914A (en) | Asset authentication method, storage medium and system based on block chain data structure |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| RJ01 | Rejection of invention patent application after publication | ||
| RJ01 | Rejection of invention patent application after publication |
Application publication date: 20180914 |