CN117544762A - Project supervision method and system based on big data analysis - Google Patents
Project supervision method and system based on big data analysis Download PDFInfo
- Publication number
- CN117544762A CN117544762A CN202311548704.8A CN202311548704A CN117544762A CN 117544762 A CN117544762 A CN 117544762A CN 202311548704 A CN202311548704 A CN 202311548704A CN 117544762 A CN117544762 A CN 117544762A
- Authority
- CN
- China
- Prior art keywords
- single server
- server
- video information
- preset
- analysis module
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
- 238000000034 method Methods 0.000 title claims abstract description 33
- 238000007405 data analysis Methods 0.000 title claims abstract description 22
- 238000004458 analytical method Methods 0.000 claims description 116
- 238000012545 processing Methods 0.000 claims description 56
- 230000005540 biological transmission Effects 0.000 claims description 25
- 230000005484 gravity Effects 0.000 claims description 12
- 230000008569 process Effects 0.000 claims description 9
- 230000005856 abnormality Effects 0.000 claims description 8
- 230000001105 regulatory effect Effects 0.000 claims description 7
- 230000003068 static effect Effects 0.000 claims description 3
- 230000004048 modification Effects 0.000 description 4
- 238000012986 modification Methods 0.000 description 4
- 238000012544 monitoring process Methods 0.000 description 3
- 238000010586 diagram Methods 0.000 description 2
- 230000004044 response Effects 0.000 description 2
- 238000006467 substitution reaction Methods 0.000 description 2
- 230000002159 abnormal effect Effects 0.000 description 1
- 238000004891 communication Methods 0.000 description 1
- 238000010276 construction Methods 0.000 description 1
- 238000005516 engineering process Methods 0.000 description 1
- 230000006872 improvement Effects 0.000 description 1
- 230000002265 prevention Effects 0.000 description 1
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N17/00—Diagnosis, testing or measuring for television systems or their details
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/20—Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
- H04N21/23—Processing of content or additional data; Elementary server operations; Server middleware
- H04N21/234—Processing of video elementary streams, e.g. splicing of video streams, manipulating MPEG-4 scene graphs
- H04N21/2343—Processing of video elementary streams, e.g. splicing of video streams, manipulating MPEG-4 scene graphs involving reformatting operations of video signals for distribution or compliance with end-user requests or end-user device requirements
- H04N21/234363—Processing of video elementary streams, e.g. splicing of video streams, manipulating MPEG-4 scene graphs involving reformatting operations of video signals for distribution or compliance with end-user requests or end-user device requirements by altering the spatial resolution, e.g. for clients with a lower screen resolution
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/20—Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
- H04N21/23—Processing of content or additional data; Elementary server operations; Server middleware
- H04N21/24—Monitoring of processes or resources, e.g. monitoring of server load, available bandwidth, upstream requests
- H04N21/2405—Monitoring of the internal components or processes of the server, e.g. server load
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N7/00—Television systems
- H04N7/18—Closed-circuit television [CCTV] systems, i.e. systems in which the video signal is not broadcast
Abstract
The invention relates to the technical field of project supervision, in particular to a project supervision method and a system based on big data analysis.
Description
Technical Field
The invention relates to the technical field of project supervision, in particular to a project supervision method and system based on big data analysis.
Background
Video monitoring is used as a widely used technical precaution means and plays an increasingly important role in the construction of urban social security comprehensive prevention and control systems.
The public safety level can be effectively improved through project supervision maintained by the public safety video management system.
The video data of the public places are collected and managed through the monitoring cameras and other devices, so that the actual conditions of the public places can be known, and the public safety is improved: video data may provide strong evidence that helps to provide important information and data support for the user.
CN114938269a discloses a public safety video monitoring digital asset key hosting method and system, the method comprises: receiving digital asset information of a hosting device input by a user; based on an initial user name and an initial password of the hosting device, scanning the hosting device by adopting a network fingerprint identification technology based on active scanning, sending a data packet to obtain response data of the hosting device, and identifying the hosting device according to a matching result of a characteristic field in the response data and the fingerprint of the hosting device stored in a device fingerprint library; respectively establishing a key management capability pool aiming at different types, manufacturers and models of managed devices; generating a random password according to a rule preset by a user, and adapting a corresponding key escrow interface in a key management capability pool to modify the password of the escrow device into the random password; providing a random password to a user when a key inquiry instruction of the user is received; it follows that the prior art has the following problems: the method and the device have the advantages that the storage address of the video information is not considered to be determined, the storage definition of the video is not considered to be determined according to the actual retrieving condition of the video information, the efficiency of the user for acquiring the video information is affected, the video information with too long storage time is not considered to be processed, the operation parameters of the server are not considered to be adjusted according to the acquiring condition of the video by the server, the safety of video information transmission is affected, and the storage efficiency of the video information is further affected.
Disclosure of Invention
Therefore, the invention provides a project supervision method and system for big data analysis, which are used for solving the problems that in the prior art, the storage address of video information is not considered to be determined, the storage definition of video is not considered to be determined according to the actual retrieval condition of the video information, the efficiency of the video information acquisition of a user is influenced, the processing of the video information with too long storage time is not considered, the operation parameters of a server are not considered to be adjusted according to the acquisition condition of the video by the server, the transmission safety of the video information is influenced, and the storage efficiency of the video information is further influenced.
On one hand, the invention provides a project supervision method and system for big data analysis, comprising the following steps:
each server periodically receives and stores video information in each corresponding region respectively, and an analysis module judges whether the running state of the single server accords with a preset standard according to the downloading rate of the video information by the single server;
when the running state of the single server is judged to be not in accordance with the preset standard, the alarm module is controlled to send alarm information aiming at network abnormality according to the obtained speed difference value between the average value of the downloading speeds of the servers and the downloading speed of the single server, or the data processing amount aiming at the single server is determined according to the data amount of the video information obtained by the single server in the last transmission period so as to process the video information in the single server;
When the running state of the single server is judged to be in accordance with a preset standard, the storage definition of the video information of each area corresponding to the server is adjusted to a corresponding value according to the acquired calling frequency of the video information of the single server;
when the operation state of the single server is primarily judged to meet the preset standard, whether the operation state of the single server meets the preset standard or not is secondarily judged according to the memory ratio of the residual memory of the single server to the total memory, so as to judge whether the storage definition of the video information of each corresponding area of the single server is regulated or not;
when the adjustment of the storage definition of the video information is completed, determining whether to adjust the corresponding area of the single server according to the number proportion of the video information with the storage definition larger than the preset definition in the single server to the total number of the video information in the server;
when the operation state of the single server is secondarily judged to meet the preset standard, the single server is controlled to maintain the current operation parameters, or when the adjustment of the operation parameters of the single server is completed, the single server is controlled to operate by using the adjusted operation parameters.
Further, each server periodically receives and stores video information in each corresponding area, and the analysis module determines, according to the downloading rate of the video information by the single server, whether the running state of the single server meets a server determination mode of a preset standard, where:
the first server judging mode is that the analysis module judges that the running state of the single server does not accord with a preset standard, and determines a processing mode aiming at the single server according to the obtained speed difference value between the average value of the downloading speeds of the servers and the downloading speed of the single server; the first server judges that the downloading rate is smaller than or equal to a first preset rate;
the second server judging mode is that the analysis module preliminarily judges whether the running state of the single server accords with a preset standard, and judges whether the running state of the single server accords with the preset standard or not according to the memory ratio of the residual memory of the single server to the total memory; the second server judging mode meets the condition that the downloading rate is smaller than or equal to a second preset rate and larger than the first preset rate, and the first preset rate is smaller than the second preset rate;
The third server judging mode is that the analysis module judges that the running state of the single server accords with a preset standard, and the storage definition of the video information of each area corresponding to the single server is adjusted to a corresponding value according to the acquired calling frequency of the video information of the single server; the third server judges that the downloading rate is larger than a second preset rate;
the calling frequency is the ratio of the video information calling times of a single server in the preset history time to the preset history time.
Further, the analysis module determines, in the second server determination mode, whether the running state of the single server meets a server secondary determination mode of a preset standard according to a memory ratio of a remaining memory of the single server to a total memory, where:
the second judging mode of the first server is that the analysis module judges that the running state of the single server does not accord with a preset standard, and the data processing amount of the single server is determined according to the data amount of the video information acquired by the single server in the last transmission period; the second judging mode of the first server meets the condition that the memory duty ratio is smaller than or equal to a first preset duty ratio;
The second server secondary judgment mode is that the analysis module judges that the running state of a single server does not accord with a preset standard, and the storage definition of video information of each area corresponding to the server is adjusted to a corresponding value according to the difference value of the memory duty ratio and the first preset duty ratio; the second server secondary judgment mode meets the condition that the memory duty ratio is smaller than or equal to a second preset duty ratio and larger than the first preset duty ratio, and the first preset duty ratio is smaller than the second preset duty ratio;
the second judgment mode of the third server is that the analysis module judges that the running state of the single server accords with a preset standard, and controls the single server to maintain the running of the current running parameters; the second judgment mode of the third server meets the condition that the memory ratio is larger than the second preset ratio.
Further, the analysis module determines a processing mode for a single server according to a calculated speed difference value between an average value of download speeds of the servers and the download speed of the single server in the first server determination mode, wherein:
the first processing mode is that the analysis module controls the alarm module to send out alarm information aiming at network abnormality; the first processing mode meets the condition that the speed difference value is smaller than or equal to a preset speed difference value;
The second processing mode is that the analysis module determines the data processing amount aiming at the single server according to the data amount of the video information acquired by the single server in the last transmission period; the second processing mode satisfies that the speed difference is greater than the preset speed difference.
Further, the analysis module determines a data adjustment mode for the data processing amount of the single server based on the data amount of the video information acquired by the single server in the last transmission period, wherein:
the first data adjustment mode is that the analysis module uses a first preset data adjustment coefficient to adjust the data processing amount of a single server to a corresponding value; the first data adjustment mode satisfies that the data volume of video information acquired by a single server in the last transmission period is smaller than or equal to the first data volume;
the second data adjustment mode is that the analysis module uses a second preset data adjustment coefficient to adjust the data processing amount of the single server to a corresponding value; the second data adjustment mode satisfies that the data volume of video information acquired by a single server in the last transmission period is smaller than or equal to the second data volume and larger than the first data volume, and the first data volume is smaller than the second data volume;
The third data adjustment mode is that the analysis module uses a third preset data adjustment coefficient to adjust the data processing amount of the single server to a corresponding value; the third data adjustment mode satisfies that the data volume of video information acquired by a single server in the last transmission period is larger than the second data volume;
the analysis module selects video information of corresponding data processing capacity in a single server to process under the condition of completing the determination of the data processing capacity;
the processing process of the single video information is to acquire the characteristics of each article in the video information, divide the video information into a plurality of time periods, and delete the video information of the single time period for the single time period if the characteristics of each article are continuously static;
if the object features run in a single time period, the server acquires the running track of the moving object features, and the server deletes the video information in the single time period when the moving object features are continuously in the video information; if there are video frames within a single time period that do not contain the running item feature, the server retains the video information for that time period.
Further, the analysis module determines a storage adjustment mode of the storage definition of the video information of each area corresponding to the single server according to the acquired retrieval frequency of the video information of the single server in the third server determination mode, wherein:
The first storage adjustment mode is that the analysis module uses a first preset storage adjustment coefficient to adjust the storage definition of video information of each area corresponding to a single server to a corresponding value; the first storage adjustment mode meets the condition that the retrieval frequency of video information of a single server is smaller than or equal to a first preset retrieval frequency;
the second storage adjustment mode is that the analysis module uses a second preset storage adjustment coefficient to adjust the storage definition of the video information of each area corresponding to the single server to a corresponding value; the second storage adjustment mode satisfies that the calling frequency of the video information of the single server is smaller than or equal to a second preset calling frequency and larger than the first preset calling frequency, and the first preset calling frequency is smaller than the second preset calling frequency;
the third storage adjustment mode is that the analysis module uses a third preset storage adjustment coefficient to adjust the storage definition of the video information of each area corresponding to the single server to a corresponding value; the third storage adjustment mode satisfies that the retrieval frequency of the video information of the single server is larger than the second preset retrieval frequency;
when the analysis module completes the heightening of the storage definition, the adjusted storage definition is compared with the maximum storage definition, and if the adjusted storage definition is larger than the maximum storage definition, the analysis module takes the maximum definition as the operation parameter of a single server; if the adjusted storage definition is smaller than or equal to the maximum storage definition, the analysis module takes the adjusted storage definition as an operation parameter of a single server;
The maximum definition is selected according to the storage definition of the video, which is common in the field in big data.
Further, the analysis module determines, according to the calculated duty ratio difference between the memory duty ratio and the first preset duty ratio, an adjustment mode of storage definition of video information of each area corresponding to a single server in the second server secondary judgment mode, where:
the first definition adjusting mode is that the analysis module uses a first preset adjusting coefficient to adjust the storage definition of the video information of each area corresponding to the single server to a corresponding value; the first definition adjusting mode meets the condition that the duty ratio difference is smaller than or equal to a first preset duty ratio difference;
the second definition adjusting mode is that the analysis module uses a second preset adjusting coefficient to adjust the storage definition of the video information of each area corresponding to the single server to a corresponding value; the second definition adjusting mode meets the condition that the duty ratio difference is smaller than or equal to a second preset duty ratio difference and larger than the first preset duty ratio difference, and the first preset duty ratio difference is smaller than the second preset duty ratio difference;
the third definition adjusting mode is that the analysis module uses a third preset adjusting coefficient to adjust the storage definition of the video information of each area corresponding to the single server to a corresponding value; the third sharpness adjustment mode satisfies that the duty ratio difference is larger than the second preset duty ratio difference.
Further, when the analysis module completes the adjustment of the storage definition of the video information, determining whether to adjust the area corresponding to the single server according to the proportion of the number of the video information with the storage definition larger than the preset definition in the single server to the total number of the video information in the server,
if the number specific gravity is smaller than or equal to the preset number specific gravity, the analysis module controls the server to continuously operate by using the current operation parameters;
and if the number specific gravity is greater than the preset number specific gravity, the analysis module adjusts the corresponding area of the single server according to the retrieval frequency of the video information of the corresponding areas in the server.
Further, the analysis module adjusts the corresponding areas of the single server based on the calling frequency of the video information of the corresponding areas in the server, and the analysis module respectively obtains the area calling frequency of each area in the single server so as to take the area with the area calling frequency lower than the preset frequency as the corresponding area of the coordination server;
the analysis module ranks the remaining memory of each server in descending order to mark the server with the largest remaining memory as a coordination server.
On the other hand, the invention also provides an item supervision system using the item supervision method of big data analysis, which comprises,
The data processing module is used for dividing the area to be monitored into a plurality of areas;
the video acquisition module comprises a plurality of monitors which are respectively distributed in each region and used for respectively acquiring video information of each region;
the receiving module comprises a plurality of servers for respectively receiving video information in the corresponding areas;
the analysis module is respectively connected with the data processing module, the video acquisition module and the server group and is used for judging whether the running state of the single server accords with a preset standard according to the downloading rate of the video information of the single server, and when the running state of the single server is primarily judged to accord with the preset standard, the secondary judgment is carried out on whether the running state of the single server accords with the preset standard according to the memory proportion of the total memory of the residual memory of the single server so as to judge whether the storage definition of the video information of each corresponding area of the single server is regulated;
and the alarm module is connected with the analysis module and used for sending out corresponding alarm information according to the judgment result of the analysis module.
Compared with the prior art, the analysis module judges whether the running state of the single server accords with the preset standard according to the downloading rate of the single server to ensure that the video information is stored in the corresponding server, and when the downloading rate is too low, the analysis module acquires the downloading rate of other servers to send out alarm information of network abnormality when the downloading rate of each server is generally too low, and alarms when the running of the servers is abnormal in time, so that the probability of loss of the video information due to the downloading abnormality is reduced; when the downloading rate of only a small number of servers is too low, deleting the video information of a single server to improve the downloading rate of the server, and further effectively improving the storage efficiency of the video information.
Further, when the downloading rate of the single server is slower, whether the running state of the single server accords with a preset standard is judged for the second time according to the memory ratio of the residual memory of the single server to the total memory, so that the storage definition of video information of each area corresponding to the single server is reduced when the memory ratio is higher, the running parameters of the server are regulated according to the video acquisition condition of the server, the safety of video information transmission is effectively improved, and the storage efficiency of the video information is further effectively improved.
Further, when the running state of the single server is judged to be in accordance with the preset standard, the storage definition of the video is determined according to the actual retrieving condition of the video information, so that the efficiency of acquiring the video information by a user is effectively improved, and the storage efficiency of the video information is further effectively improved.
Further, when the adjustment of the storage definition of the video information is completed, the areas with the area calling frequency lower than the preset frequency in the server are coordinated to the coordination server for the servers with higher storage definition of the video information, the storage addresses of the video information are determined, the efficiency of the user for acquiring the video information is improved, the corresponding areas of the servers are coordinated according to the actual calling condition of the video information, and the storage efficiency of the video information is further effectively improved.
Further, the data processing amount of the single server is determined according to the data amount of the video information acquired by the single server in the last transmission period, and the video information with too long storage time is processed, so that the storage efficiency of the video information is further effectively improved.
Drawings
FIG. 1 is a flow chart of steps of a project supervision method based on big data analysis according to an embodiment of the invention;
FIG. 2 is a block diagram of a project supervision system based on big data analysis according to an embodiment of the invention;
FIG. 3 is a flowchart of a server determination mode in which an analysis module determines whether an operation state of a single server meets a preset standard according to a downloading rate of video information by the single server;
fig. 4 is a flowchart of a server secondary judgment mode in which an analysis module determines whether an operation state of a single server meets a preset standard according to a memory ratio of a remaining memory of the single server to a total memory.
Detailed Description
In order that the objects and advantages of the invention will become more apparent, the invention will be further described with reference to the following examples; it should be understood that the specific embodiments described herein are for purposes of illustration only and are not intended to limit the scope of the invention.
Preferred embodiments of the present invention are described below with reference to the accompanying drawings. It should be understood by those skilled in the art that these embodiments are merely for explaining the technical principles of the present invention, and are not intended to limit the scope of the present invention.
It should be noted that, in the description of the present invention, terms such as "upper," "lower," "left," "right," "inner," "outer," and the like indicate directions or positional relationships based on the directions or positional relationships shown in the drawings, which are merely for convenience of description, and do not indicate or imply that the apparatus or elements must have a specific orientation, be constructed and operated in a specific orientation, and thus should not be construed as limiting the present invention.
Furthermore, it should be noted that, in the description of the present invention, unless explicitly specified and limited otherwise, the terms "mounted," "connected," and "connected" are to be construed broadly, and may be either fixedly connected, detachably connected, or integrally connected, for example; can be mechanically or electrically connected; can be directly connected or indirectly connected through an intermediate medium, and can be communication between two elements. The specific meaning of the above terms in the present invention can be understood by those skilled in the art according to the specific circumstances.
Referring to fig. 1, fig. 2, fig. 3, and fig. 4, which are respectively a step flowchart of an item supervision method based on big data analysis, a block diagram of an item supervision system, an analysis module, a server judgment mode flowchart of determining whether an operation state of a single server meets a preset standard according to a downloading rate of the single server to video information, and a server secondary judgment mode flowchart of determining whether the operation state of the single server meets the preset standard according to a memory ratio of a remaining memory of the single server to a total memory; the embodiment of the invention discloses a project supervision method and a system based on big data analysis, comprising the following steps:
each server periodically receives and stores video information in each corresponding region respectively, and an analysis module judges whether the running state of the single server accords with a preset standard according to the downloading rate of the video information by the single server;
when the running state of the single server is judged to be not in accordance with the preset standard, the alarm module is controlled to send alarm information aiming at network abnormality according to the obtained speed difference value between the average value of the downloading speeds of the servers and the downloading speed of the single server, or the data processing amount aiming at the single server is determined according to the data amount of the video information obtained by the single server in the last transmission period so as to process the video information in the single server;
When the running state of the single server is judged to be in accordance with a preset standard, the storage definition of the video information of each area corresponding to the server is adjusted to a corresponding value according to the acquired calling frequency of the video information of the single server;
when the operation state of the single server is primarily judged to meet the preset standard, whether the operation state of the single server meets the preset standard or not is secondarily judged according to the memory ratio of the residual memory of the single server to the total memory, so as to judge whether the storage definition of the video information of each corresponding area of the single server is regulated or not;
when the adjustment of the storage definition of the video information is completed, determining whether to adjust the corresponding area of the single server according to the number proportion of the video information with the storage definition larger than the preset definition in the single server to the total number of the video information in the server;
when the operation state of the single server is secondarily judged to meet the preset standard, the single server is controlled to maintain the current operation parameters, or when the adjustment of the operation parameters of the single server is completed, the single server is controlled to operate by using the adjusted operation parameters.
Specifically, each server periodically receives and stores video information in each corresponding area, and the analysis module determines, according to the downloading rate of the video information by the single server, whether the running state of the single server meets a server determination mode of a preset standard, where:
the first server judging mode is that the analysis module judges that the running state of the single server does not accord with a preset standard, and determines a processing mode aiming at the single server according to the obtained speed difference value between the average value of the downloading speeds of the servers and the downloading speed of the single server; the first server judges that the downloading rate is smaller than or equal to a first preset rate;
the second server judging mode is that the analysis module preliminarily judges whether the running state of the single server accords with a preset standard, and judges whether the running state of the single server accords with the preset standard or not according to the memory ratio of the residual memory of the single server to the total memory; the second server judging mode meets the condition that the downloading rate is smaller than or equal to a second preset rate and larger than the first preset rate, and the first preset rate is smaller than the second preset rate;
The third server judging mode is that the analysis module judges that the running state of the single server accords with a preset standard, and the storage definition of the video information of each area corresponding to the single server is adjusted to a corresponding value according to the acquired calling frequency of the video information of the single server; the third server judges that the downloading rate is larger than a second preset rate;
the calling frequency is the ratio of the video information calling times of a single server in the preset history time to the preset history time.
Specifically, the analysis module determines, in the second server determination manner, whether the running state of the single server meets a server secondary determination manner of a preset standard according to a memory ratio of a remaining memory of the single server to a total memory, where:
the second judging mode of the first server is that the analysis module judges that the running state of the single server does not accord with a preset standard, and the data processing amount of the single server is determined according to the data amount of the video information acquired by the single server in the last transmission period; the second judging mode of the first server meets the condition that the memory duty ratio is smaller than or equal to a first preset duty ratio;
The second server secondary judgment mode is that the analysis module judges that the running state of a single server does not accord with a preset standard, and the storage definition of video information of each area corresponding to the server is adjusted to a corresponding value according to the difference value of the memory duty ratio and the first preset duty ratio; the second server secondary judgment mode meets the condition that the memory duty ratio is smaller than or equal to a second preset duty ratio and larger than the first preset duty ratio, and the first preset duty ratio is smaller than the second preset duty ratio;
the second judgment mode of the third server is that the analysis module judges that the running state of the single server accords with a preset standard, and controls the single server to maintain the running of the current running parameters; the second judgment mode of the third server meets the condition that the memory ratio is larger than the second preset ratio.
Specifically, the analysis module determines a processing mode for a single server according to a calculated speed difference value between an average value of download speeds of the servers and the download speed of the single server in the first server determination mode, wherein:
the first processing mode is that the analysis module controls the alarm module to send out alarm information aiming at network abnormality; the first processing mode meets the condition that the speed difference value is smaller than or equal to a preset speed difference value;
The second processing mode is that the analysis module determines the data processing amount aiming at the single server according to the data amount of the video information acquired by the single server in the last transmission period; the second processing mode satisfies that the speed difference is greater than the preset speed difference.
Specifically, the analysis module determines a data adjustment mode for a data processing amount of the single server based on a data amount of video information acquired by the single server in a last transmission period, wherein:
the first data adjustment mode is that the analysis module uses a first preset data adjustment coefficient to adjust the data processing amount of a single server to a corresponding value; the first data adjustment mode satisfies that the data volume of video information acquired by a single server in the last transmission period is smaller than or equal to the first data volume;
the second data adjustment mode is that the analysis module uses a second preset data adjustment coefficient to adjust the data processing amount of the single server to a corresponding value; the second data adjustment mode satisfies that the data volume of video information acquired by a single server in the last transmission period is smaller than or equal to the second data volume and larger than the first data volume, and the first data volume is smaller than the second data volume;
The third data adjustment mode is that the analysis module uses a third preset data adjustment coefficient to adjust the data processing amount of the single server to a corresponding value; the third data adjustment mode satisfies that the data volume of video information acquired by a single server in the last transmission period is larger than the second data volume;
the analysis module selects video information of corresponding data processing capacity in a single server to process under the condition of completing the determination of the data processing capacity;
the processing process of the single video information is to acquire the characteristics of each article in the video information, divide the video information into a plurality of time periods, and delete the video information of the single time period for the single time period if the characteristics of each article are continuously static;
if the object features run in a single time period, the server acquires the running track of the moving object features, and the server deletes the video information in the single time period when the moving object features are continuously in the video information; if there are video frames within a single time period that do not contain the running item feature, the server retains the video information for that time period.
Specifically, the analysis module determines a storage adjustment mode of storage definition of video information of each area corresponding to the single server according to the acquired retrieval frequency of the video information of the single server in the third server determination mode, wherein:
The first storage adjustment mode is that the analysis module uses a first preset storage adjustment coefficient to adjust the storage definition of video information of each area corresponding to a single server to a corresponding value; the first storage adjustment mode meets the condition that the retrieval frequency of video information of a single server is smaller than or equal to a first preset retrieval frequency;
the second storage adjustment mode is that the analysis module uses a second preset storage adjustment coefficient to adjust the storage definition of the video information of each area corresponding to the single server to a corresponding value; the second storage adjustment mode satisfies that the calling frequency of the video information of the single server is smaller than or equal to a second preset calling frequency and larger than the first preset calling frequency, and the first preset calling frequency is smaller than the second preset calling frequency;
the third storage adjustment mode is that the analysis module uses a third preset storage adjustment coefficient to adjust the storage definition of the video information of each area corresponding to the single server to a corresponding value; the third storage adjustment mode satisfies that the retrieval frequency of the video information of the single server is larger than the second preset retrieval frequency;
when the analysis module completes the heightening of the storage definition, the adjusted storage definition is compared with the maximum storage definition, and if the adjusted storage definition is larger than the maximum storage definition, the analysis module takes the maximum definition as the operation parameter of a single server; if the adjusted storage definition is smaller than or equal to the maximum storage definition, the analysis module takes the adjusted storage definition as an operation parameter of a single server;
The maximum definition is selected according to the storage definition of the video, which is common in the field in big data.
Specifically, the analysis module determines, in the second server secondary determination manner, a manner of adjusting storage sharpness of video information of each area corresponding to a single server according to a calculated duty ratio difference between the memory duty ratio and the first preset duty ratio, where:
the first definition adjusting mode is that the analysis module uses a first preset adjusting coefficient to adjust the storage definition of the video information of each area corresponding to the single server to a corresponding value; the first definition adjusting mode meets the condition that the duty ratio difference is smaller than or equal to a first preset duty ratio difference;
the second definition adjusting mode is that the analysis module uses a second preset adjusting coefficient to adjust the storage definition of the video information of each area corresponding to the single server to a corresponding value; the second definition adjusting mode meets the condition that the duty ratio difference is smaller than or equal to a second preset duty ratio difference and larger than the first preset duty ratio difference, and the first preset duty ratio difference is smaller than the second preset duty ratio difference;
the third definition adjusting mode is that the analysis module uses a third preset adjusting coefficient to adjust the storage definition of the video information of each area corresponding to the single server to a corresponding value; the third sharpness adjustment mode satisfies that the duty ratio difference is larger than the second preset duty ratio difference.
Specifically, when the analysis module completes the adjustment of the storage definition of the video information, determining whether to adjust the area corresponding to the single server according to the number proportion of the number of the video information with the storage definition larger than the preset definition in the single server to the total number of the video information in the server,
if the number specific gravity is smaller than or equal to the preset number specific gravity, the analysis module controls the server to continuously operate by using the current operation parameters;
and if the number specific gravity is greater than the preset number specific gravity, the analysis module adjusts the corresponding area of the single server according to the retrieval frequency of the video information of the corresponding areas in the server.
9. The method for project supervision based on big data analysis according to claim 8, wherein,
the analysis module adjusts the corresponding areas of the single server based on the calling frequency of the video information of the corresponding areas in the server, and the analysis module respectively obtains the area calling frequency of the areas in the single server so as to take the area with the area calling frequency lower than the preset frequency as the corresponding area of the coordination server;
the analysis module ranks the remaining memory of each server in descending order to mark the server with the largest remaining memory as a coordination server.
Specifically, the data processing module is used for dividing a region to be monitored into a plurality of areas;
the video acquisition module comprises a plurality of monitors which are respectively distributed in each region and used for respectively acquiring video information of each region;
the receiving module comprises a plurality of servers for respectively receiving video information in the corresponding areas;
the analysis module is respectively connected with the data processing module, the video acquisition module and the server group and is used for judging whether the running state of the single server accords with a preset standard according to the downloading rate of the video information of the single server, and when the running state of the single server is primarily judged to accord with the preset standard, the secondary judgment is carried out on whether the running state of the single server accords with the preset standard according to the memory proportion of the total memory of the residual memory of the single server so as to judge whether the storage definition of the video information of each corresponding area of the single server is regulated;
and the alarm module is connected with the analysis module and used for sending out corresponding alarm information according to the judgment result of the analysis module.
Thus far, the technical solution of the present invention has been described in connection with the preferred embodiments shown in the drawings, but it is easily understood by those skilled in the art that the scope of protection of the present invention is not limited to these specific embodiments. Equivalent modifications and substitutions for related technical features may be made by those skilled in the art without departing from the principles of the present invention, and such modifications and substitutions will be within the scope of the present invention.
The foregoing description is only of the preferred embodiments of the invention and is not intended to limit the invention; various modifications and variations of the present invention will be apparent to those skilled in the art. Any modification, equivalent replacement, improvement, etc. made within the spirit and principle of the present invention should be included in the protection scope of the present invention.
Claims (10)
1. The project supervision method based on big data analysis is characterized by comprising the following steps:
each server periodically receives and stores video information in each corresponding region respectively, and an analysis module judges whether the running state of the single server accords with a preset standard according to the downloading rate of the video information by the single server;
when the running state of the single server is judged to be not in accordance with the preset standard, the alarm module is controlled to send alarm information aiming at network abnormality according to the obtained speed difference value between the average value of the downloading speeds of the servers and the downloading speed of the single server, or the data processing amount aiming at the single server is determined according to the data amount of the video information obtained by the single server in the last transmission period so as to process the video information in the single server;
when the running state of the single server is judged to be in accordance with a preset standard, the storage definition of the video information of each area corresponding to the server is adjusted to a corresponding value according to the acquired calling frequency of the video information of the single server;
When the operation state of the single server is primarily judged to meet the preset standard, whether the operation state of the single server meets the preset standard or not is secondarily judged according to the memory ratio of the residual memory of the single server to the total memory, so as to judge whether the storage definition of the video information of each corresponding area of the single server is regulated or not;
when the adjustment of the storage definition of the video information is completed, determining whether to adjust the corresponding area of the single server according to the number proportion of the video information with the storage definition larger than the preset definition in the single server to the total number of the video information in the server;
when the operation state of the single server is secondarily judged to meet the preset standard, the single server is controlled to maintain the current operation parameters, or when the adjustment of the operation parameters of the single server is completed, the single server is controlled to operate by using the adjusted operation parameters.
2. The method for project supervision based on big data analysis according to claim 1, wherein,
each server periodically receives and stores video information in each corresponding area, and the analysis module determines whether the running state of the single server accords with a server judgment mode of a preset standard according to the downloading rate of the video information by the single server, wherein:
The first server judging mode is that the analysis module judges that the running state of the single server does not accord with a preset standard, and determines a processing mode aiming at the single server according to the obtained speed difference value between the average value of the downloading speeds of the servers and the downloading speed of the single server; the first server judges that the downloading rate is smaller than or equal to a first preset rate;
the second server judging mode is that the analysis module preliminarily judges whether the running state of the single server accords with a preset standard, and judges whether the running state of the single server accords with the preset standard or not according to the memory ratio of the residual memory of the single server to the total memory; the second server judging mode meets the condition that the downloading rate is smaller than or equal to a second preset rate and larger than the first preset rate, and the first preset rate is smaller than the second preset rate;
the third server judging mode is that the analysis module judges that the running state of the single server accords with a preset standard, and the storage definition of the video information of each area corresponding to the single server is adjusted to a corresponding value according to the acquired calling frequency of the video information of the single server; the third server judges that the downloading rate is larger than a second preset rate;
The calling frequency is the ratio of the video information calling times of a single server in the preset history time to the preset history time.
3. The method for project supervision based on big data analysis according to claim 2, wherein,
the analysis module determines whether the running state of the single server accords with a server secondary judgment mode of a preset standard according to the memory ratio of the residual memory of the single server to the total memory under the second server judgment mode, wherein:
the second judging mode of the first server is that the analysis module judges that the running state of the single server does not accord with a preset standard, and the data processing amount of the single server is determined according to the data amount of the video information acquired by the single server in the last transmission period; the second judging mode of the first server meets the condition that the memory duty ratio is smaller than or equal to a first preset duty ratio;
the second server secondary judgment mode is that the analysis module judges that the running state of a single server does not accord with a preset standard, and the storage definition of video information of each area corresponding to the server is adjusted to a corresponding value according to the difference value of the memory duty ratio and the first preset duty ratio; the second server secondary judgment mode meets the condition that the memory duty ratio is smaller than or equal to a second preset duty ratio and larger than the first preset duty ratio, and the first preset duty ratio is smaller than the second preset duty ratio;
The second judgment mode of the third server is that the analysis module judges that the running state of the single server accords with a preset standard, and controls the single server to maintain the running of the current running parameters; the second judgment mode of the third server meets the condition that the memory ratio is larger than the second preset ratio.
4. The method for project supervision based on big data analysis according to claim 3,
the analysis module determines a processing mode for a single server according to a calculated speed difference value between an average value of the download speeds of the servers and the download speed of the single server in the first server judging mode, wherein:
the first processing mode is that the analysis module controls the alarm module to send out alarm information aiming at network abnormality; the first processing mode meets the condition that the speed difference value is smaller than or equal to a preset speed difference value;
the second processing mode is that the analysis module determines the data processing amount aiming at the single server according to the data amount of the video information acquired by the single server in the last transmission period; the second processing mode satisfies that the speed difference is greater than the preset speed difference.
5. The method for project supervision based on big data analysis according to claim 4,
The analysis module determines a data adjustment mode of data processing amount of the single server based on the data amount of the video information acquired by the single server in the last transmission period, wherein:
the first data adjustment mode is that the analysis module uses a first preset data adjustment coefficient to adjust the data processing amount of a single server to a corresponding value; the first data adjustment mode satisfies that the data volume of video information acquired by a single server in the last transmission period is smaller than or equal to the first data volume;
the second data adjustment mode is that the analysis module uses a second preset data adjustment coefficient to adjust the data processing amount of the single server to a corresponding value; the second data adjustment mode satisfies that the data volume of video information acquired by a single server in the last transmission period is smaller than or equal to the second data volume and larger than the first data volume, and the first data volume is smaller than the second data volume;
the third data adjustment mode is that the analysis module uses a third preset data adjustment coefficient to adjust the data processing amount of the single server to a corresponding value; the third data adjustment mode satisfies that the data volume of video information acquired by a single server in the last transmission period is larger than the second data volume;
The analysis module selects video information of corresponding data processing capacity in a single server to process under the condition of completing the determination of the data processing capacity;
the processing process of the single video information is to acquire the characteristics of each article in the video information, divide the video information into a plurality of time periods, and delete the video information of the single time period for the single time period if the characteristics of each article are continuously static;
if the object features run in a single time period, the server acquires the running track of the moving object features, and the server deletes the video information in the single time period when the moving object features are continuously in the video information; if there are video frames within a single time period that do not contain the running item feature, the server retains the video information for that time period.
6. The method for project supervision based on big data analysis according to claim 5,
the analysis module determines a storage adjustment mode of storage definition of video information of each area corresponding to the single server according to the acquired retrieval frequency of the video information of the single server in the third server judgment mode, wherein:
The first storage adjustment mode is that the analysis module uses a first preset storage adjustment coefficient to adjust the storage definition of video information of each area corresponding to a single server to a corresponding value; the first storage adjustment mode meets the condition that the retrieval frequency of video information of a single server is smaller than or equal to a first preset retrieval frequency;
the second storage adjustment mode is that the analysis module uses a second preset storage adjustment coefficient to adjust the storage definition of the video information of each area corresponding to the single server to a corresponding value; the second storage adjustment mode satisfies that the calling frequency of the video information of the single server is smaller than or equal to a second preset calling frequency and larger than the first preset calling frequency, and the first preset calling frequency is smaller than the second preset calling frequency;
the third storage adjustment mode is that the analysis module uses a third preset storage adjustment coefficient to adjust the storage definition of the video information of each area corresponding to the single server to a corresponding value; the third storage adjustment mode satisfies that the retrieval frequency of the video information of the single server is larger than the second preset retrieval frequency;
when the analysis module completes the heightening of the storage definition, the adjusted storage definition is compared with the maximum storage definition, and if the adjusted storage definition is larger than the maximum storage definition, the analysis module takes the maximum definition as the operation parameter of a single server; if the adjusted storage definition is smaller than or equal to the maximum storage definition, the analysis module takes the adjusted storage definition as an operation parameter of a single server;
The maximum definition is selected according to the storage definition of the video, which is common in the field in big data.
7. The method for project supervision based on big data analysis according to claim 6, wherein,
the analysis module determines an adjustment mode of storage definition of video information of each area corresponding to a single server according to the calculated duty ratio difference between the memory duty ratio and the first preset duty ratio in the second server secondary judgment mode, wherein:
the first definition adjusting mode is that the analysis module uses a first preset adjusting coefficient to adjust the storage definition of the video information of each area corresponding to the single server to a corresponding value; the first definition adjusting mode meets the condition that the duty ratio difference is smaller than or equal to a first preset duty ratio difference;
the second definition adjusting mode is that the analysis module uses a second preset adjusting coefficient to adjust the storage definition of the video information of each area corresponding to the single server to a corresponding value; the second definition adjusting mode meets the condition that the duty ratio difference is smaller than or equal to a second preset duty ratio difference and larger than the first preset duty ratio difference, and the first preset duty ratio difference is smaller than the second preset duty ratio difference;
The third definition adjusting mode is that the analysis module uses a third preset adjusting coefficient to adjust the storage definition of the video information of each area corresponding to the single server to a corresponding value; the third sharpness adjustment mode satisfies that the duty ratio difference is larger than the second preset duty ratio difference.
8. The method for project supervision based on big data analysis according to claim 7,
the analysis module determines whether to adjust the area corresponding to the single server according to the number proportion of the video information with the storage definition larger than the preset definition in the single server to the total number of the video information in the server when the adjustment of the storage definition of the video information is completed,
if the number specific gravity is smaller than or equal to the preset number specific gravity, the analysis module controls the server to continuously operate by using the current operation parameters;
and if the number specific gravity is greater than the preset number specific gravity, the analysis module adjusts the corresponding area of the single server according to the retrieval frequency of the video information of the corresponding areas in the server.
9. The method for project supervision based on big data analysis according to claim 8, wherein,
the analysis module adjusts the corresponding areas of the single server based on the calling frequency of the video information of the corresponding areas in the server, and the analysis module respectively obtains the area calling frequency of the areas in the single server so as to take the area with the area calling frequency lower than the preset frequency as the corresponding area of the coordination server;
The analysis module ranks the remaining memory of each server in descending order to mark the server with the largest remaining memory as a coordination server.
10. An item administration system using the item administration method based on big data analysis as claimed in any one of claims 1 to 9, comprising,
the data processing module is used for dividing the area to be monitored into a plurality of areas;
the video acquisition module comprises a plurality of monitors which are respectively distributed in each region and used for respectively acquiring video information of each region;
the receiving module comprises a plurality of servers for respectively receiving video information in the corresponding areas;
the analysis module is respectively connected with the data processing module, the video acquisition module and the server group and is used for judging whether the running state of the single server accords with a preset standard according to the downloading rate of the video information of the single server, and when the running state of the single server is primarily judged to accord with the preset standard, the secondary judgment is carried out on whether the running state of the single server accords with the preset standard according to the memory proportion of the total memory of the residual memory of the single server so as to judge whether the storage definition of the video information of each corresponding area of the single server is regulated;
And the alarm module is connected with the analysis module and used for sending out corresponding alarm information according to the judgment result of the analysis module.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202311548704.8A CN117544762B (en) | 2023-11-17 | 2023-11-17 | Project supervision method and system based on big data analysis |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202311548704.8A CN117544762B (en) | 2023-11-17 | 2023-11-17 | Project supervision method and system based on big data analysis |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN117544762A true CN117544762A (en) | 2024-02-09 |
| CN117544762B CN117544762B (en) | 2024-04-19 |
Family
ID=89791325
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202311548704.8A Active CN117544762B (en) | 2023-11-17 | 2023-11-17 | Project supervision method and system based on big data analysis |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN117544762B (en) |
Citations (12)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| JP2003331030A (en) * | 2002-05-14 | 2003-11-21 | Yamaha Corp | Hall management support system |
| US20110277009A1 (en) * | 2008-10-09 | 2011-11-10 | Telefonaktiebolaget L M Ericsson (Publ) | Supporting Functions for Quality-Assured P2P VOD Services |
| CN103368755A (en) * | 2012-03-30 | 2013-10-23 | 富泰华工业（深圳）有限公司 | A far-end server operation management system and management method |
| CN105120159A (en) * | 2015-08-26 | 2015-12-02 | 北京奇虎科技有限公司 | Method for obtaining pictures via remote control and server |
| CN105245607A (en) * | 2015-10-23 | 2016-01-13 | 中国联合网络通信集团有限公司 | Proxy server dynamic automatic selection method and system |
| CN105607924A (en) * | 2015-12-16 | 2016-05-25 | 天脉聚源(北京)传媒科技有限公司 | Download management method and apparatus |
| CN108184149A (en) * | 2017-12-29 | 2018-06-19 | 北京奇艺世纪科技有限公司 | A kind of video CD N method for optimizing scheduling and device |
| CN110149366A (en) * | 2019-04-16 | 2019-08-20 | 平安科技（深圳）有限公司 | Improve the method, apparatus and computer equipment of group system availability |
| CN113014969A (en) * | 2019-12-19 | 2021-06-22 | 华为技术有限公司 | Video playing control method, terminal device, server and storage medium |
| CN114745572A (en) * | 2022-04-14 | 2022-07-12 | 中国联合网络通信集团有限公司 | Video cache control method, device, equipment and storage medium |
| CN114846810A (en) * | 2019-12-31 | 2022-08-02 | 华为技术有限公司 | Communication method and device |
| CN116668325A (en) * | 2023-05-30 | 2023-08-29 | 广州银汉科技有限公司 | Game data middle station application system based on one-stop service |
-
2023
- 2023-11-17 CN CN202311548704.8A patent/CN117544762B/en active Active
Patent Citations (12)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| JP2003331030A (en) * | 2002-05-14 | 2003-11-21 | Yamaha Corp | Hall management support system |
| US20110277009A1 (en) * | 2008-10-09 | 2011-11-10 | Telefonaktiebolaget L M Ericsson (Publ) | Supporting Functions for Quality-Assured P2P VOD Services |
| CN103368755A (en) * | 2012-03-30 | 2013-10-23 | 富泰华工业（深圳）有限公司 | A far-end server operation management system and management method |
| CN105120159A (en) * | 2015-08-26 | 2015-12-02 | 北京奇虎科技有限公司 | Method for obtaining pictures via remote control and server |
| CN105245607A (en) * | 2015-10-23 | 2016-01-13 | 中国联合网络通信集团有限公司 | Proxy server dynamic automatic selection method and system |
| CN105607924A (en) * | 2015-12-16 | 2016-05-25 | 天脉聚源(北京)传媒科技有限公司 | Download management method and apparatus |
| CN108184149A (en) * | 2017-12-29 | 2018-06-19 | 北京奇艺世纪科技有限公司 | A kind of video CD N method for optimizing scheduling and device |
| CN110149366A (en) * | 2019-04-16 | 2019-08-20 | 平安科技（深圳）有限公司 | Improve the method, apparatus and computer equipment of group system availability |
| CN113014969A (en) * | 2019-12-19 | 2021-06-22 | 华为技术有限公司 | Video playing control method, terminal device, server and storage medium |
| CN114846810A (en) * | 2019-12-31 | 2022-08-02 | 华为技术有限公司 | Communication method and device |
| CN114745572A (en) * | 2022-04-14 | 2022-07-12 | 中国联合网络通信集团有限公司 | Video cache control method, device, equipment and storage medium |
| CN116668325A (en) * | 2023-05-30 | 2023-08-29 | 广州银汉科技有限公司 | Game data middle station application system based on one-stop service |
Also Published As
| Publication number | Publication date |
|---|---|
| CN117544762B (en) | 2024-04-19 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| KR102418969B1 (en) | System and method for predicting communication apparatuses failure based on deep learning | |
| CN110892675B (en) | Method and apparatus for monitoring block chains | |
| EP3843451B1 (en) | Method and apparatus for adjusting bandwidth, communication device and computer readable storage medium | |
| CN117544762B (en) | Project supervision method and system based on big data analysis | |
| CN112969172B (en) | Communication flow control method based on cloud mobile phone | |
| CN116489019B (en) | Intelligent visual signaling channel management method, system and medium | |
| CN113572757A (en) | Server access risk monitoring method and device | |
| CN101695049A (en) | Method and device for processing businesses in monitoring system | |
| CN113709083A (en) | Network attack detection control method, device, base station and computer storage medium | |
| CN112995266A (en) | Information pushing method and related equipment | |
| CN113709153B (en) | Log merging method and device and electronic equipment | |
| CN113179536B (en) | Traffic control method and system based on NB-IoT narrowband communication technology | |
| CN111294553B (en) | Method, device, equipment and storage medium for processing video monitoring service signaling | |
| CN113971093A (en) | Message processing method, device, equipment and computer storage medium | |
| CN112004161A (en) | Processing method and device of address resources, terminal equipment and storage medium | |
| CN112600683B (en) | Cloud conference signaling control method and system and readable storage medium | |
| CN116095683B (en) | Network security protection method and device for wireless router | |
| KR100950734B1 (en) | Automatic Recognition Method of Abnormal Status at Home Surveillance System and Internet Refrigerator | |
| CN112738093B (en) | Multi-platform selection communication system of anti-theft lock | |
| CN112615794B (en) | Intelligent acceleration system and method for service flow characteristics | |
| CN110022301A (en) | Firewall is used in internet of things equipment protection | |
| CN115248809B (en) | User communication data management method based on edge calculation | |
| EP1299973A1 (en) | Technique for monitoring a network using dynamic rule-based logic | |
| CN113347212B (en) | Trusted service scheduling method, device, equipment and storage medium based on block chain | |
| CN113259413B (en) | CDN scheduling method, scheduling system and storage medium |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |